Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/1eaf926f2c61b4a5cd35cca551246c020a60ad78 (+ 285 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--llvm-arm-master-Oz_LTO-build/84/
View Options
Report
Filter

llvm-arm-master-Oz_LTO test results

Run Order Start Time Duration
Current 0084 (llvmorg-18-init-11467-g1eaf926f2c61) 2023-11-07T07:14:01 0:00:00
Previous 0083 (llvmorg-18-init-11182-g1f21e49870fe) 2023-11-02T12:06:46 0:00:00
Baseline 0001 (llvmorg-16-init-17036-g4f40923103d2) 2023-01-06T17:55:45 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 22 24
Performance Improvements 71 113
Added Tests 10 10
Unchanged Tests 677 633
Total Tests 780

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
462.libquantum 2.15% 186.000 190.000 - -98.68% -
429.mcf 1.76% 1134.000 1154.000 - -91.75% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
462.libquantum (max) 100.00% 2.000 4.000 - -99.56% -
462.libquantum (unexplained diff vs previous) 100.00% 2.000 4.000 - 300.00% -
462.libquantum (unexplained diff vs previous) (percentage) 95.37% 1.080 2.110 - 21000.00% -
462.libquantum (max) (percentage) 65.38% 1.300 2.150 - -66.30% -
429.mcf (max) 53.85% 13.000 20.000 - -99.12% -
473.astar (unexplained diff vs previous) 50.00% 2.000 3.000 - -88.00% -
473.astar (unexplained diff vs previous) (percentage) 50.00% 0.040 0.060 - -70.00% -
471.omnetpp (unexplained diff vs previous) (percentage) 49.78% 2.230 3.340 - 240.82% -
471.omnetpp (unexplained diff vs previous) 44.62% 65.000 94.000 - -8.74% -
429.mcf (max) (percentage) 44.26% 1.220 1.760 - -89.21% -
429.mcf (unexplained diff vs previous) 42.86% 14.000 20.000 - -9.09% -
471.omnetpp (max) (percentage) 41.67% 2.280 3.230 - -65.19% -
429.mcf (unexplained diff vs previous) (percentage) 40.65% 1.230 1.730 - 981.25% -
471.omnetpp (max) 36.36% 66.000 90.000 - -90.74% -
401.bzip2 (unexplained diff vs previous) 8.33% 12.000 13.000 - -60.61% -
401.bzip2 (max) (percentage) 7.14% 0.420 0.450 - -88.10% -
401.bzip2 (unexplained diff vs previous) (percentage) 7.14% 0.420 0.450 - 125.00% -
483.xalancbmk (unexplained diff vs previous) (percentage) 6.00% 0.500 0.530 - 0.00% -
483.xalancbmk (unexplained diff vs previous) 5.88% 17.000 18.000 - 0.00% -
450.soplex (avg) (percentage) 5.21% 0.960 1.010 - 102.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
471.omnetpp -3.23% 2911.000 2817.000 - -73.11% -
450.soplex -2.17% 552.000 540.000 - -96.43% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
482.sphinx3 (unexplained diff vs previous) -90.91% 11.000 1.000 - -99.89% -
482.sphinx3 (unexplained diff vs previous) (percentage) -90.91% 1.100 0.100 - -97.08% -
470.lbm (unexplained diff vs previous) -66.67% 6.000 2.000 - -99.75% -
470.lbm (unexplained diff vs previous) (percentage) -66.67% 0.150 0.050 - -99.17% -
464.h264ref (unexplained diff vs previous) (percentage) -51.85% 0.270 0.130 - 0.00% -
464.h264ref (unexplained diff vs previous) -50.00% 16.000 8.000 - 0.00% -
456.hmmer (unexplained diff vs previous) -41.18% 17.000 10.000 - -78.26% -
456.hmmer (unexplained diff vs previous) (percentage) -40.91% 0.440 0.260 - -33.33% -
470.lbm (max) (percentage) -35.90% 0.390 0.250 - -95.63% -
470.lbm (max) -33.33% 15.000 10.000 - -98.68% -
456.hmmer (max) -29.41% 17.000 12.000 - -99.03% -
453.povray (max) (percentage) -28.70% 1.150 0.820 - 127.78% -
433.milc (unexplained diff vs previous) -25.00% 4.000 3.000 - -76.92% -
456.hmmer (max) (percentage) -24.44% 0.450 0.340 - -96.76% -
433.milc (unexplained diff vs previous) (percentage) -23.53% 0.340 0.260 - 160.00% -
450.soplex (max) -21.43% 14.000 11.000 - -95.58% -
444.namd (unexplained diff vs previous) -20.00% 5.000 4.000 - -50.00% -
453.povray (max) -20.00% 5.000 4.000 - -84.00% -
444.namd (unexplained diff vs previous) (percentage) -19.67% 0.610 0.490 - 716.67% -
450.soplex (max) (percentage) -16.54% 2.600 2.170 - 31.52% -
450.soplex (unexplained diff vs previous) -14.29% 14.000 12.000 - -82.61% -
450.soplex (unexplained diff vs previous) (percentage) -12.60% 2.540 2.220 - 382.61% -
433.milc -12.50% 8.000 7.000 - -93.97% -
433.milc (avg) -12.50% 8.000 7.000 - -93.97% -
464.h264ref (max) -12.50% 16.000 14.000 - -76.67% -
403.gcc (avg) (percentage) -11.54% 1.560 1.380 - 150.91% -
464.h264ref (max) (percentage) -11.11% 0.270 0.240 - -42.86% -
482.sphinx3 (max) -9.09% 11.000 10.000 - -98.87% -
483.xalancbmk (max) (percentage) -8.11% 1.110 1.020 - -92.09% -
483.xalancbmk (max) -8.11% 37.000 34.000 - -97.19% -
482.sphinx3 (max) (percentage) -7.21% 1.110 1.030 - -68.88% -
473.astar (max) (percentage) -6.52% 0.460 0.430 - -93.58% -
444.namd (max) (percentage) -5.30% 1.320 1.250 - -84.55% -
458.sjeng (max) -5.26% 38.000 36.000 - -95.89% -
401.bzip2 -4.76% 21.000 20.000 - -80.77% -
401.bzip2 (avg) -4.76% 21.000 20.000 - -80.77% -
473.astar (max) -4.76% 21.000 20.000 - -97.57% -
433.milc (max) (percentage) -4.55% 0.660 0.630 - -21.25% -
458.sjeng (max) (percentage) -4.35% 0.460 0.440 - -91.44% -
482.sphinx3 (avg) (percentage) -4.35% 1.150 1.100 - -36.78% -
453.povray (avg) (percentage) -4.26% 0.940 0.900 - 12.50% -
445.gobmk -4.00% 25.000 24.000 - -67.57% -
445.gobmk (avg) -4.00% 25.000 24.000 - -67.57% -
447.dealII (max) (percentage) -3.85% 0.520 0.500 - -78.99% -
445.gobmk (avg) (percentage) -3.77% 0.530 0.510 - -23.88% -
464.h264ref (avg) (percentage) -3.77% 0.530 0.510 - 75.86% -
473.astar -3.77% 53.000 51.000 - -54.46% -
473.astar (avg) -3.77% 53.000 51.000 - -54.46% -
471.omnetpp -3.61% 83.000 80.000 - -52.10% -
471.omnetpp (avg) -3.61% 83.000 80.000 - -52.10% -
473.astar (avg) (percentage) -3.51% 1.140 1.100 - 19.57% -
458.sjeng -3.45% 58.000 56.000 - -58.82% -
458.sjeng (avg) -3.45% 58.000 56.000 - -58.82% -
456.hmmer -3.41% 88.000 85.000 - -48.17% -
456.hmmer (avg) -3.41% 88.000 85.000 - -48.17% -
470.lbm -3.28% 61.000 59.000 - -86.62% -
470.lbm (avg) -3.28% 61.000 59.000 - -86.62% -
470.lbm (avg) (percentage) -3.25% 1.540 1.490 - -55.26% -
464.h264ref -3.23% 31.000 30.000 - -28.57% -
464.h264ref (avg) -3.23% 31.000 30.000 - -28.57% -
444.namd (avg) (percentage) -2.94% 1.700 1.650 - -35.80% -
445.gobmk (max) (percentage) -2.94% 0.340 0.330 - -91.15% -
403.gcc (max) (percentage) -2.94% 4.760 4.620 - 98.28% -
483.xalancbmk (avg) (percentage) -2.87% 2.790 2.710 - 27.83% -
458.sjeng (avg) (percentage) -2.86% 0.700 0.680 - -15.00% -
456.hmmer (avg) (percentage) -2.60% 2.310 2.250 - 61.87% -
483.xalancbmk -2.13% 94.000 92.000 - -53.54% -
483.xalancbmk (avg) -2.13% 94.000 92.000 - -53.54% -
401.bzip2 (avg) (percentage) -1.37% 0.730 0.720 - 10.77% -

Added Tests - sample variability
403.gcc
403.gcc (avg)
403.gcc (unexplained diff vs previous)
403.gcc (unexplained diff vs previous) (percentage)
445.gobmk (unexplained diff vs previous)
445.gobmk (unexplained diff vs previous) (percentage)
453.povray (unexplained diff vs previous)
453.povray (unexplained diff vs previous) (percentage)
458.sjeng (unexplained diff vs previous)
458.sjeng (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
450.soplex 2.13% 146765.000 149884.000 - 0.00% -
471.omnetpp 1.45% 316676.000 321253.000 - 0.00% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
462.libquantum (unexplained diff vs previous) (percentage) 21000.00% 0.010 2.110 - 95.37% -
429.mcf (unexplained diff vs previous) (percentage) 981.25% 0.160 1.730 - 40.65% -
444.namd (unexplained diff vs previous) (percentage) 716.67% 0.060 0.490 - -19.67% -
450.soplex (unexplained diff vs previous) (percentage) 382.61% 0.460 2.220 - -12.60% -
462.libquantum (unexplained diff vs previous) 300.00% 1.000 4.000 - 100.00% -
471.omnetpp (unexplained diff vs previous) (percentage) 240.82% 0.980 3.340 - 49.78% -
433.milc (unexplained diff vs previous) (percentage) 160.00% 0.100 0.260 - -23.53% -
403.gcc (avg) (percentage) 150.91% 0.550 1.380 - -11.54% -
453.povray (max) (percentage) 127.78% 0.360 0.820 - -28.70% -
401.bzip2 (unexplained diff vs previous) (percentage) 125.00% 0.200 0.450 - 7.14% -
462.libquantum (avg) (percentage) 122.08% 0.770 1.710 - 0.59% -
450.soplex (avg) (percentage) 102.00% 0.500 1.010 - 5.21% -
403.gcc (max) (percentage) 98.28% 2.330 4.620 - -2.94% -
471.omnetpp (avg) (percentage) 79.38% 1.600 2.870 - 0.35% -
464.h264ref (avg) (percentage) 75.86% 0.290 0.510 - -3.77% -
456.hmmer (avg) (percentage) 61.87% 1.390 2.250 - -2.60% -
450.soplex (max) (percentage) 31.52% 1.650 2.170 - -16.54% -
483.xalancbmk (avg) (percentage) 27.83% 2.120 2.710 - -2.87% -
473.astar (avg) (percentage) 19.57% 0.920 1.100 - -3.51% -
453.povray (avg) (percentage) 12.50% 0.800 0.900 - -4.26% -
401.bzip2 (avg) (percentage) 10.77% 0.650 0.720 - -1.37% -
429.mcf (avg) (percentage) 8.49% 2.120 2.300 - -0.86% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
429.mcf -3.15% 7239.000 7011.000 - 0.00% -
453.povray -1.90% 524493.000 514527.000 - 0.00% -
462.libquantum -1.77% 12504.000 12283.000 - 0.00% -
433.milc -1.41% 47001.000 46337.000 - 0.00% -
470.lbm -1.09% 9338.000 9236.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
403.gcc -99.40% 9509.000 57.000 - 0.00% -
462.libquantum -98.68% 14409.000 190.000 - 2.15% -
450.soplex -96.43% 15112.000 540.000 - -2.17% -
482.sphinx3 -96.23% 26682.000 1005.000 - 0.10% -
444.namd -93.47% 12400.000 810.000 - -0.49% -
453.povray -92.86% 6987.000 499.000 - -0.40% -
429.mcf -91.75% 13988.000 1154.000 - 1.76% -
433.milc -91.45% 13601.000 1163.000 - -0.26% -
401.bzip2 -82.24% 16137.000 2866.000 - -0.45% -
447.dealII -78.53% 9380.000 2014.000 - 0.30% -
471.omnetpp -73.11% 10477.000 2817.000 - -3.23% -
470.lbm -69.77% 13259.000 4008.000 - 0.05% -
456.hmmer -67.77% 11854.000 3820.000 - -0.26% -
483.xalancbmk -63.73% 9376.000 3401.000 - 0.53% -
473.astar -61.76% 12272.000 4693.000 - 0.06% -
464.h264ref -58.57% 14498.000 6006.000 - 0.13% -
445.gobmk -55.86% 11093.000 4896.000 - -0.18% -
458.sjeng -51.31% 17055.000 8304.000 - -0.20% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
482.sphinx3 (unexplained diff vs previous) -99.89% 914.000 1.000 - -90.91% -
470.lbm (unexplained diff vs previous) -99.75% 804.000 2.000 - -66.67% -
462.libquantum (max) -99.56% 919.000 4.000 - 100.00% -
470.lbm (unexplained diff vs previous) (percentage) -99.17% 6.060 0.050 - -66.67% -
429.mcf (max) -99.12% 2281.000 20.000 - 53.85% -
403.gcc (max) -99.10% 221.000 2.000 - 0.00% -
456.hmmer (max) -99.03% 1242.000 12.000 - -29.41% -
444.namd (max) -99.00% 1003.000 10.000 - 0.00% -
482.sphinx3 (max) -98.87% 883.000 10.000 - -9.09% -
470.lbm (max) -98.68% 758.000 10.000 - -33.33% -
401.bzip2 (max) -98.03% 609.000 12.000 - 0.00% -
482.sphinx3 -97.63% 464.000 11.000 - 0.00% -
482.sphinx3 (avg) -97.63% 464.000 11.000 - 0.00% -
473.astar (max) -97.57% 822.000 20.000 - -4.76% -
462.libquantum -97.27% 110.000 3.000 - 0.00% -
462.libquantum (avg) -97.27% 110.000 3.000 - 0.00% -
483.xalancbmk (max) -97.19% 1209.000 34.000 - -8.11% -
482.sphinx3 (unexplained diff vs previous) (percentage) -97.08% 3.430 0.100 - -90.91% -
456.hmmer (max) (percentage) -96.76% 10.480 0.340 - -24.44% -
445.gobmk (max) -96.13% 413.000 16.000 - 0.00% -
444.namd -95.91% 318.000 13.000 - 0.00% -
444.namd (avg) -95.91% 318.000 13.000 - 0.00% -
458.sjeng (max) -95.89% 876.000 36.000 - -5.26% -
470.lbm (max) (percentage) -95.63% 5.720 0.250 - -35.90% -
450.soplex (max) -95.58% 249.000 11.000 - -21.43% -
447.dealII (max) -95.52% 223.000 10.000 - 0.00% -
433.milc -93.97% 116.000 7.000 - -12.50% -
433.milc (avg) -93.97% 116.000 7.000 - -12.50% -
473.astar (max) (percentage) -93.58% 6.700 0.430 - -6.52% -
433.milc (max) -93.52% 108.000 7.000 - 0.00% -
450.soplex -93.33% 75.000 5.000 - 0.00% -
450.soplex (avg) -93.33% 75.000 5.000 - 0.00% -
453.povray -92.73% 55.000 4.000 - 0.00% -
453.povray (avg) -92.73% 55.000 4.000 - 0.00% -
483.xalancbmk (max) (percentage) -92.09% 12.900 1.020 - -8.11% -
458.sjeng (max) (percentage) -91.44% 5.140 0.440 - -4.35% -
429.mcf -91.22% 296.000 26.000 - 0.00% -
429.mcf (avg) -91.22% 296.000 26.000 - 0.00% -
445.gobmk (max) (percentage) -91.15% 3.730 0.330 - -2.94% -
471.omnetpp (max) -90.74% 972.000 90.000 - 36.36% -
429.mcf (max) (percentage) -89.21% 16.310 1.760 - 44.26% -
401.bzip2 (max) (percentage) -88.10% 3.780 0.450 - 7.14% -
473.astar (unexplained diff vs previous) -88.00% 25.000 3.000 - 50.00% -
470.lbm -86.62% 441.000 59.000 - -3.28% -
470.lbm (avg) -86.62% 441.000 59.000 - -3.28% -
444.namd (max) (percentage) -84.55% 8.090 1.250 - -5.30% -
453.povray (max) -84.00% 25.000 4.000 - -20.00% -
447.dealII -83.67% 98.000 16.000 - 0.00% -
447.dealII (avg) -83.67% 98.000 16.000 - 0.00% -
450.soplex (unexplained diff vs previous) -82.61% 69.000 12.000 - -14.29% -
401.bzip2 -80.77% 104.000 20.000 - -4.76% -
401.bzip2 (avg) -80.77% 104.000 20.000 - -4.76% -
447.dealII (max) (percentage) -78.99% 2.380 0.500 - -3.85% -
456.hmmer (unexplained diff vs previous) -78.26% 46.000 10.000 - -41.18% -
445.gobmk (unexplained diff vs previous) -77.50% 40.000 9.000 - 0.00% -
433.milc (unexplained diff vs previous) -76.92% 13.000 3.000 - -25.00% -
464.h264ref (max) -76.67% 60.000 14.000 - -12.50% -
473.astar (unexplained diff vs previous) (percentage) -70.00% 0.200 0.060 - 50.00% -
482.sphinx3 (max) (percentage) -68.88% 3.310 1.030 - -7.21% -
445.gobmk -67.57% 74.000 24.000 - -4.00% -
445.gobmk (avg) -67.57% 74.000 24.000 - -4.00% -
462.libquantum (max) (percentage) -66.30% 6.380 2.150 - 65.38% -
471.omnetpp (max) (percentage) -65.19% 9.280 3.230 - 41.67% -
401.bzip2 (unexplained diff vs previous) -60.61% 33.000 13.000 - 8.33% -
458.sjeng -58.82% 136.000 56.000 - -3.45% -
458.sjeng (avg) -58.82% 136.000 56.000 - -3.45% -
470.lbm (avg) (percentage) -55.26% 3.330 1.490 - -3.25% -
473.astar -54.46% 112.000 51.000 - -3.77% -
473.astar (avg) -54.46% 112.000 51.000 - -3.77% -
483.xalancbmk -53.54% 198.000 92.000 - -2.13% -
483.xalancbmk (avg) -53.54% 198.000 92.000 - -2.13% -
471.omnetpp -52.10% 167.000 80.000 - -3.61% -
471.omnetpp (avg) -52.10% 167.000 80.000 - -3.61% -
444.namd (unexplained diff vs previous) -50.00% 8.000 4.000 - -20.00% -
445.gobmk (unexplained diff vs previous) (percentage) -50.00% 0.360 0.180 - 0.00% -
456.hmmer -48.17% 164.000 85.000 - -3.41% -
456.hmmer (avg) -48.17% 164.000 85.000 - -3.41% -
464.h264ref (max) (percentage) -42.86% 0.420 0.240 - -11.11% -
482.sphinx3 (avg) (percentage) -36.78% 1.740 1.100 - -4.35% -
444.namd (avg) (percentage) -35.80% 2.570 1.650 - -2.94% -
456.hmmer (unexplained diff vs previous) (percentage) -33.33% 0.390 0.260 - -40.91% -
464.h264ref -28.57% 42.000 30.000 - -3.23% -
464.h264ref (avg) -28.57% 42.000 30.000 - -3.23% -
445.gobmk (avg) (percentage) -23.88% 0.670 0.510 - -3.77% -
447.dealII (avg) (percentage) -21.90% 1.050 0.820 - 0.00% -
433.milc (max) (percentage) -21.25% 0.800 0.630 - -4.55% -
433.milc (avg) (percentage) -20.93% 0.860 0.680 - -1.45% -
458.sjeng (avg) (percentage) -15.00% 0.800 0.680 - -2.86% -
429.mcf (unexplained diff vs previous) -9.09% 22.000 20.000 - 42.86% -
471.omnetpp (unexplained diff vs previous) -8.74% 103.000 94.000 - 44.62% -

Added Tests - sample variability
403.gcc
403.gcc (avg)
403.gcc (unexplained diff vs previous)
403.gcc (unexplained diff vs previous) (percentage)
458.sjeng (unexplained diff vs previous)
458.sjeng (unexplained diff vs previous) (percentage)
464.h264ref (unexplained diff vs previous)
464.h264ref (unexplained diff vs previous) (percentage)
483.xalancbmk (unexplained diff vs previous)
483.xalancbmk (unexplained diff vs previous) (percentage)

Report Time: 0.35s
Execution (seconds)
Name Current %
401.bzip2 2866.000 -
403.gcc 57.000 -
429.mcf 1154.000 1.76%
433.milc 1163.000 -
444.namd 810.000 -
445.gobmk 4896.000 -
447.dealII 2014.000 -
450.soplex 540.000 -2.17%
453.povray 499.000 -
456.hmmer 3820.000 -
458.sjeng 8304.000 -
462.libquantum 190.000 2.15%
464.h264ref 6006.000 -
470.lbm 4008.000 -
471.omnetpp 2817.000 -3.23%
473.astar 4693.000 -
482.sphinx3 1005.000 -
483.xalancbmk 3401.000 -
Geometric Mean 1562.837 -
Code Size (bytes)
Name Current %
401.bzip2 33725.000 -
403.gcc 1664747.000 -
429.mcf 7011.000 -
433.milc 46337.000 -
444.namd 123790.000 -
445.gobmk 1258961.000 -
447.dealII 197126.000 -
450.soplex 149884.000 -
453.povray 514527.000 -
456.hmmer 80417.000 -
458.sjeng 79514.000 -
462.libquantum 12283.000 -
464.h264ref 301383.000 -
470.lbm 9236.000 -
471.omnetpp 321253.000 -
473.astar 15607.000 -
482.sphinx3 87696.000 -
483.xalancbmk 1612280.000 -
Geometric Mean 111143.294 -
sample variability
Name Current %
401.bzip2 20.000 -4.76%
401.bzip2 (avg) 20.000 -4.76%
401.bzip2 (avg) (percentage) 0.720 -1.37%
401.bzip2 (max) 12.000 -
401.bzip2 (max) (percentage) 0.450 7.14%
401.bzip2 (unexplained diff vs previous) 13.000 8.33%
401.bzip2 (unexplained diff vs previous) (percentage) 0.450 7.14%
403.gcc 0.000 -
403.gcc (avg) 0.000 -
403.gcc (avg) (percentage) 1.380 -11.54%
403.gcc (max) 2.000 -
403.gcc (max) (percentage) 4.620 -2.94%
403.gcc (unexplained diff vs previous) 0.000 -
403.gcc (unexplained diff vs previous) (percentage) 0.000 -
429.mcf 26.000 -
429.mcf (avg) 26.000 -
429.mcf (avg) (percentage) 2.300 -
429.mcf (max) 20.000 53.85%
429.mcf (max) (percentage) 1.760 44.26%
429.mcf (unexplained diff vs previous) 20.000 42.86%
429.mcf (unexplained diff vs previous) (percentage) 1.730 40.65%
433.milc 7.000 -12.50%
433.milc (avg) 7.000 -12.50%
433.milc (avg) (percentage) 0.680 -
433.milc (max) 7.000 -
433.milc (max) (percentage) 0.630 -4.55%
433.milc (unexplained diff vs previous) 3.000 -25.00%
433.milc (unexplained diff vs previous) (percentage) 0.260 -23.53%
444.namd 13.000 -
444.namd (avg) 13.000 -
444.namd (avg) (percentage) 1.650 -2.94%
444.namd (max) 10.000 -
444.namd (max) (percentage) 1.250 -5.30%
444.namd (unexplained diff vs previous) 4.000 -20.00%
444.namd (unexplained diff vs previous) (percentage) 0.490 -19.67%
445.gobmk 24.000 -4.00%
445.gobmk (avg) 24.000 -4.00%
445.gobmk (avg) (percentage) 0.510 -3.77%
445.gobmk (max) 16.000 -
445.gobmk (max) (percentage) 0.330 -2.94%
445.gobmk (unexplained diff vs previous) 9.000 -
445.gobmk (unexplained diff vs previous) (percentage) 0.180 -
447.dealII 16.000 -
447.dealII (avg) 16.000 -
447.dealII (avg) (percentage) 0.820 -
447.dealII (max) 10.000 -
447.dealII (max) (percentage) 0.500 -3.85%
450.soplex 5.000 -
450.soplex (avg) 5.000 -
450.soplex (avg) (percentage) 1.010 5.21%
450.soplex (max) 11.000 -21.43%
450.soplex (max) (percentage) 2.170 -16.54%
450.soplex (unexplained diff vs previous) 12.000 -14.29%
450.soplex (unexplained diff vs previous) (percentage) 2.220 -12.60%
453.povray 4.000 -
453.povray (avg) 4.000 -
453.povray (avg) (percentage) 0.900 -4.26%
453.povray (max) 4.000 -20.00%
453.povray (max) (percentage) 0.820 -28.70%
453.povray (unexplained diff vs previous) 2.000 -
453.povray (unexplained diff vs previous) (percentage) 0.400 -
456.hmmer 85.000 -3.41%
456.hmmer (avg) 85.000 -3.41%
456.hmmer (avg) (percentage) 2.250 -2.60%
456.hmmer (max) 12.000 -29.41%
456.hmmer (max) (percentage) 0.340 -24.44%
456.hmmer (unexplained diff vs previous) 10.000 -41.18%
456.hmmer (unexplained diff vs previous) (percentage) 0.260 -40.91%
458.sjeng 56.000 -3.45%
458.sjeng (avg) 56.000 -3.45%
458.sjeng (avg) (percentage) 0.680 -2.86%
458.sjeng (max) 36.000 -5.26%
458.sjeng (max) (percentage) 0.440 -4.35%
458.sjeng (unexplained diff vs previous) 17.000 -
458.sjeng (unexplained diff vs previous) (percentage) 0.200 -
462.libquantum 3.000 -
462.libquantum (avg) 3.000 -
462.libquantum (avg) (percentage) 1.710 -
462.libquantum (max) 4.000 100.00%
462.libquantum (max) (percentage) 2.150 65.38%
462.libquantum (unexplained diff vs previous) 4.000 100.00%
462.libquantum (unexplained diff vs previous) (percentage) 2.110 95.37%
464.h264ref 30.000 -3.23%
464.h264ref (avg) 30.000 -3.23%
464.h264ref (avg) (percentage) 0.510 -3.77%
464.h264ref (max) 14.000 -12.50%
464.h264ref (max) (percentage) 0.240 -11.11%
464.h264ref (unexplained diff vs previous) 8.000 -50.00%
464.h264ref (unexplained diff vs previous) (percentage) 0.130 -51.85%
470.lbm 59.000 -3.28%
470.lbm (avg) 59.000 -3.28%
470.lbm (avg) (percentage) 1.490 -3.25%
470.lbm (max) 10.000 -33.33%
470.lbm (max) (percentage) 0.250 -35.90%
470.lbm (unexplained diff vs previous) 2.000 -66.67%
470.lbm (unexplained diff vs previous) (percentage) 0.050 -66.67%
471.omnetpp 80.000 -3.61%
471.omnetpp (avg) 80.000 -3.61%
471.omnetpp (avg) (percentage) 2.870 -
471.omnetpp (max) 90.000 36.36%
471.omnetpp (max) (percentage) 3.230 41.67%
471.omnetpp (unexplained diff vs previous) 94.000 44.62%
471.omnetpp (unexplained diff vs previous) (percentage) 3.340 49.78%
473.astar 51.000 -3.77%
473.astar (avg) 51.000 -3.77%
473.astar (avg) (percentage) 1.100 -3.51%
473.astar (max) 20.000 -4.76%
473.astar (max) (percentage) 0.430 -6.52%
473.astar (unexplained diff vs previous) 3.000 50.00%
473.astar (unexplained diff vs previous) (percentage) 0.060 50.00%
482.sphinx3 11.000 -
482.sphinx3 (avg) 11.000 -
482.sphinx3 (avg) (percentage) 1.100 -4.35%
482.sphinx3 (max) 10.000 -9.09%
482.sphinx3 (max) (percentage) 1.030 -7.21%
482.sphinx3 (unexplained diff vs previous) 1.000 -90.91%
482.sphinx3 (unexplained diff vs previous) (percentage) 0.100 -90.91%
483.xalancbmk 92.000 -2.13%
483.xalancbmk (avg) 92.000 -2.13%
483.xalancbmk (avg) (percentage) 2.710 -2.87%
483.xalancbmk (max) 34.000 -8.11%
483.xalancbmk (max) (percentage) 1.020 -8.11%
483.xalancbmk (unexplained diff vs previous) 18.000 5.88%
483.xalancbmk (unexplained diff vs previous) (percentage) 0.530 6.00%
Geometric Mean 2.777 -38.02%