Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/8b1727f8d9104df5ced4bdfdc065dea85ff84baf (+ 309 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--llvm-arm-master-Oz_LTO-build/30/
View Options
Report
Filter

llvm-arm-master-Oz_LTO test results

Run Order Start Time Duration
Current 0030 (llvmorg-17-init-11946-g8b1727f8d910) 2023-05-17T20:07:41 0:00:00
Previous 0029 (llvmorg-17-init-11637-ge0466a7463ec) 2023-05-14T06:49:07 0:00:00
Baseline 0001 (llvmorg-16-init-17036-g4f40923103d2) 2023-01-06T17:55:45 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 17 29
Performance Improvements 86 107
Added Tests 6 10
Unchanged Tests 671 634
Total Tests 780

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
450.soplex 1.12% 536.000 542.000 - -96.41% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
450.soplex (unexplained diff vs previous) 500.00% 1.000 6.000 - -91.30% -
450.soplex (unexplained diff vs previous) (percentage) 484.21% 0.190 1.110 - 141.30% -
462.libquantum (unexplained diff vs previous) (percentage) 207.55% 0.530 1.630 - 16200.00% -
462.libquantum (unexplained diff vs previous) 200.00% 1.000 3.000 - 200.00% -
447.dealII (unexplained diff vs previous) 100.00% 5.000 10.000 - -81.48% -
447.dealII (unexplained diff vs previous) (percentage) 100.00% 0.250 0.500 - -13.79% -
482.sphinx3 (unexplained diff vs previous) 60.00% 5.000 8.000 - -99.12% -
482.sphinx3 (unexplained diff vs previous) (percentage) 58.00% 0.500 0.790 - -76.97% -
464.h264ref (unexplained diff vs previous) (percentage) 38.89% 0.180 0.250 - 0.00% -
464.h264ref (unexplained diff vs previous) 36.36% 11.000 15.000 - 0.00% -
429.mcf (unexplained diff vs previous) (percentage) 25.23% 1.110 1.390 - 768.75% -
429.mcf (unexplained diff vs previous) 23.08% 13.000 16.000 - -27.27% -
429.mcf (max) (percentage) 21.24% 1.130 1.370 - -91.60% -
429.mcf (max) 15.38% 13.000 15.000 - -99.34% -
450.soplex (avg) (percentage) 2.90% 0.690 0.710 - 42.00% -
401.bzip2 (avg) (percentage) 2.33% 0.860 0.880 - 35.38% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
403.gcc -3.33% 60.000 58.000 - -99.39% -
462.libquantum -1.60% 187.000 184.000 - -98.72% -
429.mcf -1.37% 1167.000 1151.000 - -91.77% -
401.bzip2 -1.26% 3091.000 3052.000 - -81.09% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
473.astar (max) -95.93% 393.000 16.000 - -98.05% -
473.astar (max) (percentage) -95.69% 8.580 0.370 - -94.48% -
473.astar (unexplained diff vs previous) (percentage) -89.74% 0.390 0.040 - -80.00% -
473.astar (unexplained diff vs previous) -88.89% 18.000 2.000 - -92.00% -
444.namd (max) -88.24% 34.000 4.000 - -99.60% -
444.namd (max) (percentage) -86.41% 4.340 0.590 - -92.71% -
433.milc (unexplained diff vs previous) -80.00% 5.000 1.000 - -92.31% -
433.milc (unexplained diff vs previous) (percentage) -79.07% 0.430 0.090 - -10.00% -
456.hmmer (max) -75.00% 8.000 2.000 - -99.84% -
456.hmmer (max) (percentage) -73.91% 0.230 0.060 - -99.43% -
453.povray (unexplained diff vs previous) -69.23% 13.000 4.000 - 0.00% -
453.povray (unexplained diff vs previous) (percentage) -68.99% 2.580 0.800 - 0.00% -
444.namd (unexplained diff vs previous) -60.00% 5.000 2.000 - -75.00% -
444.namd (unexplained diff vs previous) (percentage) -59.68% 0.620 0.250 - 316.67% -
433.milc (max) -40.00% 5.000 3.000 - -97.22% -
470.lbm (unexplained diff vs previous) (percentage) -37.50% 0.080 0.050 - -99.17% -
470.lbm (unexplained diff vs previous) -33.33% 3.000 2.000 - -99.75% -
433.milc (max) (percentage) -25.58% 0.430 0.320 - -60.00% -
453.povray (max) -15.38% 13.000 11.000 - -56.00% -
458.sjeng (unexplained diff vs previous) -15.15% 33.000 28.000 - 0.00% -
458.sjeng (unexplained diff vs previous) (percentage) -15.00% 0.400 0.340 - 0.00% -
433.milc -12.50% 8.000 7.000 - -93.97% -
433.milc (avg) -12.50% 8.000 7.000 - -93.97% -
401.bzip2 (max) -11.63% 43.000 38.000 - -93.76% -
401.bzip2 (max) (percentage) -10.64% 1.410 1.260 - -66.67% -
453.povray (max) (percentage) -10.19% 2.650 2.380 - 561.11% -
401.bzip2 (unexplained diff vs previous) -9.30% 43.000 39.000 - 18.18% -
458.sjeng (max) -9.09% 33.000 30.000 - -96.58% -
401.bzip2 (unexplained diff vs previous) (percentage) -7.91% 1.390 1.280 - 540.00% -
445.gobmk -7.89% 38.000 35.000 - -52.70% -
445.gobmk (avg) -7.89% 38.000 35.000 - -52.70% -
445.gobmk (avg) (percentage) -7.69% 0.780 0.720 - 7.46% -
458.sjeng (max) (percentage) -7.50% 0.400 0.370 - -92.80% -
470.lbm (max) -7.14% 14.000 13.000 - -98.28% -
483.xalancbmk (avg) (percentage) -6.55% 6.260 5.850 - 175.94% -
483.xalancbmk -6.54% 214.000 200.000 - 1.01% -
483.xalancbmk (avg) -6.54% 214.000 200.000 - 1.01% -
433.milc (avg) (percentage) -5.71% 0.700 0.660 - -23.26% -
482.sphinx3 -5.56% 18.000 17.000 - -96.34% -
482.sphinx3 (avg) -5.56% 18.000 17.000 - -96.34% -
470.lbm (max) (percentage) -5.56% 0.360 0.340 - -94.06% -
473.astar (avg) (percentage) -5.34% 2.060 1.950 - 111.96% -
473.astar -5.32% 94.000 89.000 - -20.54% -
473.astar (avg) -5.32% 94.000 89.000 - -20.54% -
444.namd -5.26% 19.000 18.000 - -94.34% -
444.namd (avg) -5.26% 19.000 18.000 - -94.34% -
444.namd (avg) (percentage) -4.98% 2.410 2.290 - -10.89% -
429.mcf -4.88% 41.000 39.000 - -86.82% -
429.mcf (avg) -4.88% 41.000 39.000 - -86.82% -
470.lbm -4.81% 104.000 99.000 - -77.55% -
470.lbm (avg) -4.81% 104.000 99.000 - -77.55% -
470.lbm (avg) (percentage) -4.60% 2.610 2.490 - -25.23% -
464.h264ref (max) (percentage) -4.55% 0.440 0.420 - 0.00% -
447.dealII -4.55% 22.000 21.000 - -78.57% -
447.dealII (avg) -4.55% 22.000 21.000 - -78.57% -
471.omnetpp (max) (percentage) -4.46% 1.120 1.070 - -88.47% -
471.omnetpp -4.44% 135.000 129.000 - -22.75% -
471.omnetpp (avg) -4.44% 135.000 129.000 - -22.75% -
458.sjeng (avg) (percentage) -4.42% 1.130 1.080 - 35.00% -
483.xalancbmk (max) (percentage) -4.35% 1.380 1.320 - -89.77% -
458.sjeng -4.30% 93.000 89.000 - -34.56% -
458.sjeng (avg) -4.30% 93.000 89.000 - -34.56% -
456.hmmer -4.27% 164.000 157.000 - -4.27% -
456.hmmer (avg) -4.27% 164.000 157.000 - -4.27% -
483.xalancbmk (max) -4.26% 47.000 45.000 - -96.28% -
464.h264ref (avg) (percentage) -4.26% 0.940 0.900 - 210.34% -
456.hmmer (avg) (percentage) -4.19% 4.300 4.120 - 196.40% -
464.h264ref (max) -3.85% 26.000 25.000 - -58.33% -
471.omnetpp (avg) (percentage) -3.79% 4.750 4.570 - 185.62% -
447.dealII (max) (percentage) -3.73% 1.340 1.290 - -45.80% -
447.dealII (max) -3.70% 27.000 26.000 - -88.34% -
447.dealII (avg) (percentage) -3.64% 1.100 1.060 - 0.95% -
464.h264ref -3.57% 56.000 54.000 - 28.57% -
464.h264ref (avg) -3.57% 56.000 54.000 - 28.57% -
482.sphinx3 (avg) (percentage) -3.30% 1.820 1.760 - 1.15% -
471.omnetpp (max) -3.23% 31.000 30.000 - -96.91% -
450.soplex (max) (percentage) -2.88% 1.390 1.350 - -18.18% -
429.mcf (avg) (percentage) -2.81% 3.560 3.460 - 63.21% -
482.sphinx3 (max) (percentage) -2.44% 0.820 0.800 - -75.83% -
453.povray (avg) (percentage) -1.08% 0.930 0.920 - 15.00% -
403.gcc (max) (percentage) -1.02% 1.960 1.940 - -16.74% -
462.libquantum (avg) (percentage) -1.02% 1.970 1.950 - 153.25% -

Added Tests - sample variability
403.gcc
403.gcc (avg)
456.hmmer (unexplained diff vs previous)
456.hmmer (unexplained diff vs previous) (percentage)
483.xalancbmk (unexplained diff vs previous)
483.xalancbmk (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
450.soplex 2.13% 146765.000 149884.000 - 0.00% -
471.omnetpp 1.50% 316676.000 321429.000 - 0.00% -
401.bzip2 1.10% 33698.000 34069.000 - 0.00% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
462.libquantum (unexplained diff vs previous) (percentage) 16200.00% 0.010 1.630 - 207.55% -
429.mcf (unexplained diff vs previous) (percentage) 768.75% 0.160 1.390 - 25.23% -
453.povray (max) (percentage) 561.11% 0.360 2.380 - -10.19% -
401.bzip2 (unexplained diff vs previous) (percentage) 540.00% 0.200 1.280 - -7.91% -
444.namd (unexplained diff vs previous) (percentage) 316.67% 0.060 0.250 - -59.68% -
464.h264ref (avg) (percentage) 210.34% 0.290 0.900 - -4.26% -
462.libquantum (unexplained diff vs previous) 200.00% 1.000 3.000 - 200.00% -
456.hmmer (avg) (percentage) 196.40% 1.390 4.120 - -4.19% -
471.omnetpp (avg) (percentage) 185.62% 1.600 4.570 - -3.79% -
483.xalancbmk (avg) (percentage) 175.94% 2.120 5.850 - -6.55% -
462.libquantum (avg) (percentage) 153.25% 0.770 1.950 - -1.02% -
450.soplex (unexplained diff vs previous) (percentage) 141.30% 0.460 1.110 - 484.21% -
473.astar (avg) (percentage) 111.96% 0.920 1.950 - -5.34% -
429.mcf (avg) (percentage) 63.21% 2.120 3.460 - -2.81% -
450.soplex (avg) (percentage) 42.00% 0.500 0.710 - 2.90% -
403.gcc (avg) (percentage) 36.36% 0.550 0.750 - 0.00% -
401.bzip2 (avg) (percentage) 35.38% 0.650 0.880 - 2.33% -
458.sjeng (avg) (percentage) 35.00% 0.800 1.080 - -4.42% -
464.h264ref 28.57% 42.000 54.000 - -3.57% -
464.h264ref (avg) 28.57% 42.000 54.000 - -3.57% -
401.bzip2 (unexplained diff vs previous) 18.18% 33.000 39.000 - -9.30% -
453.povray (avg) (percentage) 15.00% 0.800 0.920 - -1.08% -
445.gobmk (avg) (percentage) 7.46% 0.670 0.720 - -7.69% -
482.sphinx3 (avg) (percentage) 1.15% 1.740 1.760 - -3.30% -
483.xalancbmk 1.01% 198.000 200.000 - -6.54% -
483.xalancbmk (avg) 1.01% 198.000 200.000 - -6.54% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
429.mcf -2.60% 7239.000 7051.000 - 0.00% -
453.povray -1.97% 524493.000 514179.000 - 0.00% -
462.libquantum -1.71% 12504.000 12290.000 - 0.00% -
433.milc -1.17% 47001.000 46453.000 - 0.00% -
470.lbm -1.05% 9338.000 9240.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
403.gcc -99.39% 9509.000 58.000 - -3.33% -
462.libquantum -98.72% 14409.000 184.000 - -1.60% -
450.soplex -96.41% 15112.000 542.000 - 1.12% -
482.sphinx3 -96.22% 26682.000 1008.000 - 0.80% -
444.namd -93.50% 12400.000 806.000 - 0.25% -
453.povray -92.86% 6987.000 499.000 - -0.80% -
429.mcf -91.77% 13988.000 1151.000 - -1.37% -
433.milc -91.43% 13601.000 1166.000 - -0.09% -
401.bzip2 -81.09% 16137.000 3052.000 - -1.26% -
447.dealII -78.46% 9380.000 2020.000 - -0.49% -
471.omnetpp -72.85% 10477.000 2844.000 - -0.21% -
470.lbm -69.90% 13259.000 3991.000 - 0.05% -
456.hmmer -67.75% 11854.000 3823.000 - 0.00% -
483.xalancbmk -63.37% 9376.000 3434.000 - 0.09% -
473.astar -62.67% 12272.000 4581.000 - -0.04% -
464.h264ref -58.42% 14498.000 6028.000 - 0.25% -
445.gobmk -55.67% 11093.000 4918.000 - -0.04% -
458.sjeng -51.32% 17055.000 8303.000 - 0.34% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
456.hmmer (max) -99.84% 1242.000 2.000 - -75.00% -
470.lbm (unexplained diff vs previous) -99.75% 804.000 2.000 - -33.33% -
444.namd (max) -99.60% 1003.000 4.000 - -88.24% -
403.gcc (max) -99.55% 221.000 1.000 - 0.00% -
456.hmmer (max) (percentage) -99.43% 10.480 0.060 - -73.91% -
462.libquantum (max) -99.35% 919.000 6.000 - 0.00% -
429.mcf (max) -99.34% 2281.000 15.000 - 15.38% -
470.lbm (unexplained diff vs previous) (percentage) -99.17% 6.060 0.050 - -37.50% -
482.sphinx3 (unexplained diff vs previous) -99.12% 914.000 8.000 - 60.00% -
482.sphinx3 (max) -99.09% 883.000 8.000 - 0.00% -
445.gobmk (max) -98.31% 413.000 7.000 - 0.00% -
470.lbm (max) -98.28% 758.000 13.000 - -7.14% -
473.astar (max) -98.05% 822.000 16.000 - -95.93% -
462.libquantum -97.27% 110.000 3.000 - 0.00% -
462.libquantum (avg) -97.27% 110.000 3.000 - 0.00% -
433.milc (max) -97.22% 108.000 3.000 - -40.00% -
450.soplex (max) -97.19% 249.000 7.000 - 0.00% -
471.omnetpp (max) -96.91% 972.000 30.000 - -3.23% -
458.sjeng (max) -96.58% 876.000 30.000 - -9.09% -
482.sphinx3 -96.34% 464.000 17.000 - -5.56% -
482.sphinx3 (avg) -96.34% 464.000 17.000 - -5.56% -
483.xalancbmk (max) -96.28% 1209.000 45.000 - -4.26% -
450.soplex -96.00% 75.000 3.000 - 0.00% -
450.soplex (avg) -96.00% 75.000 3.000 - 0.00% -
445.gobmk (max) (percentage) -95.98% 3.730 0.150 - 0.00% -
445.gobmk (unexplained diff vs previous) -95.00% 40.000 2.000 - 0.00% -
473.astar (max) (percentage) -94.48% 6.700 0.370 - -95.69% -
444.namd -94.34% 318.000 18.000 - -5.26% -
444.namd (avg) -94.34% 318.000 18.000 - -5.26% -
471.omnetpp (unexplained diff vs previous) -94.17% 103.000 6.000 - 0.00% -
470.lbm (max) (percentage) -94.06% 5.720 0.340 - -5.56% -
433.milc -93.97% 116.000 7.000 - -12.50% -
433.milc (avg) -93.97% 116.000 7.000 - -12.50% -
401.bzip2 (max) -93.76% 609.000 38.000 - -11.63% -
458.sjeng (max) (percentage) -92.80% 5.140 0.370 - -7.50% -
453.povray -92.73% 55.000 4.000 - 0.00% -
453.povray (avg) -92.73% 55.000 4.000 - 0.00% -
444.namd (max) (percentage) -92.71% 8.090 0.590 - -86.41% -
433.milc (unexplained diff vs previous) -92.31% 13.000 1.000 - -80.00% -
473.astar (unexplained diff vs previous) -92.00% 25.000 2.000 - -88.89% -
429.mcf (max) (percentage) -91.60% 16.310 1.370 - 21.24% -
450.soplex (unexplained diff vs previous) -91.30% 69.000 6.000 - 500.00% -
483.xalancbmk (max) (percentage) -89.77% 12.900 1.320 - -4.35% -
445.gobmk (unexplained diff vs previous) (percentage) -88.89% 0.360 0.040 - 0.00% -
471.omnetpp (max) (percentage) -88.47% 9.280 1.070 - -4.46% -
447.dealII (max) -88.34% 223.000 26.000 - -3.70% -
429.mcf -86.82% 296.000 39.000 - -4.88% -
429.mcf (avg) -86.82% 296.000 39.000 - -4.88% -
447.dealII (unexplained diff vs previous) -81.48% 54.000 10.000 - 100.00% -
473.astar (unexplained diff vs previous) (percentage) -80.00% 0.200 0.040 - -89.74% -
447.dealII -78.57% 98.000 21.000 - -4.55% -
447.dealII (avg) -78.57% 98.000 21.000 - -4.55% -
471.omnetpp (unexplained diff vs previous) (percentage) -78.57% 0.980 0.210 - 0.00% -
470.lbm -77.55% 441.000 99.000 - -4.81% -
470.lbm (avg) -77.55% 441.000 99.000 - -4.81% -
482.sphinx3 (unexplained diff vs previous) (percentage) -76.97% 3.430 0.790 - 58.00% -
482.sphinx3 (max) (percentage) -75.83% 3.310 0.800 - -2.44% -
401.bzip2 -75.00% 104.000 26.000 - 0.00% -
401.bzip2 (avg) -75.00% 104.000 26.000 - 0.00% -
444.namd (unexplained diff vs previous) -75.00% 8.000 2.000 - -60.00% -
401.bzip2 (max) (percentage) -66.67% 3.780 1.260 - -10.64% -
433.milc (max) (percentage) -60.00% 0.800 0.320 - -25.58% -
464.h264ref (max) -58.33% 60.000 25.000 - -3.85% -
453.povray (max) -56.00% 25.000 11.000 - -15.38% -
445.gobmk -52.70% 74.000 35.000 - -7.89% -
445.gobmk (avg) -52.70% 74.000 35.000 - -7.89% -
447.dealII (max) (percentage) -45.80% 2.380 1.290 - -3.73% -
462.libquantum (max) (percentage) -44.36% 6.380 3.550 - 0.00% -
458.sjeng -34.56% 136.000 89.000 - -4.30% -
458.sjeng (avg) -34.56% 136.000 89.000 - -4.30% -
429.mcf (unexplained diff vs previous) -27.27% 22.000 16.000 - 23.08% -
470.lbm (avg) (percentage) -25.23% 3.330 2.490 - -4.60% -
433.milc (avg) (percentage) -23.26% 0.860 0.660 - -5.71% -
471.omnetpp -22.75% 167.000 129.000 - -4.44% -
471.omnetpp (avg) -22.75% 167.000 129.000 - -4.44% -
473.astar -20.54% 112.000 89.000 - -5.32% -
473.astar (avg) -20.54% 112.000 89.000 - -5.32% -
450.soplex (max) (percentage) -18.18% 1.650 1.350 - -2.88% -
403.gcc (max) (percentage) -16.74% 2.330 1.940 - -1.02% -
447.dealII (unexplained diff vs previous) (percentage) -13.79% 0.580 0.500 - 100.00% -
444.namd (avg) (percentage) -10.89% 2.570 2.290 - -4.98% -
433.milc (unexplained diff vs previous) (percentage) -10.00% 0.100 0.090 - -79.07% -
456.hmmer -4.27% 164.000 157.000 - -4.27% -
456.hmmer (avg) -4.27% 164.000 157.000 - -4.27% -

Added Tests - sample variability
403.gcc
403.gcc (avg)
456.hmmer (unexplained diff vs previous)
456.hmmer (unexplained diff vs previous) (percentage)
458.sjeng (unexplained diff vs previous)
458.sjeng (unexplained diff vs previous) (percentage)
464.h264ref (unexplained diff vs previous)
464.h264ref (unexplained diff vs previous) (percentage)
483.xalancbmk (unexplained diff vs previous)
483.xalancbmk (unexplained diff vs previous) (percentage)

Report Time: 0.36s
Execution (seconds)
Name Current %
401.bzip2 3052.000 -1.26%
403.gcc 58.000 -3.33%
429.mcf 1151.000 -1.37%
433.milc 1166.000 -
444.namd 806.000 -
445.gobmk 4918.000 -
447.dealII 2020.000 -
450.soplex 542.000 1.12%
453.povray 499.000 -
456.hmmer 3823.000 -
458.sjeng 8303.000 -
462.libquantum 184.000 -1.60%
464.h264ref 6028.000 -
470.lbm 3991.000 -
471.omnetpp 2844.000 -
473.astar 4581.000 -
482.sphinx3 1008.000 -
483.xalancbmk 3434.000 -
Geometric Mean 1567.398 -
Code Size (bytes)
Name Current %
401.bzip2 34069.000 -
403.gcc 1667159.000 -
429.mcf 7051.000 -
433.milc 46453.000 -
444.namd 124518.000 -
445.gobmk 1259065.000 -
447.dealII 197298.000 -
450.soplex 149884.000 -
453.povray 514179.000 -
456.hmmer 80333.000 -
458.sjeng 79698.000 -
462.libquantum 12290.000 -
464.h264ref 301911.000 -
470.lbm 9240.000 -
471.omnetpp 321429.000 -
473.astar 15379.000 -
482.sphinx3 87516.000 -
483.xalancbmk 1612664.000 -
Geometric Mean 111229.535 -
sample variability
Name Current %
401.bzip2 26.000 -
401.bzip2 (avg) 26.000 -
401.bzip2 (avg) (percentage) 0.880 2.33%
401.bzip2 (max) 38.000 -11.63%
401.bzip2 (max) (percentage) 1.260 -10.64%
401.bzip2 (unexplained diff vs previous) 39.000 -9.30%
401.bzip2 (unexplained diff vs previous) (percentage) 1.280 -7.91%
403.gcc 0.000 -
403.gcc (avg) 0.000 -
403.gcc (avg) (percentage) 0.750 -
403.gcc (max) 1.000 -
403.gcc (max) (percentage) 1.940 -1.02%
429.mcf 39.000 -4.88%
429.mcf (avg) 39.000 -4.88%
429.mcf (avg) (percentage) 3.460 -2.81%
429.mcf (max) 15.000 15.38%
429.mcf (max) (percentage) 1.370 21.24%
429.mcf (unexplained diff vs previous) 16.000 23.08%
429.mcf (unexplained diff vs previous) (percentage) 1.390 25.23%
433.milc 7.000 -12.50%
433.milc (avg) 7.000 -12.50%
433.milc (avg) (percentage) 0.660 -5.71%
433.milc (max) 3.000 -40.00%
433.milc (max) (percentage) 0.320 -25.58%
433.milc (unexplained diff vs previous) 1.000 -80.00%
433.milc (unexplained diff vs previous) (percentage) 0.090 -79.07%
444.namd 18.000 -5.26%
444.namd (avg) 18.000 -5.26%
444.namd (avg) (percentage) 2.290 -4.98%
444.namd (max) 4.000 -88.24%
444.namd (max) (percentage) 0.590 -86.41%
444.namd (unexplained diff vs previous) 2.000 -60.00%
444.namd (unexplained diff vs previous) (percentage) 0.250 -59.68%
445.gobmk 35.000 -7.89%
445.gobmk (avg) 35.000 -7.89%
445.gobmk (avg) (percentage) 0.720 -7.69%
445.gobmk (max) 7.000 -
445.gobmk (max) (percentage) 0.150 -
445.gobmk (unexplained diff vs previous) 2.000 -
445.gobmk (unexplained diff vs previous) (percentage) 0.040 -
447.dealII 21.000 -4.55%
447.dealII (avg) 21.000 -4.55%
447.dealII (avg) (percentage) 1.060 -3.64%
447.dealII (max) 26.000 -3.70%
447.dealII (max) (percentage) 1.290 -3.73%
447.dealII (unexplained diff vs previous) 10.000 100.00%
447.dealII (unexplained diff vs previous) (percentage) 0.500 100.00%
450.soplex 3.000 -
450.soplex (avg) 3.000 -
450.soplex (avg) (percentage) 0.710 2.90%
450.soplex (max) 7.000 -
450.soplex (max) (percentage) 1.350 -2.88%
450.soplex (unexplained diff vs previous) 6.000 500.00%
450.soplex (unexplained diff vs previous) (percentage) 1.110 484.21%
453.povray 4.000 -
453.povray (avg) 4.000 -
453.povray (avg) (percentage) 0.920 -1.08%
453.povray (max) 11.000 -15.38%
453.povray (max) (percentage) 2.380 -10.19%
453.povray (unexplained diff vs previous) 4.000 -69.23%
453.povray (unexplained diff vs previous) (percentage) 0.800 -68.99%
456.hmmer 157.000 -4.27%
456.hmmer (avg) 157.000 -4.27%
456.hmmer (avg) (percentage) 4.120 -4.19%
456.hmmer (max) 2.000 -75.00%
456.hmmer (max) (percentage) 0.060 -73.91%
456.hmmer (unexplained diff vs previous) 0.000 -
456.hmmer (unexplained diff vs previous) (percentage) 0.000 -
458.sjeng 89.000 -4.30%
458.sjeng (avg) 89.000 -4.30%
458.sjeng (avg) (percentage) 1.080 -4.42%
458.sjeng (max) 30.000 -9.09%
458.sjeng (max) (percentage) 0.370 -7.50%
458.sjeng (unexplained diff vs previous) 28.000 -15.15%
458.sjeng (unexplained diff vs previous) (percentage) 0.340 -15.00%
462.libquantum 3.000 -
462.libquantum (avg) 3.000 -
462.libquantum (avg) (percentage) 1.950 -1.02%
462.libquantum (max) 6.000 -
462.libquantum (max) (percentage) 3.550 -
462.libquantum (unexplained diff vs previous) 3.000 200.00%
462.libquantum (unexplained diff vs previous) (percentage) 1.630 207.55%
464.h264ref 54.000 -3.57%
464.h264ref (avg) 54.000 -3.57%
464.h264ref (avg) (percentage) 0.900 -4.26%
464.h264ref (max) 25.000 -3.85%
464.h264ref (max) (percentage) 0.420 -4.55%
464.h264ref (unexplained diff vs previous) 15.000 36.36%
464.h264ref (unexplained diff vs previous) (percentage) 0.250 38.89%
470.lbm 99.000 -4.81%
470.lbm (avg) 99.000 -4.81%
470.lbm (avg) (percentage) 2.490 -4.60%
470.lbm (max) 13.000 -7.14%
470.lbm (max) (percentage) 0.340 -5.56%
470.lbm (unexplained diff vs previous) 2.000 -33.33%
470.lbm (unexplained diff vs previous) (percentage) 0.050 -37.50%
471.omnetpp 129.000 -4.44%
471.omnetpp (avg) 129.000 -4.44%
471.omnetpp (avg) (percentage) 4.570 -3.79%
471.omnetpp (max) 30.000 -3.23%
471.omnetpp (max) (percentage) 1.070 -4.46%
471.omnetpp (unexplained diff vs previous) 6.000 -
471.omnetpp (unexplained diff vs previous) (percentage) 0.210 -
473.astar 89.000 -5.32%
473.astar (avg) 89.000 -5.32%
473.astar (avg) (percentage) 1.950 -5.34%
473.astar (max) 16.000 -95.93%
473.astar (max) (percentage) 0.370 -95.69%
473.astar (unexplained diff vs previous) 2.000 -88.89%
473.astar (unexplained diff vs previous) (percentage) 0.040 -89.74%
482.sphinx3 17.000 -5.56%
482.sphinx3 (avg) 17.000 -5.56%
482.sphinx3 (avg) (percentage) 1.760 -3.30%
482.sphinx3 (max) 8.000 -
482.sphinx3 (max) (percentage) 0.800 -2.44%
482.sphinx3 (unexplained diff vs previous) 8.000 60.00%
482.sphinx3 (unexplained diff vs previous) (percentage) 0.790 58.00%
483.xalancbmk 200.000 -6.54%
483.xalancbmk (avg) 200.000 -6.54%
483.xalancbmk (avg) (percentage) 5.850 -6.55%
483.xalancbmk (max) 45.000 -4.26%
483.xalancbmk (max) (percentage) 1.320 -4.35%
483.xalancbmk (unexplained diff vs previous) 3.000 -
483.xalancbmk (unexplained diff vs previous) (percentage) 0.090 -
Geometric Mean 2.836 -34.30%