Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/f88436c3f3b01a04aff4a129245a8a1b1124e7f1 (+ 720 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--llvm-aarch64-master-Oz_LTO-build/3/
View Options
Report
Filter

llvm-aarch64-master-Oz_LTO test results

Run Order Start Time Duration
Current 0003 (llvmorg-17-init-03384-gf88436c3f3b0) 2023-02-17T10:25:36 0:00:00
Previous 0003 (llvmorg-16-init-17780-g6b0cd497b0fb) 2023-01-10T09:45:10 0:00:00
Baseline 0001 (llvmorg-16-init-17110-gb1256f2345f6) 2022-12-17T20:51:03 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 25 20
Performance Improvements 101 90
Added Tests 10 26
Unchanged Tests 620 620
Total Tests 756

Run-Over-Run Changes Detail

Performance Regressions - Code Size Δ Previous Current σ Δ (B) σ (B)
450.soplex 3.34% 224407.000 231906.000 - 3.34% -
447.dealII 1.15% 325223.000 328959.000 - 1.15% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
444.namd (unexplained diff vs previous) (percentage) 2200.00% 0.070 1.610 - 0.00% -
473.astar (unexplained diff vs previous) (percentage) 966.67% 0.030 0.320 - 0.00% -
458.sjeng (unexplained diff vs previous) (percentage) 600.00% 0.010 0.070 - 0.00% -
429.mcf (unexplained diff vs previous) (percentage) 544.44% 0.090 0.580 - 0.00% -
401.bzip2 (max) (percentage) 538.46% 0.130 0.830 - 1560.00% -
401.bzip2 (unexplained diff vs previous) (percentage) 530.77% 0.130 0.820 - 0.00% -
473.astar (max) (percentage) 300.00% 0.080 0.320 - 300.00% -
473.astar (unexplained diff vs previous) 300.00% 4.000 16.000 - 0.00% -
458.sjeng (unexplained diff vs previous) 150.00% 2.000 5.000 - 0.00% -
401.bzip2 (avg) (percentage) 100.00% 0.100 0.200 - 100.00% -
433.milc (unexplained diff vs previous) (percentage) 100.00% 0.080 0.160 - 700.00% -
429.mcf (max) (percentage) 75.76% 0.330 0.580 - 61.11% -
473.astar (avg) (percentage) 66.67% 0.060 0.100 - 42.86% -
473.astar (max) 60.00% 10.000 16.000 - 60.00% -
444.namd (unexplained diff vs previous) 57.14% 7.000 11.000 - 0.00% -
462.libquantum (unexplained diff vs previous) (percentage) 45.10% 0.510 0.740 - 0.00% -
462.libquantum (max) (percentage) 39.62% 0.530 0.740 - 1750.00% -
401.bzip2 (max) 27.78% 18.000 23.000 - 283.33% -
401.bzip2 (unexplained diff vs previous) 27.78% 18.000 23.000 - 0.00% -
482.sphinx3 (max) (percentage) 25.00% 0.600 0.750 - 8.70% -
462.libquantum (avg) (percentage) 9.09% 0.220 0.240 - 118.18% -

Performance Regressions - Score Δ Previous Current σ Δ (B) σ (B)
nb_compile_successful -5.26% 19.000 18.000 - -5.26% -
nb_execution_successful -5.26% 19.000 18.000 - -5.26% -

Performance Improvements - Code Size Δ Previous Current σ Δ (B) σ (B)
471.omnetpp -2.86% 490151.000 476109.000 - -2.86% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
403.gcc -99.35% 10138.000 66.000 - -99.35% -
462.libquantum -98.60% 9667.000 135.000 - -98.60% -
482.sphinx3 -96.56% 23765.000 818.000 - -96.56% -
450.soplex -96.24% 13991.000 526.000 - -96.24% -
444.namd -92.69% 9366.000 685.000 - -92.69% -
453.povray -92.68% 7337.000 537.000 - -92.64% -
433.milc -91.44% 14586.000 1248.000 - -91.45% -
429.mcf -89.88% 18901.000 1912.000 - -89.89% -
400.perlbench -82.97% 11272.000 1920.000 - -82.68% -
401.bzip2 -80.04% 13971.000 2789.000 - -80.02% -
447.dealII -79.27% 9010.000 1868.000 - -79.48% -
471.omnetpp -74.69% 11976.000 3031.000 - -74.57% -
470.lbm -71.16% 11077.000 3195.000 - -71.08% -
456.hmmer -69.27% 9083.000 2791.000 - -69.40% -
464.h264ref -62.54% 12081.000 4525.000 - -62.73% -
473.astar -62.17% 13301.000 5032.000 - -62.17% -
445.gobmk -53.93% 11694.000 5387.000 - -53.83% -
458.sjeng -51.96% 15325.000 7362.000 - -51.83% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
433.milc (max) -99.60% 247.000 1.000 - -99.63% -
450.soplex (unexplained diff vs previous) -98.18% 55.000 1.000 - 0.00% -
450.soplex (max) -98.15% 54.000 1.000 - -99.35% -
462.libquantum (unexplained diff vs previous) -97.96% 49.000 1.000 - 0.00% -
444.namd (max) -97.75% 445.000 10.000 - -97.94% -
482.sphinx3 -97.22% 216.000 6.000 - -97.22% -
482.sphinx3 (avg) -97.22% 216.000 6.000 - -97.22% -
450.soplex -97.10% 69.000 2.000 - -97.33% -
450.soplex (avg) -97.10% 69.000 2.000 - -97.33% -
482.sphinx3 (max) -95.77% 142.000 6.000 - -96.34% -
444.namd -94.44% 162.000 9.000 - -95.77% -
444.namd (avg) -94.44% 162.000 9.000 - -95.77% -
453.povray (max) -94.37% 71.000 4.000 - -94.81% -
453.povray -94.34% 53.000 3.000 - -94.34% -
453.povray (avg) -94.34% 53.000 3.000 - -94.34% -
433.milc -93.75% 96.000 6.000 - -95.04% -
433.milc (avg) -93.75% 96.000 6.000 - -95.04% -
464.h264ref (max) -93.33% 30.000 2.000 - -93.75% -
456.hmmer (unexplained diff vs previous) -93.15% 146.000 10.000 - 0.00% -
447.dealII (max) -92.24% 116.000 9.000 - -92.86% -
471.omnetpp (max) -91.01% 89.000 8.000 - -93.28% -
429.mcf -90.74% 54.000 5.000 - -92.75% -
429.mcf (avg) -90.74% 54.000 5.000 - -92.75% -
433.milc (max) (percentage) -90.59% 1.700 0.160 - -91.35% -
400.perlbench (max) -85.33% 75.000 11.000 - -85.71% -
400.perlbench -84.21% 57.000 9.000 - -83.93% -
400.perlbench (avg) -84.21% 57.000 9.000 - -83.93% -
433.milc (unexplained diff vs previous) -83.33% 12.000 2.000 - -33.33% -
429.mcf (max) -82.26% 62.000 11.000 - -83.82% -
447.dealII -81.01% 79.000 15.000 - -81.71% -
447.dealII (avg) -81.01% 79.000 15.000 - -81.71% -
464.h264ref (max) (percentage) -80.00% 0.250 0.050 - -81.48% -
471.omnetpp -79.03% 62.000 13.000 - -81.69% -
471.omnetpp (avg) -79.03% 62.000 13.000 - -81.69% -
470.lbm (max) -78.85% 104.000 22.000 - 266.67% -
456.hmmer (max) -78.32% 143.000 31.000 - -54.41% -
456.hmmer (unexplained diff vs previous) (percentage) -77.64% 1.610 0.360 - 0.00% -
470.lbm (unexplained diff vs previous) -77.01% 87.000 20.000 - 0.00% -
470.lbm -75.68% 74.000 18.000 - -71.88% -
470.lbm (avg) -75.68% 74.000 18.000 - -71.88% -
456.hmmer -73.33% 90.000 24.000 - -70.00% -
456.hmmer (avg) -73.33% 90.000 24.000 - -70.00% -
464.h264ref -68.18% 44.000 14.000 - -68.18% -
464.h264ref (avg) -68.18% 44.000 14.000 - -68.18% -
444.namd (max) (percentage) -66.81% 4.760 1.580 - -69.50% -
471.omnetpp (max) (percentage) -64.00% 0.750 0.270 - -73.00% -
458.sjeng -63.33% 30.000 11.000 - -68.57% -
458.sjeng (avg) -63.33% 30.000 11.000 - -68.57% -
445.gobmk -62.16% 37.000 14.000 - -62.16% -
445.gobmk (avg) -62.16% 37.000 14.000 - -62.16% -
401.bzip2 -61.54% 13.000 5.000 - -61.54% -
401.bzip2 (avg) -61.54% 13.000 5.000 - -61.54% -
445.gobmk (max) -59.38% 64.000 26.000 - -62.86% -
447.dealII (max) (percentage) -58.91% 1.290 0.530 - -61.87% -
458.sjeng (max) -54.55% 33.000 15.000 - -57.14% -
450.soplex (unexplained diff vs previous) (percentage) -51.28% 0.390 0.190 - 0.00% -
429.mcf (unexplained diff vs previous) -35.29% 17.000 11.000 - 0.00% -
473.astar -28.57% 7.000 5.000 - -44.44% -
473.astar (avg) -28.57% 7.000 5.000 - -44.44% -
456.hmmer (max) (percentage) -27.85% 1.580 1.140 - 52.00% -
433.milc (avg) (percentage) -25.76% 0.660 0.490 - -40.96% -
450.soplex (max) (percentage) -25.64% 0.390 0.290 - -73.64% -
470.lbm (max) (percentage) -24.47% 0.940 0.710 - 1083.33% -
470.lbm (unexplained diff vs previous) (percentage) -20.25% 0.790 0.630 - 0.00% -
444.namd (avg) (percentage) -20.23% 1.730 1.380 - -39.47% -
458.sjeng (avg) (percentage) -20.00% 0.200 0.160 - -30.43% -
445.gobmk (avg) (percentage) -18.75% 0.320 0.260 - -18.75% -
482.sphinx3 (avg) (percentage) -14.29% 0.910 0.780 - -14.29% -
464.h264ref (avg) (percentage) -13.51% 0.370 0.320 - -13.51% -
450.soplex (avg) (percentage) -12.00% 0.500 0.440 - -18.52% -
470.lbm (avg) (percentage) -11.94% 0.670 0.590 - 1.72% -
471.omnetpp (avg) (percentage) -11.54% 0.520 0.460 - -23.33% -
456.hmmer (avg) (percentage) -11.00% 1.000 0.890 - 1.14% -
445.gobmk (max) (percentage) -10.91% 0.550 0.490 - -18.33% -
400.perlbench (max) (percentage) -10.45% 0.670 0.600 - -14.29% -
453.povray (max) (percentage) -9.28% 0.970 0.880 - -16.98% -
483.xalancbmk (max) (percentage) -8.33% 0.480 0.440 - -13.73% -
453.povray (avg) (percentage) -8.22% 0.730 0.670 - -8.22% -
403.gcc (max) (percentage) -7.89% 0.380 0.350 - -12.50% -
429.mcf (avg) (percentage) -6.90% 0.290 0.270 - -27.03% -
458.sjeng (max) (percentage) -4.55% 0.220 0.210 - -8.70% -
447.dealII (avg) (percentage) -3.41% 0.880 0.850 - -6.59% -

Added Tests - sample variability
403.gcc
403.gcc (avg)
403.gcc (max)
445.gobmk (unexplained diff vs previous)
445.gobmk (unexplained diff vs previous) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (max)
482.sphinx3 (unexplained diff vs previous)
482.sphinx3 (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
450.soplex 3.34% 224407.000 231906.000 - 3.34% -
447.dealII 1.15% 325219.000 328959.000 - 1.15% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
462.libquantum (max) (percentage) 1750.00% 0.040 0.740 - 39.62% -
401.bzip2 (max) (percentage) 1560.00% 0.050 0.830 - 538.46% -
470.lbm (max) (percentage) 1083.33% 0.060 0.710 - -24.47% -
433.milc (unexplained diff vs previous) (percentage) 700.00% 0.020 0.160 - 100.00% -
473.astar (max) (percentage) 300.00% 0.080 0.320 - 300.00% -
401.bzip2 (max) 283.33% 6.000 23.000 - 27.78% -
470.lbm (max) 266.67% 6.000 22.000 - -78.85% -
462.libquantum (avg) (percentage) 118.18% 0.110 0.240 - 9.09% -
401.bzip2 (avg) (percentage) 100.00% 0.100 0.200 - 100.00% -
429.mcf (max) (percentage) 61.11% 0.360 0.580 - 75.76% -
473.astar (max) 60.00% 10.000 16.000 - 60.00% -
456.hmmer (max) (percentage) 52.00% 0.750 1.140 - -27.85% -
473.astar (avg) (percentage) 42.86% 0.070 0.100 - 66.67% -
482.sphinx3 (max) (percentage) 8.70% 0.690 0.750 - 25.00% -
470.lbm (avg) (percentage) 1.72% 0.580 0.590 - -11.94% -
456.hmmer (avg) (percentage) 1.14% 0.880 0.890 - -11.00% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -5.26% 19.000 18.000 - -5.26% -
nb_execution_successful -5.26% 19.000 18.000 - -5.26% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
471.omnetpp -2.86% 490147.000 476109.000 - -2.86% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
403.gcc -99.35% 10150.000 66.000 - -99.35% -
462.libquantum -98.60% 9659.000 135.000 - -98.60% -
482.sphinx3 -96.56% 23779.000 818.000 - -96.56% -
450.soplex -96.24% 13988.000 526.000 - -96.24% -
444.namd -92.69% 9377.000 685.000 - -92.69% -
453.povray -92.64% 7301.000 537.000 - -92.68% -
433.milc -91.45% 14590.000 1248.000 - -91.44% -
429.mcf -89.89% 18905.000 1912.000 - -89.88% -
400.perlbench -82.68% 11085.000 1920.000 - -82.97% -
401.bzip2 -80.02% 13962.000 2789.000 - -80.04% -
447.dealII -79.48% 9102.000 1868.000 - -79.27% -
471.omnetpp -74.57% 11917.000 3031.000 - -74.69% -
470.lbm -71.08% 11046.000 3195.000 - -71.16% -
456.hmmer -69.40% 9122.000 2791.000 - -69.27% -
464.h264ref -62.73% 12142.000 4525.000 - -62.54% -
473.astar -62.17% 13301.000 5032.000 - -62.17% -
445.gobmk -53.83% 11668.000 5387.000 - -53.93% -
458.sjeng -51.83% 15282.000 7362.000 - -51.96% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
433.milc (max) -99.63% 269.000 1.000 - -99.60% -
450.soplex (max) -99.35% 153.000 1.000 - -98.15% -
482.sphinx3 (unexplained diff vs previous) -98.77% 162.000 2.000 - 0.00% -
444.namd (max) -97.94% 485.000 10.000 - -97.75% -
450.soplex -97.33% 75.000 2.000 - -97.10% -
450.soplex (avg) -97.33% 75.000 2.000 - -97.10% -
482.sphinx3 -97.22% 216.000 6.000 - -97.22% -
482.sphinx3 (avg) -97.22% 216.000 6.000 - -97.22% -
482.sphinx3 (max) -96.34% 164.000 6.000 - -95.77% -
444.namd -95.77% 213.000 9.000 - -94.44% -
444.namd (avg) -95.77% 213.000 9.000 - -94.44% -
433.milc -95.04% 121.000 6.000 - -93.75% -
433.milc (avg) -95.04% 121.000 6.000 - -93.75% -
453.povray (max) -94.81% 77.000 4.000 - -94.37% -
453.povray -94.34% 53.000 3.000 - -94.34% -
453.povray (avg) -94.34% 53.000 3.000 - -94.34% -
464.h264ref (max) -93.75% 32.000 2.000 - -93.33% -
471.omnetpp (max) -93.28% 119.000 8.000 - -91.01% -
447.dealII (max) -92.86% 126.000 9.000 - -92.24% -
429.mcf -92.75% 69.000 5.000 - -90.74% -
429.mcf (avg) -92.75% 69.000 5.000 - -90.74% -
433.milc (max) (percentage) -91.35% 1.850 0.160 - -90.59% -
400.perlbench (max) -85.71% 77.000 11.000 - -85.33% -
400.perlbench -83.93% 56.000 9.000 - -84.21% -
400.perlbench (avg) -83.93% 56.000 9.000 - -84.21% -
429.mcf (max) -83.82% 68.000 11.000 - -82.26% -
447.dealII -81.71% 82.000 15.000 - -81.01% -
447.dealII (avg) -81.71% 82.000 15.000 - -81.01% -
471.omnetpp -81.69% 71.000 13.000 - -79.03% -
471.omnetpp (avg) -81.69% 71.000 13.000 - -79.03% -
464.h264ref (max) (percentage) -81.48% 0.270 0.050 - -80.00% -
450.soplex (max) (percentage) -73.64% 1.100 0.290 - -25.64% -
471.omnetpp (max) (percentage) -73.00% 1.000 0.270 - -64.00% -
470.lbm -71.88% 64.000 18.000 - -75.68% -
470.lbm (avg) -71.88% 64.000 18.000 - -75.68% -
456.hmmer -70.00% 80.000 24.000 - -73.33% -
456.hmmer (avg) -70.00% 80.000 24.000 - -73.33% -
444.namd (max) (percentage) -69.50% 5.180 1.580 - -66.81% -
458.sjeng -68.57% 35.000 11.000 - -63.33% -
458.sjeng (avg) -68.57% 35.000 11.000 - -63.33% -
464.h264ref -68.18% 44.000 14.000 - -68.18% -
464.h264ref (avg) -68.18% 44.000 14.000 - -68.18% -
482.sphinx3 (unexplained diff vs previous) (percentage) -64.71% 0.680 0.240 - 0.00% -
445.gobmk (max) -62.86% 70.000 26.000 - -59.38% -
445.gobmk -62.16% 37.000 14.000 - -62.16% -
445.gobmk (avg) -62.16% 37.000 14.000 - -62.16% -
447.dealII (max) (percentage) -61.87% 1.390 0.530 - -58.91% -
401.bzip2 -61.54% 13.000 5.000 - -61.54% -
401.bzip2 (avg) -61.54% 13.000 5.000 - -61.54% -
458.sjeng (max) -57.14% 35.000 15.000 - -54.55% -
456.hmmer (max) -54.41% 68.000 31.000 - -78.32% -
473.astar -44.44% 9.000 5.000 - -28.57% -
473.astar (avg) -44.44% 9.000 5.000 - -28.57% -
433.milc (avg) (percentage) -40.96% 0.830 0.490 - -25.76% -
444.namd (avg) (percentage) -39.47% 2.280 1.380 - -20.23% -
433.milc (unexplained diff vs previous) -33.33% 3.000 2.000 - -83.33% -
458.sjeng (avg) (percentage) -30.43% 0.230 0.160 - -20.00% -
429.mcf (avg) (percentage) -27.03% 0.370 0.270 - -6.90% -
471.omnetpp (avg) (percentage) -23.33% 0.600 0.460 - -11.54% -
445.gobmk (avg) (percentage) -18.75% 0.320 0.260 - -18.75% -
450.soplex (avg) (percentage) -18.52% 0.540 0.440 - -12.00% -
445.gobmk (max) (percentage) -18.33% 0.600 0.490 - -10.91% -
453.povray (max) (percentage) -16.98% 1.060 0.880 - -9.28% -
482.sphinx3 (avg) (percentage) -14.29% 0.910 0.780 - -14.29% -
400.perlbench (max) (percentage) -14.29% 0.700 0.600 - -10.45% -
483.xalancbmk (max) (percentage) -13.73% 0.510 0.440 - -8.33% -
464.h264ref (avg) (percentage) -13.51% 0.370 0.320 - -13.51% -
403.gcc (max) (percentage) -12.50% 0.400 0.350 - -7.89% -
458.sjeng (max) (percentage) -8.70% 0.230 0.210 - -4.55% -
453.povray (avg) (percentage) -8.22% 0.730 0.670 - -8.22% -
447.dealII (avg) (percentage) -6.59% 0.910 0.850 - -3.41% -

Added Tests - sample variability
401.bzip2 (unexplained diff vs previous)
401.bzip2 (unexplained diff vs previous) (percentage)
403.gcc
403.gcc (avg)
403.gcc (max)
429.mcf (unexplained diff vs previous)
429.mcf (unexplained diff vs previous) (percentage)
444.namd (unexplained diff vs previous)
444.namd (unexplained diff vs previous) (percentage)
445.gobmk (unexplained diff vs previous)
445.gobmk (unexplained diff vs previous) (percentage)
450.soplex (unexplained diff vs previous)
450.soplex (unexplained diff vs previous) (percentage)
456.hmmer (unexplained diff vs previous)
456.hmmer (unexplained diff vs previous) (percentage)
458.sjeng (unexplained diff vs previous)
458.sjeng (unexplained diff vs previous) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (max)
462.libquantum (unexplained diff vs previous)
462.libquantum (unexplained diff vs previous) (percentage)
470.lbm (unexplained diff vs previous)
470.lbm (unexplained diff vs previous) (percentage)
473.astar (unexplained diff vs previous)
473.astar (unexplained diff vs previous) (percentage)

Report Time: 0.35s
Execution (seconds)
Name Current %
400.perlbench 1920.000 -82.97%
401.bzip2 2789.000 -80.04%
403.gcc 66.000 -99.35%
429.mcf 1912.000 -89.88%
433.milc 1248.000 -91.44%
444.namd 685.000 -92.69%
445.gobmk 5387.000 -53.93%
447.dealII 1868.000 -79.27%
450.soplex 526.000 -96.24%
453.povray 537.000 -92.68%
456.hmmer 2791.000 -69.27%
458.sjeng 7362.000 -51.96%
462.libquantum 135.000 -98.60%
464.h264ref 4525.000 -62.54%
470.lbm 3195.000 -71.16%
471.omnetpp 3031.000 -74.69%
473.astar 5032.000 -62.17%
482.sphinx3 818.000 -96.56%
Geometric Mean 1451.857 -87.99%
Code Size (bytes)
Name Current %
400.perlbench 900398.000 -
401.bzip2 44312.000 -
403.gcc 2485392.000 -
429.mcf 9236.000 -
433.milc 62890.000 -
444.namd 143404.000 -
445.gobmk 1852150.000 -
447.dealII 328959.000 1.15%
450.soplex 231906.000 3.34%
453.povray 691409.000 -
456.hmmer 113544.000 -
458.sjeng 106823.000 -
462.libquantum 16880.000 -
464.h264ref 400309.000 -
470.lbm 10304.000 -
471.omnetpp 476109.000 -2.86%
473.astar 23764.000 -
482.sphinx3 120093.000 -
Geometric Mean 146153.926 -
Score
Name Current %
nb_compile_successful 18.000 -5.26%
nb_execution_successful 18.000 -5.26%
nb_total_tests 19.000 -
Geometric Mean 18.327 -3.54%
sample variability
Name Current %
400.perlbench 9.000 -84.21%
400.perlbench (avg) 9.000 -84.21%
400.perlbench (avg) (percentage) 0.510 -
400.perlbench (max) 11.000 -85.33%
400.perlbench (max) (percentage) 0.600 -10.45%
401.bzip2 5.000 -61.54%
401.bzip2 (avg) 5.000 -61.54%
401.bzip2 (avg) (percentage) 0.200 100.00%
401.bzip2 (max) 23.000 27.78%
401.bzip2 (max) (percentage) 0.830 538.46%
401.bzip2 (unexplained diff vs previous) 23.000 27.78%
401.bzip2 (unexplained diff vs previous) (percentage) 0.820 530.77%
403.gcc 0.000 -
403.gcc (avg) 0.000 -
403.gcc (avg) (percentage) 0.310 -
403.gcc (max) 0.000 -
403.gcc (max) (percentage) 0.350 -7.89%
429.mcf 5.000 -90.74%
429.mcf (avg) 5.000 -90.74%
429.mcf (avg) (percentage) 0.270 -6.90%
429.mcf (max) 11.000 -82.26%
429.mcf (max) (percentage) 0.580 75.76%
429.mcf (unexplained diff vs previous) 11.000 -35.29%
429.mcf (unexplained diff vs previous) (percentage) 0.580 544.44%
433.milc 6.000 -93.75%
433.milc (avg) 6.000 -93.75%
433.milc (avg) (percentage) 0.490 -25.76%
433.milc (max) 1.000 -99.60%
433.milc (max) (percentage) 0.160 -90.59%
433.milc (unexplained diff vs previous) 2.000 -83.33%
433.milc (unexplained diff vs previous) (percentage) 0.160 100.00%
444.namd 9.000 -94.44%
444.namd (avg) 9.000 -94.44%
444.namd (avg) (percentage) 1.380 -20.23%
444.namd (max) 10.000 -97.75%
444.namd (max) (percentage) 1.580 -66.81%
444.namd (unexplained diff vs previous) 11.000 57.14%
444.namd (unexplained diff vs previous) (percentage) 1.610 2200.00%
445.gobmk 14.000 -62.16%
445.gobmk (avg) 14.000 -62.16%
445.gobmk (avg) (percentage) 0.260 -18.75%
445.gobmk (max) 26.000 -59.38%
445.gobmk (max) (percentage) 0.490 -10.91%
445.gobmk (unexplained diff vs previous) 0.000 -
445.gobmk (unexplained diff vs previous) (percentage) 0.000 -
447.dealII 15.000 -81.01%
447.dealII (avg) 15.000 -81.01%
447.dealII (avg) (percentage) 0.850 -3.41%
447.dealII (max) 9.000 -92.24%
447.dealII (max) (percentage) 0.530 -58.91%
450.soplex 2.000 -97.10%
450.soplex (avg) 2.000 -97.10%
450.soplex (avg) (percentage) 0.440 -12.00%
450.soplex (max) 1.000 -98.15%
450.soplex (max) (percentage) 0.290 -25.64%
450.soplex (unexplained diff vs previous) 1.000 -98.18%
450.soplex (unexplained diff vs previous) (percentage) 0.190 -51.28%
453.povray 3.000 -94.34%
453.povray (avg) 3.000 -94.34%
453.povray (avg) (percentage) 0.670 -8.22%
453.povray (max) 4.000 -94.37%
453.povray (max) (percentage) 0.880 -9.28%
456.hmmer 24.000 -73.33%
456.hmmer (avg) 24.000 -73.33%
456.hmmer (avg) (percentage) 0.890 -11.00%
456.hmmer (max) 31.000 -78.32%
456.hmmer (max) (percentage) 1.140 -27.85%
456.hmmer (unexplained diff vs previous) 10.000 -93.15%
456.hmmer (unexplained diff vs previous) (percentage) 0.360 -77.64%
458.sjeng 11.000 -63.33%
458.sjeng (avg) 11.000 -63.33%
458.sjeng (avg) (percentage) 0.160 -20.00%
458.sjeng (max) 15.000 -54.55%
458.sjeng (max) (percentage) 0.210 -4.55%
458.sjeng (unexplained diff vs previous) 5.000 150.00%
458.sjeng (unexplained diff vs previous) (percentage) 0.070 600.00%
462.libquantum 0.000 -
462.libquantum (avg) 0.000 -
462.libquantum (avg) (percentage) 0.240 9.09%
462.libquantum (max) 0.000 -
462.libquantum (max) (percentage) 0.740 39.62%
462.libquantum (unexplained diff vs previous) 1.000 -97.96%
462.libquantum (unexplained diff vs previous) (percentage) 0.740 45.10%
464.h264ref 14.000 -68.18%
464.h264ref (avg) 14.000 -68.18%
464.h264ref (avg) (percentage) 0.320 -13.51%
464.h264ref (max) 2.000 -93.33%
464.h264ref (max) (percentage) 0.050 -80.00%
470.lbm 18.000 -75.68%
470.lbm (avg) 18.000 -75.68%
470.lbm (avg) (percentage) 0.590 -11.94%
470.lbm (max) 22.000 -78.85%
470.lbm (max) (percentage) 0.710 -24.47%
470.lbm (unexplained diff vs previous) 20.000 -77.01%
470.lbm (unexplained diff vs previous) (percentage) 0.630 -20.25%
471.omnetpp 13.000 -79.03%
471.omnetpp (avg) 13.000 -79.03%
471.omnetpp (avg) (percentage) 0.460 -11.54%
471.omnetpp (max) 8.000 -91.01%
471.omnetpp (max) (percentage) 0.270 -64.00%
473.astar 5.000 -28.57%
473.astar (avg) 5.000 -28.57%
473.astar (avg) (percentage) 0.100 66.67%
473.astar (max) 16.000 60.00%
473.astar (max) (percentage) 0.320 300.00%
473.astar (unexplained diff vs previous) 16.000 300.00%
473.astar (unexplained diff vs previous) (percentage) 0.320 966.67%
482.sphinx3 6.000 -97.22%
482.sphinx3 (avg) 6.000 -97.22%
482.sphinx3 (avg) (percentage) 0.780 -14.29%
482.sphinx3 (max) 6.000 -95.77%
482.sphinx3 (max) (percentage) 0.750 25.00%
482.sphinx3 (unexplained diff vs previous) 2.000 -
482.sphinx3 (unexplained diff vs previous) (percentage) 0.240 -
483.xalancbmk (avg) (percentage) 0.430 -
483.xalancbmk (max) (percentage) 0.440 -8.33%
Geometric Mean 1.029 -81.02%