Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/ebef44067bd0a2cd776b8baea39cffa7f602ce7b (+ 680 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--llvm-arm-master-Oz_LTO-build/222/
View Options
Report
Filter

llvm-arm-master-Oz_LTO test results

Run Order Start Time Duration
Current 0222 (llvmorg-20-init-17838-gebef44067bd0) 2025-01-10T06:53:26 0:00:00
Previous 0220 (llvmorg-20-init-17158-g91ab10e8d6c2) 2025-01-05T12:34:23 0:00:00
Baseline 0001 (llvmorg-16-init-17036-g4f40923103d2) 2023-01-06T17:55:45 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 19 21
Performance Improvements 54 125
Added Tests 2 2
Unchanged Tests 693 620
Total Tests 768

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
403.gcc 1.72% 58.000 59.000 - -99.38% -
453.povray 1.44% 486.000 493.000 - -92.94% -
482.sphinx3 1.23% 979.000 991.000 - -96.29% -
450.soplex 1.11% 541.000 547.000 - -96.38% -
462.libquantum 1.09% 183.000 185.000 - -98.72% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
450.soplex (unexplained diff vs previous) 200.00% 2.000 6.000 - -91.30% -
450.soplex (unexplained diff vs previous) (percentage) 197.30% 0.370 1.100 - 139.13% -
403.gcc 100.00% 1.000 2.000 - -96.15% -
403.gcc (avg) 100.00% 1.000 2.000 - -96.15% -
429.mcf (unexplained diff vs previous) 75.00% 4.000 7.000 - -68.18% -
429.mcf (unexplained diff vs previous) (percentage) 74.29% 0.350 0.610 - 281.25% -
471.omnetpp (unexplained diff vs previous) (percentage) 46.15% 0.390 0.570 - -41.84% -
471.omnetpp (unexplained diff vs previous) 45.45% 11.000 16.000 - -84.47% -
447.dealII (unexplained diff vs previous) (percentage) 31.88% 1.380 1.820 - 213.79% -
447.dealII (unexplained diff vs previous) 29.63% 27.000 35.000 - -35.19% -
447.dealII (max) (percentage) 27.86% 1.400 1.790 - -24.79% -
447.dealII (max) 25.93% 27.000 34.000 - -84.75% -
447.dealII (avg) (percentage) 2.70% 0.740 0.760 - -27.62% -
482.sphinx3 (avg) (percentage) 1.19% 0.840 0.850 - -51.15% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
447.dealII -1.79% 1956.000 1921.000 - -79.52% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
464.h264ref (unexplained diff vs previous) -83.33% 6.000 1.000 - 0.00% -
464.h264ref (unexplained diff vs previous) (percentage) -80.00% 0.100 0.020 - 0.00% -
470.lbm (unexplained diff vs previous) -72.22% 18.000 5.000 - -99.38% -
470.lbm (unexplained diff vs previous) (percentage) -71.11% 0.450 0.130 - -97.85% -
444.namd (max) (percentage) -51.72% 0.580 0.280 - -96.54% -
444.namd (max) -50.00% 4.000 2.000 - -99.80% -
473.astar (unexplained diff vs previous) -50.00% 16.000 8.000 - -68.00% -
473.astar (unexplained diff vs previous) (percentage) -48.57% 0.350 0.180 - -10.00% -
444.namd (unexplained diff vs previous) -33.33% 3.000 2.000 - -75.00% -
444.namd (unexplained diff vs previous) (percentage) -32.43% 0.370 0.250 - 316.67% -
482.sphinx3 (unexplained diff vs previous) (percentage) -25.77% 1.630 1.210 - -64.72% -
482.sphinx3 (unexplained diff vs previous) -25.00% 16.000 12.000 - -98.69% -
453.povray (max) -20.00% 10.000 8.000 - -68.00% -
453.povray (max) (percentage) -16.19% 2.100 1.760 - 388.89% -
445.gobmk (max) -14.29% 14.000 12.000 - -97.09% -
471.omnetpp (max) -11.76% 34.000 30.000 - -96.91% -
471.omnetpp (max) (percentage) -11.48% 1.220 1.080 - -88.36% -
450.soplex (max) -10.71% 28.000 25.000 - -89.96% -
470.lbm (max) -10.45% 134.000 120.000 - -84.17% -
458.sjeng (max) -10.42% 48.000 43.000 - -95.09% -
445.gobmk (max) (percentage) -10.34% 0.290 0.260 - -93.03% -
458.sjeng (max) (percentage) -10.17% 0.590 0.530 - -89.69% -
470.lbm (max) (percentage) -10.12% 3.360 3.020 - -47.20% -
401.bzip2 (max) (percentage) -9.70% 2.680 2.420 - -35.98% -
401.bzip2 (max) -9.33% 75.000 68.000 - -88.83% -
445.gobmk (unexplained diff vs previous) -9.09% 11.000 10.000 - -75.00% -
433.milc (max) -8.82% 68.000 62.000 - -42.59% -
445.gobmk (unexplained diff vs previous) (percentage) -8.70% 0.230 0.210 - -41.67% -
450.soplex (max) (percentage) -8.67% 5.190 4.740 - 187.27% -
433.milc (max) (percentage) -8.58% 5.830 5.330 - 566.25% -
473.astar (max) -8.47% 59.000 54.000 - -93.43% -
473.astar (max) (percentage) -7.69% 1.300 1.200 - -82.09% -
429.mcf (max) -7.06% 85.000 79.000 - -96.54% -
429.mcf -6.25% 16.000 15.000 - -94.93% -
429.mcf (avg) -6.25% 16.000 15.000 - -94.93% -
462.libquantum (max) (percentage) -6.02% 2.990 2.810 - -55.96% -
429.mcf (max) (percentage) -5.68% 7.400 6.980 - -57.20% -
464.h264ref (max) -5.41% 37.000 35.000 - -41.67% -
464.h264ref (max) (percentage) -4.76% 0.630 0.600 - 42.86% -
473.astar -4.35% 23.000 22.000 - -80.36% -
473.astar (avg) -4.35% 23.000 22.000 - -80.36% -
482.sphinx3 (max) (percentage) -3.93% 3.560 3.420 - 3.32% -
482.sphinx3 (max) -2.94% 34.000 33.000 - -96.26% -
471.omnetpp -2.63% 38.000 37.000 - -77.84% -
471.omnetpp (avg) -2.63% 38.000 37.000 - -77.84% -
403.gcc (max) (percentage) -2.32% 4.750 4.640 - 99.14% -
401.bzip2 (avg) (percentage) -2.04% 0.490 0.480 - -26.15% -
473.astar (avg) (percentage) -1.96% 0.510 0.500 - -45.65% -
470.lbm (avg) (percentage) -1.61% 0.620 0.610 - -81.68% -
456.hmmer (avg) (percentage) -1.56% 0.640 0.630 - -54.68% -
429.mcf (avg) (percentage) -1.42% 1.410 1.390 - -34.43% -
444.namd (avg) (percentage) -1.39% 0.720 0.710 - -72.37% -
433.milc (avg) (percentage) -1.20% 0.830 0.820 - -4.65% -

Added Tests - sample variability
453.povray (unexplained diff vs previous)
453.povray (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
450.soplex 2.23% 146765.000 150036.000 - 0.00% -
471.omnetpp 2.08% 316676.000 323250.000 - 0.00% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
462.libquantum (unexplained diff vs previous) (percentage) 10700.00% 0.010 1.080 - -0.92% -
433.milc (max) (percentage) 566.25% 0.800 5.330 - -8.58% -
403.gcc (avg) (percentage) 516.36% 0.550 3.390 - 0.00% -
453.povray (max) (percentage) 388.89% 0.360 1.760 - -16.19% -
444.namd (unexplained diff vs previous) (percentage) 316.67% 0.060 0.250 - -32.43% -
429.mcf (unexplained diff vs previous) (percentage) 281.25% 0.160 0.610 - 74.29% -
433.milc (unexplained diff vs previous) (percentage) 240.00% 0.100 0.340 - 0.00% -
447.dealII (unexplained diff vs previous) (percentage) 213.79% 0.580 1.820 - 31.88% -
450.soplex (avg) (percentage) 192.00% 0.500 1.460 - 0.00% -
450.soplex (max) (percentage) 187.27% 1.650 4.740 - -8.67% -
450.soplex (unexplained diff vs previous) (percentage) 139.13% 0.460 1.100 - 197.30% -
462.libquantum (avg) (percentage) 103.90% 0.770 1.570 - -0.63% -
462.libquantum (unexplained diff vs previous) 100.00% 1.000 2.000 - 0.00% -
403.gcc (max) (percentage) 99.14% 2.330 4.640 - -2.32% -
464.h264ref (max) (percentage) 42.86% 0.420 0.600 - -4.76% -
453.povray (avg) (percentage) 30.00% 0.800 1.040 - 0.97% -
482.sphinx3 (max) (percentage) 3.32% 3.310 3.420 - -3.93% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_execution_successful -5.56% 18.000 17.000 - 0.00% -
nb_compile_successful -5.26% 19.000 18.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
429.mcf -4.31% 7239.000 6927.000 - 0.00% -
462.libquantum -3.59% 12504.000 12055.000 - 0.00% -
453.povray -2.37% 524493.000 512076.000 - 0.00% -
433.milc -2.24% 47001.000 45949.000 - 0.00% -
464.h264ref -1.98% 303767.000 297765.000 - 0.00% -
444.namd -1.85% 124963.000 122654.000 - 0.00% -
401.bzip2 -1.65% 33698.000 33141.000 - 0.00% -
458.sjeng -1.50% 80297.000 79090.000 - 0.07% -
456.hmmer -1.25% 80861.000 79849.000 - 0.00% -
470.lbm -1.22% 9338.000 9224.000 - 0.00% -
447.dealII -1.05% 195792.000 193739.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
403.gcc -99.38% 9509.000 59.000 - 1.72% -
462.libquantum -98.72% 14409.000 185.000 - 1.09% -
450.soplex -96.38% 15112.000 547.000 - 1.11% -
482.sphinx3 -96.29% 26682.000 991.000 - 1.23% -
444.namd -93.49% 12400.000 807.000 - -0.25% -
453.povray -92.94% 6987.000 493.000 - 1.44% -
429.mcf -91.83% 13988.000 1143.000 - -0.61% -
433.milc -91.37% 13601.000 1174.000 - -0.34% -
401.bzip2 -82.46% 16137.000 2830.000 - 0.07% -
447.dealII -79.52% 9380.000 1921.000 - -1.79% -
471.omnetpp -73.35% 10477.000 2792.000 - -0.57% -
470.lbm -69.94% 13259.000 3986.000 - -0.13% -
456.hmmer -67.83% 11854.000 3814.000 - 0.16% -
473.astar -62.80% 12272.000 4565.000 - 0.18% -
464.h264ref -58.93% 14498.000 5954.000 - 0.02% -
445.gobmk -56.13% 11093.000 4866.000 - 0.21% -
458.sjeng -51.93% 17055.000 8199.000 - 0.72% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
444.namd (max) -99.80% 1003.000 2.000 - -50.00% -
483.xalancbmk (max) (percentage) -99.61% 12.900 0.050 - 0.00% -
456.hmmer (max) -99.52% 1242.000 6.000 - 0.00% -
462.libquantum (max) -99.46% 919.000 5.000 - 0.00% -
470.lbm (unexplained diff vs previous) -99.38% 804.000 5.000 - -72.22% -
403.gcc (max) -99.10% 221.000 2.000 - 0.00% -
482.sphinx3 (unexplained diff vs previous) -98.69% 914.000 12.000 - -25.00% -
456.hmmer (max) (percentage) -98.47% 10.480 0.160 - 0.00% -
444.namd -98.43% 318.000 5.000 - 0.00% -
444.namd (avg) -98.43% 318.000 5.000 - 0.00% -
482.sphinx3 -98.28% 464.000 8.000 - 0.00% -
482.sphinx3 (avg) -98.28% 464.000 8.000 - 0.00% -
462.libquantum -98.18% 110.000 2.000 - 0.00% -
462.libquantum (avg) -98.18% 110.000 2.000 - 0.00% -
470.lbm (unexplained diff vs previous) (percentage) -97.85% 6.060 0.130 - -71.11% -
445.gobmk (max) -97.09% 413.000 12.000 - -14.29% -
471.omnetpp (max) -96.91% 972.000 30.000 - -11.76% -
444.namd (max) (percentage) -96.54% 8.090 0.280 - -51.72% -
429.mcf (max) -96.54% 2281.000 79.000 - -7.06% -
482.sphinx3 (max) -96.26% 883.000 33.000 - -2.94% -
403.gcc -96.15% 52.000 2.000 - 100.00% -
403.gcc (avg) -96.15% 52.000 2.000 - 100.00% -
458.sjeng (max) -95.09% 876.000 43.000 - -10.42% -
429.mcf -94.93% 296.000 15.000 - -6.25% -
429.mcf (avg) -94.93% 296.000 15.000 - -6.25% -
470.lbm -94.56% 441.000 24.000 - 0.00% -
470.lbm (avg) -94.56% 441.000 24.000 - 0.00% -
401.bzip2 (unexplained diff vs previous) -93.94% 33.000 2.000 - 0.00% -
473.astar (max) -93.43% 822.000 54.000 - -8.47% -
445.gobmk (max) (percentage) -93.03% 3.730 0.260 - -10.34% -
433.milc -92.24% 116.000 9.000 - 0.00% -
433.milc (avg) -92.24% 116.000 9.000 - 0.00% -
450.soplex (unexplained diff vs previous) -91.30% 69.000 6.000 - 200.00% -
453.povray -90.91% 55.000 5.000 - 0.00% -
453.povray (avg) -90.91% 55.000 5.000 - 0.00% -
450.soplex -90.67% 75.000 7.000 - 0.00% -
450.soplex (avg) -90.67% 75.000 7.000 - 0.00% -
450.soplex (max) -89.96% 249.000 25.000 - -10.71% -
458.sjeng (max) (percentage) -89.69% 5.140 0.530 - -10.17% -
401.bzip2 (max) -88.83% 609.000 68.000 - -9.33% -
471.omnetpp (max) (percentage) -88.36% 9.280 1.080 - -11.48% -
401.bzip2 -87.50% 104.000 13.000 - 0.00% -
401.bzip2 (avg) -87.50% 104.000 13.000 - 0.00% -
456.hmmer (unexplained diff vs previous) -86.96% 46.000 6.000 - 0.00% -
447.dealII -85.71% 98.000 14.000 - 0.00% -
447.dealII (avg) -85.71% 98.000 14.000 - 0.00% -
456.hmmer -85.37% 164.000 24.000 - 0.00% -
456.hmmer (avg) -85.37% 164.000 24.000 - 0.00% -
447.dealII (max) -84.75% 223.000 34.000 - 25.93% -
471.omnetpp (unexplained diff vs previous) -84.47% 103.000 16.000 - 45.45% -
470.lbm (max) -84.17% 758.000 120.000 - -10.45% -
445.gobmk -83.78% 74.000 12.000 - 0.00% -
445.gobmk (avg) -83.78% 74.000 12.000 - 0.00% -
473.astar (max) (percentage) -82.09% 6.700 1.200 - -7.69% -
470.lbm (avg) (percentage) -81.68% 3.330 0.610 - -1.61% -
458.sjeng -80.88% 136.000 26.000 - 0.00% -
458.sjeng (avg) -80.88% 136.000 26.000 - 0.00% -
473.astar -80.36% 112.000 22.000 - -4.35% -
473.astar (avg) -80.36% 112.000 22.000 - -4.35% -
471.omnetpp -77.84% 167.000 37.000 - -2.63% -
471.omnetpp (avg) -77.84% 167.000 37.000 - -2.63% -
444.namd (unexplained diff vs previous) -75.00% 8.000 2.000 - -33.33% -
445.gobmk (unexplained diff vs previous) -75.00% 40.000 10.000 - -9.09% -
444.namd (avg) (percentage) -72.37% 2.570 0.710 - -1.39% -
433.milc (unexplained diff vs previous) -69.23% 13.000 4.000 - 0.00% -
464.h264ref -69.05% 42.000 13.000 - 0.00% -
464.h264ref (avg) -69.05% 42.000 13.000 - 0.00% -
429.mcf (unexplained diff vs previous) -68.18% 22.000 7.000 - 75.00% -
453.povray (max) -68.00% 25.000 8.000 - -20.00% -
473.astar (unexplained diff vs previous) -68.00% 25.000 8.000 - -50.00% -
401.bzip2 (unexplained diff vs previous) (percentage) -65.00% 0.200 0.070 - 0.00% -
482.sphinx3 (unexplained diff vs previous) (percentage) -64.72% 3.430 1.210 - -25.77% -
445.gobmk (avg) (percentage) -61.19% 0.670 0.260 - 0.00% -
458.sjeng (avg) (percentage) -60.00% 0.800 0.320 - 0.00% -
456.hmmer (unexplained diff vs previous) (percentage) -58.97% 0.390 0.160 - 0.00% -
429.mcf (max) (percentage) -57.20% 16.310 6.980 - -5.68% -
462.libquantum (max) (percentage) -55.96% 6.380 2.810 - -6.02% -
456.hmmer (avg) (percentage) -54.68% 1.390 0.630 - -1.56% -
482.sphinx3 (avg) (percentage) -51.15% 1.740 0.850 - 1.19% -
470.lbm (max) (percentage) -47.20% 5.720 3.020 - -10.12% -
473.astar (avg) (percentage) -45.65% 0.920 0.500 - -1.96% -
433.milc (max) -42.59% 108.000 62.000 - -8.82% -
471.omnetpp (unexplained diff vs previous) (percentage) -41.84% 0.980 0.570 - 46.15% -
445.gobmk (unexplained diff vs previous) (percentage) -41.67% 0.360 0.210 - -8.70% -
464.h264ref (max) -41.67% 60.000 35.000 - -5.41% -
401.bzip2 (max) (percentage) -35.98% 3.780 2.420 - -9.70% -
447.dealII (unexplained diff vs previous) -35.19% 54.000 35.000 - 29.63% -
429.mcf (avg) (percentage) -34.43% 2.120 1.390 - -1.42% -
483.xalancbmk (avg) (percentage) -32.08% 2.120 1.440 - 0.00% -
447.dealII (avg) (percentage) -27.62% 1.050 0.760 - 2.70% -
401.bzip2 (avg) (percentage) -26.15% 0.650 0.480 - -2.04% -
447.dealII (max) (percentage) -24.79% 2.380 1.790 - 27.86% -
464.h264ref (avg) (percentage) -24.14% 0.290 0.220 - 0.00% -
471.omnetpp (avg) (percentage) -15.00% 1.600 1.360 - -0.73% -
473.astar (unexplained diff vs previous) (percentage) -10.00% 0.200 0.180 - -48.57% -
433.milc (avg) (percentage) -4.65% 0.860 0.820 - -1.20% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 5.26% 19.000 20.000 - 0.00% -

Added Tests - sample variability
464.h264ref (unexplained diff vs previous)
464.h264ref (unexplained diff vs previous) (percentage)

Report Time: 0.34s
Execution (seconds)
Name Current %
401.bzip2 2830.000 -
403.gcc 59.000 1.72%
429.mcf 1143.000 -
433.milc 1174.000 -
444.namd 807.000 -
445.gobmk 4866.000 -
447.dealII 1921.000 -1.79%
450.soplex 547.000 1.11%
453.povray 493.000 1.44%
456.hmmer 3814.000 -
458.sjeng 8199.000 -
462.libquantum 185.000 1.09%
464.h264ref 5954.000 -
470.lbm 3986.000 -
471.omnetpp 2792.000 -
473.astar 4565.000 -
482.sphinx3 991.000 1.23%
Geometric Mean 1480.682 -
Code Size (bytes)
Name Current %
401.bzip2 33141.000 -
403.gcc 1653351.000 -
429.mcf 6927.000 -
433.milc 45949.000 -
444.namd 122654.000 -
445.gobmk 1255493.000 -
447.dealII 193739.000 -
450.soplex 150036.000 -
453.povray 512076.000 -
456.hmmer 79849.000 -
458.sjeng 79090.000 -
462.libquantum 12055.000 -
464.h264ref 297765.000 -
470.lbm 9224.000 -
471.omnetpp 323250.000 -
473.astar 15607.000 -
482.sphinx3 87440.000 -
Geometric Mean 94300.197 -
sample variability
Name Current %
401.bzip2 13.000 -
401.bzip2 (avg) 13.000 -
401.bzip2 (avg) (percentage) 0.480 -2.04%
401.bzip2 (max) 68.000 -9.33%
401.bzip2 (max) (percentage) 2.420 -9.70%
401.bzip2 (unexplained diff vs previous) 2.000 -
401.bzip2 (unexplained diff vs previous) (percentage) 0.070 -
403.gcc 2.000 100.00%
403.gcc (avg) 2.000 100.00%
403.gcc (avg) (percentage) 3.390 -
403.gcc (max) 2.000 -
403.gcc (max) (percentage) 4.640 -2.32%
429.mcf 15.000 -6.25%
429.mcf (avg) 15.000 -6.25%
429.mcf (avg) (percentage) 1.390 -1.42%
429.mcf (max) 79.000 -7.06%
429.mcf (max) (percentage) 6.980 -5.68%
429.mcf (unexplained diff vs previous) 7.000 75.00%
429.mcf (unexplained diff vs previous) (percentage) 0.610 74.29%
433.milc 9.000 -
433.milc (avg) 9.000 -
433.milc (avg) (percentage) 0.820 -1.20%
433.milc (max) 62.000 -8.82%
433.milc (max) (percentage) 5.330 -8.58%
433.milc (unexplained diff vs previous) 4.000 -
433.milc (unexplained diff vs previous) (percentage) 0.340 -
444.namd 5.000 -
444.namd (avg) 5.000 -
444.namd (avg) (percentage) 0.710 -1.39%
444.namd (max) 2.000 -50.00%
444.namd (max) (percentage) 0.280 -51.72%
444.namd (unexplained diff vs previous) 2.000 -33.33%
444.namd (unexplained diff vs previous) (percentage) 0.250 -32.43%
445.gobmk 12.000 -
445.gobmk (avg) 12.000 -
445.gobmk (avg) (percentage) 0.260 -
445.gobmk (max) 12.000 -14.29%
445.gobmk (max) (percentage) 0.260 -10.34%
445.gobmk (unexplained diff vs previous) 10.000 -9.09%
445.gobmk (unexplained diff vs previous) (percentage) 0.210 -8.70%
447.dealII 14.000 -
447.dealII (avg) 14.000 -
447.dealII (avg) (percentage) 0.760 2.70%
447.dealII (max) 34.000 25.93%
447.dealII (max) (percentage) 1.790 27.86%
447.dealII (unexplained diff vs previous) 35.000 29.63%
447.dealII (unexplained diff vs previous) (percentage) 1.820 31.88%
450.soplex 7.000 -
450.soplex (avg) 7.000 -
450.soplex (avg) (percentage) 1.460 -
450.soplex (max) 25.000 -10.71%
450.soplex (max) (percentage) 4.740 -8.67%
450.soplex (unexplained diff vs previous) 6.000 200.00%
450.soplex (unexplained diff vs previous) (percentage) 1.100 197.30%
453.povray 5.000 -
453.povray (avg) 5.000 -
453.povray (avg) (percentage) 1.040 -
453.povray (max) 8.000 -20.00%
453.povray (max) (percentage) 1.760 -16.19%
453.povray (unexplained diff vs previous) 7.000 -
453.povray (unexplained diff vs previous) (percentage) 1.420 -
456.hmmer 24.000 -
456.hmmer (avg) 24.000 -
456.hmmer (avg) (percentage) 0.630 -1.56%
456.hmmer (max) 6.000 -
456.hmmer (max) (percentage) 0.160 -
456.hmmer (unexplained diff vs previous) 6.000 -
456.hmmer (unexplained diff vs previous) (percentage) 0.160 -
458.sjeng 26.000 -
458.sjeng (avg) 26.000 -
458.sjeng (avg) (percentage) 0.320 -
458.sjeng (max) 43.000 -10.42%
458.sjeng (max) (percentage) 0.530 -10.17%
462.libquantum 2.000 -
462.libquantum (avg) 2.000 -
462.libquantum (avg) (percentage) 1.570 -
462.libquantum (max) 5.000 -
462.libquantum (max) (percentage) 2.810 -6.02%
462.libquantum (unexplained diff vs previous) 2.000 -
462.libquantum (unexplained diff vs previous) (percentage) 1.080 -
464.h264ref 13.000 -
464.h264ref (avg) 13.000 -
464.h264ref (avg) (percentage) 0.220 -
464.h264ref (max) 35.000 -5.41%
464.h264ref (max) (percentage) 0.600 -4.76%
464.h264ref (unexplained diff vs previous) 1.000 -83.33%
464.h264ref (unexplained diff vs previous) (percentage) 0.020 -80.00%
470.lbm 24.000 -
470.lbm (avg) 24.000 -
470.lbm (avg) (percentage) 0.610 -1.61%
470.lbm (max) 120.000 -10.45%
470.lbm (max) (percentage) 3.020 -10.12%
470.lbm (unexplained diff vs previous) 5.000 -72.22%
470.lbm (unexplained diff vs previous) (percentage) 0.130 -71.11%
471.omnetpp 37.000 -2.63%
471.omnetpp (avg) 37.000 -2.63%
471.omnetpp (avg) (percentage) 1.360 -
471.omnetpp (max) 30.000 -11.76%
471.omnetpp (max) (percentage) 1.080 -11.48%
471.omnetpp (unexplained diff vs previous) 16.000 45.45%
471.omnetpp (unexplained diff vs previous) (percentage) 0.570 46.15%
473.astar 22.000 -4.35%
473.astar (avg) 22.000 -4.35%
473.astar (avg) (percentage) 0.500 -1.96%
473.astar (max) 54.000 -8.47%
473.astar (max) (percentage) 1.200 -7.69%
473.astar (unexplained diff vs previous) 8.000 -50.00%
473.astar (unexplained diff vs previous) (percentage) 0.180 -48.57%
482.sphinx3 8.000 -
482.sphinx3 (avg) 8.000 -
482.sphinx3 (avg) (percentage) 0.850 1.19%
482.sphinx3 (max) 33.000 -2.94%
482.sphinx3 (max) (percentage) 3.420 -3.93%
482.sphinx3 (unexplained diff vs previous) 12.000 -25.00%
482.sphinx3 (unexplained diff vs previous) (percentage) 1.210 -25.77%
483.xalancbmk (avg) (percentage) 1.440 -
483.xalancbmk (max) (percentage) 0.050 -
Geometric Mean 3.347 28.02%