Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/da5f330e84d74aeacdbb801c46282b9eebec6793 (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--llvm-arm-master-Os-build/238/
View Options
Report
Filter

llvm-arm-master-Os test results

Run Order Start Time Duration
Current 0238 (no-change) 2024-11-30T02:47:01 0:00:00
Previous 0236 (llvmorg-20-init-14012-gda5f330e84d7) 2024-11-27T06:48:57 0:00:00
Baseline 0001 (llvmorg-16-init-16061-ge7790fbed32b) 2022-12-29T19:41:07 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 27 36
Performance Improvements 35 112
Added Tests 8 2
Unchanged Tests 710 630
Total Tests 780

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
453.povray 2.63% 457.000 469.000 - -93.16% -
471.omnetpp 1.34% 2766.000 2803.000 - -73.92% -
482.sphinx3 1.02% 883.000 892.000 - -96.61% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
453.povray (max) 500.00% 2.000 12.000 - -90.91% -
433.milc (unexplained diff vs previous) (percentage) 364.71% 0.170 0.790 - -41.48% -
433.milc (unexplained diff vs previous) 350.00% 2.000 9.000 - -95.05% -
453.povray (max) (percentage) 304.62% 0.650 2.630 - 36.27% -
473.astar (unexplained diff vs previous) (percentage) 278.57% 0.140 0.530 - -30.26% -
473.astar (unexplained diff vs previous) 271.43% 7.000 26.000 - -75.93% -
471.omnetpp (max) 208.33% 12.000 37.000 - -80.42% -
471.omnetpp (max) (percentage) 197.78% 0.450 1.340 - -23.86% -
401.bzip2 (unexplained diff vs previous) (percentage) 104.55% 0.220 0.450 - 45.16% -
401.bzip2 (unexplained diff vs previous) 100.00% 6.000 12.000 - -75.51% -
458.sjeng (max) 60.87% 23.000 37.000 - -43.08% -
458.sjeng (unexplained diff vs previous) 60.87% 23.000 37.000 - -9.76% -
458.sjeng (max) (percentage) 60.71% 0.280 0.450 - 12.50% -
458.sjeng (unexplained diff vs previous) (percentage) 57.14% 0.280 0.440 - 76.00% -
473.astar (max) 52.94% 17.000 26.000 - -77.19% -
444.namd (unexplained diff vs previous) (percentage) 51.79% 0.560 0.850 - -86.16% -
473.astar (max) (percentage) 50.00% 0.360 0.540 - -32.50% -
444.namd (unexplained diff vs previous) 50.00% 4.000 6.000 - -99.28% -
433.milc (max) 33.33% 6.000 8.000 - -95.65% -
464.h264ref (unexplained diff vs previous) 30.00% 10.000 13.000 - -78.33% -
433.milc (max) (percentage) 29.51% 0.610 0.790 - -42.34% -
464.h264ref (unexplained diff vs previous) (percentage) 27.78% 0.180 0.230 - -41.03% -
453.povray (avg) (percentage) 4.00% 1.000 1.040 - -24.09% -
444.namd (max) (percentage) 1.20% 0.830 0.840 - -87.16% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
462.libquantum -1.01% 99.000 98.000 - -99.25% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
470.lbm (unexplained diff vs previous) (percentage) -97.06% 1.020 0.030 - -99.16% -
470.lbm (unexplained diff vs previous) -96.88% 32.000 1.000 - -99.80% -
462.libquantum (max) -66.67% 3.000 1.000 - -96.15% -
450.soplex (unexplained diff vs previous) -50.00% 10.000 5.000 - -93.90% -
462.libquantum (unexplained diff vs previous) -50.00% 2.000 1.000 - -93.75% -
462.libquantum (unexplained diff vs previous) (percentage) -49.50% 2.020 1.020 - 750.00% -
450.soplex (unexplained diff vs previous) (percentage) -49.21% 1.910 0.970 - 70.18% -
462.libquantum (max) (percentage) -45.57% 3.160 1.720 - 760.00% -
456.hmmer (unexplained diff vs previous) -42.11% 19.000 11.000 - 22.22% -
456.hmmer (unexplained diff vs previous) (percentage) -41.51% 0.530 0.310 - 342.86% -
482.sphinx3 (unexplained diff vs previous) (percentage) -40.59% 1.700 1.010 - -70.64% -
482.sphinx3 (unexplained diff vs previous) -40.00% 15.000 9.000 - -99.00% -
445.gobmk (unexplained diff vs previous) (percentage) -34.33% 0.670 0.440 - 83.33% -
445.gobmk (unexplained diff vs previous) -34.29% 35.000 23.000 - -23.33% -
450.soplex (max) (percentage) -25.00% 1.880 1.410 - 147.37% -
450.soplex (max) -22.22% 9.000 7.000 - -91.46% -
470.lbm (max) (percentage) -16.83% 1.010 0.840 - -84.84% -
470.lbm (max) -16.13% 31.000 26.000 - -96.62% -
429.mcf (max) -14.29% 14.000 12.000 - -82.09% -
429.mcf (max) (percentage) -13.85% 1.300 1.120 - 100.00% -
464.h264ref (max) (percentage) -11.11% 0.360 0.320 - -17.95% -
464.h264ref (max) -10.53% 19.000 17.000 - -71.67% -
456.hmmer (max) (percentage) -9.43% 0.530 0.480 - 60.00% -
445.gobmk (max) -8.57% 35.000 32.000 - 10.34% -
401.bzip2 (max) -6.67% 15.000 14.000 - -70.83% -
482.sphinx3 (max) -6.67% 15.000 14.000 - -98.40% -
445.gobmk (max) (percentage) -5.97% 0.670 0.630 - 162.50% -
482.sphinx3 (max) (percentage) -5.78% 1.730 1.630 - -50.90% -
456.hmmer (max) -5.56% 18.000 17.000 - -57.50% -
403.gcc (avg) (percentage) -4.26% 3.760 3.600 - 650.00% -
447.dealII (max) (percentage) -2.21% 1.360 1.330 - -15.82% -
401.bzip2 (max) (percentage) -1.79% 0.560 0.550 - 77.42% -
447.dealII (avg) (percentage) -1.47% 0.680 0.670 - -54.42% -
403.gcc (max) (percentage) -1.30% 2.300 2.270 - 497.37% -

Added Tests - sample variability
403.gcc (unexplained diff vs previous)
403.gcc (unexplained diff vs previous) (percentage)
429.mcf (unexplained diff vs previous)
429.mcf (unexplained diff vs previous) (percentage)
447.dealII (unexplained diff vs previous)
447.dealII (unexplained diff vs previous) (percentage)
453.povray (unexplained diff vs previous)
453.povray (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
401.bzip2 2.16% 39458.000 40309.000 - 0.00% -
450.soplex 1.88% 198708.000 202439.000 - 0.00% -
471.omnetpp 1.10% 373579.000 377676.000 - 0.00% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
462.libquantum (avg) (percentage) 1006.67% 0.150 1.660 - -0.60% -
462.libquantum (max) (percentage) 760.00% 0.200 1.720 - -45.57% -
462.libquantum (unexplained diff vs previous) (percentage) 750.00% 0.120 1.020 - -49.50% -
403.gcc (avg) (percentage) 650.00% 0.480 3.600 - -4.26% -
403.gcc (max) (percentage) 497.37% 0.380 2.270 - -1.30% -
456.hmmer (unexplained diff vs previous) (percentage) 342.86% 0.070 0.310 - -41.51% -
450.soplex (avg) (percentage) 194.44% 0.360 1.060 - 0.00% -
429.mcf (avg) (percentage) 184.44% 0.450 1.280 - -0.78% -
483.xalancbmk (avg) (percentage) 166.00% 0.500 1.330 - 0.00% -
445.gobmk (max) (percentage) 162.50% 0.240 0.630 - -5.97% -
450.soplex (max) (percentage) 147.37% 0.570 1.410 - -25.00% -
401.bzip2 (avg) (percentage) 113.64% 0.220 0.470 - 0.00% -
429.mcf (max) (percentage) 100.00% 0.560 1.120 - -13.85% -
445.gobmk (unexplained diff vs previous) (percentage) 83.33% 0.240 0.440 - -34.33% -
401.bzip2 (max) (percentage) 77.42% 0.310 0.550 - -1.79% -
458.sjeng (unexplained diff vs previous) (percentage) 76.00% 0.250 0.440 - 57.14% -
450.soplex (unexplained diff vs previous) (percentage) 70.18% 0.570 0.970 - -49.21% -
471.omnetpp (avg) (percentage) 67.95% 0.780 1.310 - 0.00% -
445.gobmk (avg) (percentage) 66.67% 0.180 0.300 - 0.00% -
456.hmmer (max) (percentage) 60.00% 0.300 0.480 - -9.43% -
471.omnetpp (unexplained diff vs previous) (percentage) 53.49% 0.860 1.320 - 0.00% -
401.bzip2 (unexplained diff vs previous) (percentage) 45.16% 0.310 0.450 - 104.55% -
453.povray (max) (percentage) 36.27% 1.930 2.630 - 304.62% -
453.povray (unexplained diff vs previous) (percentage) 34.74% 1.900 2.560 - 0.00% -
473.astar (avg) (percentage) 30.00% 0.500 0.650 - 0.00% -
456.hmmer (avg) (percentage) 25.00% 0.360 0.450 - 0.00% -
456.hmmer (unexplained diff vs previous) 22.22% 9.000 11.000 - -42.11% -
458.sjeng (max) (percentage) 12.50% 0.400 0.450 - 60.71% -
445.gobmk (max) 10.34% 29.000 32.000 - -8.57% -
429.mcf (unexplained diff vs previous) (percentage) 7.14% 0.560 0.600 - 0.00% -
483.xalancbmk (max) (percentage) 1.54% 0.650 0.660 - 0.00% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_execution_successful -5.56% 18.000 17.000 - 0.00% -
nb_compile_successful -5.26% 19.000 18.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
462.libquantum -9.98% 26756.000 24087.000 - 0.00% -
433.milc -2.85% 74971.000 72834.000 - 0.00% -
453.povray -2.28% 593097.000 579575.000 - 0.00% -
447.dealII -2.26% 1777992.000 1737843.000 - 0.00% -
444.namd -2.06% 175160.000 171557.000 - 0.00% -
464.h264ref -1.38% 354618.000 349740.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
403.gcc -99.35% 9099.000 59.000 - 0.00% -
462.libquantum -99.25% 13126.000 98.000 - -1.01% -
482.sphinx3 -96.61% 26310.000 892.000 - 1.02% -
450.soplex -96.41% 14429.000 518.000 - -0.96% -
444.namd -94.75% 13495.000 708.000 - -0.84% -
453.povray -93.16% 6857.000 469.000 - 2.63% -
433.milc -91.57% 13482.000 1136.000 - -0.79% -
429.mcf -90.34% 11999.000 1159.000 - 0.61% -
401.bzip2 -82.82% 15683.000 2695.000 - 0.45% -
447.dealII -77.89% 8196.000 1812.000 - -0.33% -
470.lbm -77.38% 13882.000 3140.000 - 0.03% -
471.omnetpp -73.92% 10746.000 2803.000 - 1.34% -
456.hmmer -73.33% 13365.000 3565.000 - -0.31% -
473.astar -65.76% 14262.000 4884.000 - 0.54% -
464.h264ref -64.16% 15493.000 5553.000 - 0.23% -
445.gobmk -57.85% 12400.000 5227.000 - -0.44% -
458.sjeng -49.21% 16406.000 8333.000 - 0.45% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
470.lbm (unexplained diff vs previous) -99.80% 497.000 1.000 - -96.88% -
444.namd (max) -99.43% 882.000 5.000 - 0.00% -
444.namd (unexplained diff vs previous) -99.28% 828.000 6.000 - 50.00% -
470.lbm (unexplained diff vs previous) (percentage) -99.16% 3.580 0.030 - -97.06% -
482.sphinx3 (unexplained diff vs previous) -99.00% 904.000 9.000 - -40.00% -
444.namd -98.83% 514.000 6.000 - 0.00% -
444.namd (avg) -98.83% 514.000 6.000 - 0.00% -
482.sphinx3 -98.57% 489.000 7.000 - 0.00% -
482.sphinx3 (avg) -98.57% 489.000 7.000 - 0.00% -
482.sphinx3 (max) -98.40% 873.000 14.000 - -6.67% -
403.gcc (max) -97.06% 34.000 1.000 - 0.00% -
470.lbm (max) -96.62% 769.000 26.000 - -16.13% -
433.milc -96.32% 136.000 5.000 - 0.00% -
433.milc (avg) -96.32% 136.000 5.000 - 0.00% -
462.libquantum (max) -96.15% 26.000 1.000 - -66.67% -
453.povray -95.70% 93.000 4.000 - 0.00% -
453.povray (avg) -95.70% 93.000 4.000 - 0.00% -
433.milc (max) -95.65% 184.000 8.000 - 33.33% -
403.gcc -95.35% 43.000 2.000 - 0.00% -
403.gcc (avg) -95.35% 43.000 2.000 - 0.00% -
433.milc (unexplained diff vs previous) -95.05% 182.000 9.000 - 350.00% -
447.dealII (unexplained diff vs previous) -95.04% 121.000 6.000 - 0.00% -
462.libquantum -94.74% 19.000 1.000 - 0.00% -
462.libquantum (avg) -94.74% 19.000 1.000 - 0.00% -
450.soplex (unexplained diff vs previous) -93.90% 82.000 5.000 - -50.00% -
462.libquantum (unexplained diff vs previous) -93.75% 16.000 1.000 - -50.00% -
470.lbm -93.48% 322.000 21.000 - 0.00% -
470.lbm (avg) -93.48% 322.000 21.000 - 0.00% -
450.soplex (max) -91.46% 82.000 7.000 - -22.22% -
453.povray (max) -90.91% 132.000 12.000 - 500.00% -
453.povray (unexplained diff vs previous) -90.77% 130.000 12.000 - 0.00% -
450.soplex -90.20% 51.000 5.000 - 0.00% -
450.soplex (avg) -90.20% 51.000 5.000 - 0.00% -
447.dealII -90.00% 120.000 12.000 - 0.00% -
447.dealII (avg) -90.00% 120.000 12.000 - 0.00% -
429.mcf (unexplained diff vs previous) -89.55% 67.000 7.000 - 0.00% -
444.namd (max) (percentage) -87.16% 6.540 0.840 - 1.20% -
444.namd (unexplained diff vs previous) (percentage) -86.16% 6.140 0.850 - 51.79% -
470.lbm (max) (percentage) -84.84% 5.540 0.840 - -16.83% -
429.mcf (max) -82.09% 67.000 12.000 - -14.29% -
447.dealII (max) -81.40% 129.000 24.000 - 0.00% -
471.omnetpp (max) -80.42% 189.000 37.000 - 208.33% -
464.h264ref (unexplained diff vs previous) -78.33% 60.000 13.000 - 30.00% -
447.dealII (unexplained diff vs previous) (percentage) -77.70% 1.480 0.330 - 0.00% -
473.astar (max) -77.19% 114.000 26.000 - 52.94% -
473.astar (unexplained diff vs previous) -75.93% 108.000 26.000 - 271.43% -
444.namd (avg) (percentage) -75.59% 3.810 0.930 - 0.00% -
401.bzip2 (unexplained diff vs previous) -75.51% 49.000 12.000 - 100.00% -
429.mcf -73.58% 53.000 14.000 - 0.00% -
429.mcf (avg) -73.58% 53.000 14.000 - 0.00% -
464.h264ref (max) -71.67% 60.000 17.000 - -10.53% -
401.bzip2 (max) -70.83% 48.000 14.000 - -6.67% -
470.lbm (avg) (percentage) -70.69% 2.320 0.680 - -1.45% -
482.sphinx3 (unexplained diff vs previous) (percentage) -70.64% 3.440 1.010 - -40.59% -
458.sjeng -69.47% 95.000 29.000 - 0.00% -
458.sjeng (avg) -69.47% 95.000 29.000 - 0.00% -
456.hmmer -66.67% 48.000 16.000 - 0.00% -
456.hmmer (avg) -66.67% 48.000 16.000 - 0.00% -
464.h264ref -66.67% 51.000 17.000 - 0.00% -
464.h264ref (avg) -66.67% 51.000 17.000 - 0.00% -
401.bzip2 -64.71% 34.000 12.000 - 0.00% -
401.bzip2 (avg) -64.71% 34.000 12.000 - 0.00% -
471.omnetpp (unexplained diff vs previous) -59.78% 92.000 37.000 - 0.00% -
456.hmmer (max) -57.50% 40.000 17.000 - -5.56% -
471.omnetpp -56.63% 83.000 36.000 - 0.00% -
471.omnetpp (avg) -56.63% 83.000 36.000 - 0.00% -
473.astar -56.34% 71.000 31.000 - 0.00% -
473.astar (avg) -56.34% 71.000 31.000 - 0.00% -
482.sphinx3 (avg) (percentage) -54.84% 1.860 0.840 - 0.00% -
447.dealII (avg) (percentage) -54.42% 1.470 0.670 - -1.47% -
482.sphinx3 (max) (percentage) -50.90% 3.320 1.630 - -5.78% -
433.milc (avg) (percentage) -48.51% 1.010 0.520 - 0.00% -
458.sjeng (max) -43.08% 65.000 37.000 - 60.87% -
433.milc (max) (percentage) -42.34% 1.370 0.790 - 29.51% -
433.milc (unexplained diff vs previous) (percentage) -41.48% 1.350 0.790 - 364.71% -
464.h264ref (unexplained diff vs previous) (percentage) -41.03% 0.390 0.230 - 27.78% -
458.sjeng (avg) (percentage) -37.93% 0.580 0.360 - 0.00% -
473.astar (max) (percentage) -32.50% 0.800 0.540 - 50.00% -
445.gobmk -31.82% 22.000 15.000 - 0.00% -
445.gobmk (avg) -31.82% 22.000 15.000 - 0.00% -
473.astar (unexplained diff vs previous) (percentage) -30.26% 0.760 0.530 - 278.57% -
453.povray (avg) (percentage) -24.09% 1.370 1.040 - 4.00% -
471.omnetpp (max) (percentage) -23.86% 1.760 1.340 - 197.78% -
445.gobmk (unexplained diff vs previous) -23.33% 30.000 23.000 - -34.29% -
464.h264ref (max) (percentage) -17.95% 0.390 0.320 - -11.11% -
447.dealII (max) (percentage) -15.82% 1.580 1.330 - -2.21% -
458.sjeng (unexplained diff vs previous) -9.76% 41.000 37.000 - 60.87% -
464.h264ref (avg) (percentage) -3.03% 0.330 0.320 - 0.00% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 5.26% 19.000 20.000 - 0.00% -

Added Tests - sample variability
403.gcc (unexplained diff vs previous)
403.gcc (unexplained diff vs previous) (percentage)

Report Time: 0.35s
Execution (seconds)
Name Current %
401.bzip2 2695.000 -
403.gcc 59.000 -
429.mcf 1159.000 -
433.milc 1136.000 -
444.namd 708.000 -
445.gobmk 5227.000 -
447.dealII 1812.000 -
450.soplex 518.000 -
453.povray 469.000 2.63%
456.hmmer 3565.000 -
458.sjeng 8333.000 -
462.libquantum 98.000 -1.01%
464.h264ref 5553.000 -
470.lbm 3140.000 -
471.omnetpp 2803.000 1.34%
473.astar 4884.000 -
482.sphinx3 892.000 1.02%
Geometric Mean 1370.163 -
Code Size (bytes)
Name Current %
401.bzip2 40309.000 -
403.gcc 1955149.000 -
429.mcf 7966.000 -
433.milc 72834.000 -
444.namd 171557.000 -
445.gobmk 1308068.000 -
447.dealII 1737843.000 -
450.soplex 202439.000 -
453.povray 579575.000 -
456.hmmer 166782.000 -
458.sjeng 96913.000 -
462.libquantum 24087.000 -
464.h264ref 349740.000 -
470.lbm 9794.000 -
471.omnetpp 377676.000 -
473.astar 23287.000 -
482.sphinx3 114951.000 -
Geometric Mean 139360.494 -
sample variability
Name Current %
401.bzip2 12.000 -
401.bzip2 (avg) 12.000 -
401.bzip2 (avg) (percentage) 0.470 -
401.bzip2 (max) 14.000 -6.67%
401.bzip2 (max) (percentage) 0.550 -1.79%
401.bzip2 (unexplained diff vs previous) 12.000 100.00%
401.bzip2 (unexplained diff vs previous) (percentage) 0.450 104.55%
403.gcc 2.000 -
403.gcc (avg) 2.000 -
403.gcc (avg) (percentage) 3.600 -4.26%
403.gcc (max) 1.000 -
403.gcc (max) (percentage) 2.270 -1.30%
403.gcc (unexplained diff vs previous) 0.000 -
403.gcc (unexplained diff vs previous) (percentage) 0.000 -
429.mcf 14.000 -
429.mcf (avg) 14.000 -
429.mcf (avg) (percentage) 1.280 -
429.mcf (max) 12.000 -14.29%
429.mcf (max) (percentage) 1.120 -13.85%
429.mcf (unexplained diff vs previous) 7.000 -
429.mcf (unexplained diff vs previous) (percentage) 0.600 -
433.milc 5.000 -
433.milc (avg) 5.000 -
433.milc (avg) (percentage) 0.520 -
433.milc (max) 8.000 33.33%
433.milc (max) (percentage) 0.790 29.51%
433.milc (unexplained diff vs previous) 9.000 350.00%
433.milc (unexplained diff vs previous) (percentage) 0.790 364.71%
444.namd 6.000 -
444.namd (avg) 6.000 -
444.namd (avg) (percentage) 0.930 -
444.namd (max) 5.000 -
444.namd (max) (percentage) 0.840 1.20%
444.namd (unexplained diff vs previous) 6.000 50.00%
444.namd (unexplained diff vs previous) (percentage) 0.850 51.79%
445.gobmk 15.000 -
445.gobmk (avg) 15.000 -
445.gobmk (avg) (percentage) 0.300 -
445.gobmk (max) 32.000 -8.57%
445.gobmk (max) (percentage) 0.630 -5.97%
445.gobmk (unexplained diff vs previous) 23.000 -34.29%
445.gobmk (unexplained diff vs previous) (percentage) 0.440 -34.33%
447.dealII 12.000 -
447.dealII (avg) 12.000 -
447.dealII (avg) (percentage) 0.670 -1.47%
447.dealII (max) 24.000 -
447.dealII (max) (percentage) 1.330 -2.21%
447.dealII (unexplained diff vs previous) 6.000 -
447.dealII (unexplained diff vs previous) (percentage) 0.330 -
450.soplex 5.000 -
450.soplex (avg) 5.000 -
450.soplex (avg) (percentage) 1.060 -
450.soplex (max) 7.000 -22.22%
450.soplex (max) (percentage) 1.410 -25.00%
450.soplex (unexplained diff vs previous) 5.000 -50.00%
450.soplex (unexplained diff vs previous) (percentage) 0.970 -49.21%
453.povray 4.000 -
453.povray (avg) 4.000 -
453.povray (avg) (percentage) 1.040 4.00%
453.povray (max) 12.000 500.00%
453.povray (max) (percentage) 2.630 304.62%
453.povray (unexplained diff vs previous) 12.000 -
453.povray (unexplained diff vs previous) (percentage) 2.560 -
456.hmmer 16.000 -
456.hmmer (avg) 16.000 -
456.hmmer (avg) (percentage) 0.450 -
456.hmmer (max) 17.000 -5.56%
456.hmmer (max) (percentage) 0.480 -9.43%
456.hmmer (unexplained diff vs previous) 11.000 -42.11%
456.hmmer (unexplained diff vs previous) (percentage) 0.310 -41.51%
458.sjeng 29.000 -
458.sjeng (avg) 29.000 -
458.sjeng (avg) (percentage) 0.360 -
458.sjeng (max) 37.000 60.87%
458.sjeng (max) (percentage) 0.450 60.71%
458.sjeng (unexplained diff vs previous) 37.000 60.87%
458.sjeng (unexplained diff vs previous) (percentage) 0.440 57.14%
462.libquantum 1.000 -
462.libquantum (avg) 1.000 -
462.libquantum (avg) (percentage) 1.660 -
462.libquantum (max) 1.000 -66.67%
462.libquantum (max) (percentage) 1.720 -45.57%
462.libquantum (unexplained diff vs previous) 1.000 -50.00%
462.libquantum (unexplained diff vs previous) (percentage) 1.020 -49.50%
464.h264ref 17.000 -
464.h264ref (avg) 17.000 -
464.h264ref (avg) (percentage) 0.320 -
464.h264ref (max) 17.000 -10.53%
464.h264ref (max) (percentage) 0.320 -11.11%
464.h264ref (unexplained diff vs previous) 13.000 30.00%
464.h264ref (unexplained diff vs previous) (percentage) 0.230 27.78%
470.lbm 21.000 -
470.lbm (avg) 21.000 -
470.lbm (avg) (percentage) 0.680 -
470.lbm (max) 26.000 -16.13%
470.lbm (max) (percentage) 0.840 -16.83%
470.lbm (unexplained diff vs previous) 1.000 -96.88%
470.lbm (unexplained diff vs previous) (percentage) 0.030 -97.06%
471.omnetpp 36.000 -
471.omnetpp (avg) 36.000 -
471.omnetpp (avg) (percentage) 1.310 -
471.omnetpp (max) 37.000 208.33%
471.omnetpp (max) (percentage) 1.340 197.78%
471.omnetpp (unexplained diff vs previous) 37.000 -
471.omnetpp (unexplained diff vs previous) (percentage) 1.320 -
473.astar 31.000 -
473.astar (avg) 31.000 -
473.astar (avg) (percentage) 0.650 -
473.astar (max) 26.000 52.94%
473.astar (max) (percentage) 0.540 50.00%
473.astar (unexplained diff vs previous) 26.000 271.43%
473.astar (unexplained diff vs previous) (percentage) 0.530 278.57%
482.sphinx3 7.000 -
482.sphinx3 (avg) 7.000 -
482.sphinx3 (avg) (percentage) 0.840 -
482.sphinx3 (max) 14.000 -6.67%
482.sphinx3 (max) (percentage) 1.630 -5.78%
482.sphinx3 (unexplained diff vs previous) 9.000 -40.00%
482.sphinx3 (unexplained diff vs previous) (percentage) 1.010 -40.59%
483.xalancbmk (avg) (percentage) 1.330 -
483.xalancbmk (max) (percentage) 0.660 -
Geometric Mean 2.685 1.96%