Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/47e6d1816251e90b3d589710c5203a92c6015a7c (+ 279 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--llvm-arm-master-Os-build/217/
View Options
Report
Filter

llvm-arm-master-Os test results

Run Order Start Time Duration
Current 0217 (llvmorg-20-init-08109-g47e6d1816251) 2024-10-01T03:15:47 0:00:00
Previous 0216 (llvmorg-20-init-07830-g076392b0aac2) 2024-09-26T09:45:02 0:00:00
Baseline 0001 (llvmorg-16-init-16061-ge7790fbed32b) 2022-12-29T19:41:07 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 28 27
Performance Improvements 41 116
Added Tests 8 4
Unchanged Tests 703 633
Total Tests 780

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
403.gcc 3.45% 58.000 60.000 - -99.34% -
444.namd 1.83% 709.000 722.000 - -94.65% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
401.bzip2 (unexplained diff vs previous) 700.00% 1.000 8.000 - -83.67% -
401.bzip2 (unexplained diff vs previous) (percentage) 625.00% 0.040 0.290 - -6.45% -
444.namd (unexplained diff vs previous) 550.00% 2.000 13.000 - -98.43% -
444.namd (unexplained diff vs previous) (percentage) 542.86% 0.280 1.800 - -70.68% -
470.lbm (unexplained diff vs previous) (percentage) 366.67% 0.060 0.280 - -92.18% -
470.lbm (unexplained diff vs previous) 350.00% 2.000 9.000 - -98.19% -
462.libquantum (unexplained diff vs previous) (percentage) 103.92% 1.020 2.080 - 1633.33% -
429.mcf (unexplained diff vs previous) 100.00% 3.000 6.000 - -91.04% -
429.mcf (unexplained diff vs previous) (percentage) 100.00% 0.260 0.520 - -7.14% -
462.libquantum (unexplained diff vs previous) 100.00% 1.000 2.000 - -87.50% -
444.namd (max) 85.71% 7.000 13.000 - -98.53% -
444.namd (max) (percentage) 79.41% 1.020 1.830 - -72.02% -
445.gobmk (max) 62.50% 8.000 13.000 - -55.17% -
445.gobmk (max) (percentage) 56.25% 0.160 0.250 - 4.17% -
401.bzip2 (max) (percentage) 45.00% 0.200 0.290 - -6.45% -
401.bzip2 (max) 40.00% 5.000 7.000 - -85.42% -
471.omnetpp (unexplained diff vs previous) 33.33% 6.000 8.000 - -91.30% -
471.omnetpp (unexplained diff vs previous) (percentage) 31.82% 0.220 0.290 - -66.28% -
464.h264ref (unexplained diff vs previous) 28.57% 7.000 9.000 - -85.00% -
482.sphinx3 (unexplained diff vs previous) (percentage) 26.37% 0.910 1.150 - -66.57% -
482.sphinx3 (unexplained diff vs previous) 25.00% 8.000 10.000 - -98.89% -
482.sphinx3 (max) (percentage) 24.18% 0.910 1.130 - -65.96% -
464.h264ref (unexplained diff vs previous) (percentage) 23.08% 0.130 0.160 - -58.97% -
482.sphinx3 (max) 12.50% 8.000 9.000 - -98.97% -
482.sphinx3 (avg) (percentage) 1.19% 0.840 0.850 - -54.30% -
444.namd (avg) (percentage) 1.06% 0.940 0.950 - -75.07% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
462.libquantum -2.04% 98.000 96.000 - -99.27% -
482.sphinx3 -1.13% 883.000 873.000 - -96.68% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
453.povray (max) -66.67% 9.000 3.000 - -97.73% -
456.hmmer (max) (percentage) -64.06% 0.640 0.230 - -23.33% -
456.hmmer (max) -63.64% 22.000 8.000 - -80.00% -
453.povray (max) (percentage) -57.73% 1.940 0.820 - -57.51% -
458.sjeng (unexplained diff vs previous) -51.28% 39.000 19.000 - -53.66% -
458.sjeng (unexplained diff vs previous) (percentage) -51.06% 0.470 0.230 - -8.00% -
433.milc (max) (percentage) -40.38% 0.520 0.310 - -77.37% -
433.milc (max) -40.00% 5.000 3.000 - -98.37% -
433.milc (unexplained diff vs previous) (percentage) -34.62% 0.260 0.170 - -87.41% -
433.milc (unexplained diff vs previous) -33.33% 3.000 2.000 - -98.90% -
456.hmmer (unexplained diff vs previous) (percentage) -12.00% 0.250 0.220 - 214.29% -
471.omnetpp (max) -11.90% 42.000 37.000 - -80.42% -
456.hmmer (unexplained diff vs previous) -11.11% 9.000 8.000 - -11.11% -
471.omnetpp (max) (percentage) -11.04% 1.540 1.370 - -22.16% -
450.soplex (max) -9.09% 11.000 10.000 - -87.80% -
464.h264ref (max) (percentage) -8.33% 0.240 0.220 - -43.59% -
464.h264ref (max) -7.69% 13.000 12.000 - -80.00% -
470.lbm (max) (percentage) -6.93% 1.010 0.940 - -83.03% -
473.astar (max) (percentage) -6.67% 1.050 0.980 - 22.50% -
470.lbm (max) -6.45% 31.000 29.000 - -96.23% -
445.gobmk -6.25% 16.000 15.000 - -31.82% -
445.gobmk (avg) -6.25% 16.000 15.000 - -31.82% -
458.sjeng (max) (percentage) -6.25% 0.480 0.450 - 12.50% -
473.astar (max) -6.00% 50.000 47.000 - -58.77% -
458.sjeng (max) -5.13% 39.000 37.000 - -43.08% -
450.soplex (max) (percentage) -5.07% 2.170 2.060 - 261.40% -
462.libquantum (max) (percentage) -4.44% 2.480 2.370 - 1085.00% -
447.dealII (max) (percentage) -3.95% 0.760 0.730 - -53.80% -
445.gobmk (avg) (percentage) -3.23% 0.310 0.300 - 66.67% -
429.mcf (max) (percentage) -3.17% 1.260 1.220 - 117.86% -
447.dealII (avg) (percentage) -3.03% 0.660 0.640 - -56.46% -
473.astar -2.94% 34.000 33.000 - -53.52% -
473.astar (avg) -2.94% 34.000 33.000 - -53.52% -
471.omnetpp -2.70% 37.000 36.000 - -56.63% -
471.omnetpp (avg) -2.70% 37.000 36.000 - -56.63% -
403.gcc (max) (percentage) -1.48% 8.090 7.970 - 1997.37% -
473.astar (avg) (percentage) -1.41% 0.710 0.700 - 40.00% -
470.lbm (avg) (percentage) -1.39% 0.720 0.710 - -69.40% -
450.soplex (unexplained diff vs previous) (percentage) -1.30% 0.770 0.760 - 33.33% -

Added Tests - sample variability
445.gobmk (unexplained diff vs previous)
445.gobmk (unexplained diff vs previous) (percentage)
447.dealII (unexplained diff vs previous)
447.dealII (unexplained diff vs previous) (percentage)
453.povray (unexplained diff vs previous)
453.povray (unexplained diff vs previous) (percentage)
473.astar (unexplained diff vs previous)
473.astar (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
401.bzip2 9.84% 39458.000 43341.000 - 0.00% -
450.soplex 1.88% 198708.000 202447.000 - 0.00% -
471.omnetpp 1.11% 373579.000 377740.000 - 0.00% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
403.gcc (max) (percentage) 1997.37% 0.380 7.970 - -1.48% -
462.libquantum (unexplained diff vs previous) (percentage) 1633.33% 0.120 2.080 - 103.92% -
462.libquantum (max) (percentage) 1085.00% 0.200 2.370 - -4.44% -
462.libquantum (avg) (percentage) 966.67% 0.150 1.600 - 0.00% -
403.gcc (avg) (percentage) 718.75% 0.480 3.930 - 0.00% -
450.soplex (max) (percentage) 261.40% 0.570 2.060 - -5.07% -
456.hmmer (unexplained diff vs previous) (percentage) 214.29% 0.070 0.220 - -12.00% -
450.soplex (avg) (percentage) 202.78% 0.360 1.090 - 0.00% -
429.mcf (avg) (percentage) 202.22% 0.450 1.360 - -0.73% -
483.xalancbmk (avg) (percentage) 166.00% 0.500 1.330 - 0.00% -
429.mcf (max) (percentage) 117.86% 0.560 1.220 - -3.17% -
401.bzip2 (avg) (percentage) 113.64% 0.220 0.470 - 0.00% -
471.omnetpp (avg) (percentage) 70.51% 0.780 1.330 - -0.75% -
445.gobmk (avg) (percentage) 66.67% 0.180 0.300 - -3.23% -
473.astar (avg) (percentage) 40.00% 0.500 0.700 - -1.41% -
450.soplex (unexplained diff vs previous) (percentage) 33.33% 0.570 0.760 - -1.30% -
456.hmmer (avg) (percentage) 30.56% 0.360 0.470 - 0.00% -
473.astar (max) (percentage) 22.50% 0.800 0.980 - -6.67% -
458.sjeng (max) (percentage) 12.50% 0.400 0.450 - -6.25% -
445.gobmk (max) (percentage) 4.17% 0.240 0.250 - 56.25% -
445.gobmk (unexplained diff vs previous) (percentage) 4.17% 0.240 0.250 - 0.00% -
483.xalancbmk (max) (percentage) 3.08% 0.650 0.670 - 0.00% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_execution_successful -5.56% 18.000 17.000 - 0.00% -
nb_compile_successful -5.26% 19.000 18.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
462.libquantum -10.04% 26756.000 24071.000 - 0.00% -
433.milc -2.74% 74971.000 72918.000 - 0.07% -
453.povray -2.31% 593097.000 579415.000 - 0.00% -
447.dealII -2.22% 1777992.000 1738543.000 - 0.00% -
444.namd -1.68% 175160.000 172221.000 - 0.00% -
464.h264ref -1.35% 354618.000 349820.000 - 0.01% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
403.gcc -99.34% 9099.000 60.000 - 3.45% -
462.libquantum -99.27% 13126.000 96.000 - -2.04% -
482.sphinx3 -96.68% 26310.000 873.000 - -1.13% -
450.soplex -96.37% 14429.000 524.000 - 0.77% -
444.namd -94.65% 13495.000 722.000 - 1.83% -
453.povray -93.16% 6857.000 469.000 - 0.64% -
433.milc -91.52% 13482.000 1143.000 - 0.18% -
429.mcf -90.38% 11999.000 1154.000 - 0.52% -
401.bzip2 -82.61% 15683.000 2728.000 - 0.29% -
447.dealII -77.86% 8196.000 1815.000 - 0.00% -
470.lbm -77.22% 13882.000 3163.000 - 0.29% -
471.omnetpp -74.29% 10746.000 2763.000 - -0.29% -
456.hmmer -73.36% 13365.000 3561.000 - 0.23% -
473.astar -66.01% 14262.000 4848.000 - 0.00% -
464.h264ref -64.09% 15493.000 5563.000 - 0.16% -
445.gobmk -57.69% 12400.000 5247.000 - 0.25% -
458.sjeng -49.46% 16406.000 8291.000 - 0.23% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
482.sphinx3 (max) -98.97% 873.000 9.000 - 12.50% -
433.milc (unexplained diff vs previous) -98.90% 182.000 2.000 - -33.33% -
482.sphinx3 (unexplained diff vs previous) -98.89% 904.000 10.000 - 25.00% -
444.namd -98.83% 514.000 6.000 - 0.00% -
444.namd (avg) -98.83% 514.000 6.000 - 0.00% -
482.sphinx3 -98.57% 489.000 7.000 - 0.00% -
482.sphinx3 (avg) -98.57% 489.000 7.000 - 0.00% -
444.namd (max) -98.53% 882.000 13.000 - 85.71% -
444.namd (unexplained diff vs previous) -98.43% 828.000 13.000 - 550.00% -
433.milc (max) -98.37% 184.000 3.000 - -40.00% -
470.lbm (unexplained diff vs previous) -98.19% 497.000 9.000 - 350.00% -
453.povray (max) -97.73% 132.000 3.000 - -66.67% -
453.povray (unexplained diff vs previous) -97.69% 130.000 3.000 - 0.00% -
470.lbm (max) -96.23% 769.000 29.000 - -6.45% -
453.povray -95.70% 93.000 4.000 - 0.00% -
453.povray (avg) -95.70% 93.000 4.000 - 0.00% -
433.milc -95.59% 136.000 6.000 - 0.00% -
433.milc (avg) -95.59% 136.000 6.000 - 0.00% -
403.gcc -95.35% 43.000 2.000 - 0.00% -
403.gcc (avg) -95.35% 43.000 2.000 - 0.00% -
450.soplex (unexplained diff vs previous) -95.12% 82.000 4.000 - 0.00% -
462.libquantum -94.74% 19.000 1.000 - 0.00% -
462.libquantum (avg) -94.74% 19.000 1.000 - 0.00% -
470.lbm -93.17% 322.000 22.000 - 0.00% -
470.lbm (avg) -93.17% 322.000 22.000 - 0.00% -
462.libquantum (max) -92.31% 26.000 2.000 - 0.00% -
470.lbm (unexplained diff vs previous) (percentage) -92.18% 3.580 0.280 - 366.67% -
471.omnetpp (unexplained diff vs previous) -91.30% 92.000 8.000 - 33.33% -
429.mcf (unexplained diff vs previous) -91.04% 67.000 6.000 - 100.00% -
447.dealII -90.83% 120.000 11.000 - 0.00% -
447.dealII (avg) -90.83% 120.000 11.000 - 0.00% -
450.soplex -90.20% 51.000 5.000 - 0.00% -
450.soplex (avg) -90.20% 51.000 5.000 - 0.00% -
447.dealII (max) -89.92% 129.000 13.000 - 0.00% -
403.gcc (max) -88.24% 34.000 4.000 - 0.00% -
450.soplex (max) -87.80% 82.000 10.000 - -9.09% -
462.libquantum (unexplained diff vs previous) -87.50% 16.000 2.000 - 100.00% -
433.milc (unexplained diff vs previous) (percentage) -87.41% 1.350 0.170 - -34.62% -
401.bzip2 (max) -85.42% 48.000 7.000 - 40.00% -
464.h264ref (unexplained diff vs previous) -85.00% 60.000 9.000 - 28.57% -
401.bzip2 (unexplained diff vs previous) -83.67% 49.000 8.000 - 700.00% -
470.lbm (max) (percentage) -83.03% 5.540 0.940 - -6.93% -
471.omnetpp (max) -80.42% 189.000 37.000 - -11.90% -
456.hmmer (max) -80.00% 40.000 8.000 - -63.64% -
464.h264ref (max) -80.00% 60.000 12.000 - -7.69% -
429.mcf (max) -79.10% 67.000 14.000 - 0.00% -
433.milc (max) (percentage) -77.37% 1.370 0.310 - -40.38% -
444.namd (avg) (percentage) -75.07% 3.810 0.950 - 1.06% -
444.namd (max) (percentage) -72.02% 6.540 1.830 - 79.41% -
429.mcf -71.70% 53.000 15.000 - 0.00% -
429.mcf (avg) -71.70% 53.000 15.000 - 0.00% -
444.namd (unexplained diff vs previous) (percentage) -70.68% 6.140 1.800 - 542.86% -
470.lbm (avg) (percentage) -69.40% 2.320 0.710 - -1.39% -
458.sjeng -67.37% 95.000 31.000 - 0.00% -
458.sjeng (avg) -67.37% 95.000 31.000 - 0.00% -
456.hmmer -66.67% 48.000 16.000 - 0.00% -
456.hmmer (avg) -66.67% 48.000 16.000 - 0.00% -
482.sphinx3 (unexplained diff vs previous) (percentage) -66.57% 3.440 1.150 - 26.37% -
453.povray (unexplained diff vs previous) (percentage) -66.32% 1.900 0.640 - 0.00% -
471.omnetpp (unexplained diff vs previous) (percentage) -66.28% 0.860 0.290 - 31.82% -
482.sphinx3 (max) (percentage) -65.96% 3.320 1.130 - 24.18% -
401.bzip2 -64.71% 34.000 12.000 - 0.00% -
401.bzip2 (avg) -64.71% 34.000 12.000 - 0.00% -
464.h264ref -64.71% 51.000 18.000 - 0.00% -
464.h264ref (avg) -64.71% 51.000 18.000 - 0.00% -
464.h264ref (unexplained diff vs previous) (percentage) -58.97% 0.390 0.160 - 23.08% -
473.astar (max) -58.77% 114.000 47.000 - -6.00% -
453.povray (max) (percentage) -57.51% 1.930 0.820 - -57.73% -
445.gobmk (unexplained diff vs previous) -56.67% 30.000 13.000 - 0.00% -
471.omnetpp -56.63% 83.000 36.000 - -2.70% -
471.omnetpp (avg) -56.63% 83.000 36.000 - -2.70% -
447.dealII (avg) (percentage) -56.46% 1.470 0.640 - -3.03% -
445.gobmk (max) -55.17% 29.000 13.000 - 62.50% -
482.sphinx3 (avg) (percentage) -54.30% 1.860 0.850 - 1.19% -
447.dealII (max) (percentage) -53.80% 1.580 0.730 - -3.95% -
458.sjeng (unexplained diff vs previous) -53.66% 41.000 19.000 - -51.28% -
473.astar -53.52% 71.000 33.000 - -2.94% -
473.astar (avg) -53.52% 71.000 33.000 - -2.94% -
433.milc (avg) (percentage) -45.54% 1.010 0.550 - 0.00% -
464.h264ref (max) (percentage) -43.59% 0.390 0.220 - -8.33% -
458.sjeng (max) -43.08% 65.000 37.000 - -5.13% -
458.sjeng (avg) (percentage) -34.48% 0.580 0.380 - 0.00% -
445.gobmk -31.82% 22.000 15.000 - -6.25% -
445.gobmk (avg) -31.82% 22.000 15.000 - -6.25% -
453.povray (avg) (percentage) -25.55% 1.370 1.020 - -0.97% -
456.hmmer (max) (percentage) -23.33% 0.300 0.230 - -64.06% -
471.omnetpp (max) (percentage) -22.16% 1.760 1.370 - -11.04% -
456.hmmer (unexplained diff vs previous) -11.11% 9.000 8.000 - -11.11% -
458.sjeng (unexplained diff vs previous) (percentage) -8.00% 0.250 0.230 - -51.06% -
429.mcf (unexplained diff vs previous) (percentage) -7.14% 0.560 0.520 - 100.00% -
401.bzip2 (max) (percentage) -6.45% 0.310 0.290 - 45.00% -
401.bzip2 (unexplained diff vs previous) (percentage) -6.45% 0.310 0.290 - 625.00% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 5.26% 19.000 20.000 - 0.00% -

Added Tests - sample variability
447.dealII (unexplained diff vs previous)
447.dealII (unexplained diff vs previous) (percentage)
473.astar (unexplained diff vs previous)
473.astar (unexplained diff vs previous) (percentage)

Report Time: 0.35s
Execution (seconds)
Name Current %
401.bzip2 2728.000 -
403.gcc 60.000 3.45%
429.mcf 1154.000 -
433.milc 1143.000 -
444.namd 722.000 1.83%
445.gobmk 5247.000 -
447.dealII 1815.000 -
450.soplex 524.000 -
453.povray 469.000 -
456.hmmer 3561.000 -
458.sjeng 8291.000 -
462.libquantum 96.000 -2.04%
464.h264ref 5563.000 -
470.lbm 3163.000 -
471.omnetpp 2763.000 -
473.astar 4848.000 -
482.sphinx3 873.000 -1.13%
Geometric Mean 1370.676 -
Code Size (bytes)
Name Current %
401.bzip2 43341.000 -
403.gcc 1955365.000 -
429.mcf 7974.000 -
433.milc 72918.000 -
444.namd 172221.000 -
445.gobmk 1308108.000 -
447.dealII 1738543.000 -
450.soplex 202447.000 -
453.povray 579415.000 -
456.hmmer 166854.000 -
458.sjeng 96913.000 -
462.libquantum 24071.000 -
464.h264ref 349820.000 -
470.lbm 9810.000 -
471.omnetpp 377740.000 -
473.astar 23287.000 -
482.sphinx3 114907.000 -
Geometric Mean 140020.041 -
sample variability
Name Current %
401.bzip2 12.000 -
401.bzip2 (avg) 12.000 -
401.bzip2 (avg) (percentage) 0.470 -
401.bzip2 (max) 7.000 40.00%
401.bzip2 (max) (percentage) 0.290 45.00%
401.bzip2 (unexplained diff vs previous) 8.000 700.00%
401.bzip2 (unexplained diff vs previous) (percentage) 0.290 625.00%
403.gcc 2.000 -
403.gcc (avg) 2.000 -
403.gcc (avg) (percentage) 3.930 -
403.gcc (max) 4.000 -
403.gcc (max) (percentage) 7.970 -1.48%
429.mcf 15.000 -
429.mcf (avg) 15.000 -
429.mcf (avg) (percentage) 1.360 -
429.mcf (max) 14.000 -
429.mcf (max) (percentage) 1.220 -3.17%
429.mcf (unexplained diff vs previous) 6.000 100.00%
429.mcf (unexplained diff vs previous) (percentage) 0.520 100.00%
433.milc 6.000 -
433.milc (avg) 6.000 -
433.milc (avg) (percentage) 0.550 -
433.milc (max) 3.000 -40.00%
433.milc (max) (percentage) 0.310 -40.38%
433.milc (unexplained diff vs previous) 2.000 -33.33%
433.milc (unexplained diff vs previous) (percentage) 0.170 -34.62%
444.namd 6.000 -
444.namd (avg) 6.000 -
444.namd (avg) (percentage) 0.950 1.06%
444.namd (max) 13.000 85.71%
444.namd (max) (percentage) 1.830 79.41%
444.namd (unexplained diff vs previous) 13.000 550.00%
444.namd (unexplained diff vs previous) (percentage) 1.800 542.86%
445.gobmk 15.000 -6.25%
445.gobmk (avg) 15.000 -6.25%
445.gobmk (avg) (percentage) 0.300 -3.23%
445.gobmk (max) 13.000 62.50%
445.gobmk (max) (percentage) 0.250 56.25%
445.gobmk (unexplained diff vs previous) 13.000 -
445.gobmk (unexplained diff vs previous) (percentage) 0.250 -
447.dealII 11.000 -
447.dealII (avg) 11.000 -
447.dealII (avg) (percentage) 0.640 -3.03%
447.dealII (max) 13.000 -
447.dealII (max) (percentage) 0.730 -3.95%
447.dealII (unexplained diff vs previous) 0.000 -
447.dealII (unexplained diff vs previous) (percentage) 0.000 -
450.soplex 5.000 -
450.soplex (avg) 5.000 -
450.soplex (avg) (percentage) 1.090 -
450.soplex (max) 10.000 -9.09%
450.soplex (max) (percentage) 2.060 -5.07%
450.soplex (unexplained diff vs previous) 4.000 -
450.soplex (unexplained diff vs previous) (percentage) 0.760 -1.30%
453.povray 4.000 -
453.povray (avg) 4.000 -
453.povray (avg) (percentage) 1.020 -
453.povray (max) 3.000 -66.67%
453.povray (max) (percentage) 0.820 -57.73%
453.povray (unexplained diff vs previous) 3.000 -
453.povray (unexplained diff vs previous) (percentage) 0.640 -
456.hmmer 16.000 -
456.hmmer (avg) 16.000 -
456.hmmer (avg) (percentage) 0.470 -
456.hmmer (max) 8.000 -63.64%
456.hmmer (max) (percentage) 0.230 -64.06%
456.hmmer (unexplained diff vs previous) 8.000 -11.11%
456.hmmer (unexplained diff vs previous) (percentage) 0.220 -12.00%
458.sjeng 31.000 -
458.sjeng (avg) 31.000 -
458.sjeng (avg) (percentage) 0.380 -
458.sjeng (max) 37.000 -5.13%
458.sjeng (max) (percentage) 0.450 -6.25%
458.sjeng (unexplained diff vs previous) 19.000 -51.28%
458.sjeng (unexplained diff vs previous) (percentage) 0.230 -51.06%
462.libquantum 1.000 -
462.libquantum (avg) 1.000 -
462.libquantum (avg) (percentage) 1.600 -
462.libquantum (max) 2.000 -
462.libquantum (max) (percentage) 2.370 -4.44%
462.libquantum (unexplained diff vs previous) 2.000 100.00%
462.libquantum (unexplained diff vs previous) (percentage) 2.080 103.92%
464.h264ref 18.000 -
464.h264ref (avg) 18.000 -
464.h264ref (avg) (percentage) 0.330 -
464.h264ref (max) 12.000 -7.69%
464.h264ref (max) (percentage) 0.220 -8.33%
464.h264ref (unexplained diff vs previous) 9.000 28.57%
464.h264ref (unexplained diff vs previous) (percentage) 0.160 23.08%
470.lbm 22.000 -
470.lbm (avg) 22.000 -
470.lbm (avg) (percentage) 0.710 -1.39%
470.lbm (max) 29.000 -6.45%
470.lbm (max) (percentage) 0.940 -6.93%
470.lbm (unexplained diff vs previous) 9.000 350.00%
470.lbm (unexplained diff vs previous) (percentage) 0.280 366.67%
471.omnetpp 36.000 -2.70%
471.omnetpp (avg) 36.000 -2.70%
471.omnetpp (avg) (percentage) 1.330 -
471.omnetpp (max) 37.000 -11.90%
471.omnetpp (max) (percentage) 1.370 -11.04%
471.omnetpp (unexplained diff vs previous) 8.000 33.33%
471.omnetpp (unexplained diff vs previous) (percentage) 0.290 31.82%
473.astar 33.000 -2.94%
473.astar (avg) 33.000 -2.94%
473.astar (avg) (percentage) 0.700 -1.41%
473.astar (max) 47.000 -6.00%
473.astar (max) (percentage) 0.980 -6.67%
473.astar (unexplained diff vs previous) 0.000 -
473.astar (unexplained diff vs previous) (percentage) 0.000 -
482.sphinx3 7.000 -
482.sphinx3 (avg) 7.000 -
482.sphinx3 (avg) (percentage) 0.850 1.19%
482.sphinx3 (max) 9.000 12.50%
482.sphinx3 (max) (percentage) 1.130 24.18%
482.sphinx3 (unexplained diff vs previous) 10.000 25.00%
482.sphinx3 (unexplained diff vs previous) (percentage) 1.150 26.37%
483.xalancbmk (avg) (percentage) 1.330 -
483.xalancbmk (max) (percentage) 0.670 -
Geometric Mean 2.099 -24.79%