Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/b2e6b7354452c10ed6f38958253fd76aca0877de (+ 300 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--llvm-arm-master-Os-build/32/
View Options
Report
Filter

llvm-arm-master-Os test results

Run Order Start Time Duration
Current 0032 (llvmorg-17-init-12245-gb2e6b7354452) 2023-05-20T20:39:01 0:00:00
Previous 0031 (llvmorg-17-init-11945-g287dd0142c08) 2023-05-17T18:44:01 0:00:00
Baseline 0001 (llvmorg-16-init-16061-ge7790fbed32b) 2022-12-29T19:41:07 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 19 47
Performance Improvements 73 93
Added Tests 10 6
Unchanged Tests 678 634
Total Tests 780

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
403.gcc 3.39% 59.000 61.000 - -99.33% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
464.h264ref (unexplained diff vs previous) (percentage) 600.00% 0.050 0.350 - -10.26% -
464.h264ref (unexplained diff vs previous) 533.33% 3.000 19.000 - -68.33% -
429.mcf (unexplained diff vs previous) (percentage) 76.47% 0.340 0.600 - 7.14% -
429.mcf (unexplained diff vs previous) 75.00% 4.000 7.000 - -89.55% -
445.gobmk (max) (percentage) 70.00% 0.200 0.340 - 41.67% -
445.gobmk (max) 70.00% 10.000 17.000 - -41.38% -
482.sphinx3 (unexplained diff vs previous) (percentage) 51.11% 0.450 0.680 - -80.23% -
482.sphinx3 (unexplained diff vs previous) 50.00% 4.000 6.000 - -99.34% -
444.namd (unexplained diff vs previous) (percentage) 47.58% 1.240 1.830 - -70.20% -
444.namd (unexplained diff vs previous) 44.44% 9.000 13.000 - -98.43% -
444.namd (max) (percentage) 42.06% 1.260 1.790 - -72.63% -
458.sjeng (unexplained diff vs previous) (percentage) 38.26% 1.150 1.590 - 536.00% -
458.sjeng (unexplained diff vs previous) 35.79% 95.000 129.000 - 214.63% -
458.sjeng (max) (percentage) 34.48% 1.160 1.560 - 290.00% -
444.namd (max) 33.33% 9.000 12.000 - -98.64% -
458.sjeng (max) 32.63% 95.000 126.000 - 93.85% -
458.sjeng (avg) (percentage) 1.72% 1.160 1.180 - 103.45% -
483.xalancbmk (unexplained diff vs previous) (percentage) 1.56% 0.640 0.650 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
444.namd -1.79% 725.000 712.000 - -94.72% -
458.sjeng -1.56% 8255.000 8126.000 - -50.47% -
462.libquantum -1.00% 100.000 99.000 - -99.25% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
401.bzip2 (max) -81.25% 16.000 3.000 - -93.75% -
401.bzip2 (max) (percentage) -77.05% 0.610 0.140 - -54.84% -
473.astar (max) (percentage) -64.52% 0.310 0.110 - -86.25% -
473.astar (max) -64.29% 14.000 5.000 - -95.61% -
471.omnetpp (unexplained diff vs previous) (percentage) -59.48% 1.160 0.470 - -45.35% -
471.omnetpp (unexplained diff vs previous) -59.38% 32.000 13.000 - -85.87% -
471.omnetpp (max) -54.90% 51.000 23.000 - -87.83% -
471.omnetpp (max) (percentage) -53.76% 1.860 0.860 - -51.14% -
462.libquantum (max) -50.00% 2.000 1.000 - -96.15% -
462.libquantum (unexplained diff vs previous) -50.00% 2.000 1.000 - -93.75% -
462.libquantum (unexplained diff vs previous) (percentage) -49.50% 2.000 1.010 - 741.67% -
473.astar (unexplained diff vs previous) (percentage) -33.33% 0.150 0.100 - -86.84% -
470.lbm (unexplained diff vs previous) (percentage) -31.88% 0.690 0.470 - -86.87% -
470.lbm (unexplained diff vs previous) -31.82% 22.000 15.000 - -96.98% -
473.astar (unexplained diff vs previous) -28.57% 7.000 5.000 - -95.37% -
470.lbm (max) -27.27% 22.000 16.000 - -97.92% -
470.lbm (max) (percentage) -25.71% 0.700 0.520 - -90.61% -
482.sphinx3 (max) -14.29% 7.000 6.000 - -99.31% -
462.libquantum (max) (percentage) -12.75% 2.040 1.780 - 790.00% -
453.povray (max) -12.50% 8.000 7.000 - -94.70% -
450.soplex (max) -11.11% 9.000 8.000 - -90.24% -
482.sphinx3 (max) (percentage) -10.71% 0.840 0.750 - -77.41% -
433.milc (max) (percentage) -10.00% 0.500 0.450 - -67.15% -
483.xalancbmk (max) (percentage) -9.72% 0.720 0.650 - 0.00% -
450.soplex (max) (percentage) -9.63% 1.870 1.690 - 196.49% -
456.hmmer (max) -9.09% 11.000 10.000 - -75.00% -
401.bzip2 -8.33% 24.000 22.000 - -35.29% -
401.bzip2 (avg) -8.33% 24.000 22.000 - -35.29% -
483.xalancbmk (max) -8.00% 25.000 23.000 - -62.30% -
447.dealII (max) -6.67% 15.000 14.000 - -89.15% -
456.hmmer (max) (percentage) -6.06% 0.330 0.310 - 3.33% -
482.sphinx3 -5.56% 18.000 17.000 - -96.52% -
482.sphinx3 (avg) -5.56% 18.000 17.000 - -96.52% -
450.soplex (avg) (percentage) -5.26% 0.570 0.540 - 50.00% -
453.povray (avg) (percentage) -5.06% 1.580 1.500 - 9.49% -
483.xalancbmk -5.03% 199.000 189.000 - 302.13% -
483.xalancbmk (avg) -5.03% 199.000 189.000 - 302.13% -
447.dealII -5.00% 20.000 19.000 - -84.17% -
447.dealII (avg) -5.00% 20.000 19.000 - -84.17% -
429.mcf -4.92% 61.000 58.000 - 9.43% -
429.mcf (avg) -4.92% 61.000 58.000 - 9.43% -
453.povray (max) (percentage) -4.79% 1.670 1.590 - -17.62% -
473.astar (avg) (percentage) -4.58% 4.370 4.170 - 734.00% -
401.bzip2 (avg) (percentage) -4.55% 0.880 0.840 - 281.82% -
473.astar -4.33% 208.000 199.000 - 180.28% -
473.astar (avg) -4.33% 208.000 199.000 - 180.28% -
483.xalancbmk (avg) (percentage) -4.29% 5.590 5.350 - 970.00% -
456.hmmer -4.17% 72.000 69.000 - 43.75% -
456.hmmer (avg) -4.17% 72.000 69.000 - 43.75% -
456.hmmer (avg) (percentage) -3.90% 2.050 1.970 - 447.22% -
445.gobmk (avg) (percentage) -3.88% 1.030 0.990 - 450.00% -
464.h264ref -3.85% 78.000 75.000 - 47.06% -
464.h264ref (avg) -3.85% 78.000 75.000 - 47.06% -
482.sphinx3 (avg) (percentage) -3.81% 2.100 2.020 - 8.60% -
447.dealII (avg) (percentage) -3.48% 1.150 1.110 - -24.49% -
470.lbm -3.41% 88.000 85.000 - -73.60% -
470.lbm (avg) -3.41% 88.000 85.000 - -73.60% -
429.mcf (avg) (percentage) -3.28% 5.190 5.020 - 1015.56% -
471.omnetpp (avg) (percentage) -3.27% 4.590 4.440 - 469.23% -
470.lbm (avg) (percentage) -3.21% 2.800 2.710 - 16.81% -
471.omnetpp -3.17% 126.000 122.000 - 46.99% -
471.omnetpp (avg) -3.17% 126.000 122.000 - 46.99% -
464.h264ref (avg) (percentage) -2.82% 1.420 1.380 - 318.18% -
447.dealII (max) (percentage) -2.33% 0.860 0.840 - -46.84% -
433.milc (avg) (percentage) -2.27% 0.880 0.860 - -14.85% -
444.namd (avg) (percentage) -1.99% 3.010 2.950 - -22.57% -
445.gobmk -1.89% 53.000 52.000 - 136.36% -
445.gobmk (avg) -1.89% 53.000 52.000 - 136.36% -
462.libquantum (avg) (percentage) -1.66% 1.810 1.780 - 1086.67% -
403.gcc (max) (percentage) -1.16% 1.720 1.700 - 347.37% -

Added Tests - sample variability
401.bzip2 (unexplained diff vs previous)
401.bzip2 (unexplained diff vs previous) (percentage)
403.gcc
403.gcc (avg)
447.dealII (unexplained diff vs previous)
447.dealII (unexplained diff vs previous) (percentage)
450.soplex (unexplained diff vs previous)
450.soplex (unexplained diff vs previous) (percentage)
453.povray (unexplained diff vs previous)
453.povray (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
450.soplex 1.70% 198708.000 202078.000 - 0.00% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
462.libquantum (avg) (percentage) 1086.67% 0.150 1.780 - -1.66% -
429.mcf (avg) (percentage) 1015.56% 0.450 5.020 - -3.28% -
483.xalancbmk (avg) (percentage) 970.00% 0.500 5.350 - -4.29% -
462.libquantum (max) (percentage) 790.00% 0.200 1.780 - -12.75% -
462.libquantum (unexplained diff vs previous) (percentage) 741.67% 0.120 1.010 - -49.50% -
473.astar (avg) (percentage) 734.00% 0.500 4.170 - -4.58% -
458.sjeng (unexplained diff vs previous) (percentage) 536.00% 0.250 1.590 - 38.26% -
471.omnetpp (avg) (percentage) 469.23% 0.780 4.440 - -3.27% -
445.gobmk (avg) (percentage) 450.00% 0.180 0.990 - -3.88% -
456.hmmer (avg) (percentage) 447.22% 0.360 1.970 - -3.90% -
403.gcc (max) (percentage) 347.37% 0.380 1.700 - -1.16% -
456.hmmer (unexplained diff vs previous) (percentage) 342.86% 0.070 0.310 - 0.00% -
464.h264ref (avg) (percentage) 318.18% 0.330 1.380 - -2.82% -
483.xalancbmk 302.13% 47.000 189.000 - -5.03% -
483.xalancbmk (avg) 302.13% 47.000 189.000 - -5.03% -
458.sjeng (max) (percentage) 290.00% 0.400 1.560 - 34.48% -
401.bzip2 (avg) (percentage) 281.82% 0.220 0.840 - -4.55% -
464.h264ref (max) (percentage) 251.28% 0.390 1.370 - 0.00% -
458.sjeng (unexplained diff vs previous) 214.63% 41.000 129.000 - 35.79% -
450.soplex (max) (percentage) 196.49% 0.570 1.690 - -9.63% -
473.astar 180.28% 71.000 199.000 - -4.33% -
473.astar (avg) 180.28% 71.000 199.000 - -4.33% -
445.gobmk 136.36% 22.000 52.000 - -1.89% -
445.gobmk (avg) 136.36% 22.000 52.000 - -1.89% -
403.gcc (avg) (percentage) 112.50% 0.480 1.020 - 0.00% -
458.sjeng (avg) (percentage) 103.45% 0.580 1.180 - 1.72% -
458.sjeng (max) 93.85% 65.000 126.000 - 32.63% -
450.soplex (avg) (percentage) 50.00% 0.360 0.540 - -5.26% -
464.h264ref 47.06% 51.000 75.000 - -3.85% -
464.h264ref (avg) 47.06% 51.000 75.000 - -3.85% -
471.omnetpp 46.99% 83.000 122.000 - -3.17% -
471.omnetpp (avg) 46.99% 83.000 122.000 - -3.17% -
456.hmmer 43.75% 48.000 69.000 - -4.17% -
456.hmmer (avg) 43.75% 48.000 69.000 - -4.17% -
445.gobmk (max) (percentage) 41.67% 0.240 0.340 - 70.00% -
445.gobmk (unexplained diff vs previous) (percentage) 41.67% 0.240 0.340 - 0.00% -
464.h264ref (max) 25.00% 60.000 75.000 - 0.00% -
456.hmmer (unexplained diff vs previous) 22.22% 9.000 11.000 - 0.00% -
470.lbm (avg) (percentage) 16.81% 2.320 2.710 - -3.21% -
453.povray (avg) (percentage) 9.49% 1.370 1.500 - -5.06% -
429.mcf 9.43% 53.000 58.000 - -4.92% -
429.mcf (avg) 9.43% 53.000 58.000 - -4.92% -
482.sphinx3 (avg) (percentage) 8.60% 1.860 2.020 - -3.81% -
429.mcf (unexplained diff vs previous) (percentage) 7.14% 0.560 0.600 - 76.47% -
429.mcf (max) (percentage) 5.36% 0.560 0.590 - 0.00% -
456.hmmer (max) (percentage) 3.33% 0.300 0.310 - -6.06% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
462.libquantum -5.68% 26756.000 25235.000 - 0.00% -
453.povray -2.63% 593097.000 577502.000 - 0.00% -
433.milc -2.43% 74971.000 73146.000 - 0.00% -
401.bzip2 -2.18% 39458.000 38597.000 - 0.00% -
447.dealII -1.62% 1777992.000 1749175.000 - 0.00% -
482.sphinx3 -1.23% 115736.000 114311.000 - 0.00% -
456.hmmer -1.17% 168072.000 166102.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
403.gcc -99.33% 9099.000 61.000 - 3.39% -
462.libquantum -99.25% 13126.000 99.000 - -1.00% -
482.sphinx3 -96.66% 26310.000 879.000 - -0.68% -
450.soplex -96.35% 14429.000 526.000 - 0.00% -
444.namd -94.72% 13495.000 712.000 - -1.79% -
453.povray -92.99% 6857.000 481.000 - -0.41% -
433.milc -91.37% 13482.000 1163.000 - -0.26% -
429.mcf -90.23% 11999.000 1172.000 - -0.59% -
401.bzip2 -82.57% 15683.000 2733.000 - 0.00% -
447.dealII -78.44% 8196.000 1767.000 - 0.63% -
470.lbm -77.24% 13882.000 3160.000 - -0.47% -
471.omnetpp -74.31% 10746.000 2761.000 - 0.47% -
456.hmmer -73.59% 13365.000 3530.000 - -0.31% -
473.astar -66.52% 14262.000 4775.000 - -0.10% -
464.h264ref -64.50% 15493.000 5500.000 - -0.34% -
483.xalancbmk -62.35% 9427.000 3549.000 - -0.64% -
445.gobmk -57.58% 12400.000 5260.000 - 0.34% -
458.sjeng -50.47% 16406.000 8126.000 - -1.56% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
482.sphinx3 (unexplained diff vs previous) -99.34% 904.000 6.000 - 50.00% -
482.sphinx3 (max) -99.31% 873.000 6.000 - -14.29% -
444.namd (max) -98.64% 882.000 12.000 - 33.33% -
453.povray (unexplained diff vs previous) -98.46% 130.000 2.000 - 0.00% -
444.namd (unexplained diff vs previous) -98.43% 828.000 13.000 - 44.44% -
433.milc (unexplained diff vs previous) -98.35% 182.000 3.000 - 0.00% -
470.lbm (max) -97.92% 769.000 16.000 - -27.27% -
433.milc (max) -97.28% 184.000 5.000 - 0.00% -
403.gcc (max) -97.06% 34.000 1.000 - 0.00% -
470.lbm (unexplained diff vs previous) -96.98% 497.000 15.000 - -31.82% -
482.sphinx3 -96.52% 489.000 17.000 - -5.56% -
482.sphinx3 (avg) -96.52% 489.000 17.000 - -5.56% -
462.libquantum (max) -96.15% 26.000 1.000 - -50.00% -
450.soplex -96.08% 51.000 2.000 - 0.00% -
450.soplex (avg) -96.08% 51.000 2.000 - 0.00% -
444.namd -95.91% 514.000 21.000 - 0.00% -
444.namd (avg) -95.91% 514.000 21.000 - 0.00% -
473.astar (max) -95.61% 114.000 5.000 - -64.29% -
473.astar (unexplained diff vs previous) -95.37% 108.000 5.000 - -28.57% -
462.libquantum -94.74% 19.000 1.000 - 0.00% -
462.libquantum (avg) -94.74% 19.000 1.000 - 0.00% -
453.povray (max) -94.70% 132.000 7.000 - -12.50% -
401.bzip2 (max) -93.75% 48.000 3.000 - -81.25% -
462.libquantum (unexplained diff vs previous) -93.75% 16.000 1.000 - -50.00% -
433.milc -92.65% 136.000 10.000 - 0.00% -
433.milc (avg) -92.65% 136.000 10.000 - 0.00% -
453.povray -92.47% 93.000 7.000 - 0.00% -
453.povray (avg) -92.47% 93.000 7.000 - 0.00% -
429.mcf (max) -91.04% 67.000 6.000 - 0.00% -
447.dealII (unexplained diff vs previous) -90.91% 121.000 11.000 - 0.00% -
470.lbm (max) (percentage) -90.61% 5.540 0.520 - -25.71% -
450.soplex (max) -90.24% 82.000 8.000 - -11.11% -
429.mcf (unexplained diff vs previous) -89.55% 67.000 7.000 - 75.00% -
447.dealII (max) -89.15% 129.000 14.000 - -6.67% -
471.omnetpp (max) -87.83% 189.000 23.000 - -54.90% -
470.lbm (unexplained diff vs previous) (percentage) -86.87% 3.580 0.470 - -31.88% -
473.astar (unexplained diff vs previous) (percentage) -86.84% 0.760 0.100 - -33.33% -
473.astar (max) (percentage) -86.25% 0.800 0.110 - -64.52% -
471.omnetpp (unexplained diff vs previous) -85.87% 92.000 13.000 - -59.38% -
447.dealII -84.17% 120.000 19.000 - -5.00% -
447.dealII (avg) -84.17% 120.000 19.000 - -5.00% -
433.milc (unexplained diff vs previous) (percentage) -80.74% 1.350 0.260 - 0.00% -
482.sphinx3 (unexplained diff vs previous) (percentage) -80.23% 3.440 0.680 - 51.11% -
453.povray (unexplained diff vs previous) (percentage) -77.89% 1.900 0.420 - 0.00% -
482.sphinx3 (max) (percentage) -77.41% 3.320 0.750 - -10.71% -
456.hmmer (max) -75.00% 40.000 10.000 - -9.09% -
470.lbm -73.60% 322.000 85.000 - -3.41% -
470.lbm (avg) -73.60% 322.000 85.000 - -3.41% -
444.namd (max) (percentage) -72.63% 6.540 1.790 - 42.06% -
444.namd (unexplained diff vs previous) (percentage) -70.20% 6.140 1.830 - 47.58% -
464.h264ref (unexplained diff vs previous) -68.33% 60.000 19.000 - 533.33% -
433.milc (max) (percentage) -67.15% 1.370 0.450 - -10.00% -
483.xalancbmk (max) -62.30% 61.000 23.000 - -8.00% -
483.xalancbmk (unexplained diff vs previous) -62.30% 61.000 23.000 - 0.00% -
447.dealII (unexplained diff vs previous) (percentage) -58.11% 1.480 0.620 - 0.00% -
401.bzip2 (max) (percentage) -54.84% 0.310 0.140 - -77.05% -
471.omnetpp (max) (percentage) -51.14% 1.760 0.860 - -53.76% -
447.dealII (max) (percentage) -46.84% 1.580 0.840 - -2.33% -
471.omnetpp (unexplained diff vs previous) (percentage) -45.35% 0.860 0.470 - -59.48% -
445.gobmk (max) -41.38% 29.000 17.000 - 70.00% -
445.gobmk (unexplained diff vs previous) -40.00% 30.000 18.000 - 0.00% -
401.bzip2 -35.29% 34.000 22.000 - -8.33% -
401.bzip2 (avg) -35.29% 34.000 22.000 - -8.33% -
447.dealII (avg) (percentage) -24.49% 1.470 1.110 - -3.48% -
444.namd (avg) (percentage) -22.57% 3.810 2.950 - -1.99% -
453.povray (max) (percentage) -17.62% 1.930 1.590 - -4.79% -
433.milc (avg) (percentage) -14.85% 1.010 0.860 - -2.27% -
464.h264ref (unexplained diff vs previous) (percentage) -10.26% 0.390 0.350 - 600.00% -

Added Tests - sample variability
401.bzip2 (unexplained diff vs previous)
401.bzip2 (unexplained diff vs previous) (percentage)
403.gcc
403.gcc (avg)
450.soplex (unexplained diff vs previous)
450.soplex (unexplained diff vs previous) (percentage)

Report Time: 0.36s
Execution (seconds)
Name Current %
401.bzip2 2733.000 -
403.gcc 61.000 3.39%
429.mcf 1172.000 -
433.milc 1163.000 -
444.namd 712.000 -1.79%
445.gobmk 5260.000 -
447.dealII 1767.000 -
450.soplex 526.000 -
453.povray 481.000 -
456.hmmer 3530.000 -
458.sjeng 8126.000 -1.56%
462.libquantum 99.000 -1.00%
464.h264ref 5500.000 -
470.lbm 3160.000 -
471.omnetpp 2761.000 -
473.astar 4775.000 -
482.sphinx3 879.000 -
483.xalancbmk 3549.000 -
Geometric Mean 1446.879 -
Code Size (bytes)
Name Current %
401.bzip2 38597.000 -
403.gcc 1958373.000 -
429.mcf 7910.000 -
433.milc 73146.000 -
444.namd 175777.000 -
445.gobmk 1310136.000 -
447.dealII 1749175.000 -
450.soplex 202078.000 -
453.povray 577502.000 -
456.hmmer 166102.000 -
458.sjeng 96921.000 -
462.libquantum 25235.000 -
464.h264ref 352742.000 -
470.lbm 9734.000 -
471.omnetpp 376547.000 -
473.astar 23199.000 -
482.sphinx3 114311.000 -
483.xalancbmk 2286432.000 -
Geometric Mean 162931.262 -
sample variability
Name Current %
401.bzip2 22.000 -8.33%
401.bzip2 (avg) 22.000 -8.33%
401.bzip2 (avg) (percentage) 0.840 -4.55%
401.bzip2 (max) 3.000 -81.25%
401.bzip2 (max) (percentage) 0.140 -77.05%
401.bzip2 (unexplained diff vs previous) 0.000 -
401.bzip2 (unexplained diff vs previous) (percentage) 0.000 -
403.gcc 0.000 -
403.gcc (avg) 0.000 -
403.gcc (avg) (percentage) 1.020 -
403.gcc (max) 1.000 -
403.gcc (max) (percentage) 1.700 -1.16%
429.mcf 58.000 -4.92%
429.mcf (avg) 58.000 -4.92%
429.mcf (avg) (percentage) 5.020 -3.28%
429.mcf (max) 6.000 -
429.mcf (max) (percentage) 0.590 -
429.mcf (unexplained diff vs previous) 7.000 75.00%
429.mcf (unexplained diff vs previous) (percentage) 0.600 76.47%
433.milc 10.000 -
433.milc (avg) 10.000 -
433.milc (avg) (percentage) 0.860 -2.27%
433.milc (max) 5.000 -
433.milc (max) (percentage) 0.450 -10.00%
433.milc (unexplained diff vs previous) 3.000 -
433.milc (unexplained diff vs previous) (percentage) 0.260 -
444.namd 21.000 -
444.namd (avg) 21.000 -
444.namd (avg) (percentage) 2.950 -1.99%
444.namd (max) 12.000 33.33%
444.namd (max) (percentage) 1.790 42.06%
444.namd (unexplained diff vs previous) 13.000 44.44%
444.namd (unexplained diff vs previous) (percentage) 1.830 47.58%
445.gobmk 52.000 -1.89%
445.gobmk (avg) 52.000 -1.89%
445.gobmk (avg) (percentage) 0.990 -3.88%
445.gobmk (max) 17.000 70.00%
445.gobmk (max) (percentage) 0.340 70.00%
445.gobmk (unexplained diff vs previous) 18.000 -
445.gobmk (unexplained diff vs previous) (percentage) 0.340 -
447.dealII 19.000 -5.00%
447.dealII (avg) 19.000 -5.00%
447.dealII (avg) (percentage) 1.110 -3.48%
447.dealII (max) 14.000 -6.67%
447.dealII (max) (percentage) 0.840 -2.33%
447.dealII (unexplained diff vs previous) 11.000 -
447.dealII (unexplained diff vs previous) (percentage) 0.620 -
450.soplex 2.000 -
450.soplex (avg) 2.000 -
450.soplex (avg) (percentage) 0.540 -5.26%
450.soplex (max) 8.000 -11.11%
450.soplex (max) (percentage) 1.690 -9.63%
450.soplex (unexplained diff vs previous) 0.000 -
450.soplex (unexplained diff vs previous) (percentage) 0.000 -
453.povray 7.000 -
453.povray (avg) 7.000 -
453.povray (avg) (percentage) 1.500 -5.06%
453.povray (max) 7.000 -12.50%
453.povray (max) (percentage) 1.590 -4.79%
453.povray (unexplained diff vs previous) 2.000 -
453.povray (unexplained diff vs previous) (percentage) 0.420 -
456.hmmer 69.000 -4.17%
456.hmmer (avg) 69.000 -4.17%
456.hmmer (avg) (percentage) 1.970 -3.90%
456.hmmer (max) 10.000 -9.09%
456.hmmer (max) (percentage) 0.310 -6.06%
456.hmmer (unexplained diff vs previous) 11.000 -
456.hmmer (unexplained diff vs previous) (percentage) 0.310 -
458.sjeng 95.000 -
458.sjeng (avg) 95.000 -
458.sjeng (avg) (percentage) 1.180 1.72%
458.sjeng (max) 126.000 32.63%
458.sjeng (max) (percentage) 1.560 34.48%
458.sjeng (unexplained diff vs previous) 129.000 35.79%
458.sjeng (unexplained diff vs previous) (percentage) 1.590 38.26%
462.libquantum 1.000 -
462.libquantum (avg) 1.000 -
462.libquantum (avg) (percentage) 1.780 -1.66%
462.libquantum (max) 1.000 -50.00%
462.libquantum (max) (percentage) 1.780 -12.75%
462.libquantum (unexplained diff vs previous) 1.000 -50.00%
462.libquantum (unexplained diff vs previous) (percentage) 1.010 -49.50%
464.h264ref 75.000 -3.85%
464.h264ref (avg) 75.000 -3.85%
464.h264ref (avg) (percentage) 1.380 -2.82%
464.h264ref (max) 75.000 -
464.h264ref (max) (percentage) 1.370 -
464.h264ref (unexplained diff vs previous) 19.000 533.33%
464.h264ref (unexplained diff vs previous) (percentage) 0.350 600.00%
470.lbm 85.000 -3.41%
470.lbm (avg) 85.000 -3.41%
470.lbm (avg) (percentage) 2.710 -3.21%
470.lbm (max) 16.000 -27.27%
470.lbm (max) (percentage) 0.520 -25.71%
470.lbm (unexplained diff vs previous) 15.000 -31.82%
470.lbm (unexplained diff vs previous) (percentage) 0.470 -31.88%
471.omnetpp 122.000 -3.17%
471.omnetpp (avg) 122.000 -3.17%
471.omnetpp (avg) (percentage) 4.440 -3.27%
471.omnetpp (max) 23.000 -54.90%
471.omnetpp (max) (percentage) 0.860 -53.76%
471.omnetpp (unexplained diff vs previous) 13.000 -59.38%
471.omnetpp (unexplained diff vs previous) (percentage) 0.470 -59.48%
473.astar 199.000 -4.33%
473.astar (avg) 199.000 -4.33%
473.astar (avg) (percentage) 4.170 -4.58%
473.astar (max) 5.000 -64.29%
473.astar (max) (percentage) 0.110 -64.52%
473.astar (unexplained diff vs previous) 5.000 -28.57%
473.astar (unexplained diff vs previous) (percentage) 0.100 -33.33%
482.sphinx3 17.000 -5.56%
482.sphinx3 (avg) 17.000 -5.56%
482.sphinx3 (avg) (percentage) 2.020 -3.81%
482.sphinx3 (max) 6.000 -14.29%
482.sphinx3 (max) (percentage) 0.750 -10.71%
482.sphinx3 (unexplained diff vs previous) 6.000 50.00%
482.sphinx3 (unexplained diff vs previous) (percentage) 0.680 51.11%
483.xalancbmk 189.000 -5.03%
483.xalancbmk (avg) 189.000 -5.03%
483.xalancbmk (avg) (percentage) 5.350 -4.29%
483.xalancbmk (max) 23.000 -8.00%
483.xalancbmk (max) (percentage) 0.650 -9.72%
483.xalancbmk (unexplained diff vs previous) 23.000 -
483.xalancbmk (unexplained diff vs previous) (percentage) 0.650 1.56%
Geometric Mean 2.818 -24.33%