Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/5e159972917fb7d02347f98d7431f1d02bee33b6 (+ 343 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--llvm-arm-master-Os-build/80/
View Options
Report
Filter

llvm-arm-master-Os test results

Run Order Start Time Duration
Current 0080 (llvmorg-18-init-07891-g5e159972917f) 2023-10-02T08:25:18 0:00:00
Previous 0079 (llvmorg-18-init-07548-g52d35345b268) 2023-09-28T18:38:50 0:00:00
Baseline 0001 (llvmorg-16-init-16061-ge7790fbed32b) 2022-12-29T19:41:07 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 33 33
Performance Improvements 65 117
Added Tests 4 0
Unchanged Tests 678 630
Total Tests 780

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
403.gcc 5.45% 55.000 58.000 - -99.36% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
447.dealII (unexplained diff vs previous) 1600.00% 1.000 17.000 - -85.95% -
447.dealII (unexplained diff vs previous) (percentage) 1533.33% 0.060 0.980 - -33.78% -
471.omnetpp (unexplained diff vs previous) 1100.00% 1.000 12.000 - -86.96% -
471.omnetpp (unexplained diff vs previous) (percentage) 1000.00% 0.040 0.440 - -48.84% -
464.h264ref (unexplained diff vs previous) (percentage) 422.22% 0.090 0.470 - 20.51% -
464.h264ref (unexplained diff vs previous) 420.00% 5.000 26.000 - -56.67% -
482.sphinx3 (unexplained diff vs previous) 250.00% 2.000 7.000 - -99.23% -
482.sphinx3 (unexplained diff vs previous) (percentage) 243.48% 0.230 0.790 - -77.03% -
464.h264ref (max) 136.36% 11.000 26.000 - -56.67% -
464.h264ref (max) (percentage) 135.00% 0.200 0.470 - 20.51% -
453.povray (unexplained diff vs previous) (percentage) 103.45% 0.870 1.770 - -6.84% -
445.gobmk (unexplained diff vs previous) 100.00% 3.000 6.000 - -80.00% -
453.povray (unexplained diff vs previous) 100.00% 4.000 8.000 - -93.85% -
453.povray (max) (percentage) 97.73% 0.880 1.740 - -9.84% -
445.gobmk (unexplained diff vs previous) (percentage) 83.33% 0.060 0.110 - -54.17% -
453.povray (max) 75.00% 4.000 7.000 - -94.70% -
483.xalancbmk (unexplained diff vs previous) (percentage) 71.64% 0.670 1.150 - 76.92% -
483.xalancbmk (unexplained diff vs previous) 70.83% 24.000 41.000 - -32.79% -
429.mcf (unexplained diff vs previous) (percentage) 52.94% 0.170 0.260 - -53.57% -
403.gcc (max) 50.00% 2.000 3.000 - -91.18% -
429.mcf (max) 50.00% 2.000 3.000 - -95.52% -
429.mcf (unexplained diff vs previous) 50.00% 2.000 3.000 - -95.52% -
403.gcc (max) (percentage) 40.46% 3.880 5.450 - 1334.21% -
433.milc (max) (percentage) 20.93% 0.430 0.520 - -62.04% -
433.milc (unexplained diff vs previous) (percentage) 20.93% 0.430 0.520 - -61.48% -
433.milc (max) 20.00% 5.000 6.000 - -96.74% -
433.milc (unexplained diff vs previous) 20.00% 5.000 6.000 - -96.70% -
447.dealII (max) (percentage) 19.75% 0.810 0.970 - -38.61% -
447.dealII (max) 14.29% 14.000 16.000 - -87.60% -
429.mcf (max) (percentage) 13.04% 0.230 0.260 - -53.57% -
403.gcc (avg) (percentage) 12.44% 2.250 2.530 - 427.08% -
453.povray (avg) (percentage) 2.40% 1.250 1.280 - -6.57% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
453.povray -1.74% 460.000 452.000 - -93.41% -
483.xalancbmk -1.14% 3605.000 3564.000 - -62.19% -
462.libquantum -1.02% 98.000 97.000 - -99.26% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
444.namd (max) -81.25% 16.000 3.000 - -99.66% -
456.hmmer (unexplained diff vs previous) -80.00% 5.000 1.000 - -88.89% -
473.astar (unexplained diff vs previous) (percentage) -78.95% 0.380 0.080 - -89.47% -
456.hmmer (unexplained diff vs previous) (percentage) -78.57% 0.140 0.030 - -57.14% -
473.astar (unexplained diff vs previous) -77.78% 18.000 4.000 - -96.30% -
444.namd (max) (percentage) -75.11% 2.250 0.560 - -91.44% -
470.lbm (unexplained diff vs previous) (percentage) -68.42% 0.190 0.060 - -98.32% -
401.bzip2 (unexplained diff vs previous) -66.67% 18.000 6.000 - -87.76% -
450.soplex (max) -66.67% 15.000 5.000 - -93.90% -
470.lbm (unexplained diff vs previous) -66.67% 6.000 2.000 - -99.60% -
401.bzip2 (unexplained diff vs previous) (percentage) -66.15% 0.650 0.220 - -29.03% -
450.soplex (max) (percentage) -61.11% 2.880 1.120 - 96.49% -
456.hmmer (max) -60.00% 10.000 4.000 - -90.00% -
473.astar (max) -57.89% 38.000 16.000 - -85.96% -
473.astar (max) (percentage) -57.50% 0.800 0.340 - -57.50% -
456.hmmer (max) (percentage) -55.17% 0.290 0.130 - -56.67% -
462.libquantum (unexplained diff vs previous) -50.00% 2.000 1.000 - -93.75% -
462.libquantum (unexplained diff vs previous) (percentage) -49.51% 2.040 1.030 - 758.33% -
450.soplex (unexplained diff vs previous) (percentage) -43.61% 1.330 0.750 - 31.58% -
450.soplex (unexplained diff vs previous) -42.86% 7.000 4.000 - -95.12% -
462.libquantum (max) (percentage) -25.00% 2.000 1.500 - 650.00% -
401.bzip2 (max) -22.22% 18.000 14.000 - -70.83% -
401.bzip2 (max) (percentage) -16.92% 0.650 0.540 - 74.19% -
483.xalancbmk (max) -12.28% 57.000 50.000 - -18.03% -
458.sjeng (max) -11.76% 34.000 30.000 - -53.85% -
483.xalancbmk (max) (percentage) -10.63% 1.600 1.430 - 120.00% -
482.sphinx3 (max) -10.00% 10.000 9.000 - -98.97% -
458.sjeng (max) (percentage) -9.52% 0.420 0.380 - -5.00% -
470.lbm (max) (percentage) -9.52% 0.420 0.380 - -93.14% -
482.sphinx3 (max) (percentage) -8.33% 1.200 1.100 - -66.87% -
470.lbm (max) -7.69% 13.000 12.000 - -98.44% -
482.sphinx3 -7.69% 13.000 12.000 - -97.55% -
482.sphinx3 (avg) -7.69% 13.000 12.000 - -97.55% -
471.omnetpp (max) -6.45% 62.000 58.000 - -69.31% -
471.omnetpp (max) (percentage) -6.17% 2.270 2.130 - 21.02% -
445.gobmk (max) -5.88% 17.000 16.000 - -44.83% -
456.hmmer -4.35% 46.000 44.000 - -8.33% -
456.hmmer (avg) -4.35% 46.000 44.000 - -8.33% -
456.hmmer (avg) (percentage) -3.82% 1.310 1.260 - 250.00% -
471.omnetpp -3.70% 81.000 78.000 - -6.02% -
471.omnetpp (avg) -3.70% 81.000 78.000 - -6.02% -
483.xalancbmk -3.60% 111.000 107.000 - 127.66% -
483.xalancbmk (avg) -3.60% 111.000 107.000 - 127.66% -
473.astar -3.39% 118.000 114.000 - 60.56% -
473.astar (avg) -3.39% 118.000 114.000 - 60.56% -
473.astar (avg) (percentage) -3.23% 2.480 2.400 - 380.00% -
445.gobmk (max) (percentage) -3.03% 0.330 0.320 - 33.33% -
470.lbm (avg) (percentage) -3.01% 1.660 1.610 - -30.60% -
445.gobmk (avg) (percentage) -2.90% 0.690 0.670 - 272.22% -
444.namd (avg) (percentage) -2.87% 2.090 2.030 - -46.72% -
429.mcf -2.78% 36.000 35.000 - -33.96% -
429.mcf (avg) -2.78% 36.000 35.000 - -33.96% -
445.gobmk -2.78% 36.000 35.000 - 59.09% -
445.gobmk (avg) -2.78% 36.000 35.000 - 59.09% -
429.mcf (avg) (percentage) -2.55% 3.140 3.060 - 580.00% -
471.omnetpp (avg) (percentage) -2.37% 2.950 2.880 - 269.23% -
482.sphinx3 (avg) (percentage) -2.01% 1.490 1.460 - -21.51% -
483.xalancbmk (avg) (percentage) -1.94% 3.090 3.030 - 506.00% -
470.lbm -1.92% 52.000 51.000 - -84.16% -
470.lbm (avg) -1.92% 52.000 51.000 - -84.16% -
401.bzip2 (avg) (percentage) -1.59% 0.630 0.620 - 181.82% -
464.h264ref (avg) (percentage) -1.23% 0.810 0.800 - 142.42% -

Added Tests - sample variability
403.gcc (unexplained diff vs previous)
403.gcc (unexplained diff vs previous) (percentage)
444.namd (unexplained diff vs previous)
444.namd (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
401.bzip2 5.98% 39458.000 41817.000 - 0.00% -
450.soplex 1.78% 198708.000 202254.000 - 0.00% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
403.gcc (max) (percentage) 1334.21% 0.380 5.450 - 40.46% -
403.gcc (unexplained diff vs previous) (percentage) 1297.30% 0.370 5.170 - 0.00% -
462.libquantum (avg) (percentage) 860.00% 0.150 1.440 - -0.69% -
462.libquantum (unexplained diff vs previous) (percentage) 758.33% 0.120 1.030 - -49.51% -
462.libquantum (max) (percentage) 650.00% 0.200 1.500 - -25.00% -
429.mcf (avg) (percentage) 580.00% 0.450 3.060 - -2.55% -
483.xalancbmk (avg) (percentage) 506.00% 0.500 3.030 - -1.94% -
403.gcc (avg) (percentage) 427.08% 0.480 2.530 - 12.44% -
473.astar (avg) (percentage) 380.00% 0.500 2.400 - -3.23% -
445.gobmk (avg) (percentage) 272.22% 0.180 0.670 - -2.90% -
471.omnetpp (avg) (percentage) 269.23% 0.780 2.880 - -2.37% -
456.hmmer (avg) (percentage) 250.00% 0.360 1.260 - -3.82% -
450.soplex (avg) (percentage) 186.11% 0.360 1.030 - -0.96% -
401.bzip2 (avg) (percentage) 181.82% 0.220 0.620 - -1.59% -
464.h264ref (avg) (percentage) 142.42% 0.330 0.800 - -1.23% -
483.xalancbmk 127.66% 47.000 107.000 - -3.60% -
483.xalancbmk (avg) 127.66% 47.000 107.000 - -3.60% -
483.xalancbmk (max) (percentage) 120.00% 0.650 1.430 - -10.63% -
450.soplex (max) (percentage) 96.49% 0.570 1.120 - -61.11% -
483.xalancbmk (unexplained diff vs previous) (percentage) 76.92% 0.650 1.150 - 71.64% -
401.bzip2 (max) (percentage) 74.19% 0.310 0.540 - -16.92% -
473.astar 60.56% 71.000 114.000 - -3.39% -
473.astar (avg) 60.56% 71.000 114.000 - -3.39% -
445.gobmk 59.09% 22.000 35.000 - -2.78% -
445.gobmk (avg) 59.09% 22.000 35.000 - -2.78% -
458.sjeng (avg) (percentage) 36.21% 0.580 0.790 - 0.00% -
445.gobmk (max) (percentage) 33.33% 0.240 0.320 - -3.03% -
450.soplex (unexplained diff vs previous) (percentage) 31.58% 0.570 0.750 - -43.61% -
471.omnetpp (max) (percentage) 21.02% 1.760 2.130 - -6.17% -
464.h264ref (max) (percentage) 20.51% 0.390 0.470 - 135.00% -
464.h264ref (unexplained diff vs previous) (percentage) 20.51% 0.390 0.470 - 422.22% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
462.libquantum -9.00% 26756.000 24347.000 - 0.00% -
453.povray -2.66% 593097.000 577326.000 - 0.00% -
433.milc -2.52% 74971.000 73078.000 - 0.00% -
447.dealII -1.79% 1777992.000 1746195.000 - 0.00% -
482.sphinx3 -1.09% 115736.000 114471.000 - 0.00% -
456.hmmer -1.06% 168072.000 166298.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
403.gcc -99.36% 9099.000 58.000 - 5.45% -
462.libquantum -99.26% 13126.000 97.000 - -1.02% -
482.sphinx3 -96.62% 26310.000 890.000 - 0.79% -
450.soplex -96.31% 14429.000 532.000 - 0.76% -
444.namd -94.74% 13495.000 710.000 - -0.56% -
453.povray -93.41% 6857.000 452.000 - -1.74% -
433.milc -91.42% 13482.000 1157.000 - -0.52% -
429.mcf -90.23% 11999.000 1172.000 - -0.26% -
401.bzip2 -82.34% 15683.000 2770.000 - -0.22% -
447.dealII -78.88% 8196.000 1731.000 - -0.97% -
470.lbm -77.14% 13882.000 3174.000 - 0.06% -
471.omnetpp -74.53% 10746.000 2737.000 - -0.44% -
456.hmmer -73.28% 13365.000 3571.000 - 0.03% -
473.astar -66.58% 14262.000 4767.000 - 0.08% -
464.h264ref -64.24% 15493.000 5540.000 - 0.47% -
483.xalancbmk -62.19% 9427.000 3564.000 - -1.14% -
445.gobmk -57.75% 12400.000 5239.000 - 0.11% -
458.sjeng -50.37% 16406.000 8143.000 - 0.33% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
444.namd (max) -99.66% 882.000 3.000 - -81.25% -
470.lbm (unexplained diff vs previous) -99.60% 497.000 2.000 - -66.67% -
444.namd (unexplained diff vs previous) -99.52% 828.000 4.000 - 0.00% -
482.sphinx3 (unexplained diff vs previous) -99.23% 904.000 7.000 - 250.00% -
482.sphinx3 (max) -98.97% 873.000 9.000 - -10.00% -
470.lbm (max) -98.44% 769.000 12.000 - -7.69% -
470.lbm (unexplained diff vs previous) (percentage) -98.32% 3.580 0.060 - -68.42% -
403.gcc -97.67% 43.000 1.000 - 0.00% -
403.gcc (avg) -97.67% 43.000 1.000 - 0.00% -
482.sphinx3 -97.55% 489.000 12.000 - -7.69% -
482.sphinx3 (avg) -97.55% 489.000 12.000 - -7.69% -
444.namd -97.28% 514.000 14.000 - 0.00% -
444.namd (avg) -97.28% 514.000 14.000 - 0.00% -
433.milc (max) -96.74% 184.000 6.000 - 20.00% -
433.milc (unexplained diff vs previous) -96.70% 182.000 6.000 - 20.00% -
473.astar (unexplained diff vs previous) -96.30% 108.000 4.000 - -77.78% -
462.libquantum (max) -96.15% 26.000 1.000 - 0.00% -
429.mcf (max) -95.52% 67.000 3.000 - 50.00% -
429.mcf (unexplained diff vs previous) -95.52% 67.000 3.000 - 50.00% -
450.soplex (unexplained diff vs previous) -95.12% 82.000 4.000 - -42.86% -
433.milc -94.85% 136.000 7.000 - 0.00% -
433.milc (avg) -94.85% 136.000 7.000 - 0.00% -
462.libquantum -94.74% 19.000 1.000 - 0.00% -
462.libquantum (avg) -94.74% 19.000 1.000 - 0.00% -
453.povray (max) -94.70% 132.000 7.000 - 75.00% -
453.povray -94.62% 93.000 5.000 - 0.00% -
453.povray (avg) -94.62% 93.000 5.000 - 0.00% -
450.soplex (max) -93.90% 82.000 5.000 - -66.67% -
453.povray (unexplained diff vs previous) -93.85% 130.000 8.000 - 100.00% -
462.libquantum (unexplained diff vs previous) -93.75% 16.000 1.000 - -50.00% -
470.lbm (max) (percentage) -93.14% 5.540 0.380 - -9.52% -
444.namd (max) (percentage) -91.44% 6.540 0.560 - -75.11% -
403.gcc (max) -91.18% 34.000 3.000 - 50.00% -
403.gcc (unexplained diff vs previous) -91.18% 34.000 3.000 - 0.00% -
444.namd (unexplained diff vs previous) (percentage) -90.88% 6.140 0.560 - 0.00% -
450.soplex -90.20% 51.000 5.000 - 0.00% -
450.soplex (avg) -90.20% 51.000 5.000 - 0.00% -
456.hmmer (max) -90.00% 40.000 4.000 - -60.00% -
473.astar (unexplained diff vs previous) (percentage) -89.47% 0.760 0.080 - -78.95% -
456.hmmer (unexplained diff vs previous) -88.89% 9.000 1.000 - -80.00% -
447.dealII -88.33% 120.000 14.000 - 0.00% -
447.dealII (avg) -88.33% 120.000 14.000 - 0.00% -
401.bzip2 (unexplained diff vs previous) -87.76% 49.000 6.000 - -66.67% -
447.dealII (max) -87.60% 129.000 16.000 - 14.29% -
471.omnetpp (unexplained diff vs previous) -86.96% 92.000 12.000 - 1100.00% -
473.astar (max) -85.96% 114.000 16.000 - -57.89% -
447.dealII (unexplained diff vs previous) -85.95% 121.000 17.000 - 1600.00% -
470.lbm -84.16% 322.000 51.000 - -1.92% -
470.lbm (avg) -84.16% 322.000 51.000 - -1.92% -
445.gobmk (unexplained diff vs previous) -80.00% 30.000 6.000 - 100.00% -
482.sphinx3 (unexplained diff vs previous) (percentage) -77.03% 3.440 0.790 - 243.48% -
401.bzip2 (max) -70.83% 48.000 14.000 - -22.22% -
471.omnetpp (max) -69.31% 189.000 58.000 - -6.45% -
482.sphinx3 (max) (percentage) -66.87% 3.320 1.100 - -8.33% -
433.milc (max) (percentage) -62.04% 1.370 0.520 - 20.93% -
433.milc (unexplained diff vs previous) (percentage) -61.48% 1.350 0.520 - 20.93% -
473.astar (max) (percentage) -57.50% 0.800 0.340 - -57.50% -
456.hmmer (unexplained diff vs previous) (percentage) -57.14% 0.070 0.030 - -78.57% -
456.hmmer (max) (percentage) -56.67% 0.300 0.130 - -55.17% -
464.h264ref (max) -56.67% 60.000 26.000 - 136.36% -
464.h264ref (unexplained diff vs previous) -56.67% 60.000 26.000 - 420.00% -
445.gobmk (unexplained diff vs previous) (percentage) -54.17% 0.240 0.110 - 83.33% -
458.sjeng (max) -53.85% 65.000 30.000 - -11.76% -
429.mcf (max) (percentage) -53.57% 0.560 0.260 - 13.04% -
429.mcf (unexplained diff vs previous) (percentage) -53.57% 0.560 0.260 - 52.94% -
401.bzip2 -50.00% 34.000 17.000 - 0.00% -
401.bzip2 (avg) -50.00% 34.000 17.000 - 0.00% -
471.omnetpp (unexplained diff vs previous) (percentage) -48.84% 0.860 0.440 - 1000.00% -
444.namd (avg) (percentage) -46.72% 3.810 2.030 - -2.87% -
445.gobmk (max) -44.83% 29.000 16.000 - -5.88% -
447.dealII (avg) (percentage) -42.86% 1.470 0.840 - 0.00% -
447.dealII (max) (percentage) -38.61% 1.580 0.970 - 19.75% -
433.milc (avg) (percentage) -34.65% 1.010 0.660 - 0.00% -
429.mcf -33.96% 53.000 35.000 - -2.78% -
429.mcf (avg) -33.96% 53.000 35.000 - -2.78% -
447.dealII (unexplained diff vs previous) (percentage) -33.78% 1.480 0.980 - 1533.33% -
483.xalancbmk (unexplained diff vs previous) -32.79% 61.000 41.000 - 70.83% -
458.sjeng -32.63% 95.000 64.000 - 0.00% -
458.sjeng (avg) -32.63% 95.000 64.000 - 0.00% -
470.lbm (avg) (percentage) -30.60% 2.320 1.610 - -3.01% -
401.bzip2 (unexplained diff vs previous) (percentage) -29.03% 0.310 0.220 - -66.15% -
482.sphinx3 (avg) (percentage) -21.51% 1.860 1.460 - -2.01% -
483.xalancbmk (max) -18.03% 61.000 50.000 - -12.28% -
464.h264ref -13.73% 51.000 44.000 - 0.00% -
464.h264ref (avg) -13.73% 51.000 44.000 - 0.00% -
453.povray (max) (percentage) -9.84% 1.930 1.740 - 97.73% -
456.hmmer -8.33% 48.000 44.000 - -4.35% -
456.hmmer (avg) -8.33% 48.000 44.000 - -4.35% -
453.povray (unexplained diff vs previous) (percentage) -6.84% 1.900 1.770 - 103.45% -
453.povray (avg) (percentage) -6.57% 1.370 1.280 - 2.40% -
471.omnetpp -6.02% 83.000 78.000 - -3.70% -
471.omnetpp (avg) -6.02% 83.000 78.000 - -3.70% -
458.sjeng (max) (percentage) -5.00% 0.400 0.380 - -9.52% -

Report Time: 0.36s
Execution (seconds)
Name Current %
401.bzip2 2770.000 -
403.gcc 58.000 5.45%
429.mcf 1172.000 -
433.milc 1157.000 -
444.namd 710.000 -
445.gobmk 5239.000 -
447.dealII 1731.000 -
450.soplex 532.000 -
453.povray 452.000 -1.74%
456.hmmer 3571.000 -
458.sjeng 8143.000 -
462.libquantum 97.000 -1.02%
464.h264ref 5540.000 -
470.lbm 3174.000 -
471.omnetpp 2737.000 -
473.astar 4767.000 -
482.sphinx3 890.000 -
483.xalancbmk 3564.000 -1.14%
Geometric Mean 1438.124 -
Code Size (bytes)
Name Current %
401.bzip2 41817.000 -
403.gcc 1960957.000 -
429.mcf 7922.000 -
433.milc 73078.000 -
444.namd 174849.000 -
445.gobmk 1309848.000 -
447.dealII 1746195.000 -
450.soplex 202254.000 -
453.povray 577326.000 -
456.hmmer 166298.000 -
458.sjeng 97185.000 -
462.libquantum 24347.000 -
464.h264ref 352078.000 -
470.lbm 9750.000 -
471.omnetpp 376711.000 -
473.astar 23183.000 -
482.sphinx3 114471.000 -
483.xalancbmk 2286572.000 -
Geometric Mean 163333.838 -
sample variability
Name Current %
401.bzip2 17.000 -
401.bzip2 (avg) 17.000 -
401.bzip2 (avg) (percentage) 0.620 -1.59%
401.bzip2 (max) 14.000 -22.22%
401.bzip2 (max) (percentage) 0.540 -16.92%
401.bzip2 (unexplained diff vs previous) 6.000 -66.67%
401.bzip2 (unexplained diff vs previous) (percentage) 0.220 -66.15%
403.gcc 1.000 -
403.gcc (avg) 1.000 -
403.gcc (avg) (percentage) 2.530 12.44%
403.gcc (max) 3.000 50.00%
403.gcc (max) (percentage) 5.450 40.46%
403.gcc (unexplained diff vs previous) 3.000 -
403.gcc (unexplained diff vs previous) (percentage) 5.170 -
429.mcf 35.000 -2.78%
429.mcf (avg) 35.000 -2.78%
429.mcf (avg) (percentage) 3.060 -2.55%
429.mcf (max) 3.000 50.00%
429.mcf (max) (percentage) 0.260 13.04%
429.mcf (unexplained diff vs previous) 3.000 50.00%
429.mcf (unexplained diff vs previous) (percentage) 0.260 52.94%
433.milc 7.000 -
433.milc (avg) 7.000 -
433.milc (avg) (percentage) 0.660 -
433.milc (max) 6.000 20.00%
433.milc (max) (percentage) 0.520 20.93%
433.milc (unexplained diff vs previous) 6.000 20.00%
433.milc (unexplained diff vs previous) (percentage) 0.520 20.93%
444.namd 14.000 -
444.namd (avg) 14.000 -
444.namd (avg) (percentage) 2.030 -2.87%
444.namd (max) 3.000 -81.25%
444.namd (max) (percentage) 0.560 -75.11%
444.namd (unexplained diff vs previous) 4.000 -
444.namd (unexplained diff vs previous) (percentage) 0.560 -
445.gobmk 35.000 -2.78%
445.gobmk (avg) 35.000 -2.78%
445.gobmk (avg) (percentage) 0.670 -2.90%
445.gobmk (max) 16.000 -5.88%
445.gobmk (max) (percentage) 0.320 -3.03%
445.gobmk (unexplained diff vs previous) 6.000 100.00%
445.gobmk (unexplained diff vs previous) (percentage) 0.110 83.33%
447.dealII 14.000 -
447.dealII (avg) 14.000 -
447.dealII (avg) (percentage) 0.840 -
447.dealII (max) 16.000 14.29%
447.dealII (max) (percentage) 0.970 19.75%
447.dealII (unexplained diff vs previous) 17.000 1600.00%
447.dealII (unexplained diff vs previous) (percentage) 0.980 1533.33%
450.soplex 5.000 -
450.soplex (avg) 5.000 -
450.soplex (avg) (percentage) 1.030 -
450.soplex (max) 5.000 -66.67%
450.soplex (max) (percentage) 1.120 -61.11%
450.soplex (unexplained diff vs previous) 4.000 -42.86%
450.soplex (unexplained diff vs previous) (percentage) 0.750 -43.61%
453.povray 5.000 -
453.povray (avg) 5.000 -
453.povray (avg) (percentage) 1.280 2.40%
453.povray (max) 7.000 75.00%
453.povray (max) (percentage) 1.740 97.73%
453.povray (unexplained diff vs previous) 8.000 100.00%
453.povray (unexplained diff vs previous) (percentage) 1.770 103.45%
456.hmmer 44.000 -4.35%
456.hmmer (avg) 44.000 -4.35%
456.hmmer (avg) (percentage) 1.260 -3.82%
456.hmmer (max) 4.000 -60.00%
456.hmmer (max) (percentage) 0.130 -55.17%
456.hmmer (unexplained diff vs previous) 1.000 -80.00%
456.hmmer (unexplained diff vs previous) (percentage) 0.030 -78.57%
458.sjeng 64.000 -
458.sjeng (avg) 64.000 -
458.sjeng (avg) (percentage) 0.790 -
458.sjeng (max) 30.000 -11.76%
458.sjeng (max) (percentage) 0.380 -9.52%
462.libquantum 1.000 -
462.libquantum (avg) 1.000 -
462.libquantum (avg) (percentage) 1.440 -
462.libquantum (max) 1.000 -
462.libquantum (max) (percentage) 1.500 -25.00%
462.libquantum (unexplained diff vs previous) 1.000 -50.00%
462.libquantum (unexplained diff vs previous) (percentage) 1.030 -49.51%
464.h264ref 44.000 -
464.h264ref (avg) 44.000 -
464.h264ref (avg) (percentage) 0.800 -1.23%
464.h264ref (max) 26.000 136.36%
464.h264ref (max) (percentage) 0.470 135.00%
464.h264ref (unexplained diff vs previous) 26.000 420.00%
464.h264ref (unexplained diff vs previous) (percentage) 0.470 422.22%
470.lbm 51.000 -1.92%
470.lbm (avg) 51.000 -1.92%
470.lbm (avg) (percentage) 1.610 -3.01%
470.lbm (max) 12.000 -7.69%
470.lbm (max) (percentage) 0.380 -9.52%
470.lbm (unexplained diff vs previous) 2.000 -66.67%
470.lbm (unexplained diff vs previous) (percentage) 0.060 -68.42%
471.omnetpp 78.000 -3.70%
471.omnetpp (avg) 78.000 -3.70%
471.omnetpp (avg) (percentage) 2.880 -2.37%
471.omnetpp (max) 58.000 -6.45%
471.omnetpp (max) (percentage) 2.130 -6.17%
471.omnetpp (unexplained diff vs previous) 12.000 1100.00%
471.omnetpp (unexplained diff vs previous) (percentage) 0.440 1000.00%
473.astar 114.000 -3.39%
473.astar (avg) 114.000 -3.39%
473.astar (avg) (percentage) 2.400 -3.23%
473.astar (max) 16.000 -57.89%
473.astar (max) (percentage) 0.340 -57.50%
473.astar (unexplained diff vs previous) 4.000 -77.78%
473.astar (unexplained diff vs previous) (percentage) 0.080 -78.95%
482.sphinx3 12.000 -7.69%
482.sphinx3 (avg) 12.000 -7.69%
482.sphinx3 (avg) (percentage) 1.460 -2.01%
482.sphinx3 (max) 9.000 -10.00%
482.sphinx3 (max) (percentage) 1.100 -8.33%
482.sphinx3 (unexplained diff vs previous) 7.000 250.00%
482.sphinx3 (unexplained diff vs previous) (percentage) 0.790 243.48%
483.xalancbmk 107.000 -3.60%
483.xalancbmk (avg) 107.000 -3.60%
483.xalancbmk (avg) (percentage) 3.030 -1.94%
483.xalancbmk (max) 50.000 -12.28%
483.xalancbmk (max) (percentage) 1.430 -10.63%
483.xalancbmk (unexplained diff vs previous) 41.000 70.83%
483.xalancbmk (unexplained diff vs previous) (percentage) 1.150 71.64%
Geometric Mean 3.580 -