Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/6ad0788c332bb2043142954d300c49ac3e537f34 (+ 417 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6-llvm-arm-master-Os-build/2/
View Options
Report
Filter

llvm-arm-master-Os test results

Run Order Start Time Duration
Current 0002 (llvmorg-16-init-17349-g6ad0788c332b) 2023-01-11T10:53:13 0:00:00
Previous 0001 (llvmorg-16-init-16932-gf2f3b1a87ad2) 2023-01-08T01:15:25 0:00:00
Baseline 0001 (llvmorg-16-init-16061-ge7790fbed32b) 2022-12-29T19:41:07 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 16 82
Performance Improvements 92 56
Unchanged Tests 672 642
Total Tests 780

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
470.lbm 1.67% 12023.000 12224.000 - -11.94% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
450.soplex (unexplained diff vs previous) 4200.00% 1.000 43.000 - -47.56% -
450.soplex (unexplained diff vs previous) (percentage) 2900.00% 0.010 0.300 - -47.37% -
462.libquantum (unexplained diff vs previous) (percentage) 440.00% 0.100 0.540 - 350.00% -
462.libquantum (unexplained diff vs previous) 425.00% 12.000 63.000 - 293.75% -
445.gobmk (unexplained diff vs previous) (percentage) 381.82% 0.110 0.530 - 120.83% -
445.gobmk (unexplained diff vs previous) 376.92% 13.000 62.000 - 106.67% -
464.h264ref (unexplained diff vs previous) 131.82% 22.000 51.000 - -15.00% -
464.h264ref (unexplained diff vs previous) (percentage) 125.00% 0.160 0.360 - -7.69% -
456.hmmer (unexplained diff vs previous) 104.65% 43.000 88.000 - 877.78% -
456.hmmer (unexplained diff vs previous) (percentage) 102.70% 0.370 0.750 - 971.43% -
401.bzip2 (unexplained diff vs previous) 100.00% 6.000 12.000 - -75.51% -
401.bzip2 (unexplained diff vs previous) (percentage) 100.00% 0.040 0.080 - -74.19% -
444.namd (unexplained diff vs previous) 100.00% 1.000 2.000 - -99.76% -
444.namd (unexplained diff vs previous) (percentage) 100.00% 0.010 0.020 - -99.67% -
429.mcf (unexplained diff vs previous) 8.33% 24.000 26.000 - -61.19% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
483.xalancbmk -2.98% 7881.000 7646.000 - -18.89% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
482.sphinx3 (unexplained diff vs previous) (percentage) -96.21% 3.430 0.130 - -96.22% -
482.sphinx3 (unexplained diff vs previous) -96.09% 843.000 33.000 - -96.35% -
471.omnetpp (max) (percentage) -89.73% 8.960 0.920 - -47.73% -
471.omnetpp (max) -89.73% 847.000 87.000 - -53.97% -
473.astar (unexplained diff vs previous) (percentage) -85.87% 0.920 0.130 - -82.89% -
473.astar (unexplained diff vs previous) -85.59% 118.000 17.000 - -84.26% -
433.milc (unexplained diff vs previous) -76.19% 21.000 5.000 - -97.25% -
471.omnetpp (unexplained diff vs previous) -76.07% 117.000 28.000 - -69.57% -
471.omnetpp (unexplained diff vs previous) (percentage) -75.81% 1.240 0.300 - -65.12% -
433.milc (unexplained diff vs previous) (percentage) -75.00% 0.160 0.040 - -97.04% -
470.lbm (unexplained diff vs previous) (percentage) -74.45% 6.420 1.640 - -54.19% -
470.lbm (unexplained diff vs previous) -73.96% 772.000 201.000 - -59.56% -
403.gcc (unexplained diff vs previous) (percentage) -55.22% 0.670 0.300 - -18.92% -
403.gcc (unexplained diff vs previous) -55.00% 60.000 27.000 - -20.59% -
458.sjeng (unexplained diff vs previous) (percentage) -47.83% 0.230 0.120 - -52.00% -
458.sjeng (unexplained diff vs previous) -47.50% 40.000 21.000 - -48.78% -
482.sphinx3 -8.15% 589.000 541.000 - 10.63% -
482.sphinx3 (avg) -8.15% 589.000 541.000 - 10.63% -
444.namd -8.11% 444.000 408.000 - -20.62% -
444.namd (avg) -8.11% 444.000 408.000 - -20.62% -
483.xalancbmk (max) -8.08% 1201.000 1104.000 - 1709.84% -
444.namd (avg) (percentage) -7.97% 3.640 3.350 - -12.07% -
482.sphinx3 (avg) (percentage) -7.92% 2.400 2.210 - 18.82% -
458.sjeng -7.73% 181.000 167.000 - 75.79% -
458.sjeng (avg) -7.73% 181.000 167.000 - 75.79% -
458.sjeng (avg) (percentage) -7.69% 1.040 0.960 - 65.52% -
403.gcc (max) -7.23% 166.000 154.000 - 352.94% -
447.dealII (max) -7.14% 210.000 195.000 - 51.16% -
403.gcc (max) (percentage) -6.95% 1.870 1.740 - 357.89% -
447.dealII (max) (percentage) -6.74% 2.670 2.490 - 57.59% -
433.milc (avg) (percentage) -6.73% 1.040 0.970 - -3.96% -
462.libquantum (max) (percentage) -6.72% 8.180 7.630 - 3715.00% -
456.hmmer (max) (percentage) -6.69% 9.560 8.920 - 2873.33% -
433.milc -6.67% 135.000 126.000 - -7.35% -
433.milc (avg) -6.67% 135.000 126.000 - -7.35% -
464.h264ref (max) -6.59% 789.000 737.000 - 1128.33% -
458.sjeng (max) (percentage) -6.57% 4.720 4.410 - 1002.50% -
458.sjeng (max) -6.45% 822.000 769.000 - 1083.08% -
401.bzip2 -6.41% 78.000 73.000 - 114.71% -
401.bzip2 (avg) -6.41% 78.000 73.000 - 114.71% -
473.astar (avg) (percentage) -6.35% 1.260 1.180 - 136.00% -
464.h264ref (max) (percentage) -6.28% 5.570 5.220 - 1238.46% -
462.libquantum (max) -6.28% 956.000 896.000 - 3346.15% -
473.astar -6.21% 161.000 151.000 - 112.68% -
473.astar (avg) -6.21% 161.000 151.000 - 112.68% -
470.lbm (max) (percentage) -6.20% 9.350 8.770 - 58.30% -
433.milc (max) (percentage) -6.20% 2.580 2.420 - 76.64% -
429.mcf (avg) (percentage) -6.18% 1.780 1.670 - 271.11% -
473.astar (max) (percentage) -6.15% 6.670 6.260 - 682.50% -
473.astar (max) -6.07% 856.000 804.000 - 605.26% -
456.hmmer (max) -5.99% 1118.000 1051.000 - 2527.50% -
433.milc (max) -5.95% 336.000 316.000 - 71.74% -
429.mcf -5.86% 256.000 241.000 - 354.72% -
429.mcf (avg) -5.86% 256.000 241.000 - 354.72% -
401.bzip2 (max) (percentage) -5.83% 3.600 3.390 - 993.55% -
401.bzip2 (avg) (percentage) -5.77% 0.520 0.490 - 122.73% -
401.bzip2 (max) -5.74% 540.000 509.000 - 960.42% -
445.gobmk (max) -5.38% 465.000 440.000 - 1417.24% -
453.povray (max) -5.34% 131.000 124.000 - -6.06% -
483.xalancbmk (max) (percentage) -5.25% 15.250 14.450 - 2123.08% -
471.omnetpp (avg) (percentage) -5.23% 1.530 1.450 - 85.90% -
444.namd (max) (percentage) -5.21% 8.250 7.820 - 19.57% -
444.namd (max) -5.17% 1006.000 954.000 - 8.16% -
429.mcf (max) (percentage) -5.16% 17.430 16.530 - 2851.79% -
450.soplex (max) (percentage) -5.13% 1.170 1.110 - 94.74% -
453.povray (max) (percentage) -5.10% 1.960 1.860 - -3.63% -
403.gcc -5.08% 59.000 56.000 - 30.23% -
403.gcc (avg) -5.08% 59.000 56.000 - 30.23% -
429.mcf (max) -4.97% 2513.000 2388.000 - 3464.18% -
471.omnetpp -4.86% 144.000 137.000 - 65.06% -
471.omnetpp (avg) -4.86% 144.000 137.000 - 65.06% -
482.sphinx3 (max) -4.85% 1506.000 1433.000 - 64.15% -
445.gobmk (max) (percentage) -4.82% 3.940 3.750 - 1462.50% -
450.soplex (max) -4.82% 166.000 158.000 - 92.68% -
482.sphinx3 (max) (percentage) -4.72% 6.140 5.850 - 76.20% -
470.lbm (max) -4.63% 1124.000 1072.000 - 39.40% -
403.gcc (avg) (percentage) -4.48% 0.670 0.640 - 33.33% -
464.h264ref -4.42% 113.000 108.000 - 111.76% -
464.h264ref (avg) -4.42% 113.000 108.000 - 111.76% -
456.hmmer (avg) (percentage) -4.32% 1.390 1.330 - 269.44% -
464.h264ref (avg) (percentage) -3.75% 0.800 0.770 - 133.33% -
456.hmmer -3.70% 162.000 156.000 - 225.00% -
456.hmmer (avg) -3.70% 162.000 156.000 - 225.00% -
462.libquantum (avg) (percentage) -3.33% 0.900 0.870 - 480.00% -
470.lbm (avg) (percentage) -3.32% 3.610 3.490 - 50.43% -
483.xalancbmk -3.03% 165.000 160.000 - 240.43% -
483.xalancbmk (avg) -3.03% 165.000 160.000 - 240.43% -
462.libquantum -2.86% 105.000 102.000 - 436.84% -
462.libquantum (avg) -2.86% 105.000 102.000 - 436.84% -
470.lbm -1.84% 434.000 426.000 - 32.30% -
470.lbm (avg) -1.84% 434.000 426.000 - 32.30% -

Run-Over-Baseline Changes Detail

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
429.mcf 20.42% 11999.000 14449.000 - 0.18% -
458.sjeng 6.29% 16406.000 17438.000 - 0.12% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
462.libquantum (max) (percentage) 3715.00% 0.200 7.630 - -6.72% -
429.mcf (max) 3464.18% 67.000 2388.000 - -4.97% -
462.libquantum (max) 3346.15% 26.000 896.000 - -6.28% -
456.hmmer (max) (percentage) 2873.33% 0.300 8.920 - -6.69% -
429.mcf (max) (percentage) 2851.79% 0.560 16.530 - -5.16% -
456.hmmer (max) 2527.50% 40.000 1051.000 - -5.99% -
483.xalancbmk (max) (percentage) 2123.08% 0.650 14.450 - -5.25% -
483.xalancbmk (max) 1709.84% 61.000 1104.000 - -8.08% -
445.gobmk (max) (percentage) 1462.50% 0.240 3.750 - -4.82% -
445.gobmk (max) 1417.24% 29.000 440.000 - -5.38% -
464.h264ref (max) (percentage) 1238.46% 0.390 5.220 - -6.28% -
464.h264ref (max) 1128.33% 60.000 737.000 - -6.59% -
458.sjeng (max) 1083.08% 65.000 769.000 - -6.45% -
458.sjeng (max) (percentage) 1002.50% 0.400 4.410 - -6.57% -
401.bzip2 (max) (percentage) 993.55% 0.310 3.390 - -5.83% -
456.hmmer (unexplained diff vs previous) (percentage) 971.43% 0.070 0.750 - 102.70% -
401.bzip2 (max) 960.42% 48.000 509.000 - -5.74% -
456.hmmer (unexplained diff vs previous) 877.78% 9.000 88.000 - 104.65% -
473.astar (max) (percentage) 682.50% 0.800 6.260 - -6.15% -
473.astar (max) 605.26% 114.000 804.000 - -6.07% -
462.libquantum (avg) (percentage) 480.00% 0.150 0.870 - -3.33% -
462.libquantum 436.84% 19.000 102.000 - -2.86% -
462.libquantum (avg) 436.84% 19.000 102.000 - -2.86% -
403.gcc (max) (percentage) 357.89% 0.380 1.740 - -6.95% -
429.mcf 354.72% 53.000 241.000 - -5.86% -
429.mcf (avg) 354.72% 53.000 241.000 - -5.86% -
403.gcc (max) 352.94% 34.000 154.000 - -7.23% -
462.libquantum (unexplained diff vs previous) (percentage) 350.00% 0.120 0.540 - 440.00% -
483.xalancbmk (avg) (percentage) 320.00% 0.500 2.100 - 0.00% -
462.libquantum (unexplained diff vs previous) 293.75% 16.000 63.000 - 425.00% -
429.mcf (avg) (percentage) 271.11% 0.450 1.670 - -6.18% -
456.hmmer (avg) (percentage) 269.44% 0.360 1.330 - -4.32% -
483.xalancbmk 240.43% 47.000 160.000 - -3.03% -
483.xalancbmk (avg) 240.43% 47.000 160.000 - -3.03% -
456.hmmer 225.00% 48.000 156.000 - -3.70% -
456.hmmer (avg) 225.00% 48.000 156.000 - -3.70% -
445.gobmk (avg) (percentage) 200.00% 0.180 0.540 - 0.00% -
445.gobmk 186.36% 22.000 63.000 - 0.00% -
445.gobmk (avg) 186.36% 22.000 63.000 - 0.00% -
473.astar (avg) (percentage) 136.00% 0.500 1.180 - -6.35% -
464.h264ref (avg) (percentage) 133.33% 0.330 0.770 - -3.75% -
401.bzip2 (avg) (percentage) 122.73% 0.220 0.490 - -5.77% -
445.gobmk (unexplained diff vs previous) (percentage) 120.83% 0.240 0.530 - 381.82% -
401.bzip2 114.71% 34.000 73.000 - -6.41% -
401.bzip2 (avg) 114.71% 34.000 73.000 - -6.41% -
473.astar 112.68% 71.000 151.000 - -6.21% -
473.astar (avg) 112.68% 71.000 151.000 - -6.21% -
464.h264ref 111.76% 51.000 108.000 - -4.42% -
464.h264ref (avg) 111.76% 51.000 108.000 - -4.42% -
445.gobmk (unexplained diff vs previous) 106.67% 30.000 62.000 - 376.92% -
450.soplex (max) (percentage) 94.74% 0.570 1.110 - -5.13% -
450.soplex (max) 92.68% 82.000 158.000 - -4.82% -
471.omnetpp (avg) (percentage) 85.90% 0.780 1.450 - -5.23% -
433.milc (max) (percentage) 76.64% 1.370 2.420 - -6.20% -
482.sphinx3 (max) (percentage) 76.20% 3.320 5.850 - -4.72% -
458.sjeng 75.79% 95.000 167.000 - -7.73% -
458.sjeng (avg) 75.79% 95.000 167.000 - -7.73% -
433.milc (max) 71.74% 184.000 316.000 - -5.95% -
458.sjeng (avg) (percentage) 65.52% 0.580 0.960 - -7.69% -
471.omnetpp 65.06% 83.000 137.000 - -4.86% -
471.omnetpp (avg) 65.06% 83.000 137.000 - -4.86% -
482.sphinx3 (max) 64.15% 873.000 1433.000 - -4.85% -
470.lbm (max) (percentage) 58.30% 5.540 8.770 - -6.20% -
447.dealII (max) (percentage) 57.59% 1.580 2.490 - -6.74% -
447.dealII (max) 51.16% 129.000 195.000 - -7.14% -
470.lbm (avg) (percentage) 50.43% 2.320 3.490 - -3.32% -
470.lbm (max) 39.40% 769.000 1072.000 - -4.63% -
403.gcc (avg) (percentage) 33.33% 0.480 0.640 - -4.48% -
470.lbm 32.30% 322.000 426.000 - -1.84% -
470.lbm (avg) 32.30% 322.000 426.000 - -1.84% -
403.gcc 30.23% 43.000 56.000 - -5.08% -
403.gcc (avg) 30.23% 43.000 56.000 - -5.08% -
444.namd (max) (percentage) 19.57% 6.540 7.820 - -5.21% -
482.sphinx3 (avg) (percentage) 18.82% 1.860 2.210 - -7.92% -
482.sphinx3 10.63% 489.000 541.000 - -8.15% -
482.sphinx3 (avg) 10.63% 489.000 541.000 - -8.15% -
450.soplex (avg) (percentage) 8.33% 0.360 0.390 - 0.00% -
444.namd (max) 8.16% 882.000 954.000 - -5.17% -
450.soplex 7.84% 51.000 55.000 - 0.00% -
450.soplex (avg) 7.84% 51.000 55.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
483.xalancbmk -18.89% 9427.000 7646.000 - -2.98% -
470.lbm -11.94% 13882.000 12224.000 - 1.67% -
456.hmmer -11.78% 13365.000 11791.000 - 0.75% -
471.omnetpp -11.72% 10746.000 9487.000 - 0.30% -
462.libquantum -10.44% 13126.000 11755.000 - 0.54% -
473.astar -9.86% 14262.000 12856.000 - 0.13% -
444.namd -9.60% 13495.000 12200.000 - 0.02% -
464.h264ref -8.80% 15493.000 14130.000 - -0.36% -
482.sphinx3 -6.84% 26310.000 24510.000 - -0.13% -
445.gobmk -5.30% 12400.000 11743.000 - -0.53% -
401.bzip2 -4.25% 15683.000 15017.000 - 0.08% -
447.dealII -4.15% 8196.000 7856.000 - -0.43% -
433.milc -3.14% 13482.000 13058.000 - 0.04% -
403.gcc -2.52% 9099.000 8870.000 - -0.30% -
453.povray -2.33% 6857.000 6697.000 - -0.33% -
450.soplex -1.32% 14429.000 14238.000 - 0.30% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
444.namd (unexplained diff vs previous) -99.76% 828.000 2.000 - 100.00% -
444.namd (unexplained diff vs previous) (percentage) -99.67% 6.140 0.020 - 100.00% -
433.milc (unexplained diff vs previous) -97.25% 182.000 5.000 - -76.19% -
433.milc (unexplained diff vs previous) (percentage) -97.04% 1.350 0.040 - -75.00% -
482.sphinx3 (unexplained diff vs previous) -96.35% 904.000 33.000 - -96.09% -
482.sphinx3 (unexplained diff vs previous) (percentage) -96.22% 3.440 0.130 - -96.21% -
473.astar (unexplained diff vs previous) -84.26% 108.000 17.000 - -85.59% -
473.astar (unexplained diff vs previous) (percentage) -82.89% 0.760 0.130 - -85.87% -
401.bzip2 (unexplained diff vs previous) -75.51% 49.000 12.000 - 100.00% -
401.bzip2 (unexplained diff vs previous) (percentage) -74.19% 0.310 0.080 - 100.00% -
471.omnetpp (unexplained diff vs previous) -69.57% 92.000 28.000 - -76.07% -
429.mcf (unexplained diff vs previous) (percentage) -67.86% 0.560 0.180 - 5.88% -
471.omnetpp (unexplained diff vs previous) (percentage) -65.12% 0.860 0.300 - -75.81% -
429.mcf (unexplained diff vs previous) -61.19% 67.000 26.000 - 8.33% -
470.lbm (unexplained diff vs previous) -59.56% 497.000 201.000 - -73.96% -
470.lbm (unexplained diff vs previous) (percentage) -54.19% 3.580 1.640 - -74.45% -
471.omnetpp (max) -53.97% 189.000 87.000 - -89.73% -
458.sjeng (unexplained diff vs previous) (percentage) -52.00% 0.250 0.120 - -47.83% -
458.sjeng (unexplained diff vs previous) -48.78% 41.000 21.000 - -47.50% -
471.omnetpp (max) (percentage) -47.73% 1.760 0.920 - -89.73% -
450.soplex (unexplained diff vs previous) -47.56% 82.000 43.000 - 4200.00% -
450.soplex (unexplained diff vs previous) (percentage) -47.37% 0.570 0.300 - 2900.00% -
444.namd -20.62% 514.000 408.000 - -8.11% -
444.namd (avg) -20.62% 514.000 408.000 - -8.11% -
403.gcc (unexplained diff vs previous) -20.59% 34.000 27.000 - -55.00% -
403.gcc (unexplained diff vs previous) (percentage) -18.92% 0.370 0.300 - -55.22% -
464.h264ref (unexplained diff vs previous) -15.00% 60.000 51.000 - 131.82% -
444.namd (avg) (percentage) -12.07% 3.810 3.350 - -7.97% -
447.dealII -8.33% 120.000 110.000 - -0.90% -
447.dealII (avg) -8.33% 120.000 110.000 - -0.90% -
464.h264ref (unexplained diff vs previous) (percentage) -7.69% 0.390 0.360 - 125.00% -
433.milc -7.35% 136.000 126.000 - -6.67% -
433.milc (avg) -7.35% 136.000 126.000 - -6.67% -
453.povray (max) -6.06% 132.000 124.000 - -5.34% -
447.dealII (avg) (percentage) -4.08% 1.470 1.410 - 0.00% -
433.milc (avg) (percentage) -3.96% 1.010 0.970 - -6.73% -
453.povray (max) (percentage) -3.63% 1.930 1.860 - -5.10% -
453.povray -3.23% 93.000 90.000 - 0.00% -
453.povray (avg) -3.23% 93.000 90.000 - 0.00% -
453.povray (avg) (percentage) -1.46% 1.370 1.350 - 0.00% -

Report Time: 0.36s
Execution (seconds)
Name Current %
401.bzip2 15017.000 -
403.gcc 8870.000 -
429.mcf 14449.000 -
433.milc 13058.000 -
444.namd 12200.000 -
445.gobmk 11743.000 -
447.dealII 7856.000 -
450.soplex 14238.000 -
453.povray 6697.000 -
456.hmmer 11791.000 -
458.sjeng 17438.000 -
462.libquantum 11755.000 -
464.h264ref 14130.000 -
470.lbm 12224.000 1.67%
471.omnetpp 9487.000 -
473.astar 12856.000 -
482.sphinx3 24510.000 -
483.xalancbmk 7646.000 -2.98%
Geometric Mean 11977.404 -
Code Size (bytes)
Name Current %
401.bzip2 39458.000 -
403.gcc 1960234.000 -
429.mcf 7915.000 -
433.milc 74971.000 -
444.namd 175160.000 -
445.gobmk 1312260.000 -
447.dealII 1777976.000 -
450.soplex 198708.000 -
453.povray 593169.000 -
456.hmmer 168072.000 -
458.sjeng 97694.000 -
462.libquantum 26756.000 -
464.h264ref 354546.000 -
470.lbm 9723.000 -
471.omnetpp 373571.000 -
473.astar 23216.000 -
482.sphinx3 115720.000 -
483.xalancbmk 2287125.000 -
Geometric Mean 164388.335 -
sample variability
Name Current %
401.bzip2 73.000 -6.41%
401.bzip2 (avg) 73.000 -6.41%
401.bzip2 (avg) (percentage) 0.490 -5.77%
401.bzip2 (max) 509.000 -5.74%
401.bzip2 (max) (percentage) 3.390 -5.83%
401.bzip2 (unexplained diff vs previous) 12.000 100.00%
401.bzip2 (unexplained diff vs previous) (percentage) 0.080 100.00%
403.gcc 56.000 -5.08%
403.gcc (avg) 56.000 -5.08%
403.gcc (avg) (percentage) 0.640 -4.48%
403.gcc (max) 154.000 -7.23%
403.gcc (max) (percentage) 1.740 -6.95%
403.gcc (unexplained diff vs previous) 27.000 -55.00%
403.gcc (unexplained diff vs previous) (percentage) 0.300 -55.22%
429.mcf 241.000 -5.86%
429.mcf (avg) 241.000 -5.86%
429.mcf (avg) (percentage) 1.670 -6.18%
429.mcf (max) 2388.000 -4.97%
429.mcf (max) (percentage) 16.530 -5.16%
429.mcf (unexplained diff vs previous) 26.000 8.33%
429.mcf (unexplained diff vs previous) (percentage) 0.180 -
433.milc 126.000 -6.67%
433.milc (avg) 126.000 -6.67%
433.milc (avg) (percentage) 0.970 -6.73%
433.milc (max) 316.000 -5.95%
433.milc (max) (percentage) 2.420 -6.20%
433.milc (unexplained diff vs previous) 5.000 -76.19%
433.milc (unexplained diff vs previous) (percentage) 0.040 -75.00%
444.namd 408.000 -8.11%
444.namd (avg) 408.000 -8.11%
444.namd (avg) (percentage) 3.350 -7.97%
444.namd (max) 954.000 -5.17%
444.namd (max) (percentage) 7.820 -5.21%
444.namd (unexplained diff vs previous) 2.000 100.00%
444.namd (unexplained diff vs previous) (percentage) 0.020 100.00%
445.gobmk 63.000 -
445.gobmk (avg) 63.000 -
445.gobmk (avg) (percentage) 0.540 -
445.gobmk (max) 440.000 -5.38%
445.gobmk (max) (percentage) 3.750 -4.82%
445.gobmk (unexplained diff vs previous) 62.000 376.92%
445.gobmk (unexplained diff vs previous) (percentage) 0.530 381.82%
447.dealII 110.000 -
447.dealII (avg) 110.000 -
447.dealII (avg) (percentage) 1.410 -
447.dealII (max) 195.000 -7.14%
447.dealII (max) (percentage) 2.490 -6.74%
450.soplex 55.000 -
450.soplex (avg) 55.000 -
450.soplex (avg) (percentage) 0.390 -
450.soplex (max) 158.000 -4.82%
450.soplex (max) (percentage) 1.110 -5.13%
450.soplex (unexplained diff vs previous) 43.000 4200.00%
450.soplex (unexplained diff vs previous) (percentage) 0.300 2900.00%
453.povray 90.000 -
453.povray (avg) 90.000 -
453.povray (avg) (percentage) 1.350 -
453.povray (max) 124.000 -5.34%
453.povray (max) (percentage) 1.860 -5.10%
456.hmmer 156.000 -3.70%
456.hmmer (avg) 156.000 -3.70%
456.hmmer (avg) (percentage) 1.330 -4.32%
456.hmmer (max) 1051.000 -5.99%
456.hmmer (max) (percentage) 8.920 -6.69%
456.hmmer (unexplained diff vs previous) 88.000 104.65%
456.hmmer (unexplained diff vs previous) (percentage) 0.750 102.70%
458.sjeng 167.000 -7.73%
458.sjeng (avg) 167.000 -7.73%
458.sjeng (avg) (percentage) 0.960 -7.69%
458.sjeng (max) 769.000 -6.45%
458.sjeng (max) (percentage) 4.410 -6.57%
458.sjeng (unexplained diff vs previous) 21.000 -47.50%
458.sjeng (unexplained diff vs previous) (percentage) 0.120 -47.83%
462.libquantum 102.000 -2.86%
462.libquantum (avg) 102.000 -2.86%
462.libquantum (avg) (percentage) 0.870 -3.33%
462.libquantum (max) 896.000 -6.28%
462.libquantum (max) (percentage) 7.630 -6.72%
462.libquantum (unexplained diff vs previous) 63.000 425.00%
462.libquantum (unexplained diff vs previous) (percentage) 0.540 440.00%
464.h264ref 108.000 -4.42%
464.h264ref (avg) 108.000 -4.42%
464.h264ref (avg) (percentage) 0.770 -3.75%
464.h264ref (max) 737.000 -6.59%
464.h264ref (max) (percentage) 5.220 -6.28%
464.h264ref (unexplained diff vs previous) 51.000 131.82%
464.h264ref (unexplained diff vs previous) (percentage) 0.360 125.00%
470.lbm 426.000 -1.84%
470.lbm (avg) 426.000 -1.84%
470.lbm (avg) (percentage) 3.490 -3.32%
470.lbm (max) 1072.000 -4.63%
470.lbm (max) (percentage) 8.770 -6.20%
470.lbm (unexplained diff vs previous) 201.000 -73.96%
470.lbm (unexplained diff vs previous) (percentage) 1.640 -74.45%
471.omnetpp 137.000 -4.86%
471.omnetpp (avg) 137.000 -4.86%
471.omnetpp (avg) (percentage) 1.450 -5.23%
471.omnetpp (max) 87.000 -89.73%
471.omnetpp (max) (percentage) 0.920 -89.73%
471.omnetpp (unexplained diff vs previous) 28.000 -76.07%
471.omnetpp (unexplained diff vs previous) (percentage) 0.300 -75.81%
473.astar 151.000 -6.21%
473.astar (avg) 151.000 -6.21%
473.astar (avg) (percentage) 1.180 -6.35%
473.astar (max) 804.000 -6.07%
473.astar (max) (percentage) 6.260 -6.15%
473.astar (unexplained diff vs previous) 17.000 -85.59%
473.astar (unexplained diff vs previous) (percentage) 0.130 -85.87%
482.sphinx3 541.000 -8.15%
482.sphinx3 (avg) 541.000 -8.15%
482.sphinx3 (avg) (percentage) 2.210 -7.92%
482.sphinx3 (max) 1433.000 -4.85%
482.sphinx3 (max) (percentage) 5.850 -4.72%
482.sphinx3 (unexplained diff vs previous) 33.000 -96.09%
482.sphinx3 (unexplained diff vs previous) (percentage) 0.130 -96.21%
483.xalancbmk 160.000 -3.03%
483.xalancbmk (avg) 160.000 -3.03%
483.xalancbmk (avg) (percentage) 2.100 -
483.xalancbmk (max) 1104.000 -8.08%
483.xalancbmk (max) (percentage) 14.450 -5.25%
Geometric Mean 17.803 -8.77%