Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/0148df8157f05ecf3b1064508e6f012aefb87dad (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk_ci_llvm-build-tcwg_bmk_apm-llvm-master-arm-spec2k6-Os/187/
View Options
Report
Filter

llvm-arm-master-Os test results

Run Order Start Time Duration
Current 0187 (no-change) 2022-10-10T08:44:44 0:00:00
Previous 0186 (llvmorg-20-init-00122-g80d1c6acc013) 2024-07-20T17:09:21 0:00:00
Baseline 0001 (llvmorg-16-init-16061-ge7790fbed32b) 2022-12-29T19:41:07 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 111 69
Performance Improvements 26 62
Added Tests 17 0
Unchanged Tests 626 649
Total Tests 780

Run-Over-Run Changes Detail

Performance Regressions - Code Size Δ Previous Current σ Δ (B) σ (B)
462.libquantum 11.52% 23959.000 26720.000 - -0.13% -
433.milc 2.84% 72890.000 74963.000 - -0.01% -
447.dealII 2.62% 1740523.000 1786157.000 - 0.46% -
453.povray 2.44% 579307.000 593457.000 - 0.06% -
444.namd 1.65% 172793.000 175648.000 - 0.28% -
464.h264ref 1.43% 350208.000 355202.000 - 0.16% -
458.sjeng 1.13% 96985.000 98078.000 - 0.29% -

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
403.gcc 15992.98% 57.000 9173.000 - 0.81% -
462.libquantum 13288.78% 98.000 13121.000 - -0.04% -
482.sphinx3 2920.46% 870.000 26278.000 - -0.12% -
450.soplex 2653.92% 523.000 14403.000 - -0.18% -
444.namd 1759.86% 725.000 13484.000 - -0.08% -
453.povray 1393.48% 460.000 6870.000 - 0.19% -
433.milc 1092.63% 1139.000 13584.000 - 0.76% -
429.mcf 920.00% 1160.000 11832.000 - -1.39% -
401.bzip2 473.76% 2698.000 15480.000 - -1.29% -
447.dealII 356.11% 1800.000 8210.000 - 0.17% -
470.lbm 331.94% 3175.000 13714.000 - -1.21% -
471.omnetpp 280.59% 2828.000 10763.000 - 0.16% -
456.hmmer 280.35% 3558.000 13533.000 - 1.26% -
473.astar 192.38% 4871.000 14242.000 - -0.14% -
464.h264ref 177.71% 5581.000 15499.000 - 0.04% -
445.gobmk 139.35% 5187.000 12415.000 - 0.12% -
458.sjeng 98.70% 8248.000 16389.000 - -0.10% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
444.namd (max) 16620.00% 5.000 836.000 - -5.22% -
444.namd 8650.00% 6.000 525.000 - 2.14% -
444.namd (avg) 8650.00% 6.000 525.000 - 2.14% -
482.sphinx3 7100.00% 7.000 504.000 - 3.07% -
482.sphinx3 (avg) 7100.00% 7.000 504.000 - 3.07% -
482.sphinx3 (max) 6522.22% 9.000 596.000 - -31.73% -
403.gcc 5600.00% 2.000 114.000 - 165.12% -
403.gcc (avg) 5600.00% 2.000 114.000 - 165.12% -
462.libquantum 3100.00% 1.000 32.000 - 68.42% -
462.libquantum (avg) 3100.00% 1.000 32.000 - 68.42% -
470.lbm (max) 3050.00% 10.000 315.000 - -59.04% -
453.povray (max) 3025.00% 4.000 125.000 - -5.30% -
433.milc 2633.33% 6.000 164.000 - 20.59% -
433.milc (avg) 2633.33% 6.000 164.000 - 20.59% -
403.gcc (max) 2100.00% 2.000 44.000 - 29.41% -
470.lbm (unexplained diff vs previous) 1916.67% 6.000 121.000 - -75.65% -
450.soplex 1820.00% 5.000 96.000 - 88.24% -
450.soplex (avg) 1820.00% 5.000 96.000 - 88.24% -
453.povray 1500.00% 4.000 64.000 - -31.18% -
453.povray (avg) 1500.00% 4.000 64.000 - -31.18% -
433.milc (max) 1437.50% 8.000 123.000 - -33.15% -
470.lbm 1339.13% 23.000 331.000 - 2.80% -
470.lbm (avg) 1339.13% 23.000 331.000 - 2.80% -
458.sjeng 1196.55% 29.000 376.000 - 295.79% -
458.sjeng (avg) 1196.55% 29.000 376.000 - 295.79% -
433.milc (unexplained diff vs previous) 1188.89% 9.000 116.000 - -36.26% -
456.hmmer (unexplained diff vs previous) 1122.22% 9.000 110.000 - 1122.22% -
447.dealII 1060.00% 10.000 116.000 - -3.33% -
447.dealII (avg) 1060.00% 10.000 116.000 - -3.33% -
450.soplex (max) 933.33% 3.000 31.000 - -62.20% -
447.dealII (max) 873.33% 15.000 146.000 - 13.18% -
444.namd (max) (percentage) 715.79% 0.760 6.200 - -5.20% -
456.hmmer (max) 626.67% 15.000 109.000 - 172.50% -
473.astar (max) 577.78% 18.000 122.000 - 7.02% -
470.lbm (max) (percentage) 576.47% 0.340 2.300 - -58.48% -
473.astar (unexplained diff vs previous) 550.00% 2.000 13.000 - -87.96% -
458.sjeng (avg) (percentage) 538.89% 0.360 2.300 - 296.55% -
429.mcf 450.00% 16.000 88.000 - 66.04% -
429.mcf (avg) 450.00% 16.000 88.000 - 66.04% -
401.bzip2 (unexplained diff vs previous) 436.36% 11.000 59.000 - 20.41% -
462.libquantum (max) 400.00% 3.000 15.000 - -42.31% -
470.lbm (unexplained diff vs previous) (percentage) 363.16% 0.190 0.880 - -75.42% -
429.mcf (max) 341.67% 12.000 53.000 - -20.90% -
445.gobmk (max) 341.18% 17.000 75.000 - 158.62% -
444.namd (avg) (percentage) 319.35% 0.930 3.900 - 2.36% -
471.omnetpp (max) 309.76% 41.000 168.000 - -11.11% -
401.bzip2 (max) 286.67% 15.000 58.000 - 20.83% -
401.bzip2 258.33% 12.000 43.000 - 26.47% -
401.bzip2 (avg) 258.33% 12.000 43.000 - 26.47% -
456.hmmer 241.18% 17.000 58.000 - 20.83% -
456.hmmer (avg) 241.18% 17.000 58.000 - 20.83% -
470.lbm (avg) (percentage) 231.51% 0.730 2.420 - 4.31% -
456.hmmer (unexplained diff vs previous) (percentage) 224.00% 0.250 0.810 - 1057.14% -
445.gobmk 162.50% 16.000 42.000 - 90.91% -
445.gobmk (avg) 162.50% 16.000 42.000 - 90.91% -
471.omnetpp 155.26% 38.000 97.000 - 16.87% -
471.omnetpp (avg) 155.26% 38.000 97.000 - 16.87% -
450.soplex (unexplained diff vs previous) 150.00% 2.000 5.000 - -93.90% -
458.sjeng (max) 150.00% 18.000 45.000 - -30.77% -
464.h264ref 145.00% 20.000 49.000 - -3.92% -
464.h264ref (avg) 145.00% 20.000 49.000 - -3.92% -
447.dealII (avg) (percentage) 140.68% 0.590 1.420 - -3.40% -
473.astar 140.54% 37.000 89.000 - 25.35% -
473.astar (avg) 140.54% 37.000 89.000 - 25.35% -
464.h264ref (max) 136.36% 22.000 52.000 - -13.33% -
482.sphinx3 (unexplained diff vs previous) 130.00% 10.000 23.000 - -97.46% -
473.astar (max) (percentage) 126.32% 0.380 0.860 - 7.50% -
473.astar (unexplained diff vs previous) (percentage) 125.00% 0.040 0.090 - -88.16% -
482.sphinx3 (avg) (percentage) 118.18% 0.880 1.920 - 3.23% -
433.milc (avg) (percentage) 116.07% 0.560 1.210 - 19.80% -
447.dealII (max) (percentage) 110.59% 0.850 1.790 - 13.29% -
471.omnetpp (unexplained diff vs previous) 102.44% 41.000 83.000 - -9.78% -
482.sphinx3 (max) (percentage) 99.12% 1.140 2.270 - -31.63% -
456.hmmer (max) (percentage) 84.09% 0.440 0.810 - 170.00% -
429.mcf (unexplained diff vs previous) 80.00% 5.000 9.000 - -86.57% -
445.gobmk (max) (percentage) 79.41% 0.340 0.610 - 154.17% -
453.povray (max) (percentage) 71.03% 1.070 1.830 - -5.18% -
483.xalancbmk (max) (percentage) 38.24% 0.680 0.940 - 44.62% -
403.gcc (unexplained diff vs previous) 33.33% 3.000 4.000 - -88.24% -
458.sjeng (max) (percentage) 27.27% 0.220 0.280 - -30.00% -
433.milc (max) (percentage) 16.67% 0.780 0.910 - -33.58% -
433.milc (unexplained diff vs previous) (percentage) 7.59% 0.790 0.850 - -37.04% -
471.omnetpp (max) (percentage) 6.80% 1.470 1.570 - -10.80% -
445.gobmk (avg) (percentage) 6.25% 0.320 0.340 - 88.89% -

Performance Regressions - Score Δ Previous Current σ Δ (B) σ (B)
nb_total_tests -52.50% 40.000 19.000 - 0.00% -
nb_compile_successful -47.22% 36.000 19.000 - 0.00% -
nb_execution_successful -47.06% 34.000 18.000 - 0.00% -

Performance Improvements - Code Size Δ Previous Current σ Δ (B) σ (B)
401.bzip2 -4.95% 41641.000 39578.000 - 0.30% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
403.gcc (unexplained diff vs previous) (percentage) -99.24% 5.260 0.040 - -89.19% -
462.libquantum (max) (percentage) -96.25% 3.200 0.120 - -40.00% -
482.sphinx3 (unexplained diff vs previous) (percentage) -92.17% 1.150 0.090 - -97.38% -
450.soplex (unexplained diff vs previous) (percentage) -92.11% 0.380 0.030 - -94.74% -
403.gcc (max) (percentage) -90.20% 5.000 0.490 - 28.95% -
464.h264ref (unexplained diff vs previous) (percentage) -85.37% 0.410 0.060 - -84.62% -
462.libquantum (avg) (percentage) -84.57% 1.620 0.250 - 66.67% -
429.mcf (unexplained diff vs previous) (percentage) -81.40% 0.430 0.080 - -85.71% -
403.gcc (avg) (percentage) -66.67% 3.750 1.250 - 160.42% -
450.soplex (max) (percentage) -62.07% 0.580 0.220 - -61.40% -
429.mcf (max) (percentage) -59.09% 1.100 0.450 - -19.64% -
464.h264ref (unexplained diff vs previous) -56.52% 23.000 10.000 - -83.33% -
471.omnetpp (unexplained diff vs previous) (percentage) -46.90% 1.450 0.770 - -10.47% -
429.mcf (avg) (percentage) -46.43% 1.400 0.750 - 66.67% -
401.bzip2 (avg) (percentage) -41.67% 0.480 0.280 - 27.27% -
450.soplex (avg) (percentage) -40.71% 1.130 0.670 - 86.11% -
483.xalancbmk (avg) (percentage) -36.84% 1.330 0.840 - 68.00% -
401.bzip2 (max) (percentage) -34.48% 0.580 0.380 - 22.58% -
471.omnetpp (avg) (percentage) -33.58% 1.370 0.910 - 16.67% -
473.astar (avg) (percentage) -17.11% 0.760 0.630 - 26.00% -
464.h264ref (max) (percentage) -17.07% 0.410 0.340 - -12.82% -
456.hmmer (avg) (percentage) -14.00% 0.500 0.430 - 19.44% -
464.h264ref (avg) (percentage) -13.51% 0.370 0.320 - -3.03% -
453.povray (avg) (percentage) -8.74% 1.030 0.940 - -31.39% -
401.bzip2 (unexplained diff vs previous) (percentage) -7.32% 0.410 0.380 - 22.58% -

Added Tests - Code Size
483.xalancbmk

Added Tests - Execution
483.xalancbmk

Added Tests - sample variability
444.namd (unexplained diff vs previous)
444.namd (unexplained diff vs previous) (percentage)
445.gobmk (unexplained diff vs previous)
445.gobmk (unexplained diff vs previous) (percentage)
447.dealII (unexplained diff vs previous)
447.dealII (unexplained diff vs previous) (percentage)
453.povray (unexplained diff vs previous)
453.povray (unexplained diff vs previous) (percentage)
458.sjeng (unexplained diff vs previous)
458.sjeng (unexplained diff vs previous) (percentage)
483.xalancbmk
483.xalancbmk (avg)
483.xalancbmk (max)
483.xalancbmk (unexplained diff vs previous)
483.xalancbmk (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
450.soplex 2.19% 198708.000 203060.000 - 0.26% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
456.hmmer 1.26% 13365.000 13533.000 - 280.35% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
456.hmmer (unexplained diff vs previous) 1122.22% 9.000 110.000 - 1122.22% -
456.hmmer (unexplained diff vs previous) (percentage) 1057.14% 0.070 0.810 - 224.00% -
458.sjeng (avg) (percentage) 296.55% 0.580 2.300 - 538.89% -
458.sjeng 295.79% 95.000 376.000 - 1196.55% -
458.sjeng (avg) 295.79% 95.000 376.000 - 1196.55% -
456.hmmer (max) 172.50% 40.000 109.000 - 626.67% -
456.hmmer (max) (percentage) 170.00% 0.300 0.810 - 84.09% -
403.gcc 165.12% 43.000 114.000 - 5600.00% -
403.gcc (avg) 165.12% 43.000 114.000 - 5600.00% -
403.gcc (avg) (percentage) 160.42% 0.480 1.250 - -66.67% -
445.gobmk (max) 158.62% 29.000 75.000 - 341.18% -
445.gobmk (max) (percentage) 154.17% 0.240 0.610 - 79.41% -
445.gobmk 90.91% 22.000 42.000 - 162.50% -
445.gobmk (avg) 90.91% 22.000 42.000 - 162.50% -
445.gobmk (avg) (percentage) 88.89% 0.180 0.340 - 6.25% -
450.soplex 88.24% 51.000 96.000 - 1820.00% -
450.soplex (avg) 88.24% 51.000 96.000 - 1820.00% -
450.soplex (avg) (percentage) 86.11% 0.360 0.670 - -40.71% -
445.gobmk (unexplained diff vs previous) (percentage) 70.83% 0.240 0.410 - 0.00% -
445.gobmk (unexplained diff vs previous) 70.00% 30.000 51.000 - 0.00% -
462.libquantum 68.42% 19.000 32.000 - 3100.00% -
462.libquantum (avg) 68.42% 19.000 32.000 - 3100.00% -
483.xalancbmk 68.09% 47.000 79.000 - 0.00% -
483.xalancbmk (avg) 68.09% 47.000 79.000 - 0.00% -
483.xalancbmk (avg) (percentage) 68.00% 0.500 0.840 - -36.84% -
462.libquantum (avg) (percentage) 66.67% 0.150 0.250 - -84.57% -
429.mcf (avg) (percentage) 66.67% 0.450 0.750 - -46.43% -
429.mcf 66.04% 53.000 88.000 - 450.00% -
429.mcf (avg) 66.04% 53.000 88.000 - 450.00% -
483.xalancbmk (max) (percentage) 44.62% 0.650 0.940 - 38.24% -
483.xalancbmk (max) 44.26% 61.000 88.000 - 0.00% -
483.xalancbmk (unexplained diff vs previous) 32.79% 61.000 81.000 - 0.00% -
483.xalancbmk (unexplained diff vs previous) (percentage) 32.31% 0.650 0.860 - 0.00% -
403.gcc (max) 29.41% 34.000 44.000 - 2100.00% -
403.gcc (max) (percentage) 28.95% 0.380 0.490 - -90.20% -
401.bzip2 (avg) (percentage) 27.27% 0.220 0.280 - -41.67% -
401.bzip2 26.47% 34.000 43.000 - 258.33% -
401.bzip2 (avg) 26.47% 34.000 43.000 - 258.33% -
473.astar (avg) (percentage) 26.00% 0.500 0.630 - -17.11% -
473.astar 25.35% 71.000 89.000 - 140.54% -
473.astar (avg) 25.35% 71.000 89.000 - 140.54% -
401.bzip2 (max) (percentage) 22.58% 0.310 0.380 - -34.48% -
401.bzip2 (unexplained diff vs previous) (percentage) 22.58% 0.310 0.380 - -7.32% -
401.bzip2 (max) 20.83% 48.000 58.000 - 286.67% -
456.hmmer 20.83% 48.000 58.000 - 241.18% -
456.hmmer (avg) 20.83% 48.000 58.000 - 241.18% -
433.milc 20.59% 136.000 164.000 - 2633.33% -
433.milc (avg) 20.59% 136.000 164.000 - 2633.33% -
401.bzip2 (unexplained diff vs previous) 20.41% 49.000 59.000 - 436.36% -
433.milc (avg) (percentage) 19.80% 1.010 1.210 - 116.07% -
456.hmmer (avg) (percentage) 19.44% 0.360 0.430 - -14.00% -
471.omnetpp 16.87% 83.000 97.000 - 155.26% -
471.omnetpp (avg) 16.87% 83.000 97.000 - 155.26% -
471.omnetpp (avg) (percentage) 16.67% 0.780 0.910 - -33.58% -
447.dealII (max) (percentage) 13.29% 1.580 1.790 - 110.59% -
447.dealII (max) 13.18% 129.000 146.000 - 873.33% -
473.astar (max) (percentage) 7.50% 0.800 0.860 - 126.32% -
473.astar (max) 7.02% 114.000 122.000 - 577.78% -
470.lbm (avg) (percentage) 4.31% 2.320 2.420 - 231.51% -
482.sphinx3 (avg) (percentage) 3.23% 1.860 1.920 - 118.18% -
482.sphinx3 3.07% 489.000 504.000 - 7100.00% -
482.sphinx3 (avg) 3.07% 489.000 504.000 - 7100.00% -
470.lbm 2.80% 322.000 331.000 - 1339.13% -
470.lbm (avg) 2.80% 322.000 331.000 - 1339.13% -
444.namd (avg) (percentage) 2.36% 3.810 3.900 - 319.35% -
444.namd 2.14% 514.000 525.000 - 8650.00% -
444.namd (avg) 2.14% 514.000 525.000 - 8650.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
429.mcf -1.39% 11999.000 11832.000 - 920.00% -
401.bzip2 -1.29% 15683.000 15480.000 - 473.76% -
470.lbm -1.21% 13882.000 13714.000 - 331.94% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
444.namd (unexplained diff vs previous) -99.88% 828.000 1.000 - 0.00% -
444.namd (unexplained diff vs previous) (percentage) -99.84% 6.140 0.010 - 0.00% -
453.povray (unexplained diff vs previous) (percentage) -97.89% 1.900 0.040 - 0.00% -
453.povray (unexplained diff vs previous) -97.69% 130.000 3.000 - 0.00% -
482.sphinx3 (unexplained diff vs previous) -97.46% 904.000 23.000 - 130.00% -
482.sphinx3 (unexplained diff vs previous) (percentage) -97.38% 3.440 0.090 - -92.17% -
450.soplex (unexplained diff vs previous) (percentage) -94.74% 0.570 0.030 - -92.11% -
450.soplex (unexplained diff vs previous) -93.90% 82.000 5.000 - 150.00% -
403.gcc (unexplained diff vs previous) (percentage) -89.19% 0.370 0.040 - -99.24% -
403.gcc (unexplained diff vs previous) -88.24% 34.000 4.000 - 33.33% -
473.astar (unexplained diff vs previous) (percentage) -88.16% 0.760 0.090 - 125.00% -
473.astar (unexplained diff vs previous) -87.96% 108.000 13.000 - 550.00% -
429.mcf (unexplained diff vs previous) -86.57% 67.000 9.000 - 80.00% -
429.mcf (unexplained diff vs previous) (percentage) -85.71% 0.560 0.080 - -81.40% -
464.h264ref (unexplained diff vs previous) (percentage) -84.62% 0.390 0.060 - -85.37% -
464.h264ref (unexplained diff vs previous) -83.33% 60.000 10.000 - -56.52% -
470.lbm (unexplained diff vs previous) -75.65% 497.000 121.000 - 1916.67% -
470.lbm (unexplained diff vs previous) (percentage) -75.42% 3.580 0.880 - 363.16% -
458.sjeng (unexplained diff vs previous) (percentage) -64.00% 0.250 0.090 - 0.00% -
458.sjeng (unexplained diff vs previous) -63.41% 41.000 15.000 - 0.00% -
462.libquantum (unexplained diff vs previous) -62.50% 16.000 6.000 - 0.00% -
450.soplex (max) -62.20% 82.000 31.000 - 933.33% -
450.soplex (max) (percentage) -61.40% 0.570 0.220 - -62.07% -
470.lbm (max) -59.04% 769.000 315.000 - 3050.00% -
470.lbm (max) (percentage) -58.48% 5.540 2.300 - 576.47% -
462.libquantum (unexplained diff vs previous) (percentage) -58.33% 0.120 0.050 - 0.00% -
447.dealII (unexplained diff vs previous) (percentage) -51.35% 1.480 0.720 - 0.00% -
447.dealII (unexplained diff vs previous) -51.24% 121.000 59.000 - 0.00% -
462.libquantum (max) -42.31% 26.000 15.000 - 400.00% -
462.libquantum (max) (percentage) -40.00% 0.200 0.120 - -96.25% -
433.milc (unexplained diff vs previous) (percentage) -37.04% 1.350 0.850 - 7.59% -
433.milc (unexplained diff vs previous) -36.26% 182.000 116.000 - 1188.89% -
433.milc (max) (percentage) -33.58% 1.370 0.910 - 16.67% -
433.milc (max) -33.15% 184.000 123.000 - 1437.50% -
482.sphinx3 (max) -31.73% 873.000 596.000 - 6522.22% -
482.sphinx3 (max) (percentage) -31.63% 3.320 2.270 - 99.12% -
453.povray (avg) (percentage) -31.39% 1.370 0.940 - -8.74% -
453.povray -31.18% 93.000 64.000 - 1500.00% -
453.povray (avg) -31.18% 93.000 64.000 - 1500.00% -
458.sjeng (max) -30.77% 65.000 45.000 - 150.00% -
458.sjeng (max) (percentage) -30.00% 0.400 0.280 - 27.27% -
429.mcf (max) -20.90% 67.000 53.000 - 341.67% -
429.mcf (max) (percentage) -19.64% 0.560 0.450 - -59.09% -
464.h264ref (max) -13.33% 60.000 52.000 - 136.36% -
464.h264ref (max) (percentage) -12.82% 0.390 0.340 - -17.07% -
471.omnetpp (max) -11.11% 189.000 168.000 - 309.76% -
471.omnetpp (max) (percentage) -10.80% 1.760 1.570 - 6.80% -
471.omnetpp (unexplained diff vs previous) (percentage) -10.47% 0.860 0.770 - -46.90% -
471.omnetpp (unexplained diff vs previous) -9.78% 92.000 83.000 - 102.44% -
453.povray (max) -5.30% 132.000 125.000 - 3025.00% -
444.namd (max) -5.22% 882.000 836.000 - 16620.00% -
444.namd (max) (percentage) -5.20% 6.540 6.200 - 715.79% -
453.povray (max) (percentage) -5.18% 1.930 1.830 - 71.03% -
464.h264ref -3.92% 51.000 49.000 - 145.00% -
464.h264ref (avg) -3.92% 51.000 49.000 - 145.00% -
447.dealII (avg) (percentage) -3.40% 1.470 1.420 - 140.68% -
447.dealII -3.33% 120.000 116.000 - 1060.00% -
447.dealII (avg) -3.33% 120.000 116.000 - 1060.00% -
464.h264ref (avg) (percentage) -3.03% 0.330 0.320 - -13.51% -

Report Time: 0.34s
Execution (seconds)
Name Current %
401.bzip2 15480.000 473.76%
403.gcc 9173.000 15992.98%
429.mcf 11832.000 920.00%
433.milc 13584.000 1092.63%
444.namd 13484.000 1759.86%
445.gobmk 12415.000 139.35%
447.dealII 8210.000 356.11%
450.soplex 14403.000 2653.92%
453.povray 6870.000 1393.48%
456.hmmer 13533.000 280.35%
458.sjeng 16389.000 98.70%
462.libquantum 13121.000 13288.78%
464.h264ref 15499.000 177.71%
470.lbm 13714.000 331.94%
471.omnetpp 10763.000 280.59%
473.astar 14242.000 192.38%
482.sphinx3 26278.000 2920.46%
483.xalancbmk 9439.000 -
Geometric Mean 12691.593 828.74%
Code Size (bytes)
Name Current %
401.bzip2 39578.000 -4.95%
403.gcc 1962810.000 -
429.mcf 7935.000 -
433.milc 74963.000 2.84%
444.namd 175648.000 1.65%
445.gobmk 1313308.000 -
447.dealII 1786157.000 2.62%
450.soplex 203060.000 -
453.povray 593457.000 2.44%
456.hmmer 168200.000 -
458.sjeng 98078.000 1.13%
462.libquantum 26720.000 11.52%
464.h264ref 355202.000 1.43%
470.lbm 9739.000 -
471.omnetpp 377247.000 -
473.astar 23248.000 -
482.sphinx3 115840.000 -
483.xalancbmk 2288333.000 -
Geometric Mean 164906.545 18.04%
Score
Name Current %
nb_compile_successful 19.000 -47.22%
nb_execution_successful 18.000 -47.06%
nb_total_tests 19.000 -52.50%
Geometric Mean 18.661 -48.99%
sample variability
Name Current %
401.bzip2 43.000 258.33%
401.bzip2 (avg) 43.000 258.33%
401.bzip2 (avg) (percentage) 0.280 -41.67%
401.bzip2 (max) 58.000 286.67%
401.bzip2 (max) (percentage) 0.380 -34.48%
401.bzip2 (unexplained diff vs previous) 59.000 436.36%
401.bzip2 (unexplained diff vs previous) (percentage) 0.380 -7.32%
403.gcc 114.000 5600.00%
403.gcc (avg) 114.000 5600.00%
403.gcc (avg) (percentage) 1.250 -66.67%
403.gcc (max) 44.000 2100.00%
403.gcc (max) (percentage) 0.490 -90.20%
403.gcc (unexplained diff vs previous) 4.000 33.33%
403.gcc (unexplained diff vs previous) (percentage) 0.040 -99.24%
429.mcf 88.000 450.00%
429.mcf (avg) 88.000 450.00%
429.mcf (avg) (percentage) 0.750 -46.43%
429.mcf (max) 53.000 341.67%
429.mcf (max) (percentage) 0.450 -59.09%
429.mcf (unexplained diff vs previous) 9.000 80.00%
429.mcf (unexplained diff vs previous) (percentage) 0.080 -81.40%
433.milc 164.000 2633.33%
433.milc (avg) 164.000 2633.33%
433.milc (avg) (percentage) 1.210 116.07%
433.milc (max) 123.000 1437.50%
433.milc (max) (percentage) 0.910 16.67%
433.milc (unexplained diff vs previous) 116.000 1188.89%
433.milc (unexplained diff vs previous) (percentage) 0.850 7.59%
444.namd 525.000 8650.00%
444.namd (avg) 525.000 8650.00%
444.namd (avg) (percentage) 3.900 319.35%
444.namd (max) 836.000 16620.00%
444.namd (max) (percentage) 6.200 715.79%
444.namd (unexplained diff vs previous) 1.000 -
444.namd (unexplained diff vs previous) (percentage) 0.010 -
445.gobmk 42.000 162.50%
445.gobmk (avg) 42.000 162.50%
445.gobmk (avg) (percentage) 0.340 6.25%
445.gobmk (max) 75.000 341.18%
445.gobmk (max) (percentage) 0.610 79.41%
445.gobmk (unexplained diff vs previous) 51.000 -
445.gobmk (unexplained diff vs previous) (percentage) 0.410 -
447.dealII 116.000 1060.00%
447.dealII (avg) 116.000 1060.00%
447.dealII (avg) (percentage) 1.420 140.68%
447.dealII (max) 146.000 873.33%
447.dealII (max) (percentage) 1.790 110.59%
447.dealII (unexplained diff vs previous) 59.000 -
447.dealII (unexplained diff vs previous) (percentage) 0.720 -
450.soplex 96.000 1820.00%
450.soplex (avg) 96.000 1820.00%
450.soplex (avg) (percentage) 0.670 -40.71%
450.soplex (max) 31.000 933.33%
450.soplex (max) (percentage) 0.220 -62.07%
450.soplex (unexplained diff vs previous) 5.000 150.00%
450.soplex (unexplained diff vs previous) (percentage) 0.030 -92.11%
453.povray 64.000 1500.00%
453.povray (avg) 64.000 1500.00%
453.povray (avg) (percentage) 0.940 -8.74%
453.povray (max) 125.000 3025.00%
453.povray (max) (percentage) 1.830 71.03%
453.povray (unexplained diff vs previous) 3.000 -
453.povray (unexplained diff vs previous) (percentage) 0.040 -
456.hmmer 58.000 241.18%
456.hmmer (avg) 58.000 241.18%
456.hmmer (avg) (percentage) 0.430 -14.00%
456.hmmer (max) 109.000 626.67%
456.hmmer (max) (percentage) 0.810 84.09%
456.hmmer (unexplained diff vs previous) 110.000 1122.22%
456.hmmer (unexplained diff vs previous) (percentage) 0.810 224.00%
458.sjeng 376.000 1196.55%
458.sjeng (avg) 376.000 1196.55%
458.sjeng (avg) (percentage) 2.300 538.89%
458.sjeng (max) 45.000 150.00%
458.sjeng (max) (percentage) 0.280 27.27%
458.sjeng (unexplained diff vs previous) 15.000 -
458.sjeng (unexplained diff vs previous) (percentage) 0.090 -
462.libquantum 32.000 3100.00%
462.libquantum (avg) 32.000 3100.00%
462.libquantum (avg) (percentage) 0.250 -84.57%
462.libquantum (max) 15.000 400.00%
462.libquantum (max) (percentage) 0.120 -96.25%
462.libquantum (unexplained diff vs previous) 6.000 -
462.libquantum (unexplained diff vs previous) (percentage) 0.050 -
464.h264ref 49.000 145.00%
464.h264ref (avg) 49.000 145.00%
464.h264ref (avg) (percentage) 0.320 -13.51%
464.h264ref (max) 52.000 136.36%
464.h264ref (max) (percentage) 0.340 -17.07%
464.h264ref (unexplained diff vs previous) 10.000 -56.52%
464.h264ref (unexplained diff vs previous) (percentage) 0.060 -85.37%
470.lbm 331.000 1339.13%
470.lbm (avg) 331.000 1339.13%
470.lbm (avg) (percentage) 2.420 231.51%
470.lbm (max) 315.000 3050.00%
470.lbm (max) (percentage) 2.300 576.47%
470.lbm (unexplained diff vs previous) 121.000 1916.67%
470.lbm (unexplained diff vs previous) (percentage) 0.880 363.16%
471.omnetpp 97.000 155.26%
471.omnetpp (avg) 97.000 155.26%
471.omnetpp (avg) (percentage) 0.910 -33.58%
471.omnetpp (max) 168.000 309.76%
471.omnetpp (max) (percentage) 1.570 6.80%
471.omnetpp (unexplained diff vs previous) 83.000 102.44%
471.omnetpp (unexplained diff vs previous) (percentage) 0.770 -46.90%
473.astar 89.000 140.54%
473.astar (avg) 89.000 140.54%
473.astar (avg) (percentage) 0.630 -17.11%
473.astar (max) 122.000 577.78%
473.astar (max) (percentage) 0.860 126.32%
473.astar (unexplained diff vs previous) 13.000 550.00%
473.astar (unexplained diff vs previous) (percentage) 0.090 125.00%
482.sphinx3 504.000 7100.00%
482.sphinx3 (avg) 504.000 7100.00%
482.sphinx3 (avg) (percentage) 1.920 118.18%
482.sphinx3 (max) 596.000 6522.22%
482.sphinx3 (max) (percentage) 2.270 99.12%
482.sphinx3 (unexplained diff vs previous) 23.000 130.00%
482.sphinx3 (unexplained diff vs previous) (percentage) 0.090 -92.17%
483.xalancbmk 79.000 -
483.xalancbmk (avg) 79.000 -
483.xalancbmk (avg) (percentage) 0.840 -36.84%
483.xalancbmk (max) 88.000 -
483.xalancbmk (max) (percentage) 0.940 38.24%
483.xalancbmk (unexplained diff vs previous) 81.000 -
483.xalancbmk (unexplained diff vs previous) (percentage) 0.860 -
Geometric Mean 8.195 222.25%