Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/0148df8157f05ecf3b1064508e6f012aefb87dad (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk_ci_llvm-build-tcwg_bmk_apm-llvm-master-arm-spec2k6-Os/186/
View Options
Report
Filter

llvm-arm-master-Os test results

Run Order Start Time Duration
Current 0186 (no-change) 2022-10-08T18:08:33 0:00:00
Previous 0185 (llvmorg-19-init-18365-gae2012d70182) 2024-07-17T11:47:32 0:00:00
Baseline 0001 (llvmorg-16-init-16061-ge7790fbed32b) 2022-12-29T19:41:07 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 126 92
Performance Improvements 15 27
Added Tests 13 2
Unchanged Tests 626 659
Total Tests 780

Run-Over-Run Changes Detail

Performance Regressions - Code Size Δ Previous Current σ Δ (B) σ (B)
462.libquantum 11.52% 23959.000 26720.000 - -0.13% -
433.milc 2.84% 72890.000 74963.000 - -0.01% -
447.dealII 2.64% 1740291.000 1786157.000 - 0.46% -
453.povray 2.45% 579275.000 593457.000 - 0.06% -
444.namd 1.64% 172809.000 175648.000 - 0.28% -
464.h264ref 1.45% 350136.000 355202.000 - 0.16% -
458.sjeng 1.15% 96961.000 98078.000 - 0.29% -

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
403.gcc 15181.67% 60.000 9169.000 - 0.77% -
462.libquantum 13294.90% 98.000 13127.000 - 0.01% -
482.sphinx3 2883.52% 880.000 26255.000 - -0.21% -
450.soplex 2663.53% 521.000 14398.000 - -0.21% -
444.namd 1770.04% 721.000 13483.000 - -0.09% -
453.povray 1399.34% 458.000 6867.000 - 0.15% -
433.milc 1073.17% 1148.000 13468.000 - -0.10% -
429.mcf 925.19% 1155.000 11841.000 - -1.32% -
401.bzip2 469.25% 2709.000 15421.000 - -1.67% -
447.dealII 358.37% 1804.000 8269.000 - 0.89% -
470.lbm 336.57% 3169.000 13835.000 - -0.34% -
456.hmmer 284.42% 3549.000 13643.000 - 2.08% -
471.omnetpp 283.21% 2787.000 10680.000 - -0.61% -
473.astar 192.24% 4869.000 14229.000 - -0.23% -
464.h264ref 179.04% 5558.000 15509.000 - 0.10% -
445.gobmk 139.92% 5196.000 12466.000 - 0.53% -
458.sjeng 98.35% 8255.000 16374.000 - -0.20% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
482.sphinx3 (unexplained diff vs previous) 40950.00% 2.000 821.000 - -9.18% -
403.gcc (max) 22300.00% 2.000 448.000 - 1217.65% -
444.namd (max) 17500.00% 5.000 880.000 - -0.23% -
444.namd 14100.00% 6.000 852.000 - 65.76% -
444.namd (avg) 14100.00% 6.000 852.000 - 65.76% -
444.namd (unexplained diff vs previous) 13683.33% 6.000 827.000 - -0.12% -
450.soplex (max) 13333.33% 3.000 403.000 - 391.46% -
482.sphinx3 (max) 9837.50% 8.000 795.000 - -8.93% -
482.sphinx3 8742.86% 7.000 619.000 - 26.58% -
482.sphinx3 (avg) 8742.86% 7.000 619.000 - 26.58% -
458.sjeng (max) 8463.64% 22.000 1884.000 - 2798.46% -
403.gcc 7450.00% 2.000 151.000 - 251.16% -
403.gcc (avg) 7450.00% 2.000 151.000 - 251.16% -
401.bzip2 (unexplained diff vs previous) 4900.00% 1.000 50.000 - 2.04% -
458.sjeng (max) (percentage) 4162.96% 0.270 11.510 - 2777.50% -
462.libquantum (max) 4000.00% 4.000 164.000 - 530.77% -
462.libquantum 3800.00% 1.000 39.000 - 105.26% -
462.libquantum (avg) 3800.00% 1.000 39.000 - 105.26% -
470.lbm (max) 3433.33% 12.000 424.000 - -44.86% -
470.lbm (unexplained diff vs previous) 3261.54% 13.000 437.000 - -12.07% -
453.povray 3200.00% 4.000 132.000 - 41.94% -
453.povray (avg) 3200.00% 4.000 132.000 - 41.94% -
464.h264ref (unexplained diff vs previous) 3100.00% 2.000 64.000 - 6.67% -
433.milc 2783.33% 6.000 173.000 - 27.21% -
433.milc (avg) 2783.33% 6.000 173.000 - 27.21% -
453.povray (max) 2540.00% 5.000 132.000 - 0.00% -
450.soplex 2220.00% 5.000 116.000 - 127.45% -
450.soplex (avg) 2220.00% 5.000 116.000 - 127.45% -
429.mcf (max) 2115.38% 13.000 288.000 - 329.85% -
464.h264ref (max) 2000.00% 3.000 63.000 - 5.00% -
433.milc (max) 1871.43% 7.000 138.000 - -25.00% -
458.sjeng 1627.59% 29.000 501.000 - 427.37% -
458.sjeng (avg) 1627.59% 29.000 501.000 - 427.37% -
470.lbm 1556.52% 23.000 381.000 - 18.32% -
470.lbm (avg) 1556.52% 23.000 381.000 - 18.32% -
482.sphinx3 (unexplained diff vs previous) (percentage) 1260.87% 0.230 3.130 - -9.01% -
447.dealII 1230.00% 10.000 133.000 - 10.83% -
447.dealII (avg) 1230.00% 10.000 133.000 - 10.83% -
429.mcf (unexplained diff vs previous) 1180.00% 5.000 64.000 - -4.48% -
447.dealII (max) 993.33% 15.000 164.000 - 27.13% -
456.hmmer (unexplained diff vs previous) 966.67% 3.000 32.000 - 255.56% -
464.h264ref (unexplained diff vs previous) (percentage) 925.00% 0.040 0.410 - 5.13% -
447.dealII (unexplained diff vs previous) 906.25% 16.000 161.000 - 33.06% -
458.sjeng (avg) (percentage) 750.00% 0.360 3.060 - 427.59% -
401.bzip2 (unexplained diff vs previous) (percentage) 700.00% 0.040 0.320 - 3.23% -
444.namd (max) (percentage) 686.75% 0.830 6.530 - -0.15% -
470.lbm (unexplained diff vs previous) (percentage) 670.73% 0.410 3.160 - -11.73% -
470.lbm (max) (percentage) 648.78% 0.410 3.070 - -44.58% -
444.namd (unexplained diff vs previous) (percentage) 638.55% 0.830 6.130 - -0.16% -
473.astar (unexplained diff vs previous) 638.46% 13.000 96.000 - -11.11% -
444.namd (avg) (percentage) 579.57% 0.930 6.320 - 65.88% -
473.astar (max) 573.68% 19.000 128.000 - 12.28% -
429.mcf 562.50% 16.000 106.000 - 100.00% -
429.mcf (avg) 562.50% 16.000 106.000 - 100.00% -
464.h264ref (max) (percentage) 485.71% 0.070 0.410 - 5.13% -
471.omnetpp (max) 464.52% 31.000 175.000 - -7.41% -
445.gobmk (unexplained diff vs previous) 433.33% 6.000 32.000 - 6.67% -
462.libquantum (unexplained diff vs previous) 375.00% 4.000 19.000 - 18.75% -
450.soplex (max) (percentage) 366.67% 0.600 2.800 - 391.23% -
445.gobmk (max) 310.53% 19.000 78.000 - 168.97% -
470.lbm (avg) (percentage) 272.97% 0.740 2.760 - 18.97% -
473.astar 210.81% 37.000 115.000 - 61.97% -
473.astar (avg) 210.81% 37.000 115.000 - 61.97% -
401.bzip2 (max) 206.25% 16.000 49.000 - 2.08% -
482.sphinx3 (max) (percentage) 200.00% 1.010 3.030 - -8.73% -
464.h264ref 190.00% 20.000 58.000 - 13.73% -
464.h264ref (avg) 190.00% 20.000 58.000 - 13.73% -
456.hmmer (unexplained diff vs previous) (percentage) 187.50% 0.080 0.230 - 228.57% -
456.hmmer (max) 181.25% 16.000 45.000 - 12.50% -
447.dealII (avg) (percentage) 172.88% 0.590 1.610 - 9.52% -
482.sphinx3 (avg) (percentage) 168.18% 0.880 2.360 - 26.88% -
471.omnetpp 163.16% 38.000 100.000 - 20.48% -
471.omnetpp (avg) 163.16% 38.000 100.000 - 20.48% -
458.sjeng (unexplained diff vs previous) 154.55% 22.000 56.000 - 36.59% -
401.bzip2 153.85% 13.000 33.000 - -2.94% -
401.bzip2 (avg) 153.85% 13.000 33.000 - -2.94% -
473.astar (unexplained diff vs previous) (percentage) 148.15% 0.270 0.670 - -11.84% -
445.gobmk 137.50% 16.000 38.000 - 72.73% -
445.gobmk (avg) 137.50% 16.000 38.000 - 72.73% -
433.milc (avg) (percentage) 130.36% 0.560 1.290 - 27.72% -
447.dealII (max) (percentage) 126.14% 0.880 1.990 - 25.95% -
473.astar (max) (percentage) 119.51% 0.410 0.900 - 12.50% -
447.dealII (unexplained diff vs previous) (percentage) 119.10% 0.890 1.950 - 31.76% -
445.gobmk (unexplained diff vs previous) (percentage) 116.67% 0.120 0.260 - 8.33% -
456.hmmer 111.76% 17.000 36.000 - -25.00% -
456.hmmer (avg) 111.76% 17.000 36.000 - -25.00% -
429.mcf (max) (percentage) 110.34% 1.160 2.440 - 335.71% -
471.omnetpp (unexplained diff vs previous) 88.46% 26.000 49.000 - -46.74% -
453.povray (avg) (percentage) 87.38% 1.030 1.930 - 40.88% -
453.povray (max) (percentage) 72.32% 1.120 1.930 - 0.00% -
445.gobmk (max) (percentage) 65.79% 0.380 0.630 - 162.50% -
433.milc (max) (percentage) 49.28% 0.690 1.030 - -24.82% -
471.omnetpp (max) (percentage) 45.13% 1.130 1.640 - -6.82% -
483.xalancbmk (max) (percentage) 42.65% 0.680 0.970 - 49.23% -
403.gcc (max) (percentage) 30.40% 3.750 4.890 - 1186.84% -
458.sjeng (unexplained diff vs previous) (percentage) 25.93% 0.270 0.340 - 36.00% -
429.mcf (unexplained diff vs previous) (percentage) 25.58% 0.430 0.540 - -3.57% -
473.astar (avg) (percentage) 5.19% 0.770 0.810 - 62.00% -
464.h264ref (avg) (percentage) 2.70% 0.370 0.380 - 15.15% -

Performance Regressions - Score Δ Previous Current σ Δ (B) σ (B)
nb_total_tests -52.50% 40.000 19.000 - 0.00% -
nb_compile_successful -47.22% 36.000 19.000 - 0.00% -
nb_execution_successful -47.06% 34.000 18.000 - 0.00% -

Performance Improvements - Code Size Δ Previous Current σ Δ (B) σ (B)
401.bzip2 -4.95% 41641.000 39578.000 - 0.30% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
462.libquantum (unexplained diff vs previous) (percentage) -96.57% 4.080 0.140 - 16.67% -
462.libquantum (avg) (percentage) -81.71% 1.640 0.300 - 100.00% -
462.libquantum (max) (percentage) -70.66% 4.260 1.250 - 525.00% -
403.gcc (avg) (percentage) -55.41% 3.700 1.650 - 243.75% -
401.bzip2 (avg) (percentage) -54.17% 0.480 0.220 - 0.00% -
471.omnetpp (unexplained diff vs previous) (percentage) -50.54% 0.930 0.460 - -46.51% -
401.bzip2 (max) (percentage) -48.39% 0.620 0.320 - 3.23% -
456.hmmer (avg) (percentage) -46.00% 0.500 0.270 - -25.00% -
483.xalancbmk (avg) (percentage) -38.35% 1.330 0.820 - 64.00% -
429.mcf (avg) (percentage) -36.17% 1.410 0.900 - 100.00% -
471.omnetpp (avg) (percentage) -31.39% 1.370 0.940 - 20.51% -
456.hmmer (max) (percentage) -29.79% 0.470 0.330 - 10.00% -
450.soplex (avg) (percentage) -28.95% 1.140 0.810 - 125.00% -
445.gobmk (avg) (percentage) -3.13% 0.320 0.310 - 72.22% -

Added Tests - Code Size
483.xalancbmk

Added Tests - Execution
483.xalancbmk

Added Tests - sample variability
403.gcc (unexplained diff vs previous)
403.gcc (unexplained diff vs previous) (percentage)
433.milc (unexplained diff vs previous)
433.milc (unexplained diff vs previous) (percentage)
453.povray (unexplained diff vs previous)
453.povray (unexplained diff vs previous) (percentage)
483.xalancbmk
483.xalancbmk (avg)
483.xalancbmk (max)
483.xalancbmk (unexplained diff vs previous)
483.xalancbmk (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
450.soplex 2.19% 198708.000 203060.000 - 0.26% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
456.hmmer 2.08% 13365.000 13643.000 - 284.42% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
458.sjeng (max) 2798.46% 65.000 1884.000 - 8463.64% -
458.sjeng (max) (percentage) 2777.50% 0.400 11.510 - 4162.96% -
403.gcc (max) 1217.65% 34.000 448.000 - 22300.00% -
403.gcc (max) (percentage) 1186.84% 0.380 4.890 - 30.40% -
462.libquantum (max) 530.77% 26.000 164.000 - 4000.00% -
462.libquantum (max) (percentage) 525.00% 0.200 1.250 - -70.66% -
458.sjeng (avg) (percentage) 427.59% 0.580 3.060 - 750.00% -
458.sjeng 427.37% 95.000 501.000 - 1627.59% -
458.sjeng (avg) 427.37% 95.000 501.000 - 1627.59% -
450.soplex (max) 391.46% 82.000 403.000 - 13333.33% -
450.soplex (max) (percentage) 391.23% 0.570 2.800 - 366.67% -
429.mcf (max) (percentage) 335.71% 0.560 2.440 - 110.34% -
429.mcf (max) 329.85% 67.000 288.000 - 2115.38% -
456.hmmer (unexplained diff vs previous) 255.56% 9.000 32.000 - 966.67% -
403.gcc 251.16% 43.000 151.000 - 7450.00% -
403.gcc (avg) 251.16% 43.000 151.000 - 7450.00% -
403.gcc (avg) (percentage) 243.75% 0.480 1.650 - -55.41% -
456.hmmer (unexplained diff vs previous) (percentage) 228.57% 0.070 0.230 - 187.50% -
445.gobmk (max) 168.97% 29.000 78.000 - 310.53% -
445.gobmk (max) (percentage) 162.50% 0.240 0.630 - 65.79% -
450.soplex 127.45% 51.000 116.000 - 2220.00% -
450.soplex (avg) 127.45% 51.000 116.000 - 2220.00% -
450.soplex (avg) (percentage) 125.00% 0.360 0.810 - -28.95% -
462.libquantum 105.26% 19.000 39.000 - 3800.00% -
462.libquantum (avg) 105.26% 19.000 39.000 - 3800.00% -
429.mcf 100.00% 53.000 106.000 - 562.50% -
429.mcf (avg) 100.00% 53.000 106.000 - 562.50% -
429.mcf (avg) (percentage) 100.00% 0.450 0.900 - -36.17% -
462.libquantum (avg) (percentage) 100.00% 0.150 0.300 - -81.71% -
445.gobmk 72.73% 22.000 38.000 - 137.50% -
445.gobmk (avg) 72.73% 22.000 38.000 - 137.50% -
445.gobmk (avg) (percentage) 72.22% 0.180 0.310 - -3.13% -
444.namd (avg) (percentage) 65.88% 3.810 6.320 - 579.57% -
444.namd 65.76% 514.000 852.000 - 14100.00% -
444.namd (avg) 65.76% 514.000 852.000 - 14100.00% -
483.xalancbmk (avg) (percentage) 64.00% 0.500 0.820 - -38.35% -
473.astar (avg) (percentage) 62.00% 0.500 0.810 - 5.19% -
473.astar 61.97% 71.000 115.000 - 210.81% -
473.astar (avg) 61.97% 71.000 115.000 - 210.81% -
483.xalancbmk 61.70% 47.000 76.000 - 0.00% -
483.xalancbmk (avg) 61.70% 47.000 76.000 - 0.00% -
403.gcc (unexplained diff vs previous) (percentage) 59.46% 0.370 0.590 - 0.00% -
403.gcc (unexplained diff vs previous) 58.82% 34.000 54.000 - 0.00% -
483.xalancbmk (unexplained diff vs previous) 50.82% 61.000 92.000 - 0.00% -
483.xalancbmk (unexplained diff vs previous) (percentage) 50.77% 0.650 0.980 - 0.00% -
483.xalancbmk (max) (percentage) 49.23% 0.650 0.970 - 42.65% -
483.xalancbmk (max) 47.54% 61.000 90.000 - 0.00% -
453.povray 41.94% 93.000 132.000 - 3200.00% -
453.povray (avg) 41.94% 93.000 132.000 - 3200.00% -
453.povray (avg) (percentage) 40.88% 1.370 1.930 - 87.38% -
458.sjeng (unexplained diff vs previous) 36.59% 41.000 56.000 - 154.55% -
458.sjeng (unexplained diff vs previous) (percentage) 36.00% 0.250 0.340 - 25.93% -
447.dealII (unexplained diff vs previous) 33.06% 121.000 161.000 - 906.25% -
447.dealII (unexplained diff vs previous) (percentage) 31.76% 1.480 1.950 - 119.10% -
433.milc (avg) (percentage) 27.72% 1.010 1.290 - 130.36% -
433.milc 27.21% 136.000 173.000 - 2783.33% -
433.milc (avg) 27.21% 136.000 173.000 - 2783.33% -
447.dealII (max) 27.13% 129.000 164.000 - 993.33% -
482.sphinx3 (avg) (percentage) 26.88% 1.860 2.360 - 168.18% -
482.sphinx3 26.58% 489.000 619.000 - 8742.86% -
482.sphinx3 (avg) 26.58% 489.000 619.000 - 8742.86% -
447.dealII (max) (percentage) 25.95% 1.580 1.990 - 126.14% -
471.omnetpp (avg) (percentage) 20.51% 0.780 0.940 - -31.39% -
471.omnetpp 20.48% 83.000 100.000 - 163.16% -
471.omnetpp (avg) 20.48% 83.000 100.000 - 163.16% -
470.lbm (avg) (percentage) 18.97% 2.320 2.760 - 272.97% -
462.libquantum (unexplained diff vs previous) 18.75% 16.000 19.000 - 375.00% -
470.lbm 18.32% 322.000 381.000 - 1556.52% -
470.lbm (avg) 18.32% 322.000 381.000 - 1556.52% -
462.libquantum (unexplained diff vs previous) (percentage) 16.67% 0.120 0.140 - -96.57% -
464.h264ref (avg) (percentage) 15.15% 0.330 0.380 - 2.70% -
464.h264ref 13.73% 51.000 58.000 - 190.00% -
464.h264ref (avg) 13.73% 51.000 58.000 - 190.00% -
456.hmmer (max) 12.50% 40.000 45.000 - 181.25% -
473.astar (max) (percentage) 12.50% 0.800 0.900 - 119.51% -
473.astar (max) 12.28% 114.000 128.000 - 573.68% -
447.dealII 10.83% 120.000 133.000 - 1230.00% -
447.dealII (avg) 10.83% 120.000 133.000 - 1230.00% -
456.hmmer (max) (percentage) 10.00% 0.300 0.330 - -29.79% -
447.dealII (avg) (percentage) 9.52% 1.470 1.610 - 172.88% -
445.gobmk (unexplained diff vs previous) (percentage) 8.33% 0.240 0.260 - 116.67% -
445.gobmk (unexplained diff vs previous) 6.67% 30.000 32.000 - 433.33% -
464.h264ref (unexplained diff vs previous) 6.67% 60.000 64.000 - 3100.00% -
464.h264ref (max) (percentage) 5.13% 0.390 0.410 - 485.71% -
464.h264ref (unexplained diff vs previous) (percentage) 5.13% 0.390 0.410 - 925.00% -
464.h264ref (max) 5.00% 60.000 63.000 - 2000.00% -
401.bzip2 (max) (percentage) 3.23% 0.310 0.320 - -48.39% -
401.bzip2 (unexplained diff vs previous) (percentage) 3.23% 0.310 0.320 - 700.00% -
401.bzip2 (max) 2.08% 48.000 49.000 - 206.25% -
401.bzip2 (unexplained diff vs previous) 2.04% 49.000 50.000 - 4900.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
401.bzip2 -1.67% 15683.000 15421.000 - 469.25% -
429.mcf -1.32% 11999.000 11841.000 - 925.19% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
450.soplex (unexplained diff vs previous) -59.76% 82.000 33.000 - 0.00% -
450.soplex (unexplained diff vs previous) (percentage) -59.65% 0.570 0.230 - 0.00% -
471.omnetpp (unexplained diff vs previous) -46.74% 92.000 49.000 - 88.46% -
471.omnetpp (unexplained diff vs previous) (percentage) -46.51% 0.860 0.460 - -50.54% -
470.lbm (max) -44.86% 769.000 424.000 - 3433.33% -
470.lbm (max) (percentage) -44.58% 5.540 3.070 - 648.78% -
433.milc (max) -25.00% 184.000 138.000 - 1871.43% -
456.hmmer -25.00% 48.000 36.000 - 111.76% -
456.hmmer (avg) -25.00% 48.000 36.000 - 111.76% -
456.hmmer (avg) (percentage) -25.00% 0.360 0.270 - -46.00% -
433.milc (max) (percentage) -24.82% 1.370 1.030 - 49.28% -
470.lbm (unexplained diff vs previous) -12.07% 497.000 437.000 - 3261.54% -
473.astar (unexplained diff vs previous) (percentage) -11.84% 0.760 0.670 - 148.15% -
470.lbm (unexplained diff vs previous) (percentage) -11.73% 3.580 3.160 - 670.73% -
473.astar (unexplained diff vs previous) -11.11% 108.000 96.000 - 638.46% -
482.sphinx3 (unexplained diff vs previous) -9.18% 904.000 821.000 - 40950.00% -
482.sphinx3 (unexplained diff vs previous) (percentage) -9.01% 3.440 3.130 - 1260.87% -
482.sphinx3 (max) -8.93% 873.000 795.000 - 9837.50% -
482.sphinx3 (max) (percentage) -8.73% 3.320 3.030 - 200.00% -
471.omnetpp (max) -7.41% 189.000 175.000 - 464.52% -
471.omnetpp (max) (percentage) -6.82% 1.760 1.640 - 45.13% -
429.mcf (unexplained diff vs previous) -4.48% 67.000 64.000 - 1180.00% -
429.mcf (unexplained diff vs previous) (percentage) -3.57% 0.560 0.540 - 25.58% -
401.bzip2 -2.94% 34.000 33.000 - 153.85% -
401.bzip2 (avg) -2.94% 34.000 33.000 - 153.85% -

Added Tests - sample variability
433.milc (unexplained diff vs previous)
433.milc (unexplained diff vs previous) (percentage)

Report Time: 0.38s
Execution (seconds)
Name Current %
401.bzip2 15421.000 469.25%
403.gcc 9169.000 15181.67%
429.mcf 11841.000 925.19%
433.milc 13468.000 1073.17%
444.namd 13483.000 1770.04%
445.gobmk 12466.000 139.92%
447.dealII 8269.000 358.37%
450.soplex 14398.000 2663.53%
453.povray 6867.000 1399.34%
456.hmmer 13643.000 284.42%
458.sjeng 16374.000 98.35%
462.libquantum 13127.000 13294.90%
464.h264ref 15509.000 179.04%
470.lbm 13835.000 336.57%
471.omnetpp 10680.000 283.21%
473.astar 14229.000 192.24%
482.sphinx3 26255.000 2883.52%
483.xalancbmk 9358.000 -
Geometric Mean 12689.653 826.54%
Code Size (bytes)
Name Current %
401.bzip2 39578.000 -4.95%
403.gcc 1962810.000 -
429.mcf 7935.000 -
433.milc 74963.000 2.84%
444.namd 175648.000 1.64%
445.gobmk 1313308.000 -
447.dealII 1786157.000 2.64%
450.soplex 203060.000 -
453.povray 593457.000 2.45%
456.hmmer 168200.000 -
458.sjeng 98078.000 1.15%
462.libquantum 26720.000 11.52%
464.h264ref 355202.000 1.45%
470.lbm 9739.000 -
471.omnetpp 377247.000 -
473.astar 23248.000 -
482.sphinx3 115840.000 -
483.xalancbmk 2288333.000 -
Geometric Mean 164906.545 18.04%
Score
Name Current %
nb_compile_successful 19.000 -47.22%
nb_execution_successful 18.000 -47.06%
nb_total_tests 19.000 -52.50%
Geometric Mean 18.661 -48.99%
sample variability
Name Current %
401.bzip2 33.000 153.85%
401.bzip2 (avg) 33.000 153.85%
401.bzip2 (avg) (percentage) 0.220 -54.17%
401.bzip2 (max) 49.000 206.25%
401.bzip2 (max) (percentage) 0.320 -48.39%
401.bzip2 (unexplained diff vs previous) 50.000 4900.00%
401.bzip2 (unexplained diff vs previous) (percentage) 0.320 700.00%
403.gcc 151.000 7450.00%
403.gcc (avg) 151.000 7450.00%
403.gcc (avg) (percentage) 1.650 -55.41%
403.gcc (max) 448.000 22300.00%
403.gcc (max) (percentage) 4.890 30.40%
403.gcc (unexplained diff vs previous) 54.000 -
403.gcc (unexplained diff vs previous) (percentage) 0.590 -
429.mcf 106.000 562.50%
429.mcf (avg) 106.000 562.50%
429.mcf (avg) (percentage) 0.900 -36.17%
429.mcf (max) 288.000 2115.38%
429.mcf (max) (percentage) 2.440 110.34%
429.mcf (unexplained diff vs previous) 64.000 1180.00%
429.mcf (unexplained diff vs previous) (percentage) 0.540 25.58%
433.milc 173.000 2783.33%
433.milc (avg) 173.000 2783.33%
433.milc (avg) (percentage) 1.290 130.36%
433.milc (max) 138.000 1871.43%
433.milc (max) (percentage) 1.030 49.28%
433.milc (unexplained diff vs previous) 0.000 -
433.milc (unexplained diff vs previous) (percentage) 0.000 -
444.namd 852.000 14100.00%
444.namd (avg) 852.000 14100.00%
444.namd (avg) (percentage) 6.320 579.57%
444.namd (max) 880.000 17500.00%
444.namd (max) (percentage) 6.530 686.75%
444.namd (unexplained diff vs previous) 827.000 13683.33%
444.namd (unexplained diff vs previous) (percentage) 6.130 638.55%
445.gobmk 38.000 137.50%
445.gobmk (avg) 38.000 137.50%
445.gobmk (avg) (percentage) 0.310 -3.13%
445.gobmk (max) 78.000 310.53%
445.gobmk (max) (percentage) 0.630 65.79%
445.gobmk (unexplained diff vs previous) 32.000 433.33%
445.gobmk (unexplained diff vs previous) (percentage) 0.260 116.67%
447.dealII 133.000 1230.00%
447.dealII (avg) 133.000 1230.00%
447.dealII (avg) (percentage) 1.610 172.88%
447.dealII (max) 164.000 993.33%
447.dealII (max) (percentage) 1.990 126.14%
447.dealII (unexplained diff vs previous) 161.000 906.25%
447.dealII (unexplained diff vs previous) (percentage) 1.950 119.10%
450.soplex 116.000 2220.00%
450.soplex (avg) 116.000 2220.00%
450.soplex (avg) (percentage) 0.810 -28.95%
450.soplex (max) 403.000 13333.33%
450.soplex (max) (percentage) 2.800 366.67%
450.soplex (unexplained diff vs previous) 33.000 -
450.soplex (unexplained diff vs previous) (percentage) 0.230 -
453.povray 132.000 3200.00%
453.povray (avg) 132.000 3200.00%
453.povray (avg) (percentage) 1.930 87.38%
453.povray (max) 132.000 2540.00%
453.povray (max) (percentage) 1.930 72.32%
453.povray (unexplained diff vs previous) 130.000 -
453.povray (unexplained diff vs previous) (percentage) 1.890 -
456.hmmer 36.000 111.76%
456.hmmer (avg) 36.000 111.76%
456.hmmer (avg) (percentage) 0.270 -46.00%
456.hmmer (max) 45.000 181.25%
456.hmmer (max) (percentage) 0.330 -29.79%
456.hmmer (unexplained diff vs previous) 32.000 966.67%
456.hmmer (unexplained diff vs previous) (percentage) 0.230 187.50%
458.sjeng 501.000 1627.59%
458.sjeng (avg) 501.000 1627.59%
458.sjeng (avg) (percentage) 3.060 750.00%
458.sjeng (max) 1884.000 8463.64%
458.sjeng (max) (percentage) 11.510 4162.96%
458.sjeng (unexplained diff vs previous) 56.000 154.55%
458.sjeng (unexplained diff vs previous) (percentage) 0.340 25.93%
462.libquantum 39.000 3800.00%
462.libquantum (avg) 39.000 3800.00%
462.libquantum (avg) (percentage) 0.300 -81.71%
462.libquantum (max) 164.000 4000.00%
462.libquantum (max) (percentage) 1.250 -70.66%
462.libquantum (unexplained diff vs previous) 19.000 375.00%
462.libquantum (unexplained diff vs previous) (percentage) 0.140 -96.57%
464.h264ref 58.000 190.00%
464.h264ref (avg) 58.000 190.00%
464.h264ref (avg) (percentage) 0.380 2.70%
464.h264ref (max) 63.000 2000.00%
464.h264ref (max) (percentage) 0.410 485.71%
464.h264ref (unexplained diff vs previous) 64.000 3100.00%
464.h264ref (unexplained diff vs previous) (percentage) 0.410 925.00%
470.lbm 381.000 1556.52%
470.lbm (avg) 381.000 1556.52%
470.lbm (avg) (percentage) 2.760 272.97%
470.lbm (max) 424.000 3433.33%
470.lbm (max) (percentage) 3.070 648.78%
470.lbm (unexplained diff vs previous) 437.000 3261.54%
470.lbm (unexplained diff vs previous) (percentage) 3.160 670.73%
471.omnetpp 100.000 163.16%
471.omnetpp (avg) 100.000 163.16%
471.omnetpp (avg) (percentage) 0.940 -31.39%
471.omnetpp (max) 175.000 464.52%
471.omnetpp (max) (percentage) 1.640 45.13%
471.omnetpp (unexplained diff vs previous) 49.000 88.46%
471.omnetpp (unexplained diff vs previous) (percentage) 0.460 -50.54%
473.astar 115.000 210.81%
473.astar (avg) 115.000 210.81%
473.astar (avg) (percentage) 0.810 5.19%
473.astar (max) 128.000 573.68%
473.astar (max) (percentage) 0.900 119.51%
473.astar (unexplained diff vs previous) 96.000 638.46%
473.astar (unexplained diff vs previous) (percentage) 0.670 148.15%
482.sphinx3 619.000 8742.86%
482.sphinx3 (avg) 619.000 8742.86%
482.sphinx3 (avg) (percentage) 2.360 168.18%
482.sphinx3 (max) 795.000 9837.50%
482.sphinx3 (max) (percentage) 3.030 200.00%
482.sphinx3 (unexplained diff vs previous) 821.000 40950.00%
482.sphinx3 (unexplained diff vs previous) (percentage) 3.130 1260.87%
483.xalancbmk 76.000 -
483.xalancbmk (avg) 76.000 -
483.xalancbmk (avg) (percentage) 0.820 -38.35%
483.xalancbmk (max) 90.000 -
483.xalancbmk (max) (percentage) 0.970 42.65%
483.xalancbmk (unexplained diff vs previous) 92.000 -
483.xalancbmk (unexplained diff vs previous) (percentage) 0.980 -
Geometric Mean 13.583 495.75%