Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/1a2bc103bba04e8fba574c70c6201ba18ccc08ba (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk_ci_llvm-build-tcwg_bmk_apm-llvm-master-arm-spec2k6-Os/212/
View Options
Report
Filter

llvm-arm-master-Os test results

Run Order Start Time Duration
Current 0212 (no-change) 2022-11-08T06:13:05 0:00:00
Previous 0207 (llvmorg-20-init-06518-gb014265d992c) 2024-09-16T10:45:54 0:00:00
Baseline 0001 (llvmorg-16-init-16061-ge7790fbed32b) 2022-12-29T19:41:07 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 106 59
Performance Improvements 32 64
Added Tests 17 0
Unchanged Tests 625 657
Total Tests 780

Run-Over-Run Changes Detail

Performance Regressions - Code Size Δ Previous Current σ Δ (B) σ (B)
462.libquantum 11.00% 24071.000 26720.000 - -0.13% -
433.milc 2.88% 72870.000 74971.000 - 0.00% -
453.povray 2.37% 579559.000 593305.000 - 0.04% -
444.namd 2.02% 172221.000 175704.000 - 0.31% -
447.dealII 1.87% 1739243.000 1771704.000 - -0.35% -
464.h264ref 1.47% 349844.000 354994.000 - 0.11% -
458.sjeng 1.11% 96897.000 97974.000 - 0.18% -

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
403.gcc 16225.00% 56.000 9142.000 - 0.47% -
462.libquantum 13275.51% 98.000 13108.000 - -0.14% -
482.sphinx3 2989.66% 880.000 27189.000 - 3.34% -
450.soplex 2630.11% 528.000 14415.000 - -0.10% -
444.namd 1807.34% 708.000 13504.000 - 0.07% -
453.povray 1398.92% 461.000 6910.000 - 0.77% -
433.milc 1084.89% 1138.000 13484.000 - 0.01% -
429.mcf 936.19% 1144.000 11854.000 - -1.21% -
401.bzip2 479.35% 2688.000 15573.000 - -0.70% -
447.dealII 357.73% 1791.000 8198.000 - 0.02% -
470.lbm 354.01% 3140.000 14256.000 - 2.69% -
456.hmmer 283.47% 3551.000 13617.000 - 1.89% -
471.omnetpp 278.87% 2835.000 10741.000 - -0.05% -
473.astar 191.96% 4891.000 14280.000 - 0.13% -
464.h264ref 180.44% 5563.000 15601.000 - 0.70% -
445.gobmk 135.77% 5219.000 12305.000 - -0.77% -
458.sjeng 97.93% 8267.000 16363.000 - -0.26% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
482.sphinx3 (max) 17333.33% 6.000 1046.000 - 19.82% -
444.namd (max) 8480.00% 10.000 858.000 - -2.72% -
444.namd 7833.33% 6.000 476.000 - -7.39% -
444.namd (avg) 7833.33% 6.000 476.000 - -7.39% -
444.namd (unexplained diff vs previous) 7245.45% 11.000 808.000 - -2.42% -
482.sphinx3 6685.71% 7.000 475.000 - -2.86% -
482.sphinx3 (avg) 6685.71% 7.000 475.000 - -2.86% -
433.milc (unexplained diff vs previous) 4040.00% 5.000 207.000 - 13.74% -
433.milc (max) 3400.00% 6.000 210.000 - 14.13% -
447.dealII (unexplained diff vs previous) 2414.29% 7.000 176.000 - 45.45% -
403.gcc 2300.00% 2.000 48.000 - 11.63% -
403.gcc (avg) 2300.00% 2.000 48.000 - 11.63% -
453.povray 2225.00% 4.000 93.000 - 0.00% -
453.povray (avg) 2225.00% 4.000 93.000 - 0.00% -
433.milc 2133.33% 6.000 134.000 - -1.47% -
433.milc (avg) 2133.33% 6.000 134.000 - -1.47% -
462.libquantum 1900.00% 1.000 20.000 - 5.26% -
462.libquantum (avg) 1900.00% 1.000 20.000 - 5.26% -
453.povray (max) 1811.11% 9.000 172.000 - 30.30% -
464.h264ref (unexplained diff vs previous) 1316.67% 6.000 85.000 - 41.67% -
470.lbm 1136.36% 22.000 272.000 - -15.53% -
470.lbm (avg) 1136.36% 22.000 272.000 - -15.53% -
447.dealII 1054.55% 11.000 127.000 - 5.83% -
447.dealII (avg) 1054.55% 11.000 127.000 - 5.83% -
447.dealII (max) 1018.75% 16.000 179.000 - 38.76% -
462.libquantum (max) 1000.00% 2.000 22.000 - -15.38% -
403.gcc (max) 900.00% 4.000 40.000 - 17.65% -
450.soplex 880.00% 5.000 49.000 - -3.92% -
450.soplex (avg) 880.00% 5.000 49.000 - -3.92% -
450.soplex (unexplained diff vs previous) 866.67% 6.000 58.000 - -29.27% -
470.lbm (max) 858.97% 39.000 374.000 - -51.37% -
464.h264ref (max) 750.00% 10.000 85.000 - 41.67% -
447.dealII (unexplained diff vs previous) (percentage) 451.28% 0.390 2.150 - 45.27% -
429.mcf (max) 425.00% 16.000 84.000 - 25.37% -
429.mcf (unexplained diff vs previous) 425.00% 16.000 84.000 - 25.37% -
482.sphinx3 (max) (percentage) 406.58% 0.760 3.850 - 15.96% -
464.h264ref (unexplained diff vs previous) (percentage) 390.91% 0.110 0.540 - 38.46% -
450.soplex (max) 338.46% 13.000 57.000 - -30.49% -
444.namd (max) (percentage) 315.69% 1.530 6.360 - -2.75% -
456.hmmer 288.24% 17.000 66.000 - 37.50% -
456.hmmer (avg) 288.24% 17.000 66.000 - 37.50% -
444.namd (unexplained diff vs previous) (percentage) 285.81% 1.550 5.980 - -2.61% -
473.astar (max) 276.00% 25.000 94.000 - -17.54% -
444.namd (avg) (percentage) 267.71% 0.960 3.530 - -7.35% -
433.milc (unexplained diff vs previous) (percentage) 250.00% 0.440 1.540 - 14.07% -
458.sjeng 245.16% 31.000 107.000 - 12.63% -
458.sjeng (avg) 245.16% 31.000 107.000 - 12.63% -
429.mcf 237.50% 16.000 54.000 - 1.89% -
429.mcf (avg) 237.50% 16.000 54.000 - 1.89% -
456.hmmer (max) 204.17% 24.000 73.000 - 82.50% -
401.bzip2 191.67% 12.000 35.000 - 2.94% -
401.bzip2 (avg) 191.67% 12.000 35.000 - 2.94% -
464.h264ref (max) (percentage) 189.47% 0.190 0.550 - 41.03% -
445.gobmk (max) 187.50% 8.000 23.000 - -20.69% -
464.h264ref 183.33% 18.000 51.000 - 0.00% -
464.h264ref (avg) 183.33% 18.000 51.000 - 0.00% -
433.milc (max) (percentage) 168.97% 0.580 1.560 - 13.87% -
470.lbm (avg) (percentage) 161.64% 0.730 1.910 - -17.67% -
447.dealII (max) (percentage) 140.66% 0.910 2.190 - 38.61% -
447.dealII (avg) (percentage) 134.85% 0.660 1.550 - 5.44% -
470.lbm (max) (percentage) 108.73% 1.260 2.630 - -52.53% -
482.sphinx3 (avg) (percentage) 108.33% 0.840 1.750 - -5.91% -
473.astar 79.41% 34.000 61.000 - -14.08% -
473.astar (avg) 79.41% 34.000 61.000 - -14.08% -
471.omnetpp (max) 78.95% 38.000 68.000 - -64.02% -
433.milc (avg) (percentage) 78.57% 0.560 1.000 - -0.99% -
458.sjeng (avg) (percentage) 73.68% 0.380 0.660 - 13.79% -
456.hmmer (unexplained diff vs previous) 50.00% 8.000 12.000 - 33.33% -
471.omnetpp 42.11% 38.000 54.000 - -34.94% -
471.omnetpp (avg) 42.11% 38.000 54.000 - -34.94% -
445.gobmk 33.33% 15.000 20.000 - -9.09% -
445.gobmk (avg) 33.33% 15.000 20.000 - -9.09% -
453.povray (avg) (percentage) 32.04% 1.030 1.360 - -0.73% -
473.astar (max) (percentage) 24.53% 0.530 0.660 - -17.50% -
453.povray (max) (percentage) 22.66% 2.030 2.490 - 29.02% -
401.bzip2 (max) 20.00% 20.000 24.000 - -50.00% -
445.gobmk (max) (percentage) 18.75% 0.160 0.190 - -20.83% -
483.xalancbmk (max) (percentage) 2.99% 0.670 0.690 - 6.15% -
456.hmmer (avg) (percentage) 2.08% 0.480 0.490 - 36.11% -

Performance Regressions - Score Δ Previous Current σ Δ (B) σ (B)
nb_total_tests -52.50% 40.000 19.000 - 0.00% -
nb_compile_successful -47.22% 36.000 19.000 - 0.00% -
nb_execution_successful -47.06% 34.000 18.000 - 0.00% -

Performance Improvements - Code Size Δ Previous Current σ Δ (B) σ (B)
401.bzip2 -4.50% 41485.000 39618.000 - 0.41% -
450.soplex -3.27% 202455.000 195841.000 - -1.44% -
471.omnetpp -1.20% 378052.000 373527.000 - -0.01% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
471.omnetpp (unexplained diff vs previous) (percentage) -95.77% 0.710 0.030 - -96.51% -
403.gcc (max) (percentage) -94.72% 8.340 0.440 - 15.79% -
462.libquantum (max) (percentage) -94.01% 2.840 0.170 - -15.00% -
473.astar (unexplained diff vs previous) (percentage) -90.70% 0.430 0.040 - -94.74% -
462.libquantum (avg) (percentage) -90.06% 1.610 0.160 - 6.67% -
403.gcc (avg) (percentage) -86.51% 3.930 0.530 - 10.42% -
470.lbm (unexplained diff vs previous) (percentage) -85.83% 1.270 0.180 - -94.97% -
471.omnetpp (unexplained diff vs previous) -85.00% 20.000 3.000 - -96.74% -
450.soplex (max) (percentage) -84.19% 2.530 0.400 - -29.82% -
401.bzip2 (max) (percentage) -79.49% 0.780 0.160 - -48.39% -
473.astar (unexplained diff vs previous) -71.43% 21.000 6.000 - -94.44% -
450.soplex (avg) (percentage) -69.09% 1.100 0.340 - -5.56% -
429.mcf (avg) (percentage) -67.14% 1.400 0.460 - 2.22% -
458.sjeng (unexplained diff vs previous) (percentage) -67.12% 0.730 0.240 - -4.00% -
450.soplex (unexplained diff vs previous) (percentage) -64.91% 1.140 0.400 - -29.82% -
458.sjeng (max) (percentage) -64.20% 0.810 0.290 - -27.50% -
471.omnetpp (avg) (percentage) -62.22% 1.350 0.510 - -34.62% -
456.hmmer (unexplained diff vs previous) (percentage) -60.87% 0.230 0.090 - 28.57% -
483.xalancbmk (avg) (percentage) -56.39% 1.330 0.580 - 16.00% -
471.omnetpp (max) (percentage) -52.59% 1.350 0.640 - -63.64% -
401.bzip2 (avg) (percentage) -52.08% 0.480 0.230 - 4.55% -
429.mcf (max) (percentage) -50.00% 1.420 0.710 - 26.79% -
429.mcf (unexplained diff vs previous) (percentage) -49.29% 1.400 0.710 - 26.79% -
445.gobmk (avg) (percentage) -43.33% 0.300 0.170 - -5.56% -
473.astar (avg) (percentage) -39.44% 0.710 0.430 - -14.00% -
470.lbm (unexplained diff vs previous) -35.00% 40.000 26.000 - -94.77% -
458.sjeng (unexplained diff vs previous) -33.33% 60.000 40.000 - -2.44% -
458.sjeng (max) -28.79% 66.000 47.000 - -27.69% -
456.hmmer (max) (percentage) -20.59% 0.680 0.540 - 80.00% -

Added Tests - Code Size
483.xalancbmk

Added Tests - Execution
483.xalancbmk

Added Tests - sample variability
401.bzip2 (unexplained diff vs previous)
401.bzip2 (unexplained diff vs previous) (percentage)
403.gcc (unexplained diff vs previous)
403.gcc (unexplained diff vs previous) (percentage)
445.gobmk (unexplained diff vs previous)
445.gobmk (unexplained diff vs previous) (percentage)
453.povray (unexplained diff vs previous)
453.povray (unexplained diff vs previous) (percentage)
482.sphinx3 (unexplained diff vs previous)
482.sphinx3 (unexplained diff vs previous) (percentage)
483.xalancbmk
483.xalancbmk (avg)
483.xalancbmk (max)
483.xalancbmk (unexplained diff vs previous)
483.xalancbmk (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
482.sphinx3 3.34% 26310.000 27189.000 - 2989.66% -
470.lbm 2.69% 13882.000 14256.000 - 354.01% -
456.hmmer 1.89% 13365.000 13617.000 - 283.47% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
456.hmmer (max) 82.50% 40.000 73.000 - 204.17% -
456.hmmer (max) (percentage) 80.00% 0.300 0.540 - -20.59% -
447.dealII (unexplained diff vs previous) 45.45% 121.000 176.000 - 2414.29% -
447.dealII (unexplained diff vs previous) (percentage) 45.27% 1.480 2.150 - 451.28% -
464.h264ref (max) 41.67% 60.000 85.000 - 750.00% -
464.h264ref (unexplained diff vs previous) 41.67% 60.000 85.000 - 1316.67% -
464.h264ref (max) (percentage) 41.03% 0.390 0.550 - 189.47% -
447.dealII (max) 38.76% 129.000 179.000 - 1018.75% -
447.dealII (max) (percentage) 38.61% 1.580 2.190 - 140.66% -
464.h264ref (unexplained diff vs previous) (percentage) 38.46% 0.390 0.540 - 390.91% -
456.hmmer 37.50% 48.000 66.000 - 288.24% -
456.hmmer (avg) 37.50% 48.000 66.000 - 288.24% -
456.hmmer (avg) (percentage) 36.11% 0.360 0.490 - 2.08% -
456.hmmer (unexplained diff vs previous) 33.33% 9.000 12.000 - 50.00% -
453.povray (max) 30.30% 132.000 172.000 - 1811.11% -
453.povray (unexplained diff vs previous) 29.23% 130.000 168.000 - 0.00% -
453.povray (max) (percentage) 29.02% 1.930 2.490 - 22.66% -
456.hmmer (unexplained diff vs previous) (percentage) 28.57% 0.070 0.090 - -60.87% -
453.povray (unexplained diff vs previous) (percentage) 27.89% 1.900 2.430 - 0.00% -
429.mcf (max) (percentage) 26.79% 0.560 0.710 - -50.00% -
429.mcf (unexplained diff vs previous) (percentage) 26.79% 0.560 0.710 - -49.29% -
429.mcf (max) 25.37% 67.000 84.000 - 425.00% -
429.mcf (unexplained diff vs previous) 25.37% 67.000 84.000 - 425.00% -
482.sphinx3 (max) 19.82% 873.000 1046.000 - 17333.33% -
403.gcc (max) 17.65% 34.000 40.000 - 900.00% -
483.xalancbmk (avg) (percentage) 16.00% 0.500 0.580 - -56.39% -
482.sphinx3 (max) (percentage) 15.96% 3.320 3.850 - 406.58% -
403.gcc (max) (percentage) 15.79% 0.380 0.440 - -94.72% -
483.xalancbmk 14.89% 47.000 54.000 - 0.00% -
483.xalancbmk (avg) 14.89% 47.000 54.000 - 0.00% -
433.milc (max) 14.13% 184.000 210.000 - 3400.00% -
433.milc (unexplained diff vs previous) (percentage) 14.07% 1.350 1.540 - 250.00% -
433.milc (max) (percentage) 13.87% 1.370 1.560 - 168.97% -
458.sjeng (avg) (percentage) 13.79% 0.580 0.660 - 73.68% -
433.milc (unexplained diff vs previous) 13.74% 182.000 207.000 - 4040.00% -
403.gcc (unexplained diff vs previous) (percentage) 13.51% 0.370 0.420 - 0.00% -
458.sjeng 12.63% 95.000 107.000 - 245.16% -
458.sjeng (avg) 12.63% 95.000 107.000 - 245.16% -
403.gcc (unexplained diff vs previous) 11.76% 34.000 38.000 - 0.00% -
403.gcc 11.63% 43.000 48.000 - 2300.00% -
403.gcc (avg) 11.63% 43.000 48.000 - 2300.00% -
403.gcc (avg) (percentage) 10.42% 0.480 0.530 - -86.51% -
462.libquantum (avg) (percentage) 6.67% 0.150 0.160 - -90.06% -
483.xalancbmk (max) (percentage) 6.15% 0.650 0.690 - 2.99% -
447.dealII 5.83% 120.000 127.000 - 1054.55% -
447.dealII (avg) 5.83% 120.000 127.000 - 1054.55% -
447.dealII (avg) (percentage) 5.44% 1.470 1.550 - 134.85% -
462.libquantum 5.26% 19.000 20.000 - 1900.00% -
462.libquantum (avg) 5.26% 19.000 20.000 - 1900.00% -
483.xalancbmk (max) 4.92% 61.000 64.000 - 0.00% -
401.bzip2 (avg) (percentage) 4.55% 0.220 0.230 - -52.08% -
401.bzip2 2.94% 34.000 35.000 - 191.67% -
401.bzip2 (avg) 2.94% 34.000 35.000 - 191.67% -
429.mcf (avg) (percentage) 2.22% 0.450 0.460 - -67.14% -
429.mcf 1.89% 53.000 54.000 - 237.50% -
429.mcf (avg) 1.89% 53.000 54.000 - 237.50% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
450.soplex -1.44% 198708.000 195841.000 - -3.27% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
429.mcf -1.21% 11999.000 11854.000 - 936.19% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
471.omnetpp (unexplained diff vs previous) -96.74% 92.000 3.000 - -85.00% -
471.omnetpp (unexplained diff vs previous) (percentage) -96.51% 0.860 0.030 - -95.77% -
470.lbm (unexplained diff vs previous) (percentage) -94.97% 3.580 0.180 - -85.83% -
470.lbm (unexplained diff vs previous) -94.77% 497.000 26.000 - -35.00% -
473.astar (unexplained diff vs previous) (percentage) -94.74% 0.760 0.040 - -90.70% -
473.astar (unexplained diff vs previous) -94.44% 108.000 6.000 - -71.43% -
462.libquantum (unexplained diff vs previous) -93.75% 16.000 1.000 - 0.00% -
462.libquantum (unexplained diff vs previous) (percentage) -91.67% 0.120 0.010 - 0.00% -
482.sphinx3 (unexplained diff vs previous) (percentage) -85.47% 3.440 0.500 - 0.00% -
482.sphinx3 (unexplained diff vs previous) -85.07% 904.000 135.000 - 0.00% -
445.gobmk (unexplained diff vs previous) (percentage) -70.83% 0.240 0.070 - 0.00% -
445.gobmk (unexplained diff vs previous) -70.00% 30.000 9.000 - 0.00% -
471.omnetpp (max) -64.02% 189.000 68.000 - 78.95% -
471.omnetpp (max) (percentage) -63.64% 1.760 0.640 - -52.59% -
470.lbm (max) (percentage) -52.53% 5.540 2.630 - 108.73% -
470.lbm (max) -51.37% 769.000 374.000 - 858.97% -
401.bzip2 (max) -50.00% 48.000 24.000 - 20.00% -
401.bzip2 (unexplained diff vs previous) -48.98% 49.000 25.000 - 0.00% -
401.bzip2 (max) (percentage) -48.39% 0.310 0.160 - -79.49% -
401.bzip2 (unexplained diff vs previous) (percentage) -48.39% 0.310 0.160 - 0.00% -
471.omnetpp -34.94% 83.000 54.000 - 42.11% -
471.omnetpp (avg) -34.94% 83.000 54.000 - 42.11% -
471.omnetpp (avg) (percentage) -34.62% 0.780 0.510 - -62.22% -
450.soplex (max) -30.49% 82.000 57.000 - 338.46% -
450.soplex (max) (percentage) -29.82% 0.570 0.400 - -84.19% -
450.soplex (unexplained diff vs previous) (percentage) -29.82% 0.570 0.400 - -64.91% -
450.soplex (unexplained diff vs previous) -29.27% 82.000 58.000 - 866.67% -
458.sjeng (max) -27.69% 65.000 47.000 - -28.79% -
458.sjeng (max) (percentage) -27.50% 0.400 0.290 - -64.20% -
445.gobmk (max) (percentage) -20.83% 0.240 0.190 - 18.75% -
445.gobmk (max) -20.69% 29.000 23.000 - 187.50% -
470.lbm (avg) (percentage) -17.67% 2.320 1.910 - 161.64% -
473.astar (max) -17.54% 114.000 94.000 - 276.00% -
473.astar (max) (percentage) -17.50% 0.800 0.660 - 24.53% -
470.lbm -15.53% 322.000 272.000 - 1136.36% -
470.lbm (avg) -15.53% 322.000 272.000 - 1136.36% -
462.libquantum (max) -15.38% 26.000 22.000 - 1000.00% -
462.libquantum (max) (percentage) -15.00% 0.200 0.170 - -94.01% -
473.astar -14.08% 71.000 61.000 - 79.41% -
473.astar (avg) -14.08% 71.000 61.000 - 79.41% -
473.astar (avg) (percentage) -14.00% 0.500 0.430 - -39.44% -
445.gobmk -9.09% 22.000 20.000 - 33.33% -
445.gobmk (avg) -9.09% 22.000 20.000 - 33.33% -
444.namd -7.39% 514.000 476.000 - 7833.33% -
444.namd (avg) -7.39% 514.000 476.000 - 7833.33% -
444.namd (avg) (percentage) -7.35% 3.810 3.530 - 267.71% -
482.sphinx3 (avg) (percentage) -5.91% 1.860 1.750 - 108.33% -
450.soplex (avg) (percentage) -5.56% 0.360 0.340 - -69.09% -
483.xalancbmk (unexplained diff vs previous) -4.92% 61.000 58.000 - 0.00% -
483.xalancbmk (unexplained diff vs previous) (percentage) -4.62% 0.650 0.620 - 0.00% -
458.sjeng (unexplained diff vs previous) (percentage) -4.00% 0.250 0.240 - -67.12% -
450.soplex -3.92% 51.000 49.000 - 880.00% -
450.soplex (avg) -3.92% 51.000 49.000 - 880.00% -
482.sphinx3 -2.86% 489.000 475.000 - 6685.71% -
482.sphinx3 (avg) -2.86% 489.000 475.000 - 6685.71% -
444.namd (max) (percentage) -2.75% 6.540 6.360 - 315.69% -
444.namd (max) -2.72% 882.000 858.000 - 8480.00% -
444.namd (unexplained diff vs previous) (percentage) -2.61% 6.140 5.980 - 285.81% -
458.sjeng (unexplained diff vs previous) -2.44% 41.000 40.000 - -33.33% -
444.namd (unexplained diff vs previous) -2.42% 828.000 808.000 - 7245.45% -
433.milc -1.47% 136.000 134.000 - 2133.33% -
433.milc (avg) -1.47% 136.000 134.000 - 2133.33% -

Report Time: 0.34s
Execution (seconds)
Name Current %
401.bzip2 15573.000 479.35%
403.gcc 9142.000 16225.00%
429.mcf 11854.000 936.19%
433.milc 13484.000 1084.89%
444.namd 13504.000 1807.34%
445.gobmk 12305.000 135.77%
447.dealII 8198.000 357.73%
450.soplex 14415.000 2630.11%
453.povray 6910.000 1398.92%
456.hmmer 13617.000 283.47%
458.sjeng 16363.000 97.93%
462.libquantum 13108.000 13275.51%
464.h264ref 15601.000 180.44%
470.lbm 14256.000 354.01%
471.omnetpp 10741.000 278.87%
473.astar 14280.000 191.96%
482.sphinx3 27189.000 2989.66%
483.xalancbmk 9409.000 -
Geometric Mean 12744.780 835.00%
Code Size (bytes)
Name Current %
401.bzip2 39618.000 -4.50%
403.gcc 1962506.000 -
429.mcf 7935.000 -
433.milc 74971.000 2.88%
444.namd 175704.000 2.02%
445.gobmk 1312188.000 -
447.dealII 1771704.000 1.87%
450.soplex 195841.000 -3.27%
453.povray 593305.000 2.37%
456.hmmer 168248.000 -
458.sjeng 97974.000 1.11%
462.libquantum 26720.000 11.00%
464.h264ref 354994.000 1.47%
470.lbm 9739.000 -
471.omnetpp 373527.000 -1.20%
473.astar 23256.000 -
482.sphinx3 115832.000 -
483.xalancbmk 2286989.000 -
Geometric Mean 164396.717 17.77%
Score
Name Current %
nb_compile_successful 19.000 -47.22%
nb_execution_successful 18.000 -47.06%
nb_total_tests 19.000 -52.50%
Geometric Mean 18.661 -48.99%
sample variability
Name Current %
401.bzip2 35.000 191.67%
401.bzip2 (avg) 35.000 191.67%
401.bzip2 (avg) (percentage) 0.230 -52.08%
401.bzip2 (max) 24.000 20.00%
401.bzip2 (max) (percentage) 0.160 -79.49%
401.bzip2 (unexplained diff vs previous) 25.000 -
401.bzip2 (unexplained diff vs previous) (percentage) 0.160 -
403.gcc 48.000 2300.00%
403.gcc (avg) 48.000 2300.00%
403.gcc (avg) (percentage) 0.530 -86.51%
403.gcc (max) 40.000 900.00%
403.gcc (max) (percentage) 0.440 -94.72%
403.gcc (unexplained diff vs previous) 38.000 -
403.gcc (unexplained diff vs previous) (percentage) 0.420 -
429.mcf 54.000 237.50%
429.mcf (avg) 54.000 237.50%
429.mcf (avg) (percentage) 0.460 -67.14%
429.mcf (max) 84.000 425.00%
429.mcf (max) (percentage) 0.710 -50.00%
429.mcf (unexplained diff vs previous) 84.000 425.00%
429.mcf (unexplained diff vs previous) (percentage) 0.710 -49.29%
433.milc 134.000 2133.33%
433.milc (avg) 134.000 2133.33%
433.milc (avg) (percentage) 1.000 78.57%
433.milc (max) 210.000 3400.00%
433.milc (max) (percentage) 1.560 168.97%
433.milc (unexplained diff vs previous) 207.000 4040.00%
433.milc (unexplained diff vs previous) (percentage) 1.540 250.00%
444.namd 476.000 7833.33%
444.namd (avg) 476.000 7833.33%
444.namd (avg) (percentage) 3.530 267.71%
444.namd (max) 858.000 8480.00%
444.namd (max) (percentage) 6.360 315.69%
444.namd (unexplained diff vs previous) 808.000 7245.45%
444.namd (unexplained diff vs previous) (percentage) 5.980 285.81%
445.gobmk 20.000 33.33%
445.gobmk (avg) 20.000 33.33%
445.gobmk (avg) (percentage) 0.170 -43.33%
445.gobmk (max) 23.000 187.50%
445.gobmk (max) (percentage) 0.190 18.75%
445.gobmk (unexplained diff vs previous) 9.000 -
445.gobmk (unexplained diff vs previous) (percentage) 0.070 -
447.dealII 127.000 1054.55%
447.dealII (avg) 127.000 1054.55%
447.dealII (avg) (percentage) 1.550 134.85%
447.dealII (max) 179.000 1018.75%
447.dealII (max) (percentage) 2.190 140.66%
447.dealII (unexplained diff vs previous) 176.000 2414.29%
447.dealII (unexplained diff vs previous) (percentage) 2.150 451.28%
450.soplex 49.000 880.00%
450.soplex (avg) 49.000 880.00%
450.soplex (avg) (percentage) 0.340 -69.09%
450.soplex (max) 57.000 338.46%
450.soplex (max) (percentage) 0.400 -84.19%
450.soplex (unexplained diff vs previous) 58.000 866.67%
450.soplex (unexplained diff vs previous) (percentage) 0.400 -64.91%
453.povray 93.000 2225.00%
453.povray (avg) 93.000 2225.00%
453.povray (avg) (percentage) 1.360 32.04%
453.povray (max) 172.000 1811.11%
453.povray (max) (percentage) 2.490 22.66%
453.povray (unexplained diff vs previous) 168.000 -
453.povray (unexplained diff vs previous) (percentage) 2.430 -
456.hmmer 66.000 288.24%
456.hmmer (avg) 66.000 288.24%
456.hmmer (avg) (percentage) 0.490 2.08%
456.hmmer (max) 73.000 204.17%
456.hmmer (max) (percentage) 0.540 -20.59%
456.hmmer (unexplained diff vs previous) 12.000 50.00%
456.hmmer (unexplained diff vs previous) (percentage) 0.090 -60.87%
458.sjeng 107.000 245.16%
458.sjeng (avg) 107.000 245.16%
458.sjeng (avg) (percentage) 0.660 73.68%
458.sjeng (max) 47.000 -28.79%
458.sjeng (max) (percentage) 0.290 -64.20%
458.sjeng (unexplained diff vs previous) 40.000 -33.33%
458.sjeng (unexplained diff vs previous) (percentage) 0.240 -67.12%
462.libquantum 20.000 1900.00%
462.libquantum (avg) 20.000 1900.00%
462.libquantum (avg) (percentage) 0.160 -90.06%
462.libquantum (max) 22.000 1000.00%
462.libquantum (max) (percentage) 0.170 -94.01%
462.libquantum (unexplained diff vs previous) 1.000 -
462.libquantum (unexplained diff vs previous) (percentage) 0.010 -
464.h264ref 51.000 183.33%
464.h264ref (avg) 51.000 183.33%
464.h264ref (avg) (percentage) 0.330 -
464.h264ref (max) 85.000 750.00%
464.h264ref (max) (percentage) 0.550 189.47%
464.h264ref (unexplained diff vs previous) 85.000 1316.67%
464.h264ref (unexplained diff vs previous) (percentage) 0.540 390.91%
470.lbm 272.000 1136.36%
470.lbm (avg) 272.000 1136.36%
470.lbm (avg) (percentage) 1.910 161.64%
470.lbm (max) 374.000 858.97%
470.lbm (max) (percentage) 2.630 108.73%
470.lbm (unexplained diff vs previous) 26.000 -35.00%
470.lbm (unexplained diff vs previous) (percentage) 0.180 -85.83%
471.omnetpp 54.000 42.11%
471.omnetpp (avg) 54.000 42.11%
471.omnetpp (avg) (percentage) 0.510 -62.22%
471.omnetpp (max) 68.000 78.95%
471.omnetpp (max) (percentage) 0.640 -52.59%
471.omnetpp (unexplained diff vs previous) 3.000 -85.00%
471.omnetpp (unexplained diff vs previous) (percentage) 0.030 -95.77%
473.astar 61.000 79.41%
473.astar (avg) 61.000 79.41%
473.astar (avg) (percentage) 0.430 -39.44%
473.astar (max) 94.000 276.00%
473.astar (max) (percentage) 0.660 24.53%
473.astar (unexplained diff vs previous) 6.000 -71.43%
473.astar (unexplained diff vs previous) (percentage) 0.040 -90.70%
482.sphinx3 475.000 6685.71%
482.sphinx3 (avg) 475.000 6685.71%
482.sphinx3 (avg) (percentage) 1.750 108.33%
482.sphinx3 (max) 1046.000 17333.33%
482.sphinx3 (max) (percentage) 3.850 406.58%
482.sphinx3 (unexplained diff vs previous) 135.000 -
482.sphinx3 (unexplained diff vs previous) (percentage) 0.500 -
483.xalancbmk 54.000 -
483.xalancbmk (avg) 54.000 -
483.xalancbmk (avg) (percentage) 0.580 -56.39%
483.xalancbmk (max) 64.000 -
483.xalancbmk (max) (percentage) 0.690 2.99%
483.xalancbmk (unexplained diff vs previous) 58.000 -
483.xalancbmk (unexplained diff vs previous) (percentage) 0.620 -
Geometric Mean 8.524 184.96%