Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/ea2ed80e6dac21bf19d87de8bef1ec01b00dbb8d (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk_ci_llvm-build-tcwg_bmk_apm-llvm-master-aarch64-spec2k6-Oz_LTO/330/
View Options
Report
Filter

llvm-aarch64-master-Oz_LTO test results

Run Order Start Time Duration
Current 0330 (no-change) 2022-10-06T02:17:20 0:00:00
Previous 0329 (llvmorg-21-init-10512-ga76936f1c01c) 2025-04-30T02:25:12 0:00:00
Baseline 0001 (llvmorg-16-init-17110-gb1256f2345f6) 2022-12-17T20:51:03 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 93 95
Performance Improvements 59 19
Added Tests 19 30
Unchanged Tests 909 936
Total Tests 1080

Run-Over-Run Changes Detail

Performance Regressions - Code Size Δ Previous Current σ Δ (B) σ (B)
444.namd 6.81% 134655.000 143829.000 - 0.28% -
464.h264ref 3.98% 384807.000 400126.000 - 0.04% -
447.dealII 3.33% 315074.000 325579.000 - 0.11% -
403.gcc 3.14% 2413957.000 2489749.000 - 0.11% -
453.povray 3.02% 671911.000 692210.000 - 0.10% -
482.sphinx3 2.43% 117597.000 120454.000 - 0.17% -
462.libquantum 2.10% 16652.000 17001.000 - 0.07% -
400.perlbench 2.08% 882838.000 901163.000 - 0.10% -
456.hmmer 1.88% 111592.000 113689.000 - 0.07% -
473.astar 1.83% 23636.000 24068.000 - 1.17% -
458.sjeng 1.82% 105124.000 107040.000 - 0.16% -
433.milc 1.75% 62066.000 63155.000 - 0.46% -
471.omnetpp 1.72% 481912.000 490199.000 - 0.01% -
445.gobmk 1.64% 1821058.000 1850859.000 - 0.03% -
401.bzip2 1.60% 43696.000 44397.000 - 0.09% -
470.lbm 1.31% 10140.000 10273.000 - -0.39% -
450.soplex 1.26% 221522.000 224319.000 - -0.04% -

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
403.gcc 14115.28% 72.000 10235.000 - 0.84% -
462.libquantum 11735.35% 99.000 11717.000 - 21.31% -
482.sphinx3 3351.30% 805.000 27783.000 - 16.84% -
450.soplex 2637.60% 516.000 14126.000 - 0.99% -
444.namd 1393.40% 667.000 9961.000 - 6.23% -
453.povray 1336.08% 510.000 7324.000 - 0.32% -
433.milc 1111.34% 1226.000 14851.000 - 1.79% -
429.mcf 867.81% 1814.000 17556.000 - -7.14% -
400.perlbench 553.02% 1922.000 12551.000 - 13.23% -
447.dealII 407.35% 1919.000 9736.000 - 6.97% -
471.omnetpp 374.78% 2863.000 13593.000 - 14.06% -
401.bzip2 363.44% 2713.000 12573.000 - -9.95% -
470.lbm 319.68% 3165.000 13283.000 - 20.25% -
456.hmmer 280.46% 2917.000 11098.000 - 21.66% -
464.h264ref 214.69% 4364.000 13733.000 - 13.10% -
473.astar 203.58% 4914.000 14918.000 - 12.16% -
445.gobmk 136.11% 5439.000 12842.000 - 10.06% -
458.sjeng 95.14% 7441.000 14520.000 - -4.99% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
444.namd (max) 14640.00% 5.000 737.000 - 51.96% -
444.namd (unexplained diff vs previous) 11333.33% 6.000 686.000 - 0.00% -
433.milc (unexplained diff vs previous) 5583.33% 6.000 341.000 - 11266.67% -
444.namd 5100.00% 5.000 260.000 - 22.07% -
444.namd (avg) 5100.00% 5.000 260.000 - 22.07% -
403.gcc 3200.00% 1.000 33.000 - 6.45% -
403.gcc (avg) 3200.00% 1.000 33.000 - 6.45% -
403.gcc (max) 2250.00% 2.000 47.000 - 17.50% -
433.milc (max) 1731.58% 19.000 348.000 - 29.37% -
482.sphinx3 1700.00% 16.000 288.000 - 33.33% -
482.sphinx3 (avg) 1700.00% 16.000 288.000 - 33.33% -
456.hmmer (max) 1377.78% 9.000 133.000 - 95.59% -
456.hmmer (unexplained diff vs previous) 1366.67% 9.000 132.000 - 0.00% -
433.milc 1153.85% 13.000 163.000 - 34.71% -
433.milc (avg) 1153.85% 13.000 163.000 - 34.71% -
445.gobmk (unexplained diff vs previous) 977.78% 9.000 97.000 - 0.00% -
453.povray 900.00% 6.000 60.000 - 13.21% -
453.povray (avg) 900.00% 6.000 60.000 - 13.21% -
456.hmmer 872.73% 11.000 107.000 - 33.75% -
456.hmmer (avg) 872.73% 11.000 107.000 - 33.75% -
453.povray (max) 746.15% 13.000 110.000 - 42.86% -
444.namd (max) (percentage) 731.46% 0.890 7.400 - 42.86% -
450.soplex (max) 718.52% 27.000 221.000 - 44.44% -
482.sphinx3 (max) 669.23% 26.000 200.000 - 21.95% -
444.namd (unexplained diff vs previous) (percentage) 665.56% 0.900 6.890 - 0.00% -
462.libquantum 600.00% 2.000 14.000 - 40.00% -
462.libquantum (avg) 600.00% 2.000 14.000 - 40.00% -
447.dealII (max) 458.62% 29.000 162.000 - 28.57% -
450.soplex 450.00% 16.000 88.000 - 17.33% -
450.soplex (avg) 450.00% 16.000 88.000 - 17.33% -
447.dealII 433.33% 18.000 96.000 - 17.07% -
447.dealII (avg) 433.33% 18.000 96.000 - 17.07% -
433.milc (unexplained diff vs previous) (percentage) 369.39% 0.490 2.300 - 11400.00% -
445.gobmk (unexplained diff vs previous) (percentage) 347.06% 0.170 0.760 - 0.00% -
482.sphinx3 (unexplained diff vs previous) 284.00% 25.000 96.000 - -40.74% -
456.hmmer (unexplained diff vs previous) (percentage) 283.87% 0.310 1.190 - 0.00% -
456.hmmer (max) (percentage) 263.64% 0.330 1.200 - 60.00% -
429.mcf (unexplained diff vs previous) 256.00% 25.000 89.000 - 0.00% -
444.namd (avg) (percentage) 235.90% 0.780 2.620 - 14.91% -
470.lbm 158.82% 34.000 88.000 - 37.50% -
470.lbm (avg) 158.82% 34.000 88.000 - 37.50% -
456.hmmer (avg) (percentage) 148.72% 0.390 0.970 - 10.23% -
483.xalancbmk (max) (percentage) 70.27% 0.370 0.630 - 23.53% -
433.milc (max) (percentage) 46.88% 1.600 2.350 - 27.03% -
471.omnetpp 41.82% 55.000 78.000 - 9.86% -
471.omnetpp (avg) 41.82% 55.000 78.000 - 9.86% -
445.gobmk (max) 32.88% 73.000 97.000 - 38.57% -
464.h264ref 30.23% 43.000 56.000 - 27.27% -
464.h264ref (avg) 30.23% 43.000 56.000 - 27.27% -
471.omnetpp (max) 18.18% 88.000 104.000 - -12.61% -
458.sjeng (unexplained diff vs previous) 12.12% 33.000 37.000 - 0.00% -
447.dealII (max) (percentage) 9.15% 1.530 1.670 - 20.14% -
483.xalancbmk (avg) (percentage) 6.98% 0.430 0.460 - 6.98% -
433.milc (avg) (percentage) 2.80% 1.070 1.100 - 32.53% -
447.dealII (avg) (percentage) 2.06% 0.970 0.990 - 8.79% -

Performance Regressions - Score Δ Previous Current σ Δ (B) σ (B)
nb_total_tests -38.71% 31.000 19.000 - 0.00% -
nb_compile_successful -29.63% 27.000 19.000 - 0.00% -
nb_execution_successful -29.63% 27.000 19.000 - 0.00% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
401.bzip2 (unexplained diff vs previous) (percentage) -99.86% 7.300 0.010 - 0.00% -
462.libquantum (unexplained diff vs previous) (percentage) -99.72% 7.070 0.020 - 0.00% -
401.bzip2 (unexplained diff vs previous) -99.49% 198.000 1.000 - 0.00% -
462.libquantum (max) (percentage) -99.24% 6.600 0.050 - 25.00% -
401.bzip2 (max) (percentage) -99.11% 7.870 0.070 - 40.00% -
473.astar (max) (percentage) -98.31% 5.310 0.090 - 12.50% -
429.mcf (max) (percentage) -97.02% 17.140 0.510 - 41.67% -
473.astar (unexplained diff vs previous) (percentage) -96.39% 0.830 0.030 - 0.00% -
401.bzip2 (max) -96.24% 213.000 8.000 - 33.33% -
462.libquantum (avg) (percentage) -95.67% 2.770 0.120 - 9.09% -
473.astar (avg) (percentage) -95.58% 1.810 0.080 - 14.29% -
473.astar (max) -95.00% 260.000 13.000 - 30.00% -
470.lbm (max) (percentage) -94.71% 1.700 0.090 - 50.00% -
429.mcf (avg) (percentage) -94.26% 6.790 0.390 - 5.41% -
400.perlbench (max) (percentage) -90.70% 3.440 0.320 - -54.29% -
401.bzip2 (avg) (percentage) -89.58% 0.960 0.100 - 0.00% -
400.perlbench (avg) (percentage) -89.43% 2.650 0.280 - -45.10% -
482.sphinx3 (unexplained diff vs previous) (percentage) -88.75% 3.110 0.350 - -48.53% -
473.astar (unexplained diff vs previous) -87.80% 41.000 5.000 - 0.00% -
473.astar -87.50% 88.000 11.000 - 22.22% -
473.astar (avg) -87.50% 88.000 11.000 - 22.22% -
403.gcc (avg) (percentage) -87.16% 2.570 0.330 - 6.45% -
403.gcc (max) (percentage) -86.78% 3.480 0.460 - 15.00% -
464.h264ref (max) (percentage) -85.84% 2.330 0.330 - 22.22% -
470.lbm (unexplained diff vs previous) (percentage) -85.00% 0.600 0.090 - 0.00% -
450.soplex (avg) (percentage) -80.56% 3.240 0.630 - 16.67% -
470.lbm (max) -79.25% 53.000 11.000 - 83.33% -
482.sphinx3 (max) (percentage) -77.98% 3.270 0.720 - 4.35% -
471.omnetpp (max) (percentage) -75.00% 3.080 0.770 - -23.00% -
462.libquantum (unexplained diff vs previous) -71.43% 7.000 2.000 - 0.00% -
429.mcf (max) -71.29% 310.000 89.000 - 30.88% -
450.soplex (max) (percentage) -70.54% 5.330 1.570 - 42.73% -
471.omnetpp (avg) (percentage) -70.10% 1.940 0.580 - -3.33% -
458.sjeng (max) (percentage) -68.48% 0.920 0.290 - 26.09% -
429.mcf (unexplained diff vs previous) (percentage) -63.04% 1.380 0.510 - 0.00% -
445.gobmk (avg) (percentage) -59.76% 0.820 0.330 - 3.13% -
464.h264ref (avg) (percentage) -58.59% 0.990 0.410 - 10.81% -
464.h264ref (max) -55.45% 101.000 45.000 - 40.62% -
458.sjeng (avg) (percentage) -54.39% 0.570 0.260 - 13.04% -
401.bzip2 -53.85% 26.000 12.000 - -7.69% -
401.bzip2 (avg) -53.85% 26.000 12.000 - -7.69% -
482.sphinx3 (avg) (percentage) -48.77% 2.030 1.040 - 14.29% -
429.mcf -44.72% 123.000 68.000 - -1.45% -
429.mcf (avg) -44.72% 123.000 68.000 - -1.45% -
445.gobmk (max) (percentage) -44.12% 1.360 0.760 - 26.67% -
458.sjeng (unexplained diff vs previous) (percentage) -43.18% 0.440 0.250 - 0.00% -
453.povray (max) (percentage) -42.15% 2.610 1.510 - 42.45% -
400.perlbench (max) -39.39% 66.000 40.000 - -48.05% -
470.lbm (avg) (percentage) -39.09% 1.100 0.670 - 15.52% -
453.povray (avg) (percentage) -38.52% 1.350 0.830 - 13.70% -
458.sjeng (max) -38.24% 68.000 42.000 - 20.00% -
470.lbm (unexplained diff vs previous) -36.84% 19.000 12.000 - 0.00% -
400.perlbench -30.00% 50.000 35.000 - -37.50% -
400.perlbench (avg) -30.00% 50.000 35.000 - -37.50% -
462.libquantum (max) -16.67% 6.000 5.000 - 66.67% -
458.sjeng -11.90% 42.000 37.000 - 5.71% -
458.sjeng (avg) -11.90% 42.000 37.000 - 5.71% -
445.gobmk -4.55% 44.000 42.000 - 13.51% -
445.gobmk (avg) -4.55% 44.000 42.000 - 13.51% -

Added Tests - Code Size
483.xalancbmk

Added Tests - Execution
483.xalancbmk

Added Tests - sample variability
403.gcc (unexplained diff vs previous)
403.gcc (unexplained diff vs previous) (percentage)
447.dealII (unexplained diff vs previous)
447.dealII (unexplained diff vs previous) (percentage)
450.soplex (unexplained diff vs previous)
450.soplex (unexplained diff vs previous) (percentage)
453.povray (unexplained diff vs previous)
453.povray (unexplained diff vs previous) (percentage)
464.h264ref (unexplained diff vs previous)
464.h264ref (unexplained diff vs previous) (percentage)
471.omnetpp (unexplained diff vs previous)
471.omnetpp (unexplained diff vs previous) (percentage)
483.xalancbmk
483.xalancbmk (avg)
483.xalancbmk (max)
483.xalancbmk (unexplained diff vs previous)
483.xalancbmk (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
473.astar 1.17% 23789.000 24068.000 - 1.83% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
483.xalancbmk 24.19% 9633.000 11963.000 - 0.00% -
456.hmmer 21.66% 9122.000 11098.000 - 280.46% -
462.libquantum 21.31% 9659.000 11717.000 - 11735.35% -
470.lbm 20.25% 11046.000 13283.000 - 319.68% -
482.sphinx3 16.84% 23779.000 27783.000 - 3351.30% -
471.omnetpp 14.06% 11917.000 13593.000 - 374.78% -
400.perlbench 13.23% 11085.000 12551.000 - 553.02% -
464.h264ref 13.10% 12142.000 13733.000 - 214.69% -
473.astar 12.16% 13301.000 14918.000 - 203.58% -
445.gobmk 10.06% 11668.000 12842.000 - 136.11% -
447.dealII 6.97% 9102.000 9736.000 - 407.35% -
444.namd 6.23% 9377.000 9961.000 - 1393.40% -
433.milc 1.79% 14590.000 14851.000 - 1111.34% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
433.milc (unexplained diff vs previous) (percentage) 11400.00% 0.020 2.300 - 369.39% -
433.milc (unexplained diff vs previous) 11266.67% 3.000 341.000 - 5583.33% -
456.hmmer (max) 95.59% 68.000 133.000 - 1377.78% -
470.lbm (max) 83.33% 6.000 11.000 - -79.25% -
462.libquantum (max) 66.67% 3.000 5.000 - -16.67% -
456.hmmer (max) (percentage) 60.00% 0.750 1.200 - 263.64% -
483.xalancbmk (max) 53.06% 49.000 75.000 - 0.00% -
444.namd (max) 51.96% 485.000 737.000 - 14640.00% -
470.lbm (max) (percentage) 50.00% 0.060 0.090 - -94.71% -
450.soplex (max) 44.44% 153.000 221.000 - 718.52% -
444.namd (max) (percentage) 42.86% 5.180 7.400 - 731.46% -
453.povray (max) 42.86% 77.000 110.000 - 746.15% -
450.soplex (max) (percentage) 42.73% 1.100 1.570 - -70.54% -
453.povray (max) (percentage) 42.45% 1.060 1.510 - -42.15% -
429.mcf (max) (percentage) 41.67% 0.360 0.510 - -97.02% -
464.h264ref (max) 40.62% 32.000 45.000 - -55.45% -
401.bzip2 (max) (percentage) 40.00% 0.050 0.070 - -99.11% -
462.libquantum 40.00% 10.000 14.000 - 600.00% -
462.libquantum (avg) 40.00% 10.000 14.000 - 600.00% -
445.gobmk (max) 38.57% 70.000 97.000 - 32.88% -
470.lbm 37.50% 64.000 88.000 - 158.82% -
470.lbm (avg) 37.50% 64.000 88.000 - 158.82% -
433.milc 34.71% 121.000 163.000 - 1153.85% -
433.milc (avg) 34.71% 121.000 163.000 - 1153.85% -
483.xalancbmk 34.15% 41.000 55.000 - 0.00% -
483.xalancbmk (avg) 34.15% 41.000 55.000 - 0.00% -
456.hmmer 33.75% 80.000 107.000 - 872.73% -
456.hmmer (avg) 33.75% 80.000 107.000 - 872.73% -
401.bzip2 (max) 33.33% 6.000 8.000 - -96.24% -
482.sphinx3 33.33% 216.000 288.000 - 1700.00% -
482.sphinx3 (avg) 33.33% 216.000 288.000 - 1700.00% -
433.milc (avg) (percentage) 32.53% 0.830 1.100 - 2.80% -
429.mcf (max) 30.88% 68.000 89.000 - -71.29% -
473.astar (max) 30.00% 10.000 13.000 - -95.00% -
433.milc (max) 29.37% 269.000 348.000 - 1731.58% -
447.dealII (max) 28.57% 126.000 162.000 - 458.62% -
464.h264ref 27.27% 44.000 56.000 - 30.23% -
464.h264ref (avg) 27.27% 44.000 56.000 - 30.23% -
433.milc (max) (percentage) 27.03% 1.850 2.350 - 46.88% -
445.gobmk (max) (percentage) 26.67% 0.600 0.760 - -44.12% -
458.sjeng (max) (percentage) 26.09% 0.230 0.290 - -68.48% -
462.libquantum (max) (percentage) 25.00% 0.040 0.050 - -99.24% -
483.xalancbmk (max) (percentage) 23.53% 0.510 0.630 - 70.27% -
464.h264ref (max) (percentage) 22.22% 0.270 0.330 - -85.84% -
473.astar 22.22% 9.000 11.000 - -87.50% -
473.astar (avg) 22.22% 9.000 11.000 - -87.50% -
444.namd 22.07% 213.000 260.000 - 5100.00% -
444.namd (avg) 22.07% 213.000 260.000 - 5100.00% -
482.sphinx3 (max) 21.95% 164.000 200.000 - 669.23% -
447.dealII (max) (percentage) 20.14% 1.390 1.670 - 9.15% -
458.sjeng (max) 20.00% 35.000 42.000 - -38.24% -
403.gcc (max) 17.50% 40.000 47.000 - 2250.00% -
450.soplex 17.33% 75.000 88.000 - 450.00% -
450.soplex (avg) 17.33% 75.000 88.000 - 450.00% -
447.dealII 17.07% 82.000 96.000 - 433.33% -
447.dealII (avg) 17.07% 82.000 96.000 - 433.33% -
450.soplex (avg) (percentage) 16.67% 0.540 0.630 - -80.56% -
470.lbm (avg) (percentage) 15.52% 0.580 0.670 - -39.09% -
403.gcc (max) (percentage) 15.00% 0.400 0.460 - -86.78% -
444.namd (avg) (percentage) 14.91% 2.280 2.620 - 235.90% -
482.sphinx3 (avg) (percentage) 14.29% 0.910 1.040 - -48.77% -
453.povray (avg) (percentage) 13.70% 0.730 0.830 - -38.52% -
445.gobmk 13.51% 37.000 42.000 - -4.55% -
445.gobmk (avg) 13.51% 37.000 42.000 - -4.55% -
453.povray 13.21% 53.000 60.000 - 900.00% -
453.povray (avg) 13.21% 53.000 60.000 - 900.00% -
458.sjeng (avg) (percentage) 13.04% 0.230 0.260 - -54.39% -
464.h264ref (avg) (percentage) 10.81% 0.370 0.410 - -58.59% -
456.hmmer (avg) (percentage) 10.23% 0.880 0.970 - 148.72% -
471.omnetpp 9.86% 71.000 78.000 - 41.82% -
471.omnetpp (avg) 9.86% 71.000 78.000 - 41.82% -
447.dealII (avg) (percentage) 8.79% 0.910 0.990 - 2.06% -
483.xalancbmk (avg) (percentage) 6.98% 0.430 0.460 - 6.98% -
403.gcc (avg) (percentage) 6.45% 0.310 0.330 - -87.16% -
403.gcc 6.45% 31.000 33.000 - 3200.00% -
403.gcc (avg) 6.45% 31.000 33.000 - 3200.00% -
458.sjeng 5.71% 35.000 37.000 - -11.90% -
458.sjeng (avg) 5.71% 35.000 37.000 - -11.90% -
429.mcf (avg) (percentage) 5.41% 0.370 0.390 - -94.26% -
482.sphinx3 (max) (percentage) 4.35% 0.690 0.720 - -77.98% -
445.gobmk (avg) (percentage) 3.13% 0.320 0.330 - -59.76% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
401.bzip2 -9.95% 13962.000 12573.000 - 363.44% -
429.mcf -7.14% 18905.000 17556.000 - 867.81% -
458.sjeng -4.99% 15282.000 14520.000 - 95.14% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
471.omnetpp (unexplained diff vs previous) (percentage) -68.32% 1.010 0.320 - 0.00% -
471.omnetpp (unexplained diff vs previous) -63.33% 120.000 44.000 - 0.00% -
400.perlbench (max) (percentage) -54.29% 0.700 0.320 - -90.70% -
482.sphinx3 (unexplained diff vs previous) (percentage) -48.53% 0.680 0.350 - -88.75% -
400.perlbench (max) -48.05% 77.000 40.000 - -39.39% -
400.perlbench (avg) (percentage) -45.10% 0.510 0.280 - -89.43% -
482.sphinx3 (unexplained diff vs previous) -40.74% 162.000 96.000 - 284.00% -
400.perlbench -37.50% 56.000 35.000 - -30.00% -
400.perlbench (avg) -37.50% 56.000 35.000 - -30.00% -
471.omnetpp (max) (percentage) -23.00% 1.000 0.770 - -75.00% -
471.omnetpp (max) -12.61% 119.000 104.000 - 18.18% -
401.bzip2 -7.69% 13.000 12.000 - -53.85% -
401.bzip2 (avg) -7.69% 13.000 12.000 - -53.85% -
471.omnetpp (avg) (percentage) -3.33% 0.600 0.580 - -70.10% -
429.mcf -1.45% 69.000 68.000 - -44.72% -
429.mcf (avg) -1.45% 69.000 68.000 - -44.72% -

Added Tests - sample variability
401.bzip2 (unexplained diff vs previous)
401.bzip2 (unexplained diff vs previous) (percentage)
403.gcc (unexplained diff vs previous)
403.gcc (unexplained diff vs previous) (percentage)
429.mcf (unexplained diff vs previous)
429.mcf (unexplained diff vs previous) (percentage)
444.namd (unexplained diff vs previous)
444.namd (unexplained diff vs previous) (percentage)
445.gobmk (unexplained diff vs previous)
445.gobmk (unexplained diff vs previous) (percentage)
447.dealII (unexplained diff vs previous)
447.dealII (unexplained diff vs previous) (percentage)
450.soplex (unexplained diff vs previous)
450.soplex (unexplained diff vs previous) (percentage)
453.povray (unexplained diff vs previous)
453.povray (unexplained diff vs previous) (percentage)
456.hmmer (unexplained diff vs previous)
456.hmmer (unexplained diff vs previous) (percentage)
458.sjeng (unexplained diff vs previous)
458.sjeng (unexplained diff vs previous) (percentage)
462.libquantum (unexplained diff vs previous)
462.libquantum (unexplained diff vs previous) (percentage)
464.h264ref (unexplained diff vs previous)
464.h264ref (unexplained diff vs previous) (percentage)
470.lbm (unexplained diff vs previous)
470.lbm (unexplained diff vs previous) (percentage)
473.astar (unexplained diff vs previous)
473.astar (unexplained diff vs previous) (percentage)
483.xalancbmk (unexplained diff vs previous)
483.xalancbmk (unexplained diff vs previous) (percentage)

Report Time: 0.38s
Execution (seconds)
Name Current %
400.perlbench 12551.000 553.02%
401.bzip2 12573.000 363.44%
403.gcc 10235.000 14115.28%
429.mcf 17556.000 867.81%
433.milc 14851.000 1111.34%
444.namd 9961.000 1393.40%
445.gobmk 12842.000 136.11%
447.dealII 9736.000 407.35%
450.soplex 14126.000 2637.60%
453.povray 7324.000 1336.08%
456.hmmer 11098.000 280.46%
458.sjeng 14520.000 95.14%
462.libquantum 11717.000 11735.35%
464.h264ref 13733.000 214.69%
470.lbm 13283.000 319.68%
471.omnetpp 13593.000 374.78%
473.astar 14918.000 203.58%
482.sphinx3 27783.000 3351.30%
483.xalancbmk 11963.000 -
Geometric Mean 12898.437 811.84%
Code Size (bytes)
Name Current %
400.perlbench 901163.000 2.08%
401.bzip2 44397.000 1.60%
403.gcc 2489749.000 3.14%
429.mcf 9249.000 -
433.milc 63155.000 1.75%
444.namd 143829.000 6.81%
445.gobmk 1850859.000 1.64%
447.dealII 325579.000 3.33%
450.soplex 224319.000 1.26%
453.povray 692210.000 3.02%
456.hmmer 113689.000 1.88%
458.sjeng 107040.000 1.82%
462.libquantum 17001.000 2.10%
464.h264ref 400126.000 3.98%
470.lbm 10273.000 1.31%
471.omnetpp 490199.000 1.72%
473.astar 24068.000 1.83%
482.sphinx3 120454.000 2.43%
483.xalancbmk 2540035.000 -
Geometric Mean 170048.877 18.93%
Score
Name Current %
nb_compile_successful 19.000 -29.63%
nb_execution_successful 19.000 -29.63%
nb_total_tests 19.000 -38.71%
Geometric Mean 19.000 -32.80%
sample variability
Name Current %
400.perlbench 35.000 -30.00%
400.perlbench (avg) 35.000 -30.00%
400.perlbench (avg) (percentage) 0.280 -89.43%
400.perlbench (max) 40.000 -39.39%
400.perlbench (max) (percentage) 0.320 -90.70%
401.bzip2 12.000 -53.85%
401.bzip2 (avg) 12.000 -53.85%
401.bzip2 (avg) (percentage) 0.100 -89.58%
401.bzip2 (max) 8.000 -96.24%
401.bzip2 (max) (percentage) 0.070 -99.11%
401.bzip2 (unexplained diff vs previous) 1.000 -99.49%
401.bzip2 (unexplained diff vs previous) (percentage) 0.010 -99.86%
403.gcc 33.000 3200.00%
403.gcc (avg) 33.000 3200.00%
403.gcc (avg) (percentage) 0.330 -87.16%
403.gcc (max) 47.000 2250.00%
403.gcc (max) (percentage) 0.460 -86.78%
403.gcc (unexplained diff vs previous) 7.000 -
403.gcc (unexplained diff vs previous) (percentage) 0.070 -
429.mcf 68.000 -44.72%
429.mcf (avg) 68.000 -44.72%
429.mcf (avg) (percentage) 0.390 -94.26%
429.mcf (max) 89.000 -71.29%
429.mcf (max) (percentage) 0.510 -97.02%
429.mcf (unexplained diff vs previous) 89.000 256.00%
429.mcf (unexplained diff vs previous) (percentage) 0.510 -63.04%
433.milc 163.000 1153.85%
433.milc (avg) 163.000 1153.85%
433.milc (avg) (percentage) 1.100 2.80%
433.milc (max) 348.000 1731.58%
433.milc (max) (percentage) 2.350 46.88%
433.milc (unexplained diff vs previous) 341.000 5583.33%
433.milc (unexplained diff vs previous) (percentage) 2.300 369.39%
444.namd 260.000 5100.00%
444.namd (avg) 260.000 5100.00%
444.namd (avg) (percentage) 2.620 235.90%
444.namd (max) 737.000 14640.00%
444.namd (max) (percentage) 7.400 731.46%
444.namd (unexplained diff vs previous) 686.000 11333.33%
444.namd (unexplained diff vs previous) (percentage) 6.890 665.56%
445.gobmk 42.000 -4.55%
445.gobmk (avg) 42.000 -4.55%
445.gobmk (avg) (percentage) 0.330 -59.76%
445.gobmk (max) 97.000 32.88%
445.gobmk (max) (percentage) 0.760 -44.12%
445.gobmk (unexplained diff vs previous) 97.000 977.78%
445.gobmk (unexplained diff vs previous) (percentage) 0.760 347.06%
447.dealII 96.000 433.33%
447.dealII (avg) 96.000 433.33%
447.dealII (avg) (percentage) 0.990 2.06%
447.dealII (max) 162.000 458.62%
447.dealII (max) (percentage) 1.670 9.15%
447.dealII (unexplained diff vs previous) 160.000 -
447.dealII (unexplained diff vs previous) (percentage) 1.640 -
450.soplex 88.000 450.00%
450.soplex (avg) 88.000 450.00%
450.soplex (avg) (percentage) 0.630 -80.56%
450.soplex (max) 221.000 718.52%
450.soplex (max) (percentage) 1.570 -70.54%
450.soplex (unexplained diff vs previous) 219.000 -
450.soplex (unexplained diff vs previous) (percentage) 1.550 -
453.povray 60.000 900.00%
453.povray (avg) 60.000 900.00%
453.povray (avg) (percentage) 0.830 -38.52%
453.povray (max) 110.000 746.15%
453.povray (max) (percentage) 1.510 -42.15%
453.povray (unexplained diff vs previous) 109.000 -
453.povray (unexplained diff vs previous) (percentage) 1.490 -
456.hmmer 107.000 872.73%
456.hmmer (avg) 107.000 872.73%
456.hmmer (avg) (percentage) 0.970 148.72%
456.hmmer (max) 133.000 1377.78%
456.hmmer (max) (percentage) 1.200 263.64%
456.hmmer (unexplained diff vs previous) 132.000 1366.67%
456.hmmer (unexplained diff vs previous) (percentage) 1.190 283.87%
458.sjeng 37.000 -11.90%
458.sjeng (avg) 37.000 -11.90%
458.sjeng (avg) (percentage) 0.260 -54.39%
458.sjeng (max) 42.000 -38.24%
458.sjeng (max) (percentage) 0.290 -68.48%
458.sjeng (unexplained diff vs previous) 37.000 12.12%
458.sjeng (unexplained diff vs previous) (percentage) 0.250 -43.18%
462.libquantum 14.000 600.00%
462.libquantum (avg) 14.000 600.00%
462.libquantum (avg) (percentage) 0.120 -95.67%
462.libquantum (max) 5.000 -16.67%
462.libquantum (max) (percentage) 0.050 -99.24%
462.libquantum (unexplained diff vs previous) 2.000 -71.43%
462.libquantum (unexplained diff vs previous) (percentage) 0.020 -99.72%
464.h264ref 56.000 30.23%
464.h264ref (avg) 56.000 30.23%
464.h264ref (avg) (percentage) 0.410 -58.59%
464.h264ref (max) 45.000 -55.45%
464.h264ref (max) (percentage) 0.330 -85.84%
464.h264ref (unexplained diff vs previous) 2.000 -
464.h264ref (unexplained diff vs previous) (percentage) 0.010 -
470.lbm 88.000 158.82%
470.lbm (avg) 88.000 158.82%
470.lbm (avg) (percentage) 0.670 -39.09%
470.lbm (max) 11.000 -79.25%
470.lbm (max) (percentage) 0.090 -94.71%
470.lbm (unexplained diff vs previous) 12.000 -36.84%
470.lbm (unexplained diff vs previous) (percentage) 0.090 -85.00%
471.omnetpp 78.000 41.82%
471.omnetpp (avg) 78.000 41.82%
471.omnetpp (avg) (percentage) 0.580 -70.10%
471.omnetpp (max) 104.000 18.18%
471.omnetpp (max) (percentage) 0.770 -75.00%
471.omnetpp (unexplained diff vs previous) 44.000 -
471.omnetpp (unexplained diff vs previous) (percentage) 0.320 -
473.astar 11.000 -87.50%
473.astar (avg) 11.000 -87.50%
473.astar (avg) (percentage) 0.080 -95.58%
473.astar (max) 13.000 -95.00%
473.astar (max) (percentage) 0.090 -98.31%
473.astar (unexplained diff vs previous) 5.000 -87.80%
473.astar (unexplained diff vs previous) (percentage) 0.030 -96.39%
482.sphinx3 288.000 1700.00%
482.sphinx3 (avg) 288.000 1700.00%
482.sphinx3 (avg) (percentage) 1.040 -48.77%
482.sphinx3 (max) 200.000 669.23%
482.sphinx3 (max) (percentage) 0.720 -77.98%
482.sphinx3 (unexplained diff vs previous) 96.000 284.00%
482.sphinx3 (unexplained diff vs previous) (percentage) 0.350 -88.75%
483.xalancbmk 55.000 -
483.xalancbmk (avg) 55.000 -
483.xalancbmk (avg) (percentage) 0.460 6.98%
483.xalancbmk (max) 75.000 -
483.xalancbmk (max) (percentage) 0.630 70.27%
483.xalancbmk (unexplained diff vs previous) 62.000 -
483.xalancbmk (unexplained diff vs previous) (percentage) 0.520 -
Geometric Mean 6.692 -5.66%