Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=e8723b48d9ebbc1d1dd21b2840326c8e871facd7 (unchanged)
git_gcc https://github.com/gcc-mirror/gcc/commit/9d20529d94b23275885f380d155fe8671ab5353a (+ 1 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=4b2a1b602fc1ade0de85084feb328203be3147c9 (unchanged)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/0c5b83b8e0d8ab9a82cb0bdbcc46a1e0ded4345e (unchanged)
regression GNU-1280
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-aarch64-master-Os_LTO-build/273/
View Options
Report
Filter

gnu-aarch64-master-Os_LTO test results

Run Order Start Time Duration
Current 0273 (basepoints/gcc-15-01945-g9d20529d94b) 2024-07-12T09:57:06 0:00:00
Previous 0272 (basepoints/gcc-15-01944-ge08ebd7d77a2) 2024-07-11T14:53:29 0:00:00
Baseline 0001 (4-changed-components) 2023-02-20T22:48:24 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 79 8
Performance Improvements 73 173
Unchanged Tests 1084 1055
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Code Size Δ Previous Current σ Δ (B) σ (B)
458.sjeng 3.98% 102308.000 106376.000 - 2.24% -
444.namd 2.14% 185800.000 189776.000 - 0.74% -

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
436.cactusADM 1.70% 2118.000 2154.000 - 3.41% -
453.povray 1.12% 535.000 541.000 - -1.10% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
429.mcf (unexplained diff vs previous) (percentage) 18420.00% 0.050 9.260 0.000 -99.29% 0.000
429.mcf (unexplained diff vs previous) 16300.00% 1.000 164.000 0.000 -99.12% 0.000
471.omnetpp (unexplained diff vs previous) (percentage) 981.08% 0.370 4.000 0.000 -98.98% 0.000
471.omnetpp (unexplained diff vs previous) 950.00% 10.000 105.000 0.000 -99.01% 0.000
470.lbm (unexplained diff vs previous) (percentage) 479.17% 0.240 1.390 0.000 -99.47% 0.000
470.lbm (unexplained diff vs previous) 477.78% 9.000 52.000 0.000 -99.48% 0.000
473.astar (unexplained diff vs previous) (percentage) 370.80% 1.130 5.320 0.000 -97.31% 0.000
473.astar (unexplained diff vs previous) 348.28% 58.000 260.000 0.000 -97.44% 0.000
410.bwaves (unexplained diff vs previous) (percentage) 297.06% 0.340 1.350 0.000 -99.02% 0.000
410.bwaves (unexplained diff vs previous) 295.00% 20.000 79.000 0.000 -98.99% 0.000
462.libquantum (unexplained diff vs previous) (percentage) 102.78% 0.720 1.460 0.000 -99.98% 0.000
462.libquantum (unexplained diff vs previous) 100.00% 1.000 2.000 0.000 -99.99% 0.000
416.gamess (avg) (percentage) 31.03% 0.580 0.760 - -82.81% -
436.cactusADM 22.73% 22.000 27.000 - -78.23% -
436.cactusADM (avg) 22.73% 22.000 27.000 - -78.23% -
456.hmmer 21.43% 14.000 17.000 - -86.61% -
456.hmmer (avg) 21.43% 14.000 17.000 - -86.61% -
456.hmmer (avg) (percentage) 19.61% 0.510 0.610 - -86.17% -
470.lbm (avg) (percentage) 19.51% 0.820 0.980 - -84.52% -
444.namd (avg) (percentage) 18.64% 1.180 1.400 - -84.82% -
436.cactusADM (avg) (percentage) 17.76% 1.070 1.260 - -78.93% -
434.zeusmp 17.39% 23.000 27.000 - -81.63% -
434.zeusmp (avg) 17.39% 23.000 27.000 - -81.63% -
470.lbm 16.13% 31.000 36.000 - -84.94% -
470.lbm (avg) 16.13% 31.000 36.000 - -84.94% -
434.zeusmp (avg) (percentage) 15.96% 0.940 1.090 - -81.37% -
464.h264ref (avg) (percentage) 15.28% 0.720 0.830 - -83.69% -
464.h264ref 14.63% 41.000 47.000 - -83.96% -
464.h264ref (avg) 14.63% 41.000 47.000 - -83.96% -
410.bwaves (avg) (percentage) 14.44% 0.900 1.030 - -76.64% -
410.bwaves 13.21% 53.000 60.000 - -75.90% -
410.bwaves (avg) 13.21% 53.000 60.000 - -75.90% -
471.omnetpp (max) (percentage) 12.28% 3.420 3.840 - -95.18% -
444.namd 11.11% 9.000 10.000 - -85.29% -
444.namd (avg) 11.11% 9.000 10.000 - -85.29% -
481.wrf (avg) (percentage) 11.11% 1.620 1.800 - -71.15% -
433.milc (avg) (percentage) 10.66% 1.220 1.350 - -77.69% -
447.dealII 10.53% 19.000 21.000 - -78.79% -
447.dealII (avg) 10.53% 19.000 21.000 - -78.79% -
458.sjeng (avg) (percentage) 9.52% 0.630 0.690 - -78.37% -
458.sjeng 8.70% 46.000 50.000 - -79.25% -
458.sjeng (avg) 8.70% 46.000 50.000 - -79.25% -
482.sphinx3 (avg) (percentage) 8.20% 1.830 1.980 - -75.03% -
459.GemsFDTD (avg) (percentage) 7.97% 1.380 1.490 - -74.49% -
471.omnetpp (max) 7.53% 93.000 100.000 - -95.39% -
447.dealII (avg) (percentage) 7.44% 1.210 1.300 - -77.47% -
433.milc 7.14% 14.000 15.000 - -78.26% -
433.milc (avg) 7.14% 14.000 15.000 - -78.26% -
453.povray (avg) (percentage) 7.10% 1.550 1.660 - -78.75% -
445.gobmk 6.82% 44.000 47.000 - -76.02% -
445.gobmk (avg) 6.82% 44.000 47.000 - -76.02% -
482.sphinx3 6.67% 15.000 16.000 - -78.38% -
482.sphinx3 (avg) 6.67% 15.000 16.000 - -78.38% -
445.gobmk (avg) (percentage) 6.52% 0.920 0.980 - -74.94% -
471.omnetpp (avg) (percentage) 5.96% 2.180 2.310 - -71.83% -
435.gromacs (avg) (percentage) 5.78% 1.730 1.830 - -63.83% -
473.astar (avg) (percentage) 5.66% 1.590 1.680 - -59.62% -
465.tonto (avg) (percentage) 5.34% 1.310 1.380 - -58.68% -
401.bzip2 (avg) (percentage) 4.24% 1.650 1.720 - -68.61% -
459.GemsFDTD 4.05% 74.000 77.000 - -78.61% -
459.GemsFDTD (avg) 4.05% 74.000 77.000 - -78.61% -
429.mcf (avg) (percentage) 3.35% 5.370 5.550 - -27.64% -
462.libquantum (avg) (percentage) 3.30% 1.820 1.880 - -75.46% -
435.gromacs 2.44% 123.000 126.000 - -65.67% -
435.gromacs (avg) 2.44% 123.000 126.000 - -65.67% -
400.perlbench (avg) (percentage) 2.36% 2.120 2.170 - -65.83% -
454.calculix (avg) (percentage) 1.98% 3.530 3.600 - -55.11% -
483.xalancbmk (avg) (percentage) 1.72% 2.910 2.960 - -54.46% -
471.omnetpp 1.69% 59.000 60.000 - -73.09% -
471.omnetpp (avg) 1.69% 59.000 60.000 - -73.09% -
473.astar 1.23% 81.000 82.000 - -61.50% -
473.astar (avg) 1.23% 81.000 82.000 - -61.50% -
450.soplex (avg) (percentage) 1.15% 2.620 2.650 - -58.79% -

Performance Regressions - Score Δ Previous Current σ Δ (B) σ (B)
nb_compile_successful -4.17% 48.000 46.000 - 58.62% -
nb_execution_successful -4.17% 48.000 46.000 - 58.62% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
429.mcf -8.48% 1935.000 1771.000 - 24.37% -
450.soplex -6.58% 593.000 554.000 - -2.29% -
473.astar -5.06% 5143.000 4883.000 - -4.78% -
471.omnetpp -3.84% 2731.000 2626.000 - -3.60% -
401.bzip2 -3.79% 3005.000 2891.000 - -1.70% -
400.perlbench -3.71% 1564.000 1506.000 - -9.44% -
459.GemsFDTD -3.67% 5373.000 5176.000 - -16.15% -
433.milc -3.43% 1166.000 1126.000 - -2.17% -
435.gromacs -3.01% 7144.000 6929.000 - -4.68% -
482.sphinx3 -2.97% 843.000 818.000 - -13.44% -
437.leslie3d -2.48% 11089.000 10814.000 - -7.10% -
434.zeusmp -1.70% 2529.000 2486.000 - -1.11% -
444.namd -1.67% 780.000 767.000 - 2.68% -
462.libquantum -1.44% 139.000 137.000 - -2.14% -
470.lbm -1.37% 3791.000 3739.000 - -1.29% -
458.sjeng -1.34% 7389.000 7290.000 - -3.66% -
410.bwaves -1.33% 5924.000 5845.000 - 3.41% -
464.h264ref -1.02% 5777.000 5718.000 - -0.75% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
450.soplex (max) -14.81% 27.000 23.000 - -95.78% -
401.bzip2 (max) -12.96% 54.000 47.000 - -97.97% -
473.astar (max) -12.20% 295.000 259.000 - -92.40% -
444.namd (max) -11.76% 17.000 15.000 - -97.81% -
433.milc (max) -11.43% 35.000 31.000 - -97.03% -
400.perlbench (max) -10.20% 49.000 44.000 - -96.85% -
482.sphinx3 (max) -10.00% 40.000 36.000 - -96.05% -
450.soplex (max) (percentage) -10.00% 4.700 4.230 - -95.60% -
401.bzip2 (max) (percentage) -9.89% 1.820 1.640 - -97.91% -
444.namd (max) (percentage) -9.65% 2.280 2.060 - -97.76% -
435.gromacs (max) -8.86% 237.000 216.000 - -93.95% -
429.mcf (max) -8.54% 164.000 150.000 - -88.65% -
447.dealII (max) -8.33% 24.000 22.000 - -98.41% -
459.GemsFDTD (max) -7.98% 163.000 150.000 - -96.60% -
456.hmmer (max) -7.69% 13.000 12.000 - -99.43% -
462.libquantum (max) (percentage) -7.56% 4.100 3.790 - -96.17% -
400.perlbench (max) (percentage) -7.52% 3.190 2.950 - -96.49% -
458.sjeng (max) -7.50% 120.000 111.000 - -96.92% -
464.h264ref (max) -7.46% 67.000 62.000 - -98.02% -
473.astar (max) (percentage) -7.32% 5.740 5.320 - -91.99% -
482.sphinx3 (max) (percentage) -7.28% 4.810 4.460 - -95.38% -
470.lbm (max) -7.02% 57.000 53.000 - -98.07% -
437.leslie3d (max) -6.75% 815.000 760.000 - -60.60% -
445.gobmk (max) (percentage) -6.73% 1.040 0.970 - -98.16% -
450.soplex -6.67% 15.000 14.000 - -61.11% -
450.soplex (avg) -6.67% 15.000 14.000 - -61.11% -
453.povray (max) -6.67% 15.000 14.000 - -97.19% -
433.milc (max) (percentage) -6.62% 3.020 2.820 - -96.89% -
470.lbm (max) (percentage) -6.58% 1.520 1.420 - -98.04% -
465.tonto (max) (percentage) -6.45% 1.860 1.740 - -90.99% -
435.gromacs (max) (percentage) -6.31% 3.330 3.120 - -93.65% -
458.sjeng (max) (percentage) -6.13% 1.630 1.530 - -96.79% -
447.dealII (max) (percentage) -6.12% 1.470 1.380 - -98.28% -
434.zeusmp (max) -6.00% 50.000 47.000 - -97.71% -
445.gobmk (max) -6.00% 50.000 47.000 - -98.22% -
464.h264ref (max) (percentage) -5.98% 1.170 1.100 - -97.97% -
410.bwaves (max) -5.83% 103.000 97.000 - -97.04% -
436.cactusADM (max) (percentage) -5.49% 0.910 0.860 - -99.03% -
434.zeusmp (max) (percentage) -5.47% 2.010 1.900 - -97.68% -
436.cactusADM (max) -5.26% 19.000 18.000 - -99.03% -
429.mcf -4.85% 103.000 98.000 - -10.09% -
429.mcf (avg) -4.85% 103.000 98.000 - -10.09% -
459.GemsFDTD (max) (percentage) -4.61% 3.040 2.900 - -95.94% -
410.bwaves (max) (percentage) -4.57% 1.750 1.670 - -97.12% -
453.povray (max) (percentage) -4.48% 2.900 2.770 - -96.96% -
456.hmmer (max) (percentage) -4.44% 0.450 0.430 - -99.42% -
437.leslie3d (max) (percentage) -4.35% 7.350 7.030 - -57.60% -
437.leslie3d -3.86% 492.000 473.000 - 33.24% -
437.leslie3d (avg) -3.86% 492.000 473.000 - 33.24% -
403.gcc (avg) (percentage) -3.78% 5.290 5.090 - -30.46% -
400.perlbench -3.03% 33.000 32.000 - -69.52% -
400.perlbench (avg) -3.03% 33.000 32.000 - -69.52% -
437.leslie3d (avg) (percentage) -1.35% 4.440 4.380 - 43.61% -
481.wrf (max) (percentage) -1.14% 0.880 0.870 - -98.73% -

Performance Improvements - Score Δ Previous Current σ Δ (B) σ (B)
nb_total_tests 2.94% 68.000 70.000 - 141.38% -

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
458.sjeng 2.24% 104048.000 106376.000 - 3.98% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
429.mcf 24.37% 1424.000 1771.000 - -8.48% -
410.bwaves 3.41% 5652.000 5845.000 - -1.33% -
436.cactusADM 3.41% 2083.000 2154.000 - 1.70% -
444.namd 2.68% 747.000 767.000 - -1.67% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d (avg) (percentage) 43.61% 3.050 4.380 - -1.35% -
437.leslie3d 33.24% 355.000 473.000 - -3.86% -
437.leslie3d (avg) 33.24% 355.000 473.000 - -3.86% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
459.GemsFDTD -3.69% 244728.000 235700.000 - -0.03% -
434.zeusmp -3.55% 152037.000 146647.000 - -0.04% -
437.leslie3d -2.95% 59479.000 57722.000 - -0.05% -
464.h264ref -2.37% 387748.000 378556.000 - -0.04% -
435.gromacs -1.97% 499261.000 489445.000 - -0.02% -
410.bwaves -1.77% 16760.000 16464.000 - 0.00% -
470.lbm -1.49% 9691.000 9547.000 - 0.00% -
433.milc -1.42% 61382.000 60513.000 - -0.16% -
456.hmmer -1.34% 108691.000 107239.000 - -0.01% -
436.cactusADM -1.28% 352891.000 348391.000 - -0.02% -
450.soplex -1.21% 205081.000 202590.000 - -0.02% -
462.libquantum -1.19% 16085.000 15893.000 - -0.40% -
401.bzip2 -1.18% 44233.000 43711.000 - -0.04% -
453.povray -1.12% 661389.000 653957.000 - -0.64% -
400.perlbench -1.10% 893848.000 883995.000 - -0.01% -
482.sphinx3 -1.05% 112859.000 111679.000 - -0.05% -
447.dealII -1.02% 311591.000 308428.000 - -0.01% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
459.GemsFDTD -16.15% 6173.000 5176.000 - -3.67% -
482.sphinx3 -13.44% 945.000 818.000 - -2.97% -
400.perlbench -9.44% 1663.000 1506.000 - -3.71% -
437.leslie3d -7.10% 11640.000 10814.000 - -2.48% -
447.dealII -5.92% 1724.000 1622.000 - -0.73% -
473.astar -4.78% 5128.000 4883.000 - -5.06% -
435.gromacs -4.68% 7269.000 6929.000 - -3.01% -
458.sjeng -3.66% 7567.000 7290.000 - -1.34% -
471.omnetpp -3.60% 2724.000 2626.000 - -3.84% -
445.gobmk -2.73% 5023.000 4886.000 - 0.53% -
450.soplex -2.29% 567.000 554.000 - -6.58% -
433.milc -2.17% 1151.000 1126.000 - -3.43% -
462.libquantum -2.14% 140.000 137.000 - -1.44% -
401.bzip2 -1.70% 2941.000 2891.000 - -3.79% -
470.lbm -1.29% 3788.000 3739.000 - -1.37% -
434.zeusmp -1.11% 2514.000 2486.000 - -1.70% -
453.povray -1.10% 547.000 541.000 - 1.12% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
462.libquantum (unexplained diff vs previous) -99.99% 13518.000 2.000 0.000 100.00% 0.000
462.libquantum (unexplained diff vs previous) (percentage) -99.98% 9655.710 1.460 0.000 102.78% 0.000
470.lbm (unexplained diff vs previous) -99.48% 9990.000 52.000 0.000 477.78% 0.000
470.lbm (unexplained diff vs previous) (percentage) -99.47% 263.730 1.390 0.000 479.17% 0.000
456.hmmer (max) -99.43% 2120.000 12.000 - -7.69% -
456.hmmer (max) (percentage) -99.42% 73.590 0.430 - -4.44% -
429.mcf (unexplained diff vs previous) (percentage) -99.29% 1305.690 9.260 0.000 18420.00% 0.000
454.calculix (max) (percentage) -99.15% 99.730 0.850 - 0.00% -
429.mcf (unexplained diff vs previous) -99.12% 18593.000 164.000 0.000 16300.00% 0.000
436.cactusADM (max) (percentage) -99.03% 88.730 0.860 - -5.49% -
436.cactusADM (max) -99.03% 1848.000 18.000 - -5.26% -
410.bwaves (unexplained diff vs previous) (percentage) -99.02% 137.900 1.350 0.000 297.06% 0.000
471.omnetpp (unexplained diff vs previous) -99.01% 10659.000 105.000 0.000 950.00% 0.000
416.gamess (max) (percentage) -98.99% 38.550 0.390 - 0.00% -
410.bwaves (unexplained diff vs previous) -98.99% 7794.000 79.000 0.000 295.00% 0.000
471.omnetpp (unexplained diff vs previous) (percentage) -98.98% 391.300 4.000 0.000 981.08% 0.000
481.wrf (max) (percentage) -98.73% 68.700 0.870 - -1.14% -
447.dealII (max) -98.41% 1384.000 22.000 - -8.33% -
447.dealII (max) (percentage) -98.28% 80.280 1.380 - -6.12% -
445.gobmk (max) -98.22% 2643.000 47.000 - -6.00% -
445.gobmk (max) (percentage) -98.16% 52.630 0.970 - -6.73% -
470.lbm (max) -98.07% 2746.000 53.000 - -7.02% -
470.lbm (max) (percentage) -98.04% 72.510 1.420 - -6.58% -
464.h264ref (max) -98.02% 3127.000 62.000 - -7.46% -
464.h264ref (max) (percentage) -97.97% 54.290 1.100 - -5.98% -
401.bzip2 (max) -97.97% 2313.000 47.000 - -12.96% -
401.bzip2 (max) (percentage) -97.91% 78.650 1.640 - -9.89% -
444.namd (max) -97.81% 685.000 15.000 - -11.76% -
444.namd (max) (percentage) -97.76% 91.790 2.060 - -9.65% -
434.zeusmp (max) -97.71% 2055.000 47.000 - -6.00% -
434.zeusmp (max) (percentage) -97.68% 81.770 1.900 - -5.47% -
473.astar (unexplained diff vs previous) -97.44% 10146.000 260.000 0.000 348.28% 0.000
483.xalancbmk (max) (percentage) -97.42% 68.670 1.770 - 0.00% -
473.astar (unexplained diff vs previous) (percentage) -97.31% 197.850 5.320 0.000 370.80% 0.000
453.povray (max) -97.19% 499.000 14.000 - -6.67% -
410.bwaves (max) (percentage) -97.12% 57.970 1.670 - -4.57% -
410.bwaves (max) -97.04% 3276.000 97.000 - -5.83% -
433.milc (max) -97.03% 1044.000 31.000 - -11.43% -
453.povray (max) (percentage) -96.96% 91.250 2.770 - -4.48% -
458.sjeng (max) -96.92% 3602.000 111.000 - -7.50% -
433.milc (max) (percentage) -96.89% 90.750 2.820 - -6.62% -
400.perlbench (max) -96.85% 1397.000 44.000 - -10.20% -
458.sjeng (max) (percentage) -96.79% 47.610 1.530 - -6.13% -
459.GemsFDTD (max) -96.60% 4411.000 150.000 - -7.98% -
400.perlbench (max) (percentage) -96.49% 84.060 2.950 - -7.52% -
462.libquantum (max) -96.38% 138.000 5.000 - 0.00% -
462.libquantum (max) (percentage) -96.17% 98.970 3.790 - -7.56% -
482.sphinx3 (max) -96.05% 911.000 36.000 - -10.00% -
403.gcc (max) (percentage) -96.00% 99.360 3.970 - -0.25% -
459.GemsFDTD (max) (percentage) -95.94% 71.460 2.900 - -4.61% -
450.soplex (max) -95.78% 545.000 23.000 - -14.81% -
450.soplex (max) (percentage) -95.60% 96.240 4.230 - -10.00% -
471.omnetpp (max) -95.39% 2169.000 100.000 - 7.53% -
482.sphinx3 (max) (percentage) -95.38% 96.500 4.460 - -7.28% -
471.omnetpp (max) (percentage) -95.18% 79.650 3.840 - 12.28% -
435.gromacs (max) -93.95% 3573.000 216.000 - -8.86% -
435.gromacs (max) (percentage) -93.65% 49.160 3.120 - -6.31% -
473.astar (max) -92.40% 3406.000 259.000 - -12.20% -
473.astar (max) (percentage) -91.99% 66.430 5.320 - -7.32% -
465.tonto (max) (percentage) -90.99% 19.310 1.740 - -6.45% -
429.mcf (max) (percentage) -90.87% 92.890 8.480 - -0.24% -
429.mcf (max) -88.65% 1322.000 150.000 - -8.54% -
456.hmmer -86.61% 127.000 17.000 - 21.43% -
456.hmmer (avg) -86.61% 127.000 17.000 - 21.43% -
456.hmmer (avg) (percentage) -86.17% 4.410 0.610 - 19.61% -
444.namd -85.29% 68.000 10.000 - 11.11% -
444.namd (avg) -85.29% 68.000 10.000 - 11.11% -
470.lbm -84.94% 239.000 36.000 - 16.13% -
470.lbm (avg) -84.94% 239.000 36.000 - 16.13% -
444.namd (avg) (percentage) -84.82% 9.220 1.400 - 18.64% -
470.lbm (avg) (percentage) -84.52% 6.330 0.980 - 19.51% -
464.h264ref -83.96% 293.000 47.000 - 14.63% -
464.h264ref (avg) -83.96% 293.000 47.000 - 14.63% -
464.h264ref (avg) (percentage) -83.69% 5.090 0.830 - 15.28% -
416.gamess (avg) (percentage) -82.81% 4.420 0.760 - 31.03% -
434.zeusmp -81.63% 147.000 27.000 - 17.39% -
434.zeusmp (avg) -81.63% 147.000 27.000 - 17.39% -
434.zeusmp (avg) (percentage) -81.37% 5.850 1.090 - 15.96% -
453.povray -80.95% 42.000 8.000 - 0.00% -
453.povray (avg) -80.95% 42.000 8.000 - 0.00% -
462.libquantum -80.00% 10.000 2.000 - 0.00% -
462.libquantum (avg) -80.00% 10.000 2.000 - 0.00% -
458.sjeng -79.25% 241.000 50.000 - 8.70% -
458.sjeng (avg) -79.25% 241.000 50.000 - 8.70% -
436.cactusADM (avg) (percentage) -78.93% 5.980 1.260 - 17.76% -
447.dealII -78.79% 99.000 21.000 - 10.53% -
447.dealII (avg) -78.79% 99.000 21.000 - 10.53% -
453.povray (avg) (percentage) -78.75% 7.810 1.660 - 7.10% -
459.GemsFDTD -78.61% 360.000 77.000 - 4.05% -
459.GemsFDTD (avg) -78.61% 360.000 77.000 - 4.05% -
482.sphinx3 -78.38% 74.000 16.000 - 6.67% -
482.sphinx3 (avg) -78.38% 74.000 16.000 - 6.67% -
458.sjeng (avg) (percentage) -78.37% 3.190 0.690 - 9.52% -
433.milc -78.26% 69.000 15.000 - 7.14% -
433.milc (avg) -78.26% 69.000 15.000 - 7.14% -
436.cactusADM -78.23% 124.000 27.000 - 22.73% -
436.cactusADM (avg) -78.23% 124.000 27.000 - 22.73% -
433.milc (avg) (percentage) -77.69% 6.050 1.350 - 10.66% -
447.dealII (avg) (percentage) -77.47% 5.770 1.300 - 7.44% -
410.bwaves (avg) (percentage) -76.64% 4.410 1.030 - 14.44% -
445.gobmk -76.02% 196.000 47.000 - 6.82% -
445.gobmk (avg) -76.02% 196.000 47.000 - 6.82% -
410.bwaves -75.90% 249.000 60.000 - 13.21% -
410.bwaves (avg) -75.90% 249.000 60.000 - 13.21% -
462.libquantum (avg) (percentage) -75.46% 7.660 1.880 - 3.30% -
482.sphinx3 (avg) (percentage) -75.03% 7.930 1.980 - 8.20% -
445.gobmk (avg) (percentage) -74.94% 3.910 0.980 - 6.52% -
459.GemsFDTD (avg) (percentage) -74.49% 5.840 1.490 - 7.97% -
471.omnetpp -73.09% 223.000 60.000 - 1.69% -
471.omnetpp (avg) -73.09% 223.000 60.000 - 1.69% -
471.omnetpp (avg) (percentage) -71.83% 8.200 2.310 - 5.96% -
481.wrf (avg) (percentage) -71.15% 6.240 1.800 - 11.11% -
401.bzip2 -69.57% 161.000 49.000 - 0.00% -
401.bzip2 (avg) -69.57% 161.000 49.000 - 0.00% -
400.perlbench -69.52% 105.000 32.000 - -3.03% -
400.perlbench (avg) -69.52% 105.000 32.000 - -3.03% -
401.bzip2 (avg) (percentage) -68.61% 5.480 1.720 - 4.24% -
400.perlbench (avg) (percentage) -65.83% 6.350 2.170 - 2.36% -
435.gromacs -65.67% 367.000 126.000 - 2.44% -
435.gromacs (avg) -65.67% 367.000 126.000 - 2.44% -
435.gromacs (avg) (percentage) -63.83% 5.060 1.830 - 5.78% -
473.astar -61.50% 213.000 82.000 - 1.23% -
473.astar (avg) -61.50% 213.000 82.000 - 1.23% -
450.soplex -61.11% 36.000 14.000 - -6.67% -
450.soplex (avg) -61.11% 36.000 14.000 - -6.67% -
437.leslie3d (max) -60.60% 1929.000 760.000 - -6.75% -
473.astar (avg) (percentage) -59.62% 4.160 1.680 - 5.66% -
450.soplex (avg) (percentage) -58.79% 6.430 2.650 - 1.15% -
465.tonto (avg) (percentage) -58.68% 3.340 1.380 - 5.34% -
437.leslie3d (max) (percentage) -57.60% 16.580 7.030 - -4.35% -
454.calculix (avg) (percentage) -55.11% 8.020 3.600 - 1.98% -
483.xalancbmk (avg) (percentage) -54.46% 6.500 2.960 - 1.72% -
403.gcc (avg) (percentage) -30.46% 7.320 5.090 - -3.78% -
429.mcf (avg) (percentage) -27.64% 7.670 5.550 - 3.35% -
429.mcf -10.09% 109.000 98.000 - -4.85% -
429.mcf (avg) -10.09% 109.000 98.000 - -4.85% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 141.38% 29.000 70.000 - 2.94% -
nb_compile_successful 58.62% 29.000 46.000 - -4.17% -
nb_execution_successful 58.62% 29.000 46.000 - -4.17% -

Report Time: 0.36s
Execution (seconds)
Name Current %
400.perlbench 1506.000 -3.71%
401.bzip2 2891.000 -3.79%
410.bwaves 5845.000 -1.33%
429.mcf 1771.000 -8.48%
433.milc 1126.000 -3.43%
434.zeusmp 2486.000 -1.70%
435.gromacs 6929.000 -3.01%
436.cactusADM 2154.000 1.70%
437.leslie3d 10814.000 -2.48%
444.namd 767.000 -1.67%
445.gobmk 4886.000 -
447.dealII 1622.000 -
450.soplex 554.000 -6.58%
453.povray 541.000 1.12%
456.hmmer 2909.000 -
458.sjeng 7290.000 -1.34%
459.GemsFDTD 5176.000 -3.67%
462.libquantum 137.000 -1.44%
464.h264ref 5718.000 -1.02%
470.lbm 3739.000 -1.37%
471.omnetpp 2626.000 -3.84%
473.astar 4883.000 -5.06%
482.sphinx3 818.000 -2.97%
Geometric Mean 2249.335 -2.41%
Code Size (bytes)
Name Current %
400.perlbench 883995.000 -
401.bzip2 43711.000 -
410.bwaves 16464.000 -
429.mcf 9055.000 -
433.milc 60513.000 -
434.zeusmp 146647.000 -
435.gromacs 489445.000 -
436.cactusADM 348391.000 -
437.leslie3d 57722.000 -
444.namd 189776.000 2.14%
445.gobmk 1374918.000 -
447.dealII 308428.000 -
450.soplex 202590.000 -
453.povray 653957.000 -
456.hmmer 107239.000 -
458.sjeng 106376.000 3.98%
459.GemsFDTD 235700.000 -
462.libquantum 15893.000 -
464.h264ref 378556.000 -
470.lbm 9547.000 -
471.omnetpp 475410.000 -
473.astar 22752.000 -
482.sphinx3 111679.000 -
Geometric Mean 122172.087 -
Score
Name Current %
nb_compile_successful 46.000 -4.17%
nb_execution_successful 46.000 -4.17%
nb_total_tests 70.000 2.94%
Geometric Mean 52.910 -1.85%
sample variability
Name Current %
400.perlbench 32.000 -3.03%
400.perlbench (avg) 32.000 -3.03%
400.perlbench (avg) (percentage) 2.170 2.36%
400.perlbench (max) 44.000 -10.20%
400.perlbench (max) (percentage) 2.950 -7.52%
401.bzip2 49.000 -
401.bzip2 (avg) 49.000 -
401.bzip2 (avg) (percentage) 1.720 4.24%
401.bzip2 (max) 47.000 -12.96%
401.bzip2 (max) (percentage) 1.640 -9.89%
403.gcc (avg) (percentage) 5.090 -3.78%
403.gcc (max) (percentage) 3.970 -
410.bwaves 60.000 13.21%
410.bwaves (avg) 60.000 13.21%
410.bwaves (avg) (percentage) 1.030 14.44%
410.bwaves (max) 97.000 -5.83%
410.bwaves (max) (percentage) 1.670 -4.57%
410.bwaves (unexplained diff vs previous) 79.000 295.00%
410.bwaves (unexplained diff vs previous) (percentage) 1.350 297.06%
416.gamess (avg) (percentage) 0.760 31.03%
416.gamess (max) (percentage) 0.390 -
429.mcf 98.000 -4.85%
429.mcf (avg) 98.000 -4.85%
429.mcf (avg) (percentage) 5.550 3.35%
429.mcf (max) 150.000 -8.54%
429.mcf (max) (percentage) 8.480 -
429.mcf (unexplained diff vs previous) 164.000 16300.00%
429.mcf (unexplained diff vs previous) (percentage) 9.260 18420.00%
433.milc 15.000 7.14%
433.milc (avg) 15.000 7.14%
433.milc (avg) (percentage) 1.350 10.66%
433.milc (max) 31.000 -11.43%
433.milc (max) (percentage) 2.820 -6.62%
434.zeusmp 27.000 17.39%
434.zeusmp (avg) 27.000 17.39%
434.zeusmp (avg) (percentage) 1.090 15.96%
434.zeusmp (max) 47.000 -6.00%
434.zeusmp (max) (percentage) 1.900 -5.47%
435.gromacs 126.000 2.44%
435.gromacs (avg) 126.000 2.44%
435.gromacs (avg) (percentage) 1.830 5.78%
435.gromacs (max) 216.000 -8.86%
435.gromacs (max) (percentage) 3.120 -6.31%
436.cactusADM 27.000 22.73%
436.cactusADM (avg) 27.000 22.73%
436.cactusADM (avg) (percentage) 1.260 17.76%
436.cactusADM (max) 18.000 -5.26%
436.cactusADM (max) (percentage) 0.860 -5.49%
437.leslie3d 473.000 -3.86%
437.leslie3d (avg) 473.000 -3.86%
437.leslie3d (avg) (percentage) 4.380 -1.35%
437.leslie3d (max) 760.000 -6.75%
437.leslie3d (max) (percentage) 7.030 -4.35%
444.namd 10.000 11.11%
444.namd (avg) 10.000 11.11%
444.namd (avg) (percentage) 1.400 18.64%
444.namd (max) 15.000 -11.76%
444.namd (max) (percentage) 2.060 -9.65%
445.gobmk 47.000 6.82%
445.gobmk (avg) 47.000 6.82%
445.gobmk (avg) (percentage) 0.980 6.52%
445.gobmk (max) 47.000 -6.00%
445.gobmk (max) (percentage) 0.970 -6.73%
447.dealII 21.000 10.53%
447.dealII (avg) 21.000 10.53%
447.dealII (avg) (percentage) 1.300 7.44%
447.dealII (max) 22.000 -8.33%
447.dealII (max) (percentage) 1.380 -6.12%
450.soplex 14.000 -6.67%
450.soplex (avg) 14.000 -6.67%
450.soplex (avg) (percentage) 2.650 1.15%
450.soplex (max) 23.000 -14.81%
450.soplex (max) (percentage) 4.230 -10.00%
453.povray 8.000 -
453.povray (avg) 8.000 -
453.povray (avg) (percentage) 1.660 7.10%
453.povray (max) 14.000 -6.67%
453.povray (max) (percentage) 2.770 -4.48%
454.calculix (avg) (percentage) 3.600 1.98%
454.calculix (max) (percentage) 0.850 -
456.hmmer 17.000 21.43%
456.hmmer (avg) 17.000 21.43%
456.hmmer (avg) (percentage) 0.610 19.61%
456.hmmer (max) 12.000 -7.69%
456.hmmer (max) (percentage) 0.430 -4.44%
458.sjeng 50.000 8.70%
458.sjeng (avg) 50.000 8.70%
458.sjeng (avg) (percentage) 0.690 9.52%
458.sjeng (max) 111.000 -7.50%
458.sjeng (max) (percentage) 1.530 -6.13%
459.GemsFDTD 77.000 4.05%
459.GemsFDTD (avg) 77.000 4.05%
459.GemsFDTD (avg) (percentage) 1.490 7.97%
459.GemsFDTD (max) 150.000 -7.98%
459.GemsFDTD (max) (percentage) 2.900 -4.61%
462.libquantum 2.000 -
462.libquantum (avg) 2.000 -
462.libquantum (avg) (percentage) 1.880 3.30%
462.libquantum (max) 5.000 -
462.libquantum (max) (percentage) 3.790 -7.56%
462.libquantum (unexplained diff vs previous) 2.000 100.00%
462.libquantum (unexplained diff vs previous) (percentage) 1.460 102.78%
464.h264ref 47.000 14.63%
464.h264ref (avg) 47.000 14.63%
464.h264ref (avg) (percentage) 0.830 15.28%
464.h264ref (max) 62.000 -7.46%
464.h264ref (max) (percentage) 1.100 -5.98%
465.tonto (avg) (percentage) 1.380 5.34%
465.tonto (max) (percentage) 1.740 -6.45%
470.lbm 36.000 16.13%
470.lbm (avg) 36.000 16.13%
470.lbm (avg) (percentage) 0.980 19.51%
470.lbm (max) 53.000 -7.02%
470.lbm (max) (percentage) 1.420 -6.58%
470.lbm (unexplained diff vs previous) 52.000 477.78%
470.lbm (unexplained diff vs previous) (percentage) 1.390 479.17%
471.omnetpp 60.000 1.69%
471.omnetpp (avg) 60.000 1.69%
471.omnetpp (avg) (percentage) 2.310 5.96%
471.omnetpp (max) 100.000 7.53%
471.omnetpp (max) (percentage) 3.840 12.28%
471.omnetpp (unexplained diff vs previous) 105.000 950.00%
471.omnetpp (unexplained diff vs previous) (percentage) 4.000 981.08%
473.astar 82.000 1.23%
473.astar (avg) 82.000 1.23%
473.astar (avg) (percentage) 1.680 5.66%
473.astar (max) 259.000 -12.20%
473.astar (max) (percentage) 5.320 -7.32%
473.astar (unexplained diff vs previous) 260.000 348.28%
473.astar (unexplained diff vs previous) (percentage) 5.320 370.80%
481.wrf (avg) (percentage) 1.800 11.11%
481.wrf (max) (percentage) 0.870 -1.14%
482.sphinx3 16.000 6.67%
482.sphinx3 (avg) 16.000 6.67%
482.sphinx3 (avg) (percentage) 1.980 8.20%
482.sphinx3 (max) 36.000 -10.00%
482.sphinx3 (max) (percentage) 4.460 -7.28%
483.xalancbmk (avg) (percentage) 2.960 1.72%
483.xalancbmk (max) (percentage) 1.770 -
Geometric Mean 9.820 22.00%