Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=5cbed9c77bb0c1f5d94ededa401131a2c3217028 (+ 56 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/913bab282d95e842907fec5a552a74ef64a6d4f6 (+ 38 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=4dc22baa84bdb4111c0ac0db7139bf9ab953bf61 (+ 23 commits)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/d3af75d288b8a0b36df2d7e6b91e4946c03b3473 (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-aarch64-master-Os_LTO-build/277/
View Options
Report
Filter

gnu-aarch64-master-Os_LTO test results

Run Order Start Time Duration
Current 0277 (3-changed-components) 2024-07-19T15:37:43 0:00:00
Previous 0276 (4-changed-components) 2024-07-17T00:21:03 0:00:00
Baseline 0001 (4-changed-components) 2023-02-20T22:48:24 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 14 15
Performance Improvements 87 187
Added Tests 4 0
Unchanged Tests 1131 1034
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
401.bzip2 2.16% 2921.000 2984.000 - 1.46% -
453.povray 1.84% 544.000 554.000 - 1.28% -
436.cactusADM 1.71% 2101.000 2137.000 - 2.59% -
435.gromacs 1.48% 7110.000 7215.000 - -0.74% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
450.soplex (unexplained diff vs previous) (percentage) 208.82% 0.680 2.100 0.000 -99.92% 0.000
401.bzip2 (unexplained diff vs previous) 200.00% 21.000 63.000 0.000 -99.42% 0.000
450.soplex (unexplained diff vs previous) 200.00% 4.000 12.000 0.000 -99.92% 0.000
401.bzip2 (unexplained diff vs previous) (percentage) 193.06% 0.720 2.110 0.000 -99.43% 0.000
429.mcf (unexplained diff vs previous) (percentage) 160.00% 0.100 0.260 0.000 -99.98% 0.000
429.mcf (unexplained diff vs previous) 150.00% 2.000 5.000 0.000 -99.97% 0.000
401.bzip2 (max) 60.00% 40.000 64.000 - -97.23% -
401.bzip2 (max) (percentage) 55.40% 1.390 2.160 - -97.25% -
401.bzip2 2.04% 49.000 50.000 - -68.94% -
401.bzip2 (avg) 2.04% 49.000 50.000 - -68.94% -

Performance Improvements - Code Size Δ Previous Current σ Δ (B) σ (B)
459.GemsFDTD -1.71% 236796.000 232736.000 - -4.90% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
437.leslie3d -4.45% 11963.000 11431.000 - -1.80% -
462.libquantum -2.88% 139.000 135.000 - -3.57% -
450.soplex -2.05% 584.000 572.000 - 0.88% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
471.omnetpp (unexplained diff vs previous) (percentage) -95.77% 2.600 0.110 0.000 -99.97% 0.000
471.omnetpp (unexplained diff vs previous) -95.71% 70.000 3.000 0.000 -99.97% 0.000
456.hmmer (unexplained diff vs previous) (percentage) -79.27% 0.820 0.170 0.000 -99.94% 0.000
456.hmmer (unexplained diff vs previous) -79.17% 24.000 5.000 0.000 -99.94% 0.000
445.gobmk (unexplained diff vs previous) -69.23% 39.000 12.000 0.000 -99.78% 0.000
445.gobmk (unexplained diff vs previous) (percentage) -69.23% 0.780 0.240 0.000 -99.78% 0.000
482.sphinx3 (unexplained diff vs previous) -62.50% 8.000 3.000 0.000 -99.99% 0.000
482.sphinx3 (unexplained diff vs previous) (percentage) -62.50% 0.960 0.360 0.000 -99.99% 0.000
435.gromacs (unexplained diff vs previous) (percentage) -56.16% 3.330 1.460 0.000 -98.49% 0.000
435.gromacs (unexplained diff vs previous) -55.70% 237.000 105.000 0.000 -98.51% 0.000
434.zeusmp (unexplained diff vs previous) (percentage) -30.77% 0.520 0.360 0.000 -99.92% 0.000
434.zeusmp (unexplained diff vs previous) -30.77% 13.000 9.000 0.000 -99.92% 0.000
456.hmmer (max) -29.17% 24.000 17.000 - -99.20% -
456.hmmer (max) (percentage) -25.61% 0.820 0.610 - -99.17% -
437.leslie3d (max) -22.89% 1280.000 987.000 - -48.83% -
462.libquantum (max) -20.00% 5.000 4.000 - -97.10% -
462.libquantum (unexplained diff vs previous) -20.00% 5.000 4.000 0.000 -99.97% 0.000
470.lbm (unexplained diff vs previous) -20.00% 5.000 4.000 0.000 -99.96% 0.000
437.leslie3d (max) (percentage) -19.25% 10.700 8.640 - -47.89% -
458.sjeng (unexplained diff vs previous) -18.75% 16.000 13.000 0.000 -99.81% 0.000
458.sjeng (unexplained diff vs previous) (percentage) -18.18% 0.220 0.180 0.000 -99.80% 0.000
462.libquantum (unexplained diff vs previous) (percentage) -17.78% 3.600 2.960 0.000 -99.97% 0.000
462.libquantum (max) (percentage) -16.62% 3.730 3.110 - -96.86% -
470.lbm (unexplained diff vs previous) (percentage) -15.38% 0.130 0.110 0.000 -99.96% 0.000
444.namd (max) -14.29% 7.000 6.000 - -99.12% -
450.soplex (max) -12.50% 16.000 14.000 - -97.43% -
470.lbm (max) -12.00% 50.000 44.000 - -98.40% -
429.mcf (max) -11.59% 138.000 122.000 - -90.77% -
410.bwaves (max) -11.54% 78.000 69.000 - -97.89% -
410.bwaves (max) (percentage) -11.36% 1.320 1.170 - -97.98% -
470.lbm (max) (percentage) -11.28% 1.330 1.180 - -98.37% -
471.omnetpp (max) -11.24% 89.000 79.000 - -96.36% -
473.astar (max) -11.23% 187.000 166.000 - -95.13% -
429.mcf (max) (percentage) -11.16% 7.170 6.370 - -93.14% -
471.omnetpp (max) (percentage) -11.14% 3.320 2.950 - -96.30% -
473.astar (max) (percentage) -10.96% 3.650 3.250 - -95.11% -
482.sphinx3 (max) -9.68% 31.000 28.000 - -96.93% -
433.milc (max) -9.52% 21.000 19.000 - -98.18% -
445.gobmk (max) (percentage) -9.02% 1.220 1.110 - -97.89% -
444.namd (max) (percentage) -8.79% 0.910 0.830 - -99.10% -
482.sphinx3 (max) (percentage) -8.71% 3.790 3.460 - -96.41% -
450.soplex (max) (percentage) -8.57% 2.800 2.560 - -97.34% -
445.gobmk (max) -8.33% 60.000 55.000 - -97.92% -
458.sjeng (max) (percentage) -8.20% 0.610 0.560 - -98.82% -
434.zeusmp (max) (percentage) -8.14% 1.720 1.580 - -98.07% -
433.milc (max) (percentage) -7.65% 1.830 1.690 - -98.14% -
447.dealII (max) (percentage) -7.50% 2.000 1.850 - -97.70% -
436.cactusADM (max) (percentage) -7.34% 1.090 1.010 - -98.86% -
435.gromacs (max) (percentage) -7.34% 4.770 4.420 - -91.01% -
434.zeusmp (max) -6.98% 43.000 40.000 - -98.05% -
458.sjeng (max) -6.82% 44.000 41.000 - -98.86% -
450.soplex -6.67% 15.000 14.000 - -61.11% -
450.soplex (avg) -6.67% 15.000 14.000 - -61.11% -
447.dealII (max) -6.25% 32.000 30.000 - -97.83% -
435.gromacs (max) -6.19% 339.000 318.000 - -91.10% -
400.perlbench (max) -5.48% 73.000 69.000 - -95.06% -
447.dealII -4.76% 21.000 20.000 - -79.80% -
447.dealII (avg) -4.76% 21.000 20.000 - -79.80% -
400.perlbench (max) (percentage) -4.63% 4.750 4.530 - -94.61% -
436.cactusADM (max) -4.55% 22.000 21.000 - -98.86% -
437.leslie3d -4.35% 529.000 506.000 - 42.54% -
437.leslie3d (avg) -4.35% 529.000 506.000 - 42.54% -
465.tonto (max) (percentage) -4.27% 1.640 1.570 - -91.87% -
465.tonto (max) -3.85% 182.000 175.000 - -91.71% -
459.GemsFDTD (max) -3.45% 174.000 168.000 - -96.19% -
453.povray (max) (percentage) -3.45% 2.320 2.240 - -97.55% -
459.GemsFDTD (max) (percentage) -3.36% 3.270 3.160 - -95.58% -
464.h264ref (max) (percentage) -3.12% 0.960 0.930 - -98.29% -
445.gobmk -2.08% 48.000 47.000 - -76.02% -
445.gobmk (avg) -2.08% 48.000 47.000 - -76.02% -
464.h264ref (max) -1.82% 55.000 54.000 - -98.27% -
456.hmmer (avg) (percentage) -1.67% 0.600 0.590 - -86.62% -
410.bwaves -1.67% 60.000 59.000 - -76.31% -
410.bwaves (avg) -1.67% 60.000 59.000 - -76.31% -
447.dealII (avg) (percentage) -1.54% 1.300 1.280 - -77.82% -
444.namd (avg) (percentage) -1.46% 1.370 1.350 - -85.36% -
429.mcf (avg) (percentage) -1.28% 5.470 5.400 - -29.60% -
473.astar (avg) (percentage) -1.18% 1.690 1.670 - -59.86% -
473.astar -1.16% 86.000 85.000 - -60.09% -
473.astar (avg) -1.16% 86.000 85.000 - -60.09% -
445.gobmk (avg) (percentage) -1.03% 0.970 0.960 - -75.45% -
470.lbm (avg) (percentage) -1.03% 0.970 0.960 - -84.83% -
482.sphinx3 (avg) (percentage) -1.01% 1.980 1.960 - -75.28% -

Added Tests - sample variability
437.leslie3d (unexplained diff vs previous)
437.leslie3d (unexplained diff vs previous) (percentage)
447.dealII (unexplained diff vs previous)
447.dealII (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
458.sjeng 2.24% 104048.000 106376.000 - 0.00% -
465.tonto 1.35% 1946163.000 1972378.000 - 0.01% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
429.mcf 35.46% 1424.000 1929.000 - -0.26% -
410.bwaves 4.99% 5652.000 5934.000 - -0.15% -
444.namd 3.88% 747.000 776.000 - -0.26% -
436.cactusADM 2.59% 2083.000 2137.000 - 1.71% -
465.tonto 1.97% 10941.000 11157.000 - 0.42% -
456.hmmer 1.84% 2882.000 2935.000 - -0.17% -
464.h264ref 1.49% 5761.000 5847.000 - 0.39% -
401.bzip2 1.46% 2941.000 2984.000 - 2.16% -
453.povray 1.28% 547.000 554.000 - 1.84% -
433.milc 1.04% 1151.000 1163.000 - 0.52% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d (avg) (percentage) 45.25% 3.050 4.430 - 0.00% -
437.leslie3d 42.54% 355.000 506.000 - -4.35% -
437.leslie3d (avg) 42.54% 355.000 506.000 - -4.35% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d -7.91% 59479.000 54774.000 - 0.00% -
459.GemsFDTD -4.90% 244728.000 232736.000 - -1.71% -
434.zeusmp -3.55% 152037.000 146647.000 - 0.00% -
464.h264ref -2.37% 387748.000 378548.000 - -0.01% -
435.gromacs -1.97% 499261.000 489445.000 - 0.00% -
410.bwaves -1.77% 16760.000 16464.000 - 0.00% -
453.povray -1.74% 661389.000 649853.000 - -0.63% -
470.lbm -1.49% 9691.000 9547.000 - 0.00% -
433.milc -1.42% 61382.000 60513.000 - 0.00% -
456.hmmer -1.34% 108691.000 107239.000 - 0.00% -
436.cactusADM -1.28% 352891.000 348383.000 - -0.00% -
450.soplex -1.21% 205081.000 202590.000 - 0.00% -
462.libquantum -1.19% 16085.000 15893.000 - 0.00% -
401.bzip2 -1.18% 44233.000 43711.000 - 0.00% -
482.sphinx3 -1.05% 112859.000 111679.000 - 0.00% -
447.dealII -1.01% 311591.000 308436.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
459.GemsFDTD -13.38% 6173.000 5347.000 - 0.00% -
482.sphinx3 -11.96% 945.000 832.000 - -0.36% -
400.perlbench -7.10% 1663.000 1545.000 - 0.13% -
447.dealII -4.87% 1724.000 1640.000 - 0.18% -
462.libquantum -3.57% 140.000 135.000 - -2.88% -
458.sjeng -2.74% 7567.000 7360.000 - -0.18% -
437.leslie3d -1.80% 11640.000 11431.000 - -4.45% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
482.sphinx3 (unexplained diff vs previous) -99.99% 26073.000 3.000 0.000 -62.50% 0.000
482.sphinx3 (unexplained diff vs previous) (percentage) -99.99% 2759.050 0.360 0.000 -62.50% 0.000
429.mcf (unexplained diff vs previous) (percentage) -99.98% 1305.690 0.260 0.000 160.00% 0.000
444.namd (unexplained diff vs previous) (percentage) -99.98% 1118.610 0.260 0.000 0.00% 0.000
444.namd (unexplained diff vs previous) -99.98% 8356.000 2.000 0.000 0.00% 0.000
429.mcf (unexplained diff vs previous) -99.97% 18593.000 5.000 0.000 150.00% 0.000
471.omnetpp (unexplained diff vs previous) (percentage) -99.97% 391.300 0.110 0.000 -95.77% 0.000
471.omnetpp (unexplained diff vs previous) -99.97% 10659.000 3.000 0.000 -95.71% 0.000
462.libquantum (unexplained diff vs previous) -99.97% 13518.000 4.000 0.000 -20.00% 0.000
462.libquantum (unexplained diff vs previous) (percentage) -99.97% 9655.710 2.960 0.000 -17.78% 0.000
470.lbm (unexplained diff vs previous) -99.96% 9990.000 4.000 0.000 -20.00% 0.000
470.lbm (unexplained diff vs previous) (percentage) -99.96% 263.730 0.110 0.000 -15.38% 0.000
447.dealII (unexplained diff vs previous) -99.96% 7017.000 3.000 0.000 0.00% 0.000
447.dealII (unexplained diff vs previous) (percentage) -99.96% 407.020 0.180 0.000 0.00% 0.000
433.milc (unexplained diff vs previous) (percentage) -99.95% 980.800 0.520 0.000 0.00% 0.000
433.milc (unexplained diff vs previous) -99.95% 11289.000 6.000 0.000 0.00% 0.000
456.hmmer (unexplained diff vs previous) (percentage) -99.94% 278.630 0.170 0.000 -79.27% 0.000
456.hmmer (unexplained diff vs previous) -99.94% 8030.000 5.000 0.000 -79.17% 0.000
473.astar (unexplained diff vs previous) -99.92% 10146.000 8.000 0.000 0.00% 0.000
434.zeusmp (unexplained diff vs previous) -99.92% 11280.000 9.000 0.000 -30.77% 0.000
434.zeusmp (unexplained diff vs previous) (percentage) -99.92% 448.690 0.360 0.000 -30.77% 0.000
473.astar (unexplained diff vs previous) (percentage) -99.92% 197.850 0.160 0.000 0.00% 0.000
450.soplex (unexplained diff vs previous) (percentage) -99.92% 2557.320 2.100 0.000 208.82% 0.000
450.soplex (unexplained diff vs previous) -99.92% 14500.000 12.000 0.000 200.00% 0.000
458.sjeng (unexplained diff vs previous) -99.81% 6876.000 13.000 0.000 -18.75% 0.000
458.sjeng (unexplained diff vs previous) (percentage) -99.80% 90.870 0.180 0.000 -18.18% 0.000
445.gobmk (unexplained diff vs previous) -99.78% 5581.000 12.000 0.000 -69.23% 0.000
445.gobmk (unexplained diff vs previous) (percentage) -99.78% 111.110 0.240 0.000 -69.23% 0.000
401.bzip2 (unexplained diff vs previous) (percentage) -99.43% 368.340 2.110 0.000 193.06% 0.000
401.bzip2 (unexplained diff vs previous) -99.42% 10833.000 63.000 0.000 200.00% 0.000
456.hmmer (max) -99.20% 2120.000 17.000 - -29.17% -
456.hmmer (max) (percentage) -99.17% 73.590 0.610 - -25.61% -
454.calculix (max) (percentage) -99.16% 99.730 0.840 - 0.00% -
444.namd (max) -99.12% 685.000 6.000 - -14.29% -
444.namd (max) (percentage) -99.10% 91.790 0.830 - -8.79% -
416.gamess (max) (percentage) -98.99% 38.550 0.390 - 0.00% -
436.cactusADM (max) -98.86% 1848.000 21.000 - -4.55% -
458.sjeng (max) -98.86% 3602.000 41.000 - -6.82% -
436.cactusADM (max) (percentage) -98.86% 88.730 1.010 - -7.34% -
458.sjeng (max) (percentage) -98.82% 47.610 0.560 - -8.20% -
481.wrf (max) (percentage) -98.75% 68.700 0.860 - 0.00% -
435.gromacs (unexplained diff vs previous) -98.51% 7028.000 105.000 0.000 -55.70% 0.000
435.gromacs (unexplained diff vs previous) (percentage) -98.49% 96.680 1.460 0.000 -56.16% 0.000
470.lbm (max) -98.40% 2746.000 44.000 - -12.00% -
470.lbm (max) (percentage) -98.37% 72.510 1.180 - -11.28% -
464.h264ref (max) (percentage) -98.29% 54.290 0.930 - -3.12% -
464.h264ref (max) -98.27% 3127.000 54.000 - -1.82% -
433.milc (max) -98.18% 1044.000 19.000 - -9.52% -
433.milc (max) (percentage) -98.14% 90.750 1.690 - -7.65% -
434.zeusmp (max) (percentage) -98.07% 81.770 1.580 - -8.14% -
434.zeusmp (max) -98.05% 2055.000 40.000 - -6.98% -
410.bwaves (max) (percentage) -97.98% 57.970 1.170 - -11.36% -
445.gobmk (max) -97.92% 2643.000 55.000 - -8.33% -
410.bwaves (max) -97.89% 3276.000 69.000 - -11.54% -
445.gobmk (max) (percentage) -97.89% 52.630 1.110 - -9.02% -
447.dealII (max) -97.83% 1384.000 30.000 - -6.25% -
447.dealII (max) (percentage) -97.70% 80.280 1.850 - -7.50% -
453.povray (max) -97.60% 499.000 12.000 - 0.00% -
453.povray (max) (percentage) -97.55% 91.250 2.240 - -3.45% -
450.soplex (max) -97.43% 545.000 14.000 - -12.50% -
483.xalancbmk (max) (percentage) -97.42% 68.670 1.770 - 0.00% -
450.soplex (max) (percentage) -97.34% 96.240 2.560 - -8.57% -
401.bzip2 (max) (percentage) -97.25% 78.650 2.160 - 55.40% -
401.bzip2 (max) -97.23% 2313.000 64.000 - 60.00% -
462.libquantum (max) -97.10% 138.000 4.000 - -20.00% -
482.sphinx3 (max) -96.93% 911.000 28.000 - -9.68% -
462.libquantum (max) (percentage) -96.86% 98.970 3.110 - -16.62% -
482.sphinx3 (max) (percentage) -96.41% 96.500 3.460 - -8.71% -
471.omnetpp (max) -96.36% 2169.000 79.000 - -11.24% -
471.omnetpp (max) (percentage) -96.30% 79.650 2.950 - -11.14% -
459.GemsFDTD (max) -96.19% 4411.000 168.000 - -3.45% -
403.gcc (max) (percentage) -96.04% 99.360 3.930 - -0.25% -
459.GemsFDTD (max) (percentage) -95.58% 71.460 3.160 - -3.36% -
473.astar (max) -95.13% 3406.000 166.000 - -11.23% -
473.astar (max) (percentage) -95.11% 66.430 3.250 - -10.96% -
400.perlbench (max) -95.06% 1397.000 69.000 - -5.48% -
400.perlbench (max) (percentage) -94.61% 84.060 4.530 - -4.63% -
429.mcf (max) (percentage) -93.14% 92.890 6.370 - -11.16% -
465.tonto (max) (percentage) -91.87% 19.310 1.570 - -4.27% -
465.tonto (max) -91.71% 2112.000 175.000 - -3.85% -
435.gromacs (max) -91.10% 3573.000 318.000 - -6.19% -
435.gromacs (max) (percentage) -91.01% 49.160 4.420 - -7.34% -
429.mcf (max) -90.77% 1322.000 122.000 - -11.59% -
456.hmmer (avg) (percentage) -86.62% 4.410 0.590 - -1.67% -
456.hmmer -86.61% 127.000 17.000 - 0.00% -
456.hmmer (avg) -86.61% 127.000 17.000 - 0.00% -
444.namd (avg) (percentage) -85.36% 9.220 1.350 - -1.46% -
444.namd -85.29% 68.000 10.000 - 0.00% -
444.namd (avg) -85.29% 68.000 10.000 - 0.00% -
470.lbm -84.94% 239.000 36.000 - 0.00% -
470.lbm (avg) -84.94% 239.000 36.000 - 0.00% -
470.lbm (avg) (percentage) -84.83% 6.330 0.960 - -1.03% -
464.h264ref -83.96% 293.000 47.000 - 0.00% -
464.h264ref (avg) -83.96% 293.000 47.000 - 0.00% -
464.h264ref (avg) (percentage) -83.89% 5.090 0.820 - 0.00% -
416.gamess (avg) (percentage) -82.81% 4.420 0.760 - 0.00% -
434.zeusmp (avg) (percentage) -81.71% 5.850 1.070 - -0.93% -
434.zeusmp -81.63% 147.000 27.000 - 0.00% -
434.zeusmp (avg) -81.63% 147.000 27.000 - 0.00% -
453.povray -80.95% 42.000 8.000 - 0.00% -
453.povray (avg) -80.95% 42.000 8.000 - 0.00% -
462.libquantum -80.00% 10.000 2.000 - 0.00% -
462.libquantum (avg) -80.00% 10.000 2.000 - 0.00% -
447.dealII -79.80% 99.000 20.000 - -4.76% -
447.dealII (avg) -79.80% 99.000 20.000 - -4.76% -
458.sjeng -79.67% 241.000 49.000 - 0.00% -
458.sjeng (avg) -79.67% 241.000 49.000 - 0.00% -
436.cactusADM (avg) (percentage) -79.26% 5.980 1.240 - 0.00% -
453.povray (avg) (percentage) -79.26% 7.810 1.620 - 0.00% -
436.cactusADM -79.03% 124.000 26.000 - 0.00% -
436.cactusADM (avg) -79.03% 124.000 26.000 - 0.00% -
458.sjeng (avg) (percentage) -79.00% 3.190 0.670 - 0.00% -
482.sphinx3 -78.38% 74.000 16.000 - 0.00% -
482.sphinx3 (avg) -78.38% 74.000 16.000 - 0.00% -
433.milc -78.26% 69.000 15.000 - 0.00% -
433.milc (avg) -78.26% 69.000 15.000 - 0.00% -
433.milc (avg) (percentage) -78.02% 6.050 1.330 - -0.75% -
447.dealII (avg) (percentage) -77.82% 5.770 1.280 - -1.54% -
459.GemsFDTD -77.78% 360.000 80.000 - 0.00% -
459.GemsFDTD (avg) -77.78% 360.000 80.000 - 0.00% -
410.bwaves (avg) (percentage) -77.10% 4.410 1.010 - 0.00% -
437.leslie3d (unexplained diff vs previous) -77.01% 2314.000 532.000 0.000 0.00% 0.000
437.leslie3d (unexplained diff vs previous) (percentage) -76.61% 19.880 4.650 0.000 0.00% 0.000
410.bwaves -76.31% 249.000 59.000 - -1.67% -
410.bwaves (avg) -76.31% 249.000 59.000 - -1.67% -
445.gobmk -76.02% 196.000 47.000 - -2.08% -
445.gobmk (avg) -76.02% 196.000 47.000 - -2.08% -
445.gobmk (avg) (percentage) -75.45% 3.910 0.960 - -1.03% -
482.sphinx3 (avg) (percentage) -75.28% 7.930 1.960 - -1.01% -
462.libquantum (avg) (percentage) -75.20% 7.660 1.900 - 0.53% -
459.GemsFDTD (avg) (percentage) -74.14% 5.840 1.510 - 0.00% -
471.omnetpp -72.20% 223.000 62.000 - 0.00% -
471.omnetpp (avg) -72.20% 223.000 62.000 - 0.00% -
471.omnetpp (avg) (percentage) -71.95% 8.200 2.300 - -0.86% -
481.wrf (avg) (percentage) -71.15% 6.240 1.800 - 0.00% -
401.bzip2 (avg) (percentage) -69.34% 5.480 1.680 - 0.00% -
401.bzip2 -68.94% 161.000 50.000 - 2.04% -
401.bzip2 (avg) -68.94% 161.000 50.000 - 2.04% -
400.perlbench -68.57% 105.000 33.000 - 0.00% -
400.perlbench (avg) -68.57% 105.000 33.000 - 0.00% -
400.perlbench (avg) (percentage) -65.35% 6.350 2.200 - 0.00% -
435.gromacs -63.22% 367.000 135.000 - 0.75% -
435.gromacs (avg) -63.22% 367.000 135.000 - 0.75% -
435.gromacs (avg) (percentage) -62.85% 5.060 1.880 - -0.53% -
450.soplex -61.11% 36.000 14.000 - -6.67% -
450.soplex (avg) -61.11% 36.000 14.000 - -6.67% -
473.astar -60.09% 213.000 85.000 - -1.16% -
473.astar (avg) -60.09% 213.000 85.000 - -1.16% -
473.astar (avg) (percentage) -59.86% 4.160 1.670 - -1.18% -
450.soplex (avg) (percentage) -59.41% 6.430 2.610 - 0.00% -
465.tonto (avg) (percentage) -58.38% 3.340 1.390 - 0.00% -
465.tonto -57.53% 365.000 155.000 - 0.65% -
465.tonto (avg) -57.53% 365.000 155.000 - 0.65% -
454.calculix (avg) (percentage) -55.11% 8.020 3.600 - 0.00% -
483.xalancbmk (avg) (percentage) -54.46% 6.500 2.960 - 0.00% -
437.leslie3d (max) -48.83% 1929.000 987.000 - -22.89% -
437.leslie3d (max) (percentage) -47.89% 16.580 8.640 - -19.25% -
403.gcc (avg) (percentage) -30.46% 7.320 5.090 - 0.00% -
429.mcf (avg) (percentage) -29.60% 7.670 5.400 - -1.28% -
429.mcf -4.59% 109.000 104.000 - -0.95% -
429.mcf (avg) -4.59% 109.000 104.000 - -0.95% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 134.48% 29.000 68.000 - 0.00% -
nb_compile_successful 65.52% 29.000 48.000 - 0.00% -
nb_execution_successful 65.52% 29.000 48.000 - 0.00% -

Report Time: 0.41s
Execution (seconds)
Name Current %
400.perlbench 1545.000 -
401.bzip2 2984.000 2.16%
410.bwaves 5934.000 -
429.mcf 1929.000 -
433.milc 1163.000 -
434.zeusmp 2533.000 -
435.gromacs 7215.000 1.48%
436.cactusADM 2137.000 1.71%
437.leslie3d 11431.000 -4.45%
444.namd 776.000 -
445.gobmk 4976.000 -
447.dealII 1640.000 -
450.soplex 572.000 -2.05%
453.povray 554.000 1.84%
456.hmmer 2935.000 -
458.sjeng 7360.000 -
459.GemsFDTD 5347.000 -
462.libquantum 135.000 -2.88%
464.h264ref 5847.000 -
465.tonto 11157.000 -
470.lbm 3792.000 -
471.omnetpp 2699.000 -
473.astar 5136.000 -
482.sphinx3 832.000 -
Geometric Mean 2461.423 -
Code Size (bytes)
Name Current %
400.perlbench 892155.000 -
401.bzip2 43711.000 -
410.bwaves 16464.000 -
429.mcf 9055.000 -
433.milc 60513.000 -
434.zeusmp 146647.000 -
435.gromacs 489445.000 -
436.cactusADM 348383.000 -
437.leslie3d 54774.000 -
444.namd 189776.000 -
445.gobmk 1374918.000 -
447.dealII 308436.000 -
450.soplex 202590.000 -
453.povray 649853.000 -
456.hmmer 107239.000 -
458.sjeng 106376.000 -
459.GemsFDTD 232736.000 -1.71%
462.libquantum 15893.000 -
464.h264ref 378548.000 -
465.tonto 1972378.000 -
470.lbm 9547.000 -
471.omnetpp 475410.000 -
473.astar 22752.000 -
482.sphinx3 111679.000 -
Geometric Mean 136829.735 -
sample variability
Name Current %
400.perlbench 33.000 -
400.perlbench (avg) 33.000 -
400.perlbench (avg) (percentage) 2.200 -
400.perlbench (max) 69.000 -5.48%
400.perlbench (max) (percentage) 4.530 -4.63%
401.bzip2 50.000 2.04%
401.bzip2 (avg) 50.000 2.04%
401.bzip2 (avg) (percentage) 1.680 -
401.bzip2 (max) 64.000 60.00%
401.bzip2 (max) (percentage) 2.160 55.40%
401.bzip2 (unexplained diff vs previous) 63.000 200.00%
401.bzip2 (unexplained diff vs previous) (percentage) 2.110 193.06%
403.gcc (avg) (percentage) 5.090 -
403.gcc (max) (percentage) 3.930 -
410.bwaves 59.000 -1.67%
410.bwaves (avg) 59.000 -1.67%
410.bwaves (avg) (percentage) 1.010 -
410.bwaves (max) 69.000 -11.54%
410.bwaves (max) (percentage) 1.170 -11.36%
416.gamess (avg) (percentage) 0.760 -
416.gamess (max) (percentage) 0.390 -
429.mcf 104.000 -
429.mcf (avg) 104.000 -
429.mcf (avg) (percentage) 5.400 -1.28%
429.mcf (max) 122.000 -11.59%
429.mcf (max) (percentage) 6.370 -11.16%
429.mcf (unexplained diff vs previous) 5.000 150.00%
429.mcf (unexplained diff vs previous) (percentage) 0.260 160.00%
433.milc 15.000 -
433.milc (avg) 15.000 -
433.milc (avg) (percentage) 1.330 -
433.milc (max) 19.000 -9.52%
433.milc (max) (percentage) 1.690 -7.65%
433.milc (unexplained diff vs previous) 6.000 -
433.milc (unexplained diff vs previous) (percentage) 0.520 -
434.zeusmp 27.000 -
434.zeusmp (avg) 27.000 -
434.zeusmp (avg) (percentage) 1.070 -
434.zeusmp (max) 40.000 -6.98%
434.zeusmp (max) (percentage) 1.580 -8.14%
434.zeusmp (unexplained diff vs previous) 9.000 -30.77%
434.zeusmp (unexplained diff vs previous) (percentage) 0.360 -30.77%
435.gromacs 135.000 -
435.gromacs (avg) 135.000 -
435.gromacs (avg) (percentage) 1.880 -
435.gromacs (max) 318.000 -6.19%
435.gromacs (max) (percentage) 4.420 -7.34%
435.gromacs (unexplained diff vs previous) 105.000 -55.70%
435.gromacs (unexplained diff vs previous) (percentage) 1.460 -56.16%
436.cactusADM 26.000 -
436.cactusADM (avg) 26.000 -
436.cactusADM (avg) (percentage) 1.240 -
436.cactusADM (max) 21.000 -4.55%
436.cactusADM (max) (percentage) 1.010 -7.34%
437.leslie3d 506.000 -4.35%
437.leslie3d (avg) 506.000 -4.35%
437.leslie3d (avg) (percentage) 4.430 -
437.leslie3d (max) 987.000 -22.89%
437.leslie3d (max) (percentage) 8.640 -19.25%
437.leslie3d (unexplained diff vs previous) 532.000 -
437.leslie3d (unexplained diff vs previous) (percentage) 4.650 -
444.namd 10.000 -
444.namd (avg) 10.000 -
444.namd (avg) (percentage) 1.350 -1.46%
444.namd (max) 6.000 -14.29%
444.namd (max) (percentage) 0.830 -8.79%
444.namd (unexplained diff vs previous) 2.000 -
444.namd (unexplained diff vs previous) (percentage) 0.260 -
445.gobmk 47.000 -2.08%
445.gobmk (avg) 47.000 -2.08%
445.gobmk (avg) (percentage) 0.960 -1.03%
445.gobmk (max) 55.000 -8.33%
445.gobmk (max) (percentage) 1.110 -9.02%
445.gobmk (unexplained diff vs previous) 12.000 -69.23%
445.gobmk (unexplained diff vs previous) (percentage) 0.240 -69.23%
447.dealII 20.000 -4.76%
447.dealII (avg) 20.000 -4.76%
447.dealII (avg) (percentage) 1.280 -1.54%
447.dealII (max) 30.000 -6.25%
447.dealII (max) (percentage) 1.850 -7.50%
447.dealII (unexplained diff vs previous) 3.000 -
447.dealII (unexplained diff vs previous) (percentage) 0.180 -
450.soplex 14.000 -6.67%
450.soplex (avg) 14.000 -6.67%
450.soplex (avg) (percentage) 2.610 -
450.soplex (max) 14.000 -12.50%
450.soplex (max) (percentage) 2.560 -8.57%
450.soplex (unexplained diff vs previous) 12.000 200.00%
450.soplex (unexplained diff vs previous) (percentage) 2.100 208.82%
453.povray 8.000 -
453.povray (avg) 8.000 -
453.povray (avg) (percentage) 1.620 -
453.povray (max) 12.000 -
453.povray (max) (percentage) 2.240 -3.45%
454.calculix (avg) (percentage) 3.600 -
454.calculix (max) (percentage) 0.840 -
456.hmmer 17.000 -
456.hmmer (avg) 17.000 -
456.hmmer (avg) (percentage) 0.590 -1.67%
456.hmmer (max) 17.000 -29.17%
456.hmmer (max) (percentage) 0.610 -25.61%
456.hmmer (unexplained diff vs previous) 5.000 -79.17%
456.hmmer (unexplained diff vs previous) (percentage) 0.170 -79.27%
458.sjeng 49.000 -
458.sjeng (avg) 49.000 -
458.sjeng (avg) (percentage) 0.670 -
458.sjeng (max) 41.000 -6.82%
458.sjeng (max) (percentage) 0.560 -8.20%
458.sjeng (unexplained diff vs previous) 13.000 -18.75%
458.sjeng (unexplained diff vs previous) (percentage) 0.180 -18.18%
459.GemsFDTD 80.000 -
459.GemsFDTD (avg) 80.000 -
459.GemsFDTD (avg) (percentage) 1.510 -
459.GemsFDTD (max) 168.000 -3.45%
459.GemsFDTD (max) (percentage) 3.160 -3.36%
462.libquantum 2.000 -
462.libquantum (avg) 2.000 -
462.libquantum (avg) (percentage) 1.900 -
462.libquantum (max) 4.000 -20.00%
462.libquantum (max) (percentage) 3.110 -16.62%
462.libquantum (unexplained diff vs previous) 4.000 -20.00%
462.libquantum (unexplained diff vs previous) (percentage) 2.960 -17.78%
464.h264ref 47.000 -
464.h264ref (avg) 47.000 -
464.h264ref (avg) (percentage) 0.820 -
464.h264ref (max) 54.000 -1.82%
464.h264ref (max) (percentage) 0.930 -3.12%
465.tonto 155.000 -
465.tonto (avg) 155.000 -
465.tonto (avg) (percentage) 1.390 -
465.tonto (max) 175.000 -3.85%
465.tonto (max) (percentage) 1.570 -4.27%
470.lbm 36.000 -
470.lbm (avg) 36.000 -
470.lbm (avg) (percentage) 0.960 -1.03%
470.lbm (max) 44.000 -12.00%
470.lbm (max) (percentage) 1.180 -11.28%
470.lbm (unexplained diff vs previous) 4.000 -20.00%
470.lbm (unexplained diff vs previous) (percentage) 0.110 -15.38%
471.omnetpp 62.000 -
471.omnetpp (avg) 62.000 -
471.omnetpp (avg) (percentage) 2.300 -
471.omnetpp (max) 79.000 -11.24%
471.omnetpp (max) (percentage) 2.950 -11.14%
471.omnetpp (unexplained diff vs previous) 3.000 -95.71%
471.omnetpp (unexplained diff vs previous) (percentage) 0.110 -95.77%
473.astar 85.000 -1.16%
473.astar (avg) 85.000 -1.16%
473.astar (avg) (percentage) 1.670 -1.18%
473.astar (max) 166.000 -11.23%
473.astar (max) (percentage) 3.250 -10.96%
473.astar (unexplained diff vs previous) 8.000 -
473.astar (unexplained diff vs previous) (percentage) 0.160 -
481.wrf (avg) (percentage) 1.800 -
481.wrf (max) (percentage) 0.860 -
482.sphinx3 16.000 -
482.sphinx3 (avg) 16.000 -
482.sphinx3 (avg) (percentage) 1.960 -1.01%
482.sphinx3 (max) 28.000 -9.68%
482.sphinx3 (max) (percentage) 3.460 -8.71%
482.sphinx3 (unexplained diff vs previous) 3.000 -62.50%
482.sphinx3 (unexplained diff vs previous) (percentage) 0.360 -62.50%
483.xalancbmk (avg) (percentage) 2.960 -
483.xalancbmk (max) (percentage) 1.770 -
Geometric Mean 7.086 28.30%