Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=eff93f19cb973c58fbc9899e4e111d583e4a1dbe (+ 14 commits)
git_gcc https://gcc.gnu.org/git/gcc.git (64319b2ccae2fdfae06347545e031e56d790dad7) (+ 54 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=de14f1959ee5f9b845a7cae43bee03068b8136f0 (+ 4 commits)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/b56d937da32fe959bffba6750805ade1d5fe76d3 (+ 503 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-aarch64-master-Os_LTO-build/395/
View Options
Report
Filter

gnu-aarch64-master-Os_LTO test results

Run Order Start Time Duration
Current 0395 (4-changed-components) 2025-04-10T14:27:20 0:00:00
Previous 0394 (4-changed-components) 2025-04-07T20:30:59 0:00:00
Baseline 0001 (4-changed-components) 2023-02-20T22:48:24 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 25 13
Performance Improvements 69 180
Added Tests 4 0
Unchanged Tests 1138 1043
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
471.omnetpp 2.77% 2748.000 2824.000 - 3.67% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
401.bzip2 (unexplained diff vs previous) 100.00% 11.000 22.000 - -99.80% -
401.bzip2 (unexplained diff vs previous) (percentage) 97.22% 0.360 0.710 - -99.81% -
445.gobmk (unexplained diff vs previous) 90.91% 11.000 21.000 - -99.62% -
445.gobmk (unexplained diff vs previous) (percentage) 86.96% 0.230 0.430 - -99.61% -
462.libquantum (unexplained diff vs previous) (percentage) 53.74% 1.470 2.260 - -99.98% -
473.astar (unexplained diff vs previous) (percentage) 50.60% 0.830 1.250 - -99.37% -
462.libquantum (unexplained diff vs previous) 50.00% 2.000 3.000 - -99.98% -
473.astar (unexplained diff vs previous) 48.84% 43.000 64.000 - -99.37% -
471.omnetpp (max) 47.17% 53.000 78.000 - -96.40% -
471.omnetpp (unexplained diff vs previous) 46.15% 52.000 76.000 - -99.29% -
471.omnetpp (max) (percentage) 43.52% 1.930 2.770 - -96.52% -
450.soplex (unexplained diff vs previous) (percentage) 42.47% 2.190 3.120 - -99.88% -
471.omnetpp (unexplained diff vs previous) (percentage) 42.33% 1.890 2.690 - -99.31% -
450.soplex (unexplained diff vs previous) 38.46% 13.000 18.000 - -99.88% -
462.libquantum (max) (percentage) 38.12% 1.600 2.210 - -97.77% -
465.tonto (max) 21.21% 33.000 40.000 - -98.11% -
465.tonto (unexplained diff vs previous) 21.21% 33.000 40.000 - -97.74% -
465.tonto (max) (percentage) 20.00% 0.300 0.360 - -98.14% -
465.tonto (unexplained diff vs previous) (percentage) 20.00% 0.300 0.360 - -97.78% -
433.milc (unexplained diff vs previous) (percentage) 10.47% 0.860 0.950 - -99.90% -
433.milc (unexplained diff vs previous) 10.00% 10.000 11.000 - -99.90% -
450.soplex (max) (percentage) 4.84% 2.890 3.030 - -96.85% -
471.omnetpp 3.64% 55.000 57.000 - -74.44% -
471.omnetpp (avg) 3.64% 55.000 57.000 - -74.44% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
450.soplex -3.03% 594.000 576.000 - 1.59% -
437.leslie3d -2.31% 11416.000 11152.000 - -4.19% -
462.libquantum -2.21% 136.000 133.000 - -5.00% -
473.astar -1.23% 5202.000 5138.000 - 0.20% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
435.gromacs (unexplained diff vs previous) (percentage) -95.24% 0.210 0.010 - -99.99% -
435.gromacs (unexplained diff vs previous) -93.33% 15.000 1.000 - -99.99% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -89.47% 0.570 0.060 - -99.98% -
459.GemsFDTD (unexplained diff vs previous) -89.29% 28.000 3.000 - -99.98% -
482.sphinx3 (unexplained diff vs previous) -80.00% 5.000 1.000 - -100.00% -
482.sphinx3 (unexplained diff vs previous) (percentage) -80.00% 0.600 0.120 - -100.00% -
434.zeusmp (unexplained diff vs previous) -75.00% 12.000 3.000 - -99.97% -
434.zeusmp (unexplained diff vs previous) (percentage) -74.51% 0.510 0.130 - -99.97% -
444.namd (unexplained diff vs previous) (percentage) -71.88% 0.960 0.270 - -99.98% -
444.namd (unexplained diff vs previous) -71.43% 7.000 2.000 - -99.98% -
470.lbm (unexplained diff vs previous) -67.50% 40.000 13.000 - -99.87% -
470.lbm (unexplained diff vs previous) (percentage) -67.31% 1.040 0.340 - -99.87% -
410.bwaves (unexplained diff vs previous) (percentage) -52.78% 0.360 0.170 - -99.88% -
410.bwaves (unexplained diff vs previous) -52.38% 21.000 10.000 - -99.87% -
429.mcf (unexplained diff vs previous) -47.37% 38.000 20.000 - -99.89% -
429.mcf (unexplained diff vs previous) (percentage) -46.45% 1.830 0.980 - -99.92% -
410.bwaves (max) (percentage) -45.90% 0.610 0.330 - -99.43% -
410.bwaves (max) -45.71% 35.000 19.000 - -99.42% -
437.leslie3d (unexplained diff vs previous) -45.34% 483.000 264.000 - -88.59% -
437.leslie3d (unexplained diff vs previous) (percentage) -43.97% 4.230 2.370 - -88.08% -
458.sjeng (max) -38.46% 52.000 32.000 - -99.11% -
458.sjeng (max) (percentage) -37.14% 0.700 0.440 - -99.08% -
453.povray (unexplained diff vs previous) -25.00% 4.000 3.000 - -99.95% -
453.povray (unexplained diff vs previous) (percentage) -24.32% 0.740 0.560 - -99.95% -
447.dealII (max) (percentage) -18.68% 0.910 0.740 - -99.08% -
453.povray (max) -16.67% 6.000 5.000 - -99.00% -
447.dealII (max) -14.29% 14.000 12.000 - -99.13% -
429.mcf (max) -13.16% 38.000 33.000 - -97.50% -
470.lbm (max) -12.50% 40.000 35.000 - -98.73% -
470.lbm (max) (percentage) -12.38% 1.050 0.920 - -98.73% -
429.mcf (max) (percentage) -12.30% 1.870 1.640 - -98.23% -
437.leslie3d (max) -12.10% 504.000 443.000 - -77.03% -
459.GemsFDTD (max) -10.71% 28.000 25.000 - -99.43% -
437.leslie3d (max) (percentage) -9.95% 4.420 3.980 - -76.00% -
434.zeusmp (max) (percentage) -9.80% 0.510 0.460 - -99.44% -
434.zeusmp (max) -9.09% 11.000 10.000 - -99.51% -
444.namd (max) -9.09% 11.000 10.000 - -98.54% -
459.GemsFDTD (max) (percentage) -8.62% 0.580 0.530 - -99.26% -
433.milc (max) -7.14% 14.000 13.000 - -98.75% -
433.milc (max) (percentage) -4.13% 1.210 1.160 - -98.72% -
445.gobmk (max) -4.00% 25.000 24.000 - -99.09% -
401.bzip2 (max) (percentage) -3.88% 1.030 0.990 - -98.74% -
444.namd (max) (percentage) -3.87% 1.550 1.490 - -98.38% -
482.sphinx3 (max) -3.85% 26.000 25.000 - -97.26% -
445.gobmk (max) (percentage) -3.77% 0.530 0.510 - -99.03% -
453.povray (max) (percentage) -3.60% 1.110 1.070 - -98.83% -
435.gromacs (max) -3.45% 58.000 56.000 - -98.43% -
401.bzip2 (max) -3.23% 31.000 30.000 - -98.70% -
482.sphinx3 (max) (percentage) -2.81% 3.200 3.110 - -96.78% -
437.leslie3d -2.76% 471.000 458.000 - 29.01% -
437.leslie3d (avg) -2.76% 471.000 458.000 - 29.01% -
435.gromacs (max) (percentage) -2.50% 0.800 0.780 - -98.41% -
410.bwaves -2.13% 47.000 46.000 - -81.53% -
410.bwaves (avg) -2.13% 47.000 46.000 - -81.53% -
435.gromacs -1.74% 115.000 113.000 - -69.21% -
435.gromacs (avg) -1.74% 115.000 113.000 - -69.21% -
458.sjeng (avg) (percentage) -1.69% 0.590 0.580 - -81.82% -
435.gromacs (avg) (percentage) -1.26% 1.590 1.570 - -68.97% -
473.astar -1.19% 84.000 83.000 - -61.03% -
473.astar (avg) -1.19% 84.000 83.000 - -61.03% -
434.zeusmp (avg) (percentage) -1.18% 0.850 0.840 - -85.64% -
445.gobmk (avg) (percentage) -1.18% 0.850 0.840 - -78.52% -
429.mcf -1.11% 90.000 89.000 - -18.35% -
429.mcf (avg) -1.11% 90.000 89.000 - -18.35% -
482.sphinx3 (avg) (percentage) -1.09% 1.830 1.810 - -77.18% -

Added Tests - sample variability
447.dealII (unexplained diff vs previous)
447.dealII (unexplained diff vs previous) (percentage)
458.sjeng (unexplained diff vs previous)
458.sjeng (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
410.bwaves 6.42% 16760.000 17836.000 - 0.00% -
465.tonto 1.08% 1946163.000 1967171.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
429.mcf 44.03% 1424.000 2051.000 - -0.97% -
401.bzip2 6.09% 2941.000 3120.000 - 0.71% -
471.omnetpp 3.67% 2724.000 2824.000 - 2.77% -
410.bwaves 2.23% 5652.000 5778.000 - 0.17% -
465.tonto 1.71% 10941.000 11128.000 - 0.36% -
450.soplex 1.59% 567.000 576.000 - -3.03% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d (avg) (percentage) 34.75% 3.050 4.110 - -0.48% -
437.leslie3d 29.01% 355.000 458.000 - -2.76% -
437.leslie3d (avg) 29.01% 355.000 458.000 - -2.76% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -31.03% 29.000 20.000 - 0.00% -
nb_execution_successful -31.03% 29.000 20.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d -8.59% 59479.000 54370.000 - 0.00% -
459.GemsFDTD -4.75% 244728.000 233112.000 - 0.00% -
444.namd -3.60% 188385.000 181600.000 - 0.00% -
447.dealII -2.69% 311591.000 303215.000 - 0.00% -
462.libquantum -1.94% 16085.000 15773.000 - 0.00% -
435.gromacs -1.90% 499261.000 489758.000 - 0.00% -
470.lbm -1.82% 9691.000 9515.000 - 0.00% -
434.zeusmp -1.79% 152037.000 149319.000 - 0.00% -
433.milc -1.71% 61382.000 60332.000 - 0.00% -
453.povray -1.43% 661389.000 651936.000 - 0.00% -
473.astar -1.41% 22968.000 22644.000 - 0.00% -
450.soplex -1.32% 205081.000 202372.000 - 0.00% -
401.bzip2 -1.23% 44233.000 43691.000 - 0.00% -
482.sphinx3 -1.07% 112859.000 111650.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
459.GemsFDTD -21.12% 6173.000 4869.000 - -0.06% -
482.sphinx3 -11.53% 945.000 836.000 - -0.12% -
434.zeusmp -6.80% 2514.000 2343.000 - -0.13% -
447.dealII -5.74% 1724.000 1625.000 - 0.74% -
462.libquantum -5.00% 140.000 133.000 - -2.21% -
437.leslie3d -4.19% 11640.000 11152.000 - -2.31% -
445.gobmk -2.65% 5023.000 4890.000 - 0.43% -
444.namd -2.01% 747.000 732.000 - 0.27% -
458.sjeng -1.78% 7567.000 7432.000 - -0.25% -
453.povray -1.65% 547.000 538.000 - -0.55% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
482.sphinx3 (unexplained diff vs previous) -100.00% 26073.000 1.000 - -80.00% -
482.sphinx3 (unexplained diff vs previous) (percentage) -100.00% 2759.050 0.120 - -80.00% -
435.gromacs (unexplained diff vs previous) (percentage) -99.99% 96.680 0.010 - -95.24% -
435.gromacs (unexplained diff vs previous) -99.99% 7028.000 1.000 - -93.33% -
459.GemsFDTD (unexplained diff vs previous) -99.98% 15458.000 3.000 - -89.29% -
462.libquantum (unexplained diff vs previous) -99.98% 13518.000 3.000 - 50.00% -
462.libquantum (unexplained diff vs previous) (percentage) -99.98% 9655.710 2.260 - 53.74% -
444.namd (unexplained diff vs previous) -99.98% 8356.000 2.000 - -71.43% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -99.98% 250.410 0.060 - -89.47% -
444.namd (unexplained diff vs previous) (percentage) -99.98% 1118.610 0.270 - -71.88% -
434.zeusmp (unexplained diff vs previous) -99.97% 11280.000 3.000 - -75.00% -
434.zeusmp (unexplained diff vs previous) (percentage) -99.97% 448.690 0.130 - -74.51% -
453.povray (unexplained diff vs previous) -99.95% 5707.000 3.000 - -25.00% -
453.povray (unexplained diff vs previous) (percentage) -99.95% 1043.330 0.560 - -24.32% -
429.mcf (unexplained diff vs previous) (percentage) -99.92% 1305.690 0.980 - -46.45% -
433.milc (unexplained diff vs previous) (percentage) -99.90% 980.800 0.950 - 10.47% -
433.milc (unexplained diff vs previous) -99.90% 11289.000 11.000 - 10.00% -
429.mcf (unexplained diff vs previous) -99.89% 18593.000 20.000 - -47.37% -
450.soplex (unexplained diff vs previous) (percentage) -99.88% 2557.320 3.120 - 42.47% -
410.bwaves (unexplained diff vs previous) (percentage) -99.88% 137.900 0.170 - -52.78% -
450.soplex (unexplained diff vs previous) -99.88% 14500.000 18.000 - 38.46% -
410.bwaves (unexplained diff vs previous) -99.87% 7794.000 10.000 - -52.38% -
470.lbm (unexplained diff vs previous) (percentage) -99.87% 263.730 0.340 - -67.31% -
470.lbm (unexplained diff vs previous) -99.87% 9990.000 13.000 - -67.50% -
447.dealII (unexplained diff vs previous) -99.83% 7017.000 12.000 - 0.00% -
447.dealII (unexplained diff vs previous) (percentage) -99.82% 407.020 0.740 - 0.00% -
401.bzip2 (unexplained diff vs previous) (percentage) -99.81% 368.340 0.710 - 97.22% -
401.bzip2 (unexplained diff vs previous) -99.80% 10833.000 22.000 - 100.00% -
458.sjeng (unexplained diff vs previous) -99.72% 6876.000 19.000 - 0.00% -
458.sjeng (unexplained diff vs previous) (percentage) -99.71% 90.870 0.260 - 0.00% -
445.gobmk (unexplained diff vs previous) -99.62% 5581.000 21.000 - 90.91% -
445.gobmk (unexplained diff vs previous) (percentage) -99.61% 111.110 0.430 - 86.96% -
456.hmmer (max) (percentage) -99.55% 73.590 0.330 - 0.00% -
434.zeusmp (max) -99.51% 2055.000 10.000 - -9.09% -
434.zeusmp (max) (percentage) -99.44% 81.770 0.460 - -9.80% -
459.GemsFDTD (max) -99.43% 4411.000 25.000 - -10.71% -
410.bwaves (max) (percentage) -99.43% 57.970 0.330 - -45.90% -
410.bwaves (max) -99.42% 3276.000 19.000 - -45.71% -
473.astar (unexplained diff vs previous) -99.37% 10146.000 64.000 - 48.84% -
473.astar (unexplained diff vs previous) (percentage) -99.37% 197.850 1.250 - 50.60% -
464.h264ref (max) (percentage) -99.32% 54.290 0.370 - 0.00% -
471.omnetpp (unexplained diff vs previous) (percentage) -99.31% 391.300 2.690 - 42.33% -
471.omnetpp (unexplained diff vs previous) -99.29% 10659.000 76.000 - 46.15% -
459.GemsFDTD (max) (percentage) -99.26% 71.460 0.530 - -8.62% -
454.calculix (max) (percentage) -99.18% 99.730 0.820 - 0.00% -
447.dealII (max) -99.13% 1384.000 12.000 - -14.29% -
458.sjeng (max) -99.11% 3602.000 32.000 - -38.46% -
445.gobmk (max) -99.09% 2643.000 24.000 - -4.00% -
447.dealII (max) (percentage) -99.08% 80.280 0.740 - -18.68% -
458.sjeng (max) (percentage) -99.08% 47.610 0.440 - -37.14% -
416.gamess (max) (percentage) -99.07% 38.550 0.360 - 0.00% -
436.cactusADM (max) (percentage) -99.04% 88.730 0.850 - 0.00% -
445.gobmk (max) (percentage) -99.03% 52.630 0.510 - -3.77% -
453.povray (max) -99.00% 499.000 5.000 - -16.67% -
481.wrf (max) (percentage) -98.86% 68.700 0.780 - 0.00% -
453.povray (max) (percentage) -98.83% 91.250 1.070 - -3.60% -
433.milc (max) -98.75% 1044.000 13.000 - -7.14% -
401.bzip2 (max) (percentage) -98.74% 78.650 0.990 - -3.88% -
470.lbm (max) (percentage) -98.73% 72.510 0.920 - -12.38% -
470.lbm (max) -98.73% 2746.000 35.000 - -12.50% -
433.milc (max) (percentage) -98.72% 90.750 1.160 - -4.13% -
401.bzip2 (max) -98.70% 2313.000 30.000 - -3.23% -
462.libquantum (max) -98.55% 138.000 2.000 - 0.00% -
444.namd (max) -98.54% 685.000 10.000 - -9.09% -
435.gromacs (max) -98.43% 3573.000 56.000 - -3.45% -
435.gromacs (max) (percentage) -98.41% 49.160 0.780 - -2.50% -
444.namd (max) (percentage) -98.38% 91.790 1.490 - -3.87% -
429.mcf (max) (percentage) -98.23% 92.890 1.640 - -12.30% -
465.tonto (max) (percentage) -98.14% 19.310 0.360 - 20.00% -
465.tonto (max) -98.11% 2112.000 40.000 - 21.21% -
465.tonto (unexplained diff vs previous) (percentage) -97.78% 16.190 0.360 - 20.00% -
462.libquantum (max) (percentage) -97.77% 98.970 2.210 - 38.12% -
465.tonto (unexplained diff vs previous) -97.74% 1771.000 40.000 - 21.21% -
400.perlbench (max) (percentage) -97.57% 84.060 2.040 - 0.00% -
429.mcf (max) -97.50% 1322.000 33.000 - -13.16% -
483.xalancbmk (max) (percentage) -97.42% 68.670 1.770 - 0.00% -
482.sphinx3 (max) -97.26% 911.000 25.000 - -3.85% -
450.soplex (max) -96.88% 545.000 17.000 - 0.00% -
450.soplex (max) (percentage) -96.85% 96.240 3.030 - 4.84% -
482.sphinx3 (max) (percentage) -96.78% 96.500 3.110 - -2.81% -
471.omnetpp (max) (percentage) -96.52% 79.650 2.770 - 43.52% -
471.omnetpp (max) -96.40% 2169.000 78.000 - 47.17% -
403.gcc (max) (percentage) -96.30% 99.360 3.680 - 0.00% -
473.astar (max) (percentage) -96.01% 66.430 2.650 - 0.00% -
473.astar (max) -96.01% 3406.000 136.000 - -0.73% -
437.leslie3d (unexplained diff vs previous) -88.59% 2314.000 264.000 - -45.34% -
444.namd -88.24% 68.000 8.000 - 0.00% -
444.namd (avg) -88.24% 68.000 8.000 - 0.00% -
456.hmmer (avg) (percentage) -88.21% 4.410 0.520 - 0.00% -
437.leslie3d (unexplained diff vs previous) (percentage) -88.08% 19.880 2.370 - -43.97% -
444.namd (avg) (percentage) -87.53% 9.220 1.150 - 0.00% -
470.lbm -87.45% 239.000 30.000 - 0.00% -
470.lbm (avg) -87.45% 239.000 30.000 - 0.00% -
470.lbm (avg) (percentage) -87.36% 6.330 0.800 - 0.00% -
434.zeusmp -87.07% 147.000 19.000 - 0.00% -
434.zeusmp (avg) -87.07% 147.000 19.000 - 0.00% -
464.h264ref (avg) (percentage) -86.05% 5.090 0.710 - 0.00% -
434.zeusmp (avg) (percentage) -85.64% 5.850 0.840 - -1.18% -
459.GemsFDTD -83.06% 360.000 61.000 - 0.00% -
459.GemsFDTD (avg) -83.06% 360.000 61.000 - 0.00% -
416.gamess (avg) (percentage) -82.81% 4.420 0.760 - 0.00% -
436.cactusADM (avg) (percentage) -82.44% 5.980 1.050 - 0.00% -
458.sjeng -82.16% 241.000 43.000 - 0.00% -
458.sjeng (avg) -82.16% 241.000 43.000 - 0.00% -
447.dealII -81.82% 99.000 18.000 - 0.00% -
447.dealII (avg) -81.82% 99.000 18.000 - 0.00% -
458.sjeng (avg) (percentage) -81.82% 3.190 0.580 - -1.69% -
410.bwaves (avg) (percentage) -81.63% 4.410 0.810 - -1.22% -
410.bwaves -81.53% 249.000 46.000 - -2.13% -
410.bwaves (avg) -81.53% 249.000 46.000 - -2.13% -
453.povray -80.95% 42.000 8.000 - 0.00% -
453.povray (avg) -80.95% 42.000 8.000 - 0.00% -
447.dealII (avg) (percentage) -80.76% 5.770 1.110 - -0.89% -
462.libquantum -80.00% 10.000 2.000 - 0.00% -
462.libquantum (avg) -80.00% 10.000 2.000 - 0.00% -
482.sphinx3 -79.73% 74.000 15.000 - 0.00% -
482.sphinx3 (avg) -79.73% 74.000 15.000 - 0.00% -
453.povray (avg) (percentage) -79.51% 7.810 1.600 - -0.62% -
445.gobmk -79.08% 196.000 41.000 - 0.00% -
445.gobmk (avg) -79.08% 196.000 41.000 - 0.00% -
445.gobmk (avg) (percentage) -78.52% 3.910 0.840 - -1.18% -
459.GemsFDTD (avg) (percentage) -78.42% 5.840 1.260 - -0.79% -
433.milc -78.26% 69.000 15.000 - 0.00% -
433.milc (avg) -78.26% 69.000 15.000 - 0.00% -
433.milc (avg) (percentage) -78.18% 6.050 1.320 - 0.00% -
482.sphinx3 (avg) (percentage) -77.18% 7.930 1.810 - -1.09% -
437.leslie3d (max) -77.03% 1929.000 443.000 - -12.10% -
437.leslie3d (max) (percentage) -76.00% 16.580 3.980 - -9.95% -
471.omnetpp (avg) (percentage) -75.24% 8.200 2.030 - 0.50% -
462.libquantum (avg) (percentage) -74.93% 7.660 1.920 - 0.52% -
471.omnetpp -74.44% 223.000 57.000 - 3.64% -
471.omnetpp (avg) -74.44% 223.000 57.000 - 3.64% -
481.wrf (avg) (percentage) -71.15% 6.240 1.800 - 0.00% -
401.bzip2 (avg) (percentage) -70.62% 5.480 1.610 - -0.62% -
400.perlbench (avg) (percentage) -69.45% 6.350 1.940 - 0.00% -
435.gromacs -69.21% 367.000 113.000 - -1.74% -
435.gromacs (avg) -69.21% 367.000 113.000 - -1.74% -
435.gromacs (avg) (percentage) -68.97% 5.060 1.570 - -1.26% -
401.bzip2 -68.94% 161.000 50.000 - 0.00% -
401.bzip2 (avg) -68.94% 161.000 50.000 - 0.00% -
465.tonto (avg) (percentage) -64.97% 3.340 1.170 - -0.85% -
465.tonto -64.38% 365.000 130.000 - 0.00% -
465.tonto (avg) -64.38% 365.000 130.000 - 0.00% -
450.soplex -61.11% 36.000 14.000 - 0.00% -
450.soplex (avg) -61.11% 36.000 14.000 - 0.00% -
473.astar (avg) (percentage) -61.06% 4.160 1.620 - -0.61% -
473.astar -61.03% 213.000 83.000 - -1.19% -
473.astar (avg) -61.03% 213.000 83.000 - -1.19% -
450.soplex (avg) (percentage) -60.96% 6.430 2.510 - 0.40% -
454.calculix (avg) (percentage) -55.11% 8.020 3.600 - 0.00% -
483.xalancbmk (avg) (percentage) -54.46% 6.500 2.960 - 0.00% -
429.mcf (avg) (percentage) -43.42% 7.670 4.340 - -0.69% -
403.gcc (avg) (percentage) -30.46% 7.320 5.090 - 0.00% -
429.mcf -18.35% 109.000 89.000 - -1.11% -
429.mcf (avg) -18.35% 109.000 89.000 - -1.11% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 31.03% 29.000 38.000 - 0.00% -

Report Time: 0.53s
Execution (seconds)
Name Current %
401.bzip2 3120.000 -
410.bwaves 5778.000 -
429.mcf 2051.000 -
433.milc 1155.000 -
434.zeusmp 2343.000 -
435.gromacs 7255.000 -
437.leslie3d 11152.000 -2.31%
444.namd 732.000 -
445.gobmk 4890.000 -
447.dealII 1625.000 -
450.soplex 576.000 -3.03%
453.povray 538.000 -
458.sjeng 7432.000 -
459.GemsFDTD 4869.000 -
462.libquantum 133.000 -2.21%
465.tonto 11128.000 -
470.lbm 3823.000 -
471.omnetpp 2824.000 2.77%
473.astar 5138.000 -1.23%
482.sphinx3 836.000 -
Geometric Mean 2387.593 -
Code Size (bytes)
Name Current %
401.bzip2 43691.000 -
410.bwaves 17836.000 -
429.mcf 9086.000 -
433.milc 60332.000 -
434.zeusmp 149319.000 -
435.gromacs 489758.000 -
437.leslie3d 54370.000 -
444.namd 181600.000 -
445.gobmk 1369338.000 -
447.dealII 303215.000 -
450.soplex 202372.000 -
453.povray 651936.000 -
458.sjeng 103307.000 -
459.GemsFDTD 233112.000 -
462.libquantum 15773.000 -
465.tonto 1967171.000 -
470.lbm 9515.000 -
471.omnetpp 473272.000 -
473.astar 22644.000 -
482.sphinx3 111650.000 -
Geometric Mean 114256.005 -
sample variability
Name Current %
400.perlbench (avg) (percentage) 1.940 -
400.perlbench (max) (percentage) 2.040 -
401.bzip2 50.000 -
401.bzip2 (avg) 50.000 -
401.bzip2 (avg) (percentage) 1.610 -
401.bzip2 (max) 30.000 -3.23%
401.bzip2 (max) (percentage) 0.990 -3.88%
401.bzip2 (unexplained diff vs previous) 22.000 100.00%
401.bzip2 (unexplained diff vs previous) (percentage) 0.710 97.22%
403.gcc (avg) (percentage) 5.090 -
403.gcc (max) (percentage) 3.680 -
410.bwaves 46.000 -2.13%
410.bwaves (avg) 46.000 -2.13%
410.bwaves (avg) (percentage) 0.810 -
410.bwaves (max) 19.000 -45.71%
410.bwaves (max) (percentage) 0.330 -45.90%
410.bwaves (unexplained diff vs previous) 10.000 -52.38%
410.bwaves (unexplained diff vs previous) (percentage) 0.170 -52.78%
416.gamess (avg) (percentage) 0.760 -
416.gamess (max) (percentage) 0.360 -
429.mcf 89.000 -1.11%
429.mcf (avg) 89.000 -1.11%
429.mcf (avg) (percentage) 4.340 -
429.mcf (max) 33.000 -13.16%
429.mcf (max) (percentage) 1.640 -12.30%
429.mcf (unexplained diff vs previous) 20.000 -47.37%
429.mcf (unexplained diff vs previous) (percentage) 0.980 -46.45%
433.milc 15.000 -
433.milc (avg) 15.000 -
433.milc (avg) (percentage) 1.320 -
433.milc (max) 13.000 -7.14%
433.milc (max) (percentage) 1.160 -4.13%
433.milc (unexplained diff vs previous) 11.000 10.00%
433.milc (unexplained diff vs previous) (percentage) 0.950 10.47%
434.zeusmp 19.000 -
434.zeusmp (avg) 19.000 -
434.zeusmp (avg) (percentage) 0.840 -1.18%
434.zeusmp (max) 10.000 -9.09%
434.zeusmp (max) (percentage) 0.460 -9.80%
434.zeusmp (unexplained diff vs previous) 3.000 -75.00%
434.zeusmp (unexplained diff vs previous) (percentage) 0.130 -74.51%
435.gromacs 113.000 -1.74%
435.gromacs (avg) 113.000 -1.74%
435.gromacs (avg) (percentage) 1.570 -1.26%
435.gromacs (max) 56.000 -3.45%
435.gromacs (max) (percentage) 0.780 -2.50%
435.gromacs (unexplained diff vs previous) 1.000 -93.33%
435.gromacs (unexplained diff vs previous) (percentage) 0.010 -95.24%
436.cactusADM (avg) (percentage) 1.050 -
436.cactusADM (max) (percentage) 0.850 -
437.leslie3d 458.000 -2.76%
437.leslie3d (avg) 458.000 -2.76%
437.leslie3d (avg) (percentage) 4.110 -
437.leslie3d (max) 443.000 -12.10%
437.leslie3d (max) (percentage) 3.980 -9.95%
437.leslie3d (unexplained diff vs previous) 264.000 -45.34%
437.leslie3d (unexplained diff vs previous) (percentage) 2.370 -43.97%
444.namd 8.000 -
444.namd (avg) 8.000 -
444.namd (avg) (percentage) 1.150 -
444.namd (max) 10.000 -9.09%
444.namd (max) (percentage) 1.490 -3.87%
444.namd (unexplained diff vs previous) 2.000 -71.43%
444.namd (unexplained diff vs previous) (percentage) 0.270 -71.88%
445.gobmk 41.000 -
445.gobmk (avg) 41.000 -
445.gobmk (avg) (percentage) 0.840 -1.18%
445.gobmk (max) 24.000 -4.00%
445.gobmk (max) (percentage) 0.510 -3.77%
445.gobmk (unexplained diff vs previous) 21.000 90.91%
445.gobmk (unexplained diff vs previous) (percentage) 0.430 86.96%
447.dealII 18.000 -
447.dealII (avg) 18.000 -
447.dealII (avg) (percentage) 1.110 -
447.dealII (max) 12.000 -14.29%
447.dealII (max) (percentage) 0.740 -18.68%
447.dealII (unexplained diff vs previous) 12.000 -
447.dealII (unexplained diff vs previous) (percentage) 0.740 -
450.soplex 14.000 -
450.soplex (avg) 14.000 -
450.soplex (avg) (percentage) 2.510 -
450.soplex (max) 17.000 -
450.soplex (max) (percentage) 3.030 4.84%
450.soplex (unexplained diff vs previous) 18.000 38.46%
450.soplex (unexplained diff vs previous) (percentage) 3.120 42.47%
453.povray 8.000 -
453.povray (avg) 8.000 -
453.povray (avg) (percentage) 1.600 -
453.povray (max) 5.000 -16.67%
453.povray (max) (percentage) 1.070 -3.60%
453.povray (unexplained diff vs previous) 3.000 -25.00%
453.povray (unexplained diff vs previous) (percentage) 0.560 -24.32%
454.calculix (avg) (percentage) 3.600 -
454.calculix (max) (percentage) 0.820 -
456.hmmer (avg) (percentage) 0.520 -
456.hmmer (max) (percentage) 0.330 -
458.sjeng 43.000 -
458.sjeng (avg) 43.000 -
458.sjeng (avg) (percentage) 0.580 -1.69%
458.sjeng (max) 32.000 -38.46%
458.sjeng (max) (percentage) 0.440 -37.14%
458.sjeng (unexplained diff vs previous) 19.000 -
458.sjeng (unexplained diff vs previous) (percentage) 0.260 -
459.GemsFDTD 61.000 -
459.GemsFDTD (avg) 61.000 -
459.GemsFDTD (avg) (percentage) 1.260 -
459.GemsFDTD (max) 25.000 -10.71%
459.GemsFDTD (max) (percentage) 0.530 -8.62%
459.GemsFDTD (unexplained diff vs previous) 3.000 -89.29%
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.060 -89.47%
462.libquantum 2.000 -
462.libquantum (avg) 2.000 -
462.libquantum (avg) (percentage) 1.920 -
462.libquantum (max) 2.000 -
462.libquantum (max) (percentage) 2.210 38.12%
462.libquantum (unexplained diff vs previous) 3.000 50.00%
462.libquantum (unexplained diff vs previous) (percentage) 2.260 53.74%
464.h264ref (avg) (percentage) 0.710 -
464.h264ref (max) (percentage) 0.370 -
465.tonto 130.000 -
465.tonto (avg) 130.000 -
465.tonto (avg) (percentage) 1.170 -
465.tonto (max) 40.000 21.21%
465.tonto (max) (percentage) 0.360 20.00%
465.tonto (unexplained diff vs previous) 40.000 21.21%
465.tonto (unexplained diff vs previous) (percentage) 0.360 20.00%
470.lbm 30.000 -
470.lbm (avg) 30.000 -
470.lbm (avg) (percentage) 0.800 -
470.lbm (max) 35.000 -12.50%
470.lbm (max) (percentage) 0.920 -12.38%
470.lbm (unexplained diff vs previous) 13.000 -67.50%
470.lbm (unexplained diff vs previous) (percentage) 0.340 -67.31%
471.omnetpp 57.000 3.64%
471.omnetpp (avg) 57.000 3.64%
471.omnetpp (avg) (percentage) 2.030 -
471.omnetpp (max) 78.000 47.17%
471.omnetpp (max) (percentage) 2.770 43.52%
471.omnetpp (unexplained diff vs previous) 76.000 46.15%
471.omnetpp (unexplained diff vs previous) (percentage) 2.690 42.33%
473.astar 83.000 -1.19%
473.astar (avg) 83.000 -1.19%
473.astar (avg) (percentage) 1.620 -
473.astar (max) 136.000 -
473.astar (max) (percentage) 2.650 -
473.astar (unexplained diff vs previous) 64.000 48.84%
473.astar (unexplained diff vs previous) (percentage) 1.250 50.60%
481.wrf (avg) (percentage) 1.800 -
481.wrf (max) (percentage) 0.780 -
482.sphinx3 15.000 -
482.sphinx3 (avg) 15.000 -
482.sphinx3 (avg) (percentage) 1.810 -1.09%
482.sphinx3 (max) 25.000 -3.85%
482.sphinx3 (max) (percentage) 3.110 -2.81%
482.sphinx3 (unexplained diff vs previous) 1.000 -80.00%
482.sphinx3 (unexplained diff vs previous) (percentage) 0.120 -80.00%
483.xalancbmk (avg) (percentage) 2.960 -
483.xalancbmk (max) (percentage) 1.770 -
Geometric Mean 4.803 -14.93%