Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=ef8975b494c8c9bca73cda76c33244bb5fd1677f (+ 23 commits)
git_gcc https://gcc.gnu.org/git/gcc.git (ccf9db9a6fa4b5bc7aad5e9603e2ac71984142a0) (+ 36 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=4cf2d869367e3813c6c8f662915dedb1f3830c53 (+ 3 commits)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/68b02c3ac18b9686154702eb4aa2e5327d35e3ac (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-aarch64-master-Os_LTO-build/375/
View Options
Report
Filter

gnu-aarch64-master-Os_LTO test results

Run Order Start Time Duration
Current 0375 (3-changed-components) 2025-03-01T06:58:51 0:00:00
Previous 0374 (3-changed-components) 2025-02-26T05:05:20 0:00:00
Baseline 0001 (4-changed-components) 2023-02-20T22:48:24 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 14 10
Performance Improvements 78 179
Unchanged Tests 1144 1047
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
462.libquantum 2.26% 133.000 136.000 - -2.86% -
450.soplex 1.20% 582.000 589.000 - 3.88% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
429.mcf (unexplained diff vs previous) 1350.00% 2.000 29.000 - -99.84% -
429.mcf (unexplained diff vs previous) (percentage) 1340.00% 0.100 1.440 - -99.89% -
450.soplex (unexplained diff vs previous) 250.00% 2.000 7.000 - -99.95% -
450.soplex (unexplained diff vs previous) (percentage) 250.00% 0.340 1.190 - -99.95% -
459.GemsFDTD (unexplained diff vs previous) 212.50% 8.000 25.000 - -99.84% -
459.GemsFDTD (unexplained diff vs previous) (percentage) 205.88% 0.170 0.520 - -99.79% -
410.bwaves (unexplained diff vs previous) (percentage) 154.84% 0.310 0.790 - -99.43% -
410.bwaves (unexplained diff vs previous) 150.00% 18.000 45.000 - -99.42% -
435.gromacs (unexplained diff vs previous) (percentage) 136.76% 0.680 1.610 - -98.33% -
465.tonto (unexplained diff vs previous) 135.71% 14.000 33.000 - -98.14% -
435.gromacs (unexplained diff vs previous) 132.65% 49.000 114.000 - -98.38% -
465.tonto (unexplained diff vs previous) (percentage) 130.77% 0.130 0.300 - -98.15% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
437.leslie3d -2.70% 11668.000 11353.000 - -2.47% -
435.gromacs -1.58% 7213.000 7099.000 - -2.34% -
429.mcf -1.42% 2046.000 2017.000 - 41.64% -
453.povray -1.09% 548.000 542.000 - -0.91% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
434.zeusmp (unexplained diff vs previous) (percentage) -86.67% 0.300 0.040 - -99.99% -
434.zeusmp (unexplained diff vs previous) -85.71% 7.000 1.000 - -99.99% -
471.omnetpp (unexplained diff vs previous) -83.33% 48.000 8.000 - -99.92% -
471.omnetpp (unexplained diff vs previous) (percentage) -83.05% 1.770 0.300 - -99.92% -
473.astar (unexplained diff vs previous) -70.37% 27.000 8.000 - -99.92% -
473.astar (unexplained diff vs previous) (percentage) -69.23% 0.520 0.160 - -99.92% -
447.dealII (max) (percentage) -65.20% 2.500 0.870 - -98.92% -
447.dealII (max) -65.00% 40.000 14.000 - -98.99% -
401.bzip2 (unexplained diff vs previous) (percentage) -59.84% 1.220 0.490 - -99.87% -
401.bzip2 (unexplained diff vs previous) -59.46% 37.000 15.000 - -99.86% -
453.povray (unexplained diff vs previous) -57.14% 14.000 6.000 - -99.89% -
453.povray (unexplained diff vs previous) (percentage) -56.47% 2.550 1.110 - -99.89% -
444.namd (unexplained diff vs previous) -55.56% 9.000 4.000 - -99.95% -
444.namd (unexplained diff vs previous) (percentage) -54.92% 1.220 0.550 - -99.95% -
437.leslie3d (unexplained diff vs previous) -50.24% 633.000 315.000 - -86.39% -
437.leslie3d (unexplained diff vs previous) (percentage) -48.99% 5.430 2.770 - -86.07% -
453.povray (max) (percentage) -42.72% 4.190 2.400 - -97.37% -
470.lbm (max) (percentage) -41.30% 1.840 1.080 - -98.51% -
453.povray (max) -40.91% 22.000 13.000 - -97.39% -
470.lbm (max) -40.58% 69.000 41.000 - -98.51% -
433.milc (unexplained diff vs previous) (percentage) -38.57% 0.700 0.430 - -99.96% -
433.milc (unexplained diff vs previous) -37.50% 8.000 5.000 - -99.96% -
434.zeusmp (max) -34.48% 29.000 19.000 - -99.08% -
447.dealII (unexplained diff vs previous) (percentage) -34.41% 0.930 0.610 - -99.85% -
434.zeusmp (max) (percentage) -33.86% 1.270 0.840 - -98.97% -
447.dealII (unexplained diff vs previous) -33.33% 15.000 10.000 - -99.86% -
437.leslie3d (max) -27.06% 669.000 488.000 - -74.70% -
458.sjeng (max) -25.53% 94.000 70.000 - -98.06% -
437.leslie3d (max) (percentage) -25.09% 5.740 4.300 - -74.07% -
458.sjeng (max) (percentage) -24.00% 1.250 0.950 - -98.00% -
458.sjeng (unexplained diff vs previous) -22.35% 85.000 66.000 - -99.04% -
458.sjeng (unexplained diff vs previous) (percentage) -22.12% 1.130 0.880 - -99.03% -
470.lbm (unexplained diff vs previous) -19.05% 21.000 17.000 - -99.83% -
470.lbm (unexplained diff vs previous) (percentage) -18.18% 0.550 0.450 - -99.83% -
462.libquantum (max) -16.67% 6.000 5.000 - -96.38% -
444.namd (max) -12.50% 8.000 7.000 - -98.98% -
444.namd (max) (percentage) -12.40% 1.210 1.060 - -98.85% -
471.omnetpp (max) -11.94% 67.000 59.000 - -97.28% -
471.omnetpp (max) (percentage) -11.24% 2.490 2.210 - -97.23% -
429.mcf (max) -7.37% 190.000 176.000 - -86.69% -
429.mcf (max) (percentage) -6.23% 9.310 8.730 - -90.60% -
450.soplex (max) (percentage) -6.16% 4.710 4.420 - -95.41% -
473.astar (max) (percentage) -6.13% 4.240 3.980 - -94.01% -
401.bzip2 (max) (percentage) -6.12% 4.900 4.600 - -94.15% -
482.sphinx3 (max) (percentage) -6.05% 3.140 2.950 - -96.94% -
473.astar (max) -5.96% 218.000 205.000 - -93.98% -
459.GemsFDTD (max) (percentage) -5.93% 2.700 2.540 - -96.45% -
459.GemsFDTD (max) -5.43% 129.000 122.000 - -97.23% -
401.bzip2 (max) -5.41% 148.000 140.000 - -93.95% -
433.milc (max) (percentage) -4.67% 4.500 4.290 - -95.27% -
462.libquantum (max) (percentage) -4.61% 4.560 4.350 - -95.60% -
435.gromacs (max) -4.58% 131.000 125.000 - -96.50% -
465.tonto (max) -4.41% 272.000 260.000 - -87.69% -
465.tonto (max) (percentage) -4.40% 2.500 2.390 - -87.62% -
433.milc (max) -3.92% 51.000 49.000 - -95.31% -
482.sphinx3 (max) -3.85% 26.000 25.000 - -97.26% -
450.soplex (max) -3.70% 27.000 26.000 - -95.23% -
445.gobmk (max) -3.08% 65.000 63.000 - -97.62% -
445.gobmk (max) (percentage) -2.99% 1.340 1.300 - -97.53% -
437.leslie3d -2.87% 488.000 474.000 - 33.52% -
437.leslie3d (avg) -2.87% 488.000 474.000 - 33.52% -
435.gromacs (max) (percentage) -2.75% 1.820 1.770 - -96.40% -
429.mcf -2.15% 93.000 91.000 - -16.51% -
429.mcf (avg) -2.15% 93.000 91.000 - -16.51% -
471.omnetpp -1.75% 57.000 56.000 - -74.89% -
471.omnetpp (avg) -1.75% 57.000 56.000 - -74.89% -
459.GemsFDTD -1.59% 63.000 62.000 - -82.78% -
459.GemsFDTD (avg) -1.59% 63.000 62.000 - -82.78% -
465.tonto -1.48% 135.000 133.000 - -63.56% -
465.tonto (avg) -1.48% 135.000 133.000 - -63.56% -
481.wrf (max) (percentage) -1.27% 0.790 0.780 - -98.86% -
445.gobmk (avg) (percentage) -1.15% 0.870 0.860 - -78.01% -
434.zeusmp (avg) (percentage) -1.14% 0.880 0.870 - -85.13% -
482.sphinx3 (unexplained diff vs previous) (percentage) -1.05% 0.950 0.940 - -99.97% -

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
410.bwaves 6.40% 16760.000 17832.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
429.mcf 41.64% 1424.000 2017.000 - -1.42% -
450.soplex 3.88% 567.000 589.000 - 1.20% -
401.bzip2 3.67% 2941.000 3049.000 - 0.49% -
410.bwaves 1.20% 5652.000 5720.000 - -0.78% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d (avg) (percentage) 37.05% 3.050 4.180 - -0.24% -
437.leslie3d 33.52% 355.000 474.000 - -2.87% -
437.leslie3d (avg) 33.52% 355.000 474.000 - -2.87% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -31.03% 29.000 20.000 - 0.00% -
nb_execution_successful -31.03% 29.000 20.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d -8.69% 59479.000 54310.000 - 0.00% -
459.GemsFDTD -4.85% 244728.000 232852.000 - 0.00% -
447.dealII -2.16% 311591.000 304874.000 - 0.00% -
462.libquantum -1.89% 16085.000 15781.000 - 0.00% -
434.zeusmp -1.82% 152037.000 149263.000 - 0.00% -
435.gromacs -1.76% 499261.000 490450.000 - 0.00% -
433.milc -1.53% 61382.000 60440.000 - 0.00% -
470.lbm -1.49% 9691.000 9547.000 - 0.00% -
453.povray -1.26% 661389.000 653088.000 - 0.00% -
444.namd -1.24% 188385.000 186052.000 - 0.00% -
401.bzip2 -1.13% 44233.000 43735.000 - 0.00% -
473.astar -1.04% 22968.000 22728.000 - 0.00% -
482.sphinx3 -1.03% 112859.000 111702.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
459.GemsFDTD -21.61% 6173.000 4839.000 - 0.52% -
482.sphinx3 -10.16% 945.000 849.000 - 0.95% -
434.zeusmp -6.56% 2514.000 2349.000 - -0.04% -
447.dealII -5.39% 1724.000 1631.000 - 0.62% -
462.libquantum -2.86% 140.000 136.000 - 2.26% -
445.gobmk -2.55% 5023.000 4895.000 - -0.06% -
437.leslie3d -2.47% 11640.000 11353.000 - -2.70% -
435.gromacs -2.34% 7269.000 7099.000 - -1.58% -
444.namd -2.14% 747.000 731.000 - -0.54% -
458.sjeng -1.27% 7567.000 7471.000 - -0.88% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
434.zeusmp (unexplained diff vs previous) -99.99% 11280.000 1.000 - -85.71% -
434.zeusmp (unexplained diff vs previous) (percentage) -99.99% 448.690 0.040 - -86.67% -
462.libquantum (unexplained diff vs previous) -99.98% 13518.000 3.000 - 0.00% -
462.libquantum (unexplained diff vs previous) (percentage) -99.98% 9655.710 2.210 - 0.00% -
482.sphinx3 (unexplained diff vs previous) -99.97% 26073.000 8.000 - 0.00% -
482.sphinx3 (unexplained diff vs previous) (percentage) -99.97% 2759.050 0.940 - -1.05% -
433.milc (unexplained diff vs previous) (percentage) -99.96% 980.800 0.430 - -38.57% -
433.milc (unexplained diff vs previous) -99.96% 11289.000 5.000 - -37.50% -
450.soplex (unexplained diff vs previous) (percentage) -99.95% 2557.320 1.190 - 250.00% -
444.namd (unexplained diff vs previous) -99.95% 8356.000 4.000 - -55.56% -
450.soplex (unexplained diff vs previous) -99.95% 14500.000 7.000 - 250.00% -
444.namd (unexplained diff vs previous) (percentage) -99.95% 1118.610 0.550 - -54.92% -
445.gobmk (unexplained diff vs previous) -99.95% 5581.000 3.000 - 0.00% -
445.gobmk (unexplained diff vs previous) (percentage) -99.95% 111.110 0.060 - 0.00% -
471.omnetpp (unexplained diff vs previous) -99.92% 10659.000 8.000 - -83.33% -
471.omnetpp (unexplained diff vs previous) (percentage) -99.92% 391.300 0.300 - -83.05% -
473.astar (unexplained diff vs previous) -99.92% 10146.000 8.000 - -70.37% -
473.astar (unexplained diff vs previous) (percentage) -99.92% 197.850 0.160 - -69.23% -
453.povray (unexplained diff vs previous) -99.89% 5707.000 6.000 - -57.14% -
453.povray (unexplained diff vs previous) (percentage) -99.89% 1043.330 1.110 - -56.47% -
429.mcf (unexplained diff vs previous) (percentage) -99.89% 1305.690 1.440 - 1340.00% -
401.bzip2 (unexplained diff vs previous) (percentage) -99.87% 368.340 0.490 - -59.84% -
401.bzip2 (unexplained diff vs previous) -99.86% 10833.000 15.000 - -59.46% -
447.dealII (unexplained diff vs previous) -99.86% 7017.000 10.000 - -33.33% -
447.dealII (unexplained diff vs previous) (percentage) -99.85% 407.020 0.610 - -34.41% -
429.mcf (unexplained diff vs previous) -99.84% 18593.000 29.000 - 1350.00% -
459.GemsFDTD (unexplained diff vs previous) -99.84% 15458.000 25.000 - 212.50% -
470.lbm (unexplained diff vs previous) -99.83% 9990.000 17.000 - -19.05% -
470.lbm (unexplained diff vs previous) (percentage) -99.83% 263.730 0.450 - -18.18% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -99.79% 250.410 0.520 - 205.88% -
456.hmmer (max) (percentage) -99.54% 73.590 0.340 - 0.00% -
410.bwaves (unexplained diff vs previous) (percentage) -99.43% 137.900 0.790 - 154.84% -
410.bwaves (unexplained diff vs previous) -99.42% 7794.000 45.000 - 150.00% -
464.h264ref (max) (percentage) -99.32% 54.290 0.370 - 0.00% -
454.calculix (max) (percentage) -99.18% 99.730 0.820 - 0.00% -
434.zeusmp (max) -99.08% 2055.000 19.000 - -34.48% -
416.gamess (max) (percentage) -99.07% 38.550 0.360 - 0.00% -
458.sjeng (unexplained diff vs previous) -99.04% 6876.000 66.000 - -22.35% -
458.sjeng (unexplained diff vs previous) (percentage) -99.03% 90.870 0.880 - -22.12% -
436.cactusADM (max) (percentage) -99.03% 88.730 0.860 - 0.00% -
447.dealII (max) -98.99% 1384.000 14.000 - -65.00% -
444.namd (max) -98.98% 685.000 7.000 - -12.50% -
434.zeusmp (max) (percentage) -98.97% 81.770 0.840 - -33.86% -
447.dealII (max) (percentage) -98.92% 80.280 0.870 - -65.20% -
481.wrf (max) (percentage) -98.86% 68.700 0.780 - -1.27% -
444.namd (max) (percentage) -98.85% 91.790 1.060 - -12.40% -
410.bwaves (max) -98.66% 3276.000 44.000 - 0.00% -
410.bwaves (max) (percentage) -98.65% 57.970 0.780 - 0.00% -
470.lbm (max) (percentage) -98.51% 72.510 1.080 - -41.30% -
470.lbm (max) -98.51% 2746.000 41.000 - -40.58% -
435.gromacs (unexplained diff vs previous) -98.38% 7028.000 114.000 - 132.65% -
435.gromacs (unexplained diff vs previous) (percentage) -98.33% 96.680 1.610 - 136.76% -
465.tonto (unexplained diff vs previous) (percentage) -98.15% 16.190 0.300 - 130.77% -
465.tonto (unexplained diff vs previous) -98.14% 1771.000 33.000 - 135.71% -
458.sjeng (max) -98.06% 3602.000 70.000 - -25.53% -
458.sjeng (max) (percentage) -98.00% 47.610 0.950 - -24.00% -
445.gobmk (max) -97.62% 2643.000 63.000 - -3.08% -
445.gobmk (max) (percentage) -97.53% 52.630 1.300 - -2.99% -
400.perlbench (max) (percentage) -97.53% 84.060 2.080 - -0.48% -
483.xalancbmk (max) (percentage) -97.42% 68.670 1.770 - 0.00% -
453.povray (max) -97.39% 499.000 13.000 - -40.91% -
453.povray (max) (percentage) -97.37% 91.250 2.400 - -42.72% -
471.omnetpp (max) -97.28% 2169.000 59.000 - -11.94% -
482.sphinx3 (max) -97.26% 911.000 25.000 - -3.85% -
459.GemsFDTD (max) -97.23% 4411.000 122.000 - -5.43% -
471.omnetpp (max) (percentage) -97.23% 79.650 2.210 - -11.24% -
482.sphinx3 (max) (percentage) -96.94% 96.500 2.950 - -6.05% -
435.gromacs (max) -96.50% 3573.000 125.000 - -4.58% -
459.GemsFDTD (max) (percentage) -96.45% 71.460 2.540 - -5.93% -
435.gromacs (max) (percentage) -96.40% 49.160 1.770 - -2.75% -
462.libquantum (max) -96.38% 138.000 5.000 - -16.67% -
403.gcc (max) (percentage) -96.29% 99.360 3.690 - 0.00% -
462.libquantum (max) (percentage) -95.60% 98.970 4.350 - -4.61% -
450.soplex (max) (percentage) -95.41% 96.240 4.420 - -6.16% -
433.milc (max) -95.31% 1044.000 49.000 - -3.92% -
433.milc (max) (percentage) -95.27% 90.750 4.290 - -4.67% -
450.soplex (max) -95.23% 545.000 26.000 - -3.70% -
401.bzip2 (max) (percentage) -94.15% 78.650 4.600 - -6.12% -
473.astar (max) (percentage) -94.01% 66.430 3.980 - -6.13% -
473.astar (max) -93.98% 3406.000 205.000 - -5.96% -
401.bzip2 (max) -93.95% 2313.000 140.000 - -5.41% -
429.mcf (max) (percentage) -90.60% 92.890 8.730 - -6.23% -
444.namd -88.24% 68.000 8.000 - 0.00% -
444.namd (avg) -88.24% 68.000 8.000 - 0.00% -
456.hmmer (avg) (percentage) -88.21% 4.410 0.520 - 0.00% -
465.tonto (max) -87.69% 2112.000 260.000 - -4.41% -
465.tonto (max) (percentage) -87.62% 19.310 2.390 - -4.40% -
444.namd (avg) (percentage) -87.53% 9.220 1.150 - -0.86% -
470.lbm (avg) (percentage) -87.05% 6.330 0.820 - 0.00% -
470.lbm -87.03% 239.000 31.000 - 0.00% -
470.lbm (avg) -87.03% 239.000 31.000 - 0.00% -
429.mcf (max) -86.69% 1322.000 176.000 - -7.37% -
434.zeusmp -86.39% 147.000 20.000 - 0.00% -
434.zeusmp (avg) -86.39% 147.000 20.000 - 0.00% -
437.leslie3d (unexplained diff vs previous) -86.39% 2314.000 315.000 - -50.24% -
437.leslie3d (unexplained diff vs previous) (percentage) -86.07% 19.880 2.770 - -48.99% -
464.h264ref (avg) (percentage) -86.05% 5.090 0.710 - 0.00% -
434.zeusmp (avg) (percentage) -85.13% 5.850 0.870 - -1.14% -
416.gamess (avg) (percentage) -82.81% 4.420 0.760 - 0.00% -
459.GemsFDTD -82.78% 360.000 62.000 - -1.59% -
459.GemsFDTD (avg) -82.78% 360.000 62.000 - -1.59% -
436.cactusADM (avg) (percentage) -82.44% 5.980 1.050 - 0.00% -
447.dealII -81.82% 99.000 18.000 - 0.00% -
447.dealII (avg) -81.82% 99.000 18.000 - 0.00% -
458.sjeng -81.74% 241.000 44.000 - 0.00% -
458.sjeng (avg) -81.74% 241.000 44.000 - 0.00% -
458.sjeng (avg) (percentage) -81.50% 3.190 0.590 - 0.00% -
410.bwaves (avg) (percentage) -81.18% 4.410 0.830 - 0.00% -
410.bwaves -81.12% 249.000 47.000 - 0.00% -
410.bwaves (avg) -81.12% 249.000 47.000 - 0.00% -
453.povray -80.95% 42.000 8.000 - 0.00% -
453.povray (avg) -80.95% 42.000 8.000 - 0.00% -
447.dealII (avg) (percentage) -80.42% 5.770 1.130 - 0.00% -
462.libquantum -80.00% 10.000 2.000 - 0.00% -
462.libquantum (avg) -80.00% 10.000 2.000 - 0.00% -
482.sphinx3 -79.73% 74.000 15.000 - 0.00% -
482.sphinx3 (avg) -79.73% 74.000 15.000 - 0.00% -
453.povray (avg) (percentage) -79.13% 7.810 1.630 - -0.61% -
445.gobmk -78.57% 196.000 42.000 - 0.00% -
445.gobmk (avg) -78.57% 196.000 42.000 - 0.00% -
433.milc -78.26% 69.000 15.000 - 0.00% -
433.milc (avg) -78.26% 69.000 15.000 - 0.00% -
433.milc (avg) (percentage) -78.02% 6.050 1.330 - -0.75% -
445.gobmk (avg) (percentage) -78.01% 3.910 0.860 - -1.15% -
459.GemsFDTD (avg) (percentage) -77.74% 5.840 1.300 - -0.76% -
482.sphinx3 (avg) (percentage) -77.18% 7.930 1.810 - -0.55% -
471.omnetpp -74.89% 223.000 56.000 - -1.75% -
471.omnetpp (avg) -74.89% 223.000 56.000 - -1.75% -
437.leslie3d (max) -74.70% 1929.000 488.000 - -27.06% -
462.libquantum (avg) (percentage) -74.67% 7.660 1.940 - 0.00% -
471.omnetpp (avg) (percentage) -74.63% 8.200 2.080 - -0.95% -
437.leslie3d (max) (percentage) -74.07% 16.580 4.300 - -25.09% -
481.wrf (avg) (percentage) -71.15% 6.240 1.800 - 0.00% -
401.bzip2 (avg) (percentage) -69.71% 5.480 1.660 - -0.60% -
400.perlbench (avg) (percentage) -69.45% 6.350 1.940 - 0.00% -
401.bzip2 -68.94% 161.000 50.000 - 0.00% -
401.bzip2 (avg) -68.94% 161.000 50.000 - 0.00% -
435.gromacs -68.66% 367.000 115.000 - -0.86% -
435.gromacs (avg) -68.66% 367.000 115.000 - -0.86% -
435.gromacs (avg) (percentage) -67.98% 5.060 1.620 - 0.00% -
465.tonto -63.56% 365.000 133.000 - -1.48% -
465.tonto (avg) -63.56% 365.000 133.000 - -1.48% -
465.tonto (avg) (percentage) -63.17% 3.340 1.230 - -0.81% -
450.soplex -61.11% 36.000 14.000 - 0.00% -
450.soplex (avg) -61.11% 36.000 14.000 - 0.00% -
450.soplex (avg) (percentage) -60.96% 6.430 2.510 - -0.79% -
473.astar (avg) (percentage) -59.86% 4.160 1.670 - -0.60% -
473.astar -59.62% 213.000 86.000 - 0.00% -
473.astar (avg) -59.62% 213.000 86.000 - 0.00% -
454.calculix (avg) (percentage) -55.11% 8.020 3.600 - 0.00% -
483.xalancbmk (avg) (percentage) -54.46% 6.500 2.960 - 0.00% -
429.mcf (avg) (percentage) -41.07% 7.670 4.520 - -0.66% -
403.gcc (avg) (percentage) -30.46% 7.320 5.090 - 0.00% -
429.mcf -16.51% 109.000 91.000 - -2.15% -
429.mcf (avg) -16.51% 109.000 91.000 - -2.15% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 31.03% 29.000 38.000 - 0.00% -

Report Time: 0.36s
Execution (seconds)
Name Current %
401.bzip2 3049.000 -
410.bwaves 5720.000 -
429.mcf 2017.000 -1.42%
433.milc 1155.000 -
434.zeusmp 2349.000 -
435.gromacs 7099.000 -1.58%
437.leslie3d 11353.000 -2.70%
444.namd 731.000 -
445.gobmk 4895.000 -
447.dealII 1631.000 -
450.soplex 589.000 1.20%
453.povray 542.000 -1.09%
458.sjeng 7471.000 -
459.GemsFDTD 4839.000 -
462.libquantum 136.000 2.26%
465.tonto 10885.000 -
470.lbm 3815.000 -
471.omnetpp 2711.000 -
473.astar 5157.000 -
482.sphinx3 849.000 -
Geometric Mean 2382.512 -
Code Size (bytes)
Name Current %
401.bzip2 43735.000 -
410.bwaves 17832.000 -
429.mcf 9086.000 -
433.milc 60440.000 -
434.zeusmp 149263.000 -
435.gromacs 490450.000 -
437.leslie3d 54310.000 -
444.namd 186052.000 -
445.gobmk 1374806.000 -
447.dealII 304874.000 -
450.soplex 203251.000 -
453.povray 653088.000 -
458.sjeng 103327.000 -
459.GemsFDTD 232852.000 -
462.libquantum 15781.000 -
465.tonto 1964847.000 -
470.lbm 9547.000 -
471.omnetpp 475129.000 -
473.astar 22728.000 -
482.sphinx3 111702.000 -
Geometric Mean 114554.081 -
sample variability
Name Current %
400.perlbench (avg) (percentage) 1.940 -
400.perlbench (max) (percentage) 2.080 -
401.bzip2 50.000 -
401.bzip2 (avg) 50.000 -
401.bzip2 (avg) (percentage) 1.660 -
401.bzip2 (max) 140.000 -5.41%
401.bzip2 (max) (percentage) 4.600 -6.12%
401.bzip2 (unexplained diff vs previous) 15.000 -59.46%
401.bzip2 (unexplained diff vs previous) (percentage) 0.490 -59.84%
403.gcc (avg) (percentage) 5.090 -
403.gcc (max) (percentage) 3.690 -
410.bwaves 47.000 -
410.bwaves (avg) 47.000 -
410.bwaves (avg) (percentage) 0.830 -
410.bwaves (max) 44.000 -
410.bwaves (max) (percentage) 0.780 -
410.bwaves (unexplained diff vs previous) 45.000 150.00%
410.bwaves (unexplained diff vs previous) (percentage) 0.790 154.84%
416.gamess (avg) (percentage) 0.760 -
416.gamess (max) (percentage) 0.360 -
429.mcf 91.000 -2.15%
429.mcf (avg) 91.000 -2.15%
429.mcf (avg) (percentage) 4.520 -
429.mcf (max) 176.000 -7.37%
429.mcf (max) (percentage) 8.730 -6.23%
429.mcf (unexplained diff vs previous) 29.000 1350.00%
429.mcf (unexplained diff vs previous) (percentage) 1.440 1340.00%
433.milc 15.000 -
433.milc (avg) 15.000 -
433.milc (avg) (percentage) 1.330 -
433.milc (max) 49.000 -3.92%
433.milc (max) (percentage) 4.290 -4.67%
433.milc (unexplained diff vs previous) 5.000 -37.50%
433.milc (unexplained diff vs previous) (percentage) 0.430 -38.57%
434.zeusmp 20.000 -
434.zeusmp (avg) 20.000 -
434.zeusmp (avg) (percentage) 0.870 -1.14%
434.zeusmp (max) 19.000 -34.48%
434.zeusmp (max) (percentage) 0.840 -33.86%
434.zeusmp (unexplained diff vs previous) 1.000 -85.71%
434.zeusmp (unexplained diff vs previous) (percentage) 0.040 -86.67%
435.gromacs 115.000 -
435.gromacs (avg) 115.000 -
435.gromacs (avg) (percentage) 1.620 -
435.gromacs (max) 125.000 -4.58%
435.gromacs (max) (percentage) 1.770 -2.75%
435.gromacs (unexplained diff vs previous) 114.000 132.65%
435.gromacs (unexplained diff vs previous) (percentage) 1.610 136.76%
436.cactusADM (avg) (percentage) 1.050 -
436.cactusADM (max) (percentage) 0.860 -
437.leslie3d 474.000 -2.87%
437.leslie3d (avg) 474.000 -2.87%
437.leslie3d (avg) (percentage) 4.180 -
437.leslie3d (max) 488.000 -27.06%
437.leslie3d (max) (percentage) 4.300 -25.09%
437.leslie3d (unexplained diff vs previous) 315.000 -50.24%
437.leslie3d (unexplained diff vs previous) (percentage) 2.770 -48.99%
444.namd 8.000 -
444.namd (avg) 8.000 -
444.namd (avg) (percentage) 1.150 -
444.namd (max) 7.000 -12.50%
444.namd (max) (percentage) 1.060 -12.40%
444.namd (unexplained diff vs previous) 4.000 -55.56%
444.namd (unexplained diff vs previous) (percentage) 0.550 -54.92%
445.gobmk 42.000 -
445.gobmk (avg) 42.000 -
445.gobmk (avg) (percentage) 0.860 -1.15%
445.gobmk (max) 63.000 -3.08%
445.gobmk (max) (percentage) 1.300 -2.99%
445.gobmk (unexplained diff vs previous) 3.000 -
445.gobmk (unexplained diff vs previous) (percentage) 0.060 -
447.dealII 18.000 -
447.dealII (avg) 18.000 -
447.dealII (avg) (percentage) 1.130 -
447.dealII (max) 14.000 -65.00%
447.dealII (max) (percentage) 0.870 -65.20%
447.dealII (unexplained diff vs previous) 10.000 -33.33%
447.dealII (unexplained diff vs previous) (percentage) 0.610 -34.41%
450.soplex 14.000 -
450.soplex (avg) 14.000 -
450.soplex (avg) (percentage) 2.510 -
450.soplex (max) 26.000 -3.70%
450.soplex (max) (percentage) 4.420 -6.16%
450.soplex (unexplained diff vs previous) 7.000 250.00%
450.soplex (unexplained diff vs previous) (percentage) 1.190 250.00%
453.povray 8.000 -
453.povray (avg) 8.000 -
453.povray (avg) (percentage) 1.630 -
453.povray (max) 13.000 -40.91%
453.povray (max) (percentage) 2.400 -42.72%
453.povray (unexplained diff vs previous) 6.000 -57.14%
453.povray (unexplained diff vs previous) (percentage) 1.110 -56.47%
454.calculix (avg) (percentage) 3.600 -
454.calculix (max) (percentage) 0.820 -
456.hmmer (avg) (percentage) 0.520 -
456.hmmer (max) (percentage) 0.340 -
458.sjeng 44.000 -
458.sjeng (avg) 44.000 -
458.sjeng (avg) (percentage) 0.590 -
458.sjeng (max) 70.000 -25.53%
458.sjeng (max) (percentage) 0.950 -24.00%
458.sjeng (unexplained diff vs previous) 66.000 -22.35%
458.sjeng (unexplained diff vs previous) (percentage) 0.880 -22.12%
459.GemsFDTD 62.000 -1.59%
459.GemsFDTD (avg) 62.000 -1.59%
459.GemsFDTD (avg) (percentage) 1.300 -
459.GemsFDTD (max) 122.000 -5.43%
459.GemsFDTD (max) (percentage) 2.540 -5.93%
459.GemsFDTD (unexplained diff vs previous) 25.000 212.50%
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.520 205.88%
462.libquantum 2.000 -
462.libquantum (avg) 2.000 -
462.libquantum (avg) (percentage) 1.940 -
462.libquantum (max) 5.000 -16.67%
462.libquantum (max) (percentage) 4.350 -4.61%
462.libquantum (unexplained diff vs previous) 3.000 -
462.libquantum (unexplained diff vs previous) (percentage) 2.210 -
464.h264ref (avg) (percentage) 0.710 -
464.h264ref (max) (percentage) 0.370 -
465.tonto 133.000 -1.48%
465.tonto (avg) 133.000 -1.48%
465.tonto (avg) (percentage) 1.230 -
465.tonto (max) 260.000 -4.41%
465.tonto (max) (percentage) 2.390 -4.40%
465.tonto (unexplained diff vs previous) 33.000 135.71%
465.tonto (unexplained diff vs previous) (percentage) 0.300 130.77%
470.lbm 31.000 -
470.lbm (avg) 31.000 -
470.lbm (avg) (percentage) 0.820 -
470.lbm (max) 41.000 -40.58%
470.lbm (max) (percentage) 1.080 -41.30%
470.lbm (unexplained diff vs previous) 17.000 -19.05%
470.lbm (unexplained diff vs previous) (percentage) 0.450 -18.18%
471.omnetpp 56.000 -1.75%
471.omnetpp (avg) 56.000 -1.75%
471.omnetpp (avg) (percentage) 2.080 -
471.omnetpp (max) 59.000 -11.94%
471.omnetpp (max) (percentage) 2.210 -11.24%
471.omnetpp (unexplained diff vs previous) 8.000 -83.33%
471.omnetpp (unexplained diff vs previous) (percentage) 0.300 -83.05%
473.astar 86.000 -
473.astar (avg) 86.000 -
473.astar (avg) (percentage) 1.670 -
473.astar (max) 205.000 -5.96%
473.astar (max) (percentage) 3.980 -6.13%
473.astar (unexplained diff vs previous) 8.000 -70.37%
473.astar (unexplained diff vs previous) (percentage) 0.160 -69.23%
481.wrf (avg) (percentage) 1.800 -
481.wrf (max) (percentage) 0.780 -1.27%
482.sphinx3 15.000 -
482.sphinx3 (avg) 15.000 -
482.sphinx3 (avg) (percentage) 1.810 -
482.sphinx3 (max) 25.000 -3.85%
482.sphinx3 (max) (percentage) 2.950 -6.05%
482.sphinx3 (unexplained diff vs previous) 8.000 -
482.sphinx3 (unexplained diff vs previous) (percentage) 0.940 -1.05%
483.xalancbmk (avg) (percentage) 2.960 -
483.xalancbmk (max) (percentage) 1.770 -
Geometric Mean 6.106 5.34%