Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=e564115c8a0e8f9b993cf0add01fa34548005d20 (+ 57 commits)
git_gcc https://gcc.gnu.org/git/gcc.git (70035b6c13852435d7ae396c0762ee26897d4d45) (unchanged)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=53a71b9f66dbc7f0ce44ec95bff7caa31fa0374b (+ 26 commits)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/73eab0e90b4becff0564c5964867c8eef41388bf (+ 158 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-aarch64-master-Os_LTO-build/353/
View Options
Report
Filter

gnu-aarch64-master-Os_LTO test results

Run Order Start Time Duration
Current 0353 (3-changed-components) 2025-01-07T21:58:31 0:00:00
Previous 0351 (3-changed-components) 2025-01-04T16:39:25 0:00:00
Baseline 0001 (4-changed-components) 2023-02-20T22:48:24 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 19 11
Performance Improvements 71 170
Added Tests 8 8
Unchanged Tests 1138 1047
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
437.leslie3d 5.21% 10973.000 11545.000 - -0.82% -
453.povray 2.04% 540.000 551.000 - 0.73% -
471.omnetpp 2.01% 2688.000 2742.000 - 0.66% -
447.dealII 1.41% 1629.000 1652.000 - -4.18% -
435.gromacs 1.11% 7192.000 7272.000 - 0.04% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
437.leslie3d (unexplained diff vs previous) 158.82% 221.000 572.000 - -75.28% -
437.leslie3d (unexplained diff vs previous) (percentage) 146.27% 2.010 4.950 - -75.10% -
471.omnetpp (unexplained diff vs previous) 86.21% 29.000 54.000 - -99.49% -
471.omnetpp (unexplained diff vs previous) (percentage) 82.41% 1.080 1.970 - -99.50% -
435.gromacs (unexplained diff vs previous) 23.08% 65.000 80.000 - -98.86% -
435.gromacs (unexplained diff vs previous) (percentage) 22.22% 0.900 1.100 - -98.86% -
447.dealII (unexplained diff vs previous) 15.00% 20.000 23.000 - -99.67% -
447.dealII (unexplained diff vs previous) (percentage) 13.01% 1.230 1.390 - -99.66% -
437.leslie3d (max) 12.97% 532.000 601.000 - -68.84% -
437.leslie3d (max) (percentage) 7.42% 4.850 5.210 - -68.58% -
437.leslie3d 5.22% 479.000 504.000 - 41.97% -
437.leslie3d (avg) 5.22% 479.000 504.000 - 41.97% -
471.omnetpp 1.85% 54.000 55.000 - -75.34% -
471.omnetpp (avg) 1.85% 54.000 55.000 - -75.34% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
482.sphinx3 (unexplained diff vs previous) -93.94% 33.000 2.000 - -99.99% -
482.sphinx3 (unexplained diff vs previous) (percentage) -93.81% 3.880 0.240 - -99.99% -
470.lbm (unexplained diff vs previous) (percentage) -90.20% 1.020 0.100 - -99.96% -
470.lbm (unexplained diff vs previous) -89.74% 39.000 4.000 - -99.96% -
401.bzip2 (unexplained diff vs previous) (percentage) -89.09% 6.140 0.670 - -99.82% -
401.bzip2 (unexplained diff vs previous) -88.95% 190.000 21.000 - -99.81% -
459.GemsFDTD (unexplained diff vs previous) -87.37% 190.000 24.000 - -99.84% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -87.18% 3.510 0.450 - -99.82% -
444.namd (unexplained diff vs previous) (percentage) -86.17% 0.940 0.130 - -99.99% -
444.namd (unexplained diff vs previous) -85.71% 7.000 1.000 - -99.99% -
434.zeusmp (unexplained diff vs previous) -80.95% 42.000 8.000 - -99.93% -
434.zeusmp (unexplained diff vs previous) (percentage) -80.77% 1.820 0.350 - -99.92% -
445.gobmk (unexplained diff vs previous) -80.77% 78.000 15.000 - -99.73% -
445.gobmk (unexplained diff vs previous) (percentage) -80.50% 1.590 0.310 - -99.72% -
410.bwaves (unexplained diff vs previous) (percentage) -78.57% 1.400 0.300 - -99.78% -
410.bwaves (unexplained diff vs previous) -78.31% 83.000 18.000 - -99.77% -
465.tonto (unexplained diff vs previous) (percentage) -78.24% 3.400 0.740 - -95.43% -
465.tonto (unexplained diff vs previous) -78.10% 379.000 83.000 - -95.31% -
433.milc (unexplained diff vs previous) -73.68% 38.000 10.000 - -99.91% -
433.milc (unexplained diff vs previous) (percentage) -73.39% 3.270 0.870 - -99.91% -
458.sjeng (unexplained diff vs previous) -58.33% 48.000 20.000 - -99.71% -
458.sjeng (unexplained diff vs previous) (percentage) -57.81% 0.640 0.270 - -99.70% -
482.sphinx3 (max) -26.47% 34.000 25.000 - -97.26% -
410.bwaves (max) -26.19% 84.000 62.000 - -98.11% -
410.bwaves (max) (percentage) -25.35% 1.420 1.060 - -98.17% -
445.gobmk (max) -25.32% 79.000 59.000 - -97.77% -
473.astar (max) -25.12% 211.000 158.000 - -95.36% -
429.mcf (max) (percentage) -25.05% 10.620 7.960 - -91.43% -
482.sphinx3 (max) (percentage) -25.00% 4.040 3.030 - -96.86% -
429.mcf (max) -25.00% 216.000 162.000 - -87.75% -
473.astar (max) (percentage) -24.94% 4.130 3.100 - -95.33% -
445.gobmk (max) (percentage) -24.84% 1.610 1.210 - -97.70% -
444.namd (max) -14.29% 7.000 6.000 - -99.12% -
433.milc (max) -12.82% 39.000 34.000 - -96.74% -
462.libquantum (max) -12.50% 8.000 7.000 - -94.93% -
433.milc (max) (percentage) -12.43% 3.380 2.960 - -96.74% -
444.namd (max) (percentage) -9.47% 0.950 0.860 - -99.06% -
470.lbm (max) (percentage) -8.80% 1.250 1.140 - -98.43% -
459.GemsFDTD (max) -8.63% 197.000 180.000 - -95.92% -
470.lbm (max) -8.51% 47.000 43.000 - -98.43% -
462.libquantum (max) (percentage) -8.29% 6.150 5.640 - -94.30% -
401.bzip2 (max) (percentage) -8.26% 6.540 6.000 - -92.37% -
459.GemsFDTD (max) (percentage) -8.24% 3.640 3.340 - -95.33% -
434.zeusmp (max) (percentage) -8.11% 1.850 1.700 - -97.92% -
401.bzip2 (max) -7.92% 202.000 186.000 - -91.96% -
458.sjeng (max) (percentage) -7.35% 0.680 0.630 - -98.68% -
434.zeusmp (max) -7.14% 42.000 39.000 - -98.10% -
465.tonto (max) (percentage) -6.25% 3.520 3.300 - -82.91% -
471.omnetpp (max) (percentage) -6.25% 2.560 2.400 - -96.99% -
458.sjeng (max) -6.00% 50.000 47.000 - -98.70% -
453.povray (max) (percentage) -5.92% 3.380 3.180 - -96.52% -
465.tonto (max) -5.61% 392.000 370.000 - -82.48% -
453.povray (max) -5.56% 18.000 17.000 - -96.59% -
435.gromacs (max) (percentage) -5.44% 1.470 1.390 - -97.17% -
450.soplex (max) -5.26% 38.000 36.000 - -93.39% -
450.soplex (max) (percentage) -4.57% 6.570 6.270 - -93.49% -
471.omnetpp (max) -4.41% 68.000 65.000 - -97.00% -
435.gromacs (max) -3.81% 105.000 101.000 - -97.17% -
453.povray (unexplained diff vs previous) (percentage) -1.96% 2.040 2.000 - -99.81% -
459.GemsFDTD -1.45% 69.000 68.000 - -81.11% -
459.GemsFDTD (avg) -1.45% 69.000 68.000 - -81.11% -
447.dealII (max) (percentage) -1.40% 1.430 1.410 - -98.24% -
473.astar -1.25% 80.000 79.000 - -62.91% -
473.astar (avg) -1.25% 80.000 79.000 - -62.91% -
450.soplex (avg) (percentage) -1.22% 2.450 2.420 - -62.36% -
445.gobmk (avg) (percentage) -1.18% 0.850 0.840 - -78.52% -
482.sphinx3 (avg) (percentage) -1.16% 1.720 1.700 - -78.56% -
429.mcf (avg) (percentage) -1.08% 4.650 4.600 - -40.03% -
429.mcf -1.06% 94.000 93.000 - -14.68% -
429.mcf (avg) -1.06% 94.000 93.000 - -14.68% -
462.libquantum (avg) (percentage) -1.05% 1.910 1.890 - -75.33% -

Added Tests - sample variability
429.mcf (unexplained diff vs previous)
429.mcf (unexplained diff vs previous) (percentage)
450.soplex (unexplained diff vs previous)
450.soplex (unexplained diff vs previous) (percentage)
462.libquantum (unexplained diff vs previous)
462.libquantum (unexplained diff vs previous) (percentage)
473.astar (unexplained diff vs previous)
473.astar (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
465.tonto 1.35% 1946163.000 1972475.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
429.mcf 43.33% 1424.000 2041.000 - 0.00% -
401.bzip2 5.95% 2941.000 3116.000 - 0.68% -
410.bwaves 4.78% 5652.000 5922.000 - -0.30% -
450.soplex 3.00% 567.000 584.000 - 0.00% -
465.tonto 2.73% 10941.000 11240.000 - 0.74% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d (avg) (percentage) 43.28% 3.050 4.370 - 0.00% -
437.leslie3d 41.97% 355.000 504.000 - 5.22% -
437.leslie3d (avg) 41.97% 355.000 504.000 - 5.22% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -31.03% 29.000 20.000 - 0.00% -
nb_execution_successful -31.03% 29.000 20.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d -8.90% 59479.000 54186.000 - 0.00% -
459.GemsFDTD -5.47% 244728.000 231344.000 - 0.00% -
444.namd -3.27% 188385.000 182220.000 - 0.00% -
447.dealII -2.16% 311591.000 304870.000 - 0.00% -
435.gromacs -1.86% 499261.000 489954.000 - 0.00% -
410.bwaves -1.84% 16760.000 16452.000 - 0.00% -
453.povray -1.82% 661389.000 649324.000 - 0.00% -
462.libquantum -1.79% 16085.000 15797.000 - 0.00% -
470.lbm -1.49% 9691.000 9547.000 - 0.00% -
433.milc -1.46% 61382.000 60488.000 - 0.00% -
458.sjeng -1.44% 104048.000 102551.000 - 0.00% -
450.soplex -1.33% 205081.000 202350.000 - 0.00% -
473.astar -1.18% 22968.000 22696.000 - 0.00% -
401.bzip2 -1.18% 44233.000 43711.000 - 0.00% -
482.sphinx3 -1.04% 112859.000 111690.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
459.GemsFDTD -12.68% 6173.000 5390.000 - -0.44% -
482.sphinx3 -10.26% 945.000 848.000 - -0.24% -
434.zeusmp -8.51% 2514.000 2300.000 - -0.35% -
447.dealII -4.18% 1724.000 1652.000 - 1.41% -
445.gobmk -2.59% 5023.000 4893.000 - -0.31% -
462.libquantum -1.43% 140.000 138.000 - 0.00% -
458.sjeng -1.28% 7567.000 7470.000 - 0.27% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
482.sphinx3 (unexplained diff vs previous) -99.99% 26073.000 2.000 - -93.94% -
482.sphinx3 (unexplained diff vs previous) (percentage) -99.99% 2759.050 0.240 - -93.81% -
444.namd (unexplained diff vs previous) (percentage) -99.99% 1118.610 0.130 - -86.17% -
444.namd (unexplained diff vs previous) -99.99% 8356.000 1.000 - -85.71% -
470.lbm (unexplained diff vs previous) (percentage) -99.96% 263.730 0.100 - -90.20% -
470.lbm (unexplained diff vs previous) -99.96% 9990.000 4.000 - -89.74% -
434.zeusmp (unexplained diff vs previous) -99.93% 11280.000 8.000 - -80.95% -
434.zeusmp (unexplained diff vs previous) (percentage) -99.92% 448.690 0.350 - -80.77% -
433.milc (unexplained diff vs previous) -99.91% 11289.000 10.000 - -73.68% -
433.milc (unexplained diff vs previous) (percentage) -99.91% 980.800 0.870 - -73.39% -
459.GemsFDTD (unexplained diff vs previous) -99.84% 15458.000 24.000 - -87.37% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -99.82% 250.410 0.450 - -87.18% -
401.bzip2 (unexplained diff vs previous) (percentage) -99.82% 368.340 0.670 - -89.09% -
453.povray (unexplained diff vs previous) (percentage) -99.81% 1043.330 2.000 - -1.96% -
453.povray (unexplained diff vs previous) -99.81% 5707.000 11.000 - 0.00% -
401.bzip2 (unexplained diff vs previous) -99.81% 10833.000 21.000 - -88.95% -
410.bwaves (unexplained diff vs previous) (percentage) -99.78% 137.900 0.300 - -78.57% -
410.bwaves (unexplained diff vs previous) -99.77% 7794.000 18.000 - -78.31% -
445.gobmk (unexplained diff vs previous) -99.73% 5581.000 15.000 - -80.77% -
445.gobmk (unexplained diff vs previous) (percentage) -99.72% 111.110 0.310 - -80.50% -
458.sjeng (unexplained diff vs previous) -99.71% 6876.000 20.000 - -58.33% -
458.sjeng (unexplained diff vs previous) (percentage) -99.70% 90.870 0.270 - -57.81% -
447.dealII (unexplained diff vs previous) -99.67% 7017.000 23.000 - 15.00% -
447.dealII (unexplained diff vs previous) (percentage) -99.66% 407.020 1.390 - 13.01% -
456.hmmer (max) (percentage) -99.51% 73.590 0.360 - 0.00% -
471.omnetpp (unexplained diff vs previous) (percentage) -99.50% 391.300 1.970 - 82.41% -
471.omnetpp (unexplained diff vs previous) -99.49% 10659.000 54.000 - 86.21% -
464.h264ref (max) (percentage) -99.30% 54.290 0.380 - 0.00% -
454.calculix (max) (percentage) -99.18% 99.730 0.820 - 0.00% -
444.namd (max) -99.12% 685.000 6.000 - -14.29% -
416.gamess (max) (percentage) -99.07% 38.550 0.360 - 0.00% -
444.namd (max) (percentage) -99.06% 91.790 0.860 - -9.47% -
436.cactusADM (max) (percentage) -99.02% 88.730 0.870 - 0.00% -
435.gromacs (unexplained diff vs previous) (percentage) -98.86% 96.680 1.100 - 22.22% -
435.gromacs (unexplained diff vs previous) -98.86% 7028.000 80.000 - 23.08% -
481.wrf (max) (percentage) -98.85% 68.700 0.790 - 0.00% -
458.sjeng (max) -98.70% 3602.000 47.000 - -6.00% -
458.sjeng (max) (percentage) -98.68% 47.610 0.630 - -7.35% -
470.lbm (max) -98.43% 2746.000 43.000 - -8.51% -
470.lbm (max) (percentage) -98.43% 72.510 1.140 - -8.80% -
447.dealII (max) -98.34% 1384.000 23.000 - 0.00% -
447.dealII (max) (percentage) -98.24% 80.280 1.410 - -1.40% -
410.bwaves (max) (percentage) -98.17% 57.970 1.060 - -25.35% -
410.bwaves (max) -98.11% 3276.000 62.000 - -26.19% -
434.zeusmp (max) -98.10% 2055.000 39.000 - -7.14% -
434.zeusmp (max) (percentage) -97.92% 81.770 1.700 - -8.11% -
445.gobmk (max) -97.77% 2643.000 59.000 - -25.32% -
445.gobmk (max) (percentage) -97.70% 52.630 1.210 - -24.84% -
483.xalancbmk (max) (percentage) -97.42% 68.670 1.770 - 0.00% -
400.perlbench (max) (percentage) -97.37% 84.060 2.210 - -0.45% -
482.sphinx3 (max) -97.26% 911.000 25.000 - -26.47% -
435.gromacs (max) -97.17% 3573.000 101.000 - -3.81% -
435.gromacs (max) (percentage) -97.17% 49.160 1.390 - -5.44% -
471.omnetpp (max) -97.00% 2169.000 65.000 - -4.41% -
471.omnetpp (max) (percentage) -96.99% 79.650 2.400 - -6.25% -
482.sphinx3 (max) (percentage) -96.86% 96.500 3.030 - -25.00% -
433.milc (max) -96.74% 1044.000 34.000 - -12.82% -
433.milc (max) (percentage) -96.74% 90.750 2.960 - -12.43% -
453.povray (max) -96.59% 499.000 17.000 - -5.56% -
453.povray (max) (percentage) -96.52% 91.250 3.180 - -5.92% -
403.gcc (max) (percentage) -96.26% 99.360 3.720 - 0.00% -
459.GemsFDTD (max) -95.92% 4411.000 180.000 - -8.63% -
465.tonto (unexplained diff vs previous) (percentage) -95.43% 16.190 0.740 - -78.24% -
473.astar (max) -95.36% 3406.000 158.000 - -25.12% -
473.astar (max) (percentage) -95.33% 66.430 3.100 - -24.94% -
459.GemsFDTD (max) (percentage) -95.33% 71.460 3.340 - -8.24% -
465.tonto (unexplained diff vs previous) -95.31% 1771.000 83.000 - -78.10% -
462.libquantum (max) -94.93% 138.000 7.000 - -12.50% -
462.libquantum (max) (percentage) -94.30% 98.970 5.640 - -8.29% -
450.soplex (max) (percentage) -93.49% 96.240 6.270 - -4.57% -
450.soplex (max) -93.39% 545.000 36.000 - -5.26% -
401.bzip2 (max) (percentage) -92.37% 78.650 6.000 - -8.26% -
401.bzip2 (max) -91.96% 2313.000 186.000 - -7.92% -
429.mcf (max) (percentage) -91.43% 92.890 7.960 - -25.05% -
444.namd -88.24% 68.000 8.000 - 0.00% -
444.namd (avg) -88.24% 68.000 8.000 - 0.00% -
456.hmmer (avg) (percentage) -88.21% 4.410 0.520 - 0.00% -
444.namd (avg) (percentage) -87.85% 9.220 1.120 - -0.88% -
429.mcf (max) -87.75% 1322.000 162.000 - -25.00% -
470.lbm (avg) (percentage) -87.52% 6.330 0.790 - 0.00% -
470.lbm -87.45% 239.000 30.000 - 0.00% -
470.lbm (avg) -87.45% 239.000 30.000 - 0.00% -
434.zeusmp -86.39% 147.000 20.000 - 0.00% -
434.zeusmp (avg) -86.39% 147.000 20.000 - 0.00% -
464.h264ref (avg) (percentage) -86.05% 5.090 0.710 - 0.00% -
434.zeusmp (avg) (percentage) -84.79% 5.850 0.890 - 0.00% -
458.sjeng -82.99% 241.000 41.000 - 0.00% -
458.sjeng (avg) -82.99% 241.000 41.000 - 0.00% -
465.tonto (max) (percentage) -82.91% 19.310 3.300 - -6.25% -
416.gamess (avg) (percentage) -82.81% 4.420 0.760 - 0.00% -
465.tonto (max) -82.48% 2112.000 370.000 - -5.61% -
458.sjeng (avg) (percentage) -82.45% 3.190 0.560 - 0.00% -
436.cactusADM (avg) (percentage) -82.44% 5.980 1.050 - 0.00% -
447.dealII -81.82% 99.000 18.000 - 0.00% -
447.dealII (avg) -81.82% 99.000 18.000 - 0.00% -
410.bwaves (avg) (percentage) -81.18% 4.410 0.830 - 0.00% -
459.GemsFDTD -81.11% 360.000 68.000 - -1.45% -
459.GemsFDTD (avg) -81.11% 360.000 68.000 - -1.45% -
482.sphinx3 -81.08% 74.000 14.000 - 0.00% -
482.sphinx3 (avg) -81.08% 74.000 14.000 - 0.00% -
453.povray -80.95% 42.000 8.000 - 0.00% -
453.povray (avg) -80.95% 42.000 8.000 - 0.00% -
447.dealII (avg) (percentage) -80.42% 5.770 1.130 - 0.00% -
410.bwaves -80.32% 249.000 49.000 - 0.00% -
410.bwaves (avg) -80.32% 249.000 49.000 - 0.00% -
462.libquantum -80.00% 10.000 2.000 - 0.00% -
462.libquantum (avg) -80.00% 10.000 2.000 - 0.00% -
433.milc -79.71% 69.000 14.000 - 0.00% -
433.milc (avg) -79.71% 69.000 14.000 - 0.00% -
433.milc (avg) (percentage) -79.67% 6.050 1.230 - -0.81% -
453.povray (avg) (percentage) -79.64% 7.810 1.590 - 0.00% -
445.gobmk -79.08% 196.000 41.000 - 0.00% -
445.gobmk (avg) -79.08% 196.000 41.000 - 0.00% -
482.sphinx3 (avg) (percentage) -78.56% 7.930 1.700 - -1.16% -
445.gobmk (avg) (percentage) -78.52% 3.910 0.840 - -1.18% -
459.GemsFDTD (avg) (percentage) -78.08% 5.840 1.280 - -0.78% -
471.omnetpp (avg) (percentage) -75.49% 8.200 2.010 - 0.00% -
471.omnetpp -75.34% 223.000 55.000 - 1.85% -
471.omnetpp (avg) -75.34% 223.000 55.000 - 1.85% -
462.libquantum (avg) (percentage) -75.33% 7.660 1.890 - -1.05% -
437.leslie3d (unexplained diff vs previous) -75.28% 2314.000 572.000 - 158.82% -
437.leslie3d (unexplained diff vs previous) (percentage) -75.10% 19.880 4.950 - 146.27% -
401.bzip2 (avg) (percentage) -72.81% 5.480 1.490 - 0.00% -
401.bzip2 -71.43% 161.000 46.000 - 0.00% -
401.bzip2 (avg) -71.43% 161.000 46.000 - 0.00% -
481.wrf (avg) (percentage) -71.15% 6.240 1.800 - 0.00% -
400.perlbench (avg) (percentage) -69.45% 6.350 1.940 - 0.00% -
437.leslie3d (max) -68.84% 1929.000 601.000 - 12.97% -
437.leslie3d (max) (percentage) -68.58% 16.580 5.210 - 7.42% -
435.gromacs -67.03% 367.000 121.000 - 0.83% -
435.gromacs (avg) -67.03% 367.000 121.000 - 0.83% -
435.gromacs (avg) (percentage) -67.00% 5.060 1.670 - -0.60% -
473.astar -62.91% 213.000 79.000 - -1.25% -
473.astar (avg) -62.91% 213.000 79.000 - -1.25% -
473.astar (avg) (percentage) -62.50% 4.160 1.560 - -0.64% -
450.soplex (avg) (percentage) -62.36% 6.430 2.420 - -1.22% -
465.tonto (avg) (percentage) -61.38% 3.340 1.290 - -0.77% -
450.soplex -61.11% 36.000 14.000 - 0.00% -
450.soplex (avg) -61.11% 36.000 14.000 - 0.00% -
465.tonto -60.55% 365.000 144.000 - -0.69% -
465.tonto (avg) -60.55% 365.000 144.000 - -0.69% -
454.calculix (avg) (percentage) -55.11% 8.020 3.600 - 0.00% -
483.xalancbmk (avg) (percentage) -54.46% 6.500 2.960 - 0.00% -
429.mcf (avg) (percentage) -40.03% 7.670 4.600 - -1.08% -
403.gcc (avg) (percentage) -30.46% 7.320 5.090 - 0.00% -
429.mcf -14.68% 109.000 93.000 - -1.06% -
429.mcf (avg) -14.68% 109.000 93.000 - -1.06% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 31.03% 29.000 38.000 - 0.00% -

Added Tests - sample variability
429.mcf (unexplained diff vs previous)
429.mcf (unexplained diff vs previous) (percentage)
450.soplex (unexplained diff vs previous)
450.soplex (unexplained diff vs previous) (percentage)
462.libquantum (unexplained diff vs previous)
462.libquantum (unexplained diff vs previous) (percentage)
473.astar (unexplained diff vs previous)
473.astar (unexplained diff vs previous) (percentage)

Report Time: 0.36s
Execution (seconds)
Name Current %
401.bzip2 3116.000 -
410.bwaves 5922.000 -
429.mcf 2041.000 -
433.milc 1152.000 -
434.zeusmp 2300.000 -
435.gromacs 7272.000 1.11%
437.leslie3d 11545.000 5.21%
444.namd 746.000 -
445.gobmk 4893.000 -
447.dealII 1652.000 1.41%
450.soplex 584.000 -
453.povray 551.000 2.04%
458.sjeng 7470.000 -
459.GemsFDTD 5390.000 -
462.libquantum 138.000 -
465.tonto 11240.000 -
470.lbm 3823.000 -
471.omnetpp 2742.000 2.01%
473.astar 5124.000 -
482.sphinx3 848.000 -
Geometric Mean 2416.868 -
Code Size (bytes)
Name Current %
401.bzip2 43711.000 -
410.bwaves 16452.000 -
429.mcf 9086.000 -
433.milc 60488.000 -
434.zeusmp 151959.000 -
435.gromacs 489954.000 -
437.leslie3d 54186.000 -
444.namd 182220.000 -
445.gobmk 1375074.000 -
447.dealII 304870.000 -
450.soplex 202350.000 -
453.povray 649324.000 -
458.sjeng 102551.000 -
459.GemsFDTD 231344.000 -
462.libquantum 15797.000 -
465.tonto 1972475.000 -
470.lbm 9547.000 -
471.omnetpp 475181.000 -
473.astar 22696.000 -
482.sphinx3 111690.000 -
Geometric Mean 113942.247 -
sample variability
Name Current %
400.perlbench (avg) (percentage) 1.940 -
400.perlbench (max) (percentage) 2.210 -
401.bzip2 46.000 -
401.bzip2 (avg) 46.000 -
401.bzip2 (avg) (percentage) 1.490 -
401.bzip2 (max) 186.000 -7.92%
401.bzip2 (max) (percentage) 6.000 -8.26%
401.bzip2 (unexplained diff vs previous) 21.000 -88.95%
401.bzip2 (unexplained diff vs previous) (percentage) 0.670 -89.09%
403.gcc (avg) (percentage) 5.090 -
403.gcc (max) (percentage) 3.720 -
410.bwaves 49.000 -
410.bwaves (avg) 49.000 -
410.bwaves (avg) (percentage) 0.830 -
410.bwaves (max) 62.000 -26.19%
410.bwaves (max) (percentage) 1.060 -25.35%
410.bwaves (unexplained diff vs previous) 18.000 -78.31%
410.bwaves (unexplained diff vs previous) (percentage) 0.300 -78.57%
416.gamess (avg) (percentage) 0.760 -
416.gamess (max) (percentage) 0.360 -
429.mcf 93.000 -1.06%
429.mcf (avg) 93.000 -1.06%
429.mcf (avg) (percentage) 4.600 -1.08%
429.mcf (max) 162.000 -25.00%
429.mcf (max) (percentage) 7.960 -25.05%
429.mcf (unexplained diff vs previous) 0.000 -
429.mcf (unexplained diff vs previous) (percentage) 0.000 -
433.milc 14.000 -
433.milc (avg) 14.000 -
433.milc (avg) (percentage) 1.230 -
433.milc (max) 34.000 -12.82%
433.milc (max) (percentage) 2.960 -12.43%
433.milc (unexplained diff vs previous) 10.000 -73.68%
433.milc (unexplained diff vs previous) (percentage) 0.870 -73.39%
434.zeusmp 20.000 -
434.zeusmp (avg) 20.000 -
434.zeusmp (avg) (percentage) 0.890 -
434.zeusmp (max) 39.000 -7.14%
434.zeusmp (max) (percentage) 1.700 -8.11%
434.zeusmp (unexplained diff vs previous) 8.000 -80.95%
434.zeusmp (unexplained diff vs previous) (percentage) 0.350 -80.77%
435.gromacs 121.000 -
435.gromacs (avg) 121.000 -
435.gromacs (avg) (percentage) 1.670 -
435.gromacs (max) 101.000 -3.81%
435.gromacs (max) (percentage) 1.390 -5.44%
435.gromacs (unexplained diff vs previous) 80.000 23.08%
435.gromacs (unexplained diff vs previous) (percentage) 1.100 22.22%
436.cactusADM (avg) (percentage) 1.050 -
436.cactusADM (max) (percentage) 0.870 -
437.leslie3d 504.000 5.22%
437.leslie3d (avg) 504.000 5.22%
437.leslie3d (avg) (percentage) 4.370 -
437.leslie3d (max) 601.000 12.97%
437.leslie3d (max) (percentage) 5.210 7.42%
437.leslie3d (unexplained diff vs previous) 572.000 158.82%
437.leslie3d (unexplained diff vs previous) (percentage) 4.950 146.27%
444.namd 8.000 -
444.namd (avg) 8.000 -
444.namd (avg) (percentage) 1.120 -
444.namd (max) 6.000 -14.29%
444.namd (max) (percentage) 0.860 -9.47%
444.namd (unexplained diff vs previous) 1.000 -85.71%
444.namd (unexplained diff vs previous) (percentage) 0.130 -86.17%
445.gobmk 41.000 -
445.gobmk (avg) 41.000 -
445.gobmk (avg) (percentage) 0.840 -1.18%
445.gobmk (max) 59.000 -25.32%
445.gobmk (max) (percentage) 1.210 -24.84%
445.gobmk (unexplained diff vs previous) 15.000 -80.77%
445.gobmk (unexplained diff vs previous) (percentage) 0.310 -80.50%
447.dealII 18.000 -
447.dealII (avg) 18.000 -
447.dealII (avg) (percentage) 1.130 -
447.dealII (max) 23.000 -
447.dealII (max) (percentage) 1.410 -1.40%
447.dealII (unexplained diff vs previous) 23.000 15.00%
447.dealII (unexplained diff vs previous) (percentage) 1.390 13.01%
450.soplex 14.000 -
450.soplex (avg) 14.000 -
450.soplex (avg) (percentage) 2.420 -1.22%
450.soplex (max) 36.000 -5.26%
450.soplex (max) (percentage) 6.270 -4.57%
450.soplex (unexplained diff vs previous) 0.000 -
450.soplex (unexplained diff vs previous) (percentage) 0.000 -
453.povray 8.000 -
453.povray (avg) 8.000 -
453.povray (avg) (percentage) 1.590 -
453.povray (max) 17.000 -5.56%
453.povray (max) (percentage) 3.180 -5.92%
453.povray (unexplained diff vs previous) 11.000 -
453.povray (unexplained diff vs previous) (percentage) 2.000 -1.96%
454.calculix (avg) (percentage) 3.600 -
454.calculix (max) (percentage) 0.820 -
456.hmmer (avg) (percentage) 0.520 -
456.hmmer (max) (percentage) 0.360 -
458.sjeng 41.000 -
458.sjeng (avg) 41.000 -
458.sjeng (avg) (percentage) 0.560 -
458.sjeng (max) 47.000 -6.00%
458.sjeng (max) (percentage) 0.630 -7.35%
458.sjeng (unexplained diff vs previous) 20.000 -58.33%
458.sjeng (unexplained diff vs previous) (percentage) 0.270 -57.81%
459.GemsFDTD 68.000 -1.45%
459.GemsFDTD (avg) 68.000 -1.45%
459.GemsFDTD (avg) (percentage) 1.280 -
459.GemsFDTD (max) 180.000 -8.63%
459.GemsFDTD (max) (percentage) 3.340 -8.24%
459.GemsFDTD (unexplained diff vs previous) 24.000 -87.37%
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.450 -87.18%
462.libquantum 2.000 -
462.libquantum (avg) 2.000 -
462.libquantum (avg) (percentage) 1.890 -1.05%
462.libquantum (max) 7.000 -12.50%
462.libquantum (max) (percentage) 5.640 -8.29%
462.libquantum (unexplained diff vs previous) 0.000 -
462.libquantum (unexplained diff vs previous) (percentage) 0.000 -
464.h264ref (avg) (percentage) 0.710 -
464.h264ref (max) (percentage) 0.380 -
465.tonto 144.000 -
465.tonto (avg) 144.000 -
465.tonto (avg) (percentage) 1.290 -
465.tonto (max) 370.000 -5.61%
465.tonto (max) (percentage) 3.300 -6.25%
465.tonto (unexplained diff vs previous) 83.000 -78.10%
465.tonto (unexplained diff vs previous) (percentage) 0.740 -78.24%
470.lbm 30.000 -
470.lbm (avg) 30.000 -
470.lbm (avg) (percentage) 0.790 -
470.lbm (max) 43.000 -8.51%
470.lbm (max) (percentage) 1.140 -8.80%
470.lbm (unexplained diff vs previous) 4.000 -89.74%
470.lbm (unexplained diff vs previous) (percentage) 0.100 -90.20%
471.omnetpp 55.000 1.85%
471.omnetpp (avg) 55.000 1.85%
471.omnetpp (avg) (percentage) 2.010 -
471.omnetpp (max) 65.000 -4.41%
471.omnetpp (max) (percentage) 2.400 -6.25%
471.omnetpp (unexplained diff vs previous) 54.000 86.21%
471.omnetpp (unexplained diff vs previous) (percentage) 1.970 82.41%
473.astar 79.000 -1.25%
473.astar (avg) 79.000 -1.25%
473.astar (avg) (percentage) 1.560 -
473.astar (max) 158.000 -25.12%
473.astar (max) (percentage) 3.100 -24.94%
473.astar (unexplained diff vs previous) 0.000 -
473.astar (unexplained diff vs previous) (percentage) 0.000 -
481.wrf (avg) (percentage) 1.800 -
481.wrf (max) (percentage) 0.790 -
482.sphinx3 14.000 -
482.sphinx3 (avg) 14.000 -
482.sphinx3 (avg) (percentage) 1.700 -1.16%
482.sphinx3 (max) 25.000 -26.47%
482.sphinx3 (max) (percentage) 3.030 -25.00%
482.sphinx3 (unexplained diff vs previous) 2.000 -93.94%
482.sphinx3 (unexplained diff vs previous) (percentage) 0.240 -93.81%
483.xalancbmk (avg) (percentage) 2.960 -
483.xalancbmk (max) (percentage) 1.770 -
Geometric Mean 3.862 -56.66%