Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=c2d698fe03a6092d58a07de96068b87836daced0 (+ 152 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/ecd2c373720af214f20671f9e7d760548b51ef4a (unchanged)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=44ccc2465c6af5bd811d8258bf744aaafd5392fc (+ 23 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=f13102b78850c48082dca7202b8402d9dd6745b5 (+ 17472 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-aarch64-master-Os_LTO-build/215/
View Options
Report
Filter

gnu-aarch64-master-Os_LTO test results

Run Order Start Time Duration
Current 0215 (3-changed-components) 2024-03-29T01:28:48 0:00:00
Previous 0211 (3-changed-components) 2024-03-22T06:41:17 0:00:00
Baseline 0001 (4-changed-components) 2023-02-20T22:48:24 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 40 11
Performance Improvements 112 199
Unchanged Tests 1084 1026
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
462.libquantum 2.94% 136.000 140.000 - 0.00% -
450.soplex 1.71% 584.000 594.000 - 4.76% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
450.soplex (unexplained diff vs previous) 900.00% 1.000 10.000 - -99.93% -
450.soplex (unexplained diff vs previous) (percentage) 888.24% 0.170 1.680 - -99.93% -
429.mcf (unexplained diff vs previous) (percentage) 885.71% 0.140 1.380 - -99.89% -
429.mcf (unexplained diff vs previous) 850.00% 2.000 19.000 - -99.90% -
456.hmmer (unexplained diff vs previous) (percentage) 346.15% 0.130 0.580 - -99.79% -
456.hmmer (unexplained diff vs previous) 325.00% 4.000 17.000 - -99.79% -
450.soplex (max) 233.33% 3.000 10.000 - -98.17% -
450.soplex (max) (percentage) 216.67% 0.540 1.710 - -98.22% -
456.hmmer (max) 166.67% 6.000 16.000 - -99.25% -
458.sjeng (unexplained diff vs previous) 166.67% 6.000 16.000 - -99.77% -
458.sjeng (unexplained diff vs previous) (percentage) 162.50% 0.080 0.210 - -99.77% -
456.hmmer (max) (percentage) 159.09% 0.220 0.570 - -99.23% -
436.cactusADM (unexplained diff vs previous) 140.00% 5.000 12.000 - -99.93% -
436.cactusADM (max) (percentage) 137.50% 0.240 0.570 - -99.36% -
436.cactusADM (unexplained diff vs previous) (percentage) 137.50% 0.240 0.570 - -99.93% -
429.mcf (max) 125.00% 8.000 18.000 - -98.64% -
436.cactusADM (max) 120.00% 5.000 11.000 - -99.40% -
429.mcf (max) (percentage) 119.35% 0.620 1.360 - -98.54% -
462.libquantum (max) 100.00% 2.000 4.000 - -97.10% -
462.libquantum (unexplained diff vs previous) 100.00% 2.000 4.000 - -99.97% -
462.libquantum (unexplained diff vs previous) (percentage) 94.56% 1.470 2.860 - -99.97% -
437.leslie3d (unexplained diff vs previous) (percentage) 64.32% 4.540 7.460 - -62.47% -
459.GemsFDTD (unexplained diff vs previous) (percentage) 61.76% 0.340 0.550 - -99.78% -
459.GemsFDTD (unexplained diff vs previous) 61.11% 18.000 29.000 - -99.81% -
473.astar (unexplained diff vs previous) (percentage) 57.63% 0.590 0.930 - -99.53% -
473.astar (unexplained diff vs previous) 54.84% 31.000 48.000 - -99.53% -
473.astar (max) (percentage) 53.33% 0.600 0.920 - -98.62% -
437.leslie3d (unexplained diff vs previous) 52.80% 536.000 819.000 - -64.61% -
473.astar (max) 51.61% 31.000 47.000 - -98.62% -
437.leslie3d (max) (percentage) 41.06% 4.920 6.940 - -58.14% -
462.libquantum (max) (percentage) 36.11% 2.160 2.940 - -97.03% -
437.leslie3d (max) 31.21% 580.000 761.000 - -60.55% -
410.bwaves (unexplained diff vs previous) (percentage) 26.83% 0.820 1.040 - -99.25% -
459.GemsFDTD (max) 26.09% 23.000 29.000 - -99.34% -
459.GemsFDTD (max) (percentage) 25.00% 0.440 0.550 - -99.23% -
410.bwaves (unexplained diff vs previous) 24.49% 49.000 61.000 - -99.22% -
410.bwaves (max) (percentage) 24.10% 0.830 1.030 - -98.22% -
410.bwaves (max) 22.45% 49.000 60.000 - -98.17% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
437.leslie3d -6.94% 11798.000 10979.000 - -5.68% -
471.omnetpp -2.08% 2795.000 2737.000 - 0.48% -
429.mcf -1.36% 1394.000 1375.000 - -3.44% -
447.dealII -1.14% 1669.000 1650.000 - -4.29% -
410.bwaves -1.03% 5943.000 5882.000 - 4.07% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
470.lbm (unexplained diff vs previous) (percentage) -88.89% 0.450 0.050 - -99.98% -
470.lbm (unexplained diff vs previous) -88.24% 17.000 2.000 - -99.98% -
444.namd (unexplained diff vs previous) -80.00% 5.000 1.000 - -99.99% -
444.namd (unexplained diff vs previous) (percentage) -80.00% 0.650 0.130 - -99.99% -
465.tonto (unexplained diff vs previous) -76.39% 72.000 17.000 - -99.04% -
465.tonto (unexplained diff vs previous) (percentage) -75.81% 0.620 0.150 - -99.07% -
453.povray (unexplained diff vs previous) (percentage) -75.34% 0.730 0.180 - -99.98% -
453.povray (unexplained diff vs previous) -75.00% 4.000 1.000 - -99.98% -
400.perlbench (unexplained diff vs previous) (percentage) -73.76% 2.210 0.580 - -99.89% -
400.perlbench (unexplained diff vs previous) -73.53% 34.000 9.000 - -99.90% -
435.gromacs (unexplained diff vs previous) -70.19% 104.000 31.000 - -99.56% -
435.gromacs (unexplained diff vs previous) (percentage) -69.86% 1.460 0.440 - -99.54% -
433.milc (max) -66.67% 9.000 3.000 - -99.71% -
445.gobmk (max) -62.50% 40.000 15.000 - -99.43% -
445.gobmk (max) (percentage) -62.20% 0.820 0.310 - -99.41% -
433.milc (max) (percentage) -61.90% 0.840 0.320 - -99.65% -
433.milc (unexplained diff vs previous) (percentage) -60.47% 0.430 0.170 - -99.98% -
433.milc (unexplained diff vs previous) -60.00% 5.000 2.000 - -99.98% -
464.h264ref (unexplained diff vs previous) (percentage) -57.14% 0.070 0.030 - -99.97% -
464.h264ref (unexplained diff vs previous) -50.00% 4.000 2.000 - -99.97% -
416.gamess (unexplained diff vs previous) -46.88% 32.000 17.000 - -99.78% -
416.gamess (unexplained diff vs previous) (percentage) -46.15% 0.260 0.140 - -99.78% -
401.bzip2 (unexplained diff vs previous) -37.50% 16.000 10.000 - -99.91% -
401.bzip2 (unexplained diff vs previous) (percentage) -35.85% 0.530 0.340 - -99.91% -
444.namd (max) (percentage) -34.48% 0.870 0.570 - -99.38% -
447.dealII (unexplained diff vs previous) -34.48% 29.000 19.000 - -99.73% -
447.dealII (unexplained diff vs previous) (percentage) -33.91% 1.740 1.150 - -99.72% -
444.namd (max) -33.33% 6.000 4.000 - -99.42% -
465.tonto (max) -32.58% 89.000 60.000 - -97.16% -
465.tonto (max) (percentage) -32.47% 0.770 0.520 - -97.31% -
453.povray (max) -25.00% 4.000 3.000 - -99.40% -
435.gromacs (max) -17.65% 102.000 84.000 - -97.65% -
470.lbm (max) -17.65% 17.000 14.000 - -99.49% -
447.dealII (max) -17.24% 29.000 24.000 - -98.27% -
447.dealII (max) (percentage) -16.95% 1.770 1.470 - -98.17% -
435.gromacs (max) (percentage) -16.67% 1.440 1.200 - -97.56% -
453.povray (max) (percentage) -16.22% 0.740 0.620 - -99.32% -
470.lbm (max) (percentage) -13.33% 0.450 0.390 - -99.46% -
471.omnetpp (max) -12.50% 64.000 56.000 - -97.42% -
445.gobmk (unexplained diff vs previous) -11.76% 17.000 15.000 - -99.73% -
434.zeusmp (max) (percentage) -11.54% 0.780 0.690 - -99.16% -
445.gobmk (unexplained diff vs previous) (percentage) -11.43% 0.350 0.310 - -99.72% -
482.sphinx3 (max) -11.11% 9.000 8.000 - -99.12% -
434.zeusmp (max) -10.53% 19.000 17.000 - -99.17% -
458.sjeng (max) -10.53% 19.000 17.000 - -99.53% -
471.omnetpp (max) (percentage) -9.17% 2.290 2.080 - -97.39% -
458.sjeng (max) (percentage) -7.69% 0.260 0.240 - -99.50% -
400.perlbench (max) -6.98% 43.000 40.000 - -97.14% -
400.perlbench (max) (percentage) -6.36% 2.830 2.650 - -96.85% -
437.leslie3d -6.24% 561.000 526.000 - 48.17% -
437.leslie3d (avg) -6.24% 561.000 526.000 - 48.17% -
401.bzip2 (max) (percentage) -5.00% 2.200 2.090 - -97.34% -
464.h264ref (max) (percentage) -4.88% 0.410 0.390 - -99.28% -
416.gamess (max) (percentage) -4.76% 0.630 0.600 - -98.44% -
401.bzip2 (max) -4.62% 65.000 62.000 - -97.32% -
482.sphinx3 (max) (percentage) -4.59% 1.090 1.040 - -98.92% -
464.h264ref (max) -4.35% 23.000 22.000 - -99.30% -
416.gamess (max) -3.95% 76.000 73.000 - -98.48% -
471.omnetpp (unexplained diff vs previous) -3.33% 60.000 58.000 - -99.46% -
436.cactusADM -3.12% 32.000 31.000 - -75.00% -
436.cactusADM (avg) -3.12% 32.000 31.000 - -75.00% -
434.zeusmp -3.03% 33.000 32.000 - -78.23% -
434.zeusmp (avg) -3.03% 33.000 32.000 - -78.23% -
400.perlbench -2.78% 36.000 35.000 - -66.67% -
400.perlbench (avg) -2.78% 36.000 35.000 - -66.67% -
416.gamess (avg) (percentage) -2.56% 0.780 0.760 - -82.81% -
429.mcf -2.35% 85.000 83.000 - -23.85% -
429.mcf (avg) -2.35% 85.000 83.000 - -23.85% -
465.tonto -2.35% 170.000 166.000 - -54.52% -
465.tonto (avg) -2.35% 170.000 166.000 - -54.52% -
435.gromacs -2.17% 138.000 135.000 - -63.22% -
435.gromacs (avg) -2.17% 138.000 135.000 - -63.22% -
416.gamess -2.13% 94.000 92.000 - -83.27% -
416.gamess (avg) -2.13% 94.000 92.000 - -83.27% -
473.astar -2.13% 94.000 92.000 - -56.81% -
473.astar (avg) -2.13% 94.000 92.000 - -56.81% -
454.calculix (max) (percentage) -2.06% 0.970 0.950 - -99.05% -
465.tonto (avg) (percentage) -2.05% 1.460 1.430 - -57.19% -
445.gobmk -1.96% 51.000 50.000 - -74.49% -
445.gobmk (avg) -1.96% 51.000 50.000 - -74.49% -
464.h264ref (avg) (percentage) -1.94% 1.030 1.010 - -80.16% -
433.milc (avg) (percentage) -1.86% 1.610 1.580 - -73.88% -
444.namd (avg) (percentage) -1.80% 1.670 1.640 - -82.21% -
401.bzip2 -1.75% 57.000 56.000 - -65.22% -
401.bzip2 (avg) -1.75% 57.000 56.000 - -65.22% -
458.sjeng -1.75% 57.000 56.000 - -76.76% -
458.sjeng (avg) -1.75% 57.000 56.000 - -76.76% -
453.povray (avg) (percentage) -1.72% 1.740 1.710 - -78.10% -
400.perlbench (avg) (percentage) -1.70% 2.350 2.310 - -63.62% -
464.h264ref -1.69% 59.000 58.000 - -80.20% -
464.h264ref (avg) -1.69% 59.000 58.000 - -80.20% -
470.lbm (avg) (percentage) -1.63% 1.230 1.210 - -80.88% -
401.bzip2 (avg) (percentage) -1.56% 1.920 1.890 - -65.51% -
435.gromacs (avg) (percentage) -1.54% 1.950 1.920 - -62.06% -
471.omnetpp -1.54% 65.000 64.000 - -71.30% -
471.omnetpp (avg) -1.54% 65.000 64.000 - -71.30% -
482.sphinx3 (avg) (percentage) -1.52% 1.970 1.940 - -75.54% -
434.zeusmp (avg) (percentage) -1.52% 1.320 1.300 - -77.78% -
471.omnetpp (unexplained diff vs previous) (percentage) -1.40% 2.150 2.120 - -99.46% -
436.cactusADM (avg) (percentage) -1.30% 1.540 1.520 - -74.58% -
458.sjeng (avg) (percentage) -1.30% 0.770 0.760 - -76.18% -
459.GemsFDTD (avg) (percentage) -1.28% 1.560 1.540 - -73.63% -
403.gcc (max) (percentage) -1.26% 4.760 4.700 - -95.27% -
459.GemsFDTD -1.22% 82.000 81.000 - -77.50% -
459.GemsFDTD (avg) -1.22% 82.000 81.000 - -77.50% -
429.mcf (avg) (percentage) -1.14% 6.130 6.060 - -20.99% -
473.astar (avg) (percentage) -1.10% 1.810 1.790 - -56.97% -

Run-Over-Baseline Changes Detail

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
465.tonto 6.56% 10941.000 11659.000 - -0.15% -
450.soplex 4.76% 567.000 594.000 - 1.71% -
410.bwaves 4.07% 5652.000 5882.000 - -1.03% -
444.namd 3.35% 747.000 772.000 - -0.13% -
456.hmmer 2.29% 2882.000 2948.000 - -0.57% -
401.bzip2 1.46% 2941.000 2984.000 - -0.33% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d (avg) (percentage) 57.38% 3.050 4.800 - 0.84% -
437.leslie3d 48.17% 355.000 526.000 - -6.24% -
437.leslie3d (avg) 48.17% 355.000 526.000 - -6.24% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -13.79% 29.000 25.000 - 0.00% -
nb_execution_successful -13.79% 29.000 25.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
459.GemsFDTD -2.65% 244728.000 238232.000 - 0.00% -
434.zeusmp -2.56% 152037.000 148143.000 - 0.00% -
410.bwaves -1.67% 16760.000 16480.000 - 0.00% -
444.namd -1.61% 188385.000 185348.000 - 0.00% -
464.h264ref -1.46% 387748.000 382096.000 - 0.00% -
470.lbm -1.44% 9691.000 9551.000 - 0.00% -
435.gromacs -1.39% 499261.000 492297.000 - 0.00% -
437.leslie3d -1.33% 59479.000 58690.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
459.GemsFDTD -14.24% 6173.000 5294.000 - 0.55% -
482.sphinx3 -12.49% 945.000 827.000 - -0.36% -
400.perlbench -7.10% 1663.000 1545.000 - 0.59% -
437.leslie3d -5.68% 11640.000 10979.000 - -6.94% -
447.dealII -4.29% 1724.000 1650.000 - -1.14% -
429.mcf -3.44% 1424.000 1375.000 - -1.36% -
435.gromacs -2.61% 7269.000 7079.000 - -0.44% -
445.gobmk -2.51% 5023.000 4897.000 - -0.31% -
416.gamess -2.24% 12465.000 12186.000 - 0.14% -
458.sjeng -1.43% 7567.000 7459.000 - 0.21% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
482.sphinx3 (unexplained diff vs previous) -99.99% 26073.000 3.000 - 0.00% -
444.namd (unexplained diff vs previous) (percentage) -99.99% 1118.610 0.130 - -80.00% -
444.namd (unexplained diff vs previous) -99.99% 8356.000 1.000 - -80.00% -
482.sphinx3 (unexplained diff vs previous) (percentage) -99.99% 2759.050 0.360 - 0.00% -
453.povray (unexplained diff vs previous) (percentage) -99.98% 1043.330 0.180 - -75.34% -
433.milc (unexplained diff vs previous) (percentage) -99.98% 980.800 0.170 - -60.47% -
453.povray (unexplained diff vs previous) -99.98% 5707.000 1.000 - -75.00% -
433.milc (unexplained diff vs previous) -99.98% 11289.000 2.000 - -60.00% -
470.lbm (unexplained diff vs previous) (percentage) -99.98% 263.730 0.050 - -88.89% -
470.lbm (unexplained diff vs previous) -99.98% 9990.000 2.000 - -88.24% -
464.h264ref (unexplained diff vs previous) (percentage) -99.97% 118.780 0.030 - -57.14% -
464.h264ref (unexplained diff vs previous) -99.97% 6843.000 2.000 - -50.00% -
462.libquantum (unexplained diff vs previous) -99.97% 13518.000 4.000 - 100.00% -
462.libquantum (unexplained diff vs previous) (percentage) -99.97% 9655.710 2.860 - 94.56% -
434.zeusmp (unexplained diff vs previous) -99.95% 11280.000 6.000 - 0.00% -
434.zeusmp (unexplained diff vs previous) (percentage) -99.95% 448.690 0.240 - 0.00% -
450.soplex (unexplained diff vs previous) (percentage) -99.93% 2557.320 1.680 - 888.24% -
450.soplex (unexplained diff vs previous) -99.93% 14500.000 10.000 - 900.00% -
436.cactusADM (unexplained diff vs previous) (percentage) -99.93% 787.130 0.570 - 137.50% -
436.cactusADM (unexplained diff vs previous) -99.93% 16396.000 12.000 - 140.00% -
401.bzip2 (unexplained diff vs previous) (percentage) -99.91% 368.340 0.340 - -35.85% -
401.bzip2 (unexplained diff vs previous) -99.91% 10833.000 10.000 - -37.50% -
429.mcf (unexplained diff vs previous) -99.90% 18593.000 19.000 - 850.00% -
400.perlbench (unexplained diff vs previous) -99.90% 8772.000 9.000 - -73.53% -
429.mcf (unexplained diff vs previous) (percentage) -99.89% 1305.690 1.380 - 885.71% -
400.perlbench (unexplained diff vs previous) (percentage) -99.89% 527.480 0.580 - -73.76% -
459.GemsFDTD (unexplained diff vs previous) -99.81% 15458.000 29.000 - 61.11% -
456.hmmer (unexplained diff vs previous) (percentage) -99.79% 278.630 0.580 - 346.15% -
456.hmmer (unexplained diff vs previous) -99.79% 8030.000 17.000 - 325.00% -
416.gamess (unexplained diff vs previous) -99.78% 7819.000 17.000 - -46.88% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -99.78% 250.410 0.550 - 61.76% -
416.gamess (unexplained diff vs previous) (percentage) -99.78% 62.730 0.140 - -46.15% -
458.sjeng (unexplained diff vs previous) (percentage) -99.77% 90.870 0.210 - 162.50% -
458.sjeng (unexplained diff vs previous) -99.77% 6876.000 16.000 - 166.67% -
445.gobmk (unexplained diff vs previous) -99.73% 5581.000 15.000 - -11.76% -
447.dealII (unexplained diff vs previous) -99.73% 7017.000 19.000 - -34.48% -
445.gobmk (unexplained diff vs previous) (percentage) -99.72% 111.110 0.310 - -11.43% -
447.dealII (unexplained diff vs previous) (percentage) -99.72% 407.020 1.150 - -33.91% -
433.milc (max) -99.71% 1044.000 3.000 - -66.67% -
433.milc (max) (percentage) -99.65% 90.750 0.320 - -61.90% -
435.gromacs (unexplained diff vs previous) -99.56% 7028.000 31.000 - -70.19% -
435.gromacs (unexplained diff vs previous) (percentage) -99.54% 96.680 0.440 - -69.86% -
473.astar (unexplained diff vs previous) (percentage) -99.53% 197.850 0.930 - 57.63% -
458.sjeng (max) -99.53% 3602.000 17.000 - -10.53% -
473.astar (unexplained diff vs previous) -99.53% 10146.000 48.000 - 54.84% -
458.sjeng (max) (percentage) -99.50% 47.610 0.240 - -7.69% -
470.lbm (max) -99.49% 2746.000 14.000 - -17.65% -
470.lbm (max) (percentage) -99.46% 72.510 0.390 - -13.33% -
471.omnetpp (unexplained diff vs previous) (percentage) -99.46% 391.300 2.120 - -1.40% -
471.omnetpp (unexplained diff vs previous) -99.46% 10659.000 58.000 - -3.33% -
445.gobmk (max) -99.43% 2643.000 15.000 - -62.50% -
444.namd (max) -99.42% 685.000 4.000 - -33.33% -
445.gobmk (max) (percentage) -99.41% 52.630 0.310 - -62.20% -
436.cactusADM (max) -99.40% 1848.000 11.000 - 120.00% -
453.povray (max) -99.40% 499.000 3.000 - -25.00% -
444.namd (max) (percentage) -99.38% 91.790 0.570 - -34.48% -
436.cactusADM (max) (percentage) -99.36% 88.730 0.570 - 137.50% -
459.GemsFDTD (max) -99.34% 4411.000 29.000 - 26.09% -
453.povray (max) (percentage) -99.32% 91.250 0.620 - -16.22% -
464.h264ref (max) -99.30% 3127.000 22.000 - -4.35% -
464.h264ref (max) (percentage) -99.28% 54.290 0.390 - -4.88% -
410.bwaves (unexplained diff vs previous) (percentage) -99.25% 137.900 1.040 - 26.83% -
456.hmmer (max) -99.25% 2120.000 16.000 - 166.67% -
459.GemsFDTD (max) (percentage) -99.23% 71.460 0.550 - 25.00% -
456.hmmer (max) (percentage) -99.23% 73.590 0.570 - 159.09% -
410.bwaves (unexplained diff vs previous) -99.22% 7794.000 61.000 - 24.49% -
434.zeusmp (max) -99.17% 2055.000 17.000 - -10.53% -
434.zeusmp (max) (percentage) -99.16% 81.770 0.690 - -11.54% -
482.sphinx3 (max) -99.12% 911.000 8.000 - -11.11% -
465.tonto (unexplained diff vs previous) (percentage) -99.07% 16.190 0.150 - -75.81% -
454.calculix (max) (percentage) -99.05% 99.730 0.950 - -2.06% -
465.tonto (unexplained diff vs previous) -99.04% 1771.000 17.000 - -76.39% -
482.sphinx3 (max) (percentage) -98.92% 96.500 1.040 - -4.59% -
429.mcf (max) -98.64% 1322.000 18.000 - 125.00% -
473.astar (max) -98.62% 3406.000 47.000 - 51.61% -
473.astar (max) (percentage) -98.62% 66.430 0.920 - 53.33% -
429.mcf (max) (percentage) -98.54% 92.890 1.360 - 119.35% -
416.gamess (max) -98.48% 4805.000 73.000 - -3.95% -
481.wrf (max) (percentage) -98.47% 68.700 1.050 - -0.94% -
416.gamess (max) (percentage) -98.44% 38.550 0.600 - -4.76% -
447.dealII (max) -98.27% 1384.000 24.000 - -17.24% -
410.bwaves (max) (percentage) -98.22% 57.970 1.030 - 24.10% -
450.soplex (max) (percentage) -98.22% 96.240 1.710 - 216.67% -
447.dealII (max) (percentage) -98.17% 80.280 1.470 - -16.95% -
410.bwaves (max) -98.17% 3276.000 60.000 - 22.45% -
450.soplex (max) -98.17% 545.000 10.000 - 233.33% -
435.gromacs (max) -97.65% 3573.000 84.000 - -17.65% -
435.gromacs (max) (percentage) -97.56% 49.160 1.200 - -16.67% -
483.xalancbmk (max) (percentage) -97.42% 68.670 1.770 - 0.00% -
471.omnetpp (max) -97.42% 2169.000 56.000 - -12.50% -
471.omnetpp (max) (percentage) -97.39% 79.650 2.080 - -9.17% -
401.bzip2 (max) (percentage) -97.34% 78.650 2.090 - -5.00% -
401.bzip2 (max) -97.32% 2313.000 62.000 - -4.62% -
465.tonto (max) (percentage) -97.31% 19.310 0.520 - -32.47% -
465.tonto (max) -97.16% 2112.000 60.000 - -32.58% -
400.perlbench (max) -97.14% 1397.000 40.000 - -6.98% -
462.libquantum (max) -97.10% 138.000 4.000 - 100.00% -
462.libquantum (max) (percentage) -97.03% 98.970 2.940 - 36.11% -
400.perlbench (max) (percentage) -96.85% 84.060 2.650 - -6.36% -
403.gcc (max) (percentage) -95.27% 99.360 4.700 - -1.26% -
416.gamess -83.27% 550.000 92.000 - -2.13% -
416.gamess (avg) -83.27% 550.000 92.000 - -2.13% -
416.gamess (avg) (percentage) -82.81% 4.420 0.760 - -2.56% -
456.hmmer -82.68% 127.000 22.000 - 0.00% -
456.hmmer (avg) -82.68% 127.000 22.000 - 0.00% -
456.hmmer (avg) (percentage) -82.54% 4.410 0.770 - 0.00% -
444.namd -82.35% 68.000 12.000 - 0.00% -
444.namd (avg) -82.35% 68.000 12.000 - 0.00% -
444.namd (avg) (percentage) -82.21% 9.220 1.640 - -1.80% -
470.lbm (avg) (percentage) -80.88% 6.330 1.210 - -1.63% -
470.lbm -80.75% 239.000 46.000 - 0.00% -
470.lbm (avg) -80.75% 239.000 46.000 - 0.00% -
464.h264ref -80.20% 293.000 58.000 - -1.69% -
464.h264ref (avg) -80.20% 293.000 58.000 - -1.69% -
464.h264ref (avg) (percentage) -80.16% 5.090 1.010 - -1.94% -
462.libquantum -80.00% 10.000 2.000 - 0.00% -
462.libquantum (avg) -80.00% 10.000 2.000 - 0.00% -
453.povray -78.57% 42.000 9.000 - 0.00% -
453.povray (avg) -78.57% 42.000 9.000 - 0.00% -
482.sphinx3 -78.38% 74.000 16.000 - 0.00% -
482.sphinx3 (avg) -78.38% 74.000 16.000 - 0.00% -
434.zeusmp -78.23% 147.000 32.000 - -3.03% -
434.zeusmp (avg) -78.23% 147.000 32.000 - -3.03% -
453.povray (avg) (percentage) -78.10% 7.810 1.710 - -1.72% -
434.zeusmp (avg) (percentage) -77.78% 5.850 1.300 - -1.52% -
459.GemsFDTD -77.50% 360.000 81.000 - -1.22% -
459.GemsFDTD (avg) -77.50% 360.000 81.000 - -1.22% -
458.sjeng -76.76% 241.000 56.000 - -1.75% -
458.sjeng (avg) -76.76% 241.000 56.000 - -1.75% -
462.libquantum (avg) (percentage) -76.24% 7.660 1.820 - 0.55% -
458.sjeng (avg) (percentage) -76.18% 3.190 0.760 - -1.30% -
447.dealII -75.76% 99.000 24.000 - 0.00% -
447.dealII (avg) -75.76% 99.000 24.000 - 0.00% -
482.sphinx3 (avg) (percentage) -75.54% 7.930 1.940 - -1.52% -
436.cactusADM -75.00% 124.000 31.000 - -3.12% -
436.cactusADM (avg) -75.00% 124.000 31.000 - -3.12% -
447.dealII (avg) (percentage) -74.70% 5.770 1.460 - -0.68% -
436.cactusADM (avg) (percentage) -74.58% 5.980 1.520 - -1.30% -
445.gobmk -74.49% 196.000 50.000 - -1.96% -
445.gobmk (avg) -74.49% 196.000 50.000 - -1.96% -
433.milc -73.91% 69.000 18.000 - 0.00% -
433.milc (avg) -73.91% 69.000 18.000 - 0.00% -
433.milc (avg) (percentage) -73.88% 6.050 1.580 - -1.86% -
410.bwaves (avg) (percentage) -73.70% 4.410 1.160 - 0.00% -
445.gobmk (avg) (percentage) -73.66% 3.910 1.030 - -0.96% -
459.GemsFDTD (avg) (percentage) -73.63% 5.840 1.540 - -1.28% -
410.bwaves -72.69% 249.000 68.000 - 0.00% -
410.bwaves (avg) -72.69% 249.000 68.000 - 0.00% -
471.omnetpp -71.30% 223.000 64.000 - -1.54% -
471.omnetpp (avg) -71.30% 223.000 64.000 - -1.54% -
471.omnetpp (avg) (percentage) -71.22% 8.200 2.360 - 0.00% -
481.wrf (avg) (percentage) -71.15% 6.240 1.800 - 0.00% -
400.perlbench -66.67% 105.000 35.000 - -2.78% -
400.perlbench (avg) -66.67% 105.000 35.000 - -2.78% -
401.bzip2 (avg) (percentage) -65.51% 5.480 1.890 - -1.56% -
401.bzip2 -65.22% 161.000 56.000 - -1.75% -
401.bzip2 (avg) -65.22% 161.000 56.000 - -1.75% -
437.leslie3d (unexplained diff vs previous) -64.61% 2314.000 819.000 - 52.80% -
400.perlbench (avg) (percentage) -63.62% 6.350 2.310 - -1.70% -
435.gromacs -63.22% 367.000 135.000 - -2.17% -
435.gromacs (avg) -63.22% 367.000 135.000 - -2.17% -
437.leslie3d (unexplained diff vs previous) (percentage) -62.47% 19.880 7.460 - 64.32% -
435.gromacs (avg) (percentage) -62.06% 5.060 1.920 - -1.54% -
437.leslie3d (max) -60.55% 1929.000 761.000 - 31.21% -
450.soplex (avg) (percentage) -58.48% 6.430 2.670 - -0.74% -
450.soplex -58.33% 36.000 15.000 - 0.00% -
450.soplex (avg) -58.33% 36.000 15.000 - 0.00% -
437.leslie3d (max) (percentage) -58.14% 16.580 6.940 - 41.06% -
465.tonto (avg) (percentage) -57.19% 3.340 1.430 - -2.05% -
473.astar (avg) (percentage) -56.97% 4.160 1.790 - -1.10% -
473.astar -56.81% 213.000 92.000 - -2.13% -
473.astar (avg) -56.81% 213.000 92.000 - -2.13% -
454.calculix (avg) (percentage) -55.11% 8.020 3.600 - 0.00% -
465.tonto -54.52% 365.000 166.000 - -2.35% -
465.tonto (avg) -54.52% 365.000 166.000 - -2.35% -
483.xalancbmk (avg) (percentage) -54.46% 6.500 2.960 - 0.00% -
403.gcc (avg) (percentage) -30.46% 7.320 5.090 - 0.00% -
429.mcf -23.85% 109.000 83.000 - -2.35% -
429.mcf (avg) -23.85% 109.000 83.000 - -2.35% -
429.mcf (avg) (percentage) -20.99% 7.670 6.060 - -1.14% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 13.79% 29.000 33.000 - 0.00% -

Report Time: 0.37s
Execution (seconds)
Name Current %
400.perlbench 1545.000 -
401.bzip2 2984.000 -
410.bwaves 5882.000 -1.03%
416.gamess 12186.000 -
429.mcf 1375.000 -1.36%
433.milc 1151.000 -
434.zeusmp 2525.000 -
435.gromacs 7079.000 -
436.cactusADM 2100.000 -
437.leslie3d 10979.000 -6.94%
444.namd 772.000 -
445.gobmk 4897.000 -
447.dealII 1650.000 -1.14%
450.soplex 594.000 1.71%
453.povray 547.000 -
456.hmmer 2948.000 -
458.sjeng 7459.000 -
459.GemsFDTD 5294.000 -
462.libquantum 140.000 2.94%
464.h264ref 5759.000 -
465.tonto 11659.000 -
470.lbm 3803.000 -
471.omnetpp 2737.000 -2.08%
473.astar 5165.000 -
482.sphinx3 827.000 -
Geometric Mean 2588.789 -
Code Size (bytes)
Name Current %
400.perlbench 890587.000 -
401.bzip2 43919.000 -
410.bwaves 16480.000 -
416.gamess 5700921.000 -
429.mcf 9055.000 -
433.milc 60805.000 -
434.zeusmp 148143.000 -
435.gromacs 492297.000 -
436.cactusADM 350637.000 -
437.leslie3d 58690.000 -
444.namd 185348.000 -
445.gobmk 1383066.000 -
447.dealII 310444.000 -
450.soplex 205303.000 -
453.povray 656269.000 -
456.hmmer 108215.000 -
458.sjeng 103292.000 -
459.GemsFDTD 238232.000 -
462.libquantum 16085.000 -
464.h264ref 382096.000 -
465.tonto 1939926.000 -
470.lbm 9551.000 -
471.omnetpp 479794.000 -
473.astar 22880.000 -
482.sphinx3 112243.000 -
Geometric Mean 159736.912 -
sample variability
Name Current %
400.perlbench 35.000 -2.78%
400.perlbench (avg) 35.000 -2.78%
400.perlbench (avg) (percentage) 2.310 -1.70%
400.perlbench (max) 40.000 -6.98%
400.perlbench (max) (percentage) 2.650 -6.36%
400.perlbench (unexplained diff vs previous) 9.000 -73.53%
400.perlbench (unexplained diff vs previous) (percentage) 0.580 -73.76%
401.bzip2 56.000 -1.75%
401.bzip2 (avg) 56.000 -1.75%
401.bzip2 (avg) (percentage) 1.890 -1.56%
401.bzip2 (max) 62.000 -4.62%
401.bzip2 (max) (percentage) 2.090 -5.00%
401.bzip2 (unexplained diff vs previous) 10.000 -37.50%
401.bzip2 (unexplained diff vs previous) (percentage) 0.340 -35.85%
403.gcc (avg) (percentage) 5.090 -
403.gcc (max) (percentage) 4.700 -1.26%
410.bwaves 68.000 -
410.bwaves (avg) 68.000 -
410.bwaves (avg) (percentage) 1.160 -
410.bwaves (max) 60.000 22.45%
410.bwaves (max) (percentage) 1.030 24.10%
410.bwaves (unexplained diff vs previous) 61.000 24.49%
410.bwaves (unexplained diff vs previous) (percentage) 1.040 26.83%
416.gamess 92.000 -2.13%
416.gamess (avg) 92.000 -2.13%
416.gamess (avg) (percentage) 0.760 -2.56%
416.gamess (max) 73.000 -3.95%
416.gamess (max) (percentage) 0.600 -4.76%
416.gamess (unexplained diff vs previous) 17.000 -46.88%
416.gamess (unexplained diff vs previous) (percentage) 0.140 -46.15%
429.mcf 83.000 -2.35%
429.mcf (avg) 83.000 -2.35%
429.mcf (avg) (percentage) 6.060 -1.14%
429.mcf (max) 18.000 125.00%
429.mcf (max) (percentage) 1.360 119.35%
429.mcf (unexplained diff vs previous) 19.000 850.00%
429.mcf (unexplained diff vs previous) (percentage) 1.380 885.71%
433.milc 18.000 -
433.milc (avg) 18.000 -
433.milc (avg) (percentage) 1.580 -1.86%
433.milc (max) 3.000 -66.67%
433.milc (max) (percentage) 0.320 -61.90%
433.milc (unexplained diff vs previous) 2.000 -60.00%
433.milc (unexplained diff vs previous) (percentage) 0.170 -60.47%
434.zeusmp 32.000 -3.03%
434.zeusmp (avg) 32.000 -3.03%
434.zeusmp (avg) (percentage) 1.300 -1.52%
434.zeusmp (max) 17.000 -10.53%
434.zeusmp (max) (percentage) 0.690 -11.54%
434.zeusmp (unexplained diff vs previous) 6.000 -
434.zeusmp (unexplained diff vs previous) (percentage) 0.240 -
435.gromacs 135.000 -2.17%
435.gromacs (avg) 135.000 -2.17%
435.gromacs (avg) (percentage) 1.920 -1.54%
435.gromacs (max) 84.000 -17.65%
435.gromacs (max) (percentage) 1.200 -16.67%
435.gromacs (unexplained diff vs previous) 31.000 -70.19%
435.gromacs (unexplained diff vs previous) (percentage) 0.440 -69.86%
436.cactusADM 31.000 -3.12%
436.cactusADM (avg) 31.000 -3.12%
436.cactusADM (avg) (percentage) 1.520 -1.30%
436.cactusADM (max) 11.000 120.00%
436.cactusADM (max) (percentage) 0.570 137.50%
436.cactusADM (unexplained diff vs previous) 12.000 140.00%
436.cactusADM (unexplained diff vs previous) (percentage) 0.570 137.50%
437.leslie3d 526.000 -6.24%
437.leslie3d (avg) 526.000 -6.24%
437.leslie3d (avg) (percentage) 4.800 -
437.leslie3d (max) 761.000 31.21%
437.leslie3d (max) (percentage) 6.940 41.06%
437.leslie3d (unexplained diff vs previous) 819.000 52.80%
437.leslie3d (unexplained diff vs previous) (percentage) 7.460 64.32%
444.namd 12.000 -
444.namd (avg) 12.000 -
444.namd (avg) (percentage) 1.640 -1.80%
444.namd (max) 4.000 -33.33%
444.namd (max) (percentage) 0.570 -34.48%
444.namd (unexplained diff vs previous) 1.000 -80.00%
444.namd (unexplained diff vs previous) (percentage) 0.130 -80.00%
445.gobmk 50.000 -1.96%
445.gobmk (avg) 50.000 -1.96%
445.gobmk (avg) (percentage) 1.030 -
445.gobmk (max) 15.000 -62.50%
445.gobmk (max) (percentage) 0.310 -62.20%
445.gobmk (unexplained diff vs previous) 15.000 -11.76%
445.gobmk (unexplained diff vs previous) (percentage) 0.310 -11.43%
447.dealII 24.000 -
447.dealII (avg) 24.000 -
447.dealII (avg) (percentage) 1.460 -
447.dealII (max) 24.000 -17.24%
447.dealII (max) (percentage) 1.470 -16.95%
447.dealII (unexplained diff vs previous) 19.000 -34.48%
447.dealII (unexplained diff vs previous) (percentage) 1.150 -33.91%
450.soplex 15.000 -
450.soplex (avg) 15.000 -
450.soplex (avg) (percentage) 2.670 -
450.soplex (max) 10.000 233.33%
450.soplex (max) (percentage) 1.710 216.67%
450.soplex (unexplained diff vs previous) 10.000 900.00%
450.soplex (unexplained diff vs previous) (percentage) 1.680 888.24%
453.povray 9.000 -
453.povray (avg) 9.000 -
453.povray (avg) (percentage) 1.710 -1.72%
453.povray (max) 3.000 -25.00%
453.povray (max) (percentage) 0.620 -16.22%
453.povray (unexplained diff vs previous) 1.000 -75.00%
453.povray (unexplained diff vs previous) (percentage) 0.180 -75.34%
454.calculix (avg) (percentage) 3.600 -
454.calculix (max) (percentage) 0.950 -2.06%
456.hmmer 22.000 -
456.hmmer (avg) 22.000 -
456.hmmer (avg) (percentage) 0.770 -
456.hmmer (max) 16.000 166.67%
456.hmmer (max) (percentage) 0.570 159.09%
456.hmmer (unexplained diff vs previous) 17.000 325.00%
456.hmmer (unexplained diff vs previous) (percentage) 0.580 346.15%
458.sjeng 56.000 -1.75%
458.sjeng (avg) 56.000 -1.75%
458.sjeng (avg) (percentage) 0.760 -1.30%
458.sjeng (max) 17.000 -10.53%
458.sjeng (max) (percentage) 0.240 -7.69%
458.sjeng (unexplained diff vs previous) 16.000 166.67%
458.sjeng (unexplained diff vs previous) (percentage) 0.210 162.50%
459.GemsFDTD 81.000 -1.22%
459.GemsFDTD (avg) 81.000 -1.22%
459.GemsFDTD (avg) (percentage) 1.540 -1.28%
459.GemsFDTD (max) 29.000 26.09%
459.GemsFDTD (max) (percentage) 0.550 25.00%
459.GemsFDTD (unexplained diff vs previous) 29.000 61.11%
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.550 61.76%
462.libquantum 2.000 -
462.libquantum (avg) 2.000 -
462.libquantum (avg) (percentage) 1.820 -
462.libquantum (max) 4.000 100.00%
462.libquantum (max) (percentage) 2.940 36.11%
462.libquantum (unexplained diff vs previous) 4.000 100.00%
462.libquantum (unexplained diff vs previous) (percentage) 2.860 94.56%
464.h264ref 58.000 -1.69%
464.h264ref (avg) 58.000 -1.69%
464.h264ref (avg) (percentage) 1.010 -1.94%
464.h264ref (max) 22.000 -4.35%
464.h264ref (max) (percentage) 0.390 -4.88%
464.h264ref (unexplained diff vs previous) 2.000 -50.00%
464.h264ref (unexplained diff vs previous) (percentage) 0.030 -57.14%
465.tonto 166.000 -2.35%
465.tonto (avg) 166.000 -2.35%
465.tonto (avg) (percentage) 1.430 -2.05%
465.tonto (max) 60.000 -32.58%
465.tonto (max) (percentage) 0.520 -32.47%
465.tonto (unexplained diff vs previous) 17.000 -76.39%
465.tonto (unexplained diff vs previous) (percentage) 0.150 -75.81%
470.lbm 46.000 -
470.lbm (avg) 46.000 -
470.lbm (avg) (percentage) 1.210 -1.63%
470.lbm (max) 14.000 -17.65%
470.lbm (max) (percentage) 0.390 -13.33%
470.lbm (unexplained diff vs previous) 2.000 -88.24%
470.lbm (unexplained diff vs previous) (percentage) 0.050 -88.89%
471.omnetpp 64.000 -1.54%
471.omnetpp (avg) 64.000 -1.54%
471.omnetpp (avg) (percentage) 2.360 -
471.omnetpp (max) 56.000 -12.50%
471.omnetpp (max) (percentage) 2.080 -9.17%
471.omnetpp (unexplained diff vs previous) 58.000 -3.33%
471.omnetpp (unexplained diff vs previous) (percentage) 2.120 -1.40%
473.astar 92.000 -2.13%
473.astar (avg) 92.000 -2.13%
473.astar (avg) (percentage) 1.790 -1.10%
473.astar (max) 47.000 51.61%
473.astar (max) (percentage) 0.920 53.33%
473.astar (unexplained diff vs previous) 48.000 54.84%
473.astar (unexplained diff vs previous) (percentage) 0.930 57.63%
481.wrf (avg) (percentage) 1.800 -
481.wrf (max) (percentage) 1.050 -
482.sphinx3 16.000 -
482.sphinx3 (avg) 16.000 -
482.sphinx3 (avg) (percentage) 1.940 -1.52%
482.sphinx3 (max) 8.000 -11.11%
482.sphinx3 (max) (percentage) 1.040 -4.59%
482.sphinx3 (unexplained diff vs previous) 3.000 -
482.sphinx3 (unexplained diff vs previous) (percentage) 0.360 -
483.xalancbmk (avg) (percentage) 2.960 -
483.xalancbmk (max) (percentage) 1.770 -
Geometric Mean 5.725 8.70%