Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=878e894801169461adc00129ad33947ad541420d (unchanged)
git_gcc https://github.com/gcc-mirror/gcc/commit/2c3db94d9fd07681f8806dae93d555779ff4dfb1 (+ 1 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=9c72830eb3e12c1d57ac7d1992c96ee69ccd835d (unchanged)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=f9f042df0c5a1377b526200359b1d1124e1cd1ff (unchanged)
regression GNU-1054
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-aarch64-master-Os_LTO-build/193/
View Options
Report
Filter

gnu-aarch64-master-Os_LTO test results

Run Order Start Time Duration
Current 0193 (basepoints/gcc-14-06032-g2c3db94d9fd) 2024-01-27T18:48:40 0:00:00
Previous 0192 (basepoints/gcc-14-06031-g37043268825) 2024-01-25T17:16:50 0:00:00
Baseline 0001 (4-changed-components) 2023-02-20T22:48:24 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 82 11
Performance Improvements 89 203
Added Tests 4 0
Unchanged Tests 1061 1022
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
429.mcf 28.21% 1372.000 1759.000 - 23.53% -
437.leslie3d 1.61% 11011.000 11188.000 - -3.88% -
436.cactusADM 1.19% 2099.000 2124.000 - 1.97% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
400.perlbench (unexplained diff vs previous) (percentage) 4550.00% 0.060 2.790 - -99.47% -
400.perlbench (unexplained diff vs previous) 4100.00% 1.000 42.000 - -99.52% -
433.milc (unexplained diff vs previous) 3100.00% 1.000 32.000 - -99.72% -
433.milc (unexplained diff vs previous) (percentage) 3088.89% 0.090 2.870 - -99.71% -
458.sjeng (unexplained diff vs previous) (percentage) 2260.00% 0.050 1.180 - -98.70% -
401.bzip2 (unexplained diff vs previous) (percentage) 2246.15% 0.130 3.050 - -99.17% -
401.bzip2 (unexplained diff vs previous) 2125.00% 4.000 89.000 - -99.18% -
458.sjeng (unexplained diff vs previous) 2050.00% 4.000 86.000 - -98.75% -
429.mcf (unexplained diff vs previous) 1333.33% 27.000 387.000 - -97.92% -
434.zeusmp (unexplained diff vs previous) 1266.67% 3.000 41.000 - -99.64% -
434.zeusmp (unexplained diff vs previous) (percentage) 1258.33% 0.120 1.630 - -99.64% -
429.mcf (unexplained diff vs previous) (percentage) 1016.75% 1.970 22.000 - -98.32% -
473.astar (unexplained diff vs previous) (percentage) 894.59% 0.370 3.680 - -98.14% -
473.astar (unexplained diff vs previous) 863.16% 19.000 183.000 - -98.20% -
435.gromacs (unexplained diff vs previous) (percentage) 593.33% 0.300 2.080 - -97.85% -
435.gromacs (unexplained diff vs previous) 568.18% 22.000 147.000 - -97.91% -
435.gromacs (max) (percentage) 383.33% 0.420 2.030 - -95.87% -
435.gromacs (max) 376.67% 30.000 143.000 - -96.00% -
459.GemsFDTD (unexplained diff vs previous) (percentage) 366.67% 0.390 1.820 - -99.27% -
459.GemsFDTD (unexplained diff vs previous) 362.50% 24.000 111.000 - -99.28% -
445.gobmk (unexplained diff vs previous) (percentage) 350.00% 0.560 2.520 - -97.73% -
445.gobmk (unexplained diff vs previous) 339.29% 28.000 123.000 - -97.80% -
482.sphinx3 (unexplained diff vs previous) (percentage) 332.56% 0.430 1.860 - -99.93% -
482.sphinx3 (unexplained diff vs previous) 325.00% 4.000 17.000 - -99.93% -
450.soplex (unexplained diff vs previous) (percentage) 277.27% 1.540 5.810 - -99.77% -
400.perlbench (max) (percentage) 266.22% 0.740 2.710 - -96.78% -
400.perlbench (max) 263.64% 11.000 40.000 - -97.14% -
450.soplex (unexplained diff vs previous) 255.56% 9.000 32.000 - -99.78% -
470.lbm (unexplained diff vs previous) 255.56% 9.000 32.000 - -99.68% -
470.lbm (unexplained diff vs previous) (percentage) 254.17% 0.240 0.850 - -99.68% -
464.h264ref (max) 252.94% 17.000 60.000 - -98.08% -
464.h264ref (unexplained diff vs previous) (percentage) 241.94% 0.310 1.060 - -99.11% -
464.h264ref (unexplained diff vs previous) 238.89% 18.000 61.000 - -99.11% -
464.h264ref (max) (percentage) 238.71% 0.310 1.050 - -98.07% -
436.cactusADM (unexplained diff vs previous) 212.50% 8.000 25.000 - -99.85% -
436.cactusADM (unexplained diff vs previous) (percentage) 210.53% 0.380 1.180 - -99.85% -
462.libquantum (unexplained diff vs previous) (percentage) 208.33% 0.720 2.220 - -99.98% -
462.libquantum (unexplained diff vs previous) 200.00% 1.000 3.000 - -99.98% -
436.cactusADM (max) 177.78% 9.000 25.000 - -98.65% -
436.cactusADM (max) (percentage) 158.70% 0.460 1.190 - -98.66% -
410.bwaves (unexplained diff vs previous) (percentage) 145.83% 0.480 1.180 - -99.14% -
410.bwaves (unexplained diff vs previous) 144.44% 27.000 66.000 - -99.15% -
433.milc (max) 138.46% 13.000 31.000 - -97.03% -
433.milc (max) (percentage) 136.44% 1.180 2.790 - -96.93% -
450.soplex (max) (percentage) 135.62% 2.330 5.490 - -94.30% -
458.sjeng (max) (percentage) 132.00% 0.500 1.160 - -97.56% -
450.soplex (max) 130.77% 13.000 30.000 - -94.50% -
458.sjeng (max) 127.03% 37.000 84.000 - -97.67% -
445.gobmk (max) (percentage) 125.69% 1.090 2.460 - -95.33% -
445.gobmk (max) 122.22% 54.000 120.000 - -95.46% -
429.mcf (max) 114.72% 231.000 496.000 - -62.48% -
462.libquantum (max) 100.00% 1.000 2.000 - -98.55% -
456.hmmer (unexplained diff vs previous) 87.50% 8.000 15.000 - -99.81% -
456.hmmer (unexplained diff vs previous) (percentage) 85.71% 0.280 0.520 - -99.81% -
471.omnetpp (unexplained diff vs previous) (percentage) 73.52% 2.190 3.800 - -99.03% -
462.libquantum (max) (percentage) 69.53% 1.280 2.170 - -97.81% -
429.mcf (max) (percentage) 67.22% 16.870 28.210 - -69.63% -
471.omnetpp (unexplained diff vs previous) 67.21% 61.000 102.000 - -99.04% -
473.astar (max) (percentage) 64.35% 2.160 3.550 - -94.66% -
471.omnetpp (max) (percentage) 63.39% 2.240 3.660 - -95.40% -
481.wrf (unexplained diff vs previous) (percentage) 61.11% 0.180 0.290 - -99.87% -
481.wrf (unexplained diff vs previous) 60.00% 10.000 16.000 - -99.87% -
473.astar (max) 58.56% 111.000 176.000 - -94.83% -
470.lbm (max) (percentage) 58.49% 0.530 0.840 - -98.84% -
471.omnetpp (max) 58.06% 62.000 98.000 - -95.48% -
470.lbm (max) 55.00% 20.000 31.000 - -98.87% -
410.bwaves (max) 41.30% 46.000 65.000 - -98.02% -
410.bwaves (max) (percentage) 40.96% 0.830 1.170 - -97.98% -
429.mcf 36.05% 86.000 117.000 - 7.34% -
429.mcf (avg) 36.05% 86.000 117.000 - 7.34% -
429.mcf (avg) (percentage) 5.71% 6.310 6.670 - -13.04% -
436.cactusADM 2.78% 36.000 37.000 - -70.16% -
436.cactusADM (avg) 2.78% 36.000 37.000 - -70.16% -
445.gobmk (avg) (percentage) 2.70% 1.110 1.140 - -70.84% -
450.soplex (avg) (percentage) 1.72% 2.910 2.960 - -53.97% -
473.astar (avg) (percentage) 1.55% 1.930 1.960 - -52.88% -
433.milc (avg) (percentage) 1.16% 1.730 1.750 - -71.07% -

Performance Regressions - Score Δ Previous Current σ Δ (B) σ (B)
nb_compile_successful -3.57% 28.000 27.000 - -6.90% -
nb_execution_successful -3.57% 28.000 27.000 - -6.90% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
450.soplex -5.49% 583.000 551.000 - -2.82% -
403.gcc -5.08% 59.000 56.000 - 0.00% -
471.omnetpp -3.66% 2784.000 2682.000 - -1.54% -
473.astar -3.55% 5157.000 4974.000 - -3.00% -
401.bzip2 -2.96% 3010.000 2921.000 - -0.68% -
433.milc -2.79% 1148.000 1116.000 - -3.04% -
400.perlbench -2.71% 1548.000 1506.000 - -9.44% -
445.gobmk -2.46% 5008.000 4885.000 - -2.75% -
462.libquantum -2.17% 138.000 135.000 - -3.57% -
435.gromacs -2.03% 7228.000 7081.000 - -2.59% -
465.tonto -2.03% 11427.000 11195.000 - 2.32% -
482.sphinx3 -1.82% 933.000 916.000 - -3.07% -
459.GemsFDTD -1.78% 6223.000 6112.000 - -0.99% -
434.zeusmp -1.61% 2549.000 2508.000 - -0.24% -
410.bwaves -1.17% 5649.000 5583.000 - -1.22% -
458.sjeng -1.16% 7403.000 7317.000 - -3.30% -
464.h264ref -1.05% 5799.000 5738.000 - -0.40% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
444.namd (unexplained diff vs previous) (percentage) -83.95% 0.810 0.130 - -99.99% -
444.namd (unexplained diff vs previous) -83.33% 6.000 1.000 - -99.99% -
437.leslie3d (unexplained diff vs previous) (percentage) -40.60% 2.660 1.580 - -92.05% -
437.leslie3d (max) (percentage) -40.11% 3.790 2.270 - -86.31% -
447.dealII (unexplained diff vs previous) -40.00% 5.000 3.000 - -99.96% -
447.dealII (unexplained diff vs previous) (percentage) -40.00% 0.300 0.180 - -99.96% -
453.povray (unexplained diff vs previous) -40.00% 5.000 3.000 - -99.95% -
437.leslie3d (unexplained diff vs previous) -39.59% 293.000 177.000 - -92.35% -
453.povray (unexplained diff vs previous) (percentage) -39.56% 0.910 0.550 - -99.95% -
437.leslie3d (max) -39.33% 417.000 253.000 - -86.88% -
403.gcc -33.33% 3.000 2.000 - -50.00% -
403.gcc (avg) -33.33% 3.000 2.000 - -50.00% -
444.namd (max) -20.00% 5.000 4.000 - -99.42% -
444.namd (max) (percentage) -16.25% 0.800 0.670 - -99.27% -
454.calculix (max) (percentage) -12.58% 1.590 1.390 - -98.61% -
401.bzip2 (max) -8.25% 97.000 89.000 - -96.15% -
444.namd -7.14% 14.000 13.000 - -80.88% -
444.namd (avg) -7.14% 14.000 13.000 - -80.88% -
456.hmmer (max) -6.25% 16.000 15.000 - -99.29% -
456.hmmer (max) (percentage) -5.36% 0.560 0.530 - -99.28% -
465.tonto (max) -5.02% 299.000 284.000 - -86.55% -
482.sphinx3 -5.00% 20.000 19.000 - -74.32% -
482.sphinx3 (avg) -5.00% 20.000 19.000 - -74.32% -
434.zeusmp (max) -4.76% 42.000 40.000 - -98.05% -
482.sphinx3 (max) -4.76% 21.000 20.000 - -97.80% -
401.bzip2 (max) (percentage) -4.64% 3.230 3.080 - -96.08% -
447.dealII (max) (percentage) -4.41% 1.360 1.300 - -98.38% -
447.dealII (max) -4.35% 23.000 22.000 - -98.41% -
403.gcc (max) (percentage) -4.03% 6.210 5.960 - -94.00% -
482.sphinx3 (max) (percentage) -3.95% 2.280 2.190 - -97.73% -
459.GemsFDTD (max) -3.87% 155.000 149.000 - -96.62% -
447.dealII -3.85% 26.000 25.000 - -74.75% -
447.dealII (avg) -3.85% 26.000 25.000 - -74.75% -
453.povray (max) (percentage) -3.73% 1.610 1.550 - -98.30% -
416.gamess -3.45% 116.000 112.000 - -79.64% -
416.gamess (avg) -3.45% 116.000 112.000 - -79.64% -
416.gamess (avg) (percentage) -3.19% 0.940 0.910 - -79.41% -
416.gamess (max) -3.17% 63.000 61.000 - -98.73% -
465.tonto (max) (percentage) -3.05% 2.620 2.540 - -86.85% -
434.zeusmp (max) (percentage) -3.01% 1.660 1.610 - -98.03% -
471.omnetpp -2.99% 67.000 65.000 - -70.85% -
471.omnetpp (avg) -2.99% 67.000 65.000 - -70.85% -
481.wrf -2.94% 102.000 99.000 - -71.30% -
481.wrf (avg) -2.94% 102.000 99.000 - -71.30% -
400.perlbench -2.78% 36.000 35.000 - -66.67% -
400.perlbench (avg) -2.78% 36.000 35.000 - -66.67% -
481.wrf (avg) (percentage) -2.70% 1.850 1.800 - -71.15% -
459.GemsFDTD (max) (percentage) -2.40% 2.500 2.440 - -96.59% -
481.wrf (max) (percentage) -2.34% 1.280 1.250 - -98.18% -
473.astar -2.02% 99.000 97.000 - -54.46% -
473.astar (avg) -2.02% 99.000 97.000 - -54.46% -
416.gamess (max) (percentage) -1.96% 0.510 0.500 - -98.70% -
435.gromacs -1.96% 153.000 150.000 - -59.13% -
435.gromacs (avg) -1.96% 153.000 150.000 - -59.13% -
470.lbm -1.96% 51.000 50.000 - -79.08% -
470.lbm (avg) -1.96% 51.000 50.000 - -79.08% -
447.dealII (avg) (percentage) -1.92% 1.560 1.530 - -73.48% -
459.GemsFDTD -1.89% 106.000 104.000 - -71.11% -
459.GemsFDTD (avg) -1.89% 106.000 104.000 - -71.11% -
401.bzip2 -1.64% 61.000 60.000 - -62.73% -
401.bzip2 (avg) -1.64% 61.000 60.000 - -62.73% -
458.sjeng -1.64% 61.000 60.000 - -75.10% -
458.sjeng (avg) -1.64% 61.000 60.000 - -75.10% -
444.namd (avg) (percentage) -1.60% 1.880 1.850 - -79.93% -
453.povray (avg) (percentage) -1.58% 1.900 1.870 - -76.06% -
481.wrf (max) -1.43% 70.000 69.000 - -98.18% -
437.leslie3d (avg) (percentage) -1.40% 5.010 4.940 - 61.97% -
410.bwaves -1.37% 73.000 72.000 - -71.08% -
410.bwaves (avg) -1.37% 73.000 72.000 - -71.08% -
465.tonto -1.16% 172.000 170.000 - -53.42% -
465.tonto (avg) -1.16% 172.000 170.000 - -53.42% -

Performance Improvements - Score Δ Previous Current σ Δ (B) σ (B)
nb_total_tests 3.33% 30.000 31.000 - 6.90% -

Added Tests - sample variability
416.gamess (unexplained diff vs previous)
416.gamess (unexplained diff vs previous) (percentage)
465.tonto (unexplained diff vs previous)
465.tonto (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
450.soplex 1.72% 205081.000 208601.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
429.mcf 23.53% 1424.000 1759.000 - 28.21% -
465.tonto 2.32% 10941.000 11195.000 - -2.03% -
436.cactusADM 1.97% 2083.000 2124.000 - 1.19% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d (avg) (percentage) 61.97% 3.050 4.940 - -1.40% -
437.leslie3d 55.49% 355.000 552.000 - 0.18% -
437.leslie3d (avg) 55.49% 355.000 552.000 - 0.18% -
429.mcf 7.34% 109.000 117.000 - 36.05% -
429.mcf (avg) 7.34% 109.000 117.000 - 36.05% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -6.90% 29.000 27.000 - -3.57% -
nb_execution_successful -6.90% 29.000 27.000 - -3.57% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
459.GemsFDTD -1.45% 244728.000 241184.000 - 0.00% -
410.bwaves -1.22% 16760.000 16556.000 - 0.00% -
481.wrf -1.07% 1956607.000 1935742.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
400.perlbench -9.44% 1663.000 1506.000 - -2.71% -
437.leslie3d -3.88% 11640.000 11188.000 - 1.61% -
462.libquantum -3.57% 140.000 135.000 - -2.17% -
458.sjeng -3.30% 7567.000 7317.000 - -1.16% -
482.sphinx3 -3.07% 945.000 916.000 - -1.82% -
433.milc -3.04% 1151.000 1116.000 - -2.79% -
473.astar -3.00% 5128.000 4974.000 - -3.55% -
450.soplex -2.82% 567.000 551.000 - -5.49% -
445.gobmk -2.75% 5023.000 4885.000 - -2.46% -
435.gromacs -2.59% 7269.000 7081.000 - -2.03% -
447.dealII -1.57% 1724.000 1697.000 - 0.18% -
471.omnetpp -1.54% 2724.000 2682.000 - -3.66% -
410.bwaves -1.22% 5652.000 5583.000 - -1.17% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
444.namd (unexplained diff vs previous) (percentage) -99.99% 1118.610 0.130 - -83.95% -
444.namd (unexplained diff vs previous) -99.99% 8356.000 1.000 - -83.33% -
462.libquantum (unexplained diff vs previous) -99.98% 13518.000 3.000 - 200.00% -
462.libquantum (unexplained diff vs previous) (percentage) -99.98% 9655.710 2.220 - 208.33% -
447.dealII (unexplained diff vs previous) -99.96% 7017.000 3.000 - -40.00% -
447.dealII (unexplained diff vs previous) (percentage) -99.96% 407.020 0.180 - -40.00% -
453.povray (unexplained diff vs previous) -99.95% 5707.000 3.000 - -40.00% -
453.povray (unexplained diff vs previous) (percentage) -99.95% 1043.330 0.550 - -39.56% -
482.sphinx3 (unexplained diff vs previous) -99.93% 26073.000 17.000 - 325.00% -
482.sphinx3 (unexplained diff vs previous) (percentage) -99.93% 2759.050 1.860 - 332.56% -
481.wrf (unexplained diff vs previous) -99.87% 12149.000 16.000 - 60.00% -
481.wrf (unexplained diff vs previous) (percentage) -99.87% 219.530 0.290 - 61.11% -
436.cactusADM (unexplained diff vs previous) (percentage) -99.85% 787.130 1.180 - 210.53% -
436.cactusADM (unexplained diff vs previous) -99.85% 16396.000 25.000 - 212.50% -
456.hmmer (unexplained diff vs previous) (percentage) -99.81% 278.630 0.520 - 85.71% -
456.hmmer (unexplained diff vs previous) -99.81% 8030.000 15.000 - 87.50% -
450.soplex (unexplained diff vs previous) -99.78% 14500.000 32.000 - 255.56% -
450.soplex (unexplained diff vs previous) (percentage) -99.77% 2557.320 5.810 - 277.27% -
433.milc (unexplained diff vs previous) -99.72% 11289.000 32.000 - 3100.00% -
433.milc (unexplained diff vs previous) (percentage) -99.71% 980.800 2.870 - 3088.89% -
470.lbm (unexplained diff vs previous) -99.68% 9990.000 32.000 - 255.56% -
470.lbm (unexplained diff vs previous) (percentage) -99.68% 263.730 0.850 - 254.17% -
434.zeusmp (unexplained diff vs previous) (percentage) -99.64% 448.690 1.630 - 1258.33% -
434.zeusmp (unexplained diff vs previous) -99.64% 11280.000 41.000 - 1266.67% -
416.gamess (unexplained diff vs previous) -99.60% 7819.000 31.000 - 0.00% -
416.gamess (unexplained diff vs previous) (percentage) -99.60% 62.730 0.250 - 0.00% -
400.perlbench (unexplained diff vs previous) -99.52% 8772.000 42.000 - 4100.00% -
400.perlbench (unexplained diff vs previous) (percentage) -99.47% 527.480 2.790 - 4550.00% -
444.namd (max) -99.42% 685.000 4.000 - -20.00% -
456.hmmer (max) -99.29% 2120.000 15.000 - -6.25% -
459.GemsFDTD (unexplained diff vs previous) -99.28% 15458.000 111.000 - 362.50% -
456.hmmer (max) (percentage) -99.28% 73.590 0.530 - -5.36% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -99.27% 250.410 1.820 - 366.67% -
444.namd (max) (percentage) -99.27% 91.790 0.670 - -16.25% -
401.bzip2 (unexplained diff vs previous) -99.18% 10833.000 89.000 - 2125.00% -
401.bzip2 (unexplained diff vs previous) (percentage) -99.17% 368.340 3.050 - 2246.15% -
410.bwaves (unexplained diff vs previous) -99.15% 7794.000 66.000 - 144.44% -
410.bwaves (unexplained diff vs previous) (percentage) -99.14% 137.900 1.180 - 145.83% -
464.h264ref (unexplained diff vs previous) -99.11% 6843.000 61.000 - 238.89% -
464.h264ref (unexplained diff vs previous) (percentage) -99.11% 118.780 1.060 - 241.94% -
471.omnetpp (unexplained diff vs previous) -99.04% 10659.000 102.000 - 67.21% -
471.omnetpp (unexplained diff vs previous) (percentage) -99.03% 391.300 3.800 - 73.52% -
470.lbm (max) -98.87% 2746.000 31.000 - 55.00% -
470.lbm (max) (percentage) -98.84% 72.510 0.840 - 58.49% -
458.sjeng (unexplained diff vs previous) -98.75% 6876.000 86.000 - 2050.00% -
416.gamess (max) -98.73% 4805.000 61.000 - -3.17% -
416.gamess (max) (percentage) -98.70% 38.550 0.500 - -1.96% -
458.sjeng (unexplained diff vs previous) (percentage) -98.70% 90.870 1.180 - 2260.00% -
436.cactusADM (max) (percentage) -98.66% 88.730 1.190 - 158.70% -
436.cactusADM (max) -98.65% 1848.000 25.000 - 177.78% -
454.calculix (max) (percentage) -98.61% 99.730 1.390 - -12.58% -
462.libquantum (max) -98.55% 138.000 2.000 - 100.00% -
447.dealII (max) -98.41% 1384.000 22.000 - -4.35% -
453.povray (max) -98.40% 499.000 8.000 - 0.00% -
447.dealII (max) (percentage) -98.38% 80.280 1.300 - -4.41% -
429.mcf (unexplained diff vs previous) (percentage) -98.32% 1305.690 22.000 - 1016.75% -
453.povray (max) (percentage) -98.30% 91.250 1.550 - -3.73% -
473.astar (unexplained diff vs previous) -98.20% 10146.000 183.000 - 863.16% -
481.wrf (max) -98.18% 3801.000 69.000 - -1.43% -
481.wrf (max) (percentage) -98.18% 68.700 1.250 - -2.34% -
473.astar (unexplained diff vs previous) (percentage) -98.14% 197.850 3.680 - 894.59% -
464.h264ref (max) -98.08% 3127.000 60.000 - 252.94% -
464.h264ref (max) (percentage) -98.07% 54.290 1.050 - 238.71% -
434.zeusmp (max) -98.05% 2055.000 40.000 - -4.76% -
434.zeusmp (max) (percentage) -98.03% 81.770 1.610 - -3.01% -
410.bwaves (max) -98.02% 3276.000 65.000 - 41.30% -
410.bwaves (max) (percentage) -97.98% 57.970 1.170 - 40.96% -
429.mcf (unexplained diff vs previous) -97.92% 18593.000 387.000 - 1333.33% -
435.gromacs (unexplained diff vs previous) -97.91% 7028.000 147.000 - 568.18% -
435.gromacs (unexplained diff vs previous) (percentage) -97.85% 96.680 2.080 - 593.33% -
462.libquantum (max) (percentage) -97.81% 98.970 2.170 - 69.53% -
482.sphinx3 (max) -97.80% 911.000 20.000 - -4.76% -
445.gobmk (unexplained diff vs previous) -97.80% 5581.000 123.000 - 339.29% -
445.gobmk (unexplained diff vs previous) (percentage) -97.73% 111.110 2.520 - 350.00% -
482.sphinx3 (max) (percentage) -97.73% 96.500 2.190 - -3.95% -
458.sjeng (max) -97.67% 3602.000 84.000 - 127.03% -
458.sjeng (max) (percentage) -97.56% 47.610 1.160 - 132.00% -
483.xalancbmk (max) (percentage) -97.42% 68.670 1.770 - 0.00% -
400.perlbench (max) -97.14% 1397.000 40.000 - 263.64% -
433.milc (max) -97.03% 1044.000 31.000 - 138.46% -
433.milc (max) (percentage) -96.93% 90.750 2.790 - 136.44% -
400.perlbench (max) (percentage) -96.78% 84.060 2.710 - 266.22% -
459.GemsFDTD (max) -96.62% 4411.000 149.000 - -3.87% -
459.GemsFDTD (max) (percentage) -96.59% 71.460 2.440 - -2.40% -
401.bzip2 (max) -96.15% 2313.000 89.000 - -8.25% -
401.bzip2 (max) (percentage) -96.08% 78.650 3.080 - -4.64% -
435.gromacs (max) -96.00% 3573.000 143.000 - 376.67% -
435.gromacs (max) (percentage) -95.87% 49.160 2.030 - 383.33% -
471.omnetpp (max) -95.48% 2169.000 98.000 - 58.06% -
445.gobmk (max) -95.46% 2643.000 120.000 - 122.22% -
471.omnetpp (max) (percentage) -95.40% 79.650 3.660 - 63.39% -
445.gobmk (max) (percentage) -95.33% 52.630 2.460 - 125.69% -
473.astar (max) -94.83% 3406.000 176.000 - 58.56% -
473.astar (max) (percentage) -94.66% 66.430 3.550 - 64.35% -
403.gcc (max) -94.55% 55.000 3.000 - 0.00% -
450.soplex (max) -94.50% 545.000 30.000 - 130.77% -
450.soplex (max) (percentage) -94.30% 96.240 5.490 - 135.62% -
403.gcc (max) (percentage) -94.00% 99.360 5.960 - -4.03% -
437.leslie3d (unexplained diff vs previous) -92.35% 2314.000 177.000 - -39.59% -
437.leslie3d (unexplained diff vs previous) (percentage) -92.05% 19.880 1.580 - -40.60% -
465.tonto (unexplained diff vs previous) (percentage) -87.21% 16.190 2.070 - 0.00% -
465.tonto (unexplained diff vs previous) -86.90% 1771.000 232.000 - 0.00% -
437.leslie3d (max) -86.88% 1929.000 253.000 - -39.33% -
465.tonto (max) (percentage) -86.85% 19.310 2.540 - -3.05% -
465.tonto (max) -86.55% 2112.000 284.000 - -5.02% -
437.leslie3d (max) (percentage) -86.31% 16.580 2.270 - -40.11% -
444.namd -80.88% 68.000 13.000 - -7.14% -
444.namd (avg) -80.88% 68.000 13.000 - -7.14% -
456.hmmer -80.31% 127.000 25.000 - 0.00% -
456.hmmer (avg) -80.31% 127.000 25.000 - 0.00% -
456.hmmer (avg) (percentage) -80.27% 4.410 0.870 - 0.00% -
462.libquantum -80.00% 10.000 2.000 - 0.00% -
462.libquantum (avg) -80.00% 10.000 2.000 - 0.00% -
444.namd (avg) (percentage) -79.93% 9.220 1.850 - -1.60% -
416.gamess -79.64% 550.000 112.000 - -3.45% -
416.gamess (avg) -79.64% 550.000 112.000 - -3.45% -
416.gamess (avg) (percentage) -79.41% 4.420 0.910 - -3.19% -
470.lbm -79.08% 239.000 50.000 - -1.96% -
470.lbm (avg) -79.08% 239.000 50.000 - -1.96% -
470.lbm (avg) (percentage) -78.67% 6.330 1.350 - -0.74% -
464.h264ref -77.13% 293.000 67.000 - 0.00% -
464.h264ref (avg) -77.13% 293.000 67.000 - 0.00% -
464.h264ref (avg) (percentage) -77.01% 5.090 1.170 - 0.00% -
453.povray -76.19% 42.000 10.000 - 0.00% -
453.povray (avg) -76.19% 42.000 10.000 - 0.00% -
453.povray (avg) (percentage) -76.06% 7.810 1.870 - -1.58% -
462.libquantum (avg) (percentage) -75.33% 7.660 1.890 - 0.00% -
458.sjeng -75.10% 241.000 60.000 - -1.64% -
458.sjeng (avg) -75.10% 241.000 60.000 - -1.64% -
434.zeusmp -74.83% 147.000 37.000 - 0.00% -
434.zeusmp (avg) -74.83% 147.000 37.000 - 0.00% -
447.dealII -74.75% 99.000 25.000 - -3.85% -
447.dealII (avg) -74.75% 99.000 25.000 - -3.85% -
434.zeusmp (avg) (percentage) -74.36% 5.850 1.500 - 0.67% -
482.sphinx3 -74.32% 74.000 19.000 - -5.00% -
482.sphinx3 (avg) -74.32% 74.000 19.000 - -5.00% -
458.sjeng (avg) (percentage) -73.98% 3.190 0.830 - 0.00% -
447.dealII (avg) (percentage) -73.48% 5.770 1.530 - -1.92% -
482.sphinx3 (avg) (percentage) -72.51% 7.930 2.180 - 0.00% -
433.milc -72.46% 69.000 19.000 - 0.00% -
433.milc (avg) -72.46% 69.000 19.000 - 0.00% -
445.gobmk -71.94% 196.000 55.000 - 0.00% -
445.gobmk (avg) -71.94% 196.000 55.000 - 0.00% -
481.wrf -71.30% 345.000 99.000 - -2.94% -
481.wrf (avg) -71.30% 345.000 99.000 - -2.94% -
481.wrf (avg) (percentage) -71.15% 6.240 1.800 - -2.70% -
459.GemsFDTD -71.11% 360.000 104.000 - -1.89% -
459.GemsFDTD (avg) -71.11% 360.000 104.000 - -1.89% -
410.bwaves -71.08% 249.000 72.000 - -1.37% -
410.bwaves (avg) -71.08% 249.000 72.000 - -1.37% -
433.milc (avg) (percentage) -71.07% 6.050 1.750 - 1.16% -
471.omnetpp -70.85% 223.000 65.000 - -2.99% -
471.omnetpp (avg) -70.85% 223.000 65.000 - -2.99% -
445.gobmk (avg) (percentage) -70.84% 3.910 1.140 - 2.70% -
436.cactusADM (avg) (percentage) -70.74% 5.980 1.750 - -0.57% -
459.GemsFDTD (avg) (percentage) -70.72% 5.840 1.710 - 0.00% -
410.bwaves (avg) (percentage) -70.52% 4.410 1.300 - 0.00% -
471.omnetpp (avg) (percentage) -70.24% 8.200 2.440 - 0.83% -
436.cactusADM -70.16% 124.000 37.000 - 2.78% -
436.cactusADM (avg) -70.16% 124.000 37.000 - 2.78% -
429.mcf (max) (percentage) -69.63% 92.890 28.210 - 67.22% -
400.perlbench -66.67% 105.000 35.000 - -2.78% -
400.perlbench (avg) -66.67% 105.000 35.000 - -2.78% -
400.perlbench (avg) (percentage) -63.15% 6.350 2.340 - 0.43% -
401.bzip2 -62.73% 161.000 60.000 - -1.64% -
401.bzip2 (avg) -62.73% 161.000 60.000 - -1.64% -
429.mcf (max) -62.48% 1322.000 496.000 - 114.72% -
401.bzip2 (avg) (percentage) -62.41% 5.480 2.060 - 0.98% -
435.gromacs -59.13% 367.000 150.000 - -1.96% -
435.gromacs (avg) -59.13% 367.000 150.000 - -1.96% -
435.gromacs (avg) (percentage) -58.10% 5.060 2.120 - 0.00% -
450.soplex -55.56% 36.000 16.000 - 0.00% -
450.soplex (avg) -55.56% 36.000 16.000 - 0.00% -
454.calculix (avg) (percentage) -55.11% 8.020 3.600 - 0.00% -
465.tonto (avg) (percentage) -54.49% 3.340 1.520 - 0.66% -
483.xalancbmk (avg) (percentage) -54.46% 6.500 2.960 - 0.00% -
473.astar -54.46% 213.000 97.000 - -2.02% -
473.astar (avg) -54.46% 213.000 97.000 - -2.02% -
450.soplex (avg) (percentage) -53.97% 6.430 2.960 - 1.72% -
465.tonto -53.42% 365.000 170.000 - -1.16% -
465.tonto (avg) -53.42% 365.000 170.000 - -1.16% -
473.astar (avg) (percentage) -52.88% 4.160 1.960 - 1.55% -
403.gcc -50.00% 4.000 2.000 - -33.33% -
403.gcc (avg) -50.00% 4.000 2.000 - -33.33% -
403.gcc (avg) (percentage) -30.46% 7.320 5.090 - 0.00% -
429.mcf (avg) (percentage) -13.04% 7.670 6.670 - 5.71% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 6.90% 29.000 31.000 - 3.33% -

Report Time: 0.39s
Execution (seconds)
Name Current %
400.perlbench 1506.000 -2.71%
401.bzip2 2921.000 -2.96%
403.gcc 56.000 -5.08%
410.bwaves 5583.000 -1.17%
416.gamess 12399.000 -
429.mcf 1759.000 28.21%
433.milc 1116.000 -2.79%
434.zeusmp 2508.000 -1.61%
435.gromacs 7081.000 -2.03%
436.cactusADM 2124.000 1.19%
437.leslie3d 11188.000 1.61%
444.namd 744.000 -
445.gobmk 4885.000 -2.46%
447.dealII 1697.000 -
450.soplex 551.000 -5.49%
453.povray 548.000 -
456.hmmer 2886.000 -
458.sjeng 7317.000 -1.16%
459.GemsFDTD 6112.000 -1.78%
462.libquantum 135.000 -2.17%
464.h264ref 5738.000 -1.05%
465.tonto 11195.000 -2.03%
470.lbm 3766.000 -
471.omnetpp 2682.000 -3.66%
473.astar 4974.000 -3.55%
481.wrf 5550.000 -
482.sphinx3 916.000 -1.82%
Geometric Mean 2321.603 -
Code Size (bytes)
Name Current %
400.perlbench 887707.000 -
401.bzip2 44007.000 -
403.gcc 2442099.000 -
410.bwaves 16556.000 -
416.gamess 5731769.000 -
429.mcf 9119.000 -
433.milc 61117.000 -
434.zeusmp 153211.000 -
435.gromacs 498121.000 -
436.cactusADM 351609.000 -
437.leslie3d 58926.000 -
444.namd 187924.000 -
445.gobmk 1379062.000 -
447.dealII 310927.000 -
450.soplex 208601.000 -
453.povray 658313.000 -
456.hmmer 108399.000 -
458.sjeng 103492.000 -
459.GemsFDTD 241184.000 -
462.libquantum 16117.000 -
464.h264ref 386364.000 -
465.tonto 1949594.000 -
470.lbm 9707.000 -
471.omnetpp 480478.000 -
473.astar 22996.000 -
481.wrf 1935742.000 -
482.sphinx3 112287.000 -
Geometric Mean 194983.902 -
Score
Name Current %
nb_compile_successful 27.000 -3.57%
nb_execution_successful 27.000 -3.57%
nb_total_tests 31.000 3.33%
Geometric Mean 28.272 -1.32%
sample variability
Name Current %
400.perlbench 35.000 -2.78%
400.perlbench (avg) 35.000 -2.78%
400.perlbench (avg) (percentage) 2.340 -
400.perlbench (max) 40.000 263.64%
400.perlbench (max) (percentage) 2.710 266.22%
400.perlbench (unexplained diff vs previous) 42.000 4100.00%
400.perlbench (unexplained diff vs previous) (percentage) 2.790 4550.00%
401.bzip2 60.000 -1.64%
401.bzip2 (avg) 60.000 -1.64%
401.bzip2 (avg) (percentage) 2.060 -
401.bzip2 (max) 89.000 -8.25%
401.bzip2 (max) (percentage) 3.080 -4.64%
401.bzip2 (unexplained diff vs previous) 89.000 2125.00%
401.bzip2 (unexplained diff vs previous) (percentage) 3.050 2246.15%
403.gcc 2.000 -33.33%
403.gcc (avg) 2.000 -33.33%
403.gcc (avg) (percentage) 5.090 -
403.gcc (max) 3.000 -
403.gcc (max) (percentage) 5.960 -4.03%
410.bwaves 72.000 -1.37%
410.bwaves (avg) 72.000 -1.37%
410.bwaves (avg) (percentage) 1.300 -
410.bwaves (max) 65.000 41.30%
410.bwaves (max) (percentage) 1.170 40.96%
410.bwaves (unexplained diff vs previous) 66.000 144.44%
410.bwaves (unexplained diff vs previous) (percentage) 1.180 145.83%
416.gamess 112.000 -3.45%
416.gamess (avg) 112.000 -3.45%
416.gamess (avg) (percentage) 0.910 -3.19%
416.gamess (max) 61.000 -3.17%
416.gamess (max) (percentage) 0.500 -1.96%
416.gamess (unexplained diff vs previous) 31.000 -
416.gamess (unexplained diff vs previous) (percentage) 0.250 -
429.mcf 117.000 36.05%
429.mcf (avg) 117.000 36.05%
429.mcf (avg) (percentage) 6.670 5.71%
429.mcf (max) 496.000 114.72%
429.mcf (max) (percentage) 28.210 67.22%
429.mcf (unexplained diff vs previous) 387.000 1333.33%
429.mcf (unexplained diff vs previous) (percentage) 22.000 1016.75%
433.milc 19.000 -
433.milc (avg) 19.000 -
433.milc (avg) (percentage) 1.750 1.16%
433.milc (max) 31.000 138.46%
433.milc (max) (percentage) 2.790 136.44%
433.milc (unexplained diff vs previous) 32.000 3100.00%
433.milc (unexplained diff vs previous) (percentage) 2.870 3088.89%
434.zeusmp 37.000 -
434.zeusmp (avg) 37.000 -
434.zeusmp (avg) (percentage) 1.500 -
434.zeusmp (max) 40.000 -4.76%
434.zeusmp (max) (percentage) 1.610 -3.01%
434.zeusmp (unexplained diff vs previous) 41.000 1266.67%
434.zeusmp (unexplained diff vs previous) (percentage) 1.630 1258.33%
435.gromacs 150.000 -1.96%
435.gromacs (avg) 150.000 -1.96%
435.gromacs (avg) (percentage) 2.120 -
435.gromacs (max) 143.000 376.67%
435.gromacs (max) (percentage) 2.030 383.33%
435.gromacs (unexplained diff vs previous) 147.000 568.18%
435.gromacs (unexplained diff vs previous) (percentage) 2.080 593.33%
436.cactusADM 37.000 2.78%
436.cactusADM (avg) 37.000 2.78%
436.cactusADM (avg) (percentage) 1.750 -
436.cactusADM (max) 25.000 177.78%
436.cactusADM (max) (percentage) 1.190 158.70%
436.cactusADM (unexplained diff vs previous) 25.000 212.50%
436.cactusADM (unexplained diff vs previous) (percentage) 1.180 210.53%
437.leslie3d 552.000 -
437.leslie3d (avg) 552.000 -
437.leslie3d (avg) (percentage) 4.940 -1.40%
437.leslie3d (max) 253.000 -39.33%
437.leslie3d (max) (percentage) 2.270 -40.11%
437.leslie3d (unexplained diff vs previous) 177.000 -39.59%
437.leslie3d (unexplained diff vs previous) (percentage) 1.580 -40.60%
444.namd 13.000 -7.14%
444.namd (avg) 13.000 -7.14%
444.namd (avg) (percentage) 1.850 -1.60%
444.namd (max) 4.000 -20.00%
444.namd (max) (percentage) 0.670 -16.25%
444.namd (unexplained diff vs previous) 1.000 -83.33%
444.namd (unexplained diff vs previous) (percentage) 0.130 -83.95%
445.gobmk 55.000 -
445.gobmk (avg) 55.000 -
445.gobmk (avg) (percentage) 1.140 2.70%
445.gobmk (max) 120.000 122.22%
445.gobmk (max) (percentage) 2.460 125.69%
445.gobmk (unexplained diff vs previous) 123.000 339.29%
445.gobmk (unexplained diff vs previous) (percentage) 2.520 350.00%
447.dealII 25.000 -3.85%
447.dealII (avg) 25.000 -3.85%
447.dealII (avg) (percentage) 1.530 -1.92%
447.dealII (max) 22.000 -4.35%
447.dealII (max) (percentage) 1.300 -4.41%
447.dealII (unexplained diff vs previous) 3.000 -40.00%
447.dealII (unexplained diff vs previous) (percentage) 0.180 -40.00%
450.soplex 16.000 -
450.soplex (avg) 16.000 -
450.soplex (avg) (percentage) 2.960 1.72%
450.soplex (max) 30.000 130.77%
450.soplex (max) (percentage) 5.490 135.62%
450.soplex (unexplained diff vs previous) 32.000 255.56%
450.soplex (unexplained diff vs previous) (percentage) 5.810 277.27%
453.povray 10.000 -
453.povray (avg) 10.000 -
453.povray (avg) (percentage) 1.870 -1.58%
453.povray (max) 8.000 -
453.povray (max) (percentage) 1.550 -3.73%
453.povray (unexplained diff vs previous) 3.000 -40.00%
453.povray (unexplained diff vs previous) (percentage) 0.550 -39.56%
454.calculix (avg) (percentage) 3.600 -
454.calculix (max) (percentage) 1.390 -12.58%
456.hmmer 25.000 -
456.hmmer (avg) 25.000 -
456.hmmer (avg) (percentage) 0.870 -
456.hmmer (max) 15.000 -6.25%
456.hmmer (max) (percentage) 0.530 -5.36%
456.hmmer (unexplained diff vs previous) 15.000 87.50%
456.hmmer (unexplained diff vs previous) (percentage) 0.520 85.71%
458.sjeng 60.000 -1.64%
458.sjeng (avg) 60.000 -1.64%
458.sjeng (avg) (percentage) 0.830 -
458.sjeng (max) 84.000 127.03%
458.sjeng (max) (percentage) 1.160 132.00%
458.sjeng (unexplained diff vs previous) 86.000 2050.00%
458.sjeng (unexplained diff vs previous) (percentage) 1.180 2260.00%
459.GemsFDTD 104.000 -1.89%
459.GemsFDTD (avg) 104.000 -1.89%
459.GemsFDTD (avg) (percentage) 1.710 -
459.GemsFDTD (max) 149.000 -3.87%
459.GemsFDTD (max) (percentage) 2.440 -2.40%
459.GemsFDTD (unexplained diff vs previous) 111.000 362.50%
459.GemsFDTD (unexplained diff vs previous) (percentage) 1.820 366.67%
462.libquantum 2.000 -
462.libquantum (avg) 2.000 -
462.libquantum (avg) (percentage) 1.890 -
462.libquantum (max) 2.000 100.00%
462.libquantum (max) (percentage) 2.170 69.53%
462.libquantum (unexplained diff vs previous) 3.000 200.00%
462.libquantum (unexplained diff vs previous) (percentage) 2.220 208.33%
464.h264ref 67.000 -
464.h264ref (avg) 67.000 -
464.h264ref (avg) (percentage) 1.170 -
464.h264ref (max) 60.000 252.94%
464.h264ref (max) (percentage) 1.050 238.71%
464.h264ref (unexplained diff vs previous) 61.000 238.89%
464.h264ref (unexplained diff vs previous) (percentage) 1.060 241.94%
465.tonto 170.000 -1.16%
465.tonto (avg) 170.000 -1.16%
465.tonto (avg) (percentage) 1.520 -
465.tonto (max) 284.000 -5.02%
465.tonto (max) (percentage) 2.540 -3.05%
465.tonto (unexplained diff vs previous) 232.000 -
465.tonto (unexplained diff vs previous) (percentage) 2.070 -
470.lbm 50.000 -1.96%
470.lbm (avg) 50.000 -1.96%
470.lbm (avg) (percentage) 1.350 -
470.lbm (max) 31.000 55.00%
470.lbm (max) (percentage) 0.840 58.49%
470.lbm (unexplained diff vs previous) 32.000 255.56%
470.lbm (unexplained diff vs previous) (percentage) 0.850 254.17%
471.omnetpp 65.000 -2.99%
471.omnetpp (avg) 65.000 -2.99%
471.omnetpp (avg) (percentage) 2.440 -
471.omnetpp (max) 98.000 58.06%
471.omnetpp (max) (percentage) 3.660 63.39%
471.omnetpp (unexplained diff vs previous) 102.000 67.21%
471.omnetpp (unexplained diff vs previous) (percentage) 3.800 73.52%
473.astar 97.000 -2.02%
473.astar (avg) 97.000 -2.02%
473.astar (avg) (percentage) 1.960 1.55%
473.astar (max) 176.000 58.56%
473.astar (max) (percentage) 3.550 64.35%
473.astar (unexplained diff vs previous) 183.000 863.16%
473.astar (unexplained diff vs previous) (percentage) 3.680 894.59%
481.wrf 99.000 -2.94%
481.wrf (avg) 99.000 -2.94%
481.wrf (avg) (percentage) 1.800 -2.70%
481.wrf (max) 69.000 -1.43%
481.wrf (max) (percentage) 1.250 -2.34%
481.wrf (unexplained diff vs previous) 16.000 60.00%
481.wrf (unexplained diff vs previous) (percentage) 0.290 61.11%
482.sphinx3 19.000 -5.00%
482.sphinx3 (avg) 19.000 -5.00%
482.sphinx3 (avg) (percentage) 2.180 -
482.sphinx3 (max) 20.000 -4.76%
482.sphinx3 (max) (percentage) 2.190 -3.95%
482.sphinx3 (unexplained diff vs previous) 17.000 325.00%
482.sphinx3 (unexplained diff vs previous) (percentage) 1.860 332.56%
483.xalancbmk (avg) (percentage) 2.960 -
483.xalancbmk (max) (percentage) 1.770 -
Geometric Mean 10.279 56.31%