Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=878e894801169461adc00129ad33947ad541420d (unchanged)
git_gcc https://github.com/gcc-mirror/gcc/commit/55e94561e97ed0bce4774aa1c6b5d5d82209a379 (+ 1 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=9c72830eb3e12c1d57ac7d1992c96ee69ccd835d (unchanged)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=f9f042df0c5a1377b526200359b1d1124e1cd1ff (unchanged)
regression GNU-1055
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-aarch64-master-Os_LTO-build/200/
View Options
Report
Filter

gnu-aarch64-master-Os_LTO test results

Run Order Start Time Duration
Current 0200 (basepoints/gcc-14-06033-g55e94561e97) 2024-01-28T19:34:35 0:00:00
Previous 0193 (basepoints/gcc-14-06032-g2c3db94d9fd) 2024-01-27T18:48:40 0:00:00
Baseline 0001 (4-changed-components) 2023-02-20T22:48:24 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 113 15
Performance Improvements 64 192
Unchanged Tests 1059 1029
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
450.soplex 6.90% 551.000 589.000 - 3.88% -
403.gcc 5.36% 56.000 59.000 - 5.36% -
400.perlbench 4.91% 1506.000 1580.000 - -4.99% -
473.astar 4.66% 4974.000 5206.000 - 1.52% -
471.omnetpp 3.50% 2682.000 2776.000 - 1.91% -
435.gromacs 3.40% 7081.000 7322.000 - 0.73% -
401.bzip2 3.18% 2921.000 3014.000 - 2.48% -
465.tonto 3.16% 11195.000 11549.000 - 5.56% -
433.milc 2.87% 1116.000 1148.000 - -0.26% -
482.sphinx3 2.40% 916.000 938.000 - -0.74% -
459.GemsFDTD 2.14% 6112.000 6243.000 - 1.13% -
445.gobmk 1.64% 4885.000 4965.000 - -1.15% -
462.libquantum 1.48% 135.000 137.000 - -2.14% -
434.zeusmp 1.44% 2508.000 2544.000 - 1.19% -
458.sjeng 1.28% 7317.000 7411.000 - -2.06% -
447.dealII 1.24% 1697.000 1718.000 - -0.35% -
470.lbm 1.19% 3766.000 3811.000 - 0.61% -
453.povray 1.09% 548.000 554.000 - 1.28% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
447.dealII (unexplained diff vs previous) 600.00% 3.000 21.000 - -99.70% -
447.dealII (unexplained diff vs previous) (percentage) 577.78% 0.180 1.220 - -99.70% -
444.namd (unexplained diff vs previous) (percentage) 307.69% 0.130 0.530 - -99.95% -
444.namd (unexplained diff vs previous) 300.00% 1.000 4.000 - -99.95% -
453.povray (unexplained diff vs previous) 100.00% 3.000 6.000 - -99.89% -
453.povray (unexplained diff vs previous) (percentage) 96.36% 0.550 1.080 - -99.90% -
400.perlbench (max) 92.50% 40.000 77.000 - -94.49% -
437.leslie3d (unexplained diff vs previous) (percentage) 84.81% 1.580 2.920 - -85.31% -
400.perlbench (max) (percentage) 81.18% 2.710 4.910 - -94.16% -
437.leslie3d (unexplained diff vs previous) 79.10% 177.000 317.000 - -86.30% -
400.perlbench (unexplained diff vs previous) 76.19% 42.000 74.000 - -99.16% -
435.gromacs (max) 73.43% 143.000 248.000 - -93.06% -
400.perlbench (unexplained diff vs previous) (percentage) 67.74% 2.790 4.680 - -99.11% -
435.gromacs (max) (percentage) 67.49% 2.030 3.400 - -93.08% -
435.gromacs (unexplained diff vs previous) 63.95% 147.000 241.000 - -96.57% -
435.gromacs (unexplained diff vs previous) (percentage) 58.17% 2.080 3.290 - -96.60% -
465.tonto (unexplained diff vs previous) 52.59% 232.000 354.000 - -80.01% -
403.gcc 50.00% 2.000 3.000 - -25.00% -
403.gcc (avg) 50.00% 2.000 3.000 - -25.00% -
465.tonto (unexplained diff vs previous) (percentage) 48.31% 2.070 3.070 - -81.04% -
470.lbm (max) 45.16% 31.000 45.000 - -98.36% -
470.lbm (max) (percentage) 41.67% 0.840 1.190 - -98.36% -
470.lbm (unexplained diff vs previous) 40.62% 32.000 45.000 - -99.55% -
470.lbm (unexplained diff vs previous) (percentage) 38.82% 0.850 1.180 - -99.55% -
473.astar (max) 37.50% 176.000 242.000 - -92.89% -
450.soplex (max) 33.33% 30.000 40.000 - -92.66% -
473.astar (max) (percentage) 31.27% 3.550 4.660 - -92.99% -
482.sphinx3 (unexplained diff vs previous) 29.41% 17.000 22.000 - -99.92% -
465.tonto (max) 28.17% 284.000 364.000 - -82.77% -
473.astar (unexplained diff vs previous) 26.78% 183.000 232.000 - -97.71% -
482.sphinx3 (unexplained diff vs previous) (percentage) 26.34% 1.860 2.350 - -99.91% -
450.soplex (max) (percentage) 25.68% 5.490 6.900 - -92.83% -
437.leslie3d (max) (percentage) 24.67% 2.270 2.830 - -82.93% -
465.tonto (max) (percentage) 24.41% 2.540 3.160 - -83.64% -
437.leslie3d (max) 21.34% 253.000 307.000 - -84.09% -
473.astar (unexplained diff vs previous) (percentage) 21.20% 3.680 4.460 - -97.75% -
450.soplex (unexplained diff vs previous) 18.75% 32.000 38.000 - -99.74% -
459.GemsFDTD (unexplained diff vs previous) 18.02% 111.000 131.000 - -99.15% -
459.GemsFDTD (unexplained diff vs previous) (percentage) 15.38% 1.820 2.100 - -99.16% -
429.mcf (unexplained diff vs previous) (percentage) 14.14% 22.000 25.110 - -98.08% -
458.sjeng (max) 11.90% 84.000 94.000 - -97.39% -
450.soplex (unexplained diff vs previous) (percentage) 11.02% 5.810 6.450 - -99.75% -
458.sjeng (max) (percentage) 10.34% 1.160 1.280 - -97.31% -
482.sphinx3 (max) 10.00% 20.000 22.000 - -97.59% -
482.sphinx3 (max) (percentage) 9.59% 2.190 2.400 - -97.51% -
458.sjeng (unexplained diff vs previous) 9.30% 86.000 94.000 - -98.63% -
458.sjeng (unexplained diff vs previous) (percentage) 7.63% 1.180 1.270 - -98.60% -
473.astar 7.22% 97.000 104.000 - -51.17% -
473.astar (avg) 7.22% 97.000 104.000 - -51.17% -
401.bzip2 (max) 6.74% 89.000 95.000 - -95.89% -
465.tonto 6.47% 170.000 181.000 - -50.41% -
465.tonto (avg) 6.47% 170.000 181.000 - -50.41% -
450.soplex 6.25% 16.000 17.000 - -52.78% -
450.soplex (avg) 6.25% 16.000 17.000 - -52.78% -
400.perlbench 5.71% 35.000 37.000 - -64.76% -
400.perlbench (avg) 5.71% 35.000 37.000 - -64.76% -
433.milc 5.26% 19.000 20.000 - -71.01% -
433.milc (avg) 5.26% 19.000 20.000 - -71.01% -
482.sphinx3 5.26% 19.000 20.000 - -72.97% -
482.sphinx3 (avg) 5.26% 19.000 20.000 - -72.97% -
436.cactusADM (unexplained diff vs previous) (percentage) 5.08% 1.180 1.240 - -99.84% -
435.gromacs 4.67% 150.000 157.000 - -57.22% -
435.gromacs (avg) 4.67% 150.000 157.000 - -57.22% -
471.omnetpp 4.62% 65.000 68.000 - -69.51% -
471.omnetpp (avg) 4.62% 65.000 68.000 - -69.51% -
401.bzip2 (unexplained diff vs previous) 4.49% 89.000 93.000 - -99.14% -
436.cactusADM (unexplained diff vs previous) 4.00% 25.000 26.000 - -99.84% -
447.dealII 4.00% 25.000 26.000 - -73.74% -
447.dealII (avg) 4.00% 25.000 26.000 - -73.74% -
445.gobmk 3.64% 55.000 57.000 - -70.92% -
445.gobmk (avg) 3.64% 55.000 57.000 - -70.92% -
401.bzip2 3.33% 60.000 62.000 - -61.49% -
401.bzip2 (avg) 3.33% 60.000 62.000 - -61.49% -
458.sjeng 3.33% 60.000 62.000 - -74.27% -
458.sjeng (avg) 3.33% 60.000 62.000 - -74.27% -
429.mcf (avg) (percentage) 3.30% 6.670 6.890 - -10.17% -
465.tonto (avg) (percentage) 3.29% 1.520 1.570 - -52.99% -
401.bzip2 (max) (percentage) 3.25% 3.080 3.180 - -95.96% -
433.milc (max) 3.23% 31.000 32.000 - -96.93% -
459.GemsFDTD 2.88% 104.000 107.000 - -70.28% -
459.GemsFDTD (avg) 2.88% 104.000 107.000 - -70.28% -
433.milc (max) (percentage) 2.87% 2.790 2.870 - -96.84% -
434.zeusmp 2.70% 37.000 38.000 - -74.15% -
434.zeusmp (avg) 2.70% 37.000 38.000 - -74.15% -
400.perlbench (avg) (percentage) 2.56% 2.340 2.400 - -62.20% -
436.cactusADM (max) (percentage) 2.52% 1.190 1.220 - -98.63% -
450.soplex (avg) (percentage) 2.36% 2.960 3.030 - -52.88% -
473.astar (avg) (percentage) 2.04% 1.960 2.000 - -51.92% -
470.lbm 2.00% 50.000 51.000 - -78.66% -
470.lbm (avg) 2.00% 50.000 51.000 - -78.66% -
435.gromacs (avg) (percentage) 1.42% 2.120 2.150 - -57.51% -
401.bzip2 (unexplained diff vs previous) (percentage) 1.31% 3.050 3.090 - -99.16% -
458.sjeng (avg) (percentage) 1.20% 0.830 0.840 - -73.67% -

Performance Regressions - Score Δ Previous Current σ Δ (B) σ (B)
nb_compile_successful -3.70% 27.000 26.000 - -10.34% -
nb_execution_successful -3.70% 27.000 26.000 - -10.34% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
429.mcf -20.07% 1759.000 1406.000 - -1.26% -
437.leslie3d -2.83% 11188.000 10871.000 - -6.61% -
436.cactusADM -1.22% 2124.000 2098.000 - 0.72% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
456.hmmer (unexplained diff vs previous) (percentage) -80.77% 0.520 0.100 - -99.96% -
456.hmmer (unexplained diff vs previous) -80.00% 15.000 3.000 - -99.96% -
416.gamess (unexplained diff vs previous) (percentage) -68.00% 0.250 0.080 - -99.87% -
416.gamess (unexplained diff vs previous) -67.74% 31.000 10.000 - -99.87% -
416.gamess (max) (percentage) -56.00% 0.500 0.220 - -99.43% -
416.gamess (max) -55.74% 61.000 27.000 - -99.44% -
410.bwaves (unexplained diff vs previous) (percentage) -51.69% 1.180 0.570 - -99.59% -
410.bwaves (unexplained diff vs previous) -51.52% 66.000 32.000 - -99.59% -
445.gobmk (unexplained diff vs previous) (percentage) -36.11% 2.520 1.610 - -98.55% -
445.gobmk (unexplained diff vs previous) -34.96% 123.000 80.000 - -98.57% -
462.libquantum (unexplained diff vs previous) (percentage) -34.23% 2.220 1.460 - -99.98% -
462.libquantum (unexplained diff vs previous) -33.33% 3.000 2.000 - -99.99% -
429.mcf (max) -30.04% 496.000 347.000 - -73.75% -
464.h264ref (unexplained diff vs previous) (percentage) -21.70% 1.060 0.830 - -99.30% -
464.h264ref (unexplained diff vs previous) -21.31% 61.000 48.000 - -99.30% -
456.hmmer (max) -20.00% 15.000 12.000 - -99.43% -
456.hmmer (max) (percentage) -18.87% 0.530 0.430 - -99.42% -
429.mcf -17.95% 117.000 96.000 - -11.93% -
429.mcf (avg) -17.95% 117.000 96.000 - -11.93% -
464.h264ref (max) (percentage) -17.14% 1.050 0.870 - -98.40% -
464.h264ref (max) -16.67% 60.000 50.000 - -98.40% -
434.zeusmp (unexplained diff vs previous) (percentage) -12.88% 1.630 1.420 - -99.68% -
410.bwaves (max) (percentage) -12.82% 1.170 1.020 - -98.24% -
445.gobmk (max) (percentage) -12.60% 2.460 2.150 - -95.91% -
429.mcf (max) (percentage) -12.51% 28.210 24.680 - -73.43% -
410.bwaves (max) -12.31% 65.000 57.000 - -98.26% -
434.zeusmp (unexplained diff vs previous) -12.20% 41.000 36.000 - -99.68% -
445.gobmk (max) -11.67% 120.000 106.000 - -95.99% -
471.omnetpp (unexplained diff vs previous) (percentage) -10.79% 3.800 3.390 - -99.13% -
434.zeusmp (max) (percentage) -10.56% 1.610 1.440 - -98.24% -
444.namd (max) (percentage) -10.45% 0.670 0.600 - -99.35% -
434.zeusmp (max) -10.00% 40.000 36.000 - -98.25% -
429.mcf (unexplained diff vs previous) -8.79% 387.000 353.000 - -98.10% -
454.calculix (max) (percentage) -8.63% 1.390 1.270 - -98.73% -
462.libquantum (max) (percentage) -8.29% 2.170 1.990 - -97.99% -
471.omnetpp (unexplained diff vs previous) -7.84% 102.000 94.000 - -99.12% -
447.dealII (max) -4.55% 22.000 21.000 - -98.48% -
471.omnetpp (max) (percentage) -4.37% 3.660 3.500 - -95.61% -
456.hmmer -4.00% 25.000 24.000 - -81.10% -
456.hmmer (avg) -4.00% 25.000 24.000 - -81.10% -
447.dealII (max) (percentage) -3.85% 1.300 1.250 - -98.44% -
437.leslie3d -3.62% 552.000 532.000 - 49.86% -
437.leslie3d (avg) -3.62% 552.000 532.000 - 49.86% -
403.gcc (max) (percentage) -3.52% 5.960 5.750 - -94.21% -
416.gamess (avg) (percentage) -3.30% 0.910 0.880 - -80.09% -
453.povray (max) (percentage) -3.23% 1.550 1.500 - -98.36% -
433.milc (unexplained diff vs previous) (percentage) -2.79% 2.870 2.790 - -99.72% -
436.cactusADM -2.70% 37.000 36.000 - -70.97% -
436.cactusADM (avg) -2.70% 37.000 36.000 - -70.97% -
416.gamess -2.68% 112.000 109.000 - -80.18% -
416.gamess (avg) -2.68% 112.000 109.000 - -80.18% -
459.GemsFDTD (max) (percentage) -2.46% 2.440 2.380 - -96.67% -
481.wrf (max) (percentage) -2.40% 1.250 1.220 - -98.22% -
456.hmmer (avg) (percentage) -2.30% 0.870 0.850 - -80.73% -
410.bwaves (avg) (percentage) -1.54% 1.300 1.280 - -70.98% -
410.bwaves -1.39% 72.000 71.000 - -71.49% -
410.bwaves (avg) -1.39% 72.000 71.000 - -71.49% -
444.namd (avg) (percentage) -1.08% 1.850 1.830 - -80.15% -
453.povray (avg) (percentage) -1.07% 1.870 1.850 - -76.31% -
471.omnetpp (max) -1.02% 98.000 97.000 - -95.53% -

Performance Improvements - Score Δ Previous Current σ Δ (B) σ (B)
nb_total_tests 3.23% 31.000 32.000 - 10.34% -

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
450.soplex 1.72% 205081.000 208601.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
465.tonto 5.56% 10941.000 11549.000 - 3.16% -
403.gcc 5.36% 56.000 59.000 - 5.36% -
450.soplex 3.88% 567.000 589.000 - 6.90% -
401.bzip2 2.48% 2941.000 3014.000 - 3.18% -
471.omnetpp 1.91% 2724.000 2776.000 - 3.50% -
473.astar 1.52% 5128.000 5206.000 - 4.66% -
453.povray 1.28% 547.000 554.000 - 1.09% -
434.zeusmp 1.19% 2514.000 2544.000 - 1.44% -
459.GemsFDTD 1.13% 6173.000 6243.000 - 2.14% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d (avg) (percentage) 60.66% 3.050 4.900 - -0.81% -
437.leslie3d 49.86% 355.000 532.000 - -3.62% -
437.leslie3d (avg) 49.86% 355.000 532.000 - -3.62% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -10.34% 29.000 26.000 - -3.70% -
nb_execution_successful -10.34% 29.000 26.000 - -3.70% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
459.GemsFDTD -1.45% 244728.000 241184.000 - 0.00% -
410.bwaves -1.22% 16760.000 16556.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d -6.61% 11640.000 10871.000 - -2.83% -
400.perlbench -4.99% 1663.000 1580.000 - 4.91% -
462.libquantum -2.14% 140.000 137.000 - 1.48% -
458.sjeng -2.06% 7567.000 7411.000 - 1.28% -
429.mcf -1.26% 1424.000 1406.000 - -20.07% -
445.gobmk -1.15% 5023.000 4965.000 - 1.64% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
462.libquantum (unexplained diff vs previous) -99.99% 13518.000 2.000 - -33.33% -
462.libquantum (unexplained diff vs previous) (percentage) -99.98% 9655.710 1.460 - -34.23% -
456.hmmer (unexplained diff vs previous) (percentage) -99.96% 278.630 0.100 - -80.77% -
456.hmmer (unexplained diff vs previous) -99.96% 8030.000 3.000 - -80.00% -
444.namd (unexplained diff vs previous) (percentage) -99.95% 1118.610 0.530 - 307.69% -
444.namd (unexplained diff vs previous) -99.95% 8356.000 4.000 - 300.00% -
482.sphinx3 (unexplained diff vs previous) -99.92% 26073.000 22.000 - 29.41% -
482.sphinx3 (unexplained diff vs previous) (percentage) -99.91% 2759.050 2.350 - 26.34% -
453.povray (unexplained diff vs previous) (percentage) -99.90% 1043.330 1.080 - 96.36% -
453.povray (unexplained diff vs previous) -99.89% 5707.000 6.000 - 100.00% -
416.gamess (unexplained diff vs previous) (percentage) -99.87% 62.730 0.080 - -68.00% -
416.gamess (unexplained diff vs previous) -99.87% 7819.000 10.000 - -67.74% -
436.cactusADM (unexplained diff vs previous) (percentage) -99.84% 787.130 1.240 - 5.08% -
436.cactusADM (unexplained diff vs previous) -99.84% 16396.000 26.000 - 4.00% -
450.soplex (unexplained diff vs previous) (percentage) -99.75% 2557.320 6.450 - 11.02% -
450.soplex (unexplained diff vs previous) -99.74% 14500.000 38.000 - 18.75% -
433.milc (unexplained diff vs previous) -99.72% 11289.000 32.000 - 0.00% -
433.milc (unexplained diff vs previous) (percentage) -99.72% 980.800 2.790 - -2.79% -
447.dealII (unexplained diff vs previous) -99.70% 7017.000 21.000 - 600.00% -
447.dealII (unexplained diff vs previous) (percentage) -99.70% 407.020 1.220 - 577.78% -
434.zeusmp (unexplained diff vs previous) (percentage) -99.68% 448.690 1.420 - -12.88% -
434.zeusmp (unexplained diff vs previous) -99.68% 11280.000 36.000 - -12.20% -
410.bwaves (unexplained diff vs previous) -99.59% 7794.000 32.000 - -51.52% -
410.bwaves (unexplained diff vs previous) (percentage) -99.59% 137.900 0.570 - -51.69% -
470.lbm (unexplained diff vs previous) (percentage) -99.55% 263.730 1.180 - 38.82% -
470.lbm (unexplained diff vs previous) -99.55% 9990.000 45.000 - 40.62% -
416.gamess (max) -99.44% 4805.000 27.000 - -55.74% -
456.hmmer (max) -99.43% 2120.000 12.000 - -20.00% -
416.gamess (max) (percentage) -99.43% 38.550 0.220 - -56.00% -
444.namd (max) -99.42% 685.000 4.000 - 0.00% -
456.hmmer (max) (percentage) -99.42% 73.590 0.430 - -18.87% -
444.namd (max) (percentage) -99.35% 91.790 0.600 - -10.45% -
464.h264ref (unexplained diff vs previous) (percentage) -99.30% 118.780 0.830 - -21.70% -
464.h264ref (unexplained diff vs previous) -99.30% 6843.000 48.000 - -21.31% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -99.16% 250.410 2.100 - 15.38% -
401.bzip2 (unexplained diff vs previous) (percentage) -99.16% 368.340 3.090 - 1.31% -
400.perlbench (unexplained diff vs previous) -99.16% 8772.000 74.000 - 76.19% -
459.GemsFDTD (unexplained diff vs previous) -99.15% 15458.000 131.000 - 18.02% -
401.bzip2 (unexplained diff vs previous) -99.14% 10833.000 93.000 - 4.49% -
471.omnetpp (unexplained diff vs previous) (percentage) -99.13% 391.300 3.390 - -10.79% -
471.omnetpp (unexplained diff vs previous) -99.12% 10659.000 94.000 - -7.84% -
400.perlbench (unexplained diff vs previous) (percentage) -99.11% 527.480 4.680 - 67.74% -
454.calculix (max) (percentage) -98.73% 99.730 1.270 - -8.63% -
436.cactusADM (max) -98.65% 1848.000 25.000 - 0.00% -
458.sjeng (unexplained diff vs previous) -98.63% 6876.000 94.000 - 9.30% -
436.cactusADM (max) (percentage) -98.63% 88.730 1.220 - 2.52% -
458.sjeng (unexplained diff vs previous) (percentage) -98.60% 90.870 1.270 - 7.63% -
445.gobmk (unexplained diff vs previous) -98.57% 5581.000 80.000 - -34.96% -
445.gobmk (unexplained diff vs previous) (percentage) -98.55% 111.110 1.610 - -36.11% -
462.libquantum (max) -98.55% 138.000 2.000 - 0.00% -
447.dealII (max) -98.48% 1384.000 21.000 - -4.55% -
447.dealII (max) (percentage) -98.44% 80.280 1.250 - -3.85% -
464.h264ref (max) -98.40% 3127.000 50.000 - -16.67% -
464.h264ref (max) (percentage) -98.40% 54.290 0.870 - -17.14% -
453.povray (max) -98.40% 499.000 8.000 - 0.00% -
470.lbm (max) -98.36% 2746.000 45.000 - 45.16% -
470.lbm (max) (percentage) -98.36% 72.510 1.190 - 41.67% -
453.povray (max) (percentage) -98.36% 91.250 1.500 - -3.23% -
410.bwaves (max) -98.26% 3276.000 57.000 - -12.31% -
434.zeusmp (max) -98.25% 2055.000 36.000 - -10.00% -
410.bwaves (max) (percentage) -98.24% 57.970 1.020 - -12.82% -
434.zeusmp (max) (percentage) -98.24% 81.770 1.440 - -10.56% -
481.wrf (max) (percentage) -98.22% 68.700 1.220 - -2.40% -
429.mcf (unexplained diff vs previous) -98.10% 18593.000 353.000 - -8.79% -
429.mcf (unexplained diff vs previous) (percentage) -98.08% 1305.690 25.110 - 14.14% -
462.libquantum (max) (percentage) -97.99% 98.970 1.990 - -8.29% -
473.astar (unexplained diff vs previous) (percentage) -97.75% 197.850 4.460 - 21.20% -
473.astar (unexplained diff vs previous) -97.71% 10146.000 232.000 - 26.78% -
482.sphinx3 (max) -97.59% 911.000 22.000 - 10.00% -
482.sphinx3 (max) (percentage) -97.51% 96.500 2.400 - 9.59% -
483.xalancbmk (max) (percentage) -97.42% 68.670 1.770 - 0.00% -
458.sjeng (max) -97.39% 3602.000 94.000 - 11.90% -
458.sjeng (max) (percentage) -97.31% 47.610 1.280 - 10.34% -
433.milc (max) -96.93% 1044.000 32.000 - 3.23% -
433.milc (max) (percentage) -96.84% 90.750 2.870 - 2.87% -
459.GemsFDTD (max) (percentage) -96.67% 71.460 2.380 - -2.46% -
459.GemsFDTD (max) -96.64% 4411.000 148.000 - -0.67% -
435.gromacs (unexplained diff vs previous) (percentage) -96.60% 96.680 3.290 - 58.17% -
435.gromacs (unexplained diff vs previous) -96.57% 7028.000 241.000 - 63.95% -
445.gobmk (max) -95.99% 2643.000 106.000 - -11.67% -
401.bzip2 (max) (percentage) -95.96% 78.650 3.180 - 3.25% -
445.gobmk (max) (percentage) -95.91% 52.630 2.150 - -12.60% -
401.bzip2 (max) -95.89% 2313.000 95.000 - 6.74% -
471.omnetpp (max) (percentage) -95.61% 79.650 3.500 - -4.37% -
471.omnetpp (max) -95.53% 2169.000 97.000 - -1.02% -
403.gcc (max) -94.55% 55.000 3.000 - 0.00% -
400.perlbench (max) -94.49% 1397.000 77.000 - 92.50% -
403.gcc (max) (percentage) -94.21% 99.360 5.750 - -3.52% -
400.perlbench (max) (percentage) -94.16% 84.060 4.910 - 81.18% -
435.gromacs (max) (percentage) -93.08% 49.160 3.400 - 67.49% -
435.gromacs (max) -93.06% 3573.000 248.000 - 73.43% -
473.astar (max) (percentage) -92.99% 66.430 4.660 - 31.27% -
473.astar (max) -92.89% 3406.000 242.000 - 37.50% -
450.soplex (max) (percentage) -92.83% 96.240 6.900 - 25.68% -
450.soplex (max) -92.66% 545.000 40.000 - 33.33% -
437.leslie3d (unexplained diff vs previous) -86.30% 2314.000 317.000 - 79.10% -
437.leslie3d (unexplained diff vs previous) (percentage) -85.31% 19.880 2.920 - 84.81% -
437.leslie3d (max) -84.09% 1929.000 307.000 - 21.34% -
465.tonto (max) (percentage) -83.64% 19.310 3.160 - 24.41% -
437.leslie3d (max) (percentage) -82.93% 16.580 2.830 - 24.67% -
465.tonto (max) -82.77% 2112.000 364.000 - 28.17% -
456.hmmer -81.10% 127.000 24.000 - -4.00% -
456.hmmer (avg) -81.10% 127.000 24.000 - -4.00% -
465.tonto (unexplained diff vs previous) (percentage) -81.04% 16.190 3.070 - 48.31% -
444.namd -80.88% 68.000 13.000 - 0.00% -
444.namd (avg) -80.88% 68.000 13.000 - 0.00% -
456.hmmer (avg) (percentage) -80.73% 4.410 0.850 - -2.30% -
416.gamess -80.18% 550.000 109.000 - -2.68% -
416.gamess (avg) -80.18% 550.000 109.000 - -2.68% -
444.namd (avg) (percentage) -80.15% 9.220 1.830 - -1.08% -
416.gamess (avg) (percentage) -80.09% 4.420 0.880 - -3.30% -
465.tonto (unexplained diff vs previous) -80.01% 1771.000 354.000 - 52.59% -
462.libquantum -80.00% 10.000 2.000 - 0.00% -
462.libquantum (avg) -80.00% 10.000 2.000 - 0.00% -
470.lbm (avg) (percentage) -78.67% 6.330 1.350 - 0.00% -
470.lbm -78.66% 239.000 51.000 - 2.00% -
470.lbm (avg) -78.66% 239.000 51.000 - 2.00% -
464.h264ref (avg) (percentage) -77.21% 5.090 1.160 - -0.85% -
464.h264ref -77.13% 293.000 67.000 - 0.00% -
464.h264ref (avg) -77.13% 293.000 67.000 - 0.00% -
453.povray (avg) (percentage) -76.31% 7.810 1.850 - -1.07% -
453.povray -76.19% 42.000 10.000 - 0.00% -
453.povray (avg) -76.19% 42.000 10.000 - 0.00% -
462.libquantum (avg) (percentage) -75.33% 7.660 1.890 - 0.00% -
434.zeusmp (avg) (percentage) -74.36% 5.850 1.500 - 0.00% -
458.sjeng -74.27% 241.000 62.000 - 3.33% -
458.sjeng (avg) -74.27% 241.000 62.000 - 3.33% -
434.zeusmp -74.15% 147.000 38.000 - 2.70% -
434.zeusmp (avg) -74.15% 147.000 38.000 - 2.70% -
429.mcf (max) -73.75% 1322.000 347.000 - -30.04% -
447.dealII -73.74% 99.000 26.000 - 4.00% -
447.dealII (avg) -73.74% 99.000 26.000 - 4.00% -
458.sjeng (avg) (percentage) -73.67% 3.190 0.840 - 1.20% -
447.dealII (avg) (percentage) -73.66% 5.770 1.520 - -0.65% -
429.mcf (max) (percentage) -73.43% 92.890 24.680 - -12.51% -
482.sphinx3 -72.97% 74.000 20.000 - 5.26% -
482.sphinx3 (avg) -72.97% 74.000 20.000 - 5.26% -
482.sphinx3 (avg) (percentage) -72.51% 7.930 2.180 - 0.00% -
410.bwaves -71.49% 249.000 71.000 - -1.39% -
410.bwaves (avg) -71.49% 249.000 71.000 - -1.39% -
481.wrf (avg) (percentage) -71.15% 6.240 1.800 - 0.00% -
433.milc -71.01% 69.000 20.000 - 5.26% -
433.milc (avg) -71.01% 69.000 20.000 - 5.26% -
410.bwaves (avg) (percentage) -70.98% 4.410 1.280 - -1.54% -
436.cactusADM -70.97% 124.000 36.000 - -2.70% -
436.cactusADM (avg) -70.97% 124.000 36.000 - -2.70% -
445.gobmk -70.92% 196.000 57.000 - 3.64% -
445.gobmk (avg) -70.92% 196.000 57.000 - 3.64% -
433.milc (avg) (percentage) -70.91% 6.050 1.760 - 0.57% -
436.cactusADM (avg) (percentage) -70.90% 5.980 1.740 - -0.57% -
445.gobmk (avg) (percentage) -70.59% 3.910 1.150 - 0.88% -
459.GemsFDTD (avg) (percentage) -70.55% 5.840 1.720 - 0.58% -
459.GemsFDTD -70.28% 360.000 107.000 - 2.88% -
459.GemsFDTD (avg) -70.28% 360.000 107.000 - 2.88% -
471.omnetpp (avg) (percentage) -70.00% 8.200 2.460 - 0.82% -
471.omnetpp -69.51% 223.000 68.000 - 4.62% -
471.omnetpp (avg) -69.51% 223.000 68.000 - 4.62% -
400.perlbench -64.76% 105.000 37.000 - 5.71% -
400.perlbench (avg) -64.76% 105.000 37.000 - 5.71% -
400.perlbench (avg) (percentage) -62.20% 6.350 2.400 - 2.56% -
401.bzip2 (avg) (percentage) -62.04% 5.480 2.080 - 0.97% -
401.bzip2 -61.49% 161.000 62.000 - 3.33% -
401.bzip2 (avg) -61.49% 161.000 62.000 - 3.33% -
435.gromacs (avg) (percentage) -57.51% 5.060 2.150 - 1.42% -
435.gromacs -57.22% 367.000 157.000 - 4.67% -
435.gromacs (avg) -57.22% 367.000 157.000 - 4.67% -
454.calculix (avg) (percentage) -55.11% 8.020 3.600 - 0.00% -
483.xalancbmk (avg) (percentage) -54.46% 6.500 2.960 - 0.00% -
465.tonto (avg) (percentage) -52.99% 3.340 1.570 - 3.29% -
450.soplex (avg) (percentage) -52.88% 6.430 3.030 - 2.36% -
450.soplex -52.78% 36.000 17.000 - 6.25% -
450.soplex (avg) -52.78% 36.000 17.000 - 6.25% -
473.astar (avg) (percentage) -51.92% 4.160 2.000 - 2.04% -
473.astar -51.17% 213.000 104.000 - 7.22% -
473.astar (avg) -51.17% 213.000 104.000 - 7.22% -
465.tonto -50.41% 365.000 181.000 - 6.47% -
465.tonto (avg) -50.41% 365.000 181.000 - 6.47% -
403.gcc (avg) (percentage) -30.46% 7.320 5.090 - 0.00% -
403.gcc -25.00% 4.000 3.000 - 50.00% -
403.gcc (avg) -25.00% 4.000 3.000 - 50.00% -
429.mcf -11.93% 109.000 96.000 - -17.95% -
429.mcf (avg) -11.93% 109.000 96.000 - -17.95% -
429.mcf (avg) (percentage) -10.17% 7.670 6.890 - 3.30% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 10.34% 29.000 32.000 - 3.23% -

Report Time: 0.37s
Execution (seconds)
Name Current %
400.perlbench 1580.000 4.91%
401.bzip2 3014.000 3.18%
403.gcc 59.000 5.36%
410.bwaves 5615.000 -
416.gamess 12409.000 -
429.mcf 1406.000 -20.07%
433.milc 1148.000 2.87%
434.zeusmp 2544.000 1.44%
435.gromacs 7322.000 3.40%
436.cactusADM 2098.000 -1.22%
437.leslie3d 10871.000 -2.83%
444.namd 748.000 -
445.gobmk 4965.000 1.64%
447.dealII 1718.000 1.24%
450.soplex 589.000 6.90%
453.povray 554.000 1.09%
456.hmmer 2889.000 -
458.sjeng 7411.000 1.28%
459.GemsFDTD 6243.000 2.14%
462.libquantum 137.000 1.48%
464.h264ref 5786.000 -
465.tonto 11549.000 3.16%
470.lbm 3811.000 1.19%
471.omnetpp 2776.000 3.50%
473.astar 5206.000 4.66%
482.sphinx3 938.000 2.40%
Geometric Mean 2268.093 1.03%
Code Size (bytes)
Name Current %
400.perlbench 887707.000 -
401.bzip2 44007.000 -
403.gcc 2442099.000 -
410.bwaves 16556.000 -
416.gamess 5731769.000 -
429.mcf 9119.000 -
433.milc 61117.000 -
434.zeusmp 153211.000 -
435.gromacs 498121.000 -
436.cactusADM 351609.000 -
437.leslie3d 58926.000 -
444.namd 187924.000 -
445.gobmk 1379062.000 -
447.dealII 310927.000 -
450.soplex 208601.000 -
453.povray 658313.000 -
456.hmmer 108399.000 -
458.sjeng 103492.000 -
459.GemsFDTD 241184.000 -
462.libquantum 16117.000 -
464.h264ref 386364.000 -
465.tonto 1949594.000 -
470.lbm 9707.000 -
471.omnetpp 480478.000 -
473.astar 22996.000 -
482.sphinx3 112287.000 -
Geometric Mean 178508.303 -
Score
Name Current %
nb_compile_successful 26.000 -3.70%
nb_execution_successful 26.000 -3.70%
nb_total_tests 32.000 3.23%
Geometric Mean 27.863 -1.45%
sample variability
Name Current %
400.perlbench 37.000 5.71%
400.perlbench (avg) 37.000 5.71%
400.perlbench (avg) (percentage) 2.400 2.56%
400.perlbench (max) 77.000 92.50%
400.perlbench (max) (percentage) 4.910 81.18%
400.perlbench (unexplained diff vs previous) 74.000 76.19%
400.perlbench (unexplained diff vs previous) (percentage) 4.680 67.74%
401.bzip2 62.000 3.33%
401.bzip2 (avg) 62.000 3.33%
401.bzip2 (avg) (percentage) 2.080 -
401.bzip2 (max) 95.000 6.74%
401.bzip2 (max) (percentage) 3.180 3.25%
401.bzip2 (unexplained diff vs previous) 93.000 4.49%
401.bzip2 (unexplained diff vs previous) (percentage) 3.090 1.31%
403.gcc 3.000 50.00%
403.gcc (avg) 3.000 50.00%
403.gcc (avg) (percentage) 5.090 -
403.gcc (max) 3.000 -
403.gcc (max) (percentage) 5.750 -3.52%
410.bwaves 71.000 -1.39%
410.bwaves (avg) 71.000 -1.39%
410.bwaves (avg) (percentage) 1.280 -1.54%
410.bwaves (max) 57.000 -12.31%
410.bwaves (max) (percentage) 1.020 -12.82%
410.bwaves (unexplained diff vs previous) 32.000 -51.52%
410.bwaves (unexplained diff vs previous) (percentage) 0.570 -51.69%
416.gamess 109.000 -2.68%
416.gamess (avg) 109.000 -2.68%
416.gamess (avg) (percentage) 0.880 -3.30%
416.gamess (max) 27.000 -55.74%
416.gamess (max) (percentage) 0.220 -56.00%
416.gamess (unexplained diff vs previous) 10.000 -67.74%
416.gamess (unexplained diff vs previous) (percentage) 0.080 -68.00%
429.mcf 96.000 -17.95%
429.mcf (avg) 96.000 -17.95%
429.mcf (avg) (percentage) 6.890 3.30%
429.mcf (max) 347.000 -30.04%
429.mcf (max) (percentage) 24.680 -12.51%
429.mcf (unexplained diff vs previous) 353.000 -8.79%
429.mcf (unexplained diff vs previous) (percentage) 25.110 14.14%
433.milc 20.000 5.26%
433.milc (avg) 20.000 5.26%
433.milc (avg) (percentage) 1.760 -
433.milc (max) 32.000 3.23%
433.milc (max) (percentage) 2.870 2.87%
433.milc (unexplained diff vs previous) 32.000 -
433.milc (unexplained diff vs previous) (percentage) 2.790 -2.79%
434.zeusmp 38.000 2.70%
434.zeusmp (avg) 38.000 2.70%
434.zeusmp (avg) (percentage) 1.500 -
434.zeusmp (max) 36.000 -10.00%
434.zeusmp (max) (percentage) 1.440 -10.56%
434.zeusmp (unexplained diff vs previous) 36.000 -12.20%
434.zeusmp (unexplained diff vs previous) (percentage) 1.420 -12.88%
435.gromacs 157.000 4.67%
435.gromacs (avg) 157.000 4.67%
435.gromacs (avg) (percentage) 2.150 1.42%
435.gromacs (max) 248.000 73.43%
435.gromacs (max) (percentage) 3.400 67.49%
435.gromacs (unexplained diff vs previous) 241.000 63.95%
435.gromacs (unexplained diff vs previous) (percentage) 3.290 58.17%
436.cactusADM 36.000 -2.70%
436.cactusADM (avg) 36.000 -2.70%
436.cactusADM (avg) (percentage) 1.740 -
436.cactusADM (max) 25.000 -
436.cactusADM (max) (percentage) 1.220 2.52%
436.cactusADM (unexplained diff vs previous) 26.000 4.00%
436.cactusADM (unexplained diff vs previous) (percentage) 1.240 5.08%
437.leslie3d 532.000 -3.62%
437.leslie3d (avg) 532.000 -3.62%
437.leslie3d (avg) (percentage) 4.900 -
437.leslie3d (max) 307.000 21.34%
437.leslie3d (max) (percentage) 2.830 24.67%
437.leslie3d (unexplained diff vs previous) 317.000 79.10%
437.leslie3d (unexplained diff vs previous) (percentage) 2.920 84.81%
444.namd 13.000 -
444.namd (avg) 13.000 -
444.namd (avg) (percentage) 1.830 -1.08%
444.namd (max) 4.000 -
444.namd (max) (percentage) 0.600 -10.45%
444.namd (unexplained diff vs previous) 4.000 300.00%
444.namd (unexplained diff vs previous) (percentage) 0.530 307.69%
445.gobmk 57.000 3.64%
445.gobmk (avg) 57.000 3.64%
445.gobmk (avg) (percentage) 1.150 -
445.gobmk (max) 106.000 -11.67%
445.gobmk (max) (percentage) 2.150 -12.60%
445.gobmk (unexplained diff vs previous) 80.000 -34.96%
445.gobmk (unexplained diff vs previous) (percentage) 1.610 -36.11%
447.dealII 26.000 4.00%
447.dealII (avg) 26.000 4.00%
447.dealII (avg) (percentage) 1.520 -
447.dealII (max) 21.000 -4.55%
447.dealII (max) (percentage) 1.250 -3.85%
447.dealII (unexplained diff vs previous) 21.000 600.00%
447.dealII (unexplained diff vs previous) (percentage) 1.220 577.78%
450.soplex 17.000 6.25%
450.soplex (avg) 17.000 6.25%
450.soplex (avg) (percentage) 3.030 2.36%
450.soplex (max) 40.000 33.33%
450.soplex (max) (percentage) 6.900 25.68%
450.soplex (unexplained diff vs previous) 38.000 18.75%
450.soplex (unexplained diff vs previous) (percentage) 6.450 11.02%
453.povray 10.000 -
453.povray (avg) 10.000 -
453.povray (avg) (percentage) 1.850 -1.07%
453.povray (max) 8.000 -
453.povray (max) (percentage) 1.500 -3.23%
453.povray (unexplained diff vs previous) 6.000 100.00%
453.povray (unexplained diff vs previous) (percentage) 1.080 96.36%
454.calculix (avg) (percentage) 3.600 -
454.calculix (max) (percentage) 1.270 -8.63%
456.hmmer 24.000 -4.00%
456.hmmer (avg) 24.000 -4.00%
456.hmmer (avg) (percentage) 0.850 -2.30%
456.hmmer (max) 12.000 -20.00%
456.hmmer (max) (percentage) 0.430 -18.87%
456.hmmer (unexplained diff vs previous) 3.000 -80.00%
456.hmmer (unexplained diff vs previous) (percentage) 0.100 -80.77%
458.sjeng 62.000 3.33%
458.sjeng (avg) 62.000 3.33%
458.sjeng (avg) (percentage) 0.840 1.20%
458.sjeng (max) 94.000 11.90%
458.sjeng (max) (percentage) 1.280 10.34%
458.sjeng (unexplained diff vs previous) 94.000 9.30%
458.sjeng (unexplained diff vs previous) (percentage) 1.270 7.63%
459.GemsFDTD 107.000 2.88%
459.GemsFDTD (avg) 107.000 2.88%
459.GemsFDTD (avg) (percentage) 1.720 -
459.GemsFDTD (max) 148.000 -
459.GemsFDTD (max) (percentage) 2.380 -2.46%
459.GemsFDTD (unexplained diff vs previous) 131.000 18.02%
459.GemsFDTD (unexplained diff vs previous) (percentage) 2.100 15.38%
462.libquantum 2.000 -
462.libquantum (avg) 2.000 -
462.libquantum (avg) (percentage) 1.890 -
462.libquantum (max) 2.000 -
462.libquantum (max) (percentage) 1.990 -8.29%
462.libquantum (unexplained diff vs previous) 2.000 -33.33%
462.libquantum (unexplained diff vs previous) (percentage) 1.460 -34.23%
464.h264ref 67.000 -
464.h264ref (avg) 67.000 -
464.h264ref (avg) (percentage) 1.160 -
464.h264ref (max) 50.000 -16.67%
464.h264ref (max) (percentage) 0.870 -17.14%
464.h264ref (unexplained diff vs previous) 48.000 -21.31%
464.h264ref (unexplained diff vs previous) (percentage) 0.830 -21.70%
465.tonto 181.000 6.47%
465.tonto (avg) 181.000 6.47%
465.tonto (avg) (percentage) 1.570 3.29%
465.tonto (max) 364.000 28.17%
465.tonto (max) (percentage) 3.160 24.41%
465.tonto (unexplained diff vs previous) 354.000 52.59%
465.tonto (unexplained diff vs previous) (percentage) 3.070 48.31%
470.lbm 51.000 2.00%
470.lbm (avg) 51.000 2.00%
470.lbm (avg) (percentage) 1.350 -
470.lbm (max) 45.000 45.16%
470.lbm (max) (percentage) 1.190 41.67%
470.lbm (unexplained diff vs previous) 45.000 40.62%
470.lbm (unexplained diff vs previous) (percentage) 1.180 38.82%
471.omnetpp 68.000 4.62%
471.omnetpp (avg) 68.000 4.62%
471.omnetpp (avg) (percentage) 2.460 -
471.omnetpp (max) 97.000 -1.02%
471.omnetpp (max) (percentage) 3.500 -4.37%
471.omnetpp (unexplained diff vs previous) 94.000 -7.84%
471.omnetpp (unexplained diff vs previous) (percentage) 3.390 -10.79%
473.astar 104.000 7.22%
473.astar (avg) 104.000 7.22%
473.astar (avg) (percentage) 2.000 2.04%
473.astar (max) 242.000 37.50%
473.astar (max) (percentage) 4.660 31.27%
473.astar (unexplained diff vs previous) 232.000 26.78%
473.astar (unexplained diff vs previous) (percentage) 4.460 21.20%
481.wrf (avg) (percentage) 1.800 -
481.wrf (max) (percentage) 1.220 -2.40%
482.sphinx3 20.000 5.26%
482.sphinx3 (avg) 20.000 5.26%
482.sphinx3 (avg) (percentage) 2.180 -
482.sphinx3 (max) 22.000 10.00%
482.sphinx3 (max) (percentage) 2.400 9.59%
482.sphinx3 (unexplained diff vs previous) 22.000 29.41%
482.sphinx3 (unexplained diff vs previous) (percentage) 2.350 26.34%
483.xalancbmk (avg) (percentage) 2.960 -
483.xalancbmk (max) (percentage) 1.770 -
Geometric Mean 10.532 4.30%