Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=b3ee98cda498bb256411c5bc23cf7fb9b17f10db (+ 40 commits)
git_gcc https://gcc.gnu.org/git/gcc.git (c232f921615e385b8185fe6778a79469ae711672) (+ 195 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=7796e378c47b840d9c2e8af4fc6c209ed97f555b (+ 15 commits)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/a56a17fef0e450ef64524066bc166ac1c0b5cee4 (+ 136 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-aarch64-master-Os_LTO-build/308/
View Options
Report
Filter

gnu-aarch64-master-Os_LTO test results

Run Order Start Time Duration
Current 0308 (4-changed-components) 2024-10-19T11:36:10 0:00:00
Previous 0307 (4-changed-components) 2022-09-22T21:08:55 0:00:00
Baseline 0001 (4-changed-components) 2023-02-20T22:48:24 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 50 12
Performance Improvements 151 185
Added Tests 2 0
Unchanged Tests 1033 1039
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Code Size Δ Previous Current σ Δ (B) σ (B)
465.tonto 1.20% 1948787.000 1972207.000 - 1.34% -

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
465.tonto 31.63% 8410.000 11070.000 - 1.18% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
403.gcc (avg) (percentage) 1717.86% 0.280 5.090 - -30.46% -
429.mcf (avg) (percentage) 1351.52% 0.330 4.790 - -37.55% -
483.xalancbmk (avg) (percentage) 1309.52% 0.210 2.960 - -54.46% -
403.gcc (max) (percentage) 1020.59% 0.340 3.810 - -96.17% -
454.calculix (avg) (percentage) 872.97% 0.370 3.600 - -55.11% -
462.libquantum (unexplained diff vs previous) (percentage) 640.00% 0.100 0.740 - -99.99% -
473.astar (avg) (percentage) 488.89% 0.270 1.590 - -61.78% -
473.astar (max) (percentage) 360.00% 0.250 1.150 - -98.27% -
483.xalancbmk (max) (percentage) 342.50% 0.400 1.770 - -97.42% -
401.bzip2 (avg) (percentage) 329.41% 0.340 1.460 - -73.36% -
429.mcf (max) (percentage) 195.59% 0.680 2.010 - -97.84% -
458.sjeng (avg) (percentage) 190.48% 0.210 0.610 - -80.88% -
462.libquantum (avg) (percentage) 190.32% 0.620 1.800 - -76.50% -
450.soplex (avg) (percentage) 157.14% 0.980 2.520 - -60.81% -
450.soplex (unexplained diff vs previous) (percentage) 127.94% 0.680 1.550 - -99.94% -
473.astar 113.16% 38.000 81.000 - -61.97% -
473.astar (avg) 113.16% 38.000 81.000 - -61.97% -
464.h264ref (avg) (percentage) 108.33% 0.360 0.750 - -85.27% -
450.soplex (max) (percentage) 103.62% 1.380 2.810 - -97.08% -
445.gobmk (avg) (percentage) 100.00% 0.440 0.880 - -77.49% -
447.dealII (avg) (percentage) 98.36% 0.610 1.210 - -79.03% -
400.perlbench (avg) (percentage) 93.20% 1.030 1.990 - -68.66% -
471.omnetpp (unexplained diff vs previous) (percentage) 81.33% 0.750 1.360 - -99.65% -
437.leslie3d (avg) (percentage) 78.95% 2.470 4.420 - 44.92% -
429.mcf 76.79% 56.000 99.000 - -9.17% -
429.mcf (avg) 76.79% 56.000 99.000 - -9.17% -
401.bzip2 (max) (percentage) 69.44% 0.360 0.610 - -99.22% -
473.astar (max) 65.71% 35.000 58.000 - -98.30% -
473.astar (unexplained diff vs previous) (percentage) 64.00% 0.250 0.410 - -99.79% -
462.libquantum (max) (percentage) 60.36% 1.110 1.780 - -98.20% -
433.milc (unexplained diff vs previous) (percentage) 59.18% 0.490 0.780 - -99.92% -
458.sjeng 51.72% 29.000 44.000 - -81.74% -
458.sjeng (avg) 51.72% 29.000 44.000 - -81.74% -
454.calculix (max) (percentage) 50.91% 0.550 0.830 - -99.17% -
458.sjeng (unexplained diff vs previous) (percentage) 50.00% 0.100 0.150 - -99.83% -
465.tonto 38.54% 96.000 133.000 - -63.56% -
465.tonto (avg) 38.54% 96.000 133.000 - -63.56% -
437.leslie3d 37.09% 364.000 499.000 - 40.56% -
437.leslie3d (avg) 37.09% 364.000 499.000 - 40.56% -
435.gromacs (avg) (percentage) 36.51% 1.260 1.720 - -66.01% -
444.namd (unexplained diff vs previous) (percentage) 34.21% 0.380 0.510 - -99.95% -
400.perlbench (max) (percentage) 31.95% 1.690 2.230 - -97.35% -
453.povray (avg) (percentage) 27.05% 1.220 1.550 - -80.15% -
465.tonto (avg) (percentage) 5.22% 1.150 1.210 - -63.77% -
481.wrf (avg) (percentage) 4.05% 1.730 1.800 - -71.15% -
471.omnetpp (avg) (percentage) 2.36% 2.120 2.170 - -73.54% -

Performance Regressions - Score Δ Previous Current σ Δ (B) σ (B)
nb_compile_successful -17.24% 29.000 24.000 - -17.24% -
nb_execution_successful -17.24% 29.000 24.000 - -17.24% -

Performance Improvements - Code Size Δ Previous Current σ Δ (B) σ (B)
437.leslie3d -7.77% 59403.000 54786.000 - -7.89% -
459.GemsFDTD -6.17% 247936.000 232648.000 - -4.94% -
434.zeusmp -4.57% 153897.000 146871.000 - -3.40% -
435.gromacs -2.88% 504291.000 489745.000 - -1.91% -
450.soplex -2.13% 206988.000 202574.000 - -1.22% -
464.h264ref -2.00% 387188.000 379440.000 - -2.14% -
447.dealII -1.90% 312932.000 306976.000 - -1.48% -
453.povray -1.83% 661943.000 649821.000 - -1.75% -
410.bwaves -1.81% 16768.000 16464.000 - -1.77% -
470.lbm -1.69% 9711.000 9547.000 - -1.49% -
458.sjeng -1.67% 104024.000 102284.000 - -1.70% -
471.omnetpp -1.47% 482480.000 475388.000 - -0.55% -
444.namd -1.35% 188301.000 185768.000 - -1.39% -
456.hmmer -1.32% 108631.000 107195.000 - -1.38% -
436.cactusADM -1.23% 352679.000 348331.000 - -1.29% -
433.milc -1.19% 61230.000 60501.000 - -1.44% -
401.bzip2 -1.14% 44221.000 43719.000 - -1.16% -
482.sphinx3 -1.04% 112831.000 111663.000 - -1.06% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
462.libquantum -98.83% 11525.000 135.000 - -3.57% -
482.sphinx3 -97.22% 29933.000 833.000 - -11.85% -
450.soplex -96.32% 15758.000 580.000 - 2.29% -
453.povray -91.75% 6525.000 538.000 - -1.65% -
444.namd -91.31% 9014.000 783.000 - 4.82% -
433.milc -91.01% 12853.000 1155.000 - 0.35% -
436.cactusADM -87.98% 17614.000 2117.000 - 1.63% -
429.mcf -87.92% 17161.000 2073.000 - 45.58% -
400.perlbench -85.79% 10916.000 1551.000 - -6.73% -
434.zeusmp -82.70% 13379.000 2314.000 - -7.96% -
447.dealII -81.39% 8829.000 1643.000 - -4.70% -
401.bzip2 -80.14% 14886.000 2957.000 - 0.54% -
459.GemsFDTD -77.36% 23585.000 5339.000 - -13.51% -
471.omnetpp -75.43% 10751.000 2641.000 - -3.05% -
456.hmmer -73.92% 11051.000 2882.000 - 0.00% -
470.lbm -70.37% 12779.000 3787.000 - -0.03% -
473.astar -63.94% 14169.000 5109.000 - -0.37% -
464.h264ref -57.88% 13789.000 5808.000 - 0.82% -
410.bwaves -56.67% 13675.000 5925.000 - 4.83% -
445.gobmk -56.38% 11537.000 5033.000 - 0.20% -
435.gromacs -53.26% 15365.000 7181.000 - -1.21% -
458.sjeng -47.61% 14030.000 7351.000 - -2.85% -
437.leslie3d -23.26% 14739.000 11310.000 - -2.84% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
429.mcf (unexplained diff vs previous) -99.15% 118.000 1.000 - -99.99% -
444.namd (max) -99.10% 442.000 4.000 - -99.42% -
482.sphinx3 (max) -98.60% 787.000 11.000 - -98.79% -
462.libquantum (max) -98.43% 127.000 2.000 - -98.55% -
482.sphinx3 -98.07% 727.000 14.000 - -81.08% -
482.sphinx3 (avg) -98.07% 727.000 14.000 - -81.08% -
410.bwaves (unexplained diff vs previous) -97.90% 524.000 11.000 - -99.86% -
470.lbm (unexplained diff vs previous) -97.67% 43.000 1.000 - -99.99% -
444.namd -97.41% 347.000 9.000 - -86.76% -
444.namd (avg) -97.41% 347.000 9.000 - -86.76% -
462.libquantum -97.18% 71.000 2.000 - -80.00% -
462.libquantum (avg) -97.18% 71.000 2.000 - -80.00% -
433.milc (max) -96.90% 290.000 9.000 - -99.14% -
401.bzip2 (unexplained diff vs previous) -96.30% 54.000 2.000 - -99.98% -
436.cactusADM (max) -96.28% 403.000 15.000 - -99.19% -
470.lbm (max) -96.03% 353.000 14.000 - -99.49% -
436.cactusADM (unexplained diff vs previous) -95.18% 83.000 4.000 - -99.98% -
410.bwaves (max) -95.04% 504.000 25.000 - -99.24% -
410.bwaves (unexplained diff vs previous) (percentage) -95.04% 3.830 0.190 - -99.86% -
433.milc -93.97% 232.000 14.000 - -79.71% -
433.milc (avg) -93.97% 232.000 14.000 - -79.71% -
453.povray (max) -93.06% 144.000 10.000 - -98.00% -
429.mcf (unexplained diff vs previous) (percentage) -92.75% 0.690 0.050 - -100.00% -
450.soplex (max) -92.63% 217.000 16.000 - -97.06% -
456.hmmer (max) -92.21% 77.000 6.000 - -99.72% -
450.soplex (unexplained diff vs previous) -91.59% 107.000 9.000 - -99.94% -
436.cactusADM -91.39% 267.000 23.000 - -81.45% -
436.cactusADM (avg) -91.39% 267.000 23.000 - -81.45% -
470.lbm (unexplained diff vs previous) (percentage) -91.18% 0.340 0.030 - -99.99% -
471.omnetpp (max) -91.00% 500.000 45.000 - -97.93% -
450.soplex -90.91% 154.000 14.000 - -61.11% -
450.soplex (avg) -90.91% 154.000 14.000 - -61.11% -
462.libquantum (unexplained diff vs previous) -90.91% 11.000 1.000 - -99.99% -
434.zeusmp (max) -90.75% 173.000 16.000 - -99.22% -
453.povray -89.87% 79.000 8.000 - -80.95% -
453.povray (avg) -89.87% 79.000 8.000 - -80.95% -
459.GemsFDTD (max) -88.68% 318.000 36.000 - -99.18% -
444.namd (max) (percentage) -88.59% 4.910 0.560 - -99.39% -
410.bwaves (max) (percentage) -88.35% 3.690 0.430 - -99.26% -
444.namd (unexplained diff vs previous) -88.24% 34.000 4.000 - -99.95% -
470.lbm -88.01% 267.000 32.000 - -86.61% -
470.lbm (avg) -88.01% 267.000 32.000 - -86.61% -
434.zeusmp -87.57% 177.000 22.000 - -85.03% -
434.zeusmp (avg) -87.57% 177.000 22.000 - -85.03% -
464.h264ref (max) -87.50% 64.000 8.000 - -99.74% -
470.lbm (max) (percentage) -86.28% 2.770 0.380 - -99.48% -
433.milc (unexplained diff vs previous) -85.71% 63.000 9.000 - -99.92% -
416.gamess (max) (percentage) -85.60% 2.570 0.370 - -99.04% -
447.dealII (max) -81.90% 105.000 19.000 - -98.63% -
400.perlbench (max) -81.52% 184.000 34.000 - -97.57% -
401.bzip2 (unexplained diff vs previous) (percentage) -80.56% 0.360 0.070 - -99.98% -
458.sjeng (max) -80.36% 56.000 11.000 - -99.69% -
465.tonto (max) (percentage) -80.18% 2.270 0.450 - -97.67% -
459.GemsFDTD -78.64% 323.000 69.000 - -80.83% -
459.GemsFDTD (avg) -78.64% 323.000 69.000 - -80.83% -
445.gobmk (max) -77.89% 95.000 21.000 - -99.21% -
456.hmmer -76.56% 64.000 15.000 - -88.19% -
456.hmmer (avg) -76.56% 64.000 15.000 - -88.19% -
471.omnetpp -74.89% 227.000 57.000 - -74.44% -
471.omnetpp (avg) -74.89% 227.000 57.000 - -74.44% -
465.tonto (max) -74.21% 190.000 49.000 - -97.68% -
400.perlbench -73.21% 112.000 30.000 - -71.43% -
400.perlbench (avg) -73.21% 112.000 30.000 - -71.43% -
435.gromacs (max) -72.92% 336.000 91.000 - -97.45% -
410.bwaves -72.63% 190.000 52.000 - -79.12% -
410.bwaves (avg) -72.63% 190.000 52.000 - -79.12% -
464.h264ref (max) (percentage) -70.21% 0.470 0.140 - -99.74% -
444.namd (avg) (percentage) -68.91% 3.860 1.200 - -86.98% -
436.cactusADM (max) (percentage) -68.12% 2.290 0.730 - -99.18% -
401.bzip2 (max) -66.04% 53.000 18.000 - -99.22% -
456.hmmer (max) (percentage) -65.71% 0.700 0.240 - -99.67% -
481.wrf (max) (percentage) -65.25% 2.360 0.820 - -98.81% -
429.mcf (max) -64.66% 116.000 41.000 - -96.90% -
447.dealII -64.15% 53.000 19.000 - -80.81% -
447.dealII (avg) -64.15% 53.000 19.000 - -80.81% -
437.leslie3d (unexplained diff vs previous) -63.53% 606.000 221.000 - -90.45% -
471.omnetpp (max) (percentage) -63.09% 4.660 1.720 - -97.84% -
458.sjeng (max) (percentage) -62.50% 0.400 0.150 - -99.68% -
433.milc (max) (percentage) -61.95% 2.260 0.860 - -99.05% -
436.cactusADM (unexplained diff vs previous) (percentage) -59.57% 0.470 0.190 - -99.98% -
470.lbm (avg) (percentage) -58.85% 2.090 0.860 - -86.41% -
416.gamess (avg) (percentage) -58.47% 1.830 0.760 - -82.81% -
471.omnetpp (unexplained diff vs previous) -55.56% 81.000 36.000 - -99.66% -
437.leslie3d (unexplained diff vs previous) (percentage) -52.55% 4.110 1.950 - -90.19% -
482.sphinx3 (max) (percentage) -49.43% 2.630 1.330 - -98.62% -
445.gobmk (max) (percentage) -49.40% 0.830 0.420 - -99.20% -
459.GemsFDTD (max) (percentage) -48.89% 1.350 0.690 - -99.03% -
437.leslie3d (max) -44.94% 632.000 348.000 - -81.96% -
434.zeusmp (max) (percentage) -44.62% 1.300 0.720 - -99.12% -
473.astar (unexplained diff vs previous) -41.67% 36.000 21.000 - -99.79% -
435.gromacs (max) (percentage) -41.55% 2.190 1.280 - -97.40% -
435.gromacs -36.27% 193.000 123.000 - -66.49% -
435.gromacs (avg) -36.27% 193.000 123.000 - -66.49% -
410.bwaves (avg) (percentage) -35.97% 1.390 0.890 - -79.82% -
433.milc (avg) (percentage) -32.60% 1.810 1.220 - -79.83% -
437.leslie3d (max) (percentage) -28.21% 4.290 3.080 - -81.42% -
436.cactusADM (avg) (percentage) -27.63% 1.520 1.100 - -81.61% -
434.zeusmp (avg) (percentage) -27.07% 1.330 0.970 - -83.42% -
482.sphinx3 (avg) (percentage) -26.75% 2.430 1.780 - -77.55% -
458.sjeng (unexplained diff vs previous) -21.43% 14.000 11.000 - -99.84% -
401.bzip2 -14.00% 50.000 43.000 - -73.29% -
401.bzip2 (avg) -14.00% 50.000 43.000 - -73.29% -
464.h264ref -12.24% 49.000 43.000 - -85.32% -
464.h264ref (avg) -12.24% 49.000 43.000 - -85.32% -
445.gobmk -12.00% 50.000 44.000 - -77.55% -
445.gobmk (avg) -12.00% 50.000 44.000 - -77.55% -
453.povray (max) (percentage) -11.26% 2.220 1.970 - -97.84% -
456.hmmer (avg) (percentage) -8.62% 0.580 0.530 - -87.98% -
459.GemsFDTD (avg) (percentage) -4.38% 1.370 1.310 - -77.57% -

Performance Improvements - Score Δ Previous Current σ Δ (B) σ (B)
nb_total_tests 17.24% 29.000 34.000 - 17.24% -

Added Tests - sample variability
459.GemsFDTD (unexplained diff vs previous)
459.GemsFDTD (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
465.tonto 1.34% 1946163.000 1972207.000 - 1.20% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
429.mcf 45.58% 1424.000 2073.000 - -87.92% -
410.bwaves 4.83% 5652.000 5925.000 - -56.67% -
444.namd 4.82% 747.000 783.000 - -91.31% -
450.soplex 2.29% 567.000 580.000 - -96.32% -
436.cactusADM 1.63% 2083.000 2117.000 - -87.98% -
465.tonto 1.18% 10941.000 11070.000 - 31.63% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d (avg) (percentage) 44.92% 3.050 4.420 - 78.95% -
437.leslie3d 40.56% 355.000 499.000 - 37.09% -
437.leslie3d (avg) 40.56% 355.000 499.000 - 37.09% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -17.24% 29.000 24.000 - -17.24% -
nb_execution_successful -17.24% 29.000 24.000 - -17.24% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d -7.89% 59479.000 54786.000 - -7.77% -
459.GemsFDTD -4.94% 244728.000 232648.000 - -6.17% -
434.zeusmp -3.40% 152037.000 146871.000 - -4.57% -
464.h264ref -2.14% 387748.000 379440.000 - -2.00% -
435.gromacs -1.91% 499261.000 489745.000 - -2.88% -
410.bwaves -1.77% 16760.000 16464.000 - -1.81% -
453.povray -1.75% 661389.000 649821.000 - -1.83% -
458.sjeng -1.70% 104048.000 102284.000 - -1.67% -
470.lbm -1.49% 9691.000 9547.000 - -1.69% -
447.dealII -1.48% 311591.000 306976.000 - -1.90% -
433.milc -1.44% 61382.000 60501.000 - -1.19% -
444.namd -1.39% 188385.000 185768.000 - -1.35% -
456.hmmer -1.38% 108691.000 107195.000 - -1.32% -
436.cactusADM -1.29% 352891.000 348331.000 - -1.23% -
450.soplex -1.22% 205081.000 202574.000 - -2.13% -
462.libquantum -1.19% 16085.000 15893.000 - -0.95% -
401.bzip2 -1.16% 44233.000 43719.000 - -1.14% -
482.sphinx3 -1.06% 112859.000 111663.000 - -1.04% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
459.GemsFDTD -13.51% 6173.000 5339.000 - -77.36% -
482.sphinx3 -11.85% 945.000 833.000 - -97.22% -
434.zeusmp -7.96% 2514.000 2314.000 - -82.70% -
400.perlbench -6.73% 1663.000 1551.000 - -85.79% -
447.dealII -4.70% 1724.000 1643.000 - -81.39% -
462.libquantum -3.57% 140.000 135.000 - -98.83% -
471.omnetpp -3.05% 2724.000 2641.000 - -75.43% -
458.sjeng -2.85% 7567.000 7351.000 - -47.61% -
437.leslie3d -2.84% 11640.000 11310.000 - -23.26% -
453.povray -1.65% 547.000 538.000 - -91.75% -
435.gromacs -1.21% 7269.000 7181.000 - -53.26% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
429.mcf (unexplained diff vs previous) (percentage) -100.00% 1305.690 0.050 - -92.75% -
429.mcf (unexplained diff vs previous) -99.99% 18593.000 1.000 - -99.15% -
462.libquantum (unexplained diff vs previous) -99.99% 13518.000 1.000 - -90.91% -
462.libquantum (unexplained diff vs previous) (percentage) -99.99% 9655.710 0.740 - 640.00% -
470.lbm (unexplained diff vs previous) -99.99% 9990.000 1.000 - -97.67% -
470.lbm (unexplained diff vs previous) (percentage) -99.99% 263.730 0.030 - -91.18% -
401.bzip2 (unexplained diff vs previous) -99.98% 10833.000 2.000 - -96.30% -
401.bzip2 (unexplained diff vs previous) (percentage) -99.98% 368.340 0.070 - -80.56% -
436.cactusADM (unexplained diff vs previous) (percentage) -99.98% 787.130 0.190 - -59.57% -
436.cactusADM (unexplained diff vs previous) -99.98% 16396.000 4.000 - -95.18% -
444.namd (unexplained diff vs previous) (percentage) -99.95% 1118.610 0.510 - 34.21% -
444.namd (unexplained diff vs previous) -99.95% 8356.000 4.000 - -88.24% -
450.soplex (unexplained diff vs previous) (percentage) -99.94% 2557.320 1.550 - 127.94% -
450.soplex (unexplained diff vs previous) -99.94% 14500.000 9.000 - -91.59% -
433.milc (unexplained diff vs previous) (percentage) -99.92% 980.800 0.780 - 59.18% -
433.milc (unexplained diff vs previous) -99.92% 11289.000 9.000 - -85.71% -
410.bwaves (unexplained diff vs previous) (percentage) -99.86% 137.900 0.190 - -95.04% -
410.bwaves (unexplained diff vs previous) -99.86% 7794.000 11.000 - -97.90% -
458.sjeng (unexplained diff vs previous) -99.84% 6876.000 11.000 - -21.43% -
458.sjeng (unexplained diff vs previous) (percentage) -99.83% 90.870 0.150 - 50.00% -
473.astar (unexplained diff vs previous) -99.79% 10146.000 21.000 - -41.67% -
473.astar (unexplained diff vs previous) (percentage) -99.79% 197.850 0.410 - 64.00% -
459.GemsFDTD (unexplained diff vs previous) -99.76% 15458.000 37.000 - 0.00% -
464.h264ref (max) -99.74% 3127.000 8.000 - -87.50% -
464.h264ref (max) (percentage) -99.74% 54.290 0.140 - -70.21% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -99.72% 250.410 0.690 - 0.00% -
456.hmmer (max) -99.72% 2120.000 6.000 - -92.21% -
458.sjeng (max) -99.69% 3602.000 11.000 - -80.36% -
458.sjeng (max) (percentage) -99.68% 47.610 0.150 - -62.50% -
456.hmmer (max) (percentage) -99.67% 73.590 0.240 - -65.71% -
471.omnetpp (unexplained diff vs previous) -99.66% 10659.000 36.000 - -55.56% -
471.omnetpp (unexplained diff vs previous) (percentage) -99.65% 391.300 1.360 - 81.33% -
470.lbm (max) -99.49% 2746.000 14.000 - -96.03% -
470.lbm (max) (percentage) -99.48% 72.510 0.380 - -86.28% -
444.namd (max) -99.42% 685.000 4.000 - -99.10% -
444.namd (max) (percentage) -99.39% 91.790 0.560 - -88.59% -
410.bwaves (max) (percentage) -99.26% 57.970 0.430 - -88.35% -
410.bwaves (max) -99.24% 3276.000 25.000 - -95.04% -
401.bzip2 (max) (percentage) -99.22% 78.650 0.610 - 69.44% -
401.bzip2 (max) -99.22% 2313.000 18.000 - -66.04% -
434.zeusmp (max) -99.22% 2055.000 16.000 - -90.75% -
445.gobmk (max) -99.21% 2643.000 21.000 - -77.89% -
445.gobmk (max) (percentage) -99.20% 52.630 0.420 - -49.40% -
436.cactusADM (max) -99.19% 1848.000 15.000 - -96.28% -
459.GemsFDTD (max) -99.18% 4411.000 36.000 - -88.68% -
436.cactusADM (max) (percentage) -99.18% 88.730 0.730 - -68.12% -
454.calculix (max) (percentage) -99.17% 99.730 0.830 - 50.91% -
433.milc (max) -99.14% 1044.000 9.000 - -96.90% -
434.zeusmp (max) (percentage) -99.12% 81.770 0.720 - -44.62% -
433.milc (max) (percentage) -99.05% 90.750 0.860 - -61.95% -
416.gamess (max) (percentage) -99.04% 38.550 0.370 - -85.60% -
459.GemsFDTD (max) (percentage) -99.03% 71.460 0.690 - -48.89% -
481.wrf (max) (percentage) -98.81% 68.700 0.820 - -65.25% -
482.sphinx3 (max) -98.79% 911.000 11.000 - -98.60% -
447.dealII (max) -98.63% 1384.000 19.000 - -81.90% -
482.sphinx3 (max) (percentage) -98.62% 96.500 1.330 - -49.43% -
462.libquantum (max) -98.55% 138.000 2.000 - -98.43% -
447.dealII (max) (percentage) -98.52% 80.280 1.190 - 0.00% -
473.astar (max) -98.30% 3406.000 58.000 - 65.71% -
473.astar (max) (percentage) -98.27% 66.430 1.150 - 360.00% -
462.libquantum (max) (percentage) -98.20% 98.970 1.780 - 60.36% -
453.povray (max) -98.00% 499.000 10.000 - -93.06% -
471.omnetpp (max) -97.93% 2169.000 45.000 - -91.00% -
453.povray (max) (percentage) -97.84% 91.250 1.970 - -11.26% -
471.omnetpp (max) (percentage) -97.84% 79.650 1.720 - -63.09% -
429.mcf (max) (percentage) -97.84% 92.890 2.010 - 195.59% -
465.tonto (max) -97.68% 2112.000 49.000 - -74.21% -
465.tonto (max) (percentage) -97.67% 19.310 0.450 - -80.18% -
400.perlbench (max) -97.57% 1397.000 34.000 - -81.52% -
435.gromacs (max) -97.45% 3573.000 91.000 - -72.92% -
483.xalancbmk (max) (percentage) -97.42% 68.670 1.770 - 342.50% -
435.gromacs (max) (percentage) -97.40% 49.160 1.280 - -41.55% -
400.perlbench (max) (percentage) -97.35% 84.060 2.230 - 31.95% -
450.soplex (max) (percentage) -97.08% 96.240 2.810 - 103.62% -
450.soplex (max) -97.06% 545.000 16.000 - -92.63% -
429.mcf (max) -96.90% 1322.000 41.000 - -64.66% -
403.gcc (max) (percentage) -96.17% 99.360 3.810 - 1020.59% -
437.leslie3d (unexplained diff vs previous) -90.45% 2314.000 221.000 - -63.53% -
437.leslie3d (unexplained diff vs previous) (percentage) -90.19% 19.880 1.950 - -52.55% -
456.hmmer -88.19% 127.000 15.000 - -76.56% -
456.hmmer (avg) -88.19% 127.000 15.000 - -76.56% -
456.hmmer (avg) (percentage) -87.98% 4.410 0.530 - -8.62% -
444.namd (avg) (percentage) -86.98% 9.220 1.200 - -68.91% -
444.namd -86.76% 68.000 9.000 - -97.41% -
444.namd (avg) -86.76% 68.000 9.000 - -97.41% -
470.lbm -86.61% 239.000 32.000 - -88.01% -
470.lbm (avg) -86.61% 239.000 32.000 - -88.01% -
470.lbm (avg) (percentage) -86.41% 6.330 0.860 - -58.85% -
464.h264ref -85.32% 293.000 43.000 - -12.24% -
464.h264ref (avg) -85.32% 293.000 43.000 - -12.24% -
464.h264ref (avg) (percentage) -85.27% 5.090 0.750 - 108.33% -
434.zeusmp -85.03% 147.000 22.000 - -87.57% -
434.zeusmp (avg) -85.03% 147.000 22.000 - -87.57% -
434.zeusmp (avg) (percentage) -83.42% 5.850 0.970 - -27.07% -
416.gamess (avg) (percentage) -82.81% 4.420 0.760 - -58.47% -
437.leslie3d (max) -81.96% 1929.000 348.000 - -44.94% -
458.sjeng -81.74% 241.000 44.000 - 51.72% -
458.sjeng (avg) -81.74% 241.000 44.000 - 51.72% -
436.cactusADM (avg) (percentage) -81.61% 5.980 1.100 - -27.63% -
436.cactusADM -81.45% 124.000 23.000 - -91.39% -
436.cactusADM (avg) -81.45% 124.000 23.000 - -91.39% -
437.leslie3d (max) (percentage) -81.42% 16.580 3.080 - -28.21% -
482.sphinx3 -81.08% 74.000 14.000 - -98.07% -
482.sphinx3 (avg) -81.08% 74.000 14.000 - -98.07% -
453.povray -80.95% 42.000 8.000 - -89.87% -
453.povray (avg) -80.95% 42.000 8.000 - -89.87% -
458.sjeng (avg) (percentage) -80.88% 3.190 0.610 - 190.48% -
459.GemsFDTD -80.83% 360.000 69.000 - -78.64% -
459.GemsFDTD (avg) -80.83% 360.000 69.000 - -78.64% -
447.dealII -80.81% 99.000 19.000 - -64.15% -
447.dealII (avg) -80.81% 99.000 19.000 - -64.15% -
453.povray (avg) (percentage) -80.15% 7.810 1.550 - 27.05% -
462.libquantum -80.00% 10.000 2.000 - -97.18% -
462.libquantum (avg) -80.00% 10.000 2.000 - -97.18% -
433.milc (avg) (percentage) -79.83% 6.050 1.220 - -32.60% -
410.bwaves (avg) (percentage) -79.82% 4.410 0.890 - -35.97% -
433.milc -79.71% 69.000 14.000 - -93.97% -
433.milc (avg) -79.71% 69.000 14.000 - -93.97% -
410.bwaves -79.12% 249.000 52.000 - -72.63% -
410.bwaves (avg) -79.12% 249.000 52.000 - -72.63% -
447.dealII (avg) (percentage) -79.03% 5.770 1.210 - 98.36% -
459.GemsFDTD (avg) (percentage) -77.57% 5.840 1.310 - -4.38% -
482.sphinx3 (avg) (percentage) -77.55% 7.930 1.780 - -26.75% -
445.gobmk -77.55% 196.000 44.000 - -12.00% -
445.gobmk (avg) -77.55% 196.000 44.000 - -12.00% -
445.gobmk (avg) (percentage) -77.49% 3.910 0.880 - 100.00% -
462.libquantum (avg) (percentage) -76.50% 7.660 1.800 - 190.32% -
471.omnetpp -74.44% 223.000 57.000 - -74.89% -
471.omnetpp (avg) -74.44% 223.000 57.000 - -74.89% -
471.omnetpp (avg) (percentage) -73.54% 8.200 2.170 - 2.36% -
401.bzip2 (avg) (percentage) -73.36% 5.480 1.460 - 329.41% -
401.bzip2 -73.29% 161.000 43.000 - -14.00% -
401.bzip2 (avg) -73.29% 161.000 43.000 - -14.00% -
400.perlbench -71.43% 105.000 30.000 - -73.21% -
400.perlbench (avg) -71.43% 105.000 30.000 - -73.21% -
481.wrf (avg) (percentage) -71.15% 6.240 1.800 - 4.05% -
400.perlbench (avg) (percentage) -68.66% 6.350 1.990 - 93.20% -
435.gromacs -66.49% 367.000 123.000 - -36.27% -
435.gromacs (avg) -66.49% 367.000 123.000 - -36.27% -
435.gromacs (avg) (percentage) -66.01% 5.060 1.720 - 36.51% -
465.tonto (avg) (percentage) -63.77% 3.340 1.210 - 5.22% -
465.tonto -63.56% 365.000 133.000 - 38.54% -
465.tonto (avg) -63.56% 365.000 133.000 - 38.54% -
473.astar -61.97% 213.000 81.000 - 113.16% -
473.astar (avg) -61.97% 213.000 81.000 - 113.16% -
473.astar (avg) (percentage) -61.78% 4.160 1.590 - 488.89% -
450.soplex -61.11% 36.000 14.000 - -90.91% -
450.soplex (avg) -61.11% 36.000 14.000 - -90.91% -
450.soplex (avg) (percentage) -60.81% 6.430 2.520 - 157.14% -
454.calculix (avg) (percentage) -55.11% 8.020 3.600 - 872.97% -
483.xalancbmk (avg) (percentage) -54.46% 6.500 2.960 - 1309.52% -
429.mcf (avg) (percentage) -37.55% 7.670 4.790 - 1351.52% -
403.gcc (avg) (percentage) -30.46% 7.320 5.090 - 1717.86% -
429.mcf -9.17% 109.000 99.000 - 76.79% -
429.mcf (avg) -9.17% 109.000 99.000 - 76.79% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 17.24% 29.000 34.000 - 17.24% -

Report Time: 0.37s
Execution (seconds)
Name Current %
400.perlbench 1551.000 -85.79%
401.bzip2 2957.000 -80.14%
410.bwaves 5925.000 -56.67%
429.mcf 2073.000 -87.92%
433.milc 1155.000 -91.01%
434.zeusmp 2314.000 -82.70%
435.gromacs 7181.000 -53.26%
436.cactusADM 2117.000 -87.98%
437.leslie3d 11310.000 -23.26%
444.namd 783.000 -91.31%
445.gobmk 5033.000 -56.38%
447.dealII 1643.000 -81.39%
450.soplex 580.000 -96.32%
453.povray 538.000 -91.75%
456.hmmer 2882.000 -73.92%
458.sjeng 7351.000 -47.61%
459.GemsFDTD 5339.000 -77.36%
462.libquantum 135.000 -98.83%
464.h264ref 5808.000 -57.88%
465.tonto 11070.000 31.63%
470.lbm 3787.000 -70.37%
471.omnetpp 2641.000 -75.43%
473.astar 5109.000 -63.94%
482.sphinx3 833.000 -97.22%
Geometric Mean 2449.899 -81.36%
Code Size (bytes)
Name Current %
400.perlbench 892379.000 -
401.bzip2 43719.000 -1.14%
410.bwaves 16464.000 -1.81%
429.mcf 9119.000 -
433.milc 60501.000 -1.19%
434.zeusmp 146871.000 -4.57%
435.gromacs 489745.000 -2.88%
436.cactusADM 348331.000 -1.23%
437.leslie3d 54786.000 -7.77%
444.namd 185768.000 -1.35%
445.gobmk 1379170.000 -
447.dealII 306976.000 -1.90%
450.soplex 202574.000 -2.13%
453.povray 649821.000 -1.83%
456.hmmer 107195.000 -1.32%
458.sjeng 102284.000 -1.67%
459.GemsFDTD 232648.000 -6.17%
462.libquantum 15893.000 -
464.h264ref 379440.000 -2.00%
465.tonto 1972207.000 1.20%
470.lbm 9547.000 -1.69%
471.omnetpp 475388.000 -1.47%
473.astar 22760.000 -
482.sphinx3 111663.000 -1.04%
Geometric Mean 136537.973 -1.84%
Score
Name Current %
nb_compile_successful 24.000 -17.24%
nb_execution_successful 24.000 -17.24%
nb_total_tests 34.000 17.24%
Geometric Mean 26.955 -7.05%
sample variability
Name Current %
400.perlbench 30.000 -73.21%
400.perlbench (avg) 30.000 -73.21%
400.perlbench (avg) (percentage) 1.990 93.20%
400.perlbench (max) 34.000 -81.52%
400.perlbench (max) (percentage) 2.230 31.95%
401.bzip2 43.000 -14.00%
401.bzip2 (avg) 43.000 -14.00%
401.bzip2 (avg) (percentage) 1.460 329.41%
401.bzip2 (max) 18.000 -66.04%
401.bzip2 (max) (percentage) 0.610 69.44%
401.bzip2 (unexplained diff vs previous) 2.000 -96.30%
401.bzip2 (unexplained diff vs previous) (percentage) 0.070 -80.56%
403.gcc (avg) (percentage) 5.090 1717.86%
403.gcc (max) (percentage) 3.810 1020.59%
410.bwaves 52.000 -72.63%
410.bwaves (avg) 52.000 -72.63%
410.bwaves (avg) (percentage) 0.890 -35.97%
410.bwaves (max) 25.000 -95.04%
410.bwaves (max) (percentage) 0.430 -88.35%
410.bwaves (unexplained diff vs previous) 11.000 -97.90%
410.bwaves (unexplained diff vs previous) (percentage) 0.190 -95.04%
416.gamess (avg) (percentage) 0.760 -58.47%
416.gamess (max) (percentage) 0.370 -85.60%
429.mcf 99.000 76.79%
429.mcf (avg) 99.000 76.79%
429.mcf (avg) (percentage) 4.790 1351.52%
429.mcf (max) 41.000 -64.66%
429.mcf (max) (percentage) 2.010 195.59%
429.mcf (unexplained diff vs previous) 1.000 -99.15%
429.mcf (unexplained diff vs previous) (percentage) 0.050 -92.75%
433.milc 14.000 -93.97%
433.milc (avg) 14.000 -93.97%
433.milc (avg) (percentage) 1.220 -32.60%
433.milc (max) 9.000 -96.90%
433.milc (max) (percentage) 0.860 -61.95%
433.milc (unexplained diff vs previous) 9.000 -85.71%
433.milc (unexplained diff vs previous) (percentage) 0.780 59.18%
434.zeusmp 22.000 -87.57%
434.zeusmp (avg) 22.000 -87.57%
434.zeusmp (avg) (percentage) 0.970 -27.07%
434.zeusmp (max) 16.000 -90.75%
434.zeusmp (max) (percentage) 0.720 -44.62%
435.gromacs 123.000 -36.27%
435.gromacs (avg) 123.000 -36.27%
435.gromacs (avg) (percentage) 1.720 36.51%
435.gromacs (max) 91.000 -72.92%
435.gromacs (max) (percentage) 1.280 -41.55%
436.cactusADM 23.000 -91.39%
436.cactusADM (avg) 23.000 -91.39%
436.cactusADM (avg) (percentage) 1.100 -27.63%
436.cactusADM (max) 15.000 -96.28%
436.cactusADM (max) (percentage) 0.730 -68.12%
436.cactusADM (unexplained diff vs previous) 4.000 -95.18%
436.cactusADM (unexplained diff vs previous) (percentage) 0.190 -59.57%
437.leslie3d 499.000 37.09%
437.leslie3d (avg) 499.000 37.09%
437.leslie3d (avg) (percentage) 4.420 78.95%
437.leslie3d (max) 348.000 -44.94%
437.leslie3d (max) (percentage) 3.080 -28.21%
437.leslie3d (unexplained diff vs previous) 221.000 -63.53%
437.leslie3d (unexplained diff vs previous) (percentage) 1.950 -52.55%
444.namd 9.000 -97.41%
444.namd (avg) 9.000 -97.41%
444.namd (avg) (percentage) 1.200 -68.91%
444.namd (max) 4.000 -99.10%
444.namd (max) (percentage) 0.560 -88.59%
444.namd (unexplained diff vs previous) 4.000 -88.24%
444.namd (unexplained diff vs previous) (percentage) 0.510 34.21%
445.gobmk 44.000 -12.00%
445.gobmk (avg) 44.000 -12.00%
445.gobmk (avg) (percentage) 0.880 100.00%
445.gobmk (max) 21.000 -77.89%
445.gobmk (max) (percentage) 0.420 -49.40%
447.dealII 19.000 -64.15%
447.dealII (avg) 19.000 -64.15%
447.dealII (avg) (percentage) 1.210 98.36%
447.dealII (max) 19.000 -81.90%
447.dealII (max) (percentage) 1.190 -
450.soplex 14.000 -90.91%
450.soplex (avg) 14.000 -90.91%
450.soplex (avg) (percentage) 2.520 157.14%
450.soplex (max) 16.000 -92.63%
450.soplex (max) (percentage) 2.810 103.62%
450.soplex (unexplained diff vs previous) 9.000 -91.59%
450.soplex (unexplained diff vs previous) (percentage) 1.550 127.94%
453.povray 8.000 -89.87%
453.povray (avg) 8.000 -89.87%
453.povray (avg) (percentage) 1.550 27.05%
453.povray (max) 10.000 -93.06%
453.povray (max) (percentage) 1.970 -11.26%
454.calculix (avg) (percentage) 3.600 872.97%
454.calculix (max) (percentage) 0.830 50.91%
456.hmmer 15.000 -76.56%
456.hmmer (avg) 15.000 -76.56%
456.hmmer (avg) (percentage) 0.530 -8.62%
456.hmmer (max) 6.000 -92.21%
456.hmmer (max) (percentage) 0.240 -65.71%
458.sjeng 44.000 51.72%
458.sjeng (avg) 44.000 51.72%
458.sjeng (avg) (percentage) 0.610 190.48%
458.sjeng (max) 11.000 -80.36%
458.sjeng (max) (percentage) 0.150 -62.50%
458.sjeng (unexplained diff vs previous) 11.000 -21.43%
458.sjeng (unexplained diff vs previous) (percentage) 0.150 50.00%
459.GemsFDTD 69.000 -78.64%
459.GemsFDTD (avg) 69.000 -78.64%
459.GemsFDTD (avg) (percentage) 1.310 -4.38%
459.GemsFDTD (max) 36.000 -88.68%
459.GemsFDTD (max) (percentage) 0.690 -48.89%
459.GemsFDTD (unexplained diff vs previous) 37.000 -
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.690 -
462.libquantum 2.000 -97.18%
462.libquantum (avg) 2.000 -97.18%
462.libquantum (avg) (percentage) 1.800 190.32%
462.libquantum (max) 2.000 -98.43%
462.libquantum (max) (percentage) 1.780 60.36%
462.libquantum (unexplained diff vs previous) 1.000 -90.91%
462.libquantum (unexplained diff vs previous) (percentage) 0.740 640.00%
464.h264ref 43.000 -12.24%
464.h264ref (avg) 43.000 -12.24%
464.h264ref (avg) (percentage) 0.750 108.33%
464.h264ref (max) 8.000 -87.50%
464.h264ref (max) (percentage) 0.140 -70.21%
465.tonto 133.000 38.54%
465.tonto (avg) 133.000 38.54%
465.tonto (avg) (percentage) 1.210 5.22%
465.tonto (max) 49.000 -74.21%
465.tonto (max) (percentage) 0.450 -80.18%
470.lbm 32.000 -88.01%
470.lbm (avg) 32.000 -88.01%
470.lbm (avg) (percentage) 0.860 -58.85%
470.lbm (max) 14.000 -96.03%
470.lbm (max) (percentage) 0.380 -86.28%
470.lbm (unexplained diff vs previous) 1.000 -97.67%
470.lbm (unexplained diff vs previous) (percentage) 0.030 -91.18%
471.omnetpp 57.000 -74.89%
471.omnetpp (avg) 57.000 -74.89%
471.omnetpp (avg) (percentage) 2.170 2.36%
471.omnetpp (max) 45.000 -91.00%
471.omnetpp (max) (percentage) 1.720 -63.09%
471.omnetpp (unexplained diff vs previous) 36.000 -55.56%
471.omnetpp (unexplained diff vs previous) (percentage) 1.360 81.33%
473.astar 81.000 113.16%
473.astar (avg) 81.000 113.16%
473.astar (avg) (percentage) 1.590 488.89%
473.astar (max) 58.000 65.71%
473.astar (max) (percentage) 1.150 360.00%
473.astar (unexplained diff vs previous) 21.000 -41.67%
473.astar (unexplained diff vs previous) (percentage) 0.410 64.00%
481.wrf (avg) (percentage) 1.800 4.05%
481.wrf (max) (percentage) 0.820 -65.25%
482.sphinx3 14.000 -98.07%
482.sphinx3 (avg) 14.000 -98.07%
482.sphinx3 (avg) (percentage) 1.780 -26.75%
482.sphinx3 (max) 11.000 -98.60%
482.sphinx3 (max) (percentage) 1.330 -49.43%
483.xalancbmk (avg) (percentage) 2.960 1309.52%
483.xalancbmk (max) (percentage) 1.770 342.50%
Geometric Mean 5.171 -61.93%