Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=4635b42ac78b532dfdc5f6725e8267ee928cc5f0 (unchanged)
git_gcc https://github.com/gcc-mirror/gcc/commit/c08b0d3f7b3539b26031de31d88dea6b94474577 (+ 1 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=46b5e98ef6f1b9f4b53851f152ecb8209064b26c (unchanged)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=b84a9523bab4a2483d7b7566b81a7859c2fd9a78 (unchanged)
regression GNU-1227
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-aarch64-master-Os_LTO-build/254/
View Options
Report
Filter

gnu-aarch64-master-Os_LTO test results

Run Order Start Time Duration
Current 0254 (basepoints/gcc-15-00861-gc08b0d3f7b3) 2024-05-31T05:13:22 0:00:00
Previous 0253 (basepoints/gcc-15-00860-g19cc6111112) 2024-05-30T10:26:28 0:00:00
Baseline 0001 (4-changed-components) 2023-02-20T22:48:24 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 41 11
Performance Improvements 103 194
Unchanged Tests 1092 1031
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Code Size Δ Previous Current σ Δ (B) σ (B)
465.tonto 3.29% 1937214.000 2000958.000 - 2.82% -
459.GemsFDTD 1.84% 236832.000 241192.000 - -1.44% -

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
437.leslie3d 1.84% 10928.000 11129.000 - -4.39% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
462.libquantum (unexplained diff vs previous) (percentage) 25.54% 3.680 4.620 0.000 -99.95% 0.000
437.leslie3d (unexplained diff vs previous) 20.36% 167.000 201.000 0.000 -91.31% 0.000
462.libquantum (unexplained diff vs previous) 20.00% 5.000 6.000 0.000 -99.96% 0.000
437.leslie3d (unexplained diff vs previous) (percentage) 18.30% 1.530 1.810 0.000 -90.90% 0.000
429.mcf (unexplained diff vs previous) (percentage) 15.61% 8.070 9.330 0.000 -99.29% 0.000
462.libquantum (max) (percentage) 15.45% 3.820 4.410 - -95.54% -
450.soplex (unexplained diff vs previous) (percentage) 12.76% 9.560 10.780 0.000 -99.58% 0.000
453.povray (unexplained diff vs previous) (percentage) 10.16% 2.560 2.820 0.000 -99.73% 0.000
433.milc (unexplained diff vs previous) (percentage) 9.87% 2.330 2.560 0.000 -99.74% 0.000
444.namd (unexplained diff vs previous) (percentage) 9.68% 1.550 1.700 0.000 -99.85% 0.000
473.astar (unexplained diff vs previous) (percentage) 8.82% 4.080 4.440 0.000 -97.76% 0.000
482.sphinx3 (unexplained diff vs previous) (percentage) 8.58% 5.830 6.330 0.000 -99.77% 0.000
444.namd (unexplained diff vs previous) 8.33% 12.000 13.000 0.000 -99.84% 0.000
433.milc (unexplained diff vs previous) 7.41% 27.000 29.000 0.000 -99.74% 0.000
453.povray (unexplained diff vs previous) 7.14% 14.000 15.000 0.000 -99.74% 0.000
444.namd (max) (percentage) 7.01% 1.570 1.680 - -98.17% -
401.bzip2 (unexplained diff vs previous) (percentage) 6.38% 4.700 5.000 0.000 -98.64% 0.000
429.mcf (unexplained diff vs previous) 5.81% 155.000 164.000 0.000 -99.12% 0.000
433.milc (max) (percentage) 5.04% 2.380 2.500 - -97.25% -
464.h264ref (unexplained diff vs previous) (percentage) 4.63% 1.080 1.130 0.000 -99.05% 0.000
453.povray (max) (percentage) 4.56% 2.630 2.750 - -96.99% -
450.soplex (avg) (percentage) 4.53% 2.650 2.770 - -56.92% -
473.astar (unexplained diff vs previous) 4.15% 217.000 226.000 0.000 -97.77% 0.000
482.sphinx3 (avg) (percentage) 3.72% 1.880 1.950 - -75.41% -
433.milc (max) 3.70% 27.000 28.000 - -97.32% -
464.h264ref (unexplained diff vs previous) 3.17% 63.000 65.000 0.000 -99.05% 0.000
410.bwaves (avg) (percentage) 2.75% 1.090 1.120 - -74.60% -
401.bzip2 (avg) (percentage) 2.21% 1.810 1.850 - -66.24% -
462.libquantum (avg) (percentage) 2.20% 1.820 1.860 - -75.72% -
435.gromacs (avg) (percentage) 2.12% 1.890 1.930 - -61.86% -
482.sphinx3 (unexplained diff vs previous) 2.00% 50.000 51.000 0.000 -99.80% 0.000
445.gobmk (avg) (percentage) 1.98% 1.010 1.030 - -73.66% -
473.astar (avg) (percentage) 1.82% 1.650 1.680 - -59.62% -
450.soplex (unexplained diff vs previous) 1.75% 57.000 58.000 0.000 -99.60% 0.000
434.zeusmp (avg) (percentage) 1.69% 1.180 1.200 - -79.49% -
433.milc (avg) (percentage) 1.44% 1.390 1.410 - -76.69% -
401.bzip2 (unexplained diff vs previous) 1.39% 144.000 146.000 0.000 -98.65% 0.000
453.povray (avg) (percentage) 1.16% 1.720 1.740 - -77.72% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
450.soplex -9.73% 596.000 538.000 - -5.11% -
429.mcf -8.54% 1921.000 1757.000 - 23.38% -
459.GemsFDTD -6.00% 5487.000 5158.000 - -16.44% -
482.sphinx3 -5.95% 857.000 806.000 - -14.71% -
401.bzip2 -4.77% 3064.000 2918.000 - -0.78% -
462.libquantum -4.41% 136.000 130.000 - -7.14% -
473.astar -4.25% 5319.000 5093.000 - -0.68% -
435.gromacs -4.24% 7264.000 6956.000 - -4.31% -
471.omnetpp -3.82% 2773.000 2667.000 - -2.09% -
410.bwaves -3.11% 6048.000 5860.000 - 3.68% -
400.perlbench -2.80% 1570.000 1526.000 - -8.24% -
453.povray -2.75% 546.000 531.000 - -2.93% -
433.milc -2.50% 1161.000 1132.000 - -1.65% -
445.gobmk -2.11% 5110.000 5002.000 - -0.42% -
465.tonto -1.94% 11505.000 11282.000 - 3.12% -
434.zeusmp -1.93% 2533.000 2484.000 - -1.19% -
447.dealII -1.75% 1659.000 1630.000 - -5.45% -
444.namd -1.68% 776.000 763.000 - 2.14% -
470.lbm -1.63% 3801.000 3739.000 - -1.29% -
464.h264ref -1.12% 5810.000 5745.000 - -0.28% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
447.dealII (unexplained diff vs previous) -42.00% 50.000 29.000 0.000 -99.59% 0.000
447.dealII (unexplained diff vs previous) (percentage) -40.86% 3.010 1.780 0.000 -99.56% 0.000
471.omnetpp (unexplained diff vs previous) -21.48% 135.000 106.000 0.000 -99.01% 0.000
471.omnetpp (unexplained diff vs previous) (percentage) -18.48% 4.870 3.970 0.000 -98.99% 0.000
445.gobmk (unexplained diff vs previous) -18.18% 132.000 108.000 0.000 -98.06% 0.000
458.sjeng (unexplained diff vs previous) (percentage) -17.24% 0.870 0.720 0.000 -99.21% 0.000
458.sjeng (unexplained diff vs previous) -17.19% 64.000 53.000 0.000 -99.23% 0.000
400.perlbench (unexplained diff vs previous) -16.98% 53.000 44.000 0.000 -99.50% 0.000
445.gobmk (unexplained diff vs previous) (percentage) -16.28% 2.580 2.160 0.000 -98.06% 0.000
435.gromacs (max) -16.20% 358.000 300.000 - -91.60% -
450.soplex (max) -15.87% 63.000 53.000 - -90.28% -
400.perlbench (unexplained diff vs previous) (percentage) -14.79% 3.380 2.880 0.000 -99.45% 0.000
465.tonto (max) -14.35% 474.000 406.000 - -80.78% -
434.zeusmp (max) -14.04% 57.000 49.000 - -97.62% -
447.dealII (max) -13.73% 51.000 44.000 - -96.82% -
410.bwaves (unexplained diff vs previous) -13.36% 217.000 188.000 0.000 -97.59% 0.000
400.perlbench (max) -12.96% 54.000 47.000 - -96.64% -
465.tonto (max) (percentage) -12.62% 4.120 3.600 - -81.36% -
435.gromacs (max) (percentage) -12.55% 4.940 4.320 - -91.21% -
447.dealII (max) (percentage) -12.54% 3.110 2.720 - -96.61% -
434.zeusmp (unexplained diff vs previous) -12.50% 56.000 49.000 0.000 -99.57% 0.000
434.zeusmp (max) (percentage) -12.39% 2.260 1.980 - -97.58% -
470.lbm (max) -11.43% 70.000 62.000 - -97.74% -
471.omnetpp (max) -11.35% 141.000 125.000 - -94.24% -
482.sphinx3 (max) -11.32% 53.000 47.000 - -94.84% -
410.bwaves (max) -11.16% 224.000 199.000 - -93.93% -
434.zeusmp (unexplained diff vs previous) (percentage) -10.86% 2.210 1.970 0.000 -99.56% 0.000
429.mcf (max) -10.71% 168.000 150.000 - -88.65% -
410.bwaves (unexplained diff vs previous) (percentage) -10.58% 3.590 3.210 0.000 -97.67% 0.000
470.lbm (max) (percentage) -10.27% 1.850 1.660 - -97.71% -
470.lbm (unexplained diff vs previous) -10.14% 69.000 62.000 0.000 -99.38% 0.000
400.perlbench (max) (percentage) -10.03% 3.490 3.140 - -96.26% -
456.hmmer (max) -10.00% 10.000 9.000 - -99.58% -
435.gromacs (unexplained diff vs previous) -9.94% 342.000 308.000 0.000 -95.62% 0.000
459.GemsFDTD (max) -9.69% 351.000 317.000 - -92.81% -
470.lbm (unexplained diff vs previous) (percentage) -8.79% 1.820 1.660 0.000 -99.37% 0.000
471.omnetpp (max) (percentage) -8.40% 5.120 4.690 - -94.11% -
410.bwaves (max) (percentage) -8.33% 3.720 3.410 - -94.12% -
456.hmmer (max) (percentage) -8.33% 0.360 0.330 - -99.55% -
401.bzip2 (max) -7.95% 151.000 139.000 - -93.99% -
429.mcf -7.83% 115.000 106.000 - -2.75% -
429.mcf (avg) -7.83% 115.000 106.000 - -2.75% -
437.leslie3d (max) (percentage) -7.28% 4.120 3.820 - -76.96% -
458.sjeng (max) (percentage) -6.82% 0.880 0.820 - -98.28% -
445.gobmk (max) -6.67% 135.000 126.000 - -95.23% -
450.soplex -6.67% 15.000 14.000 - -61.11% -
450.soplex (avg) -6.67% 15.000 14.000 - -61.11% -
436.cactusADM (max) (percentage) -6.58% 0.760 0.710 - -99.20% -
433.milc -6.25% 16.000 15.000 - -78.26% -
433.milc (avg) -6.25% 16.000 15.000 - -78.26% -
436.cactusADM (max) -6.25% 16.000 15.000 - -99.19% -
458.sjeng (max) -6.25% 64.000 60.000 - -98.33% -
482.sphinx3 -6.25% 16.000 15.000 - -79.73% -
482.sphinx3 (avg) -6.25% 16.000 15.000 - -79.73% -
450.soplex (max) (percentage) -6.24% 10.580 9.920 - -89.69% -
435.gromacs (unexplained diff vs previous) (percentage) -5.94% 4.710 4.430 0.000 -95.42% 0.000
459.GemsFDTD -5.88% 85.000 80.000 - -77.78% -
459.GemsFDTD (avg) -5.88% 85.000 80.000 - -77.78% -
464.h264ref (max) -5.71% 70.000 66.000 - -97.89% -
437.leslie3d (max) -5.56% 450.000 425.000 - -77.97% -
464.h264ref (max) (percentage) -4.92% 1.220 1.160 - -97.86% -
445.gobmk (max) (percentage) -4.91% 2.650 2.520 - -95.21% -
473.astar (max) -4.42% 226.000 216.000 - -93.66% -
447.dealII -4.35% 23.000 22.000 - -77.78% -
447.dealII (avg) -4.35% 23.000 22.000 - -77.78% -
482.sphinx3 (max) (percentage) -4.03% 6.200 5.950 - -93.83% -
459.GemsFDTD (max) (percentage) -3.91% 6.400 6.150 - -91.39% -
401.bzip2 -3.64% 55.000 53.000 - -67.08% -
401.bzip2 (avg) -3.64% 55.000 53.000 - -67.08% -
401.bzip2 (max) (percentage) -3.25% 4.930 4.770 - -93.94% -
471.omnetpp -3.17% 63.000 61.000 - -72.65% -
471.omnetpp (avg) -3.17% 63.000 61.000 - -72.65% -
429.mcf (max) (percentage) -2.73% 8.780 8.540 - -90.81% -
416.gamess (max) (percentage) -2.33% 0.430 0.420 - -98.91% -
473.astar -2.30% 87.000 85.000 - -60.09% -
473.astar (avg) -2.30% 87.000 85.000 - -60.09% -
435.gromacs -2.19% 137.000 134.000 - -63.49% -
435.gromacs (avg) -2.19% 137.000 134.000 - -63.49% -
458.sjeng -1.92% 52.000 51.000 - -78.84% -
458.sjeng (avg) -1.92% 52.000 51.000 - -78.84% -
465.tonto -1.72% 174.000 171.000 - -53.15% -
465.tonto (avg) -1.72% 174.000 171.000 - -53.15% -
437.leslie3d (avg) (percentage) -1.11% 4.510 4.460 - 46.23% -

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
465.tonto 2.82% 1946163.000 2000958.000 - 3.29% -
400.perlbench 1.47% 893848.000 906955.000 - -0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
429.mcf 23.38% 1424.000 1757.000 - -8.54% -
410.bwaves 3.68% 5652.000 5860.000 - -3.11% -
465.tonto 3.12% 10941.000 11282.000 - -1.94% -
436.cactusADM 2.88% 2083.000 2143.000 - 0.80% -
444.namd 2.14% 747.000 763.000 - -1.68% -
456.hmmer 1.25% 2882.000 2918.000 - 0.03% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d (avg) (percentage) 46.23% 3.050 4.460 - -1.11% -
437.leslie3d 39.72% 355.000 496.000 - 0.81% -
437.leslie3d (avg) 39.72% 355.000 496.000 - 0.81% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
434.zeusmp -2.48% 152037.000 148271.000 - 0.00% -
437.leslie3d -1.63% 59479.000 58510.000 - 0.00% -
462.libquantum -1.59% 16085.000 15829.000 - 0.00% -
464.h264ref -1.51% 387748.000 381912.000 - 0.00% -
459.GemsFDTD -1.44% 244728.000 241192.000 - 1.84% -
470.lbm -1.44% 9691.000 9551.000 - 0.00% -
410.bwaves -1.26% 16760.000 16548.000 - 0.00% -
435.gromacs -1.12% 499261.000 493689.000 - 0.00% -
444.namd -1.11% 188385.000 186296.000 - 0.00% -
433.milc -1.10% 61382.000 60709.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
459.GemsFDTD -16.44% 6173.000 5158.000 - -6.00% -
482.sphinx3 -14.71% 945.000 806.000 - -5.95% -
400.perlbench -8.24% 1663.000 1526.000 - -2.80% -
462.libquantum -7.14% 140.000 130.000 - -4.41% -
447.dealII -5.45% 1724.000 1630.000 - -1.75% -
450.soplex -5.11% 567.000 538.000 - -9.73% -
437.leslie3d -4.39% 11640.000 11129.000 - 1.84% -
435.gromacs -4.31% 7269.000 6956.000 - -4.24% -
458.sjeng -3.25% 7567.000 7321.000 - -0.72% -
453.povray -2.93% 547.000 531.000 - -2.75% -
471.omnetpp -2.09% 2724.000 2667.000 - -3.82% -
433.milc -1.65% 1151.000 1132.000 - -2.50% -
470.lbm -1.29% 3788.000 3739.000 - -1.63% -
434.zeusmp -1.19% 2514.000 2484.000 - -1.93% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
462.libquantum (unexplained diff vs previous) -99.96% 13518.000 6.000 0.000 20.00% 0.000
462.libquantum (unexplained diff vs previous) (percentage) -99.95% 9655.710 4.620 0.000 25.54% 0.000
444.namd (unexplained diff vs previous) (percentage) -99.85% 1118.610 1.700 0.000 9.68% 0.000
444.namd (unexplained diff vs previous) -99.84% 8356.000 13.000 0.000 8.33% 0.000
482.sphinx3 (unexplained diff vs previous) -99.80% 26073.000 51.000 0.000 2.00% 0.000
482.sphinx3 (unexplained diff vs previous) (percentage) -99.77% 2759.050 6.330 0.000 8.58% 0.000
433.milc (unexplained diff vs previous) -99.74% 11289.000 29.000 0.000 7.41% 0.000
433.milc (unexplained diff vs previous) (percentage) -99.74% 980.800 2.560 0.000 9.87% 0.000
453.povray (unexplained diff vs previous) -99.74% 5707.000 15.000 0.000 7.14% 0.000
453.povray (unexplained diff vs previous) (percentage) -99.73% 1043.330 2.820 0.000 10.16% 0.000
450.soplex (unexplained diff vs previous) -99.60% 14500.000 58.000 0.000 1.75% 0.000
447.dealII (unexplained diff vs previous) -99.59% 7017.000 29.000 0.000 -42.00% 0.000
450.soplex (unexplained diff vs previous) (percentage) -99.58% 2557.320 10.780 0.000 12.76% 0.000
456.hmmer (max) -99.58% 2120.000 9.000 - -10.00% -
434.zeusmp (unexplained diff vs previous) -99.57% 11280.000 49.000 0.000 -12.50% 0.000
447.dealII (unexplained diff vs previous) (percentage) -99.56% 407.020 1.780 0.000 -40.86% 0.000
434.zeusmp (unexplained diff vs previous) (percentage) -99.56% 448.690 1.970 0.000 -10.86% 0.000
456.hmmer (max) (percentage) -99.55% 73.590 0.330 - -8.33% -
400.perlbench (unexplained diff vs previous) -99.50% 8772.000 44.000 0.000 -16.98% 0.000
400.perlbench (unexplained diff vs previous) (percentage) -99.45% 527.480 2.880 0.000 -14.79% 0.000
470.lbm (unexplained diff vs previous) -99.38% 9990.000 62.000 0.000 -10.14% 0.000
470.lbm (unexplained diff vs previous) (percentage) -99.37% 263.730 1.660 0.000 -8.79% 0.000
429.mcf (unexplained diff vs previous) (percentage) -99.29% 1305.690 9.330 0.000 15.61% 0.000
458.sjeng (unexplained diff vs previous) -99.23% 6876.000 53.000 0.000 -17.19% 0.000
458.sjeng (unexplained diff vs previous) (percentage) -99.21% 90.870 0.720 0.000 -17.24% 0.000
436.cactusADM (max) (percentage) -99.20% 88.730 0.710 - -6.58% -
436.cactusADM (max) -99.19% 1848.000 15.000 - -6.25% -
454.calculix (max) (percentage) -99.13% 99.730 0.870 - 0.00% -
429.mcf (unexplained diff vs previous) -99.12% 18593.000 164.000 0.000 5.81% 0.000
464.h264ref (unexplained diff vs previous) -99.05% 6843.000 65.000 0.000 3.17% 0.000
464.h264ref (unexplained diff vs previous) (percentage) -99.05% 118.780 1.130 0.000 4.63% 0.000
471.omnetpp (unexplained diff vs previous) -99.01% 10659.000 106.000 0.000 -21.48% 0.000
471.omnetpp (unexplained diff vs previous) (percentage) -98.99% 391.300 3.970 0.000 -18.48% 0.000
416.gamess (max) (percentage) -98.91% 38.550 0.420 - -2.33% -
401.bzip2 (unexplained diff vs previous) -98.65% 10833.000 146.000 0.000 1.39% 0.000
481.wrf (max) (percentage) -98.65% 68.700 0.930 - 0.00% -
401.bzip2 (unexplained diff vs previous) (percentage) -98.64% 368.340 5.000 0.000 6.38% 0.000
458.sjeng (max) -98.33% 3602.000 60.000 - -6.25% -
458.sjeng (max) (percentage) -98.28% 47.610 0.820 - -6.82% -
444.namd (max) -98.25% 685.000 12.000 - 0.00% -
444.namd (max) (percentage) -98.17% 91.790 1.680 - 7.01% -
445.gobmk (unexplained diff vs previous) -98.06% 5581.000 108.000 0.000 -18.18% 0.000
445.gobmk (unexplained diff vs previous) (percentage) -98.06% 111.110 2.160 0.000 -16.28% 0.000
464.h264ref (max) -97.89% 3127.000 66.000 - -5.71% -
464.h264ref (max) (percentage) -97.86% 54.290 1.160 - -4.92% -
473.astar (unexplained diff vs previous) -97.77% 10146.000 226.000 0.000 4.15% 0.000
473.astar (unexplained diff vs previous) (percentage) -97.76% 197.850 4.440 0.000 8.82% 0.000
470.lbm (max) -97.74% 2746.000 62.000 - -11.43% -
470.lbm (max) (percentage) -97.71% 72.510 1.660 - -10.27% -
410.bwaves (unexplained diff vs previous) (percentage) -97.67% 137.900 3.210 0.000 -10.58% 0.000
434.zeusmp (max) -97.62% 2055.000 49.000 - -14.04% -
410.bwaves (unexplained diff vs previous) -97.59% 7794.000 188.000 0.000 -13.36% 0.000
434.zeusmp (max) (percentage) -97.58% 81.770 1.980 - -12.39% -
483.xalancbmk (max) (percentage) -97.42% 68.670 1.770 - 0.00% -
433.milc (max) -97.32% 1044.000 28.000 - 3.70% -
433.milc (max) (percentage) -97.25% 90.750 2.500 - 5.04% -
453.povray (max) -97.19% 499.000 14.000 - 0.00% -
453.povray (max) (percentage) -96.99% 91.250 2.750 - 4.56% -
447.dealII (max) -96.82% 1384.000 44.000 - -13.73% -
400.perlbench (max) -96.64% 1397.000 47.000 - -12.96% -
447.dealII (max) (percentage) -96.61% 80.280 2.720 - -12.54% -
462.libquantum (max) -96.38% 138.000 5.000 - 0.00% -
400.perlbench (max) (percentage) -96.26% 84.060 3.140 - -10.03% -
403.gcc (max) (percentage) -95.79% 99.360 4.180 - -0.48% -
435.gromacs (unexplained diff vs previous) -95.62% 7028.000 308.000 0.000 -9.94% 0.000
462.libquantum (max) (percentage) -95.54% 98.970 4.410 - 15.45% -
435.gromacs (unexplained diff vs previous) (percentage) -95.42% 96.680 4.430 0.000 -5.94% 0.000
445.gobmk (max) -95.23% 2643.000 126.000 - -6.67% -
445.gobmk (max) (percentage) -95.21% 52.630 2.520 - -4.91% -
482.sphinx3 (max) -94.84% 911.000 47.000 - -11.32% -
471.omnetpp (max) -94.24% 2169.000 125.000 - -11.35% -
410.bwaves (max) (percentage) -94.12% 57.970 3.410 - -8.33% -
471.omnetpp (max) (percentage) -94.11% 79.650 4.690 - -8.40% -
401.bzip2 (max) -93.99% 2313.000 139.000 - -7.95% -
401.bzip2 (max) (percentage) -93.94% 78.650 4.770 - -3.25% -
410.bwaves (max) -93.93% 3276.000 199.000 - -11.16% -
482.sphinx3 (max) (percentage) -93.83% 96.500 5.950 - -4.03% -
473.astar (max) -93.66% 3406.000 216.000 - -4.42% -
473.astar (max) (percentage) -93.60% 66.430 4.250 - 0.00% -
459.GemsFDTD (max) -92.81% 4411.000 317.000 - -9.69% -
435.gromacs (max) -91.60% 3573.000 300.000 - -16.20% -
459.GemsFDTD (max) (percentage) -91.39% 71.460 6.150 - -3.91% -
437.leslie3d (unexplained diff vs previous) -91.31% 2314.000 201.000 0.000 20.36% 0.000
435.gromacs (max) (percentage) -91.21% 49.160 4.320 - -12.55% -
437.leslie3d (unexplained diff vs previous) (percentage) -90.90% 19.880 1.810 0.000 18.30% 0.000
429.mcf (max) (percentage) -90.81% 92.890 8.540 - -2.73% -
450.soplex (max) -90.28% 545.000 53.000 - -15.87% -
450.soplex (max) (percentage) -89.69% 96.240 9.920 - -6.24% -
429.mcf (max) -88.65% 1322.000 150.000 - -10.71% -
456.hmmer -85.04% 127.000 19.000 - 0.00% -
456.hmmer (avg) -85.04% 127.000 19.000 - 0.00% -
456.hmmer (avg) (percentage) -84.58% 4.410 0.680 - 0.00% -
444.namd -83.82% 68.000 11.000 - 0.00% -
444.namd (avg) -83.82% 68.000 11.000 - 0.00% -
444.namd (avg) (percentage) -83.73% 9.220 1.500 - 0.67% -
470.lbm -83.26% 239.000 40.000 - 0.00% -
470.lbm (avg) -83.26% 239.000 40.000 - 0.00% -
470.lbm (avg) (percentage) -83.10% 6.330 1.070 - 0.00% -
416.gamess (avg) (percentage) -82.81% 4.420 0.760 - 0.00% -
464.h264ref -82.25% 293.000 52.000 - 0.00% -
464.h264ref (avg) -82.25% 293.000 52.000 - 0.00% -
464.h264ref (avg) (percentage) -82.12% 5.090 0.910 - 0.00% -
465.tonto (max) (percentage) -81.36% 19.310 3.600 - -12.62% -
465.tonto (max) -80.78% 2112.000 406.000 - -14.35% -
434.zeusmp -80.27% 147.000 29.000 - 0.00% -
434.zeusmp (avg) -80.27% 147.000 29.000 - 0.00% -
462.libquantum -80.00% 10.000 2.000 - 0.00% -
462.libquantum (avg) -80.00% 10.000 2.000 - 0.00% -
482.sphinx3 -79.73% 74.000 15.000 - -6.25% -
482.sphinx3 (avg) -79.73% 74.000 15.000 - -6.25% -
434.zeusmp (avg) (percentage) -79.49% 5.850 1.200 - 1.69% -
458.sjeng -78.84% 241.000 51.000 - -1.92% -
458.sjeng (avg) -78.84% 241.000 51.000 - -1.92% -
453.povray -78.57% 42.000 9.000 - 0.00% -
453.povray (avg) -78.57% 42.000 9.000 - 0.00% -
433.milc -78.26% 69.000 15.000 - -6.25% -
433.milc (avg) -78.26% 69.000 15.000 - -6.25% -
437.leslie3d (max) -77.97% 1929.000 425.000 - -5.56% -
447.dealII -77.78% 99.000 22.000 - -4.35% -
447.dealII (avg) -77.78% 99.000 22.000 - -4.35% -
459.GemsFDTD -77.78% 360.000 80.000 - -5.88% -
459.GemsFDTD (avg) -77.78% 360.000 80.000 - -5.88% -
458.sjeng (avg) (percentage) -77.74% 3.190 0.710 - 0.00% -
453.povray (avg) (percentage) -77.72% 7.810 1.740 - 1.16% -
437.leslie3d (max) (percentage) -76.96% 16.580 3.820 - -7.28% -
436.cactusADM (avg) (percentage) -76.92% 5.980 1.380 - 0.00% -
433.milc (avg) (percentage) -76.69% 6.050 1.410 - 1.44% -
436.cactusADM -76.61% 124.000 29.000 - 0.00% -
436.cactusADM (avg) -76.61% 124.000 29.000 - 0.00% -
447.dealII (avg) (percentage) -75.74% 5.770 1.400 - 0.72% -
462.libquantum (avg) (percentage) -75.72% 7.660 1.860 - 2.20% -
482.sphinx3 (avg) (percentage) -75.41% 7.930 1.950 - 3.72% -
410.bwaves (avg) (percentage) -74.60% 4.410 1.120 - 2.75% -
445.gobmk -73.98% 196.000 51.000 - 0.00% -
445.gobmk (avg) -73.98% 196.000 51.000 - 0.00% -
410.bwaves -73.90% 249.000 65.000 - 0.00% -
410.bwaves (avg) -73.90% 249.000 65.000 - 0.00% -
445.gobmk (avg) (percentage) -73.66% 3.910 1.030 - 1.98% -
459.GemsFDTD (avg) (percentage) -73.29% 5.840 1.560 - 0.00% -
471.omnetpp -72.65% 223.000 61.000 - -3.17% -
471.omnetpp (avg) -72.65% 223.000 61.000 - -3.17% -
471.omnetpp (avg) (percentage) -71.95% 8.200 2.300 - 0.88% -
481.wrf (avg) (percentage) -71.15% 6.240 1.800 - 0.00% -
400.perlbench -67.62% 105.000 34.000 - 0.00% -
400.perlbench (avg) -67.62% 105.000 34.000 - 0.00% -
401.bzip2 -67.08% 161.000 53.000 - -3.64% -
401.bzip2 (avg) -67.08% 161.000 53.000 - -3.64% -
401.bzip2 (avg) (percentage) -66.24% 5.480 1.850 - 2.21% -
400.perlbench (avg) (percentage) -64.88% 6.350 2.230 - 0.45% -
435.gromacs -63.49% 367.000 134.000 - -2.19% -
435.gromacs (avg) -63.49% 367.000 134.000 - -2.19% -
435.gromacs (avg) (percentage) -61.86% 5.060 1.930 - 2.12% -
450.soplex -61.11% 36.000 14.000 - -6.67% -
450.soplex (avg) -61.11% 36.000 14.000 - -6.67% -
473.astar -60.09% 213.000 85.000 - -2.30% -
473.astar (avg) -60.09% 213.000 85.000 - -2.30% -
473.astar (avg) (percentage) -59.62% 4.160 1.680 - 1.82% -
450.soplex (avg) (percentage) -56.92% 6.430 2.770 - 4.53% -
454.calculix (avg) (percentage) -55.11% 8.020 3.600 - 0.00% -
465.tonto (avg) (percentage) -54.49% 3.340 1.520 - 0.00% -
483.xalancbmk (avg) (percentage) -54.46% 6.500 2.960 - 0.00% -
465.tonto -53.15% 365.000 171.000 - -1.72% -
465.tonto (avg) -53.15% 365.000 171.000 - -1.72% -
403.gcc (avg) (percentage) -30.46% 7.320 5.090 - 0.00% -
429.mcf (avg) (percentage) -21.25% 7.670 6.040 - 0.67% -
429.mcf -2.75% 109.000 106.000 - -7.83% -
429.mcf (avg) -2.75% 109.000 106.000 - -7.83% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 134.48% 29.000 68.000 - 0.00% -
nb_compile_successful 65.52% 29.000 48.000 - 0.00% -
nb_execution_successful 65.52% 29.000 48.000 - 0.00% -

Report Time: 0.39s
Execution (seconds)
Name Current %
400.perlbench 1526.000 -2.80%
401.bzip2 2918.000 -4.77%
410.bwaves 5860.000 -3.11%
429.mcf 1757.000 -8.54%
433.milc 1132.000 -2.50%
434.zeusmp 2484.000 -1.93%
435.gromacs 6956.000 -4.24%
436.cactusADM 2143.000 -
437.leslie3d 11129.000 1.84%
444.namd 763.000 -1.68%
445.gobmk 5002.000 -2.11%
447.dealII 1630.000 -1.75%
450.soplex 538.000 -9.73%
453.povray 531.000 -2.75%
456.hmmer 2918.000 -
458.sjeng 7321.000 -
459.GemsFDTD 5158.000 -6.00%
462.libquantum 130.000 -4.41%
464.h264ref 5745.000 -1.12%
465.tonto 11282.000 -1.94%
470.lbm 3739.000 -1.63%
471.omnetpp 2667.000 -3.82%
473.astar 5093.000 -4.25%
482.sphinx3 806.000 -5.95%
Geometric Mean 2407.992 -3.08%
Code Size (bytes)
Name Current %
400.perlbench 906955.000 -
401.bzip2 43831.000 -
410.bwaves 16548.000 -
429.mcf 9055.000 -
433.milc 60709.000 -
434.zeusmp 148271.000 -
435.gromacs 493689.000 -
436.cactusADM 350639.000 -
437.leslie3d 58510.000 -
444.namd 186296.000 -
445.gobmk 1379094.000 -
447.dealII 309636.000 -
450.soplex 205243.000 -
453.povray 660325.000 -
456.hmmer 108211.000 -
458.sjeng 103108.000 -
459.GemsFDTD 241192.000 1.84%
462.libquantum 15829.000 -
464.h264ref 381912.000 -
465.tonto 2000958.000 3.29%
470.lbm 9551.000 -
471.omnetpp 480350.000 -
473.astar 22888.000 -
482.sphinx3 112183.000 -
Geometric Mean 137922.621 -
sample variability
Name Current %
400.perlbench 34.000 -
400.perlbench (avg) 34.000 -
400.perlbench (avg) (percentage) 2.230 -
400.perlbench (max) 47.000 -12.96%
400.perlbench (max) (percentage) 3.140 -10.03%
400.perlbench (unexplained diff vs previous) 44.000 -16.98%
400.perlbench (unexplained diff vs previous) (percentage) 2.880 -14.79%
401.bzip2 53.000 -3.64%
401.bzip2 (avg) 53.000 -3.64%
401.bzip2 (avg) (percentage) 1.850 2.21%
401.bzip2 (max) 139.000 -7.95%
401.bzip2 (max) (percentage) 4.770 -3.25%
401.bzip2 (unexplained diff vs previous) 146.000 1.39%
401.bzip2 (unexplained diff vs previous) (percentage) 5.000 6.38%
403.gcc (avg) (percentage) 5.090 -
403.gcc (max) (percentage) 4.180 -
410.bwaves 65.000 -
410.bwaves (avg) 65.000 -
410.bwaves (avg) (percentage) 1.120 2.75%
410.bwaves (max) 199.000 -11.16%
410.bwaves (max) (percentage) 3.410 -8.33%
410.bwaves (unexplained diff vs previous) 188.000 -13.36%
410.bwaves (unexplained diff vs previous) (percentage) 3.210 -10.58%
416.gamess (avg) (percentage) 0.760 -
416.gamess (max) (percentage) 0.420 -2.33%
429.mcf 106.000 -7.83%
429.mcf (avg) 106.000 -7.83%
429.mcf (avg) (percentage) 6.040 -
429.mcf (max) 150.000 -10.71%
429.mcf (max) (percentage) 8.540 -2.73%
429.mcf (unexplained diff vs previous) 164.000 5.81%
429.mcf (unexplained diff vs previous) (percentage) 9.330 15.61%
433.milc 15.000 -6.25%
433.milc (avg) 15.000 -6.25%
433.milc (avg) (percentage) 1.410 1.44%
433.milc (max) 28.000 3.70%
433.milc (max) (percentage) 2.500 5.04%
433.milc (unexplained diff vs previous) 29.000 7.41%
433.milc (unexplained diff vs previous) (percentage) 2.560 9.87%
434.zeusmp 29.000 -
434.zeusmp (avg) 29.000 -
434.zeusmp (avg) (percentage) 1.200 1.69%
434.zeusmp (max) 49.000 -14.04%
434.zeusmp (max) (percentage) 1.980 -12.39%
434.zeusmp (unexplained diff vs previous) 49.000 -12.50%
434.zeusmp (unexplained diff vs previous) (percentage) 1.970 -10.86%
435.gromacs 134.000 -2.19%
435.gromacs (avg) 134.000 -2.19%
435.gromacs (avg) (percentage) 1.930 2.12%
435.gromacs (max) 300.000 -16.20%
435.gromacs (max) (percentage) 4.320 -12.55%
435.gromacs (unexplained diff vs previous) 308.000 -9.94%
435.gromacs (unexplained diff vs previous) (percentage) 4.430 -5.94%
436.cactusADM 29.000 -
436.cactusADM (avg) 29.000 -
436.cactusADM (avg) (percentage) 1.380 -
436.cactusADM (max) 15.000 -6.25%
436.cactusADM (max) (percentage) 0.710 -6.58%
437.leslie3d 496.000 -
437.leslie3d (avg) 496.000 -
437.leslie3d (avg) (percentage) 4.460 -1.11%
437.leslie3d (max) 425.000 -5.56%
437.leslie3d (max) (percentage) 3.820 -7.28%
437.leslie3d (unexplained diff vs previous) 201.000 20.36%
437.leslie3d (unexplained diff vs previous) (percentage) 1.810 18.30%
444.namd 11.000 -
444.namd (avg) 11.000 -
444.namd (avg) (percentage) 1.500 -
444.namd (max) 12.000 -
444.namd (max) (percentage) 1.680 7.01%
444.namd (unexplained diff vs previous) 13.000 8.33%
444.namd (unexplained diff vs previous) (percentage) 1.700 9.68%
445.gobmk 51.000 -
445.gobmk (avg) 51.000 -
445.gobmk (avg) (percentage) 1.030 1.98%
445.gobmk (max) 126.000 -6.67%
445.gobmk (max) (percentage) 2.520 -4.91%
445.gobmk (unexplained diff vs previous) 108.000 -18.18%
445.gobmk (unexplained diff vs previous) (percentage) 2.160 -16.28%
447.dealII 22.000 -4.35%
447.dealII (avg) 22.000 -4.35%
447.dealII (avg) (percentage) 1.400 -
447.dealII (max) 44.000 -13.73%
447.dealII (max) (percentage) 2.720 -12.54%
447.dealII (unexplained diff vs previous) 29.000 -42.00%
447.dealII (unexplained diff vs previous) (percentage) 1.780 -40.86%
450.soplex 14.000 -6.67%
450.soplex (avg) 14.000 -6.67%
450.soplex (avg) (percentage) 2.770 4.53%
450.soplex (max) 53.000 -15.87%
450.soplex (max) (percentage) 9.920 -6.24%
450.soplex (unexplained diff vs previous) 58.000 1.75%
450.soplex (unexplained diff vs previous) (percentage) 10.780 12.76%
453.povray 9.000 -
453.povray (avg) 9.000 -
453.povray (avg) (percentage) 1.740 1.16%
453.povray (max) 14.000 -
453.povray (max) (percentage) 2.750 4.56%
453.povray (unexplained diff vs previous) 15.000 7.14%
453.povray (unexplained diff vs previous) (percentage) 2.820 10.16%
454.calculix (avg) (percentage) 3.600 -
454.calculix (max) (percentage) 0.870 -
456.hmmer 19.000 -
456.hmmer (avg) 19.000 -
456.hmmer (avg) (percentage) 0.680 -
456.hmmer (max) 9.000 -10.00%
456.hmmer (max) (percentage) 0.330 -8.33%
458.sjeng 51.000 -1.92%
458.sjeng (avg) 51.000 -1.92%
458.sjeng (avg) (percentage) 0.710 -
458.sjeng (max) 60.000 -6.25%
458.sjeng (max) (percentage) 0.820 -6.82%
458.sjeng (unexplained diff vs previous) 53.000 -17.19%
458.sjeng (unexplained diff vs previous) (percentage) 0.720 -17.24%
459.GemsFDTD 80.000 -5.88%
459.GemsFDTD (avg) 80.000 -5.88%
459.GemsFDTD (avg) (percentage) 1.560 -
459.GemsFDTD (max) 317.000 -9.69%
459.GemsFDTD (max) (percentage) 6.150 -3.91%
462.libquantum 2.000 -
462.libquantum (avg) 2.000 -
462.libquantum (avg) (percentage) 1.860 2.20%
462.libquantum (max) 5.000 -
462.libquantum (max) (percentage) 4.410 15.45%
462.libquantum (unexplained diff vs previous) 6.000 20.00%
462.libquantum (unexplained diff vs previous) (percentage) 4.620 25.54%
464.h264ref 52.000 -
464.h264ref (avg) 52.000 -
464.h264ref (avg) (percentage) 0.910 -
464.h264ref (max) 66.000 -5.71%
464.h264ref (max) (percentage) 1.160 -4.92%
464.h264ref (unexplained diff vs previous) 65.000 3.17%
464.h264ref (unexplained diff vs previous) (percentage) 1.130 4.63%
465.tonto 171.000 -1.72%
465.tonto (avg) 171.000 -1.72%
465.tonto (avg) (percentage) 1.520 -
465.tonto (max) 406.000 -14.35%
465.tonto (max) (percentage) 3.600 -12.62%
470.lbm 40.000 -
470.lbm (avg) 40.000 -
470.lbm (avg) (percentage) 1.070 -
470.lbm (max) 62.000 -11.43%
470.lbm (max) (percentage) 1.660 -10.27%
470.lbm (unexplained diff vs previous) 62.000 -10.14%
470.lbm (unexplained diff vs previous) (percentage) 1.660 -8.79%
471.omnetpp 61.000 -3.17%
471.omnetpp (avg) 61.000 -3.17%
471.omnetpp (avg) (percentage) 2.300 -
471.omnetpp (max) 125.000 -11.35%
471.omnetpp (max) (percentage) 4.690 -8.40%
471.omnetpp (unexplained diff vs previous) 106.000 -21.48%
471.omnetpp (unexplained diff vs previous) (percentage) 3.970 -18.48%
473.astar 85.000 -2.30%
473.astar (avg) 85.000 -2.30%
473.astar (avg) (percentage) 1.680 1.82%
473.astar (max) 216.000 -4.42%
473.astar (max) (percentage) 4.250 -
473.astar (unexplained diff vs previous) 226.000 4.15%
473.astar (unexplained diff vs previous) (percentage) 4.440 8.82%
481.wrf (avg) (percentage) 1.800 -
481.wrf (max) (percentage) 0.930 -
482.sphinx3 15.000 -6.25%
482.sphinx3 (avg) 15.000 -6.25%
482.sphinx3 (avg) (percentage) 1.950 3.72%
482.sphinx3 (max) 47.000 -11.32%
482.sphinx3 (max) (percentage) 5.950 -4.03%
482.sphinx3 (unexplained diff vs previous) 51.000 2.00%
482.sphinx3 (unexplained diff vs previous) (percentage) 6.330 8.58%
483.xalancbmk (avg) (percentage) 2.960 -
483.xalancbmk (max) (percentage) 1.770 -
Geometric Mean 11.865 -3.29%