Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=7845a24a6d6ec735f617bebec1153004cdfcd0bf (+ 32 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/1bf18629c54adf4893c8db5227a36e1952ee69a3 (+ 72 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=2e94e2f5d2bf2de124c8ad7da85463355e54ccb2 (+ 6 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=378e271eb0f3f02d1e81bd813ec97c106238613e (+ 61 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-aarch64-master-Os_LTO-build/210/
View Options
Report
Filter

gnu-aarch64-master-Os_LTO test results

Run Order Start Time Duration
Current 0210 (4-changed-components) 2024-03-19T04:27:09 0:00:00
Previous 0209 (3-changed-components) 2024-03-15T18:09:04 0:00:00
Baseline 0001 (4-changed-components) 2023-02-20T22:48:24 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 18 13
Performance Improvements 119 199
Added Tests 12 0
Unchanged Tests 1087 1024
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
400.perlbench 3.09% 1523.000 1570.000 - -5.59% -
434.zeusmp 1.04% 2511.000 2537.000 - 0.91% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
434.zeusmp (unexplained diff vs previous) 766.67% 3.000 26.000 - -99.77% -
434.zeusmp (unexplained diff vs previous) (percentage) 750.00% 0.120 1.020 - -99.77% -
416.gamess (max) 583.33% 12.000 82.000 - -98.29% -
416.gamess (max) (percentage) 580.00% 0.100 0.680 - -98.24% -
447.dealII (unexplained diff vs previous) (percentage) 227.78% 0.540 1.770 - -99.57% -
447.dealII (unexplained diff vs previous) 222.22% 9.000 29.000 - -99.59% -
410.bwaves (unexplained diff vs previous) (percentage) 195.00% 0.200 0.590 - -99.57% -
410.bwaves (unexplained diff vs previous) 191.67% 12.000 35.000 - -99.55% -
410.bwaves (max) (percentage) 168.18% 0.220 0.590 - -98.98% -
410.bwaves (max) 161.54% 13.000 34.000 - -98.96% -
434.zeusmp (max) 160.00% 10.000 26.000 - -98.73% -
434.zeusmp (max) (percentage) 153.66% 0.410 1.040 - -98.73% -
447.dealII (max) 115.38% 13.000 28.000 - -97.98% -
447.dealII (max) (percentage) 112.20% 0.820 1.740 - -97.83% -
400.perlbench 2.86% 35.000 36.000 - -65.71% -
400.perlbench (avg) 2.86% 35.000 36.000 - -65.71% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
447.dealII -1.74% 1669.000 1640.000 - -4.87% -
471.omnetpp -1.72% 2783.000 2735.000 - 0.40% -
437.leslie3d -1.70% 11457.000 11262.000 - -3.25% -
401.bzip2 -1.60% 3059.000 3010.000 - 2.35% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
433.milc (unexplained diff vs previous) -90.91% 11.000 1.000 - -99.99% -
433.milc (unexplained diff vs previous) (percentage) -90.53% 0.950 0.090 - -99.99% -
429.mcf (unexplained diff vs previous) (percentage) -86.00% 0.500 0.070 - -99.99% -
429.mcf (unexplained diff vs previous) -85.71% 7.000 1.000 - -99.99% -
462.libquantum (unexplained diff vs previous) -75.00% 4.000 1.000 - -99.99% -
462.libquantum (unexplained diff vs previous) (percentage) -74.66% 2.960 0.750 - -99.99% -
437.leslie3d (unexplained diff vs previous) -72.92% 720.000 195.000 - -91.57% -
437.leslie3d (unexplained diff vs previous) (percentage) -72.45% 6.280 1.730 - -91.30% -
465.tonto (max) -62.65% 249.000 93.000 - -95.60% -
465.tonto (max) (percentage) -62.33% 2.150 0.810 - -95.81% -
458.sjeng (unexplained diff vs previous) (percentage) -58.97% 0.390 0.160 - -99.82% -
458.sjeng (unexplained diff vs previous) -58.62% 29.000 12.000 - -99.83% -
433.milc (max) (percentage) -54.59% 1.960 0.890 - -99.02% -
433.milc (max) -54.55% 22.000 10.000 - -99.04% -
436.cactusADM (unexplained diff vs previous) -50.00% 6.000 3.000 - -99.98% -
436.cactusADM (unexplained diff vs previous) (percentage) -50.00% 0.280 0.140 - -99.98% -
473.astar (unexplained diff vs previous) -43.48% 23.000 13.000 - -99.87% -
473.astar (unexplained diff vs previous) (percentage) -43.18% 0.440 0.250 - -99.87% -
470.lbm (unexplained diff vs previous) -40.00% 5.000 3.000 - -99.97% -
470.lbm (unexplained diff vs previous) (percentage) -38.46% 0.130 0.080 - -99.97% -
401.bzip2 (unexplained diff vs previous) -34.67% 75.000 49.000 - -99.55% -
401.bzip2 (unexplained diff vs previous) (percentage) -33.47% 2.450 1.630 - -99.56% -
450.soplex (unexplained diff vs previous) -33.33% 3.000 2.000 - -99.99% -
450.soplex (unexplained diff vs previous) (percentage) -33.33% 0.510 0.340 - -99.99% -
482.sphinx3 (unexplained diff vs previous) -33.33% 6.000 4.000 - -99.98% -
482.sphinx3 (unexplained diff vs previous) (percentage) -33.33% 0.720 0.480 - -99.98% -
458.sjeng (max) -32.26% 31.000 21.000 - -99.42% -
471.omnetpp (unexplained diff vs previous) -31.43% 70.000 48.000 - -99.55% -
458.sjeng (max) (percentage) -30.95% 0.420 0.290 - -99.39% -
471.omnetpp (unexplained diff vs previous) (percentage) -30.16% 2.520 1.760 - -99.55% -
435.gromacs (max) (percentage) -27.66% 0.940 0.680 - -98.62% -
435.gromacs (max) -26.87% 67.000 49.000 - -98.63% -
473.astar (max) (percentage) -25.00% 0.440 0.330 - -99.50% -
473.astar (max) -22.73% 22.000 17.000 - -99.50% -
462.libquantum (max) (percentage) -16.67% 2.880 2.400 - -97.58% -
444.namd (max) -14.29% 7.000 6.000 - -99.12% -
464.h264ref (max) -13.79% 29.000 25.000 - -99.20% -
464.h264ref (max) (percentage) -13.73% 0.510 0.440 - -99.19% -
459.GemsFDTD (max) (percentage) -13.21% 0.530 0.460 - -99.36% -
456.hmmer (max) -12.50% 8.000 7.000 - -99.67% -
437.leslie3d (max) -11.52% 677.000 599.000 - -68.95% -
456.hmmer (unexplained diff vs previous) -11.11% 9.000 8.000 - -99.90% -
459.GemsFDTD (max) -11.11% 27.000 24.000 - -99.46% -
450.soplex (max) (percentage) -10.94% 0.640 0.570 - -99.41% -
436.cactusADM (max) (percentage) -10.71% 0.280 0.250 - -99.72% -
482.sphinx3 (max) -10.00% 10.000 9.000 - -99.01% -
456.hmmer (max) (percentage) -10.00% 0.300 0.270 - -99.63% -
456.hmmer (unexplained diff vs previous) (percentage) -10.00% 0.300 0.270 - -99.90% -
437.leslie3d (max) (percentage) -9.98% 5.910 5.320 - -67.91% -
400.perlbench (unexplained diff vs previous) (percentage) -8.84% 3.280 2.990 - -99.43% -
482.sphinx3 (max) (percentage) -8.66% 1.270 1.160 - -98.80% -
401.bzip2 (max) -7.89% 76.000 70.000 - -96.97% -
444.namd -7.69% 13.000 12.000 - -82.35% -
444.namd (avg) -7.69% 13.000 12.000 - -82.35% -
401.bzip2 (max) (percentage) -7.17% 2.510 2.330 - -97.04% -
470.lbm (max) (percentage) -7.14% 0.420 0.390 - -99.46% -
429.mcf (max) (percentage) -7.14% 0.700 0.650 - -99.30% -
471.omnetpp (max) -7.04% 71.000 66.000 - -96.96% -
470.lbm (max) -6.67% 15.000 14.000 - -99.49% -
453.povray (max) (percentage) -6.53% 1.990 1.860 - -97.96% -
450.soplex -6.25% 16.000 15.000 - -58.33% -
450.soplex (avg) -6.25% 16.000 15.000 - -58.33% -
471.omnetpp (max) (percentage) -6.20% 2.580 2.420 - -96.96% -
444.namd (max) (percentage) -6.19% 0.970 0.910 - -99.01% -
400.perlbench (unexplained diff vs previous) -6.00% 50.000 47.000 - -99.46% -
433.milc -5.26% 19.000 18.000 - -73.91% -
433.milc (avg) -5.26% 19.000 18.000 - -73.91% -
447.dealII -4.17% 24.000 23.000 - -76.77% -
447.dealII (avg) -4.17% 24.000 23.000 - -76.77% -
436.cactusADM -3.03% 33.000 32.000 - -74.19% -
436.cactusADM (avg) -3.03% 33.000 32.000 - -74.19% -
437.leslie3d -2.90% 552.000 536.000 - 50.99% -
437.leslie3d (avg) -2.90% 552.000 536.000 - 50.99% -
465.tonto -2.84% 176.000 171.000 - -53.15% -
465.tonto (avg) -2.84% 176.000 171.000 - -53.15% -
400.perlbench (max) (percentage) -2.83% 3.180 3.090 - -96.32% -
465.tonto (avg) (percentage) -2.63% 1.520 1.480 - -55.69% -
429.mcf -2.27% 88.000 86.000 - -21.10% -
429.mcf (avg) -2.27% 88.000 86.000 - -21.10% -
470.lbm -2.13% 47.000 46.000 - -80.75% -
470.lbm (avg) -2.13% 47.000 46.000 - -80.75% -
473.astar -2.08% 96.000 94.000 - -55.87% -
473.astar (avg) -2.08% 96.000 94.000 - -55.87% -
445.gobmk -1.92% 52.000 51.000 - -73.98% -
445.gobmk (avg) -1.92% 52.000 51.000 - -73.98% -
436.cactusADM (avg) (percentage) -1.89% 1.590 1.560 - -73.91% -
464.h264ref (avg) (percentage) -1.87% 1.070 1.050 - -79.37% -
445.gobmk (avg) (percentage) -1.85% 1.080 1.060 - -72.89% -
459.GemsFDTD (avg) (percentage) -1.85% 1.620 1.590 - -72.77% -
450.soplex (avg) (percentage) -1.80% 2.780 2.730 - -57.54% -
444.namd (avg) (percentage) -1.75% 1.710 1.680 - -81.78% -
410.bwaves (avg) (percentage) -1.69% 1.180 1.160 - -73.70% -
401.bzip2 -1.69% 59.000 58.000 - -63.98% -
401.bzip2 (avg) -1.69% 59.000 58.000 - -63.98% -
464.h264ref -1.64% 61.000 60.000 - -79.52% -
464.h264ref (avg) -1.64% 61.000 60.000 - -79.52% -
470.lbm (avg) (percentage) -1.59% 1.260 1.240 - -80.41% -
471.omnetpp -1.54% 65.000 64.000 - -71.30% -
471.omnetpp (avg) -1.54% 65.000 64.000 - -71.30% -
435.gromacs (avg) (percentage) -1.50% 2.000 1.970 - -61.07% -
482.sphinx3 (avg) (percentage) -1.48% 2.030 2.000 - -74.78% -
410.bwaves -1.45% 69.000 68.000 - -72.69% -
410.bwaves (avg) -1.45% 69.000 68.000 - -72.69% -
403.gcc (max) (percentage) -1.43% 4.900 4.830 - -95.14% -
429.mcf (avg) (percentage) -1.42% 6.320 6.230 - -18.77% -
456.hmmer (avg) (percentage) -1.27% 0.790 0.780 - -82.31% -
458.sjeng (avg) (percentage) -1.27% 0.790 0.780 - -75.55% -
437.leslie3d (avg) (percentage) -1.24% 4.820 4.760 - 56.07% -
433.milc (avg) (percentage) -1.21% 1.650 1.630 - -73.06% -
459.GemsFDTD -1.19% 84.000 83.000 - -76.94% -
459.GemsFDTD (avg) -1.19% 84.000 83.000 - -76.94% -
462.libquantum (avg) (percentage) -1.09% 1.830 1.810 - -76.37% -
473.astar (avg) (percentage) -1.08% 1.850 1.830 - -56.01% -
453.povray (unexplained diff vs previous) (percentage) -1.08% 0.930 0.920 - -99.91% -
454.calculix (max) (percentage) -1.01% 0.990 0.980 - -99.02% -

Added Tests - sample variability
416.gamess (unexplained diff vs previous)
416.gamess (unexplained diff vs previous) (percentage)
435.gromacs (unexplained diff vs previous)
435.gromacs (unexplained diff vs previous) (percentage)
445.gobmk (unexplained diff vs previous)
445.gobmk (unexplained diff vs previous) (percentage)
459.GemsFDTD (unexplained diff vs previous)
459.GemsFDTD (unexplained diff vs previous) (percentage)
464.h264ref (unexplained diff vs previous)
464.h264ref (unexplained diff vs previous) (percentage)
465.tonto (unexplained diff vs previous)
465.tonto (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
465.tonto 6.06% 10941.000 11604.000 - -0.16% -
410.bwaves 4.28% 5652.000 5894.000 - -0.59% -
450.soplex 2.82% 567.000 583.000 - -0.34% -
444.namd 2.81% 747.000 768.000 - 0.13% -
456.hmmer 2.74% 2882.000 2961.000 - 0.27% -
401.bzip2 2.35% 2941.000 3010.000 - -1.60% -
436.cactusADM 1.15% 2083.000 2107.000 - -0.14% -
473.astar 1.05% 5128.000 5182.000 - -0.25% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d (avg) (percentage) 56.07% 3.050 4.760 - -1.24% -
437.leslie3d 50.99% 355.000 536.000 - -2.90% -
437.leslie3d (avg) 50.99% 355.000 536.000 - -2.90% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -13.79% 29.000 25.000 - 0.00% -
nb_execution_successful -13.79% 29.000 25.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
459.GemsFDTD -2.65% 244728.000 238232.000 - 0.00% -
434.zeusmp -2.56% 152037.000 148143.000 - 0.00% -
410.bwaves -1.67% 16760.000 16480.000 - 0.00% -
444.namd -1.61% 188385.000 185348.000 - 0.00% -
464.h264ref -1.46% 387748.000 382096.000 - 0.00% -
470.lbm -1.44% 9691.000 9551.000 - 0.00% -
435.gromacs -1.39% 499261.000 492297.000 - 0.00% -
437.leslie3d -1.33% 59479.000 58690.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
459.GemsFDTD -15.00% 6173.000 5247.000 - 0.11% -
482.sphinx3 -12.17% 945.000 830.000 - -0.48% -
400.perlbench -5.59% 1663.000 1570.000 - 3.09% -
447.dealII -4.87% 1724.000 1640.000 - -1.74% -
462.libquantum -4.29% 140.000 134.000 - -0.74% -
437.leslie3d -3.25% 11640.000 11262.000 - -1.70% -
416.gamess -2.63% 12465.000 12137.000 - -0.68% -
445.gobmk -2.55% 5023.000 4895.000 - -0.02% -
429.mcf -2.25% 1424.000 1392.000 - -0.07% -
458.sjeng -1.56% 7567.000 7449.000 - 0.16% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
429.mcf (unexplained diff vs previous) (percentage) -99.99% 1305.690 0.070 - -86.00% -
429.mcf (unexplained diff vs previous) -99.99% 18593.000 1.000 - -85.71% -
462.libquantum (unexplained diff vs previous) -99.99% 13518.000 1.000 - -75.00% -
462.libquantum (unexplained diff vs previous) (percentage) -99.99% 9655.710 0.750 - -74.66% -
433.milc (unexplained diff vs previous) -99.99% 11289.000 1.000 - -90.91% -
433.milc (unexplained diff vs previous) (percentage) -99.99% 980.800 0.090 - -90.53% -
444.namd (unexplained diff vs previous) (percentage) -99.99% 1118.610 0.130 - 0.00% -
444.namd (unexplained diff vs previous) -99.99% 8356.000 1.000 - 0.00% -
450.soplex (unexplained diff vs previous) (percentage) -99.99% 2557.320 0.340 - -33.33% -
450.soplex (unexplained diff vs previous) -99.99% 14500.000 2.000 - -33.33% -
482.sphinx3 (unexplained diff vs previous) -99.98% 26073.000 4.000 - -33.33% -
482.sphinx3 (unexplained diff vs previous) (percentage) -99.98% 2759.050 0.480 - -33.33% -
436.cactusADM (unexplained diff vs previous) (percentage) -99.98% 787.130 0.140 - -50.00% -
445.gobmk (unexplained diff vs previous) -99.98% 5581.000 1.000 - 0.00% -
445.gobmk (unexplained diff vs previous) (percentage) -99.98% 111.110 0.020 - 0.00% -
436.cactusADM (unexplained diff vs previous) -99.98% 16396.000 3.000 - -50.00% -
470.lbm (unexplained diff vs previous) -99.97% 9990.000 3.000 - -40.00% -
470.lbm (unexplained diff vs previous) (percentage) -99.97% 263.730 0.080 - -38.46% -
459.GemsFDTD (unexplained diff vs previous) -99.96% 15458.000 6.000 - 0.00% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -99.96% 250.410 0.110 - 0.00% -
453.povray (unexplained diff vs previous) -99.91% 5707.000 5.000 - 0.00% -
453.povray (unexplained diff vs previous) (percentage) -99.91% 1043.330 0.920 - -1.08% -
456.hmmer (unexplained diff vs previous) (percentage) -99.90% 278.630 0.270 - -10.00% -
456.hmmer (unexplained diff vs previous) -99.90% 8030.000 8.000 - -11.11% -
473.astar (unexplained diff vs previous) (percentage) -99.87% 197.850 0.250 - -43.18% -
473.astar (unexplained diff vs previous) -99.87% 10146.000 13.000 - -43.48% -
464.h264ref (unexplained diff vs previous) -99.87% 6843.000 9.000 - 0.00% -
464.h264ref (unexplained diff vs previous) (percentage) -99.87% 118.780 0.160 - 0.00% -
458.sjeng (unexplained diff vs previous) -99.83% 6876.000 12.000 - -58.62% -
458.sjeng (unexplained diff vs previous) (percentage) -99.82% 90.870 0.160 - -58.97% -
434.zeusmp (unexplained diff vs previous) (percentage) -99.77% 448.690 1.020 - 750.00% -
434.zeusmp (unexplained diff vs previous) -99.77% 11280.000 26.000 - 766.67% -
436.cactusADM (max) -99.73% 1848.000 5.000 - 0.00% -
436.cactusADM (max) (percentage) -99.72% 88.730 0.250 - -10.71% -
456.hmmer (max) -99.67% 2120.000 7.000 - -12.50% -
456.hmmer (max) (percentage) -99.63% 73.590 0.270 - -10.00% -
447.dealII (unexplained diff vs previous) -99.59% 7017.000 29.000 - 222.22% -
410.bwaves (unexplained diff vs previous) (percentage) -99.57% 137.900 0.590 - 195.00% -
447.dealII (unexplained diff vs previous) (percentage) -99.57% 407.020 1.770 - 227.78% -
401.bzip2 (unexplained diff vs previous) (percentage) -99.56% 368.340 1.630 - -33.47% -
410.bwaves (unexplained diff vs previous) -99.55% 7794.000 35.000 - 191.67% -
471.omnetpp (unexplained diff vs previous) (percentage) -99.55% 391.300 1.760 - -30.16% -
471.omnetpp (unexplained diff vs previous) -99.55% 10659.000 48.000 - -31.43% -
401.bzip2 (unexplained diff vs previous) -99.55% 10833.000 49.000 - -34.67% -
473.astar (max) (percentage) -99.50% 66.430 0.330 - -25.00% -
473.astar (max) -99.50% 3406.000 17.000 - -22.73% -
470.lbm (max) -99.49% 2746.000 14.000 - -6.67% -
400.perlbench (unexplained diff vs previous) -99.46% 8772.000 47.000 - -6.00% -
470.lbm (max) (percentage) -99.46% 72.510 0.390 - -7.14% -
459.GemsFDTD (max) -99.46% 4411.000 24.000 - -11.11% -
450.soplex (max) -99.45% 545.000 3.000 - 0.00% -
400.perlbench (unexplained diff vs previous) (percentage) -99.43% 527.480 2.990 - -8.84% -
458.sjeng (max) -99.42% 3602.000 21.000 - -32.26% -
450.soplex (max) (percentage) -99.41% 96.240 0.570 - -10.94% -
458.sjeng (max) (percentage) -99.39% 47.610 0.290 - -30.95% -
435.gromacs (unexplained diff vs previous) -99.36% 7028.000 45.000 - 0.00% -
435.gromacs (unexplained diff vs previous) (percentage) -99.36% 96.680 0.620 - 0.00% -
459.GemsFDTD (max) (percentage) -99.36% 71.460 0.460 - -13.21% -
429.mcf (max) -99.32% 1322.000 9.000 - 0.00% -
429.mcf (max) (percentage) -99.30% 92.890 0.650 - -7.14% -
464.h264ref (max) -99.20% 3127.000 25.000 - -13.79% -
464.h264ref (max) (percentage) -99.19% 54.290 0.440 - -13.73% -
444.namd (max) -99.12% 685.000 6.000 - -14.29% -
433.milc (max) -99.04% 1044.000 10.000 - -54.55% -
433.milc (max) (percentage) -99.02% 90.750 0.890 - -54.59% -
454.calculix (max) (percentage) -99.02% 99.730 0.980 - -1.01% -
482.sphinx3 (max) -99.01% 911.000 9.000 - -10.00% -
465.tonto (unexplained diff vs previous) (percentage) -99.01% 16.190 0.160 - 0.00% -
444.namd (max) (percentage) -99.01% 91.790 0.910 - -6.19% -
410.bwaves (max) (percentage) -98.98% 57.970 0.590 - 168.18% -
410.bwaves (max) -98.96% 3276.000 34.000 - 161.54% -
416.gamess (unexplained diff vs previous) -98.94% 7819.000 83.000 - 0.00% -
465.tonto (unexplained diff vs previous) -98.93% 1771.000 19.000 - 0.00% -
416.gamess (unexplained diff vs previous) (percentage) -98.92% 62.730 0.680 - 0.00% -
482.sphinx3 (max) (percentage) -98.80% 96.500 1.160 - -8.66% -
434.zeusmp (max) -98.73% 2055.000 26.000 - 160.00% -
434.zeusmp (max) (percentage) -98.73% 81.770 1.040 - 153.66% -
435.gromacs (max) -98.63% 3573.000 49.000 - -26.87% -
435.gromacs (max) (percentage) -98.62% 49.160 0.680 - -27.66% -
445.gobmk (max) -98.49% 2643.000 40.000 - 0.00% -
445.gobmk (max) (percentage) -98.44% 52.630 0.820 - 0.00% -
481.wrf (max) (percentage) -98.43% 68.700 1.080 - -0.92% -
416.gamess (max) -98.29% 4805.000 82.000 - 583.33% -
416.gamess (max) (percentage) -98.24% 38.550 0.680 - 580.00% -
453.povray (max) -98.00% 499.000 10.000 - 0.00% -
447.dealII (max) -97.98% 1384.000 28.000 - 115.38% -
453.povray (max) (percentage) -97.96% 91.250 1.860 - -6.53% -
447.dealII (max) (percentage) -97.83% 80.280 1.740 - 112.20% -
462.libquantum (max) -97.83% 138.000 3.000 - 0.00% -
462.libquantum (max) (percentage) -97.58% 98.970 2.400 - -16.67% -
483.xalancbmk (max) (percentage) -97.42% 68.670 1.770 - 0.00% -
401.bzip2 (max) (percentage) -97.04% 78.650 2.330 - -7.17% -
401.bzip2 (max) -96.97% 2313.000 70.000 - -7.89% -
471.omnetpp (max) (percentage) -96.96% 79.650 2.420 - -6.20% -
471.omnetpp (max) -96.96% 2169.000 66.000 - -7.04% -
400.perlbench (max) -96.56% 1397.000 48.000 - 0.00% -
400.perlbench (max) (percentage) -96.32% 84.060 3.090 - -2.83% -
465.tonto (max) (percentage) -95.81% 19.310 0.810 - -62.33% -
465.tonto (max) -95.60% 2112.000 93.000 - -62.65% -
403.gcc (max) (percentage) -95.14% 99.360 4.830 - -1.43% -
437.leslie3d (unexplained diff vs previous) -91.57% 2314.000 195.000 - -72.92% -
437.leslie3d (unexplained diff vs previous) (percentage) -91.30% 19.880 1.730 - -72.45% -
416.gamess -82.36% 550.000 97.000 - 0.00% -
416.gamess (avg) -82.36% 550.000 97.000 - 0.00% -
444.namd -82.35% 68.000 12.000 - -7.69% -
444.namd (avg) -82.35% 68.000 12.000 - -7.69% -
456.hmmer (avg) (percentage) -82.31% 4.410 0.780 - -1.27% -
416.gamess (avg) (percentage) -81.90% 4.420 0.800 - 0.00% -
456.hmmer -81.89% 127.000 23.000 - 0.00% -
456.hmmer (avg) -81.89% 127.000 23.000 - 0.00% -
444.namd (avg) (percentage) -81.78% 9.220 1.680 - -1.75% -
470.lbm -80.75% 239.000 46.000 - -2.13% -
470.lbm (avg) -80.75% 239.000 46.000 - -2.13% -
470.lbm (avg) (percentage) -80.41% 6.330 1.240 - -1.59% -
462.libquantum -80.00% 10.000 2.000 - 0.00% -
462.libquantum (avg) -80.00% 10.000 2.000 - 0.00% -
464.h264ref -79.52% 293.000 60.000 - -1.64% -
464.h264ref (avg) -79.52% 293.000 60.000 - -1.64% -
464.h264ref (avg) (percentage) -79.37% 5.090 1.050 - -1.87% -
453.povray -78.57% 42.000 9.000 - 0.00% -
453.povray (avg) -78.57% 42.000 9.000 - 0.00% -
482.sphinx3 -78.38% 74.000 16.000 - 0.00% -
482.sphinx3 (avg) -78.38% 74.000 16.000 - 0.00% -
434.zeusmp -77.55% 147.000 33.000 - 0.00% -
434.zeusmp (avg) -77.55% 147.000 33.000 - 0.00% -
453.povray (avg) (percentage) -77.46% 7.810 1.760 - -0.56% -
434.zeusmp (avg) (percentage) -77.09% 5.850 1.340 - -0.74% -
459.GemsFDTD -76.94% 360.000 83.000 - -1.19% -
459.GemsFDTD (avg) -76.94% 360.000 83.000 - -1.19% -
447.dealII -76.77% 99.000 23.000 - -4.17% -
447.dealII (avg) -76.77% 99.000 23.000 - -4.17% -
462.libquantum (avg) (percentage) -76.37% 7.660 1.810 - -1.09% -
458.sjeng -75.93% 241.000 58.000 - 0.00% -
458.sjeng (avg) -75.93% 241.000 58.000 - 0.00% -
458.sjeng (avg) (percentage) -75.55% 3.190 0.780 - -1.27% -
482.sphinx3 (avg) (percentage) -74.78% 7.930 2.000 - -1.48% -
447.dealII (avg) (percentage) -74.70% 5.770 1.460 - 0.69% -
436.cactusADM -74.19% 124.000 32.000 - -3.03% -
436.cactusADM (avg) -74.19% 124.000 32.000 - -3.03% -
445.gobmk -73.98% 196.000 51.000 - -1.92% -
445.gobmk (avg) -73.98% 196.000 51.000 - -1.92% -
433.milc -73.91% 69.000 18.000 - -5.26% -
433.milc (avg) -73.91% 69.000 18.000 - -5.26% -
436.cactusADM (avg) (percentage) -73.91% 5.980 1.560 - -1.89% -
410.bwaves (avg) (percentage) -73.70% 4.410 1.160 - -1.69% -
433.milc (avg) (percentage) -73.06% 6.050 1.630 - -1.21% -
445.gobmk (avg) (percentage) -72.89% 3.910 1.060 - -1.85% -
459.GemsFDTD (avg) (percentage) -72.77% 5.840 1.590 - -1.85% -
410.bwaves -72.69% 249.000 68.000 - -1.45% -
410.bwaves (avg) -72.69% 249.000 68.000 - -1.45% -
471.omnetpp -71.30% 223.000 64.000 - -1.54% -
471.omnetpp (avg) -71.30% 223.000 64.000 - -1.54% -
471.omnetpp (avg) (percentage) -71.22% 8.200 2.360 - -0.42% -
481.wrf (avg) (percentage) -71.15% 6.240 1.800 - 0.00% -
437.leslie3d (max) -68.95% 1929.000 599.000 - -11.52% -
437.leslie3d (max) (percentage) -67.91% 16.580 5.320 - -9.98% -
400.perlbench -65.71% 105.000 36.000 - 2.86% -
400.perlbench (avg) -65.71% 105.000 36.000 - 2.86% -
401.bzip2 (avg) (percentage) -64.60% 5.480 1.940 - -0.51% -
401.bzip2 -63.98% 161.000 58.000 - -1.69% -
401.bzip2 (avg) -63.98% 161.000 58.000 - -1.69% -
400.perlbench (avg) (percentage) -62.99% 6.350 2.350 - 0.43% -
435.gromacs -61.31% 367.000 142.000 - -0.70% -
435.gromacs (avg) -61.31% 367.000 142.000 - -0.70% -
435.gromacs (avg) (percentage) -61.07% 5.060 1.970 - -1.50% -
450.soplex -58.33% 36.000 15.000 - -6.25% -
450.soplex (avg) -58.33% 36.000 15.000 - -6.25% -
450.soplex (avg) (percentage) -57.54% 6.430 2.730 - -1.80% -
473.astar (avg) (percentage) -56.01% 4.160 1.830 - -1.08% -
473.astar -55.87% 213.000 94.000 - -2.08% -
473.astar (avg) -55.87% 213.000 94.000 - -2.08% -
465.tonto (avg) (percentage) -55.69% 3.340 1.480 - -2.63% -
454.calculix (avg) (percentage) -55.11% 8.020 3.600 - 0.00% -
483.xalancbmk (avg) (percentage) -54.46% 6.500 2.960 - 0.00% -
465.tonto -53.15% 365.000 171.000 - -2.84% -
465.tonto (avg) -53.15% 365.000 171.000 - -2.84% -
403.gcc (avg) (percentage) -30.46% 7.320 5.090 - 0.00% -
429.mcf -21.10% 109.000 86.000 - -2.27% -
429.mcf (avg) -21.10% 109.000 86.000 - -2.27% -
429.mcf (avg) (percentage) -18.77% 7.670 6.230 - -1.42% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 13.79% 29.000 33.000 - 0.00% -

Report Time: 0.38s
Execution (seconds)
Name Current %
400.perlbench 1570.000 3.09%
401.bzip2 3010.000 -1.60%
410.bwaves 5894.000 -
416.gamess 12137.000 -
429.mcf 1392.000 -
433.milc 1158.000 -
434.zeusmp 2537.000 1.04%
435.gromacs 7214.000 -
436.cactusADM 2107.000 -
437.leslie3d 11262.000 -1.70%
444.namd 768.000 -
445.gobmk 4895.000 -
447.dealII 1640.000 -1.74%
450.soplex 583.000 -
453.povray 542.000 -
456.hmmer 2961.000 -
458.sjeng 7449.000 -
459.GemsFDTD 5247.000 -
462.libquantum 134.000 -
464.h264ref 5761.000 -
465.tonto 11604.000 -
470.lbm 3788.000 -
471.omnetpp 2735.000 -1.72%
473.astar 5182.000 -
482.sphinx3 830.000 -
Geometric Mean 2589.009 -
Code Size (bytes)
Name Current %
400.perlbench 890587.000 -
401.bzip2 43919.000 -
410.bwaves 16480.000 -
416.gamess 5700921.000 -
429.mcf 9055.000 -
433.milc 60805.000 -
434.zeusmp 148143.000 -
435.gromacs 492297.000 -
436.cactusADM 350637.000 -
437.leslie3d 58690.000 -
444.namd 185348.000 -
445.gobmk 1383066.000 -
447.dealII 310444.000 -
450.soplex 205303.000 -
453.povray 656269.000 -
456.hmmer 108215.000 -
458.sjeng 103292.000 -
459.GemsFDTD 238232.000 -
462.libquantum 16085.000 -
464.h264ref 382096.000 -
465.tonto 1939926.000 -
470.lbm 9551.000 -
471.omnetpp 479794.000 -
473.astar 22880.000 -
482.sphinx3 112243.000 -
Geometric Mean 159736.912 -
sample variability
Name Current %
400.perlbench 36.000 2.86%
400.perlbench (avg) 36.000 2.86%
400.perlbench (avg) (percentage) 2.350 -
400.perlbench (max) 48.000 -
400.perlbench (max) (percentage) 3.090 -2.83%
400.perlbench (unexplained diff vs previous) 47.000 -6.00%
400.perlbench (unexplained diff vs previous) (percentage) 2.990 -8.84%
401.bzip2 58.000 -1.69%
401.bzip2 (avg) 58.000 -1.69%
401.bzip2 (avg) (percentage) 1.940 -
401.bzip2 (max) 70.000 -7.89%
401.bzip2 (max) (percentage) 2.330 -7.17%
401.bzip2 (unexplained diff vs previous) 49.000 -34.67%
401.bzip2 (unexplained diff vs previous) (percentage) 1.630 -33.47%
403.gcc (avg) (percentage) 5.090 -
403.gcc (max) (percentage) 4.830 -1.43%
410.bwaves 68.000 -1.45%
410.bwaves (avg) 68.000 -1.45%
410.bwaves (avg) (percentage) 1.160 -1.69%
410.bwaves (max) 34.000 161.54%
410.bwaves (max) (percentage) 0.590 168.18%
410.bwaves (unexplained diff vs previous) 35.000 191.67%
410.bwaves (unexplained diff vs previous) (percentage) 0.590 195.00%
416.gamess 97.000 -
416.gamess (avg) 97.000 -
416.gamess (avg) (percentage) 0.800 -
416.gamess (max) 82.000 583.33%
416.gamess (max) (percentage) 0.680 580.00%
416.gamess (unexplained diff vs previous) 83.000 -
416.gamess (unexplained diff vs previous) (percentage) 0.680 -
429.mcf 86.000 -2.27%
429.mcf (avg) 86.000 -2.27%
429.mcf (avg) (percentage) 6.230 -1.42%
429.mcf (max) 9.000 -
429.mcf (max) (percentage) 0.650 -7.14%
429.mcf (unexplained diff vs previous) 1.000 -85.71%
429.mcf (unexplained diff vs previous) (percentage) 0.070 -86.00%
433.milc 18.000 -5.26%
433.milc (avg) 18.000 -5.26%
433.milc (avg) (percentage) 1.630 -1.21%
433.milc (max) 10.000 -54.55%
433.milc (max) (percentage) 0.890 -54.59%
433.milc (unexplained diff vs previous) 1.000 -90.91%
433.milc (unexplained diff vs previous) (percentage) 0.090 -90.53%
434.zeusmp 33.000 -
434.zeusmp (avg) 33.000 -
434.zeusmp (avg) (percentage) 1.340 -
434.zeusmp (max) 26.000 160.00%
434.zeusmp (max) (percentage) 1.040 153.66%
434.zeusmp (unexplained diff vs previous) 26.000 766.67%
434.zeusmp (unexplained diff vs previous) (percentage) 1.020 750.00%
435.gromacs 142.000 -
435.gromacs (avg) 142.000 -
435.gromacs (avg) (percentage) 1.970 -1.50%
435.gromacs (max) 49.000 -26.87%
435.gromacs (max) (percentage) 0.680 -27.66%
435.gromacs (unexplained diff vs previous) 45.000 -
435.gromacs (unexplained diff vs previous) (percentage) 0.620 -
436.cactusADM 32.000 -3.03%
436.cactusADM (avg) 32.000 -3.03%
436.cactusADM (avg) (percentage) 1.560 -1.89%
436.cactusADM (max) 5.000 -
436.cactusADM (max) (percentage) 0.250 -10.71%
436.cactusADM (unexplained diff vs previous) 3.000 -50.00%
436.cactusADM (unexplained diff vs previous) (percentage) 0.140 -50.00%
437.leslie3d 536.000 -2.90%
437.leslie3d (avg) 536.000 -2.90%
437.leslie3d (avg) (percentage) 4.760 -1.24%
437.leslie3d (max) 599.000 -11.52%
437.leslie3d (max) (percentage) 5.320 -9.98%
437.leslie3d (unexplained diff vs previous) 195.000 -72.92%
437.leslie3d (unexplained diff vs previous) (percentage) 1.730 -72.45%
444.namd 12.000 -7.69%
444.namd (avg) 12.000 -7.69%
444.namd (avg) (percentage) 1.680 -1.75%
444.namd (max) 6.000 -14.29%
444.namd (max) (percentage) 0.910 -6.19%
444.namd (unexplained diff vs previous) 1.000 -
444.namd (unexplained diff vs previous) (percentage) 0.130 -
445.gobmk 51.000 -1.92%
445.gobmk (avg) 51.000 -1.92%
445.gobmk (avg) (percentage) 1.060 -1.85%
445.gobmk (max) 40.000 -
445.gobmk (max) (percentage) 0.820 -
445.gobmk (unexplained diff vs previous) 1.000 -
445.gobmk (unexplained diff vs previous) (percentage) 0.020 -
447.dealII 23.000 -4.17%
447.dealII (avg) 23.000 -4.17%
447.dealII (avg) (percentage) 1.460 -
447.dealII (max) 28.000 115.38%
447.dealII (max) (percentage) 1.740 112.20%
447.dealII (unexplained diff vs previous) 29.000 222.22%
447.dealII (unexplained diff vs previous) (percentage) 1.770 227.78%
450.soplex 15.000 -6.25%
450.soplex (avg) 15.000 -6.25%
450.soplex (avg) (percentage) 2.730 -1.80%
450.soplex (max) 3.000 -
450.soplex (max) (percentage) 0.570 -10.94%
450.soplex (unexplained diff vs previous) 2.000 -33.33%
450.soplex (unexplained diff vs previous) (percentage) 0.340 -33.33%
453.povray 9.000 -
453.povray (avg) 9.000 -
453.povray (avg) (percentage) 1.760 -
453.povray (max) 10.000 -
453.povray (max) (percentage) 1.860 -6.53%
453.povray (unexplained diff vs previous) 5.000 -
453.povray (unexplained diff vs previous) (percentage) 0.920 -1.08%
454.calculix (avg) (percentage) 3.600 -
454.calculix (max) (percentage) 0.980 -1.01%
456.hmmer 23.000 -
456.hmmer (avg) 23.000 -
456.hmmer (avg) (percentage) 0.780 -1.27%
456.hmmer (max) 7.000 -12.50%
456.hmmer (max) (percentage) 0.270 -10.00%
456.hmmer (unexplained diff vs previous) 8.000 -11.11%
456.hmmer (unexplained diff vs previous) (percentage) 0.270 -10.00%
458.sjeng 58.000 -
458.sjeng (avg) 58.000 -
458.sjeng (avg) (percentage) 0.780 -1.27%
458.sjeng (max) 21.000 -32.26%
458.sjeng (max) (percentage) 0.290 -30.95%
458.sjeng (unexplained diff vs previous) 12.000 -58.62%
458.sjeng (unexplained diff vs previous) (percentage) 0.160 -58.97%
459.GemsFDTD 83.000 -1.19%
459.GemsFDTD (avg) 83.000 -1.19%
459.GemsFDTD (avg) (percentage) 1.590 -1.85%
459.GemsFDTD (max) 24.000 -11.11%
459.GemsFDTD (max) (percentage) 0.460 -13.21%
459.GemsFDTD (unexplained diff vs previous) 6.000 -
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.110 -
462.libquantum 2.000 -
462.libquantum (avg) 2.000 -
462.libquantum (avg) (percentage) 1.810 -1.09%
462.libquantum (max) 3.000 -
462.libquantum (max) (percentage) 2.400 -16.67%
462.libquantum (unexplained diff vs previous) 1.000 -75.00%
462.libquantum (unexplained diff vs previous) (percentage) 0.750 -74.66%
464.h264ref 60.000 -1.64%
464.h264ref (avg) 60.000 -1.64%
464.h264ref (avg) (percentage) 1.050 -1.87%
464.h264ref (max) 25.000 -13.79%
464.h264ref (max) (percentage) 0.440 -13.73%
464.h264ref (unexplained diff vs previous) 9.000 -
464.h264ref (unexplained diff vs previous) (percentage) 0.160 -
465.tonto 171.000 -2.84%
465.tonto (avg) 171.000 -2.84%
465.tonto (avg) (percentage) 1.480 -2.63%
465.tonto (max) 93.000 -62.65%
465.tonto (max) (percentage) 0.810 -62.33%
465.tonto (unexplained diff vs previous) 19.000 -
465.tonto (unexplained diff vs previous) (percentage) 0.160 -
470.lbm 46.000 -2.13%
470.lbm (avg) 46.000 -2.13%
470.lbm (avg) (percentage) 1.240 -1.59%
470.lbm (max) 14.000 -6.67%
470.lbm (max) (percentage) 0.390 -7.14%
470.lbm (unexplained diff vs previous) 3.000 -40.00%
470.lbm (unexplained diff vs previous) (percentage) 0.080 -38.46%
471.omnetpp 64.000 -1.54%
471.omnetpp (avg) 64.000 -1.54%
471.omnetpp (avg) (percentage) 2.360 -
471.omnetpp (max) 66.000 -7.04%
471.omnetpp (max) (percentage) 2.420 -6.20%
471.omnetpp (unexplained diff vs previous) 48.000 -31.43%
471.omnetpp (unexplained diff vs previous) (percentage) 1.760 -30.16%
473.astar 94.000 -2.08%
473.astar (avg) 94.000 -2.08%
473.astar (avg) (percentage) 1.830 -1.08%
473.astar (max) 17.000 -22.73%
473.astar (max) (percentage) 0.330 -25.00%
473.astar (unexplained diff vs previous) 13.000 -43.48%
473.astar (unexplained diff vs previous) (percentage) 0.250 -43.18%
481.wrf (avg) (percentage) 1.800 -
481.wrf (max) (percentage) 1.080 -
482.sphinx3 16.000 -
482.sphinx3 (avg) 16.000 -
482.sphinx3 (avg) (percentage) 2.000 -1.48%
482.sphinx3 (max) 9.000 -10.00%
482.sphinx3 (max) (percentage) 1.160 -8.66%
482.sphinx3 (unexplained diff vs previous) 4.000 -33.33%
482.sphinx3 (unexplained diff vs previous) (percentage) 0.480 -33.33%
483.xalancbmk (avg) (percentage) 2.960 -
483.xalancbmk (max) (percentage) 1.770 -
Geometric Mean 5.386 -7.54%