Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=e8723b48d9ebbc1d1dd21b2840326c8e871facd7 (+ 34 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/1ae5fc24e86ecc9e7b60346d9ca2e56f83517bda (unchanged)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=4b2a1b602fc1ade0de85084feb328203be3147c9 (+ 5 commits)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/0c5b83b8e0d8ab9a82cb0bdbcc46a1e0ded4345e (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-aarch64-master-Os_LTO-build/270/
View Options
Report
Filter

gnu-aarch64-master-Os_LTO test results

Run Order Start Time Duration
Current 0270 (2-changed-components) 2024-07-10T00:46:14 0:00:00
Previous 0268 (3-changed-components) 2024-07-06T20:31:45 0:00:00
Baseline 0001 (4-changed-components) 2023-02-20T22:48:24 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 101 13
Performance Improvements 37 201
Added Tests 20 0
Unchanged Tests 1078 1022
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
429.mcf 9.44% 1769.000 1936.000 - 35.96% -
473.astar 6.38% 4889.000 5201.000 - 1.42% -
450.soplex 5.64% 550.000 581.000 - 2.47% -
482.sphinx3 5.35% 804.000 847.000 - -10.37% -
462.libquantum 4.55% 132.000 138.000 - -1.43% -
400.perlbench 3.54% 1496.000 1549.000 - -6.86% -
433.milc 3.29% 1123.000 1160.000 - 0.78% -
459.GemsFDTD 3.22% 5214.000 5382.000 - -12.81% -
444.namd 2.74% 767.000 788.000 - 5.49% -
435.gromacs 2.35% 6930.000 7093.000 - -2.42% -
471.omnetpp 2.29% 2660.000 2721.000 - -0.11% -
401.bzip2 2.18% 2933.000 2997.000 - 1.90% -
434.zeusmp 2.14% 2478.000 2531.000 - 0.68% -
465.tonto 2.03% 10852.000 11072.000 - 1.20% -
458.sjeng 1.78% 7286.000 7416.000 - -2.00% -
470.lbm 1.66% 3738.000 3800.000 - 0.32% -
447.dealII 1.42% 1623.000 1646.000 - -4.52% -
453.povray 1.29% 544.000 551.000 - 0.73% -
464.h264ref 1.28% 5715.000 5788.000 - 0.47% -
410.bwaves 1.20% 5834.000 5904.000 - 4.46% -
445.gobmk 1.16% 4810.000 4866.000 - -3.13% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
465.tonto (max) 1500.00% 14.000 224.000 - -89.39% -
465.tonto (max) (percentage) 1461.54% 0.130 2.030 - -89.49% -
473.astar (max) 652.27% 44.000 331.000 - -90.28% -
473.astar (max) (percentage) 601.10% 0.910 6.380 - -90.40% -
401.bzip2 (max) 364.29% 14.000 65.000 - -97.19% -
450.soplex (max) 357.14% 7.000 32.000 - -94.13% -
401.bzip2 (max) (percentage) 344.90% 0.490 2.180 - -97.23% -
464.h264ref (max) 335.29% 17.000 74.000 - -97.63% -
464.h264ref (max) (percentage) 312.90% 0.310 1.280 - -97.64% -
450.soplex (max) (percentage) 311.68% 1.370 5.640 - -94.14% -
482.sphinx3 (max) 221.43% 14.000 45.000 - -95.06% -
445.gobmk (max) 211.11% 18.000 56.000 - -97.88% -
445.gobmk (max) (percentage) 205.26% 0.380 1.160 - -97.80% -
482.sphinx3 (max) (percentage) 193.96% 1.820 5.350 - -94.46% -
444.namd (max) 110.00% 10.000 21.000 - -96.93% -
400.perlbench (max) 107.69% 26.000 54.000 - -96.13% -
400.perlbench (max) (percentage) 102.29% 1.750 3.540 - -95.79% -
444.namd (max) (percentage) 94.33% 1.410 2.740 - -97.01% -
444.namd (unexplained diff vs previous) 90.91% 11.000 21.000 0.000 -99.75% 0.000
444.namd (unexplained diff vs previous) (percentage) 86.01% 1.430 2.660 0.000 -99.76% 0.000
458.sjeng (max) 59.04% 83.000 132.000 - -96.34% -
470.lbm (max) 57.50% 40.000 63.000 - -97.71% -
458.sjeng (max) (percentage) 56.14% 1.140 1.780 - -96.26% -
458.sjeng (unexplained diff vs previous) 54.76% 84.000 130.000 0.000 -98.11% 0.000
470.lbm (max) (percentage) 53.70% 1.080 1.660 - -97.71% -
458.sjeng (unexplained diff vs previous) (percentage) 52.17% 1.150 1.750 0.000 -98.07% 0.000
470.lbm (unexplained diff vs previous) 51.22% 41.000 62.000 0.000 -99.38% 0.000
470.lbm (unexplained diff vs previous) (percentage) 48.18% 1.100 1.630 0.000 -99.38% 0.000
462.libquantum (max) 20.00% 5.000 6.000 - -95.65% -
453.povray (max) 16.67% 6.000 7.000 - -98.60% -
453.povray 12.50% 8.000 9.000 - -78.57% -
453.povray (avg) 12.50% 8.000 9.000 - -78.57% -
429.mcf 11.34% 97.000 108.000 - -0.92% -
429.mcf (avg) 11.34% 97.000 108.000 - -0.92% -
459.GemsFDTD (max) 10.90% 156.000 173.000 - -96.08% -
473.astar 10.39% 77.000 85.000 - -60.09% -
473.astar (avg) 10.39% 77.000 85.000 - -60.09% -
444.namd 10.00% 10.000 11.000 - -83.82% -
444.namd (avg) 10.00% 10.000 11.000 - -83.82% -
450.soplex 7.14% 14.000 15.000 - -58.33% -
450.soplex (avg) 7.14% 14.000 15.000 - -58.33% -
459.GemsFDTD (max) (percentage) 6.98% 3.010 3.220 - -95.49% -
482.sphinx3 6.67% 15.000 16.000 - -78.38% -
482.sphinx3 (avg) 6.67% 15.000 16.000 - -78.38% -
456.hmmer (max) (percentage) 6.67% 0.450 0.480 - -99.35% -
434.zeusmp (max) 5.88% 51.000 54.000 - -97.37% -
459.GemsFDTD 5.19% 77.000 81.000 - -77.50% -
459.GemsFDTD (avg) 5.19% 77.000 81.000 - -77.50% -
462.libquantum (max) (percentage) 4.60% 4.350 4.550 - -95.40% -
458.sjeng 4.08% 49.000 51.000 - -78.84% -
458.sjeng (avg) 4.08% 49.000 51.000 - -78.84% -
401.bzip2 4.00% 50.000 52.000 - -67.70% -
401.bzip2 (avg) 4.00% 50.000 52.000 - -67.70% -
434.zeusmp (max) (percentage) 3.88% 2.060 2.140 - -97.38% -
473.astar (avg) (percentage) 3.77% 1.590 1.650 - -60.34% -
459.GemsFDTD (unexplained diff vs previous) 3.70% 162.000 168.000 0.000 -98.91% 0.000
471.omnetpp 3.28% 61.000 63.000 - -71.75% -
471.omnetpp (avg) 3.28% 61.000 63.000 - -71.75% -
400.perlbench 3.12% 32.000 33.000 - -68.57% -
400.perlbench (avg) 3.12% 32.000 33.000 - -68.57% -
470.lbm 2.78% 36.000 37.000 - -84.52% -
470.lbm (avg) 2.78% 36.000 37.000 - -84.52% -
465.tonto 2.68% 149.000 153.000 - -58.08% -
465.tonto (avg) 2.68% 149.000 153.000 - -58.08% -
482.sphinx3 (avg) (percentage) 2.56% 1.950 2.000 - -74.78% -
453.povray (max) (percentage) 2.38% 1.260 1.290 - -98.59% -
435.gromacs 2.36% 127.000 130.000 - -64.58% -
435.gromacs (avg) 2.36% 127.000 130.000 - -64.58% -
445.gobmk 2.13% 47.000 48.000 - -75.51% -
445.gobmk (avg) 2.13% 47.000 48.000 - -75.51% -
459.GemsFDTD (avg) (percentage) 2.03% 1.480 1.510 - -74.14% -
434.zeusmp (unexplained diff vs previous) 1.92% 52.000 53.000 0.000 -99.53% 0.000
410.bwaves 1.67% 60.000 61.000 - -75.50% -
410.bwaves (avg) 1.67% 60.000 61.000 - -75.50% -
462.libquantum (avg) (percentage) 1.60% 1.870 1.900 - -75.20% -
450.soplex (avg) (percentage) 1.53% 2.620 2.660 - -58.63% -
433.milc (avg) (percentage) 1.49% 1.340 1.360 - -77.52% -
444.namd (avg) (percentage) 1.44% 1.390 1.410 - -84.71% -
429.mcf (avg) (percentage) 1.08% 5.530 5.590 - -27.12% -
470.lbm (avg) (percentage) 1.02% 0.980 0.990 - -84.36% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
436.cactusADM -1.07% 2144.000 2121.000 - 1.82% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
437.leslie3d (unexplained diff vs previous) -85.50% 262.000 38.000 0.000 -98.36% 0.000
437.leslie3d (unexplained diff vs previous) (percentage) -85.36% 2.390 0.350 0.000 -98.24% 0.000
471.omnetpp (unexplained diff vs previous) (percentage) -47.79% 4.290 2.240 0.000 -99.43% 0.000
435.gromacs (unexplained diff vs previous) (percentage) -47.00% 4.340 2.300 0.000 -97.62% 0.000
471.omnetpp (unexplained diff vs previous) -46.49% 114.000 61.000 0.000 -99.43% 0.000
435.gromacs (unexplained diff vs previous) -45.85% 301.000 163.000 0.000 -97.68% 0.000
410.bwaves (unexplained diff vs previous) (percentage) -41.67% 2.040 1.190 0.000 -99.14% 0.000
410.bwaves (unexplained diff vs previous) -41.18% 119.000 70.000 0.000 -99.10% 0.000
429.mcf (unexplained diff vs previous) (percentage) -26.24% 11.700 8.630 0.000 -99.34% 0.000
436.cactusADM (max) -24.14% 29.000 22.000 - -98.81% -
471.omnetpp (max) (percentage) -24.02% 4.870 3.700 - -95.35% -
471.omnetpp (max) -22.48% 129.000 100.000 - -95.39% -
436.cactusADM (max) (percentage) -21.90% 1.370 1.070 - -98.79% -
447.dealII (unexplained diff vs previous) (percentage) -21.79% 1.790 1.400 0.000 -99.66% 0.000
436.cactusADM (unexplained diff vs previous) -20.69% 29.000 23.000 0.000 -99.86% 0.000
447.dealII (unexplained diff vs previous) -20.69% 29.000 23.000 0.000 -99.67% 0.000
436.cactusADM (unexplained diff vs previous) (percentage) -20.00% 1.350 1.080 0.000 -99.86% 0.000
429.mcf (unexplained diff vs previous) -19.32% 207.000 167.000 0.000 -99.10% 0.000
433.milc (unexplained diff vs previous) (percentage) -12.60% 3.650 3.190 0.000 -99.67% 0.000
435.gromacs (max) (percentage) -12.50% 4.160 3.640 - -92.60% -
435.gromacs (max) -10.42% 288.000 258.000 - -92.78% -
447.dealII (max) (percentage) -10.23% 1.760 1.580 - -98.03% -
429.mcf (max) (percentage) -9.92% 10.480 9.440 - -89.84% -
433.milc (unexplained diff vs previous) -9.76% 41.000 37.000 0.000 -99.67% 0.000
437.leslie3d (max) (percentage) -7.37% 8.410 7.790 - -53.02% -
447.dealII (max) -7.14% 28.000 26.000 - -98.12% -
437.leslie3d (max) -7.07% 920.000 855.000 - -55.68% -
410.bwaves (max) (percentage) -7.00% 2.000 1.860 - -96.79% -
433.milc (max) (percentage) -6.53% 3.520 3.290 - -96.37% -
410.bwaves (max) -6.03% 116.000 109.000 - -96.67% -
462.libquantum (unexplained diff vs previous) (percentage) -4.40% 4.550 4.350 0.000 -99.95% 0.000
433.milc (max) -2.56% 39.000 38.000 - -96.36% -
429.mcf (max) -1.62% 185.000 182.000 - -86.23% -
437.leslie3d (avg) (percentage) -1.34% 4.490 4.430 - 45.25% -
437.leslie3d -1.02% 491.000 486.000 - 36.90% -
437.leslie3d (avg) -1.02% 491.000 486.000 - 36.90% -

Added Tests - sample variability
400.perlbench (unexplained diff vs previous)
400.perlbench (unexplained diff vs previous) (percentage)
401.bzip2 (unexplained diff vs previous)
401.bzip2 (unexplained diff vs previous) (percentage)
445.gobmk (unexplained diff vs previous)
445.gobmk (unexplained diff vs previous) (percentage)
450.soplex (unexplained diff vs previous)
450.soplex (unexplained diff vs previous) (percentage)
453.povray (unexplained diff vs previous)
453.povray (unexplained diff vs previous) (percentage)
456.hmmer (unexplained diff vs previous)
456.hmmer (unexplained diff vs previous) (percentage)
464.h264ref (unexplained diff vs previous)
464.h264ref (unexplained diff vs previous) (percentage)
465.tonto (unexplained diff vs previous)
465.tonto (unexplained diff vs previous) (percentage)
473.astar (unexplained diff vs previous)
473.astar (unexplained diff vs previous) (percentage)
482.sphinx3 (unexplained diff vs previous)
482.sphinx3 (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
465.tonto 1.78% 1946163.000 1980710.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
429.mcf 35.96% 1424.000 1936.000 - 9.44% -
444.namd 5.49% 747.000 788.000 - 2.74% -
410.bwaves 4.46% 5652.000 5904.000 - 1.20% -
450.soplex 2.47% 567.000 581.000 - 5.64% -
401.bzip2 1.90% 2941.000 2997.000 - 2.18% -
436.cactusADM 1.82% 2083.000 2121.000 - -1.07% -
473.astar 1.42% 5128.000 5201.000 - 6.38% -
465.tonto 1.20% 10941.000 11072.000 - 2.03% -
456.hmmer 1.18% 2882.000 2916.000 - 0.48% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d (avg) (percentage) 45.25% 3.050 4.430 - -1.34% -
437.leslie3d 36.90% 355.000 486.000 - -1.02% -
437.leslie3d (avg) 36.90% 355.000 486.000 - -1.02% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
459.GemsFDTD -3.66% 244728.000 235768.000 - 0.00% -
434.zeusmp -3.51% 152037.000 146699.000 - 0.00% -
437.leslie3d -2.91% 59479.000 57750.000 - 0.00% -
464.h264ref -2.33% 387748.000 378704.000 - 0.00% -
435.gromacs -1.94% 499261.000 489565.000 - 0.00% -
410.bwaves -1.77% 16760.000 16464.000 - 0.00% -
458.sjeng -1.67% 104048.000 102308.000 - 0.00% -
470.lbm -1.49% 9691.000 9547.000 - 0.00% -
444.namd -1.37% 188385.000 185800.000 - 0.00% -
456.hmmer -1.32% 108691.000 107251.000 - 0.00% -
433.milc -1.26% 61382.000 60609.000 - 0.00% -
436.cactusADM -1.26% 352891.000 348447.000 - 0.00% -
450.soplex -1.20% 205081.000 202626.000 - 0.00% -
401.bzip2 -1.14% 44233.000 43727.000 - 0.00% -
400.perlbench -1.10% 893848.000 884059.000 - 0.00% -
447.dealII -1.01% 311591.000 308448.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
459.GemsFDTD -12.81% 6173.000 5382.000 - 3.22% -
482.sphinx3 -10.37% 945.000 847.000 - 5.35% -
400.perlbench -6.86% 1663.000 1549.000 - 3.54% -
437.leslie3d -5.67% 11640.000 10980.000 - 0.35% -
447.dealII -4.52% 1724.000 1646.000 - 1.42% -
445.gobmk -3.13% 5023.000 4866.000 - 1.16% -
435.gromacs -2.42% 7269.000 7093.000 - 2.35% -
458.sjeng -2.00% 7567.000 7416.000 - 1.78% -
462.libquantum -1.43% 140.000 138.000 - 4.55% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
462.libquantum (unexplained diff vs previous) -99.96% 13518.000 6.000 0.000 0.00% 0.000
462.libquantum (unexplained diff vs previous) (percentage) -99.95% 9655.710 4.350 0.000 -4.40% 0.000
453.povray (unexplained diff vs previous) (percentage) -99.88% 1043.330 1.270 0.000 0.00% 0.000
453.povray (unexplained diff vs previous) -99.88% 5707.000 7.000 0.000 0.00% 0.000
436.cactusADM (unexplained diff vs previous) (percentage) -99.86% 787.130 1.080 0.000 -20.00% 0.000
436.cactusADM (unexplained diff vs previous) -99.86% 16396.000 23.000 0.000 -20.69% 0.000
482.sphinx3 (unexplained diff vs previous) -99.84% 26073.000 43.000 0.000 0.00% 0.000
456.hmmer (unexplained diff vs previous) (percentage) -99.83% 278.630 0.480 0.000 0.00% 0.000
456.hmmer (unexplained diff vs previous) -99.83% 8030.000 14.000 0.000 0.00% 0.000
482.sphinx3 (unexplained diff vs previous) (percentage) -99.82% 2759.050 5.080 0.000 0.00% 0.000
450.soplex (unexplained diff vs previous) (percentage) -99.79% 2557.320 5.340 0.000 0.00% 0.000
450.soplex (unexplained diff vs previous) -99.79% 14500.000 31.000 0.000 0.00% 0.000
444.namd (unexplained diff vs previous) (percentage) -99.76% 1118.610 2.660 0.000 86.01% 0.000
444.namd (unexplained diff vs previous) -99.75% 8356.000 21.000 0.000 90.91% 0.000
433.milc (unexplained diff vs previous) (percentage) -99.67% 980.800 3.190 0.000 -12.60% 0.000
433.milc (unexplained diff vs previous) -99.67% 11289.000 37.000 0.000 -9.76% 0.000
447.dealII (unexplained diff vs previous) -99.67% 7017.000 23.000 0.000 -20.69% 0.000
447.dealII (unexplained diff vs previous) (percentage) -99.66% 407.020 1.400 0.000 -21.79% 0.000
434.zeusmp (unexplained diff vs previous) (percentage) -99.53% 448.690 2.090 0.000 -0.48% 0.000
434.zeusmp (unexplained diff vs previous) -99.53% 11280.000 53.000 0.000 1.92% 0.000
471.omnetpp (unexplained diff vs previous) -99.43% 10659.000 61.000 0.000 -46.49% 0.000
471.omnetpp (unexplained diff vs previous) (percentage) -99.43% 391.300 2.240 0.000 -47.79% 0.000
401.bzip2 (unexplained diff vs previous) (percentage) -99.42% 368.340 2.140 0.000 0.00% 0.000
401.bzip2 (unexplained diff vs previous) -99.41% 10833.000 64.000 0.000 0.00% 0.000
400.perlbench (unexplained diff vs previous) -99.40% 8772.000 53.000 0.000 0.00% 0.000
456.hmmer (max) -99.39% 2120.000 13.000 - 0.00% -
470.lbm (unexplained diff vs previous) (percentage) -99.38% 263.730 1.630 0.000 48.18% 0.000
470.lbm (unexplained diff vs previous) -99.38% 9990.000 62.000 0.000 51.22% 0.000
400.perlbench (unexplained diff vs previous) (percentage) -99.35% 527.480 3.420 0.000 0.00% 0.000
456.hmmer (max) (percentage) -99.35% 73.590 0.480 - 6.67% -
429.mcf (unexplained diff vs previous) (percentage) -99.34% 1305.690 8.630 0.000 -26.24% 0.000
454.calculix (max) (percentage) -99.15% 99.730 0.850 - 0.00% -
410.bwaves (unexplained diff vs previous) (percentage) -99.14% 137.900 1.190 0.000 -41.67% 0.000
410.bwaves (unexplained diff vs previous) -99.10% 7794.000 70.000 0.000 -41.18% 0.000
429.mcf (unexplained diff vs previous) -99.10% 18593.000 167.000 0.000 -19.32% 0.000
445.gobmk (unexplained diff vs previous) -99.00% 5581.000 56.000 0.000 0.00% 0.000
445.gobmk (unexplained diff vs previous) (percentage) -98.96% 111.110 1.150 0.000 0.00% 0.000
416.gamess (max) (percentage) -98.96% 38.550 0.400 - 0.00% -
464.h264ref (unexplained diff vs previous) (percentage) -98.94% 118.780 1.260 0.000 0.00% 0.000
464.h264ref (unexplained diff vs previous) -98.93% 6843.000 73.000 0.000 0.00% 0.000
459.GemsFDTD (unexplained diff vs previous) -98.91% 15458.000 168.000 0.000 3.70% 0.000
436.cactusADM (max) -98.81% 1848.000 22.000 - -24.14% -
436.cactusADM (max) (percentage) -98.79% 88.730 1.070 - -21.90% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -98.75% 250.410 3.120 0.000 0.32% 0.000
481.wrf (max) (percentage) -98.72% 68.700 0.880 - 0.00% -
453.povray (max) -98.60% 499.000 7.000 - 16.67% -
453.povray (max) (percentage) -98.59% 91.250 1.290 - 2.38% -
437.leslie3d (unexplained diff vs previous) -98.36% 2314.000 38.000 0.000 -85.50% 0.000
437.leslie3d (unexplained diff vs previous) (percentage) -98.24% 19.880 0.350 0.000 -85.36% 0.000
447.dealII (max) -98.12% 1384.000 26.000 - -7.14% -
458.sjeng (unexplained diff vs previous) -98.11% 6876.000 130.000 0.000 54.76% 0.000
458.sjeng (unexplained diff vs previous) (percentage) -98.07% 90.870 1.750 0.000 52.17% 0.000
447.dealII (max) (percentage) -98.03% 80.280 1.580 - -10.23% -
445.gobmk (max) -97.88% 2643.000 56.000 - 211.11% -
445.gobmk (max) (percentage) -97.80% 52.630 1.160 - 205.26% -
470.lbm (max) (percentage) -97.71% 72.510 1.660 - 53.70% -
470.lbm (max) -97.71% 2746.000 63.000 - 57.50% -
435.gromacs (unexplained diff vs previous) -97.68% 7028.000 163.000 0.000 -45.85% 0.000
464.h264ref (max) (percentage) -97.64% 54.290 1.280 - 312.90% -
464.h264ref (max) -97.63% 3127.000 74.000 - 335.29% -
435.gromacs (unexplained diff vs previous) (percentage) -97.62% 96.680 2.300 0.000 -47.00% 0.000
483.xalancbmk (max) (percentage) -97.42% 68.670 1.770 - 0.00% -
434.zeusmp (max) (percentage) -97.38% 81.770 2.140 - 3.88% -
434.zeusmp (max) -97.37% 2055.000 54.000 - 5.88% -
401.bzip2 (max) (percentage) -97.23% 78.650 2.180 - 344.90% -
401.bzip2 (max) -97.19% 2313.000 65.000 - 364.29% -
444.namd (max) (percentage) -97.01% 91.790 2.740 - 94.33% -
473.astar (unexplained diff vs previous) (percentage) -96.97% 197.850 6.000 0.000 0.00% 0.000
444.namd (max) -96.93% 685.000 21.000 - 110.00% -
473.astar (unexplained diff vs previous) -96.92% 10146.000 312.000 0.000 0.00% 0.000
410.bwaves (max) (percentage) -96.79% 57.970 1.860 - -7.00% -
410.bwaves (max) -96.67% 3276.000 109.000 - -6.03% -
433.milc (max) (percentage) -96.37% 90.750 3.290 - -6.53% -
433.milc (max) -96.36% 1044.000 38.000 - -2.56% -
458.sjeng (max) -96.34% 3602.000 132.000 - 59.04% -
458.sjeng (max) (percentage) -96.26% 47.610 1.780 - 56.14% -
400.perlbench (max) -96.13% 1397.000 54.000 - 107.69% -
459.GemsFDTD (max) -96.08% 4411.000 173.000 - 10.90% -
403.gcc (max) (percentage) -95.98% 99.360 3.990 - -0.25% -
400.perlbench (max) (percentage) -95.79% 84.060 3.540 - 102.29% -
462.libquantum (max) -95.65% 138.000 6.000 - 20.00% -
459.GemsFDTD (max) (percentage) -95.49% 71.460 3.220 - 6.98% -
462.libquantum (max) (percentage) -95.40% 98.970 4.550 - 4.60% -
471.omnetpp (max) -95.39% 2169.000 100.000 - -22.48% -
471.omnetpp (max) (percentage) -95.35% 79.650 3.700 - -24.02% -
482.sphinx3 (max) -95.06% 911.000 45.000 - 221.43% -
482.sphinx3 (max) (percentage) -94.46% 96.500 5.350 - 193.96% -
450.soplex (max) (percentage) -94.14% 96.240 5.640 - 311.68% -
450.soplex (max) -94.13% 545.000 32.000 - 357.14% -
435.gromacs (max) -92.78% 3573.000 258.000 - -10.42% -
435.gromacs (max) (percentage) -92.60% 49.160 3.640 - -12.50% -
473.astar (max) (percentage) -90.40% 66.430 6.380 - 601.10% -
473.astar (max) -90.28% 3406.000 331.000 - 652.27% -
429.mcf (max) (percentage) -89.84% 92.890 9.440 - -9.92% -
465.tonto (max) (percentage) -89.49% 19.310 2.030 - 1461.54% -
465.tonto (max) -89.39% 2112.000 224.000 - 1500.00% -
465.tonto (unexplained diff vs previous) (percentage) -87.71% 16.190 1.990 0.000 0.00% 0.000
465.tonto (unexplained diff vs previous) -87.58% 1771.000 220.000 0.000 0.00% 0.000
456.hmmer -86.61% 127.000 17.000 - 0.00% -
456.hmmer (avg) -86.61% 127.000 17.000 - 0.00% -
429.mcf (max) -86.23% 1322.000 182.000 - -1.62% -
456.hmmer (avg) (percentage) -86.17% 4.410 0.610 - 0.00% -
444.namd (avg) (percentage) -84.71% 9.220 1.410 - 1.44% -
470.lbm -84.52% 239.000 37.000 - 2.78% -
470.lbm (avg) -84.52% 239.000 37.000 - 2.78% -
470.lbm (avg) (percentage) -84.36% 6.330 0.990 - 1.02% -
444.namd -83.82% 68.000 11.000 - 10.00% -
444.namd (avg) -83.82% 68.000 11.000 - 10.00% -
464.h264ref -83.62% 293.000 48.000 - 0.00% -
464.h264ref (avg) -83.62% 293.000 48.000 - 0.00% -
464.h264ref (avg) (percentage) -83.50% 5.090 0.840 - 0.00% -
416.gamess (avg) (percentage) -82.81% 4.420 0.760 - 0.00% -
434.zeusmp -81.63% 147.000 27.000 - 0.00% -
434.zeusmp (avg) -81.63% 147.000 27.000 - 0.00% -
434.zeusmp (avg) (percentage) -81.20% 5.850 1.100 - 0.92% -
462.libquantum -80.00% 10.000 2.000 - 0.00% -
462.libquantum (avg) -80.00% 10.000 2.000 - 0.00% -
453.povray (avg) (percentage) -79.00% 7.810 1.640 - -0.61% -
458.sjeng -78.84% 241.000 51.000 - 4.08% -
458.sjeng (avg) -78.84% 241.000 51.000 - 4.08% -
447.dealII -78.79% 99.000 21.000 - 0.00% -
447.dealII (avg) -78.79% 99.000 21.000 - 0.00% -
436.cactusADM (avg) (percentage) -78.60% 5.980 1.280 - 0.00% -
453.povray -78.57% 42.000 9.000 - 12.50% -
453.povray (avg) -78.57% 42.000 9.000 - 12.50% -
482.sphinx3 -78.38% 74.000 16.000 - 6.67% -
482.sphinx3 (avg) -78.38% 74.000 16.000 - 6.67% -
458.sjeng (avg) (percentage) -78.37% 3.190 0.690 - 1.47% -
433.milc -78.26% 69.000 15.000 - 0.00% -
433.milc (avg) -78.26% 69.000 15.000 - 0.00% -
436.cactusADM -78.23% 124.000 27.000 - 0.00% -
436.cactusADM (avg) -78.23% 124.000 27.000 - 0.00% -
433.milc (avg) (percentage) -77.52% 6.050 1.360 - 1.49% -
459.GemsFDTD -77.50% 360.000 81.000 - 5.19% -
459.GemsFDTD (avg) -77.50% 360.000 81.000 - 5.19% -
447.dealII (avg) (percentage) -77.47% 5.770 1.300 - 0.00% -
410.bwaves (avg) (percentage) -76.42% 4.410 1.040 - 0.97% -
445.gobmk -75.51% 196.000 48.000 - 2.13% -
445.gobmk (avg) -75.51% 196.000 48.000 - 2.13% -
410.bwaves -75.50% 249.000 61.000 - 1.67% -
410.bwaves (avg) -75.50% 249.000 61.000 - 1.67% -
462.libquantum (avg) (percentage) -75.20% 7.660 1.900 - 1.60% -
482.sphinx3 (avg) (percentage) -74.78% 7.930 2.000 - 2.56% -
445.gobmk (avg) (percentage) -74.68% 3.910 0.990 - 0.00% -
459.GemsFDTD (avg) (percentage) -74.14% 5.840 1.510 - 2.03% -
471.omnetpp -71.75% 223.000 63.000 - 3.28% -
471.omnetpp (avg) -71.75% 223.000 63.000 - 3.28% -
471.omnetpp (avg) (percentage) -71.71% 8.200 2.320 - 0.00% -
481.wrf (avg) (percentage) -71.15% 6.240 1.800 - 0.00% -
400.perlbench -68.57% 105.000 33.000 - 3.12% -
400.perlbench (avg) -68.57% 105.000 33.000 - 3.12% -
401.bzip2 (avg) (percentage) -68.25% 5.480 1.740 - 0.58% -
401.bzip2 -67.70% 161.000 52.000 - 4.00% -
401.bzip2 (avg) -67.70% 161.000 52.000 - 4.00% -
400.perlbench (avg) (percentage) -65.51% 6.350 2.190 - 0.92% -
435.gromacs -64.58% 367.000 130.000 - 2.36% -
435.gromacs (avg) -64.58% 367.000 130.000 - 2.36% -
435.gromacs (avg) (percentage) -63.64% 5.060 1.840 - 0.00% -
473.astar (avg) (percentage) -60.34% 4.160 1.650 - 3.77% -
473.astar -60.09% 213.000 85.000 - 10.39% -
473.astar (avg) -60.09% 213.000 85.000 - 10.39% -
450.soplex (avg) (percentage) -58.63% 6.430 2.660 - 1.53% -
465.tonto (avg) (percentage) -58.38% 3.340 1.390 - 0.72% -
450.soplex -58.33% 36.000 15.000 - 7.14% -
450.soplex (avg) -58.33% 36.000 15.000 - 7.14% -
465.tonto -58.08% 365.000 153.000 - 2.68% -
465.tonto (avg) -58.08% 365.000 153.000 - 2.68% -
437.leslie3d (max) -55.68% 1929.000 855.000 - -7.07% -
454.calculix (avg) (percentage) -55.11% 8.020 3.600 - 0.00% -
483.xalancbmk (avg) (percentage) -54.46% 6.500 2.960 - 0.00% -
437.leslie3d (max) (percentage) -53.02% 16.580 7.790 - -7.37% -
403.gcc (avg) (percentage) -30.46% 7.320 5.090 - 0.00% -
429.mcf (avg) (percentage) -27.12% 7.670 5.590 - 1.08% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 134.48% 29.000 68.000 - 0.00% -
nb_compile_successful 65.52% 29.000 48.000 - 0.00% -
nb_execution_successful 65.52% 29.000 48.000 - 0.00% -

Report Time: 0.38s
Execution (seconds)
Name Current %
400.perlbench 1549.000 3.54%
401.bzip2 2997.000 2.18%
410.bwaves 5904.000 1.20%
429.mcf 1936.000 9.44%
433.milc 1160.000 3.29%
434.zeusmp 2531.000 2.14%
435.gromacs 7093.000 2.35%
436.cactusADM 2121.000 -1.07%
437.leslie3d 10980.000 -
444.namd 788.000 2.74%
445.gobmk 4866.000 1.16%
447.dealII 1646.000 1.42%
450.soplex 581.000 5.64%
453.povray 551.000 1.29%
456.hmmer 2916.000 -
458.sjeng 7416.000 1.78%
459.GemsFDTD 5382.000 3.22%
462.libquantum 138.000 4.55%
464.h264ref 5788.000 1.28%
465.tonto 11072.000 2.03%
470.lbm 3800.000 1.66%
471.omnetpp 2721.000 2.29%
473.astar 5201.000 6.38%
482.sphinx3 847.000 5.35%
Geometric Mean 2461.073 2.67%
Code Size (bytes)
Name Current %
400.perlbench 884059.000 -
401.bzip2 43727.000 -
410.bwaves 16464.000 -
429.mcf 9055.000 -
433.milc 60609.000 -
434.zeusmp 146699.000 -
435.gromacs 489565.000 -
436.cactusADM 348447.000 -
437.leslie3d 57750.000 -
444.namd 185800.000 -
445.gobmk 1379254.000 -
447.dealII 308448.000 -
450.soplex 202626.000 -
453.povray 658161.000 -
456.hmmer 107251.000 -
458.sjeng 102308.000 -
459.GemsFDTD 235768.000 -
462.libquantum 15957.000 -
464.h264ref 378704.000 -
465.tonto 1980710.000 -
470.lbm 9547.000 -
471.omnetpp 475482.000 -
473.astar 22752.000 -
482.sphinx3 111739.000 -
Geometric Mean 136971.309 -
sample variability
Name Current %
400.perlbench 33.000 3.12%
400.perlbench (avg) 33.000 3.12%
400.perlbench (avg) (percentage) 2.190 -
400.perlbench (max) 54.000 107.69%
400.perlbench (max) (percentage) 3.540 102.29%
400.perlbench (unexplained diff vs previous) 53.000 -
400.perlbench (unexplained diff vs previous) (percentage) 3.420 -
401.bzip2 52.000 4.00%
401.bzip2 (avg) 52.000 4.00%
401.bzip2 (avg) (percentage) 1.740 -
401.bzip2 (max) 65.000 364.29%
401.bzip2 (max) (percentage) 2.180 344.90%
401.bzip2 (unexplained diff vs previous) 64.000 -
401.bzip2 (unexplained diff vs previous) (percentage) 2.140 -
403.gcc (avg) (percentage) 5.090 -
403.gcc (max) (percentage) 3.990 -
410.bwaves 61.000 1.67%
410.bwaves (avg) 61.000 1.67%
410.bwaves (avg) (percentage) 1.040 -
410.bwaves (max) 109.000 -6.03%
410.bwaves (max) (percentage) 1.860 -7.00%
410.bwaves (unexplained diff vs previous) 70.000 -41.18%
410.bwaves (unexplained diff vs previous) (percentage) 1.190 -41.67%
416.gamess (avg) (percentage) 0.760 -
416.gamess (max) (percentage) 0.400 -
429.mcf 108.000 11.34%
429.mcf (avg) 108.000 11.34%
429.mcf (avg) (percentage) 5.590 1.08%
429.mcf (max) 182.000 -1.62%
429.mcf (max) (percentage) 9.440 -9.92%
429.mcf (unexplained diff vs previous) 167.000 -19.32%
429.mcf (unexplained diff vs previous) (percentage) 8.630 -26.24%
433.milc 15.000 -
433.milc (avg) 15.000 -
433.milc (avg) (percentage) 1.360 1.49%
433.milc (max) 38.000 -2.56%
433.milc (max) (percentage) 3.290 -6.53%
433.milc (unexplained diff vs previous) 37.000 -9.76%
433.milc (unexplained diff vs previous) (percentage) 3.190 -12.60%
434.zeusmp 27.000 -
434.zeusmp (avg) 27.000 -
434.zeusmp (avg) (percentage) 1.100 -
434.zeusmp (max) 54.000 5.88%
434.zeusmp (max) (percentage) 2.140 3.88%
434.zeusmp (unexplained diff vs previous) 53.000 1.92%
434.zeusmp (unexplained diff vs previous) (percentage) 2.090 -
435.gromacs 130.000 2.36%
435.gromacs (avg) 130.000 2.36%
435.gromacs (avg) (percentage) 1.840 -
435.gromacs (max) 258.000 -10.42%
435.gromacs (max) (percentage) 3.640 -12.50%
435.gromacs (unexplained diff vs previous) 163.000 -45.85%
435.gromacs (unexplained diff vs previous) (percentage) 2.300 -47.00%
436.cactusADM 27.000 -
436.cactusADM (avg) 27.000 -
436.cactusADM (avg) (percentage) 1.280 -
436.cactusADM (max) 22.000 -24.14%
436.cactusADM (max) (percentage) 1.070 -21.90%
436.cactusADM (unexplained diff vs previous) 23.000 -20.69%
436.cactusADM (unexplained diff vs previous) (percentage) 1.080 -20.00%
437.leslie3d 486.000 -1.02%
437.leslie3d (avg) 486.000 -1.02%
437.leslie3d (avg) (percentage) 4.430 -1.34%
437.leslie3d (max) 855.000 -7.07%
437.leslie3d (max) (percentage) 7.790 -7.37%
437.leslie3d (unexplained diff vs previous) 38.000 -85.50%
437.leslie3d (unexplained diff vs previous) (percentage) 0.350 -85.36%
444.namd 11.000 10.00%
444.namd (avg) 11.000 10.00%
444.namd (avg) (percentage) 1.410 1.44%
444.namd (max) 21.000 110.00%
444.namd (max) (percentage) 2.740 94.33%
444.namd (unexplained diff vs previous) 21.000 90.91%
444.namd (unexplained diff vs previous) (percentage) 2.660 86.01%
445.gobmk 48.000 2.13%
445.gobmk (avg) 48.000 2.13%
445.gobmk (avg) (percentage) 0.990 -
445.gobmk (max) 56.000 211.11%
445.gobmk (max) (percentage) 1.160 205.26%
445.gobmk (unexplained diff vs previous) 56.000 -
445.gobmk (unexplained diff vs previous) (percentage) 1.150 -
447.dealII 21.000 -
447.dealII (avg) 21.000 -
447.dealII (avg) (percentage) 1.300 -
447.dealII (max) 26.000 -7.14%
447.dealII (max) (percentage) 1.580 -10.23%
447.dealII (unexplained diff vs previous) 23.000 -20.69%
447.dealII (unexplained diff vs previous) (percentage) 1.400 -21.79%
450.soplex 15.000 7.14%
450.soplex (avg) 15.000 7.14%
450.soplex (avg) (percentage) 2.660 1.53%
450.soplex (max) 32.000 357.14%
450.soplex (max) (percentage) 5.640 311.68%
450.soplex (unexplained diff vs previous) 31.000 -
450.soplex (unexplained diff vs previous) (percentage) 5.340 -
453.povray 9.000 12.50%
453.povray (avg) 9.000 12.50%
453.povray (avg) (percentage) 1.640 -
453.povray (max) 7.000 16.67%
453.povray (max) (percentage) 1.290 2.38%
453.povray (unexplained diff vs previous) 7.000 -
453.povray (unexplained diff vs previous) (percentage) 1.270 -
454.calculix (avg) (percentage) 3.600 -
454.calculix (max) (percentage) 0.850 -
456.hmmer 17.000 -
456.hmmer (avg) 17.000 -
456.hmmer (avg) (percentage) 0.610 -
456.hmmer (max) 13.000 -
456.hmmer (max) (percentage) 0.480 6.67%
456.hmmer (unexplained diff vs previous) 14.000 -
456.hmmer (unexplained diff vs previous) (percentage) 0.480 -
458.sjeng 51.000 4.08%
458.sjeng (avg) 51.000 4.08%
458.sjeng (avg) (percentage) 0.690 -
458.sjeng (max) 132.000 59.04%
458.sjeng (max) (percentage) 1.780 56.14%
458.sjeng (unexplained diff vs previous) 130.000 54.76%
458.sjeng (unexplained diff vs previous) (percentage) 1.750 52.17%
459.GemsFDTD 81.000 5.19%
459.GemsFDTD (avg) 81.000 5.19%
459.GemsFDTD (avg) (percentage) 1.510 2.03%
459.GemsFDTD (max) 173.000 10.90%
459.GemsFDTD (max) (percentage) 3.220 6.98%
459.GemsFDTD (unexplained diff vs previous) 168.000 3.70%
459.GemsFDTD (unexplained diff vs previous) (percentage) 3.120 -
462.libquantum 2.000 -
462.libquantum (avg) 2.000 -
462.libquantum (avg) (percentage) 1.900 1.60%
462.libquantum (max) 6.000 20.00%
462.libquantum (max) (percentage) 4.550 4.60%
462.libquantum (unexplained diff vs previous) 6.000 -
462.libquantum (unexplained diff vs previous) (percentage) 4.350 -4.40%
464.h264ref 48.000 -
464.h264ref (avg) 48.000 -
464.h264ref (avg) (percentage) 0.840 -
464.h264ref (max) 74.000 335.29%
464.h264ref (max) (percentage) 1.280 312.90%
464.h264ref (unexplained diff vs previous) 73.000 -
464.h264ref (unexplained diff vs previous) (percentage) 1.260 -
465.tonto 153.000 2.68%
465.tonto (avg) 153.000 2.68%
465.tonto (avg) (percentage) 1.390 -
465.tonto (max) 224.000 1500.00%
465.tonto (max) (percentage) 2.030 1461.54%
465.tonto (unexplained diff vs previous) 220.000 -
465.tonto (unexplained diff vs previous) (percentage) 1.990 -
470.lbm 37.000 2.78%
470.lbm (avg) 37.000 2.78%
470.lbm (avg) (percentage) 0.990 1.02%
470.lbm (max) 63.000 57.50%
470.lbm (max) (percentage) 1.660 53.70%
470.lbm (unexplained diff vs previous) 62.000 51.22%
470.lbm (unexplained diff vs previous) (percentage) 1.630 48.18%
471.omnetpp 63.000 3.28%
471.omnetpp (avg) 63.000 3.28%
471.omnetpp (avg) (percentage) 2.320 -
471.omnetpp (max) 100.000 -22.48%
471.omnetpp (max) (percentage) 3.700 -24.02%
471.omnetpp (unexplained diff vs previous) 61.000 -46.49%
471.omnetpp (unexplained diff vs previous) (percentage) 2.240 -47.79%
473.astar 85.000 10.39%
473.astar (avg) 85.000 10.39%
473.astar (avg) (percentage) 1.650 3.77%
473.astar (max) 331.000 652.27%
473.astar (max) (percentage) 6.380 601.10%
473.astar (unexplained diff vs previous) 312.000 -
473.astar (unexplained diff vs previous) (percentage) 6.000 -
481.wrf (avg) (percentage) 1.800 -
481.wrf (max) (percentage) 0.880 -
482.sphinx3 16.000 6.67%
482.sphinx3 (avg) 16.000 6.67%
482.sphinx3 (avg) (percentage) 2.000 2.56%
482.sphinx3 (max) 45.000 221.43%
482.sphinx3 (max) (percentage) 5.350 193.96%
482.sphinx3 (unexplained diff vs previous) 43.000 -
482.sphinx3 (unexplained diff vs previous) (percentage) 5.080 -
483.xalancbmk (avg) (percentage) 2.960 -
483.xalancbmk (max) (percentage) 1.770 -
Geometric Mean 10.723 14.57%