Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=0331cd9c511f347e9acf41b8ef2bf1afb63a4a35 (+ 24 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/cea6473e48b4cfbf16f7b4a804f1562f8da8f25b (+ 97 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=910aae6e5a2196938fc30fa54dd1e96f16774ce7 (+ 6 commits)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/d3af75d288b8a0b36df2d7e6b91e4946c03b3473 (+ 141 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-aarch64-master-Os_LTO-build/276/
View Options
Report
Filter

gnu-aarch64-master-Os_LTO test results

Run Order Start Time Duration
Current 0276 (4-changed-components) 2024-07-17T00:21:03 0:00:00
Previous 0275 (4-changed-components) 2024-07-14T17:48:20 0:00:00
Baseline 0001 (4-changed-components) 2023-02-20T22:48:24 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 13 13
Performance Improvements 101 183
Added Tests 6 6
Unchanged Tests 1116 1034
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
462.libquantum 3.73% 134.000 139.000 - -0.71% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
456.hmmer (unexplained diff vs previous) (percentage) 720.00% 0.100 0.820 0.000 -99.71% 0.000
456.hmmer (unexplained diff vs previous) 700.00% 3.000 24.000 0.000 -99.70% 0.000
456.hmmer (max) 200.00% 8.000 24.000 - -98.87% -
456.hmmer (max) (percentage) 173.33% 0.300 0.820 - -98.89% -
462.libquantum (max) 150.00% 2.000 5.000 - -96.38% -
462.libquantum (max) (percentage) 70.32% 2.190 3.730 - -96.23% -
453.povray (unexplained diff vs previous) (percentage) 67.27% 0.550 0.920 0.000 -99.91% 0.000
453.povray (unexplained diff vs previous) 66.67% 3.000 5.000 0.000 -99.91% 0.000
462.libquantum (unexplained diff vs previous) 66.67% 3.000 5.000 0.000 -99.96% 0.000
462.libquantum (unexplained diff vs previous) (percentage) 60.71% 2.240 3.600 0.000 -99.96% 0.000
435.gromacs (avg) (percentage) 1.61% 1.860 1.890 - -62.65% -
462.libquantum (avg) (percentage) 1.61% 1.860 1.890 - -75.33% -

Performance Improvements - Code Size Δ Previous Current σ Δ (B) σ (B)
437.leslie3d -5.11% 57722.000 54774.000 - -7.91% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
435.gromacs -3.23% 7347.000 7110.000 - -2.19% -
471.omnetpp -2.53% 2766.000 2696.000 - -1.03% -
400.perlbench -1.53% 1567.000 1543.000 - -7.22% -
437.leslie3d -1.25% 12114.000 11963.000 - 2.77% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
429.mcf (unexplained diff vs previous) (percentage) -98.85% 8.730 0.100 0.000 -99.99% 0.000
429.mcf (unexplained diff vs previous) -98.82% 169.000 2.000 0.000 -99.99% 0.000
410.bwaves (unexplained diff vs previous) (percentage) -95.38% 1.730 0.080 0.000 -99.94% 0.000
410.bwaves (unexplained diff vs previous) -95.15% 103.000 5.000 0.000 -99.94% 0.000
470.lbm (unexplained diff vs previous) (percentage) -92.53% 1.740 0.130 0.000 -99.95% 0.000
470.lbm (unexplained diff vs previous) -92.42% 66.000 5.000 0.000 -99.95% 0.000
450.soplex (unexplained diff vs previous) (percentage) -78.06% 3.100 0.680 0.000 -99.97% 0.000
450.soplex (unexplained diff vs previous) -77.78% 18.000 4.000 0.000 -99.97% 0.000
482.sphinx3 (unexplained diff vs previous) -77.14% 35.000 8.000 0.000 -99.97% 0.000
482.sphinx3 (unexplained diff vs previous) (percentage) -76.87% 4.150 0.960 0.000 -99.97% 0.000
434.zeusmp (unexplained diff vs previous) -73.47% 49.000 13.000 0.000 -99.88% 0.000
434.zeusmp (unexplained diff vs previous) (percentage) -73.06% 1.930 0.520 0.000 -99.88% 0.000
458.sjeng (unexplained diff vs previous) -68.63% 51.000 16.000 0.000 -99.77% 0.000
458.sjeng (unexplained diff vs previous) (percentage) -68.12% 0.690 0.220 0.000 -99.76% 0.000
458.sjeng (max) -56.44% 101.000 44.000 - -98.78% -
458.sjeng (max) (percentage) -55.80% 1.380 0.610 - -98.72% -
401.bzip2 (unexplained diff vs previous) -54.35% 46.000 21.000 0.000 -99.81% 0.000
401.bzip2 (unexplained diff vs previous) (percentage) -53.85% 1.560 0.720 0.000 -99.80% 0.000
444.namd (max) (percentage) -50.27% 1.830 0.910 - -99.01% -
444.namd (max) -50.00% 14.000 7.000 - -98.98% -
445.gobmk (unexplained diff vs previous) (percentage) -43.07% 1.370 0.780 0.000 -99.30% 0.000
445.gobmk (unexplained diff vs previous) -42.65% 68.000 39.000 0.000 -99.30% 0.000
471.omnetpp (unexplained diff vs previous) -40.17% 117.000 70.000 0.000 -99.34% 0.000
471.omnetpp (unexplained diff vs previous) (percentage) -38.53% 4.230 2.600 0.000 -99.34% 0.000
435.gromacs (unexplained diff vs previous) -35.95% 370.000 237.000 0.000 -96.63% 0.000
435.gromacs (unexplained diff vs previous) (percentage) -33.93% 5.040 3.330 0.000 -96.56% 0.000
436.cactusADM (unexplained diff vs previous) -30.77% 26.000 18.000 0.000 -99.89% 0.000
436.cactusADM (unexplained diff vs previous) (percentage) -30.08% 1.230 0.860 0.000 -99.89% 0.000
433.milc (max) (percentage) -28.52% 2.560 1.830 - -97.98% -
433.milc (max) -27.59% 29.000 21.000 - -97.99% -
471.omnetpp (max) -27.05% 122.000 89.000 - -95.90% -
450.soplex (max) (percentage) -25.53% 3.760 2.800 - -97.09% -
429.mcf (max) -25.41% 185.000 138.000 - -89.56% -
470.lbm (max) -25.37% 67.000 50.000 - -98.18% -
473.astar (max) -25.20% 250.000 187.000 - -94.51% -
473.astar (max) (percentage) -25.05% 4.870 3.650 - -94.51% -
429.mcf (max) (percentage) -25.00% 9.560 7.170 - -92.28% -
410.bwaves (max) -25.00% 104.000 78.000 - -97.62% -
410.bwaves (max) (percentage) -25.00% 1.760 1.320 - -97.72% -
471.omnetpp (max) (percentage) -24.89% 4.420 3.320 - -95.83% -
470.lbm (max) (percentage) -24.86% 1.770 1.330 - -98.17% -
450.soplex (max) -23.81% 21.000 16.000 - -97.06% -
482.sphinx3 (max) -13.89% 36.000 31.000 - -96.60% -
401.bzip2 (max) -13.04% 46.000 40.000 - -98.27% -
435.gromacs (max) -12.85% 389.000 339.000 - -90.51% -
434.zeusmp (max) (percentage) -12.69% 1.970 1.720 - -97.90% -
401.bzip2 (max) (percentage) -12.58% 1.590 1.390 - -98.23% -
482.sphinx3 (max) (percentage) -12.47% 4.330 3.790 - -96.07% -
434.zeusmp (max) -12.24% 49.000 43.000 - -97.91% -
445.gobmk (max) (percentage) -12.23% 1.390 1.220 - -97.68% -
436.cactusADM (max) -12.00% 25.000 22.000 - -98.81% -
445.gobmk (max) -11.76% 68.000 60.000 - -97.73% -
435.gromacs (max) (percentage) -10.00% 5.300 4.770 - -90.30% -
436.cactusADM (max) (percentage) -9.92% 1.210 1.090 - -98.77% -
437.leslie3d (max) -8.24% 1395.000 1280.000 - -33.64% -
453.povray (max) -7.69% 13.000 12.000 - -97.60% -
437.leslie3d (max) (percentage) -7.12% 11.520 10.700 - -35.46% -
400.perlbench (max) -6.41% 78.000 73.000 - -94.77% -
447.dealII (max) -5.88% 34.000 32.000 - -97.69% -
400.perlbench (max) (percentage) -5.57% 5.030 4.750 - -94.35% -
447.dealII (max) (percentage) -5.21% 2.110 2.000 - -97.51% -
465.tonto (max) (percentage) -5.20% 1.730 1.640 - -91.51% -
459.GemsFDTD (max) -4.40% 182.000 174.000 - -96.06% -
465.tonto (max) -4.21% 190.000 182.000 - -91.38% -
453.povray (max) (percentage) -4.13% 2.420 2.320 - -97.46% -
464.h264ref (max) (percentage) -4.00% 1.000 0.960 - -98.23% -
459.GemsFDTD (max) (percentage) -3.82% 3.400 3.270 - -95.42% -
464.h264ref (max) -3.51% 57.000 55.000 - -98.24% -
471.omnetpp -3.12% 64.000 62.000 - -72.20% -
471.omnetpp (avg) -3.12% 64.000 62.000 - -72.20% -
400.perlbench -2.94% 34.000 33.000 - -68.57% -
400.perlbench (avg) -2.94% 34.000 33.000 - -68.57% -
470.lbm -2.70% 37.000 36.000 - -84.94% -
470.lbm (avg) -2.70% 37.000 36.000 - -84.94% -
458.sjeng -2.00% 50.000 49.000 - -79.67% -
458.sjeng (avg) -2.00% 50.000 49.000 - -79.67% -
410.bwaves (avg) (percentage) -1.94% 1.030 1.010 - -77.10% -
429.mcf -1.87% 107.000 105.000 - -3.67% -
429.mcf (avg) -1.87% 107.000 105.000 - -3.67% -
410.bwaves -1.64% 61.000 60.000 - -75.90% -
410.bwaves (avg) -1.64% 61.000 60.000 - -75.90% -
458.sjeng (avg) (percentage) -1.47% 0.680 0.670 - -79.00% -
435.gromacs -1.47% 136.000 134.000 - -63.49% -
435.gromacs (avg) -1.47% 136.000 134.000 - -63.49% -
437.leslie3d -1.31% 536.000 529.000 - 49.01% -
437.leslie3d (avg) -1.31% 536.000 529.000 - 49.01% -
429.mcf (avg) (percentage) -1.26% 5.540 5.470 - -28.68% -
459.GemsFDTD -1.23% 81.000 80.000 - -77.78% -
459.GemsFDTD (avg) -1.23% 81.000 80.000 - -77.78% -
473.astar (avg) (percentage) -1.17% 1.710 1.690 - -59.38% -
481.wrf (max) (percentage) -1.15% 0.870 0.860 - -98.75% -
473.astar -1.15% 87.000 86.000 - -59.62% -
473.astar (avg) -1.15% 87.000 86.000 - -59.62% -
450.soplex (avg) (percentage) -1.14% 2.640 2.610 - -59.41% -
470.lbm (avg) (percentage) -1.02% 0.980 0.970 - -84.68% -
482.sphinx3 (avg) (percentage) -1.00% 2.000 1.980 - -75.03% -

Added Tests - sample variability
433.milc (unexplained diff vs previous)
433.milc (unexplained diff vs previous) (percentage)
444.namd (unexplained diff vs previous)
444.namd (unexplained diff vs previous) (percentage)
473.astar (unexplained diff vs previous)
473.astar (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
458.sjeng 2.24% 104048.000 106376.000 - 0.00% -
465.tonto 1.34% 1946163.000 1972262.000 - -0.41% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
429.mcf 35.81% 1424.000 1934.000 - -0.10% -
410.bwaves 5.15% 5652.000 5943.000 - -0.08% -
444.namd 4.15% 747.000 778.000 - 0.00% -
450.soplex 3.00% 567.000 584.000 - 0.69% -
437.leslie3d 2.77% 11640.000 11963.000 - -1.25% -
456.hmmer 2.01% 2882.000 2940.000 - 0.82% -
465.tonto 1.54% 10941.000 11110.000 - 0.72% -
464.h264ref 1.09% 5761.000 5824.000 - 0.73% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d 49.01% 355.000 529.000 - -1.31% -
437.leslie3d (avg) 49.01% 355.000 529.000 - -1.31% -
437.leslie3d (avg) (percentage) 45.25% 3.050 4.430 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d -7.91% 59479.000 54774.000 - -5.11% -
434.zeusmp -3.55% 152037.000 146647.000 - 0.00% -
459.GemsFDTD -3.24% 244728.000 236796.000 - 0.46% -
464.h264ref -2.37% 387748.000 378568.000 - 0.00% -
435.gromacs -1.97% 499261.000 489445.000 - 0.00% -
410.bwaves -1.77% 16760.000 16464.000 - 0.00% -
470.lbm -1.49% 9691.000 9547.000 - 0.00% -
433.milc -1.42% 61382.000 60513.000 - 0.00% -
456.hmmer -1.34% 108691.000 107239.000 - 0.00% -
436.cactusADM -1.28% 352891.000 348391.000 - 0.00% -
450.soplex -1.21% 205081.000 202590.000 - 0.00% -
462.libquantum -1.19% 16085.000 15893.000 - 0.00% -
401.bzip2 -1.18% 44233.000 43711.000 - 0.00% -
453.povray -1.12% 661389.000 653957.000 - 0.00% -
482.sphinx3 -1.05% 112859.000 111679.000 - 0.00% -
447.dealII -1.01% 311591.000 308436.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
459.GemsFDTD -13.38% 6173.000 5347.000 - -0.63% -
482.sphinx3 -11.64% 945.000 835.000 - -0.95% -
400.perlbench -7.22% 1663.000 1543.000 - -1.53% -
447.dealII -5.05% 1724.000 1637.000 - -0.37% -
458.sjeng -2.56% 7567.000 7373.000 - 0.22% -
435.gromacs -2.19% 7269.000 7110.000 - -3.23% -
471.omnetpp -1.03% 2724.000 2696.000 - -2.53% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
429.mcf (unexplained diff vs previous) (percentage) -99.99% 1305.690 0.100 0.000 -98.85% 0.000
429.mcf (unexplained diff vs previous) -99.99% 18593.000 2.000 0.000 -98.82% 0.000
450.soplex (unexplained diff vs previous) (percentage) -99.97% 2557.320 0.680 0.000 -78.06% 0.000
450.soplex (unexplained diff vs previous) -99.97% 14500.000 4.000 0.000 -77.78% 0.000
482.sphinx3 (unexplained diff vs previous) -99.97% 26073.000 8.000 0.000 -77.14% 0.000
482.sphinx3 (unexplained diff vs previous) (percentage) -99.97% 2759.050 0.960 0.000 -76.87% 0.000
462.libquantum (unexplained diff vs previous) -99.96% 13518.000 5.000 0.000 66.67% 0.000
462.libquantum (unexplained diff vs previous) (percentage) -99.96% 9655.710 3.600 0.000 60.71% 0.000
470.lbm (unexplained diff vs previous) (percentage) -99.95% 263.730 0.130 0.000 -92.53% 0.000
470.lbm (unexplained diff vs previous) -99.95% 9990.000 5.000 0.000 -92.42% 0.000
410.bwaves (unexplained diff vs previous) (percentage) -99.94% 137.900 0.080 0.000 -95.38% 0.000
410.bwaves (unexplained diff vs previous) -99.94% 7794.000 5.000 0.000 -95.15% 0.000
453.povray (unexplained diff vs previous) -99.91% 5707.000 5.000 0.000 66.67% 0.000
453.povray (unexplained diff vs previous) (percentage) -99.91% 1043.330 0.920 0.000 67.27% 0.000
436.cactusADM (unexplained diff vs previous) (percentage) -99.89% 787.130 0.860 0.000 -30.08% 0.000
436.cactusADM (unexplained diff vs previous) -99.89% 16396.000 18.000 0.000 -30.77% 0.000
434.zeusmp (unexplained diff vs previous) -99.88% 11280.000 13.000 0.000 -73.47% 0.000
434.zeusmp (unexplained diff vs previous) (percentage) -99.88% 448.690 0.520 0.000 -73.06% 0.000
401.bzip2 (unexplained diff vs previous) -99.81% 10833.000 21.000 0.000 -54.35% 0.000
401.bzip2 (unexplained diff vs previous) (percentage) -99.80% 368.340 0.720 0.000 -53.85% 0.000
458.sjeng (unexplained diff vs previous) -99.77% 6876.000 16.000 0.000 -68.63% 0.000
458.sjeng (unexplained diff vs previous) (percentage) -99.76% 90.870 0.220 0.000 -68.12% 0.000
456.hmmer (unexplained diff vs previous) (percentage) -99.71% 278.630 0.820 0.000 720.00% 0.000
456.hmmer (unexplained diff vs previous) -99.70% 8030.000 24.000 0.000 700.00% 0.000
471.omnetpp (unexplained diff vs previous) -99.34% 10659.000 70.000 0.000 -40.17% 0.000
471.omnetpp (unexplained diff vs previous) (percentage) -99.34% 391.300 2.600 0.000 -38.53% 0.000
445.gobmk (unexplained diff vs previous) -99.30% 5581.000 39.000 0.000 -42.65% 0.000
445.gobmk (unexplained diff vs previous) (percentage) -99.30% 111.110 0.780 0.000 -43.07% 0.000
454.calculix (max) (percentage) -99.16% 99.730 0.840 - 0.00% -
444.namd (max) (percentage) -99.01% 91.790 0.910 - -50.27% -
416.gamess (max) (percentage) -98.99% 38.550 0.390 - 0.00% -
444.namd (max) -98.98% 685.000 7.000 - -50.00% -
456.hmmer (max) (percentage) -98.89% 73.590 0.820 - 173.33% -
456.hmmer (max) -98.87% 2120.000 24.000 - 200.00% -
436.cactusADM (max) -98.81% 1848.000 22.000 - -12.00% -
458.sjeng (max) -98.78% 3602.000 44.000 - -56.44% -
436.cactusADM (max) (percentage) -98.77% 88.730 1.090 - -9.92% -
481.wrf (max) (percentage) -98.75% 68.700 0.860 - -1.15% -
458.sjeng (max) (percentage) -98.72% 47.610 0.610 - -55.80% -
401.bzip2 (max) -98.27% 2313.000 40.000 - -13.04% -
464.h264ref (max) -98.24% 3127.000 55.000 - -3.51% -
401.bzip2 (max) (percentage) -98.23% 78.650 1.390 - -12.58% -
464.h264ref (max) (percentage) -98.23% 54.290 0.960 - -4.00% -
470.lbm (max) -98.18% 2746.000 50.000 - -25.37% -
470.lbm (max) (percentage) -98.17% 72.510 1.330 - -24.86% -
433.milc (max) -97.99% 1044.000 21.000 - -27.59% -
433.milc (max) (percentage) -97.98% 90.750 1.830 - -28.52% -
434.zeusmp (max) -97.91% 2055.000 43.000 - -12.24% -
434.zeusmp (max) (percentage) -97.90% 81.770 1.720 - -12.69% -
445.gobmk (max) -97.73% 2643.000 60.000 - -11.76% -
410.bwaves (max) (percentage) -97.72% 57.970 1.320 - -25.00% -
447.dealII (max) -97.69% 1384.000 32.000 - -5.88% -
445.gobmk (max) (percentage) -97.68% 52.630 1.220 - -12.23% -
410.bwaves (max) -97.62% 3276.000 78.000 - -25.00% -
453.povray (max) -97.60% 499.000 12.000 - -7.69% -
447.dealII (max) (percentage) -97.51% 80.280 2.000 - -5.21% -
453.povray (max) (percentage) -97.46% 91.250 2.320 - -4.13% -
483.xalancbmk (max) (percentage) -97.42% 68.670 1.770 - 0.00% -
450.soplex (max) (percentage) -97.09% 96.240 2.800 - -25.53% -
450.soplex (max) -97.06% 545.000 16.000 - -23.81% -
435.gromacs (unexplained diff vs previous) -96.63% 7028.000 237.000 0.000 -35.95% 0.000
482.sphinx3 (max) -96.60% 911.000 31.000 - -13.89% -
435.gromacs (unexplained diff vs previous) (percentage) -96.56% 96.680 3.330 0.000 -33.93% 0.000
462.libquantum (max) -96.38% 138.000 5.000 - 150.00% -
462.libquantum (max) (percentage) -96.23% 98.970 3.730 - 70.32% -
482.sphinx3 (max) (percentage) -96.07% 96.500 3.790 - -12.47% -
459.GemsFDTD (max) -96.06% 4411.000 174.000 - -4.40% -
403.gcc (max) (percentage) -96.03% 99.360 3.940 - -0.25% -
471.omnetpp (max) -95.90% 2169.000 89.000 - -27.05% -
471.omnetpp (max) (percentage) -95.83% 79.650 3.320 - -24.89% -
459.GemsFDTD (max) (percentage) -95.42% 71.460 3.270 - -3.82% -
400.perlbench (max) -94.77% 1397.000 73.000 - -6.41% -
473.astar (max) -94.51% 3406.000 187.000 - -25.20% -
473.astar (max) (percentage) -94.51% 66.430 3.650 - -25.05% -
400.perlbench (max) (percentage) -94.35% 84.060 4.750 - -5.57% -
429.mcf (max) (percentage) -92.28% 92.890 7.170 - -25.00% -
465.tonto (max) (percentage) -91.51% 19.310 1.640 - -5.20% -
465.tonto (max) -91.38% 2112.000 182.000 - -4.21% -
435.gromacs (max) -90.51% 3573.000 339.000 - -12.85% -
435.gromacs (max) (percentage) -90.30% 49.160 4.770 - -10.00% -
429.mcf (max) -89.56% 1322.000 138.000 - -25.41% -
456.hmmer -86.61% 127.000 17.000 - 0.00% -
456.hmmer (avg) -86.61% 127.000 17.000 - 0.00% -
456.hmmer (avg) (percentage) -86.39% 4.410 0.600 - 0.00% -
444.namd -85.29% 68.000 10.000 - 0.00% -
444.namd (avg) -85.29% 68.000 10.000 - 0.00% -
444.namd (avg) (percentage) -85.14% 9.220 1.370 - -0.72% -
470.lbm -84.94% 239.000 36.000 - -2.70% -
470.lbm (avg) -84.94% 239.000 36.000 - -2.70% -
470.lbm (avg) (percentage) -84.68% 6.330 0.970 - -1.02% -
464.h264ref -83.96% 293.000 47.000 - 0.00% -
464.h264ref (avg) -83.96% 293.000 47.000 - 0.00% -
464.h264ref (avg) (percentage) -83.89% 5.090 0.820 - 0.00% -
416.gamess (avg) (percentage) -82.81% 4.420 0.760 - 0.00% -
434.zeusmp -81.63% 147.000 27.000 - 0.00% -
434.zeusmp (avg) -81.63% 147.000 27.000 - 0.00% -
434.zeusmp (avg) (percentage) -81.54% 5.850 1.080 - -0.92% -
453.povray -80.95% 42.000 8.000 - 0.00% -
453.povray (avg) -80.95% 42.000 8.000 - 0.00% -
462.libquantum -80.00% 10.000 2.000 - 0.00% -
462.libquantum (avg) -80.00% 10.000 2.000 - 0.00% -
458.sjeng -79.67% 241.000 49.000 - -2.00% -
458.sjeng (avg) -79.67% 241.000 49.000 - -2.00% -
436.cactusADM (avg) (percentage) -79.26% 5.980 1.240 - -0.80% -
453.povray (avg) (percentage) -79.26% 7.810 1.620 - -0.61% -
436.cactusADM -79.03% 124.000 26.000 - 0.00% -
436.cactusADM (avg) -79.03% 124.000 26.000 - 0.00% -
458.sjeng (avg) (percentage) -79.00% 3.190 0.670 - -1.47% -
447.dealII -78.79% 99.000 21.000 - 0.00% -
447.dealII (avg) -78.79% 99.000 21.000 - 0.00% -
482.sphinx3 -78.38% 74.000 16.000 - 0.00% -
482.sphinx3 (avg) -78.38% 74.000 16.000 - 0.00% -
433.milc -78.26% 69.000 15.000 - 0.00% -
433.milc (avg) -78.26% 69.000 15.000 - 0.00% -
433.milc (avg) (percentage) -77.85% 6.050 1.340 - -0.74% -
459.GemsFDTD -77.78% 360.000 80.000 - -1.23% -
459.GemsFDTD (avg) -77.78% 360.000 80.000 - -1.23% -
447.dealII (avg) (percentage) -77.47% 5.770 1.300 - 0.00% -
410.bwaves (avg) (percentage) -77.10% 4.410 1.010 - -1.94% -
410.bwaves -75.90% 249.000 60.000 - -1.64% -
410.bwaves (avg) -75.90% 249.000 60.000 - -1.64% -
445.gobmk -75.51% 196.000 48.000 - 0.00% -
445.gobmk (avg) -75.51% 196.000 48.000 - 0.00% -
462.libquantum (avg) (percentage) -75.33% 7.660 1.890 - 1.61% -
445.gobmk (avg) (percentage) -75.19% 3.910 0.970 - 0.00% -
482.sphinx3 (avg) (percentage) -75.03% 7.930 1.980 - -1.00% -
459.GemsFDTD (avg) (percentage) -74.14% 5.840 1.510 - 0.00% -
471.omnetpp -72.20% 223.000 62.000 - -3.12% -
471.omnetpp (avg) -72.20% 223.000 62.000 - -3.12% -
471.omnetpp (avg) (percentage) -71.71% 8.200 2.320 - 0.00% -
481.wrf (avg) (percentage) -71.15% 6.240 1.800 - 0.00% -
401.bzip2 -69.57% 161.000 49.000 - 0.00% -
401.bzip2 (avg) -69.57% 161.000 49.000 - 0.00% -
401.bzip2 (avg) (percentage) -69.34% 5.480 1.680 - -0.59% -
400.perlbench -68.57% 105.000 33.000 - -2.94% -
400.perlbench (avg) -68.57% 105.000 33.000 - -2.94% -
400.perlbench (avg) (percentage) -65.35% 6.350 2.200 - 0.00% -
435.gromacs -63.49% 367.000 134.000 - -1.47% -
435.gromacs (avg) -63.49% 367.000 134.000 - -1.47% -
435.gromacs (avg) (percentage) -62.65% 5.060 1.890 - 1.61% -
473.astar -59.62% 213.000 86.000 - -1.15% -
473.astar (avg) -59.62% 213.000 86.000 - -1.15% -
450.soplex (avg) (percentage) -59.41% 6.430 2.610 - -1.14% -
473.astar (avg) (percentage) -59.38% 4.160 1.690 - -1.17% -
465.tonto (avg) (percentage) -58.38% 3.340 1.390 - 0.00% -
450.soplex -58.33% 36.000 15.000 - 0.00% -
450.soplex (avg) -58.33% 36.000 15.000 - 0.00% -
465.tonto -57.81% 365.000 154.000 - 0.65% -
465.tonto (avg) -57.81% 365.000 154.000 - 0.65% -
454.calculix (avg) (percentage) -55.11% 8.020 3.600 - 0.00% -
483.xalancbmk (avg) (percentage) -54.46% 6.500 2.960 - 0.00% -
437.leslie3d (max) (percentage) -35.46% 16.580 10.700 - -7.12% -
437.leslie3d (max) -33.64% 1929.000 1280.000 - -8.24% -
403.gcc (avg) (percentage) -30.46% 7.320 5.090 - 0.00% -
429.mcf (avg) (percentage) -28.68% 7.670 5.470 - -1.26% -
429.mcf -3.67% 109.000 105.000 - -1.87% -
429.mcf (avg) -3.67% 109.000 105.000 - -1.87% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 134.48% 29.000 68.000 - 0.00% -
nb_compile_successful 65.52% 29.000 48.000 - 0.00% -
nb_execution_successful 65.52% 29.000 48.000 - 0.00% -

Added Tests - sample variability
433.milc (unexplained diff vs previous)
433.milc (unexplained diff vs previous) (percentage)
444.namd (unexplained diff vs previous)
444.namd (unexplained diff vs previous) (percentage)
473.astar (unexplained diff vs previous)
473.astar (unexplained diff vs previous) (percentage)

Report Time: 0.39s
Execution (seconds)
Name Current %
400.perlbench 1543.000 -1.53%
401.bzip2 2921.000 -
410.bwaves 5943.000 -
429.mcf 1934.000 -
433.milc 1157.000 -
434.zeusmp 2524.000 -
435.gromacs 7110.000 -3.23%
436.cactusADM 2101.000 -
437.leslie3d 11963.000 -1.25%
444.namd 778.000 -
445.gobmk 4988.000 -
447.dealII 1637.000 -
450.soplex 584.000 -
453.povray 544.000 -
456.hmmer 2940.000 -
458.sjeng 7373.000 -
459.GemsFDTD 5347.000 -
462.libquantum 139.000 3.73%
464.h264ref 5824.000 -
465.tonto 11110.000 -
470.lbm 3788.000 -
471.omnetpp 2696.000 -2.53%
473.astar 5144.000 -
482.sphinx3 835.000 -
Geometric Mean 2463.451 -
Code Size (bytes)
Name Current %
400.perlbench 892155.000 -
401.bzip2 43711.000 -
410.bwaves 16464.000 -
429.mcf 9055.000 -
433.milc 60513.000 -
434.zeusmp 146647.000 -
435.gromacs 489445.000 -
436.cactusADM 348391.000 -
437.leslie3d 54774.000 -5.11%
444.namd 189776.000 -
445.gobmk 1374918.000 -
447.dealII 308436.000 -
450.soplex 202590.000 -
453.povray 653957.000 -
456.hmmer 107239.000 -
458.sjeng 106376.000 -
459.GemsFDTD 236796.000 -
462.libquantum 15893.000 -
464.h264ref 378568.000 -
465.tonto 1972262.000 -
470.lbm 9547.000 -
471.omnetpp 475410.000 -
473.astar 22752.000 -
482.sphinx3 111679.000 -
Geometric Mean 136964.388 -
sample variability
Name Current %
400.perlbench 33.000 -2.94%
400.perlbench (avg) 33.000 -2.94%
400.perlbench (avg) (percentage) 2.200 -
400.perlbench (max) 73.000 -6.41%
400.perlbench (max) (percentage) 4.750 -5.57%
401.bzip2 49.000 -
401.bzip2 (avg) 49.000 -
401.bzip2 (avg) (percentage) 1.680 -
401.bzip2 (max) 40.000 -13.04%
401.bzip2 (max) (percentage) 1.390 -12.58%
401.bzip2 (unexplained diff vs previous) 21.000 -54.35%
401.bzip2 (unexplained diff vs previous) (percentage) 0.720 -53.85%
403.gcc (avg) (percentage) 5.090 -
403.gcc (max) (percentage) 3.940 -
410.bwaves 60.000 -1.64%
410.bwaves (avg) 60.000 -1.64%
410.bwaves (avg) (percentage) 1.010 -1.94%
410.bwaves (max) 78.000 -25.00%
410.bwaves (max) (percentage) 1.320 -25.00%
410.bwaves (unexplained diff vs previous) 5.000 -95.15%
410.bwaves (unexplained diff vs previous) (percentage) 0.080 -95.38%
416.gamess (avg) (percentage) 0.760 -
416.gamess (max) (percentage) 0.390 -
429.mcf 105.000 -1.87%
429.mcf (avg) 105.000 -1.87%
429.mcf (avg) (percentage) 5.470 -1.26%
429.mcf (max) 138.000 -25.41%
429.mcf (max) (percentage) 7.170 -25.00%
429.mcf (unexplained diff vs previous) 2.000 -98.82%
429.mcf (unexplained diff vs previous) (percentage) 0.100 -98.85%
433.milc 15.000 -
433.milc (avg) 15.000 -
433.milc (avg) (percentage) 1.340 -
433.milc (max) 21.000 -27.59%
433.milc (max) (percentage) 1.830 -28.52%
433.milc (unexplained diff vs previous) 0.000 -
433.milc (unexplained diff vs previous) (percentage) 0.000 -
434.zeusmp 27.000 -
434.zeusmp (avg) 27.000 -
434.zeusmp (avg) (percentage) 1.080 -
434.zeusmp (max) 43.000 -12.24%
434.zeusmp (max) (percentage) 1.720 -12.69%
434.zeusmp (unexplained diff vs previous) 13.000 -73.47%
434.zeusmp (unexplained diff vs previous) (percentage) 0.520 -73.06%
435.gromacs 134.000 -1.47%
435.gromacs (avg) 134.000 -1.47%
435.gromacs (avg) (percentage) 1.890 1.61%
435.gromacs (max) 339.000 -12.85%
435.gromacs (max) (percentage) 4.770 -10.00%
435.gromacs (unexplained diff vs previous) 237.000 -35.95%
435.gromacs (unexplained diff vs previous) (percentage) 3.330 -33.93%
436.cactusADM 26.000 -
436.cactusADM (avg) 26.000 -
436.cactusADM (avg) (percentage) 1.240 -
436.cactusADM (max) 22.000 -12.00%
436.cactusADM (max) (percentage) 1.090 -9.92%
436.cactusADM (unexplained diff vs previous) 18.000 -30.77%
436.cactusADM (unexplained diff vs previous) (percentage) 0.860 -30.08%
437.leslie3d 529.000 -1.31%
437.leslie3d (avg) 529.000 -1.31%
437.leslie3d (avg) (percentage) 4.430 -
437.leslie3d (max) 1280.000 -8.24%
437.leslie3d (max) (percentage) 10.700 -7.12%
444.namd 10.000 -
444.namd (avg) 10.000 -
444.namd (avg) (percentage) 1.370 -
444.namd (max) 7.000 -50.00%
444.namd (max) (percentage) 0.910 -50.27%
444.namd (unexplained diff vs previous) 0.000 -
444.namd (unexplained diff vs previous) (percentage) 0.000 -
445.gobmk 48.000 -
445.gobmk (avg) 48.000 -
445.gobmk (avg) (percentage) 0.970 -
445.gobmk (max) 60.000 -11.76%
445.gobmk (max) (percentage) 1.220 -12.23%
445.gobmk (unexplained diff vs previous) 39.000 -42.65%
445.gobmk (unexplained diff vs previous) (percentage) 0.780 -43.07%
447.dealII 21.000 -
447.dealII (avg) 21.000 -
447.dealII (avg) (percentage) 1.300 -
447.dealII (max) 32.000 -5.88%
447.dealII (max) (percentage) 2.000 -5.21%
450.soplex 15.000 -
450.soplex (avg) 15.000 -
450.soplex (avg) (percentage) 2.610 -1.14%
450.soplex (max) 16.000 -23.81%
450.soplex (max) (percentage) 2.800 -25.53%
450.soplex (unexplained diff vs previous) 4.000 -77.78%
450.soplex (unexplained diff vs previous) (percentage) 0.680 -78.06%
453.povray 8.000 -
453.povray (avg) 8.000 -
453.povray (avg) (percentage) 1.620 -
453.povray (max) 12.000 -7.69%
453.povray (max) (percentage) 2.320 -4.13%
453.povray (unexplained diff vs previous) 5.000 66.67%
453.povray (unexplained diff vs previous) (percentage) 0.920 67.27%
454.calculix (avg) (percentage) 3.600 -
454.calculix (max) (percentage) 0.840 -
456.hmmer 17.000 -
456.hmmer (avg) 17.000 -
456.hmmer (avg) (percentage) 0.600 -
456.hmmer (max) 24.000 200.00%
456.hmmer (max) (percentage) 0.820 173.33%
456.hmmer (unexplained diff vs previous) 24.000 700.00%
456.hmmer (unexplained diff vs previous) (percentage) 0.820 720.00%
458.sjeng 49.000 -2.00%
458.sjeng (avg) 49.000 -2.00%
458.sjeng (avg) (percentage) 0.670 -1.47%
458.sjeng (max) 44.000 -56.44%
458.sjeng (max) (percentage) 0.610 -55.80%
458.sjeng (unexplained diff vs previous) 16.000 -68.63%
458.sjeng (unexplained diff vs previous) (percentage) 0.220 -68.12%
459.GemsFDTD 80.000 -1.23%
459.GemsFDTD (avg) 80.000 -1.23%
459.GemsFDTD (avg) (percentage) 1.510 -
459.GemsFDTD (max) 174.000 -4.40%
459.GemsFDTD (max) (percentage) 3.270 -3.82%
462.libquantum 2.000 -
462.libquantum (avg) 2.000 -
462.libquantum (avg) (percentage) 1.890 1.61%
462.libquantum (max) 5.000 150.00%
462.libquantum (max) (percentage) 3.730 70.32%
462.libquantum (unexplained diff vs previous) 5.000 66.67%
462.libquantum (unexplained diff vs previous) (percentage) 3.600 60.71%
464.h264ref 47.000 -
464.h264ref (avg) 47.000 -
464.h264ref (avg) (percentage) 0.820 -
464.h264ref (max) 55.000 -3.51%
464.h264ref (max) (percentage) 0.960 -4.00%
465.tonto 154.000 -
465.tonto (avg) 154.000 -
465.tonto (avg) (percentage) 1.390 -
465.tonto (max) 182.000 -4.21%
465.tonto (max) (percentage) 1.640 -5.20%
470.lbm 36.000 -2.70%
470.lbm (avg) 36.000 -2.70%
470.lbm (avg) (percentage) 0.970 -1.02%
470.lbm (max) 50.000 -25.37%
470.lbm (max) (percentage) 1.330 -24.86%
470.lbm (unexplained diff vs previous) 5.000 -92.42%
470.lbm (unexplained diff vs previous) (percentage) 0.130 -92.53%
471.omnetpp 62.000 -3.12%
471.omnetpp (avg) 62.000 -3.12%
471.omnetpp (avg) (percentage) 2.320 -
471.omnetpp (max) 89.000 -27.05%
471.omnetpp (max) (percentage) 3.320 -24.89%
471.omnetpp (unexplained diff vs previous) 70.000 -40.17%
471.omnetpp (unexplained diff vs previous) (percentage) 2.600 -38.53%
473.astar 86.000 -1.15%
473.astar (avg) 86.000 -1.15%
473.astar (avg) (percentage) 1.690 -1.17%
473.astar (max) 187.000 -25.20%
473.astar (max) (percentage) 3.650 -25.05%
473.astar (unexplained diff vs previous) 0.000 -
473.astar (unexplained diff vs previous) (percentage) 0.000 -
481.wrf (avg) (percentage) 1.800 -
481.wrf (max) (percentage) 0.860 -1.15%
482.sphinx3 16.000 -
482.sphinx3 (avg) 16.000 -
482.sphinx3 (avg) (percentage) 1.980 -1.00%
482.sphinx3 (max) 31.000 -13.89%
482.sphinx3 (max) (percentage) 3.790 -12.47%
482.sphinx3 (unexplained diff vs previous) 8.000 -77.14%
482.sphinx3 (unexplained diff vs previous) (percentage) 0.960 -76.87%
483.xalancbmk (avg) (percentage) 2.960 -
483.xalancbmk (max) (percentage) 1.770 -
Geometric Mean 5.298 -47.10%