Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=64a565589c0c79b93b1c222fbba7f27701835ff7 (+ 39 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/027bde11d44d58e6ad473af3a69dc21b451bcbc0 (+ 173 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=32328a5a1461ff88c0b1e04954e9c68b3fa7f56d (+ 25 commits)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/df0f7a976d44c1aa1dc77ac9ae39461013027b2c (+ 165 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-aarch64-master-Os_LTO-build/279/
View Options
Report
Filter

gnu-aarch64-master-Os_LTO test results

Run Order Start Time Duration
Current 0279 (4-changed-components) 2024-07-23T19:57:12 0:00:00
Previous 0277 (3-changed-components) 2024-07-19T15:37:43 0:00:00
Baseline 0001 (4-changed-components) 2023-02-20T22:48:24 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 21 13
Performance Improvements 69 175
Added Tests 10 4
Unchanged Tests 1136 1044
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
400.perlbench 1.94% 1545.000 1575.000 - -5.29% -
450.soplex 1.40% 572.000 580.000 - 2.29% -
471.omnetpp 1.04% 2699.000 2727.000 - 0.11% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
471.omnetpp (unexplained diff vs previous) (percentage) 836.36% 0.110 1.030 0.000 -99.74% 0.000
471.omnetpp (unexplained diff vs previous) 833.33% 3.000 28.000 0.000 -99.74% 0.000
458.sjeng (unexplained diff vs previous) 169.23% 13.000 35.000 0.000 -99.49% 0.000
458.sjeng (unexplained diff vs previous) (percentage) 161.11% 0.180 0.470 0.000 -99.48% 0.000
434.zeusmp (unexplained diff vs previous) 100.00% 9.000 18.000 0.000 -99.84% 0.000
434.zeusmp (unexplained diff vs previous) (percentage) 100.00% 0.360 0.720 0.000 -99.84% 0.000
470.lbm (unexplained diff vs previous) 25.00% 4.000 5.000 0.000 -99.95% 0.000
470.lbm (unexplained diff vs previous) (percentage) 18.18% 0.110 0.130 0.000 -99.95% 0.000
433.milc (unexplained diff vs previous) (percentage) 17.31% 0.520 0.610 0.000 -99.94% 0.000
433.milc (unexplained diff vs previous) 16.67% 6.000 7.000 0.000 -99.94% 0.000
450.soplex 7.14% 14.000 15.000 - -58.33% -
450.soplex (avg) 7.14% 14.000 15.000 - -58.33% -
447.dealII 5.00% 20.000 21.000 - -78.79% -
447.dealII (avg) 5.00% 20.000 21.000 - -78.79% -
400.perlbench 3.03% 33.000 34.000 - -67.62% -
400.perlbench (avg) 3.03% 33.000 34.000 - -67.62% -
473.astar 1.18% 85.000 86.000 - -59.62% -
473.astar (avg) 1.18% 85.000 86.000 - -59.62% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
437.leslie3d -3.38% 11431.000 11045.000 - -5.11% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
429.mcf (max) -97.54% 122.000 3.000 - -99.77% -
429.mcf (max) (percentage) -96.86% 6.370 0.200 - -99.78% -
444.namd (max) -83.33% 6.000 1.000 - -99.85% -
444.namd (max) (percentage) -75.90% 0.830 0.200 - -99.78% -
462.libquantum (unexplained diff vs previous) -75.00% 4.000 1.000 0.000 -99.99% 0.000
462.libquantum (unexplained diff vs previous) (percentage) -74.66% 2.960 0.750 0.000 -99.99% 0.000
435.gromacs (unexplained diff vs previous) (percentage) -62.33% 1.460 0.550 0.000 -99.43% 0.000
435.gromacs (unexplained diff vs previous) -61.90% 105.000 40.000 0.000 -99.43% 0.000
437.leslie3d (unexplained diff vs previous) -27.44% 532.000 386.000 0.000 -83.32% 0.000
462.libquantum (max) -25.00% 4.000 3.000 - -97.83% -
437.leslie3d (unexplained diff vs previous) (percentage) -24.95% 4.650 3.490 0.000 -82.44% 0.000
459.GemsFDTD (max) (percentage) -19.30% 3.160 2.550 - -96.43% -
459.GemsFDTD (max) -18.45% 168.000 137.000 - -96.89% -
462.libquantum (max) (percentage) -9.97% 3.110 2.800 - -97.17% -
456.hmmer (max) (percentage) -9.84% 0.610 0.550 - -99.25% -
437.leslie3d (max) -9.83% 987.000 890.000 - -53.86% -
401.bzip2 (max) (percentage) -8.33% 2.160 1.980 - -97.48% -
453.povray (max) -8.33% 12.000 11.000 - -97.80% -
401.bzip2 (max) -7.81% 64.000 59.000 - -97.45% -
434.zeusmp (max) -7.50% 40.000 37.000 - -98.20% -
458.sjeng (max) -7.32% 41.000 38.000 - -98.95% -
445.gobmk (max) -7.27% 55.000 51.000 - -98.07% -
458.sjeng (max) (percentage) -7.14% 0.560 0.520 - -98.91% -
450.soplex (max) -7.14% 14.000 13.000 - -97.61% -
437.leslie3d (max) (percentage) -6.71% 8.640 8.060 - -51.39% -
447.dealII (max) -6.67% 30.000 28.000 - -97.98% -
473.astar (max) (percentage) -6.46% 3.250 3.040 - -95.42% -
471.omnetpp (max) (percentage) -6.44% 2.950 2.760 - -96.53% -
434.zeusmp (max) (percentage) -6.33% 1.580 1.480 - -98.19% -
445.gobmk (max) (percentage) -6.31% 1.110 1.040 - -98.02% -
450.soplex (max) (percentage) -6.25% 2.560 2.400 - -97.51% -
482.sphinx3 (max) (percentage) -6.07% 3.460 3.250 - -96.63% -
410.bwaves (max) (percentage) -5.98% 1.170 1.100 - -98.10% -
436.cactusADM (max) (percentage) -5.94% 1.010 0.950 - -98.93% -
470.lbm (max) (percentage) -5.93% 1.180 1.110 - -98.47% -
456.hmmer (max) -5.88% 17.000 16.000 - -99.25% -
435.gromacs (max) (percentage) -5.88% 4.420 4.160 - -91.54% -
410.bwaves (max) -5.80% 69.000 65.000 - -98.02% -
473.astar (max) -5.42% 166.000 157.000 - -95.39% -
435.gromacs (max) -5.35% 318.000 301.000 - -91.58% -
433.milc (max) -5.26% 19.000 18.000 - -98.28% -
471.omnetpp (max) -5.06% 79.000 75.000 - -96.54% -
447.dealII (max) (percentage) -4.86% 1.850 1.760 - -97.81% -
436.cactusADM (max) -4.76% 21.000 20.000 - -98.92% -
470.lbm (max) -4.55% 44.000 42.000 - -98.47% -
400.perlbench (max) (percentage) -4.19% 4.530 4.340 - -94.84% -
465.tonto (max) -4.00% 175.000 168.000 - -92.05% -
465.tonto (max) (percentage) -3.82% 1.570 1.510 - -92.18% -
437.leslie3d -3.75% 506.000 487.000 - 37.18% -
437.leslie3d (avg) -3.75% 506.000 487.000 - 37.18% -
434.zeusmp -3.70% 27.000 26.000 - -82.31% -
434.zeusmp (avg) -3.70% 27.000 26.000 - -82.31% -
464.h264ref (max) -3.70% 54.000 52.000 - -98.34% -
482.sphinx3 (max) -3.57% 28.000 27.000 - -97.04% -
453.povray (max) (percentage) -3.13% 2.240 2.170 - -97.62% -
433.milc (max) (percentage) -2.96% 1.690 1.640 - -98.19% -
470.lbm -2.78% 36.000 35.000 - -85.36% -
470.lbm (avg) -2.78% 36.000 35.000 - -85.36% -
464.h264ref (max) (percentage) -2.15% 0.930 0.910 - -98.32% -
458.sjeng -2.04% 49.000 48.000 - -80.08% -
458.sjeng (avg) -2.04% 49.000 48.000 - -80.08% -
458.sjeng (avg) (percentage) -1.49% 0.670 0.660 - -79.31% -
444.namd (avg) (percentage) -1.48% 1.350 1.330 - -85.57% -
400.perlbench (max) -1.45% 69.000 68.000 - -95.13% -
459.GemsFDTD (avg) (percentage) -1.32% 1.510 1.490 - -74.49% -
429.mcf (avg) (percentage) -1.11% 5.400 5.340 - -30.38% -
435.gromacs (avg) (percentage) -1.06% 1.880 1.860 - -63.24% -
470.lbm (avg) (percentage) -1.04% 0.960 0.950 - -84.99% -

Added Tests - sample variability
410.bwaves (unexplained diff vs previous)
410.bwaves (unexplained diff vs previous) (percentage)
429.mcf (unexplained diff vs previous)
429.mcf (unexplained diff vs previous) (percentage)
436.cactusADM (unexplained diff vs previous)
436.cactusADM (unexplained diff vs previous) (percentage)
444.namd (unexplained diff vs previous)
444.namd (unexplained diff vs previous) (percentage)
459.GemsFDTD (unexplained diff vs previous)
459.GemsFDTD (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
458.sjeng 2.24% 104048.000 106376.000 - 0.00% -
465.tonto 1.35% 1946163.000 1972382.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
429.mcf 35.46% 1424.000 1929.000 - 0.00% -
410.bwaves 4.64% 5652.000 5914.000 - -0.34% -
444.namd 3.88% 747.000 776.000 - 0.00% -
436.cactusADM 2.74% 2083.000 2140.000 - 0.14% -
401.bzip2 2.35% 2941.000 3010.000 - 0.87% -
450.soplex 2.29% 567.000 580.000 - 1.40% -
456.hmmer 2.26% 2882.000 2947.000 - 0.41% -
465.tonto 1.69% 10941.000 11126.000 - -0.28% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d (avg) (percentage) 44.59% 3.050 4.410 - -0.45% -
437.leslie3d 37.18% 355.000 487.000 - -3.75% -
437.leslie3d (avg) 37.18% 355.000 487.000 - -3.75% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d -7.91% 59479.000 54774.000 - 0.00% -
459.GemsFDTD -4.90% 244728.000 232736.000 - 0.00% -
434.zeusmp -3.55% 152037.000 146647.000 - 0.00% -
464.h264ref -2.32% 387748.000 378740.000 - 0.05% -
435.gromacs -1.97% 499261.000 489445.000 - 0.00% -
410.bwaves -1.77% 16760.000 16464.000 - 0.00% -
470.lbm -1.49% 9691.000 9547.000 - 0.00% -
433.milc -1.42% 61382.000 60513.000 - 0.00% -
456.hmmer -1.32% 108691.000 107251.000 - 0.01% -
436.cactusADM -1.27% 352891.000 348399.000 - 0.00% -
450.soplex -1.22% 205081.000 202586.000 - -0.00% -
462.libquantum -1.19% 16085.000 15893.000 - 0.00% -
447.dealII -1.18% 311591.000 307904.000 - -0.17% -
401.bzip2 -1.17% 44233.000 43715.000 - 0.01% -
453.povray -1.12% 661389.000 653961.000 - 0.63% -
482.sphinx3 -1.04% 112859.000 111683.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
459.GemsFDTD -12.80% 6173.000 5383.000 - 0.67% -
482.sphinx3 -11.96% 945.000 832.000 - 0.00% -
400.perlbench -5.29% 1663.000 1575.000 - 1.94% -
437.leslie3d -5.11% 11640.000 11045.000 - -3.38% -
447.dealII -4.47% 1724.000 1647.000 - 0.43% -
462.libquantum -4.29% 140.000 134.000 - -0.74% -
458.sjeng -2.27% 7567.000 7395.000 - 0.48% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
462.libquantum (unexplained diff vs previous) -99.99% 13518.000 1.000 0.000 -75.00% 0.000
462.libquantum (unexplained diff vs previous) (percentage) -99.99% 9655.710 0.750 0.000 -74.66% 0.000
436.cactusADM (unexplained diff vs previous) (percentage) -99.98% 787.130 0.140 0.000 0.00% 0.000
436.cactusADM (unexplained diff vs previous) -99.98% 16396.000 3.000 0.000 0.00% 0.000
470.lbm (unexplained diff vs previous) (percentage) -99.95% 263.730 0.130 0.000 18.18% 0.000
470.lbm (unexplained diff vs previous) -99.95% 9990.000 5.000 0.000 25.00% 0.000
433.milc (unexplained diff vs previous) -99.94% 11289.000 7.000 0.000 16.67% 0.000
433.milc (unexplained diff vs previous) (percentage) -99.94% 980.800 0.610 0.000 17.31% 0.000
444.namd (max) -99.85% 685.000 1.000 - -83.33% -
434.zeusmp (unexplained diff vs previous) -99.84% 11280.000 18.000 0.000 100.00% 0.000
434.zeusmp (unexplained diff vs previous) (percentage) -99.84% 448.690 0.720 0.000 100.00% 0.000
429.mcf (max) (percentage) -99.78% 92.890 0.200 - -96.86% -
444.namd (max) (percentage) -99.78% 91.790 0.200 - -75.90% -
429.mcf (max) -99.77% 1322.000 3.000 - -97.54% -
459.GemsFDTD (unexplained diff vs previous) -99.77% 15458.000 36.000 0.000 0.00% 0.000
410.bwaves (unexplained diff vs previous) (percentage) -99.75% 137.900 0.340 0.000 0.00% 0.000
410.bwaves (unexplained diff vs previous) -99.74% 7794.000 20.000 0.000 0.00% 0.000
471.omnetpp (unexplained diff vs previous) -99.74% 10659.000 28.000 0.000 833.33% 0.000
471.omnetpp (unexplained diff vs previous) (percentage) -99.74% 391.300 1.030 0.000 836.36% 0.000
459.GemsFDTD (unexplained diff vs previous) (percentage) -99.73% 250.410 0.670 0.000 0.00% 0.000
458.sjeng (unexplained diff vs previous) -99.49% 6876.000 35.000 0.000 169.23% 0.000
458.sjeng (unexplained diff vs previous) (percentage) -99.48% 90.870 0.470 0.000 161.11% 0.000
435.gromacs (unexplained diff vs previous) (percentage) -99.43% 96.680 0.550 0.000 -62.33% 0.000
435.gromacs (unexplained diff vs previous) -99.43% 7028.000 40.000 0.000 -61.90% 0.000
456.hmmer (max) (percentage) -99.25% 73.590 0.550 - -9.84% -
456.hmmer (max) -99.25% 2120.000 16.000 - -5.88% -
454.calculix (max) (percentage) -99.16% 99.730 0.840 - 0.00% -
416.gamess (max) (percentage) -98.99% 38.550 0.390 - 0.00% -
458.sjeng (max) -98.95% 3602.000 38.000 - -7.32% -
436.cactusADM (max) (percentage) -98.93% 88.730 0.950 - -5.94% -
436.cactusADM (max) -98.92% 1848.000 20.000 - -4.76% -
458.sjeng (max) (percentage) -98.91% 47.610 0.520 - -7.14% -
481.wrf (max) (percentage) -98.75% 68.700 0.860 - 0.00% -
470.lbm (max) -98.47% 2746.000 42.000 - -4.55% -
470.lbm (max) (percentage) -98.47% 72.510 1.110 - -5.93% -
464.h264ref (max) -98.34% 3127.000 52.000 - -3.70% -
464.h264ref (max) (percentage) -98.32% 54.290 0.910 - -2.15% -
433.milc (max) -98.28% 1044.000 18.000 - -5.26% -
434.zeusmp (max) -98.20% 2055.000 37.000 - -7.50% -
433.milc (max) (percentage) -98.19% 90.750 1.640 - -2.96% -
434.zeusmp (max) (percentage) -98.19% 81.770 1.480 - -6.33% -
410.bwaves (max) (percentage) -98.10% 57.970 1.100 - -5.98% -
445.gobmk (max) -98.07% 2643.000 51.000 - -7.27% -
445.gobmk (max) (percentage) -98.02% 52.630 1.040 - -6.31% -
410.bwaves (max) -98.02% 3276.000 65.000 - -5.80% -
447.dealII (max) -97.98% 1384.000 28.000 - -6.67% -
462.libquantum (max) -97.83% 138.000 3.000 - -25.00% -
447.dealII (max) (percentage) -97.81% 80.280 1.760 - -4.86% -
453.povray (max) -97.80% 499.000 11.000 - -8.33% -
453.povray (max) (percentage) -97.62% 91.250 2.170 - -3.13% -
450.soplex (max) -97.61% 545.000 13.000 - -7.14% -
450.soplex (max) (percentage) -97.51% 96.240 2.400 - -6.25% -
401.bzip2 (max) (percentage) -97.48% 78.650 1.980 - -8.33% -
401.bzip2 (max) -97.45% 2313.000 59.000 - -7.81% -
483.xalancbmk (max) (percentage) -97.42% 68.670 1.770 - 0.00% -
462.libquantum (max) (percentage) -97.17% 98.970 2.800 - -9.97% -
482.sphinx3 (max) -97.04% 911.000 27.000 - -3.57% -
459.GemsFDTD (max) -96.89% 4411.000 137.000 - -18.45% -
482.sphinx3 (max) (percentage) -96.63% 96.500 3.250 - -6.07% -
471.omnetpp (max) -96.54% 2169.000 75.000 - -5.06% -
471.omnetpp (max) (percentage) -96.53% 79.650 2.760 - -6.44% -
459.GemsFDTD (max) (percentage) -96.43% 71.460 2.550 - -19.30% -
403.gcc (max) (percentage) -96.04% 99.360 3.930 - 0.00% -
473.astar (max) (percentage) -95.42% 66.430 3.040 - -6.46% -
473.astar (max) -95.39% 3406.000 157.000 - -5.42% -
400.perlbench (max) -95.13% 1397.000 68.000 - -1.45% -
400.perlbench (max) (percentage) -94.84% 84.060 4.340 - -4.19% -
465.tonto (max) (percentage) -92.18% 19.310 1.510 - -3.82% -
465.tonto (max) -92.05% 2112.000 168.000 - -4.00% -
435.gromacs (max) -91.58% 3573.000 301.000 - -5.35% -
435.gromacs (max) (percentage) -91.54% 49.160 4.160 - -5.88% -
456.hmmer (avg) (percentage) -86.62% 4.410 0.590 - 0.00% -
456.hmmer -86.61% 127.000 17.000 - 0.00% -
456.hmmer (avg) -86.61% 127.000 17.000 - 0.00% -
444.namd (avg) (percentage) -85.57% 9.220 1.330 - -1.48% -
470.lbm -85.36% 239.000 35.000 - -2.78% -
470.lbm (avg) -85.36% 239.000 35.000 - -2.78% -
444.namd -85.29% 68.000 10.000 - 0.00% -
444.namd (avg) -85.29% 68.000 10.000 - 0.00% -
470.lbm (avg) (percentage) -84.99% 6.330 0.950 - -1.04% -
464.h264ref -83.96% 293.000 47.000 - 0.00% -
464.h264ref (avg) -83.96% 293.000 47.000 - 0.00% -
464.h264ref (avg) (percentage) -83.89% 5.090 0.820 - 0.00% -
437.leslie3d (unexplained diff vs previous) -83.32% 2314.000 386.000 0.000 -27.44% 0.000
416.gamess (avg) (percentage) -82.81% 4.420 0.760 - 0.00% -
437.leslie3d (unexplained diff vs previous) (percentage) -82.44% 19.880 3.490 0.000 -24.95% 0.000
434.zeusmp -82.31% 147.000 26.000 - -3.70% -
434.zeusmp (avg) -82.31% 147.000 26.000 - -3.70% -
434.zeusmp (avg) (percentage) -81.88% 5.850 1.060 - -0.93% -
453.povray -80.95% 42.000 8.000 - 0.00% -
453.povray (avg) -80.95% 42.000 8.000 - 0.00% -
458.sjeng -80.08% 241.000 48.000 - -2.04% -
458.sjeng (avg) -80.08% 241.000 48.000 - -2.04% -
462.libquantum -80.00% 10.000 2.000 - 0.00% -
462.libquantum (avg) -80.00% 10.000 2.000 - 0.00% -
436.cactusADM (avg) (percentage) -79.43% 5.980 1.230 - -0.81% -
458.sjeng (avg) (percentage) -79.31% 3.190 0.660 - -1.49% -
453.povray (avg) (percentage) -79.26% 7.810 1.620 - 0.00% -
436.cactusADM -79.03% 124.000 26.000 - 0.00% -
436.cactusADM (avg) -79.03% 124.000 26.000 - 0.00% -
447.dealII -78.79% 99.000 21.000 - 5.00% -
447.dealII (avg) -78.79% 99.000 21.000 - 5.00% -
482.sphinx3 -78.38% 74.000 16.000 - 0.00% -
482.sphinx3 (avg) -78.38% 74.000 16.000 - 0.00% -
433.milc -78.26% 69.000 15.000 - 0.00% -
433.milc (avg) -78.26% 69.000 15.000 - 0.00% -
433.milc (avg) (percentage) -78.18% 6.050 1.320 - -0.75% -
447.dealII (avg) (percentage) -77.82% 5.770 1.280 - 0.00% -
459.GemsFDTD -77.78% 360.000 80.000 - 0.00% -
459.GemsFDTD (avg) -77.78% 360.000 80.000 - 0.00% -
410.bwaves (avg) (percentage) -77.32% 4.410 1.000 - -0.99% -
410.bwaves -76.31% 249.000 59.000 - 0.00% -
410.bwaves (avg) -76.31% 249.000 59.000 - 0.00% -
445.gobmk -76.02% 196.000 47.000 - 0.00% -
445.gobmk (avg) -76.02% 196.000 47.000 - 0.00% -
445.gobmk (avg) (percentage) -75.45% 3.910 0.960 - 0.00% -
462.libquantum (avg) (percentage) -75.33% 7.660 1.890 - -0.53% -
482.sphinx3 (avg) (percentage) -75.28% 7.930 1.960 - 0.00% -
459.GemsFDTD (avg) (percentage) -74.49% 5.840 1.490 - -1.32% -
471.omnetpp -72.20% 223.000 62.000 - 0.00% -
471.omnetpp (avg) -72.20% 223.000 62.000 - 0.00% -
471.omnetpp (avg) (percentage) -72.20% 8.200 2.280 - -0.87% -
481.wrf (avg) (percentage) -71.15% 6.240 1.800 - 0.00% -
401.bzip2 (avg) (percentage) -69.34% 5.480 1.680 - 0.00% -
401.bzip2 -68.94% 161.000 50.000 - 0.00% -
401.bzip2 (avg) -68.94% 161.000 50.000 - 0.00% -
400.perlbench -67.62% 105.000 34.000 - 3.03% -
400.perlbench (avg) -67.62% 105.000 34.000 - 3.03% -
400.perlbench (avg) (percentage) -65.35% 6.350 2.200 - 0.00% -
435.gromacs -63.49% 367.000 134.000 - -0.74% -
435.gromacs (avg) -63.49% 367.000 134.000 - -0.74% -
435.gromacs (avg) (percentage) -63.24% 5.060 1.860 - -1.06% -
473.astar (avg) (percentage) -59.86% 4.160 1.670 - 0.00% -
473.astar -59.62% 213.000 86.000 - 1.18% -
473.astar (avg) -59.62% 213.000 86.000 - 1.18% -
450.soplex (avg) (percentage) -59.41% 6.430 2.610 - 0.00% -
465.tonto (avg) (percentage) -58.38% 3.340 1.390 - 0.00% -
450.soplex -58.33% 36.000 15.000 - 7.14% -
450.soplex (avg) -58.33% 36.000 15.000 - 7.14% -
465.tonto -57.81% 365.000 154.000 - -0.65% -
465.tonto (avg) -57.81% 365.000 154.000 - -0.65% -
454.calculix (avg) (percentage) -55.11% 8.020 3.600 - 0.00% -
483.xalancbmk (avg) (percentage) -54.46% 6.500 2.960 - 0.00% -
437.leslie3d (max) -53.86% 1929.000 890.000 - -9.83% -
437.leslie3d (max) (percentage) -51.39% 16.580 8.060 - -6.71% -
403.gcc (avg) (percentage) -30.46% 7.320 5.090 - 0.00% -
429.mcf (avg) (percentage) -30.38% 7.670 5.340 - -1.11% -
429.mcf -5.50% 109.000 103.000 - -0.96% -
429.mcf (avg) -5.50% 109.000 103.000 - -0.96% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 134.48% 29.000 68.000 - 0.00% -
nb_compile_successful 65.52% 29.000 48.000 - 0.00% -
nb_execution_successful 65.52% 29.000 48.000 - 0.00% -

Added Tests - sample variability
429.mcf (unexplained diff vs previous)
429.mcf (unexplained diff vs previous) (percentage)
444.namd (unexplained diff vs previous)
444.namd (unexplained diff vs previous) (percentage)

Report Time: 0.39s
Execution (seconds)
Name Current %
400.perlbench 1575.000 1.94%
401.bzip2 3010.000 -
410.bwaves 5914.000 -
429.mcf 1929.000 -
433.milc 1156.000 -
434.zeusmp 2515.000 -
435.gromacs 7255.000 -
436.cactusADM 2140.000 -
437.leslie3d 11045.000 -3.38%
444.namd 776.000 -
445.gobmk 4976.000 -
447.dealII 1647.000 -
450.soplex 580.000 1.40%
453.povray 551.000 -
456.hmmer 2947.000 -
458.sjeng 7395.000 -
459.GemsFDTD 5383.000 -
462.libquantum 134.000 -
464.h264ref 5793.000 -
465.tonto 11126.000 -
470.lbm 3787.000 -
471.omnetpp 2727.000 1.04%
473.astar 5176.000 -
482.sphinx3 832.000 -
Geometric Mean 2462.393 -
Code Size (bytes)
Name Current %
400.perlbench 888091.000 -
401.bzip2 43715.000 -
410.bwaves 16464.000 -
429.mcf 9055.000 -
433.milc 60513.000 -
434.zeusmp 146647.000 -
435.gromacs 489445.000 -
436.cactusADM 348399.000 -
437.leslie3d 54774.000 -
444.namd 189776.000 -
445.gobmk 1374946.000 -
447.dealII 307904.000 -
450.soplex 202586.000 -
453.povray 653961.000 -
456.hmmer 107251.000 -
458.sjeng 106376.000 -
459.GemsFDTD 232736.000 -
462.libquantum 15893.000 -
464.h264ref 378740.000 -
465.tonto 1972382.000 -
470.lbm 9547.000 -
471.omnetpp 475414.000 -
473.astar 22756.000 -
482.sphinx3 111683.000 -
Geometric Mean 136835.371 -
sample variability
Name Current %
400.perlbench 34.000 3.03%
400.perlbench (avg) 34.000 3.03%
400.perlbench (avg) (percentage) 2.200 -
400.perlbench (max) 68.000 -1.45%
400.perlbench (max) (percentage) 4.340 -4.19%
401.bzip2 50.000 -
401.bzip2 (avg) 50.000 -
401.bzip2 (avg) (percentage) 1.680 -
401.bzip2 (max) 59.000 -7.81%
401.bzip2 (max) (percentage) 1.980 -8.33%
403.gcc (avg) (percentage) 5.090 -
403.gcc (max) (percentage) 3.930 -
410.bwaves 59.000 -
410.bwaves (avg) 59.000 -
410.bwaves (avg) (percentage) 1.000 -
410.bwaves (max) 65.000 -5.80%
410.bwaves (max) (percentage) 1.100 -5.98%
410.bwaves (unexplained diff vs previous) 20.000 -
410.bwaves (unexplained diff vs previous) (percentage) 0.340 -
416.gamess (avg) (percentage) 0.760 -
416.gamess (max) (percentage) 0.390 -
429.mcf 103.000 -
429.mcf (avg) 103.000 -
429.mcf (avg) (percentage) 5.340 -1.11%
429.mcf (max) 3.000 -97.54%
429.mcf (max) (percentage) 0.200 -96.86%
429.mcf (unexplained diff vs previous) 0.000 -
429.mcf (unexplained diff vs previous) (percentage) 0.000 -
433.milc 15.000 -
433.milc (avg) 15.000 -
433.milc (avg) (percentage) 1.320 -
433.milc (max) 18.000 -5.26%
433.milc (max) (percentage) 1.640 -2.96%
433.milc (unexplained diff vs previous) 7.000 16.67%
433.milc (unexplained diff vs previous) (percentage) 0.610 17.31%
434.zeusmp 26.000 -3.70%
434.zeusmp (avg) 26.000 -3.70%
434.zeusmp (avg) (percentage) 1.060 -
434.zeusmp (max) 37.000 -7.50%
434.zeusmp (max) (percentage) 1.480 -6.33%
434.zeusmp (unexplained diff vs previous) 18.000 100.00%
434.zeusmp (unexplained diff vs previous) (percentage) 0.720 100.00%
435.gromacs 134.000 -
435.gromacs (avg) 134.000 -
435.gromacs (avg) (percentage) 1.860 -1.06%
435.gromacs (max) 301.000 -5.35%
435.gromacs (max) (percentage) 4.160 -5.88%
435.gromacs (unexplained diff vs previous) 40.000 -61.90%
435.gromacs (unexplained diff vs previous) (percentage) 0.550 -62.33%
436.cactusADM 26.000 -
436.cactusADM (avg) 26.000 -
436.cactusADM (avg) (percentage) 1.230 -
436.cactusADM (max) 20.000 -4.76%
436.cactusADM (max) (percentage) 0.950 -5.94%
436.cactusADM (unexplained diff vs previous) 3.000 -
436.cactusADM (unexplained diff vs previous) (percentage) 0.140 -
437.leslie3d 487.000 -3.75%
437.leslie3d (avg) 487.000 -3.75%
437.leslie3d (avg) (percentage) 4.410 -
437.leslie3d (max) 890.000 -9.83%
437.leslie3d (max) (percentage) 8.060 -6.71%
437.leslie3d (unexplained diff vs previous) 386.000 -27.44%
437.leslie3d (unexplained diff vs previous) (percentage) 3.490 -24.95%
444.namd 10.000 -
444.namd (avg) 10.000 -
444.namd (avg) (percentage) 1.330 -1.48%
444.namd (max) 1.000 -83.33%
444.namd (max) (percentage) 0.200 -75.90%
444.namd (unexplained diff vs previous) 0.000 -
444.namd (unexplained diff vs previous) (percentage) 0.000 -
445.gobmk 47.000 -
445.gobmk (avg) 47.000 -
445.gobmk (avg) (percentage) 0.960 -
445.gobmk (max) 51.000 -7.27%
445.gobmk (max) (percentage) 1.040 -6.31%
447.dealII 21.000 5.00%
447.dealII (avg) 21.000 5.00%
447.dealII (avg) (percentage) 1.280 -
447.dealII (max) 28.000 -6.67%
447.dealII (max) (percentage) 1.760 -4.86%
450.soplex 15.000 7.14%
450.soplex (avg) 15.000 7.14%
450.soplex (avg) (percentage) 2.610 -
450.soplex (max) 13.000 -7.14%
450.soplex (max) (percentage) 2.400 -6.25%
453.povray 8.000 -
453.povray (avg) 8.000 -
453.povray (avg) (percentage) 1.620 -
453.povray (max) 11.000 -8.33%
453.povray (max) (percentage) 2.170 -3.13%
454.calculix (avg) (percentage) 3.600 -
454.calculix (max) (percentage) 0.840 -
456.hmmer 17.000 -
456.hmmer (avg) 17.000 -
456.hmmer (avg) (percentage) 0.590 -
456.hmmer (max) 16.000 -5.88%
456.hmmer (max) (percentage) 0.550 -9.84%
458.sjeng 48.000 -2.04%
458.sjeng (avg) 48.000 -2.04%
458.sjeng (avg) (percentage) 0.660 -1.49%
458.sjeng (max) 38.000 -7.32%
458.sjeng (max) (percentage) 0.520 -7.14%
458.sjeng (unexplained diff vs previous) 35.000 169.23%
458.sjeng (unexplained diff vs previous) (percentage) 0.470 161.11%
459.GemsFDTD 80.000 -
459.GemsFDTD (avg) 80.000 -
459.GemsFDTD (avg) (percentage) 1.490 -1.32%
459.GemsFDTD (max) 137.000 -18.45%
459.GemsFDTD (max) (percentage) 2.550 -19.30%
459.GemsFDTD (unexplained diff vs previous) 36.000 -
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.670 -
462.libquantum 2.000 -
462.libquantum (avg) 2.000 -
462.libquantum (avg) (percentage) 1.890 -
462.libquantum (max) 3.000 -25.00%
462.libquantum (max) (percentage) 2.800 -9.97%
462.libquantum (unexplained diff vs previous) 1.000 -75.00%
462.libquantum (unexplained diff vs previous) (percentage) 0.750 -74.66%
464.h264ref 47.000 -
464.h264ref (avg) 47.000 -
464.h264ref (avg) (percentage) 0.820 -
464.h264ref (max) 52.000 -3.70%
464.h264ref (max) (percentage) 0.910 -2.15%
465.tonto 154.000 -
465.tonto (avg) 154.000 -
465.tonto (avg) (percentage) 1.390 -
465.tonto (max) 168.000 -4.00%
465.tonto (max) (percentage) 1.510 -3.82%
470.lbm 35.000 -2.78%
470.lbm (avg) 35.000 -2.78%
470.lbm (avg) (percentage) 0.950 -1.04%
470.lbm (max) 42.000 -4.55%
470.lbm (max) (percentage) 1.110 -5.93%
470.lbm (unexplained diff vs previous) 5.000 25.00%
470.lbm (unexplained diff vs previous) (percentage) 0.130 18.18%
471.omnetpp 62.000 -
471.omnetpp (avg) 62.000 -
471.omnetpp (avg) (percentage) 2.280 -
471.omnetpp (max) 75.000 -5.06%
471.omnetpp (max) (percentage) 2.760 -6.44%
471.omnetpp (unexplained diff vs previous) 28.000 833.33%
471.omnetpp (unexplained diff vs previous) (percentage) 1.030 836.36%
473.astar 86.000 1.18%
473.astar (avg) 86.000 1.18%
473.astar (avg) (percentage) 1.670 -
473.astar (max) 157.000 -5.42%
473.astar (max) (percentage) 3.040 -6.46%
481.wrf (avg) (percentage) 1.800 -
481.wrf (max) (percentage) 0.860 -
482.sphinx3 16.000 -
482.sphinx3 (avg) 16.000 -
482.sphinx3 (avg) (percentage) 1.960 -
482.sphinx3 (max) 27.000 -3.57%
482.sphinx3 (max) (percentage) 3.250 -6.07%
483.xalancbmk (avg) (percentage) 2.960 -
483.xalancbmk (max) (percentage) 1.770 -
Geometric Mean 5.634 -33.87%