Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=d4efbce75f1f98db0837f3791a65d9cb433f7861 (+ 25 commits)
git_gcc https://gcc.gnu.org/git/gcc.git (70035b6c13852435d7ae396c0762ee26897d4d45) (+ 59 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=a257f201dd557aa82c7efb7528277afe675c0468 (+ 19 commits)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/bfa40f51f6440f26bf7686eca23a2c2e126e3084 (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-aarch64-master-Os_LTO-build/351/
View Options
Report
Filter

gnu-aarch64-master-Os_LTO test results

Run Order Start Time Duration
Current 0351 (3-changed-components) 2025-01-04T16:39:25 0:00:00
Previous 0350 (4-changed-components) 2025-01-02T01:01:49 0:00:00
Baseline 0001 (4-changed-components) 2023-02-20T22:48:24 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 97 11
Performance Improvements 37 182
Unchanged Tests 1102 1043
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
429.mcf 10.62% 1845.000 2041.000 - 43.33% -
450.soplex 6.57% 548.000 584.000 - 3.00% -
401.bzip2 6.54% 2905.000 3095.000 - 5.24% -
462.libquantum 6.15% 130.000 138.000 - -1.43% -
473.astar 4.13% 4921.000 5124.000 - -0.08% -
482.sphinx3 4.04% 817.000 850.000 - -10.05% -
459.GemsFDTD 3.64% 5224.000 5414.000 - -12.30% -
465.tonto 3.52% 10778.000 11157.000 - 1.97% -
433.milc 3.38% 1124.000 1162.000 - 0.96% -
453.povray 2.08% 529.000 540.000 - -1.28% -
434.zeusmp 1.85% 2266.000 2308.000 - -8.19% -
445.gobmk 1.61% 4830.000 4908.000 - -2.29% -
410.bwaves 1.42% 5857.000 5940.000 - 5.10% -
471.omnetpp 1.09% 2659.000 2688.000 - -1.32% -
470.lbm 1.03% 3780.000 3819.000 - 0.82% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
435.gromacs (unexplained diff vs previous) 132.14% 28.000 65.000 - -99.08% -
435.gromacs (unexplained diff vs previous) (percentage) 130.77% 0.390 0.900 - -99.07% -
462.libquantum (max) 60.00% 5.000 8.000 - -94.20% -
462.libquantum (max) (percentage) 39.46% 4.410 6.150 - -93.79% -
462.libquantum (unexplained diff vs previous) 33.33% 6.000 8.000 - -99.94% -
465.tonto (max) 27.27% 308.000 392.000 - -81.44% -
429.mcf (max) 27.06% 170.000 216.000 - -83.66% -
459.GemsFDTD (max) 26.28% 156.000 197.000 - -95.53% -
462.libquantum (unexplained diff vs previous) (percentage) 25.54% 4.620 5.800 - -99.94% -
434.zeusmp (max) 23.53% 34.000 42.000 - -97.96% -
465.tonto (max) (percentage) 23.08% 2.860 3.520 - -81.77% -
445.gobmk (unexplained diff vs previous) 21.88% 64.000 78.000 - -98.60% -
459.GemsFDTD (max) (percentage) 21.74% 2.990 3.640 - -94.91% -
434.zeusmp (max) (percentage) 21.71% 1.520 1.850 - -97.74% -
434.zeusmp (unexplained diff vs previous) 20.00% 35.000 42.000 - -99.63% -
445.gobmk (max) 19.70% 66.000 79.000 - -97.01% -
465.tonto (unexplained diff vs previous) 19.56% 317.000 379.000 - -78.60% -
445.gobmk (unexplained diff vs previous) (percentage) 19.55% 1.330 1.590 - -98.57% -
450.soplex (max) 18.75% 32.000 38.000 - -93.03% -
434.zeusmp (unexplained diff vs previous) (percentage) 18.18% 1.540 1.820 - -99.59% -
459.GemsFDTD (unexplained diff vs previous) 18.01% 161.000 190.000 - -98.77% -
482.sphinx3 (unexplained diff vs previous) 17.86% 28.000 33.000 - -99.87% -
445.gobmk (max) (percentage) 16.67% 1.380 1.610 - -96.94% -
444.namd (max) 16.67% 6.000 7.000 - -98.98% -
444.namd (unexplained diff vs previous) 16.67% 6.000 7.000 - -99.92% -
444.namd (unexplained diff vs previous) (percentage) 16.05% 0.810 0.940 - -99.92% -
465.tonto (unexplained diff vs previous) (percentage) 15.65% 2.940 3.400 - -79.00% -
429.mcf (max) (percentage) 14.81% 9.250 10.620 - -88.57% -
459.GemsFDTD (unexplained diff vs previous) (percentage) 13.96% 3.080 3.510 - -98.60% -
410.bwaves (unexplained diff vs previous) 13.70% 73.000 83.000 - -98.94% -
482.sphinx3 (unexplained diff vs previous) (percentage) 13.12% 3.430 3.880 - -99.86% -
473.astar (max) 12.83% 187.000 211.000 - -93.81% -
450.soplex (max) (percentage) 12.50% 5.840 6.570 - -93.17% -
401.bzip2 12.20% 41.000 46.000 - -71.43% -
401.bzip2 (avg) 12.20% 41.000 46.000 - -71.43% -
410.bwaves (unexplained diff vs previous) (percentage) 12.00% 1.250 1.400 - -98.98% -
429.mcf 11.90% 84.000 94.000 - -13.76% -
429.mcf (avg) 11.90% 84.000 94.000 - -13.76% -
433.milc (max) 11.43% 35.000 39.000 - -96.26% -
473.astar (max) (percentage) 8.12% 3.820 4.130 - -93.78% -
433.milc 7.69% 13.000 14.000 - -79.71% -
433.milc (avg) 7.69% 13.000 14.000 - -79.71% -
450.soplex 7.69% 13.000 14.000 - -61.11% -
450.soplex (avg) 7.69% 13.000 14.000 - -61.11% -
482.sphinx3 7.69% 13.000 14.000 - -81.08% -
482.sphinx3 (avg) 7.69% 13.000 14.000 - -81.08% -
465.tonto 7.41% 135.000 145.000 - -60.27% -
465.tonto (avg) 7.41% 135.000 145.000 - -60.27% -
401.bzip2 (max) 6.32% 190.000 202.000 - -91.27% -
459.GemsFDTD 6.15% 65.000 69.000 - -80.83% -
459.GemsFDTD (avg) 6.15% 65.000 69.000 - -80.83% -
433.milc (max) (percentage) 5.96% 3.190 3.380 - -96.28% -
450.soplex (unexplained diff vs previous) 5.88% 34.000 36.000 - -99.75% -
434.zeusmp 5.26% 19.000 20.000 - -86.39% -
434.zeusmp (avg) 5.26% 19.000 20.000 - -86.39% -
473.astar 5.26% 76.000 80.000 - -62.44% -
473.astar (avg) 5.26% 76.000 80.000 - -62.44% -
410.bwaves (max) 5.00% 80.000 84.000 - -97.44% -
473.astar (unexplained diff vs previous) 4.64% 194.000 203.000 - -98.00% -
429.mcf (unexplained diff vs previous) 4.26% 188.000 196.000 - -98.95% -
410.bwaves (max) (percentage) 3.65% 1.370 1.420 - -97.55% -
401.bzip2 (avg) (percentage) 3.47% 1.440 1.490 - -72.81% -
470.lbm 3.45% 29.000 30.000 - -87.45% -
470.lbm (avg) 3.45% 29.000 30.000 - -87.45% -
444.namd (max) (percentage) 3.26% 0.920 0.950 - -98.97% -
465.tonto (avg) (percentage) 3.17% 1.260 1.300 - -61.08% -
433.milc (unexplained diff vs previous) 2.70% 37.000 38.000 - -99.66% -
462.libquantum (avg) (percentage) 2.69% 1.860 1.910 - -75.07% -
445.gobmk 2.50% 40.000 41.000 - -79.08% -
445.gobmk (avg) 2.50% 40.000 41.000 - -79.08% -
459.GemsFDTD (avg) (percentage) 2.38% 1.260 1.290 - -77.91% -
450.soplex (avg) (percentage) 2.08% 2.400 2.450 - -61.90% -
410.bwaves 2.08% 48.000 49.000 - -80.32% -
410.bwaves (avg) 2.08% 48.000 49.000 - -80.32% -
471.omnetpp 1.89% 53.000 54.000 - -75.78% -
471.omnetpp (avg) 1.89% 53.000 54.000 - -75.78% -
482.sphinx3 (avg) (percentage) 1.78% 1.690 1.720 - -78.31% -
433.milc (avg) (percentage) 1.64% 1.220 1.240 - -79.50% -
429.mcf (avg) (percentage) 1.31% 4.590 4.650 - -39.37% -
473.astar (avg) (percentage) 1.29% 1.550 1.570 - -62.26% -
445.gobmk (avg) (percentage) 1.19% 0.840 0.850 - -78.26% -
434.zeusmp (avg) (percentage) 1.14% 0.880 0.890 - -84.79% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
437.leslie3d -1.97% 11194.000 10973.000 - -5.73% -
447.dealII -1.21% 1649.000 1629.000 - -5.51% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
471.omnetpp (unexplained diff vs previous) (percentage) -60.73% 2.750 1.080 - -99.72% -
471.omnetpp (unexplained diff vs previous) -60.27% 73.000 29.000 - -99.73% -
437.leslie3d (unexplained diff vs previous) -57.09% 515.000 221.000 - -90.45% -
437.leslie3d (unexplained diff vs previous) (percentage) -56.30% 4.600 2.010 - -89.89% -
453.povray (unexplained diff vs previous) (percentage) -46.03% 3.780 2.040 - -99.80% -
453.povray (unexplained diff vs previous) -45.00% 20.000 11.000 - -99.81% -
470.lbm (unexplained diff vs previous) (percentage) -30.14% 1.460 1.020 - -99.61% -
470.lbm (unexplained diff vs previous) -29.09% 55.000 39.000 - -99.61% -
447.dealII (unexplained diff vs previous) -20.00% 25.000 20.000 - -99.71% -
447.dealII (unexplained diff vs previous) (percentage) -19.08% 1.520 1.230 - -99.70% -
458.sjeng (unexplained diff vs previous) (percentage) -13.51% 0.740 0.640 - -99.30% -
470.lbm (max) -12.96% 54.000 47.000 - -98.29% -
458.sjeng (unexplained diff vs previous) -12.73% 55.000 48.000 - -99.30% -
470.lbm (max) (percentage) -12.59% 1.430 1.250 - -98.28% -
401.bzip2 (unexplained diff vs previous) (percentage) -12.54% 7.020 6.140 - -98.33% -
471.omnetpp (max) (percentage) -11.11% 2.880 2.560 - -96.79% -
471.omnetpp (max) -10.53% 76.000 68.000 - -96.86% -
437.leslie3d (max) -10.29% 593.000 532.000 - -72.42% -
437.leslie3d (max) (percentage) -8.49% 5.300 4.850 - -70.75% -
458.sjeng (max) (percentage) -8.11% 0.740 0.680 - -98.57% -
447.dealII (max) -8.00% 25.000 23.000 - -98.34% -
458.sjeng (max) -7.41% 54.000 50.000 - -98.61% -
447.dealII (max) (percentage) -7.14% 1.540 1.430 - -98.22% -
453.povray (max) (percentage) -7.14% 3.640 3.380 - -96.30% -
482.sphinx3 (max) (percentage) -7.13% 4.350 4.040 - -95.81% -
401.bzip2 (unexplained diff vs previous) -6.86% 204.000 190.000 - -98.25% -
435.gromacs (max) (percentage) -6.37% 1.570 1.470 - -97.01% -
429.mcf (unexplained diff vs previous) (percentage) -5.79% 10.190 9.600 - -99.26% -
435.gromacs (max) -5.41% 111.000 105.000 - -97.06% -
453.povray (max) -5.26% 19.000 18.000 - -96.39% -
482.sphinx3 (max) -2.86% 35.000 34.000 - -96.27% -
437.leslie3d -2.44% 491.000 479.000 - 34.93% -
437.leslie3d (avg) -2.44% 491.000 479.000 - 34.93% -
481.wrf (max) (percentage) -1.25% 0.800 0.790 - -98.85% -
436.cactusADM (max) (percentage) -1.14% 0.880 0.870 - -99.02% -

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
465.tonto 1.35% 1946163.000 1972475.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
429.mcf 43.33% 1424.000 2041.000 - 10.62% -
401.bzip2 5.24% 2941.000 3095.000 - 6.54% -
410.bwaves 5.10% 5652.000 5940.000 - 1.42% -
450.soplex 3.00% 567.000 584.000 - 6.57% -
465.tonto 1.97% 10941.000 11157.000 - 3.52% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d (avg) (percentage) 43.28% 3.050 4.370 - -0.46% -
437.leslie3d 34.93% 355.000 479.000 - -2.44% -
437.leslie3d (avg) 34.93% 355.000 479.000 - -2.44% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -31.03% 29.000 20.000 - 0.00% -
nb_execution_successful -31.03% 29.000 20.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d -8.90% 59479.000 54186.000 - 0.00% -
459.GemsFDTD -5.47% 244728.000 231344.000 - 0.00% -
444.namd -3.27% 188385.000 182220.000 - 0.00% -
447.dealII -2.16% 311591.000 304870.000 - 0.00% -
435.gromacs -1.86% 499261.000 489954.000 - 0.00% -
410.bwaves -1.84% 16760.000 16452.000 - 0.00% -
453.povray -1.82% 661389.000 649324.000 - 0.00% -
462.libquantum -1.79% 16085.000 15797.000 - 0.00% -
470.lbm -1.49% 9691.000 9547.000 - 0.00% -
433.milc -1.46% 61382.000 60488.000 - 0.00% -
458.sjeng -1.44% 104048.000 102551.000 - 0.00% -
450.soplex -1.33% 205081.000 202350.000 - 0.00% -
473.astar -1.18% 22968.000 22696.000 - 0.00% -
401.bzip2 -1.18% 44233.000 43711.000 - 0.00% -
482.sphinx3 -1.04% 112859.000 111690.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
459.GemsFDTD -12.30% 6173.000 5414.000 - 3.64% -
482.sphinx3 -10.05% 945.000 850.000 - 4.04% -
434.zeusmp -8.19% 2514.000 2308.000 - 1.85% -
437.leslie3d -5.73% 11640.000 10973.000 - -1.97% -
447.dealII -5.51% 1724.000 1629.000 - -1.21% -
445.gobmk -2.29% 5023.000 4908.000 - 1.61% -
458.sjeng -1.55% 7567.000 7450.000 - 0.65% -
462.libquantum -1.43% 140.000 138.000 - 6.15% -
471.omnetpp -1.32% 2724.000 2688.000 - 1.09% -
453.povray -1.28% 547.000 540.000 - 2.08% -
435.gromacs -1.06% 7269.000 7192.000 - 0.91% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
462.libquantum (unexplained diff vs previous) -99.94% 13518.000 8.000 - 33.33% -
462.libquantum (unexplained diff vs previous) (percentage) -99.94% 9655.710 5.800 - 25.54% -
444.namd (unexplained diff vs previous) -99.92% 8356.000 7.000 - 16.67% -
444.namd (unexplained diff vs previous) (percentage) -99.92% 1118.610 0.940 - 16.05% -
482.sphinx3 (unexplained diff vs previous) -99.87% 26073.000 33.000 - 17.86% -
482.sphinx3 (unexplained diff vs previous) (percentage) -99.86% 2759.050 3.880 - 13.12% -
453.povray (unexplained diff vs previous) -99.81% 5707.000 11.000 - -45.00% -
453.povray (unexplained diff vs previous) (percentage) -99.80% 1043.330 2.040 - -46.03% -
450.soplex (unexplained diff vs previous) (percentage) -99.76% 2557.320 6.160 - -0.65% -
450.soplex (unexplained diff vs previous) -99.75% 14500.000 36.000 - 5.88% -
471.omnetpp (unexplained diff vs previous) -99.73% 10659.000 29.000 - -60.27% -
471.omnetpp (unexplained diff vs previous) (percentage) -99.72% 391.300 1.080 - -60.73% -
447.dealII (unexplained diff vs previous) -99.71% 7017.000 20.000 - -20.00% -
447.dealII (unexplained diff vs previous) (percentage) -99.70% 407.020 1.230 - -19.08% -
433.milc (unexplained diff vs previous) (percentage) -99.67% 980.800 3.270 - -0.61% -
433.milc (unexplained diff vs previous) -99.66% 11289.000 38.000 - 2.70% -
434.zeusmp (unexplained diff vs previous) -99.63% 11280.000 42.000 - 20.00% -
470.lbm (unexplained diff vs previous) (percentage) -99.61% 263.730 1.020 - -30.14% -
470.lbm (unexplained diff vs previous) -99.61% 9990.000 39.000 - -29.09% -
434.zeusmp (unexplained diff vs previous) (percentage) -99.59% 448.690 1.820 - 18.18% -
456.hmmer (max) (percentage) -99.51% 73.590 0.360 - 0.00% -
458.sjeng (unexplained diff vs previous) -99.30% 6876.000 48.000 - -12.73% -
464.h264ref (max) (percentage) -99.30% 54.290 0.380 - 0.00% -
458.sjeng (unexplained diff vs previous) (percentage) -99.30% 90.870 0.640 - -13.51% -
429.mcf (unexplained diff vs previous) (percentage) -99.26% 1305.690 9.600 - -5.79% -
454.calculix (max) (percentage) -99.18% 99.730 0.820 - 0.00% -
435.gromacs (unexplained diff vs previous) -99.08% 7028.000 65.000 - 132.14% -
435.gromacs (unexplained diff vs previous) (percentage) -99.07% 96.680 0.900 - 130.77% -
416.gamess (max) (percentage) -99.07% 38.550 0.360 - 0.00% -
436.cactusADM (max) (percentage) -99.02% 88.730 0.870 - -1.14% -
410.bwaves (unexplained diff vs previous) (percentage) -98.98% 137.900 1.400 - 12.00% -
444.namd (max) -98.98% 685.000 7.000 - 16.67% -
444.namd (max) (percentage) -98.97% 91.790 0.950 - 3.26% -
429.mcf (unexplained diff vs previous) -98.95% 18593.000 196.000 - 4.26% -
410.bwaves (unexplained diff vs previous) -98.94% 7794.000 83.000 - 13.70% -
481.wrf (max) (percentage) -98.85% 68.700 0.790 - -1.25% -
459.GemsFDTD (unexplained diff vs previous) -98.77% 15458.000 190.000 - 18.01% -
458.sjeng (max) -98.61% 3602.000 50.000 - -7.41% -
445.gobmk (unexplained diff vs previous) -98.60% 5581.000 78.000 - 21.88% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -98.60% 250.410 3.510 - 13.96% -
458.sjeng (max) (percentage) -98.57% 47.610 0.680 - -8.11% -
445.gobmk (unexplained diff vs previous) (percentage) -98.57% 111.110 1.590 - 19.55% -
447.dealII (max) -98.34% 1384.000 23.000 - -8.00% -
401.bzip2 (unexplained diff vs previous) (percentage) -98.33% 368.340 6.140 - -12.54% -
470.lbm (max) -98.29% 2746.000 47.000 - -12.96% -
470.lbm (max) (percentage) -98.28% 72.510 1.250 - -12.59% -
401.bzip2 (unexplained diff vs previous) -98.25% 10833.000 190.000 - -6.86% -
447.dealII (max) (percentage) -98.22% 80.280 1.430 - -7.14% -
473.astar (unexplained diff vs previous) -98.00% 10146.000 203.000 - 4.64% -
473.astar (unexplained diff vs previous) (percentage) -98.00% 197.850 3.960 - 0.51% -
434.zeusmp (max) -97.96% 2055.000 42.000 - 23.53% -
434.zeusmp (max) (percentage) -97.74% 81.770 1.850 - 21.71% -
410.bwaves (max) (percentage) -97.55% 57.970 1.420 - 3.65% -
410.bwaves (max) -97.44% 3276.000 84.000 - 5.00% -
483.xalancbmk (max) (percentage) -97.42% 68.670 1.770 - 0.00% -
400.perlbench (max) (percentage) -97.36% 84.060 2.220 - -0.89% -
435.gromacs (max) -97.06% 3573.000 105.000 - -5.41% -
445.gobmk (max) -97.01% 2643.000 79.000 - 19.70% -
435.gromacs (max) (percentage) -97.01% 49.160 1.470 - -6.37% -
445.gobmk (max) (percentage) -96.94% 52.630 1.610 - 16.67% -
471.omnetpp (max) -96.86% 2169.000 68.000 - -10.53% -
471.omnetpp (max) (percentage) -96.79% 79.650 2.560 - -11.11% -
453.povray (max) -96.39% 499.000 18.000 - -5.26% -
453.povray (max) (percentage) -96.30% 91.250 3.380 - -7.14% -
433.milc (max) (percentage) -96.28% 90.750 3.380 - 5.96% -
482.sphinx3 (max) -96.27% 911.000 34.000 - -2.86% -
433.milc (max) -96.26% 1044.000 39.000 - 11.43% -
403.gcc (max) (percentage) -96.26% 99.360 3.720 - 0.00% -
482.sphinx3 (max) (percentage) -95.81% 96.500 4.040 - -7.13% -
459.GemsFDTD (max) -95.53% 4411.000 197.000 - 26.28% -
459.GemsFDTD (max) (percentage) -94.91% 71.460 3.640 - 21.74% -
462.libquantum (max) -94.20% 138.000 8.000 - 60.00% -
473.astar (max) -93.81% 3406.000 211.000 - 12.83% -
462.libquantum (max) (percentage) -93.79% 98.970 6.150 - 39.46% -
473.astar (max) (percentage) -93.78% 66.430 4.130 - 8.12% -
450.soplex (max) (percentage) -93.17% 96.240 6.570 - 12.50% -
450.soplex (max) -93.03% 545.000 38.000 - 18.75% -
401.bzip2 (max) (percentage) -91.68% 78.650 6.540 - -0.30% -
401.bzip2 (max) -91.27% 2313.000 202.000 - 6.32% -
437.leslie3d (unexplained diff vs previous) -90.45% 2314.000 221.000 - -57.09% -
437.leslie3d (unexplained diff vs previous) (percentage) -89.89% 19.880 2.010 - -56.30% -
429.mcf (max) (percentage) -88.57% 92.890 10.620 - 14.81% -
444.namd -88.24% 68.000 8.000 - 0.00% -
444.namd (avg) -88.24% 68.000 8.000 - 0.00% -
456.hmmer (avg) (percentage) -88.21% 4.410 0.520 - 0.00% -
444.namd (avg) (percentage) -87.74% 9.220 1.130 - 0.00% -
470.lbm (avg) (percentage) -87.52% 6.330 0.790 - 0.00% -
470.lbm -87.45% 239.000 30.000 - 3.45% -
470.lbm (avg) -87.45% 239.000 30.000 - 3.45% -
434.zeusmp -86.39% 147.000 20.000 - 5.26% -
434.zeusmp (avg) -86.39% 147.000 20.000 - 5.26% -
464.h264ref (avg) (percentage) -86.05% 5.090 0.710 - 0.00% -
434.zeusmp (avg) (percentage) -84.79% 5.850 0.890 - 1.14% -
429.mcf (max) -83.66% 1322.000 216.000 - 27.06% -
458.sjeng -82.99% 241.000 41.000 - 0.00% -
458.sjeng (avg) -82.99% 241.000 41.000 - 0.00% -
416.gamess (avg) (percentage) -82.81% 4.420 0.760 - 0.00% -
458.sjeng (avg) (percentage) -82.45% 3.190 0.560 - 0.00% -
436.cactusADM (avg) (percentage) -82.44% 5.980 1.050 - 0.00% -
447.dealII -81.82% 99.000 18.000 - 0.00% -
447.dealII (avg) -81.82% 99.000 18.000 - 0.00% -
465.tonto (max) (percentage) -81.77% 19.310 3.520 - 23.08% -
465.tonto (max) -81.44% 2112.000 392.000 - 27.27% -
410.bwaves (avg) (percentage) -81.18% 4.410 0.830 - 0.00% -
482.sphinx3 -81.08% 74.000 14.000 - 7.69% -
482.sphinx3 (avg) -81.08% 74.000 14.000 - 7.69% -
453.povray -80.95% 42.000 8.000 - 0.00% -
453.povray (avg) -80.95% 42.000 8.000 - 0.00% -
459.GemsFDTD -80.83% 360.000 69.000 - 6.15% -
459.GemsFDTD (avg) -80.83% 360.000 69.000 - 6.15% -
447.dealII (avg) (percentage) -80.42% 5.770 1.130 - 0.00% -
410.bwaves -80.32% 249.000 49.000 - 2.08% -
410.bwaves (avg) -80.32% 249.000 49.000 - 2.08% -
462.libquantum -80.00% 10.000 2.000 - 0.00% -
462.libquantum (avg) -80.00% 10.000 2.000 - 0.00% -
433.milc -79.71% 69.000 14.000 - 7.69% -
433.milc (avg) -79.71% 69.000 14.000 - 7.69% -
453.povray (avg) (percentage) -79.64% 7.810 1.590 - 0.63% -
433.milc (avg) (percentage) -79.50% 6.050 1.240 - 1.64% -
445.gobmk -79.08% 196.000 41.000 - 2.50% -
445.gobmk (avg) -79.08% 196.000 41.000 - 2.50% -
465.tonto (unexplained diff vs previous) (percentage) -79.00% 16.190 3.400 - 15.65% -
465.tonto (unexplained diff vs previous) -78.60% 1771.000 379.000 - 19.56% -
482.sphinx3 (avg) (percentage) -78.31% 7.930 1.720 - 1.78% -
445.gobmk (avg) (percentage) -78.26% 3.910 0.850 - 1.19% -
459.GemsFDTD (avg) (percentage) -77.91% 5.840 1.290 - 2.38% -
471.omnetpp -75.78% 223.000 54.000 - 1.89% -
471.omnetpp (avg) -75.78% 223.000 54.000 - 1.89% -
471.omnetpp (avg) (percentage) -75.49% 8.200 2.010 - -0.50% -
462.libquantum (avg) (percentage) -75.07% 7.660 1.910 - 2.69% -
401.bzip2 (avg) (percentage) -72.81% 5.480 1.490 - 3.47% -
437.leslie3d (max) -72.42% 1929.000 532.000 - -10.29% -
401.bzip2 -71.43% 161.000 46.000 - 12.20% -
401.bzip2 (avg) -71.43% 161.000 46.000 - 12.20% -
481.wrf (avg) (percentage) -71.15% 6.240 1.800 - 0.00% -
437.leslie3d (max) (percentage) -70.75% 16.580 4.850 - -8.49% -
400.perlbench (avg) (percentage) -69.45% 6.350 1.940 - 0.00% -
435.gromacs -67.30% 367.000 120.000 - 0.00% -
435.gromacs (avg) -67.30% 367.000 120.000 - 0.00% -
435.gromacs (avg) (percentage) -66.80% 5.060 1.680 - -0.59% -
473.astar -62.44% 213.000 80.000 - 5.26% -
473.astar (avg) -62.44% 213.000 80.000 - 5.26% -
473.astar (avg) (percentage) -62.26% 4.160 1.570 - 1.29% -
450.soplex (avg) (percentage) -61.90% 6.430 2.450 - 2.08% -
450.soplex -61.11% 36.000 14.000 - 7.69% -
450.soplex (avg) -61.11% 36.000 14.000 - 7.69% -
465.tonto (avg) (percentage) -61.08% 3.340 1.300 - 3.17% -
465.tonto -60.27% 365.000 145.000 - 7.41% -
465.tonto (avg) -60.27% 365.000 145.000 - 7.41% -
454.calculix (avg) (percentage) -55.11% 8.020 3.600 - 0.00% -
483.xalancbmk (avg) (percentage) -54.46% 6.500 2.960 - 0.00% -
429.mcf (avg) (percentage) -39.37% 7.670 4.650 - 1.31% -
403.gcc (avg) (percentage) -30.46% 7.320 5.090 - 0.00% -
429.mcf -13.76% 109.000 94.000 - 11.90% -
429.mcf (avg) -13.76% 109.000 94.000 - 11.90% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 31.03% 29.000 38.000 - 0.00% -

Report Time: 0.40s
Execution (seconds)
Name Current %
401.bzip2 3095.000 6.54%
410.bwaves 5940.000 1.42%
429.mcf 2041.000 10.62%
433.milc 1162.000 3.38%
434.zeusmp 2308.000 1.85%
435.gromacs 7192.000 -
437.leslie3d 10973.000 -1.97%
444.namd 745.000 -
445.gobmk 4908.000 1.61%
447.dealII 1629.000 -1.21%
450.soplex 584.000 6.57%
453.povray 540.000 2.08%
458.sjeng 7450.000 -
459.GemsFDTD 5414.000 3.64%
462.libquantum 138.000 6.15%
465.tonto 11157.000 3.52%
470.lbm 3819.000 1.03%
471.omnetpp 2688.000 1.09%
473.astar 5124.000 4.13%
482.sphinx3 850.000 4.04%
Geometric Mean 2403.589 2.81%
Code Size (bytes)
Name Current %
401.bzip2 43711.000 -
410.bwaves 16452.000 -
429.mcf 9086.000 -
433.milc 60488.000 -
434.zeusmp 151959.000 -
435.gromacs 489954.000 -
437.leslie3d 54186.000 -
444.namd 182220.000 -
445.gobmk 1375074.000 -
447.dealII 304870.000 -
450.soplex 202350.000 -
453.povray 649324.000 -
458.sjeng 102551.000 -
459.GemsFDTD 231344.000 -
462.libquantum 15797.000 -
465.tonto 1972475.000 -
470.lbm 9547.000 -
471.omnetpp 475181.000 -
473.astar 22696.000 -
482.sphinx3 111690.000 -
Geometric Mean 113942.247 -
sample variability
Name Current %
400.perlbench (avg) (percentage) 1.940 -
400.perlbench (max) (percentage) 2.220 -
401.bzip2 46.000 12.20%
401.bzip2 (avg) 46.000 12.20%
401.bzip2 (avg) (percentage) 1.490 3.47%
401.bzip2 (max) 202.000 6.32%
401.bzip2 (max) (percentage) 6.540 -
401.bzip2 (unexplained diff vs previous) 190.000 -6.86%
401.bzip2 (unexplained diff vs previous) (percentage) 6.140 -12.54%
403.gcc (avg) (percentage) 5.090 -
403.gcc (max) (percentage) 3.720 -
410.bwaves 49.000 2.08%
410.bwaves (avg) 49.000 2.08%
410.bwaves (avg) (percentage) 0.830 -
410.bwaves (max) 84.000 5.00%
410.bwaves (max) (percentage) 1.420 3.65%
410.bwaves (unexplained diff vs previous) 83.000 13.70%
410.bwaves (unexplained diff vs previous) (percentage) 1.400 12.00%
416.gamess (avg) (percentage) 0.760 -
416.gamess (max) (percentage) 0.360 -
429.mcf 94.000 11.90%
429.mcf (avg) 94.000 11.90%
429.mcf (avg) (percentage) 4.650 1.31%
429.mcf (max) 216.000 27.06%
429.mcf (max) (percentage) 10.620 14.81%
429.mcf (unexplained diff vs previous) 196.000 4.26%
429.mcf (unexplained diff vs previous) (percentage) 9.600 -5.79%
433.milc 14.000 7.69%
433.milc (avg) 14.000 7.69%
433.milc (avg) (percentage) 1.240 1.64%
433.milc (max) 39.000 11.43%
433.milc (max) (percentage) 3.380 5.96%
433.milc (unexplained diff vs previous) 38.000 2.70%
433.milc (unexplained diff vs previous) (percentage) 3.270 -
434.zeusmp 20.000 5.26%
434.zeusmp (avg) 20.000 5.26%
434.zeusmp (avg) (percentage) 0.890 1.14%
434.zeusmp (max) 42.000 23.53%
434.zeusmp (max) (percentage) 1.850 21.71%
434.zeusmp (unexplained diff vs previous) 42.000 20.00%
434.zeusmp (unexplained diff vs previous) (percentage) 1.820 18.18%
435.gromacs 120.000 -
435.gromacs (avg) 120.000 -
435.gromacs (avg) (percentage) 1.680 -
435.gromacs (max) 105.000 -5.41%
435.gromacs (max) (percentage) 1.470 -6.37%
435.gromacs (unexplained diff vs previous) 65.000 132.14%
435.gromacs (unexplained diff vs previous) (percentage) 0.900 130.77%
436.cactusADM (avg) (percentage) 1.050 -
436.cactusADM (max) (percentage) 0.870 -1.14%
437.leslie3d 479.000 -2.44%
437.leslie3d (avg) 479.000 -2.44%
437.leslie3d (avg) (percentage) 4.370 -
437.leslie3d (max) 532.000 -10.29%
437.leslie3d (max) (percentage) 4.850 -8.49%
437.leslie3d (unexplained diff vs previous) 221.000 -57.09%
437.leslie3d (unexplained diff vs previous) (percentage) 2.010 -56.30%
444.namd 8.000 -
444.namd (avg) 8.000 -
444.namd (avg) (percentage) 1.130 -
444.namd (max) 7.000 16.67%
444.namd (max) (percentage) 0.950 3.26%
444.namd (unexplained diff vs previous) 7.000 16.67%
444.namd (unexplained diff vs previous) (percentage) 0.940 16.05%
445.gobmk 41.000 2.50%
445.gobmk (avg) 41.000 2.50%
445.gobmk (avg) (percentage) 0.850 1.19%
445.gobmk (max) 79.000 19.70%
445.gobmk (max) (percentage) 1.610 16.67%
445.gobmk (unexplained diff vs previous) 78.000 21.88%
445.gobmk (unexplained diff vs previous) (percentage) 1.590 19.55%
447.dealII 18.000 -
447.dealII (avg) 18.000 -
447.dealII (avg) (percentage) 1.130 -
447.dealII (max) 23.000 -8.00%
447.dealII (max) (percentage) 1.430 -7.14%
447.dealII (unexplained diff vs previous) 20.000 -20.00%
447.dealII (unexplained diff vs previous) (percentage) 1.230 -19.08%
450.soplex 14.000 7.69%
450.soplex (avg) 14.000 7.69%
450.soplex (avg) (percentage) 2.450 2.08%
450.soplex (max) 38.000 18.75%
450.soplex (max) (percentage) 6.570 12.50%
450.soplex (unexplained diff vs previous) 36.000 5.88%
450.soplex (unexplained diff vs previous) (percentage) 6.160 -
453.povray 8.000 -
453.povray (avg) 8.000 -
453.povray (avg) (percentage) 1.590 -
453.povray (max) 18.000 -5.26%
453.povray (max) (percentage) 3.380 -7.14%
453.povray (unexplained diff vs previous) 11.000 -45.00%
453.povray (unexplained diff vs previous) (percentage) 2.040 -46.03%
454.calculix (avg) (percentage) 3.600 -
454.calculix (max) (percentage) 0.820 -
456.hmmer (avg) (percentage) 0.520 -
456.hmmer (max) (percentage) 0.360 -
458.sjeng 41.000 -
458.sjeng (avg) 41.000 -
458.sjeng (avg) (percentage) 0.560 -
458.sjeng (max) 50.000 -7.41%
458.sjeng (max) (percentage) 0.680 -8.11%
458.sjeng (unexplained diff vs previous) 48.000 -12.73%
458.sjeng (unexplained diff vs previous) (percentage) 0.640 -13.51%
459.GemsFDTD 69.000 6.15%
459.GemsFDTD (avg) 69.000 6.15%
459.GemsFDTD (avg) (percentage) 1.290 2.38%
459.GemsFDTD (max) 197.000 26.28%
459.GemsFDTD (max) (percentage) 3.640 21.74%
459.GemsFDTD (unexplained diff vs previous) 190.000 18.01%
459.GemsFDTD (unexplained diff vs previous) (percentage) 3.510 13.96%
462.libquantum 2.000 -
462.libquantum (avg) 2.000 -
462.libquantum (avg) (percentage) 1.910 2.69%
462.libquantum (max) 8.000 60.00%
462.libquantum (max) (percentage) 6.150 39.46%
462.libquantum (unexplained diff vs previous) 8.000 33.33%
462.libquantum (unexplained diff vs previous) (percentage) 5.800 25.54%
464.h264ref (avg) (percentage) 0.710 -
464.h264ref (max) (percentage) 0.380 -
465.tonto 145.000 7.41%
465.tonto (avg) 145.000 7.41%
465.tonto (avg) (percentage) 1.300 3.17%
465.tonto (max) 392.000 27.27%
465.tonto (max) (percentage) 3.520 23.08%
465.tonto (unexplained diff vs previous) 379.000 19.56%
465.tonto (unexplained diff vs previous) (percentage) 3.400 15.65%
470.lbm 30.000 3.45%
470.lbm (avg) 30.000 3.45%
470.lbm (avg) (percentage) 0.790 -
470.lbm (max) 47.000 -12.96%
470.lbm (max) (percentage) 1.250 -12.59%
470.lbm (unexplained diff vs previous) 39.000 -29.09%
470.lbm (unexplained diff vs previous) (percentage) 1.020 -30.14%
471.omnetpp 54.000 1.89%
471.omnetpp (avg) 54.000 1.89%
471.omnetpp (avg) (percentage) 2.010 -
471.omnetpp (max) 68.000 -10.53%
471.omnetpp (max) (percentage) 2.560 -11.11%
471.omnetpp (unexplained diff vs previous) 29.000 -60.27%
471.omnetpp (unexplained diff vs previous) (percentage) 1.080 -60.73%
473.astar 80.000 5.26%
473.astar (avg) 80.000 5.26%
473.astar (avg) (percentage) 1.570 1.29%
473.astar (max) 211.000 12.83%
473.astar (max) (percentage) 4.130 8.12%
473.astar (unexplained diff vs previous) 203.000 4.64%
473.astar (unexplained diff vs previous) (percentage) 3.960 -
481.wrf (avg) (percentage) 1.800 -
481.wrf (max) (percentage) 0.790 -1.25%
482.sphinx3 14.000 7.69%
482.sphinx3 (avg) 14.000 7.69%
482.sphinx3 (avg) (percentage) 1.720 1.78%
482.sphinx3 (max) 34.000 -2.86%
482.sphinx3 (max) (percentage) 4.040 -7.13%
482.sphinx3 (unexplained diff vs previous) 33.000 17.86%
482.sphinx3 (unexplained diff vs previous) (percentage) 3.880 13.12%
483.xalancbmk (avg) (percentage) 2.960 -
483.xalancbmk (max) (percentage) 1.770 -
Geometric Mean 9.255 1.41%