Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=11bd5aef5e6a8cbc9cb9939536957d05efe5c825 (+ 22 commits)
git_gcc https://gcc.gnu.org/git/gcc.git (6aba48a8cc128e54ee243d451ac9a843ff41c4f9) (unchanged)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=bb6496b96444dfd55d7105396780f6eba14b1cd9 (+ 1 commits)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/a1856aaa2ca74c88751f7d255dfa0c8c50fcc1ca (+ 585 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-arm-master-Os_LTO-build/338/
View Options
Report
Filter

gnu-arm-master-Os_LTO test results

Run Order Start Time Duration
Current 0338 (3-changed-components) 2025-02-03T07:26:27 0:00:00
Previous 0335 (3-changed-components) 2025-01-27T21:09:17 0:00:00
Baseline 0001 (3-changed-components) 2022-12-30T06:27:35 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 54 70
Performance Improvements 75 140
Unchanged Tests 1107 1026
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
429.mcf 3.77% 1195.000 1240.000 - -89.43% -
471.omnetpp 2.41% 2780.000 2847.000 - -69.27% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
450.soplex (unexplained diff vs previous) (percentage) 2000.00% 0.160 3.360 - 663.64% -
450.soplex (unexplained diff vs previous) 1900.00% 1.000 20.000 - -71.01% -
459.GemsFDTD (unexplained diff vs previous) (percentage) 785.71% 0.070 0.620 - -73.04% -
459.GemsFDTD (unexplained diff vs previous) 780.00% 5.000 44.000 - -92.47% -
470.lbm (unexplained diff vs previous) (percentage) 660.00% 0.050 0.380 - -92.46% -
464.h264ref (unexplained diff vs previous) 650.00% 6.000 45.000 - -22.41% -
464.h264ref (unexplained diff vs previous) (percentage) 640.00% 0.100 0.740 - 94.74% -
470.lbm (unexplained diff vs previous) 600.00% 2.000 14.000 - -98.30% -
401.bzip2 (unexplained diff vs previous) 550.00% 6.000 39.000 - -43.48% -
401.bzip2 (unexplained diff vs previous) (percentage) 547.62% 0.210 1.360 - 231.71% -
444.namd (unexplained diff vs previous) (percentage) 503.03% 0.330 1.990 - -61.95% -
444.namd (unexplained diff vs previous) 500.00% 3.000 18.000 - -97.84% -
465.tonto (unexplained diff vs previous) 426.67% 15.000 79.000 - -46.62% -
465.tonto (unexplained diff vs previous) (percentage) 408.33% 0.120 0.610 - -46.02% -
444.namd (max) 325.00% 4.000 17.000 - -98.07% -
453.povray (unexplained diff vs previous) (percentage) 316.67% 0.900 3.750 - 63.76% -
462.libquantum (unexplained diff vs previous) (percentage) 304.44% 0.450 1.820 - 2175.00% -
453.povray (unexplained diff vs previous) 300.00% 5.000 20.000 - -88.17% -
462.libquantum (unexplained diff vs previous) 300.00% 1.000 4.000 - -71.43% -
444.namd (max) (percentage) 282.35% 0.510 1.950 - -64.61% -
453.povray (max) (percentage) 225.23% 1.110 3.610 - 39.38% -
453.povray (max) 216.67% 6.000 19.000 - -90.05% -
473.astar (unexplained diff vs previous) (percentage) 141.94% 0.310 0.750 - 59.57% -
473.astar (unexplained diff vs previous) 140.00% 15.000 36.000 - -40.98% -
458.sjeng (unexplained diff vs previous) (percentage) 120.00% 0.100 0.220 - -26.67% -
458.sjeng (unexplained diff vs previous) 112.50% 8.000 17.000 - -64.58% -
471.omnetpp (unexplained diff vs previous) 91.43% 35.000 67.000 - 8.06% -
471.omnetpp (unexplained diff vs previous) (percentage) 86.51% 1.260 2.350 - 250.75% -
471.omnetpp (max) 78.95% 38.000 68.000 - -60.47% -
471.omnetpp (max) (percentage) 74.64% 1.380 2.410 - 29.57% -
433.milc (unexplained diff vs previous) (percentage) 37.91% 1.530 2.110 - 201.43% -
433.milc (unexplained diff vs previous) 35.29% 17.000 23.000 - -76.04% -
462.libquantum (max) (percentage) 31.62% 1.360 1.790 - 2137.50% -
433.milc (max) 29.41% 17.000 22.000 - -77.32% -
433.milc (max) (percentage) 29.37% 1.600 2.070 - 191.55% -
464.h264ref (max) (percentage) 17.74% 0.620 0.730 - 87.18% -
459.GemsFDTD (max) (percentage) 16.98% 0.530 0.620 - -72.81% -
459.GemsFDTD (max) 16.22% 37.000 43.000 - -92.56% -
464.h264ref (max) 15.79% 38.000 44.000 - -25.42% -
482.sphinx3 (unexplained diff vs previous) (percentage) 15.35% 4.040 4.660 - 52.29% -
456.hmmer (max) 11.11% 18.000 20.000 - -79.59% -
456.hmmer (max) (percentage) 11.11% 0.450 0.500 - -3.85% -
456.hmmer (unexplained diff vs previous) (percentage) 11.11% 0.450 0.500 - -3.85% -
456.hmmer (unexplained diff vs previous) 10.53% 19.000 21.000 - -78.57% -
482.sphinx3 (unexplained diff vs previous) 10.26% 39.000 43.000 - -96.15% -
429.mcf 4.17% 48.000 50.000 - -10.71% -
429.mcf (avg) 4.17% 48.000 50.000 - -10.71% -
471.omnetpp 4.17% 48.000 50.000 - -54.13% -
471.omnetpp (avg) 4.17% 48.000 50.000 - -54.13% -
453.povray (avg) (percentage) 2.08% 1.440 1.470 - -3.92% -
482.sphinx3 (avg) (percentage) 1.69% 1.780 1.810 - -22.98% -
437.leslie3d (avg) (percentage) 1.19% 5.030 5.090 - 204.79% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
437.leslie3d -9.16% 13089.000 11890.000 - -34.20% -
482.sphinx3 -4.46% 965.000 922.000 - -97.48% -
453.povray -3.61% 554.000 534.000 - -92.78% -
450.soplex -3.25% 616.000 596.000 - -96.21% -
433.milc -2.07% 1111.000 1088.000 - -92.04% -
444.namd -1.95% 922.000 904.000 - -94.33% -
462.libquantum -1.79% 224.000 220.000 - -98.71% -
401.bzip2 -1.34% 2908.000 2869.000 - -83.09% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
400.perlbench (unexplained diff vs previous) -77.78% 9.000 2.000 - -94.29% -
400.perlbench (unexplained diff vs previous) (percentage) -77.59% 0.580 0.130 - -58.06% -
435.gromacs (unexplained diff vs previous) -75.19% 129.000 32.000 - -89.04% -
435.gromacs (unexplained diff vs previous) (percentage) -74.85% 1.710 0.430 - -75.14% -
445.gobmk (max) -62.26% 53.000 20.000 - -39.39% -
445.gobmk (max) (percentage) -61.32% 1.060 0.410 - 51.85% -
410.bwaves (unexplained diff vs previous) -50.00% 24.000 12.000 - -95.33% -
410.bwaves (unexplained diff vs previous) (percentage) -50.00% 0.400 0.200 - -88.51% -
435.gromacs (max) -46.73% 214.000 114.000 - -61.49% -
435.gromacs (max) (percentage) -46.48% 2.840 1.520 - -13.64% -
445.gobmk (unexplained diff vs previous) -41.67% 24.000 14.000 - -22.22% -
445.gobmk (unexplained diff vs previous) (percentage) -40.43% 0.470 0.280 - 86.67% -
447.dealII (unexplained diff vs previous) -37.50% 24.000 15.000 - -77.94% -
447.dealII (unexplained diff vs previous) (percentage) -36.59% 1.230 0.780 - 4.00% -
429.mcf (max) (percentage) -27.89% 5.880 4.240 - 1225.00% -
429.mcf (max) -25.71% 70.000 52.000 - 40.54% -
429.mcf (unexplained diff vs previous) (percentage) -22.60% 4.690 3.630 - 3933.33% -
437.leslie3d (unexplained diff vs previous) -22.29% 1543.000 1199.000 - 541.18% -
437.leslie3d (max) -20.54% 1748.000 1389.000 - 148.04% -
429.mcf (unexplained diff vs previous) -19.64% 56.000 45.000 - 350.00% -
437.leslie3d (unexplained diff vs previous) (percentage) -14.50% 11.790 10.080 - 878.64% -
437.leslie3d (max) (percentage) -12.50% 13.360 11.690 - 277.10% -
482.sphinx3 (max) -10.00% 50.000 45.000 - -96.09% -
450.soplex (max) -8.70% 23.000 21.000 - -69.57% -
437.leslie3d -8.05% 658.000 605.000 - 101.00% -
437.leslie3d (avg) -8.05% 658.000 605.000 - 101.00% -
473.astar (max) -7.25% 69.000 64.000 - 4.92% -
447.dealII (max) -6.45% 31.000 29.000 - -80.67% -
450.soplex (max) (percentage) -6.43% 3.890 3.640 - 727.27% -
473.astar (max) (percentage) -6.34% 1.420 1.330 - 182.98% -
434.zeusmp (max) (percentage) -6.33% 0.790 0.740 - -67.83% -
450.soplex -6.25% 16.000 15.000 - -59.46% -
450.soplex (avg) -6.25% 16.000 15.000 - -59.46% -
447.dealII (max) (percentage) -6.17% 1.620 1.520 - -7.88% -
400.perlbench (max) -6.12% 49.000 46.000 - -48.31% -
482.sphinx3 -5.88% 17.000 16.000 - -98.14% -
482.sphinx3 (avg) -5.88% 17.000 16.000 - -98.14% -
482.sphinx3 (max) (percentage) -5.75% 5.220 4.920 - 56.19% -
400.perlbench (max) (percentage) -5.68% 3.170 2.990 - 273.75% -
434.zeusmp (max) -4.76% 21.000 20.000 - -95.84% -
456.hmmer -4.76% 21.000 20.000 - -64.29% -
456.hmmer (avg) -4.76% 21.000 20.000 - -64.29% -
401.bzip2 (max) -4.69% 64.000 61.000 - -8.96% -
465.tonto (max) -4.14% 266.000 255.000 - 14.35% -
401.bzip2 (max) (percentage) -3.59% 2.230 2.150 - 437.50% -
465.tonto (max) (percentage) -3.40% 2.060 1.990 - 16.37% -
470.lbm (max) (percentage) -3.03% 1.320 1.280 - -76.64% -
458.sjeng (max) -2.56% 39.000 38.000 - -20.83% -
459.GemsFDTD -2.47% 81.000 79.000 - -77.56% -
459.GemsFDTD (avg) -2.47% 81.000 79.000 - -77.56% -
410.bwaves (max) (percentage) -2.33% 0.860 0.840 - -52.54% -
436.cactusADM (max) (percentage) -2.08% 0.480 0.470 - -90.69% -
470.lbm (max) -2.08% 48.000 47.000 - -94.74% -
458.sjeng (max) (percentage) -1.96% 0.510 0.500 - 66.67% -
410.bwaves (max) -1.96% 51.000 50.000 - -80.77% -
410.bwaves -1.85% 54.000 53.000 - -81.66% -
410.bwaves (avg) -1.85% 54.000 53.000 - -81.66% -
458.sjeng (avg) (percentage) -1.61% 0.620 0.610 - 165.22% -
435.gromacs -1.52% 132.000 130.000 - -18.75% -
435.gromacs (avg) -1.52% 132.000 130.000 - -18.75% -
473.astar -1.39% 72.000 71.000 - 39.22% -
473.astar (avg) -1.39% 72.000 71.000 - 39.22% -
400.perlbench (avg) (percentage) -1.32% 1.510 1.490 - 282.05% -
436.cactusADM (avg) (percentage) -1.27% 0.790 0.780 - -67.50% -
435.gromacs (avg) (percentage) -1.14% 1.750 1.730 - 82.11% -
410.bwaves (avg) (percentage) -1.10% 0.910 0.900 - -54.08% -
434.zeusmp (avg) (percentage) -1.04% 0.960 0.950 - -22.13% -

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
465.tonto 1.86% 1437761.000 1464510.000 - 0.00% -
473.astar 1.78% 15549.000 15825.000 - 0.00% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
429.mcf (unexplained diff vs previous) (percentage) 3933.33% 0.090 3.630 - -22.60% -
462.libquantum (unexplained diff vs previous) (percentage) 2175.00% 0.080 1.820 - 304.44% -
462.libquantum (max) (percentage) 2137.50% 0.080 1.790 - 31.62% -
429.mcf (max) (percentage) 1225.00% 0.320 4.240 - -27.89% -
403.gcc (max) (percentage) 1066.10% 0.590 6.880 - -0.29% -
450.soplex (avg) (percentage) 1008.33% 0.240 2.660 - 0.38% -
437.leslie3d (unexplained diff vs previous) (percentage) 878.64% 1.030 10.080 - -14.50% -
429.mcf (avg) (percentage) 745.83% 0.480 4.060 - 0.00% -
450.soplex (max) (percentage) 727.27% 0.440 3.640 - -6.43% -
450.soplex (unexplained diff vs previous) (percentage) 663.64% 0.440 3.360 - 2000.00% -
462.libquantum (avg) (percentage) 600.00% 0.190 1.330 - 0.76% -
437.leslie3d (unexplained diff vs previous) 541.18% 187.000 1199.000 - -22.29% -
401.bzip2 (avg) (percentage) 507.41% 0.270 1.640 - 0.00% -
403.gcc (avg) (percentage) 451.16% 0.430 2.370 - 0.00% -
401.bzip2 (max) (percentage) 437.50% 0.400 2.150 - -3.59% -
429.mcf (unexplained diff vs previous) 350.00% 10.000 45.000 - -19.64% -
454.calculix (max) (percentage) 309.52% 0.840 3.440 - 0.00% -
400.perlbench (avg) (percentage) 282.05% 0.390 1.490 - -1.32% -
445.gobmk (avg) (percentage) 281.82% 0.220 0.840 - 0.00% -
437.leslie3d (max) (percentage) 277.10% 3.100 11.690 - -12.50% -
400.perlbench (max) (percentage) 273.75% 0.800 2.990 - -5.68% -
473.astar (avg) (percentage) 270.00% 0.400 1.480 - -0.67% -
471.omnetpp (unexplained diff vs previous) (percentage) 250.75% 0.670 2.350 - 86.51% -
401.bzip2 (unexplained diff vs previous) (percentage) 231.71% 0.410 1.360 - 547.62% -
437.leslie3d (avg) (percentage) 204.79% 1.670 5.090 - 1.19% -
433.milc (unexplained diff vs previous) (percentage) 201.43% 0.700 2.110 - 37.91% -
433.milc (max) (percentage) 191.55% 0.710 2.070 - 29.37% -
473.astar (max) (percentage) 182.98% 0.470 1.330 - -6.34% -
458.sjeng (avg) (percentage) 165.22% 0.230 0.610 - -1.61% -
437.leslie3d (max) 148.04% 560.000 1389.000 - -20.54% -
483.xalancbmk (avg) (percentage) 103.57% 0.560 1.140 - 0.00% -
437.leslie3d 101.00% 301.000 605.000 - -8.05% -
437.leslie3d (avg) 101.00% 301.000 605.000 - -8.05% -
464.h264ref (unexplained diff vs previous) (percentage) 94.74% 0.380 0.740 - 640.00% -
464.h264ref (max) (percentage) 87.18% 0.390 0.730 - 17.74% -
445.gobmk (unexplained diff vs previous) (percentage) 86.67% 0.150 0.280 - -40.43% -
435.gromacs (avg) (percentage) 82.11% 0.950 1.730 - -1.14% -
464.h264ref (avg) (percentage) 74.36% 0.390 0.680 - 0.00% -
433.milc (avg) (percentage) 69.57% 0.690 1.170 - 0.86% -
454.calculix (avg) (percentage) 69.46% 2.030 3.440 - 0.00% -
456.hmmer (avg) (percentage) 66.67% 0.300 0.500 - 0.00% -
458.sjeng (max) (percentage) 66.67% 0.300 0.500 - -1.96% -
453.povray (unexplained diff vs previous) (percentage) 63.76% 2.290 3.750 - 316.67% -
483.xalancbmk (max) (percentage) 63.04% 0.920 1.500 - 0.00% -
473.astar (unexplained diff vs previous) (percentage) 59.57% 0.470 0.750 - 141.94% -
482.sphinx3 (max) (percentage) 56.19% 3.150 4.920 - -5.75% -
445.gobmk 55.56% 27.000 42.000 - 0.00% -
445.gobmk (avg) 55.56% 27.000 42.000 - 0.00% -
482.sphinx3 (unexplained diff vs previous) (percentage) 52.29% 3.060 4.660 - 15.35% -
445.gobmk (max) (percentage) 51.85% 0.270 0.410 - -61.32% -
471.omnetpp (avg) (percentage) 50.00% 1.180 1.770 - 0.57% -
447.dealII (avg) (percentage) 45.98% 0.870 1.270 - 0.00% -
429.mcf (max) 40.54% 37.000 52.000 - -25.71% -
453.povray (max) (percentage) 39.38% 2.590 3.610 - 225.23% -
473.astar 39.22% 51.000 71.000 - -1.39% -
473.astar (avg) 39.22% 51.000 71.000 - -1.39% -
458.sjeng 30.56% 36.000 47.000 - 0.00% -
458.sjeng (avg) 30.56% 36.000 47.000 - 0.00% -
471.omnetpp (max) (percentage) 29.57% 1.860 2.410 - 74.64% -
465.tonto (max) (percentage) 16.37% 1.710 1.990 - -3.40% -
465.tonto (max) 14.35% 223.000 255.000 - -4.14% -
471.omnetpp (unexplained diff vs previous) 8.06% 62.000 67.000 - 91.43% -
473.astar (max) 4.92% 61.000 64.000 - -7.25% -
401.bzip2 4.44% 45.000 47.000 - 0.00% -
401.bzip2 (avg) 4.44% 45.000 47.000 - 0.00% -
447.dealII (unexplained diff vs previous) (percentage) 4.00% 0.750 0.780 - -36.59% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -17.24% 29.000 24.000 - 0.00% -
nb_execution_successful -17.24% 29.000 24.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
470.lbm -5.86% 10845.000 10209.000 - 0.00% -
437.leslie3d -3.79% 48001.000 46184.000 - 0.00% -
434.zeusmp -1.66% 141060.000 138714.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
462.libquantum -98.71% 17005.000 220.000 - -1.79% -
482.sphinx3 -97.48% 36586.000 922.000 - -4.46% -
450.soplex -96.21% 15709.000 596.000 - -3.25% -
444.namd -94.33% 15957.000 904.000 - -1.95% -
453.povray -92.78% 7395.000 534.000 - -3.61% -
433.milc -92.04% 13668.000 1088.000 - -2.07% -
429.mcf -89.43% 11727.000 1240.000 - 3.77% -
436.cactusADM -89.31% 24396.000 2608.000 - -0.04% -
434.zeusmp -86.77% 20932.000 2770.000 - -0.18% -
400.perlbench -86.17% 11215.000 1551.000 - -0.13% -
401.bzip2 -83.09% 16971.000 2869.000 - -1.34% -
447.dealII -78.79% 9101.000 1930.000 - -0.77% -
456.hmmer -77.95% 18995.000 4188.000 - -0.50% -
470.lbm -77.46% 16312.000 3677.000 - -0.38% -
459.GemsFDTD -72.09% 25364.000 7078.000 - -0.62% -
471.omnetpp -69.27% 9265.000 2847.000 - 2.41% -
473.astar -62.84% 12983.000 4824.000 - -0.74% -
464.h264ref -59.74% 15208.000 6122.000 - -0.73% -
410.bwaves -59.32% 14745.000 5998.000 - -0.20% -
445.gobmk -59.10% 12396.000 5070.000 - -0.28% -
435.gromacs -55.38% 16853.000 7520.000 - -0.42% -
458.sjeng -51.87% 16018.000 7710.000 - 0.22% -
437.leslie3d -34.20% 18070.000 11890.000 - -9.16% -
465.tonto -1.45% 13044.000 12855.000 - -0.61% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
436.cactusADM (unexplained diff vs previous) -99.91% 1173.000 1.000 - 0.00% -
436.cactusADM (unexplained diff vs previous) (percentage) -99.17% 4.810 0.040 - 0.00% -
436.cactusADM (max) -99.03% 1231.000 12.000 - 0.00% -
434.zeusmp (unexplained diff vs previous) -98.94% 470.000 5.000 - 0.00% -
470.lbm (unexplained diff vs previous) -98.30% 822.000 14.000 - 600.00% -
482.sphinx3 -98.14% 859.000 16.000 - -5.88% -
482.sphinx3 (avg) -98.14% 859.000 16.000 - -5.88% -
444.namd (max) -98.07% 879.000 17.000 - 325.00% -
444.namd (unexplained diff vs previous) -97.84% 834.000 18.000 - 500.00% -
444.namd -97.83% 414.000 9.000 - 0.00% -
444.namd (avg) -97.83% 414.000 9.000 - 0.00% -
436.cactusADM -96.58% 585.000 20.000 - 0.00% -
436.cactusADM (avg) -96.58% 585.000 20.000 - 0.00% -
416.gamess (max) (percentage) -96.18% 3.140 0.120 - 0.00% -
482.sphinx3 (unexplained diff vs previous) -96.15% 1118.000 43.000 - 10.26% -
482.sphinx3 (max) -96.09% 1152.000 45.000 - -10.00% -
434.zeusmp (max) -95.84% 481.000 20.000 - -4.76% -
410.bwaves (unexplained diff vs previous) -95.33% 257.000 12.000 - -50.00% -
470.lbm (max) -94.74% 893.000 47.000 - -2.08% -
400.perlbench (unexplained diff vs previous) -94.29% 35.000 2.000 - -77.78% -
470.lbm -93.91% 608.000 37.000 - 0.00% -
470.lbm (avg) -93.91% 608.000 37.000 - 0.00% -
453.povray -93.81% 113.000 7.000 - 0.00% -
453.povray (avg) -93.81% 113.000 7.000 - 0.00% -
462.libquantum -93.75% 32.000 2.000 - 0.00% -
462.libquantum (avg) -93.75% 32.000 2.000 - 0.00% -
481.wrf (max) (percentage) -93.75% 4.160 0.260 - 0.00% -
459.GemsFDTD (max) -92.56% 578.000 43.000 - 16.22% -
459.GemsFDTD (unexplained diff vs previous) -92.47% 584.000 44.000 - 780.00% -
470.lbm (unexplained diff vs previous) (percentage) -92.46% 5.040 0.380 - 660.00% -
434.zeusmp (unexplained diff vs previous) (percentage) -92.00% 2.250 0.180 - 0.00% -
436.cactusADM (max) (percentage) -90.69% 5.050 0.470 - -2.08% -
453.povray (max) -90.05% 191.000 19.000 - 216.67% -
434.zeusmp -89.80% 255.000 26.000 - 0.00% -
434.zeusmp (avg) -89.80% 255.000 26.000 - 0.00% -
435.gromacs (unexplained diff vs previous) -89.04% 292.000 32.000 - -75.19% -
410.bwaves (unexplained diff vs previous) (percentage) -88.51% 1.740 0.200 - -50.00% -
453.povray (unexplained diff vs previous) -88.17% 169.000 20.000 - 300.00% -
433.milc -87.23% 94.000 12.000 - 0.00% -
433.milc (avg) -87.23% 94.000 12.000 - 0.00% -
410.bwaves -81.66% 289.000 53.000 - -1.85% -
410.bwaves (avg) -81.66% 289.000 53.000 - -1.85% -
410.bwaves (max) -80.77% 260.000 50.000 - -1.96% -
447.dealII (max) -80.67% 150.000 29.000 - -6.45% -
456.hmmer (max) -79.59% 98.000 20.000 - 11.11% -
456.hmmer (unexplained diff vs previous) -78.57% 98.000 21.000 - 10.53% -
447.dealII (unexplained diff vs previous) -77.94% 68.000 15.000 - -37.50% -
459.GemsFDTD -77.56% 352.000 79.000 - -2.47% -
459.GemsFDTD (avg) -77.56% 352.000 79.000 - -2.47% -
433.milc (max) -77.32% 97.000 22.000 - 29.41% -
462.libquantum (max) -76.92% 13.000 3.000 - 0.00% -
470.lbm (max) (percentage) -76.64% 5.480 1.280 - -3.03% -
433.milc (unexplained diff vs previous) -76.04% 96.000 23.000 - 35.29% -
435.gromacs (unexplained diff vs previous) (percentage) -75.14% 1.730 0.430 - -74.85% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -73.04% 2.300 0.620 - 785.71% -
470.lbm (avg) (percentage) -72.92% 3.730 1.010 - -0.98% -
459.GemsFDTD (max) (percentage) -72.81% 2.280 0.620 - 16.98% -
462.libquantum (unexplained diff vs previous) -71.43% 14.000 4.000 - 300.00% -
450.soplex (unexplained diff vs previous) -71.01% 69.000 20.000 - 1900.00% -
447.dealII -69.62% 79.000 24.000 - 0.00% -
447.dealII (avg) -69.62% 79.000 24.000 - 0.00% -
450.soplex (max) -69.57% 69.000 21.000 - -8.70% -
434.zeusmp (max) (percentage) -67.83% 2.300 0.740 - -6.33% -
436.cactusADM (avg) (percentage) -67.50% 2.400 0.780 - -1.27% -
444.namd (max) (percentage) -64.61% 5.510 1.950 - 282.35% -
458.sjeng (unexplained diff vs previous) -64.58% 48.000 17.000 - 112.50% -
456.hmmer -64.29% 56.000 20.000 - -4.76% -
456.hmmer (avg) -64.29% 56.000 20.000 - -4.76% -
444.namd (unexplained diff vs previous) (percentage) -61.95% 5.230 1.990 - 503.03% -
435.gromacs (max) -61.49% 296.000 114.000 - -46.73% -
444.namd (avg) (percentage) -60.77% 2.600 1.020 - 0.99% -
471.omnetpp (max) -60.47% 172.000 68.000 - 78.95% -
450.soplex -59.46% 37.000 15.000 - -6.25% -
450.soplex (avg) -59.46% 37.000 15.000 - -6.25% -
400.perlbench (unexplained diff vs previous) (percentage) -58.06% 0.310 0.130 - -77.59% -
471.omnetpp -54.13% 109.000 50.000 - 4.17% -
471.omnetpp (avg) -54.13% 109.000 50.000 - 4.17% -
410.bwaves (avg) (percentage) -54.08% 1.960 0.900 - -1.10% -
410.bwaves (max) (percentage) -52.54% 1.770 0.840 - -2.33% -
416.gamess (avg) (percentage) -48.48% 1.650 0.850 - 0.00% -
400.perlbench (max) -48.31% 89.000 46.000 - -6.12% -
465.tonto (unexplained diff vs previous) -46.62% 148.000 79.000 - 426.67% -
400.perlbench -46.51% 43.000 23.000 - 0.00% -
400.perlbench (avg) -46.51% 43.000 23.000 - 0.00% -
465.tonto (unexplained diff vs previous) (percentage) -46.02% 1.130 0.610 - 408.33% -
401.bzip2 (unexplained diff vs previous) -43.48% 69.000 39.000 - 550.00% -
473.astar (unexplained diff vs previous) -40.98% 61.000 36.000 - 140.00% -
445.gobmk (max) -39.39% 33.000 20.000 - -62.26% -
464.h264ref -30.51% 59.000 41.000 - 0.00% -
464.h264ref (avg) -30.51% 59.000 41.000 - 0.00% -
481.wrf (avg) (percentage) -28.02% 2.570 1.850 - 0.00% -
458.sjeng (unexplained diff vs previous) (percentage) -26.67% 0.300 0.220 - 120.00% -
465.tonto -25.68% 148.000 110.000 - -0.90% -
465.tonto (avg) -25.68% 148.000 110.000 - -0.90% -
464.h264ref (max) -25.42% 59.000 44.000 - 15.79% -
465.tonto (avg) (percentage) -24.56% 1.140 0.860 - 0.00% -
482.sphinx3 (avg) (percentage) -22.98% 2.350 1.810 - 1.69% -
464.h264ref (unexplained diff vs previous) -22.41% 58.000 45.000 - 650.00% -
445.gobmk (unexplained diff vs previous) -22.22% 18.000 14.000 - -41.67% -
434.zeusmp (avg) (percentage) -22.13% 1.220 0.950 - -1.04% -
458.sjeng (max) -20.83% 48.000 38.000 - -2.56% -
435.gromacs -18.75% 160.000 130.000 - -1.52% -
435.gromacs (avg) -18.75% 160.000 130.000 - -1.52% -
459.GemsFDTD (avg) (percentage) -18.71% 1.390 1.130 - -0.88% -
435.gromacs (max) (percentage) -13.64% 1.760 1.520 - -46.48% -
429.mcf -10.71% 56.000 50.000 - 4.17% -
429.mcf (avg) -10.71% 56.000 50.000 - 4.17% -
401.bzip2 (max) -8.96% 67.000 61.000 - -4.69% -
447.dealII (max) (percentage) -7.88% 1.650 1.520 - -6.17% -
453.povray (avg) (percentage) -3.92% 1.530 1.470 - 2.08% -
456.hmmer (max) (percentage) -3.85% 0.520 0.500 - 11.11% -
456.hmmer (unexplained diff vs previous) (percentage) -3.85% 0.520 0.500 - 11.11% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 17.24% 29.000 34.000 - 0.00% -

Report Time: 0.39s
Execution (seconds)
Name Current %
400.perlbench 1551.000 -
401.bzip2 2869.000 -1.34%
410.bwaves 5998.000 -
429.mcf 1240.000 3.77%
433.milc 1088.000 -2.07%
434.zeusmp 2770.000 -
435.gromacs 7520.000 -
436.cactusADM 2608.000 -
437.leslie3d 11890.000 -9.16%
444.namd 904.000 -1.95%
445.gobmk 5070.000 -
447.dealII 1930.000 -
450.soplex 596.000 -3.25%
453.povray 534.000 -3.61%
456.hmmer 4188.000 -
458.sjeng 7710.000 -
459.GemsFDTD 7078.000 -
462.libquantum 220.000 -1.79%
464.h264ref 6122.000 -
465.tonto 12855.000 -
470.lbm 3677.000 -
471.omnetpp 2847.000 2.41%
473.astar 4824.000 -
482.sphinx3 922.000 -4.46%
Geometric Mean 2630.643 -1.15%
Code Size (bytes)
Name Current %
400.perlbench 562074.000 -
401.bzip2 33394.000 -
410.bwaves 14723.000 -
429.mcf 7713.000 -
433.milc 47729.000 -
434.zeusmp 138714.000 -
435.gromacs 393002.000 -
436.cactusADM 256626.000 -
437.leslie3d 46184.000 -
444.namd 163131.000 -
445.gobmk 1087548.000 -
447.dealII 189727.000 -
450.soplex 135852.000 -
453.povray 493733.000 -
456.hmmer 74385.000 -
458.sjeng 81345.000 -
459.GemsFDTD 194087.000 -
462.libquantum 13114.000 -
464.h264ref 301478.000 -
465.tonto 1464510.000 -
470.lbm 10209.000 -
471.omnetpp 296077.000 -
473.astar 15825.000 -
482.sphinx3 79594.000 -
Geometric Mean 105768.489 -
sample variability
Name Current %
400.perlbench 23.000 -
400.perlbench (avg) 23.000 -
400.perlbench (avg) (percentage) 1.490 -1.32%
400.perlbench (max) 46.000 -6.12%
400.perlbench (max) (percentage) 2.990 -5.68%
400.perlbench (unexplained diff vs previous) 2.000 -77.78%
400.perlbench (unexplained diff vs previous) (percentage) 0.130 -77.59%
401.bzip2 47.000 -
401.bzip2 (avg) 47.000 -
401.bzip2 (avg) (percentage) 1.640 -
401.bzip2 (max) 61.000 -4.69%
401.bzip2 (max) (percentage) 2.150 -3.59%
401.bzip2 (unexplained diff vs previous) 39.000 550.00%
401.bzip2 (unexplained diff vs previous) (percentage) 1.360 547.62%
403.gcc (avg) (percentage) 2.370 -
403.gcc (max) (percentage) 6.880 -
410.bwaves 53.000 -1.85%
410.bwaves (avg) 53.000 -1.85%
410.bwaves (avg) (percentage) 0.900 -1.10%
410.bwaves (max) 50.000 -1.96%
410.bwaves (max) (percentage) 0.840 -2.33%
410.bwaves (unexplained diff vs previous) 12.000 -50.00%
410.bwaves (unexplained diff vs previous) (percentage) 0.200 -50.00%
416.gamess (avg) (percentage) 0.850 -
416.gamess (max) (percentage) 0.120 -
429.mcf 50.000 4.17%
429.mcf (avg) 50.000 4.17%
429.mcf (avg) (percentage) 4.060 -
429.mcf (max) 52.000 -25.71%
429.mcf (max) (percentage) 4.240 -27.89%
429.mcf (unexplained diff vs previous) 45.000 -19.64%
429.mcf (unexplained diff vs previous) (percentage) 3.630 -22.60%
433.milc 12.000 -
433.milc (avg) 12.000 -
433.milc (avg) (percentage) 1.170 -
433.milc (max) 22.000 29.41%
433.milc (max) (percentage) 2.070 29.37%
433.milc (unexplained diff vs previous) 23.000 35.29%
433.milc (unexplained diff vs previous) (percentage) 2.110 37.91%
434.zeusmp 26.000 -
434.zeusmp (avg) 26.000 -
434.zeusmp (avg) (percentage) 0.950 -1.04%
434.zeusmp (max) 20.000 -4.76%
434.zeusmp (max) (percentage) 0.740 -6.33%
434.zeusmp (unexplained diff vs previous) 5.000 -
434.zeusmp (unexplained diff vs previous) (percentage) 0.180 -
435.gromacs 130.000 -1.52%
435.gromacs (avg) 130.000 -1.52%
435.gromacs (avg) (percentage) 1.730 -1.14%
435.gromacs (max) 114.000 -46.73%
435.gromacs (max) (percentage) 1.520 -46.48%
435.gromacs (unexplained diff vs previous) 32.000 -75.19%
435.gromacs (unexplained diff vs previous) (percentage) 0.430 -74.85%
436.cactusADM 20.000 -
436.cactusADM (avg) 20.000 -
436.cactusADM (avg) (percentage) 0.780 -1.27%
436.cactusADM (max) 12.000 -
436.cactusADM (max) (percentage) 0.470 -2.08%
436.cactusADM (unexplained diff vs previous) 1.000 -
436.cactusADM (unexplained diff vs previous) (percentage) 0.040 -
437.leslie3d 605.000 -8.05%
437.leslie3d (avg) 605.000 -8.05%
437.leslie3d (avg) (percentage) 5.090 1.19%
437.leslie3d (max) 1389.000 -20.54%
437.leslie3d (max) (percentage) 11.690 -12.50%
437.leslie3d (unexplained diff vs previous) 1199.000 -22.29%
437.leslie3d (unexplained diff vs previous) (percentage) 10.080 -14.50%
444.namd 9.000 -
444.namd (avg) 9.000 -
444.namd (avg) (percentage) 1.020 -
444.namd (max) 17.000 325.00%
444.namd (max) (percentage) 1.950 282.35%
444.namd (unexplained diff vs previous) 18.000 500.00%
444.namd (unexplained diff vs previous) (percentage) 1.990 503.03%
445.gobmk 42.000 -
445.gobmk (avg) 42.000 -
445.gobmk (avg) (percentage) 0.840 -
445.gobmk (max) 20.000 -62.26%
445.gobmk (max) (percentage) 0.410 -61.32%
445.gobmk (unexplained diff vs previous) 14.000 -41.67%
445.gobmk (unexplained diff vs previous) (percentage) 0.280 -40.43%
447.dealII 24.000 -
447.dealII (avg) 24.000 -
447.dealII (avg) (percentage) 1.270 -
447.dealII (max) 29.000 -6.45%
447.dealII (max) (percentage) 1.520 -6.17%
447.dealII (unexplained diff vs previous) 15.000 -37.50%
447.dealII (unexplained diff vs previous) (percentage) 0.780 -36.59%
450.soplex 15.000 -6.25%
450.soplex (avg) 15.000 -6.25%
450.soplex (avg) (percentage) 2.660 -
450.soplex (max) 21.000 -8.70%
450.soplex (max) (percentage) 3.640 -6.43%
450.soplex (unexplained diff vs previous) 20.000 1900.00%
450.soplex (unexplained diff vs previous) (percentage) 3.360 2000.00%
453.povray 7.000 -
453.povray (avg) 7.000 -
453.povray (avg) (percentage) 1.470 2.08%
453.povray (max) 19.000 216.67%
453.povray (max) (percentage) 3.610 225.23%
453.povray (unexplained diff vs previous) 20.000 300.00%
453.povray (unexplained diff vs previous) (percentage) 3.750 316.67%
454.calculix (avg) (percentage) 3.440 -
454.calculix (max) (percentage) 3.440 -
456.hmmer 20.000 -4.76%
456.hmmer (avg) 20.000 -4.76%
456.hmmer (avg) (percentage) 0.500 -
456.hmmer (max) 20.000 11.11%
456.hmmer (max) (percentage) 0.500 11.11%
456.hmmer (unexplained diff vs previous) 21.000 10.53%
456.hmmer (unexplained diff vs previous) (percentage) 0.500 11.11%
458.sjeng 47.000 -
458.sjeng (avg) 47.000 -
458.sjeng (avg) (percentage) 0.610 -1.61%
458.sjeng (max) 38.000 -2.56%
458.sjeng (max) (percentage) 0.500 -1.96%
458.sjeng (unexplained diff vs previous) 17.000 112.50%
458.sjeng (unexplained diff vs previous) (percentage) 0.220 120.00%
459.GemsFDTD 79.000 -2.47%
459.GemsFDTD (avg) 79.000 -2.47%
459.GemsFDTD (avg) (percentage) 1.130 -
459.GemsFDTD (max) 43.000 16.22%
459.GemsFDTD (max) (percentage) 0.620 16.98%
459.GemsFDTD (unexplained diff vs previous) 44.000 780.00%
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.620 785.71%
462.libquantum 2.000 -
462.libquantum (avg) 2.000 -
462.libquantum (avg) (percentage) 1.330 -
462.libquantum (max) 3.000 -
462.libquantum (max) (percentage) 1.790 31.62%
462.libquantum (unexplained diff vs previous) 4.000 300.00%
462.libquantum (unexplained diff vs previous) (percentage) 1.820 304.44%
464.h264ref 41.000 -
464.h264ref (avg) 41.000 -
464.h264ref (avg) (percentage) 0.680 -
464.h264ref (max) 44.000 15.79%
464.h264ref (max) (percentage) 0.730 17.74%
464.h264ref (unexplained diff vs previous) 45.000 650.00%
464.h264ref (unexplained diff vs previous) (percentage) 0.740 640.00%
465.tonto 110.000 -
465.tonto (avg) 110.000 -
465.tonto (avg) (percentage) 0.860 -
465.tonto (max) 255.000 -4.14%
465.tonto (max) (percentage) 1.990 -3.40%
465.tonto (unexplained diff vs previous) 79.000 426.67%
465.tonto (unexplained diff vs previous) (percentage) 0.610 408.33%
470.lbm 37.000 -
470.lbm (avg) 37.000 -
470.lbm (avg) (percentage) 1.010 -
470.lbm (max) 47.000 -2.08%
470.lbm (max) (percentage) 1.280 -3.03%
470.lbm (unexplained diff vs previous) 14.000 600.00%
470.lbm (unexplained diff vs previous) (percentage) 0.380 660.00%
471.omnetpp 50.000 4.17%
471.omnetpp (avg) 50.000 4.17%
471.omnetpp (avg) (percentage) 1.770 -
471.omnetpp (max) 68.000 78.95%
471.omnetpp (max) (percentage) 2.410 74.64%
471.omnetpp (unexplained diff vs previous) 67.000 91.43%
471.omnetpp (unexplained diff vs previous) (percentage) 2.350 86.51%
473.astar 71.000 -1.39%
473.astar (avg) 71.000 -1.39%
473.astar (avg) (percentage) 1.480 -
473.astar (max) 64.000 -7.25%
473.astar (max) (percentage) 1.330 -6.34%
473.astar (unexplained diff vs previous) 36.000 140.00%
473.astar (unexplained diff vs previous) (percentage) 0.750 141.94%
481.wrf (avg) (percentage) 1.850 -
481.wrf (max) (percentage) 0.260 -
482.sphinx3 16.000 -5.88%
482.sphinx3 (avg) 16.000 -5.88%
482.sphinx3 (avg) (percentage) 1.810 1.69%
482.sphinx3 (max) 45.000 -10.00%
482.sphinx3 (max) (percentage) 4.920 -5.75%
482.sphinx3 (unexplained diff vs previous) 43.000 10.26%
482.sphinx3 (unexplained diff vs previous) (percentage) 4.660 15.35%
483.xalancbmk (avg) (percentage) 1.140 -
483.xalancbmk (max) (percentage) 1.500 -
Geometric Mean 6.887 30.54%