Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=c33568d2c108478c25fe9959b5ce9d25b97efa6c (unchanged)
git_gcc https://gcc.gnu.org/git/gcc.git (6aba48a8cc128e54ee243d451ac9a843ff41c4f9) (unchanged)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=d7b37322c53e84eba2b35ee118b63f00c057050f (unchanged)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/bfa40f51f6440f26bf7686eca23a2c2e126e3084 (+ 116 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-arm-master-Os_LTO-build/307/
View Options
Report
Filter

gnu-arm-master-Os_LTO test results

Run Order Start Time Duration
Current 0307 (v6.12.8-77720-gbfa40f51f644) 2025-01-01T10:43:31 0:00:00
Previous 0306 (glibc-2.40.9000-00695-gd7b37322c53) 2024-12-29T05:47:28 0:00:00
Baseline 0001 (3-changed-components) 2022-12-30T06:27:35 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 20 67
Performance Improvements 102 143
Unchanged Tests 1114 1026
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
437.leslie3d 7.18% 11639.000 12475.000 - -30.96% -
453.povray 3.45% 522.000 540.000 - -92.70% -
450.soplex 1.26% 555.000 562.000 - -96.42% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
456.hmmer (unexplained diff vs previous) 320.00% 5.000 21.000 - -78.57% -
456.hmmer (unexplained diff vs previous) (percentage) 316.67% 0.120 0.500 - -3.85% -
471.omnetpp (unexplained diff vs previous) 112.50% 8.000 17.000 - -72.58% -
471.omnetpp (unexplained diff vs previous) (percentage) 110.34% 0.290 0.610 - -8.96% -
437.leslie3d (unexplained diff vs previous) 68.55% 496.000 836.000 - 347.06% -
437.leslie3d (unexplained diff vs previous) (percentage) 57.28% 4.260 6.700 - 550.49% -
437.leslie3d (max) 50.67% 594.000 895.000 - 59.82% -
437.leslie3d (max) (percentage) 40.51% 5.110 7.180 - 131.61% -
453.povray (max) 20.00% 15.000 18.000 - -90.58% -
482.sphinx3 (unexplained diff vs previous) (percentage) 17.78% 1.350 1.590 - -48.04% -
482.sphinx3 (unexplained diff vs previous) 16.67% 12.000 14.000 - -98.75% -
453.povray (max) (percentage) 16.16% 2.970 3.450 - 33.20% -
453.povray (unexplained diff vs previous) 12.50% 16.000 18.000 - -89.35% -
453.povray (unexplained diff vs previous) (percentage) 8.47% 3.070 3.330 - 45.41% -
437.leslie3d 7.85% 573.000 618.000 - 105.32% -
437.leslie3d (avg) 7.85% 573.000 618.000 - 105.32% -
453.povray (avg) (percentage) 2.14% 1.400 1.430 - -6.54% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
429.mcf -2.13% 1173.000 1148.000 - -90.21% -
482.sphinx3 -1.57% 892.000 878.000 - -97.60% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
435.gromacs (unexplained diff vs previous) (percentage) -98.86% 4.370 0.050 - -97.11% -
435.gromacs (unexplained diff vs previous) -98.75% 319.000 4.000 - -98.63% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -95.82% 2.390 0.100 - -95.65% -
459.GemsFDTD (unexplained diff vs previous) -95.78% 166.000 7.000 - -98.80% -
473.astar (unexplained diff vs previous) (percentage) -95.76% 4.480 0.190 - -59.57% -
473.astar (unexplained diff vs previous) -95.69% 209.000 9.000 - -85.25% -
470.lbm (unexplained diff vs previous) (percentage) -88.48% 1.650 0.190 - -96.23% -
470.lbm (unexplained diff vs previous) -88.33% 60.000 7.000 - -99.15% -
410.bwaves (unexplained diff vs previous) -88.30% 94.000 11.000 - -95.72% -
410.bwaves (unexplained diff vs previous) (percentage) -88.13% 1.600 0.190 - -89.08% -
464.h264ref (unexplained diff vs previous) (percentage) -87.97% 1.330 0.160 - -57.89% -
464.h264ref (unexplained diff vs previous) -87.65% 81.000 10.000 - -82.76% -
433.milc (unexplained diff vs previous) (percentage) -85.93% 2.630 0.370 - -47.14% -
447.dealII (unexplained diff vs previous) (percentage) -85.81% 1.480 0.210 - -72.00% -
433.milc (unexplained diff vs previous) -85.71% 28.000 4.000 - -95.83% -
447.dealII (unexplained diff vs previous) -85.71% 28.000 4.000 - -94.12% -
434.zeusmp (unexplained diff vs previous) (percentage) -84.62% 2.600 0.400 - -82.22% -
450.soplex (unexplained diff vs previous) (percentage) -84.59% 8.110 1.250 - 184.09% -
434.zeusmp (unexplained diff vs previous) -84.51% 71.000 11.000 - -97.66% -
450.soplex (unexplained diff vs previous) -84.44% 45.000 7.000 - -89.86% -
436.cactusADM (unexplained diff vs previous) -78.12% 32.000 7.000 - -99.40% -
436.cactusADM (unexplained diff vs previous) (percentage) -77.87% 1.220 0.270 - -94.39% -
401.bzip2 (unexplained diff vs previous) (percentage) -75.33% 2.270 0.560 - 36.59% -
401.bzip2 (unexplained diff vs previous) -75.00% 64.000 16.000 - -76.81% -
445.gobmk (unexplained diff vs previous) (percentage) -70.00% 0.800 0.240 - 60.00% -
445.gobmk (unexplained diff vs previous) -70.00% 40.000 12.000 - -33.33% -
465.tonto (unexplained diff vs previous) (percentage) -69.49% 1.770 0.540 - -52.21% -
465.tonto (unexplained diff vs previous) -69.47% 226.000 69.000 - -53.38% -
429.mcf (unexplained diff vs previous) -57.63% 59.000 25.000 - 150.00% -
429.mcf (unexplained diff vs previous) (percentage) -56.66% 5.030 2.180 - 2322.22% -
444.namd (max) (percentage) -55.96% 1.090 0.480 - -91.29% -
444.namd (max) -55.56% 9.000 4.000 - -99.54% -
458.sjeng (unexplained diff vs previous) -46.58% 73.000 39.000 - -18.75% -
400.perlbench (unexplained diff vs previous) (percentage) -45.95% 0.740 0.400 - 29.03% -
458.sjeng (unexplained diff vs previous) (percentage) -45.83% 0.960 0.520 - 73.33% -
400.perlbench (unexplained diff vs previous) -45.45% 11.000 6.000 - -82.86% -
433.milc (max) -25.93% 27.000 20.000 - -79.38% -
447.dealII (max) -25.93% 27.000 20.000 - -86.67% -
465.tonto (max) -25.79% 221.000 164.000 - -26.46% -
459.GemsFDTD (max) -25.31% 162.000 121.000 - -79.07% -
465.tonto (max) (percentage) -25.29% 1.740 1.300 - -23.98% -
434.zeusmp (max) (percentage) -25.20% 2.540 1.900 - -17.39% -
450.soplex (max) (percentage) -25.07% 7.500 5.620 - 1177.27% -
435.gromacs (max) (percentage) -25.06% 4.190 3.140 - 78.41% -
433.milc (max) (percentage) -25.00% 2.560 1.920 - 170.42% -
464.h264ref (max) (percentage) -25.00% 1.320 0.990 - 153.85% -
436.cactusADM (max) -25.00% 32.000 24.000 - -98.05% -
464.h264ref (max) -25.00% 80.000 60.000 - 1.69% -
436.cactusADM (max) (percentage) -25.00% 1.240 0.930 - -81.58% -
435.gromacs (max) -24.92% 305.000 229.000 - -22.64% -
459.GemsFDTD (max) (percentage) -24.89% 2.330 1.750 - -23.25% -
447.dealII (max) (percentage) -24.66% 1.460 1.100 - -33.33% -
434.zeusmp (max) -24.64% 69.000 52.000 - -89.19% -
450.soplex (max) -24.39% 41.000 31.000 - -55.07% -
444.namd (unexplained diff vs previous) -20.00% 5.000 4.000 - -99.52% -
444.namd (unexplained diff vs previous) (percentage) -19.64% 0.560 0.450 - -91.40% -
473.astar (max) (percentage) -16.78% 4.290 3.570 - 659.57% -
473.astar (max) -16.58% 199.000 166.000 - 172.13% -
429.mcf (max) -14.29% 56.000 48.000 - 29.73% -
458.sjeng (max) -13.89% 72.000 62.000 - 29.17% -
458.sjeng (max) (percentage) -12.63% 0.950 0.830 - 176.67% -
401.bzip2 (max) (percentage) -12.61% 2.220 1.940 - 385.00% -
429.mcf (max) (percentage) -12.53% 4.790 4.190 - 1209.38% -
482.sphinx3 (max) -11.76% 34.000 30.000 - -97.40% -
401.bzip2 (max) -11.29% 62.000 55.000 - -17.91% -
400.perlbench (max) (percentage) -10.20% 1.470 1.320 - 65.00% -
482.sphinx3 (max) (percentage) -10.08% 3.870 3.480 - 10.48% -
410.bwaves (max) -9.78% 92.000 83.000 - -68.08% -
400.perlbench (max) -9.52% 21.000 19.000 - -78.65% -
410.bwaves (max) (percentage) -9.49% 1.580 1.430 - -19.21% -
456.hmmer (max) -8.00% 25.000 23.000 - -76.53% -
445.gobmk (max) (percentage) -7.55% 1.060 0.980 - 262.96% -
445.gobmk (max) -7.55% 53.000 49.000 - 48.48% -
456.hmmer (max) (percentage) -6.56% 0.610 0.570 - 9.62% -
470.lbm (max) (percentage) -6.36% 2.200 2.060 - -62.41% -
470.lbm (max) -6.33% 79.000 74.000 - -91.71% -
429.mcf -4.26% 47.000 45.000 - -19.64% -
429.mcf (avg) -4.26% 47.000 45.000 - -19.64% -
462.libquantum (max) (percentage) -3.68% 1.360 1.310 - 1537.50% -
459.GemsFDTD -2.53% 79.000 77.000 - -78.12% -
459.GemsFDTD (avg) -2.53% 79.000 77.000 - -78.12% -
464.h264ref -2.38% 42.000 41.000 - -30.51% -
464.h264ref (avg) -2.38% 42.000 41.000 - -30.51% -
410.bwaves -1.89% 53.000 52.000 - -82.01% -
410.bwaves (avg) -1.89% 53.000 52.000 - -82.01% -
459.GemsFDTD (avg) (percentage) -1.75% 1.140 1.120 - -19.42% -
435.gromacs (avg) (percentage) -1.71% 1.750 1.720 - 81.05% -
435.gromacs -1.57% 127.000 125.000 - -21.88% -
435.gromacs (avg) -1.57% 127.000 125.000 - -21.88% -
447.dealII (avg) (percentage) -1.53% 1.310 1.290 - 48.28% -
473.astar -1.52% 66.000 65.000 - 27.45% -
473.astar (avg) -1.52% 66.000 65.000 - 27.45% -
464.h264ref (avg) (percentage) -1.43% 0.700 0.690 - 76.92% -
400.perlbench (avg) (percentage) -1.32% 1.510 1.490 - 282.05% -
465.tonto (avg) (percentage) -1.25% 0.800 0.790 - -30.70% -
445.gobmk (avg) (percentage) -1.15% 0.870 0.860 - 290.91% -
471.omnetpp (avg) (percentage) -1.11% 1.800 1.780 - 50.85% -
410.bwaves (avg) (percentage) -1.10% 0.910 0.900 - -54.08% -
462.libquantum (unexplained diff vs previous) (percentage) -1.08% 0.930 0.920 - 1050.00% -
434.zeusmp (avg) (percentage) -1.04% 0.960 0.950 - -22.13% -

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
465.tonto 1.86% 1437761.000 1464510.000 - 0.00% -
473.astar 1.78% 15549.000 15825.000 - 0.00% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
429.mcf (unexplained diff vs previous) (percentage) 2322.22% 0.090 2.180 - -56.66% -
462.libquantum (max) (percentage) 1537.50% 0.080 1.310 - -3.68% -
429.mcf (max) (percentage) 1209.38% 0.320 4.190 - -12.53% -
450.soplex (max) (percentage) 1177.27% 0.440 5.620 - -25.07% -
403.gcc (max) (percentage) 1089.83% 0.590 7.020 - -0.28% -
462.libquantum (unexplained diff vs previous) (percentage) 1050.00% 0.080 0.920 - -1.08% -
450.soplex (avg) (percentage) 958.33% 0.240 2.540 - -0.39% -
429.mcf (avg) (percentage) 729.17% 0.480 3.980 - -0.75% -
473.astar (max) (percentage) 659.57% 0.470 3.570 - -16.78% -
462.libquantum (avg) (percentage) 600.00% 0.190 1.330 - -0.75% -
437.leslie3d (unexplained diff vs previous) (percentage) 550.49% 1.030 6.700 - 57.28% -
401.bzip2 (avg) (percentage) 522.22% 0.270 1.680 - -0.59% -
403.gcc (avg) (percentage) 451.16% 0.430 2.370 - 0.00% -
401.bzip2 (max) (percentage) 385.00% 0.400 1.940 - -12.61% -
437.leslie3d (unexplained diff vs previous) 347.06% 187.000 836.000 - 68.55% -
454.calculix (max) (percentage) 310.71% 0.840 3.450 - 0.00% -
445.gobmk (avg) (percentage) 290.91% 0.220 0.860 - -1.15% -
400.perlbench (avg) (percentage) 282.05% 0.390 1.490 - -1.32% -
445.gobmk (max) (percentage) 262.96% 0.270 0.980 - -7.55% -
473.astar (avg) (percentage) 252.50% 0.400 1.410 - -0.70% -
437.leslie3d (avg) (percentage) 197.01% 1.670 4.960 - 0.61% -
450.soplex (unexplained diff vs previous) (percentage) 184.09% 0.440 1.250 - -84.59% -
458.sjeng (max) (percentage) 176.67% 0.300 0.830 - -12.63% -
473.astar (max) 172.13% 61.000 166.000 - -16.58% -
433.milc (max) (percentage) 170.42% 0.710 1.920 - -25.00% -
458.sjeng (avg) (percentage) 165.22% 0.230 0.610 - 0.00% -
464.h264ref (max) (percentage) 153.85% 0.390 0.990 - -25.00% -
429.mcf (unexplained diff vs previous) 150.00% 10.000 25.000 - -57.63% -
437.leslie3d (max) (percentage) 131.61% 3.100 7.180 - 40.51% -
437.leslie3d 105.32% 301.000 618.000 - 7.85% -
437.leslie3d (avg) 105.32% 301.000 618.000 - 7.85% -
483.xalancbmk (avg) (percentage) 103.57% 0.560 1.140 - 0.00% -
435.gromacs (avg) (percentage) 81.05% 0.950 1.720 - -1.71% -
435.gromacs (max) (percentage) 78.41% 1.760 3.140 - -25.06% -
464.h264ref (avg) (percentage) 76.92% 0.390 0.690 - -1.43% -
458.sjeng (unexplained diff vs previous) (percentage) 73.33% 0.300 0.520 - -45.83% -
456.hmmer (avg) (percentage) 70.00% 0.300 0.510 - 0.00% -
454.calculix (avg) (percentage) 69.46% 2.030 3.440 - 0.00% -
400.perlbench (max) (percentage) 65.00% 0.800 1.320 - -10.20% -
433.milc (avg) (percentage) 63.77% 0.690 1.130 - -0.88% -
483.xalancbmk (max) (percentage) 63.04% 0.920 1.500 - 0.00% -
445.gobmk (unexplained diff vs previous) (percentage) 60.00% 0.150 0.240 - -70.00% -
437.leslie3d (max) 59.82% 560.000 895.000 - 50.67% -
445.gobmk 59.26% 27.000 43.000 - 0.00% -
445.gobmk (avg) 59.26% 27.000 43.000 - 0.00% -
471.omnetpp (avg) (percentage) 50.85% 1.180 1.780 - -1.11% -
445.gobmk (max) 48.48% 33.000 49.000 - -7.55% -
447.dealII (avg) (percentage) 48.28% 0.870 1.290 - -1.53% -
453.povray (unexplained diff vs previous) (percentage) 45.41% 2.290 3.330 - 8.47% -
401.bzip2 (unexplained diff vs previous) (percentage) 36.59% 0.410 0.560 - -75.33% -
453.povray (max) (percentage) 33.20% 2.590 3.450 - 16.16% -
429.mcf (max) 29.73% 37.000 48.000 - -14.29% -
458.sjeng (max) 29.17% 48.000 62.000 - -13.89% -
400.perlbench (unexplained diff vs previous) (percentage) 29.03% 0.310 0.400 - -45.95% -
458.sjeng 27.78% 36.000 46.000 - 0.00% -
458.sjeng (avg) 27.78% 36.000 46.000 - 0.00% -
473.astar 27.45% 51.000 65.000 - -1.52% -
473.astar (avg) 27.45% 51.000 65.000 - -1.52% -
482.sphinx3 (max) (percentage) 10.48% 3.150 3.480 - -10.08% -
456.hmmer (max) (percentage) 9.62% 0.520 0.570 - -6.56% -
401.bzip2 4.44% 45.000 47.000 - 0.00% -
401.bzip2 (avg) 4.44% 45.000 47.000 - 0.00% -
464.h264ref (max) 1.69% 59.000 60.000 - -25.00% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -17.24% 29.000 24.000 - 0.00% -
nb_execution_successful -17.24% 29.000 24.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
470.lbm -5.83% 10845.000 10213.000 - 0.00% -
437.leslie3d -3.79% 48001.000 46184.000 - 0.00% -
434.zeusmp -1.66% 141060.000 138714.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
462.libquantum -98.72% 17005.000 218.000 - 0.93% -
482.sphinx3 -97.60% 36586.000 878.000 - -1.57% -
450.soplex -96.42% 15709.000 562.000 - 1.26% -
444.namd -94.38% 15957.000 896.000 - -0.44% -
453.povray -92.70% 7395.000 540.000 - 3.45% -
433.milc -92.17% 13668.000 1070.000 - 0.38% -
429.mcf -90.21% 11727.000 1148.000 - -2.13% -
436.cactusADM -89.31% 24396.000 2607.000 - -0.27% -
434.zeusmp -86.91% 20932.000 2739.000 - 0.40% -
400.perlbench -86.61% 11215.000 1502.000 - 0.40% -
401.bzip2 -83.26% 16971.000 2841.000 - 0.57% -
447.dealII -79.19% 9101.000 1894.000 - 0.21% -
456.hmmer -77.85% 18995.000 4208.000 - 0.50% -
470.lbm -77.80% 16312.000 3621.000 - -0.19% -
459.GemsFDTD -72.60% 25364.000 6951.000 - -0.10% -
471.omnetpp -69.89% 9265.000 2790.000 - 0.61% -
473.astar -64.03% 12983.000 4670.000 - 0.19% -
410.bwaves -60.25% 14745.000 5861.000 - -0.19% -
464.h264ref -60.01% 15208.000 6081.000 - 0.16% -
445.gobmk -59.54% 12396.000 5016.000 - 0.24% -
435.gromacs -56.70% 16853.000 7297.000 - 0.05% -
458.sjeng -52.80% 16018.000 7561.000 - -0.51% -
437.leslie3d -30.96% 18070.000 12475.000 - 7.18% -
465.tonto -2.81% 13044.000 12677.000 - -0.54% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
444.namd (max) -99.54% 879.000 4.000 - -55.56% -
444.namd (unexplained diff vs previous) -99.52% 834.000 4.000 - -20.00% -
436.cactusADM (unexplained diff vs previous) -99.40% 1173.000 7.000 - -78.12% -
470.lbm (unexplained diff vs previous) -99.15% 822.000 7.000 - -88.33% -
459.GemsFDTD (unexplained diff vs previous) -98.80% 584.000 7.000 - -95.78% -
482.sphinx3 (unexplained diff vs previous) -98.75% 1118.000 14.000 - 16.67% -
435.gromacs (unexplained diff vs previous) -98.63% 292.000 4.000 - -98.75% -
482.sphinx3 -98.37% 859.000 14.000 - 0.00% -
482.sphinx3 (avg) -98.37% 859.000 14.000 - 0.00% -
436.cactusADM (max) -98.05% 1231.000 24.000 - -25.00% -
444.namd -97.83% 414.000 9.000 - 0.00% -
444.namd (avg) -97.83% 414.000 9.000 - 0.00% -
434.zeusmp (unexplained diff vs previous) -97.66% 470.000 11.000 - -84.51% -
482.sphinx3 (max) -97.40% 1152.000 30.000 - -11.76% -
435.gromacs (unexplained diff vs previous) (percentage) -97.11% 1.730 0.050 - -98.86% -
436.cactusADM -96.41% 585.000 21.000 - 0.00% -
436.cactusADM (avg) -96.41% 585.000 21.000 - 0.00% -
470.lbm (unexplained diff vs previous) (percentage) -96.23% 5.040 0.190 - -88.48% -
416.gamess (max) (percentage) -96.18% 3.140 0.120 - 0.00% -
433.milc (unexplained diff vs previous) -95.83% 96.000 4.000 - -85.71% -
410.bwaves (unexplained diff vs previous) -95.72% 257.000 11.000 - -88.30% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -95.65% 2.300 0.100 - -95.82% -
436.cactusADM (unexplained diff vs previous) (percentage) -94.39% 4.810 0.270 - -77.87% -
447.dealII (unexplained diff vs previous) -94.12% 68.000 4.000 - -85.71% -
470.lbm -93.91% 608.000 37.000 - 0.00% -
470.lbm (avg) -93.91% 608.000 37.000 - 0.00% -
453.povray -93.81% 113.000 7.000 - 0.00% -
453.povray (avg) -93.81% 113.000 7.000 - 0.00% -
462.libquantum -93.75% 32.000 2.000 - 0.00% -
462.libquantum (avg) -93.75% 32.000 2.000 - 0.00% -
481.wrf (max) (percentage) -93.75% 4.160 0.260 - 0.00% -
470.lbm (max) -91.71% 893.000 74.000 - -6.33% -
444.namd (unexplained diff vs previous) (percentage) -91.40% 5.230 0.450 - -19.64% -
444.namd (max) (percentage) -91.29% 5.510 0.480 - -55.96% -
453.povray (max) -90.58% 191.000 18.000 - 20.00% -
450.soplex (unexplained diff vs previous) -89.86% 69.000 7.000 - -84.44% -
434.zeusmp -89.80% 255.000 26.000 - 0.00% -
434.zeusmp (avg) -89.80% 255.000 26.000 - 0.00% -
453.povray (unexplained diff vs previous) -89.35% 169.000 18.000 - 12.50% -
434.zeusmp (max) -89.19% 481.000 52.000 - -24.64% -
410.bwaves (unexplained diff vs previous) (percentage) -89.08% 1.740 0.190 - -88.13% -
433.milc -87.23% 94.000 12.000 - 0.00% -
433.milc (avg) -87.23% 94.000 12.000 - 0.00% -
447.dealII (max) -86.67% 150.000 20.000 - -25.93% -
462.libquantum (unexplained diff vs previous) -85.71% 14.000 2.000 - 0.00% -
473.astar (unexplained diff vs previous) -85.25% 61.000 9.000 - -95.69% -
462.libquantum (max) -84.62% 13.000 2.000 - 0.00% -
400.perlbench (unexplained diff vs previous) -82.86% 35.000 6.000 - -45.45% -
464.h264ref (unexplained diff vs previous) -82.76% 58.000 10.000 - -87.65% -
434.zeusmp (unexplained diff vs previous) (percentage) -82.22% 2.250 0.400 - -84.62% -
410.bwaves -82.01% 289.000 52.000 - -1.89% -
410.bwaves (avg) -82.01% 289.000 52.000 - -1.89% -
471.omnetpp (max) -81.98% 172.000 31.000 - 0.00% -
436.cactusADM (max) (percentage) -81.58% 5.050 0.930 - -25.00% -
433.milc (max) -79.38% 97.000 20.000 - -25.93% -
459.GemsFDTD (max) -79.07% 578.000 121.000 - -25.31% -
400.perlbench (max) -78.65% 89.000 19.000 - -9.52% -
456.hmmer (unexplained diff vs previous) -78.57% 98.000 21.000 - 320.00% -
459.GemsFDTD -78.12% 352.000 77.000 - -2.53% -
459.GemsFDTD (avg) -78.12% 352.000 77.000 - -2.53% -
401.bzip2 (unexplained diff vs previous) -76.81% 69.000 16.000 - -75.00% -
456.hmmer (max) -76.53% 98.000 23.000 - -8.00% -
471.omnetpp (unexplained diff vs previous) -72.58% 62.000 17.000 - 112.50% -
470.lbm (avg) (percentage) -72.39% 3.730 1.030 - -0.96% -
447.dealII (unexplained diff vs previous) (percentage) -72.00% 0.750 0.210 - -85.81% -
447.dealII -69.62% 79.000 24.000 - 0.00% -
447.dealII (avg) -69.62% 79.000 24.000 - 0.00% -
410.bwaves (max) -68.08% 260.000 83.000 - -9.78% -
436.cactusADM (avg) (percentage) -65.83% 2.400 0.820 - 0.00% -
456.hmmer -62.50% 56.000 21.000 - 0.00% -
456.hmmer (avg) -62.50% 56.000 21.000 - 0.00% -
470.lbm (max) (percentage) -62.41% 5.480 2.060 - -6.36% -
450.soplex -62.16% 37.000 14.000 - 0.00% -
450.soplex (avg) -62.16% 37.000 14.000 - 0.00% -
444.namd (avg) (percentage) -59.62% 2.600 1.050 - 0.00% -
473.astar (unexplained diff vs previous) (percentage) -59.57% 0.470 0.190 - -95.76% -
464.h264ref (unexplained diff vs previous) (percentage) -57.89% 0.380 0.160 - -87.97% -
450.soplex (max) -55.07% 69.000 31.000 - -24.39% -
471.omnetpp -55.05% 109.000 49.000 - 0.00% -
471.omnetpp (avg) -55.05% 109.000 49.000 - 0.00% -
410.bwaves (avg) (percentage) -54.08% 1.960 0.900 - -1.10% -
465.tonto (unexplained diff vs previous) -53.38% 148.000 69.000 - -69.47% -
465.tonto (unexplained diff vs previous) (percentage) -52.21% 1.130 0.540 - -69.49% -
400.perlbench -48.84% 43.000 22.000 - 0.00% -
400.perlbench (avg) -48.84% 43.000 22.000 - 0.00% -
416.gamess (avg) (percentage) -48.48% 1.650 0.850 - 0.00% -
482.sphinx3 (unexplained diff vs previous) (percentage) -48.04% 3.060 1.590 - 17.78% -
433.milc (unexplained diff vs previous) (percentage) -47.14% 0.700 0.370 - -85.93% -
471.omnetpp (max) (percentage) -38.71% 1.860 1.140 - 0.00% -
445.gobmk (unexplained diff vs previous) -33.33% 18.000 12.000 - -70.00% -
447.dealII (max) (percentage) -33.33% 1.650 1.100 - -24.66% -
465.tonto -32.43% 148.000 100.000 - -0.99% -
465.tonto (avg) -32.43% 148.000 100.000 - -0.99% -
482.sphinx3 (avg) (percentage) -31.06% 2.350 1.620 - 0.00% -
465.tonto (avg) (percentage) -30.70% 1.140 0.790 - -1.25% -
464.h264ref -30.51% 59.000 41.000 - -2.38% -
464.h264ref (avg) -30.51% 59.000 41.000 - -2.38% -
481.wrf (avg) (percentage) -28.02% 2.570 1.850 - 0.00% -
465.tonto (max) -26.46% 223.000 164.000 - -25.79% -
465.tonto (max) (percentage) -23.98% 1.710 1.300 - -25.29% -
459.GemsFDTD (max) (percentage) -23.25% 2.280 1.750 - -24.89% -
435.gromacs (max) -22.64% 296.000 229.000 - -24.92% -
434.zeusmp (avg) (percentage) -22.13% 1.220 0.950 - -1.04% -
435.gromacs -21.88% 160.000 125.000 - -1.57% -
435.gromacs (avg) -21.88% 160.000 125.000 - -1.57% -
429.mcf -19.64% 56.000 45.000 - -4.26% -
429.mcf (avg) -19.64% 56.000 45.000 - -4.26% -
459.GemsFDTD (avg) (percentage) -19.42% 1.390 1.120 - -1.75% -
410.bwaves (max) (percentage) -19.21% 1.770 1.430 - -9.49% -
458.sjeng (unexplained diff vs previous) -18.75% 48.000 39.000 - -46.58% -
401.bzip2 (max) -17.91% 67.000 55.000 - -11.29% -
434.zeusmp (max) (percentage) -17.39% 2.300 1.900 - -25.20% -
471.omnetpp (unexplained diff vs previous) (percentage) -8.96% 0.670 0.610 - 110.34% -
453.povray (avg) (percentage) -6.54% 1.530 1.430 - 2.14% -
456.hmmer (unexplained diff vs previous) (percentage) -3.85% 0.520 0.500 - 316.67% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 17.24% 29.000 34.000 - 0.00% -

Report Time: 0.40s
Execution (seconds)
Name Current %
400.perlbench 1502.000 -
401.bzip2 2841.000 -
410.bwaves 5861.000 -
429.mcf 1148.000 -2.13%
433.milc 1070.000 -
434.zeusmp 2739.000 -
435.gromacs 7297.000 -
436.cactusADM 2607.000 -
437.leslie3d 12475.000 7.18%
444.namd 896.000 -
445.gobmk 5016.000 -
447.dealII 1894.000 -
450.soplex 562.000 1.26%
453.povray 540.000 3.45%
456.hmmer 4208.000 -
458.sjeng 7561.000 -
459.GemsFDTD 6951.000 -
462.libquantum 218.000 -
464.h264ref 6081.000 -
465.tonto 12677.000 -
470.lbm 3621.000 -
471.omnetpp 2790.000 -
473.astar 4670.000 -
482.sphinx3 878.000 -1.57%
Geometric Mean 2585.217 -
Code Size (bytes)
Name Current %
400.perlbench 562078.000 -
401.bzip2 33398.000 -
410.bwaves 14723.000 -
429.mcf 7717.000 -
433.milc 47733.000 -
434.zeusmp 138714.000 -
435.gromacs 393002.000 -
436.cactusADM 256626.000 -
437.leslie3d 46184.000 -
444.namd 163131.000 -
445.gobmk 1087552.000 -
447.dealII 189727.000 -
450.soplex 135852.000 -
453.povray 493733.000 -
456.hmmer 74389.000 -
458.sjeng 81349.000 -
459.GemsFDTD 194087.000 -
462.libquantum 13118.000 -
464.h264ref 301482.000 -
465.tonto 1464510.000 -
470.lbm 10213.000 -
471.omnetpp 296077.000 -
473.astar 15825.000 -
482.sphinx3 79598.000 -
Geometric Mean 105775.523 -
sample variability
Name Current %
400.perlbench 22.000 -
400.perlbench (avg) 22.000 -
400.perlbench (avg) (percentage) 1.490 -1.32%
400.perlbench (max) 19.000 -9.52%
400.perlbench (max) (percentage) 1.320 -10.20%
400.perlbench (unexplained diff vs previous) 6.000 -45.45%
400.perlbench (unexplained diff vs previous) (percentage) 0.400 -45.95%
401.bzip2 47.000 -
401.bzip2 (avg) 47.000 -
401.bzip2 (avg) (percentage) 1.680 -
401.bzip2 (max) 55.000 -11.29%
401.bzip2 (max) (percentage) 1.940 -12.61%
401.bzip2 (unexplained diff vs previous) 16.000 -75.00%
401.bzip2 (unexplained diff vs previous) (percentage) 0.560 -75.33%
403.gcc (avg) (percentage) 2.370 -
403.gcc (max) (percentage) 7.020 -
410.bwaves 52.000 -1.89%
410.bwaves (avg) 52.000 -1.89%
410.bwaves (avg) (percentage) 0.900 -1.10%
410.bwaves (max) 83.000 -9.78%
410.bwaves (max) (percentage) 1.430 -9.49%
410.bwaves (unexplained diff vs previous) 11.000 -88.30%
410.bwaves (unexplained diff vs previous) (percentage) 0.190 -88.13%
416.gamess (avg) (percentage) 0.850 -
416.gamess (max) (percentage) 0.120 -
429.mcf 45.000 -4.26%
429.mcf (avg) 45.000 -4.26%
429.mcf (avg) (percentage) 3.980 -
429.mcf (max) 48.000 -14.29%
429.mcf (max) (percentage) 4.190 -12.53%
429.mcf (unexplained diff vs previous) 25.000 -57.63%
429.mcf (unexplained diff vs previous) (percentage) 2.180 -56.66%
433.milc 12.000 -
433.milc (avg) 12.000 -
433.milc (avg) (percentage) 1.130 -
433.milc (max) 20.000 -25.93%
433.milc (max) (percentage) 1.920 -25.00%
433.milc (unexplained diff vs previous) 4.000 -85.71%
433.milc (unexplained diff vs previous) (percentage) 0.370 -85.93%
434.zeusmp 26.000 -
434.zeusmp (avg) 26.000 -
434.zeusmp (avg) (percentage) 0.950 -1.04%
434.zeusmp (max) 52.000 -24.64%
434.zeusmp (max) (percentage) 1.900 -25.20%
434.zeusmp (unexplained diff vs previous) 11.000 -84.51%
434.zeusmp (unexplained diff vs previous) (percentage) 0.400 -84.62%
435.gromacs 125.000 -1.57%
435.gromacs (avg) 125.000 -1.57%
435.gromacs (avg) (percentage) 1.720 -1.71%
435.gromacs (max) 229.000 -24.92%
435.gromacs (max) (percentage) 3.140 -25.06%
435.gromacs (unexplained diff vs previous) 4.000 -98.75%
435.gromacs (unexplained diff vs previous) (percentage) 0.050 -98.86%
436.cactusADM 21.000 -
436.cactusADM (avg) 21.000 -
436.cactusADM (avg) (percentage) 0.820 -
436.cactusADM (max) 24.000 -25.00%
436.cactusADM (max) (percentage) 0.930 -25.00%
436.cactusADM (unexplained diff vs previous) 7.000 -78.12%
436.cactusADM (unexplained diff vs previous) (percentage) 0.270 -77.87%
437.leslie3d 618.000 7.85%
437.leslie3d (avg) 618.000 7.85%
437.leslie3d (avg) (percentage) 4.960 -
437.leslie3d (max) 895.000 50.67%
437.leslie3d (max) (percentage) 7.180 40.51%
437.leslie3d (unexplained diff vs previous) 836.000 68.55%
437.leslie3d (unexplained diff vs previous) (percentage) 6.700 57.28%
444.namd 9.000 -
444.namd (avg) 9.000 -
444.namd (avg) (percentage) 1.050 -
444.namd (max) 4.000 -55.56%
444.namd (max) (percentage) 0.480 -55.96%
444.namd (unexplained diff vs previous) 4.000 -20.00%
444.namd (unexplained diff vs previous) (percentage) 0.450 -19.64%
445.gobmk 43.000 -
445.gobmk (avg) 43.000 -
445.gobmk (avg) (percentage) 0.860 -1.15%
445.gobmk (max) 49.000 -7.55%
445.gobmk (max) (percentage) 0.980 -7.55%
445.gobmk (unexplained diff vs previous) 12.000 -70.00%
445.gobmk (unexplained diff vs previous) (percentage) 0.240 -70.00%
447.dealII 24.000 -
447.dealII (avg) 24.000 -
447.dealII (avg) (percentage) 1.290 -1.53%
447.dealII (max) 20.000 -25.93%
447.dealII (max) (percentage) 1.100 -24.66%
447.dealII (unexplained diff vs previous) 4.000 -85.71%
447.dealII (unexplained diff vs previous) (percentage) 0.210 -85.81%
450.soplex 14.000 -
450.soplex (avg) 14.000 -
450.soplex (avg) (percentage) 2.540 -
450.soplex (max) 31.000 -24.39%
450.soplex (max) (percentage) 5.620 -25.07%
450.soplex (unexplained diff vs previous) 7.000 -84.44%
450.soplex (unexplained diff vs previous) (percentage) 1.250 -84.59%
453.povray 7.000 -
453.povray (avg) 7.000 -
453.povray (avg) (percentage) 1.430 2.14%
453.povray (max) 18.000 20.00%
453.povray (max) (percentage) 3.450 16.16%
453.povray (unexplained diff vs previous) 18.000 12.50%
453.povray (unexplained diff vs previous) (percentage) 3.330 8.47%
454.calculix (avg) (percentage) 3.440 -
454.calculix (max) (percentage) 3.450 -
456.hmmer 21.000 -
456.hmmer (avg) 21.000 -
456.hmmer (avg) (percentage) 0.510 -
456.hmmer (max) 23.000 -8.00%
456.hmmer (max) (percentage) 0.570 -6.56%
456.hmmer (unexplained diff vs previous) 21.000 320.00%
456.hmmer (unexplained diff vs previous) (percentage) 0.500 316.67%
458.sjeng 46.000 -
458.sjeng (avg) 46.000 -
458.sjeng (avg) (percentage) 0.610 -
458.sjeng (max) 62.000 -13.89%
458.sjeng (max) (percentage) 0.830 -12.63%
458.sjeng (unexplained diff vs previous) 39.000 -46.58%
458.sjeng (unexplained diff vs previous) (percentage) 0.520 -45.83%
459.GemsFDTD 77.000 -2.53%
459.GemsFDTD (avg) 77.000 -2.53%
459.GemsFDTD (avg) (percentage) 1.120 -1.75%
459.GemsFDTD (max) 121.000 -25.31%
459.GemsFDTD (max) (percentage) 1.750 -24.89%
459.GemsFDTD (unexplained diff vs previous) 7.000 -95.78%
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.100 -95.82%
462.libquantum 2.000 -
462.libquantum (avg) 2.000 -
462.libquantum (avg) (percentage) 1.330 -
462.libquantum (max) 2.000 -
462.libquantum (max) (percentage) 1.310 -3.68%
462.libquantum (unexplained diff vs previous) 2.000 -
462.libquantum (unexplained diff vs previous) (percentage) 0.920 -1.08%
464.h264ref 41.000 -2.38%
464.h264ref (avg) 41.000 -2.38%
464.h264ref (avg) (percentage) 0.690 -1.43%
464.h264ref (max) 60.000 -25.00%
464.h264ref (max) (percentage) 0.990 -25.00%
464.h264ref (unexplained diff vs previous) 10.000 -87.65%
464.h264ref (unexplained diff vs previous) (percentage) 0.160 -87.97%
465.tonto 100.000 -
465.tonto (avg) 100.000 -
465.tonto (avg) (percentage) 0.790 -1.25%
465.tonto (max) 164.000 -25.79%
465.tonto (max) (percentage) 1.300 -25.29%
465.tonto (unexplained diff vs previous) 69.000 -69.47%
465.tonto (unexplained diff vs previous) (percentage) 0.540 -69.49%
470.lbm 37.000 -
470.lbm (avg) 37.000 -
470.lbm (avg) (percentage) 1.030 -
470.lbm (max) 74.000 -6.33%
470.lbm (max) (percentage) 2.060 -6.36%
470.lbm (unexplained diff vs previous) 7.000 -88.33%
470.lbm (unexplained diff vs previous) (percentage) 0.190 -88.48%
471.omnetpp 49.000 -
471.omnetpp (avg) 49.000 -
471.omnetpp (avg) (percentage) 1.780 -1.11%
471.omnetpp (max) 31.000 -
471.omnetpp (max) (percentage) 1.140 -
471.omnetpp (unexplained diff vs previous) 17.000 112.50%
471.omnetpp (unexplained diff vs previous) (percentage) 0.610 110.34%
473.astar 65.000 -1.52%
473.astar (avg) 65.000 -1.52%
473.astar (avg) (percentage) 1.410 -
473.astar (max) 166.000 -16.58%
473.astar (max) (percentage) 3.570 -16.78%
473.astar (unexplained diff vs previous) 9.000 -95.69%
473.astar (unexplained diff vs previous) (percentage) 0.190 -95.76%
481.wrf (avg) (percentage) 1.850 -
481.wrf (max) (percentage) 0.260 -
482.sphinx3 14.000 -
482.sphinx3 (avg) 14.000 -
482.sphinx3 (avg) (percentage) 1.620 -
482.sphinx3 (max) 30.000 -11.76%
482.sphinx3 (max) (percentage) 3.480 -10.08%
482.sphinx3 (unexplained diff vs previous) 14.000 16.67%
482.sphinx3 (unexplained diff vs previous) (percentage) 1.590 17.78%
483.xalancbmk (avg) (percentage) 1.140 -
483.xalancbmk (max) (percentage) 1.500 -
Geometric Mean 6.004 -31.48%