Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=c33568d2c108478c25fe9959b5ce9d25b97efa6c (unchanged)
git_gcc https://gcc.gnu.org/git/gcc.git (6aba48a8cc128e54ee243d451ac9a843ff41c4f9) (unchanged)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=d7b37322c53e84eba2b35ee118b63f00c057050f (+ 59 commits)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/cc2fbfb820fc476698d05a3b39f083124e82b2a3 (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-arm-master-Os_LTO-build/306/
View Options
Report
Filter

gnu-arm-master-Os_LTO test results

Run Order Start Time Duration
Current 0306 (glibc-2.40.9000-00695-gd7b37322c53) 2024-12-29T05:47:28 0:00:00
Previous 0301 (v6.12.7-77719-gcc2fbfb820fc) 2024-12-22T19:55:22 0:00:00
Baseline 0001 (3-changed-components) 2022-12-30T06:27:35 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 66 85
Performance Improvements 68 124
Unchanged Tests 1102 1027
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
436.cactusADM 1.24% 2582.000 2614.000 - -89.29% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
434.zeusmp (unexplained diff vs previous) (percentage) 3614.29% 0.070 2.600 - 15.56% -
434.zeusmp (unexplained diff vs previous) 3450.00% 2.000 71.000 - -84.89% -
436.cactusADM (unexplained diff vs previous) 3100.00% 1.000 32.000 - -97.27% -
436.cactusADM (unexplained diff vs previous) (percentage) 2950.00% 0.040 1.220 - -74.64% -
435.gromacs (unexplained diff vs previous) (percentage) 1265.62% 0.320 4.370 - 152.60% -
435.gromacs (unexplained diff vs previous) 1229.17% 24.000 319.000 - 9.25% -
450.soplex (unexplained diff vs previous) (percentage) 711.00% 1.000 8.110 - 1743.18% -
465.tonto (unexplained diff vs previous) (percentage) 669.57% 0.230 1.770 - 56.64% -
465.tonto (unexplained diff vs previous) 653.33% 30.000 226.000 - 52.70% -
450.soplex (unexplained diff vs previous) 650.00% 6.000 45.000 - -34.78% -
464.h264ref (unexplained diff vs previous) (percentage) 533.33% 0.210 1.330 - 250.00% -
464.h264ref (unexplained diff vs previous) 523.08% 13.000 81.000 - 39.66% -
453.povray (unexplained diff vs previous) (percentage) 448.21% 0.560 3.070 - 34.06% -
453.povray (unexplained diff vs previous) 433.33% 3.000 16.000 - -90.53% -
444.namd (unexplained diff vs previous) (percentage) 409.09% 0.110 0.560 - -89.29% -
444.namd (unexplained diff vs previous) 400.00% 1.000 5.000 - -99.40% -
464.h264ref (max) 400.00% 16.000 80.000 - 35.59% -
464.h264ref (max) (percentage) 388.89% 0.270 1.320 - 238.46% -
458.sjeng (unexplained diff vs previous) (percentage) 317.39% 0.230 0.960 - 220.00% -
458.sjeng (unexplained diff vs previous) 305.56% 18.000 73.000 - 52.08% -
473.astar (unexplained diff vs previous) (percentage) 241.98% 1.310 4.480 - 853.19% -
473.astar (max) (percentage) 230.00% 1.300 4.290 - 812.77% -
465.tonto (max) (percentage) 228.30% 0.530 1.740 - 1.75% -
473.astar (unexplained diff vs previous) 226.56% 64.000 209.000 - 242.62% -
465.tonto (max) 225.00% 68.000 221.000 - -0.90% -
473.astar (max) 215.87% 63.000 199.000 - 226.23% -
447.dealII (unexplained diff vs previous) (percentage) 214.89% 0.470 1.480 - 97.33% -
434.zeusmp (max) 213.64% 22.000 69.000 - -85.65% -
434.zeusmp (max) (percentage) 213.58% 0.810 2.540 - 10.43% -
447.dealII (unexplained diff vs previous) 211.11% 9.000 28.000 - -58.82% -
458.sjeng (max) 200.00% 24.000 72.000 - 50.00% -
458.sjeng (max) (percentage) 196.87% 0.320 0.950 - 216.67% -
453.povray (max) 150.00% 6.000 15.000 - -92.15% -
453.povray (max) (percentage) 143.44% 1.220 2.970 - 14.67% -
450.soplex (max) (percentage) 91.33% 3.920 7.500 - 1604.55% -
435.gromacs (max) (percentage) 87.05% 2.240 4.190 - 138.07% -
447.dealII (max) 80.00% 15.000 27.000 - -82.00% -
435.gromacs (max) 79.41% 170.000 305.000 - 3.04% -
450.soplex (max) 78.26% 23.000 41.000 - -40.58% -
447.dealII (max) (percentage) 78.05% 0.820 1.460 - -11.52% -
429.mcf (unexplained diff vs previous) (percentage) 34.85% 3.730 5.030 - 5488.89% -
459.GemsFDTD (unexplained diff vs previous) (percentage) 34.27% 1.780 2.390 - 3.91% -
429.mcf (max) (percentage) 33.06% 3.600 4.790 - 1396.87% -
459.GemsFDTD (unexplained diff vs previous) 30.71% 127.000 166.000 - -71.58% -
429.mcf (unexplained diff vs previous) 28.26% 46.000 59.000 - 490.00% -
436.cactusADM (max) 28.00% 25.000 32.000 - -97.40% -
436.cactusADM (max) (percentage) 27.84% 0.970 1.240 - -75.45% -
429.mcf (max) 27.27% 44.000 56.000 - 51.35% -
401.bzip2 (max) (percentage) 9.36% 2.030 2.220 - 455.00% -
401.bzip2 (unexplained diff vs previous) (percentage) 9.13% 2.080 2.270 - 453.66% -
401.bzip2 (max) 6.90% 58.000 62.000 - -7.46% -
401.bzip2 (unexplained diff vs previous) 6.67% 60.000 64.000 - -7.25% -
473.astar (avg) (percentage) 2.90% 1.380 1.420 - 255.00% -
450.soplex (avg) (percentage) 2.82% 2.480 2.550 - 962.50% -
433.milc (unexplained diff vs previous) (percentage) 2.73% 2.560 2.630 - 275.71% -
465.tonto (avg) (percentage) 2.56% 0.780 0.800 - -29.82% -
433.milc (max) (percentage) 2.40% 2.500 2.560 - 260.56% -
435.gromacs (avg) (percentage) 2.34% 1.710 1.750 - 84.21% -
453.povray (avg) (percentage) 2.19% 1.370 1.400 - -8.50% -
434.zeusmp (avg) (percentage) 2.13% 0.940 0.960 - -21.31% -
433.milc (avg) (percentage) 1.79% 1.120 1.140 - 65.22% -
459.GemsFDTD (avg) (percentage) 1.79% 1.120 1.140 - -17.99% -
458.sjeng (avg) (percentage) 1.67% 0.600 0.610 - 165.22% -
464.h264ref (avg) (percentage) 1.45% 0.690 0.700 - 79.49% -
410.bwaves (avg) (percentage) 1.11% 0.900 0.910 - -53.57% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
450.soplex -7.50% 600.000 555.000 - -96.47% -
429.mcf -4.79% 1232.000 1173.000 - -90.00% -
473.astar -4.29% 4870.000 4661.000 - -64.10% -
435.gromacs -4.19% 7612.000 7293.000 - -56.73% -
437.leslie3d -4.09% 12135.000 11639.000 - -35.59% -
453.povray -2.97% 538.000 522.000 - -92.94% -
433.milc -2.56% 1094.000 1066.000 - -92.20% -
434.zeusmp -2.54% 2799.000 2728.000 - -86.97% -
459.GemsFDTD -2.33% 7124.000 6958.000 - -72.57% -
401.bzip2 -2.22% 2889.000 2825.000 - -83.35% -
465.tonto -1.74% 12972.000 12746.000 - -2.28% -
470.lbm -1.63% 3688.000 3628.000 - -77.76% -
410.bwaves -1.58% 5966.000 5872.000 - -60.18% -
447.dealII -1.46% 1918.000 1890.000 - -79.23% -
482.sphinx3 -1.33% 904.000 892.000 - -97.56% -
464.h264ref -1.32% 6152.000 6071.000 - -60.08% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
456.hmmer (unexplained diff vs previous) -82.14% 28.000 5.000 - -94.90% -
456.hmmer (unexplained diff vs previous) (percentage) -82.09% 0.670 0.120 - -76.92% -
482.sphinx3 (unexplained diff vs previous) -72.73% 44.000 12.000 - -98.93% -
482.sphinx3 (unexplained diff vs previous) (percentage) -72.28% 4.870 1.350 - -55.88% -
471.omnetpp (unexplained diff vs previous) -70.37% 27.000 8.000 - -87.10% -
471.omnetpp (unexplained diff vs previous) (percentage) -70.10% 0.970 0.290 - -56.72% -
400.perlbench (unexplained diff vs previous) -59.26% 27.000 11.000 - -68.57% -
400.perlbench (unexplained diff vs previous) (percentage) -58.66% 1.790 0.740 - 138.71% -
471.omnetpp (max) -35.42% 48.000 31.000 - -81.98% -
471.omnetpp (max) (percentage) -34.10% 1.730 1.140 - -38.71% -
470.lbm (unexplained diff vs previous) -34.07% 91.000 60.000 - -92.70% -
445.gobmk (unexplained diff vs previous) -33.33% 60.000 40.000 - 122.22% -
462.libquantum (max) -33.33% 3.000 2.000 - -84.62% -
470.lbm (unexplained diff vs previous) (percentage) -33.20% 2.470 1.650 - -67.26% -
445.gobmk (unexplained diff vs previous) (percentage) -32.77% 1.190 0.800 - 433.33% -
437.leslie3d (unexplained diff vs previous) -26.95% 679.000 496.000 - 165.24% -
437.leslie3d (unexplained diff vs previous) (percentage) -23.93% 5.600 4.260 - 313.59% -
400.perlbench (max) -19.23% 26.000 21.000 - -76.40% -
400.perlbench (max) (percentage) -17.88% 1.790 1.470 - 83.75% -
482.sphinx3 (max) -17.07% 41.000 34.000 - -97.05% -
482.sphinx3 (max) (percentage) -16.59% 4.640 3.870 - 22.86% -
410.bwaves (max) -15.60% 109.000 92.000 - -64.62% -
410.bwaves (unexplained diff vs previous) -15.32% 111.000 94.000 - -63.42% -
410.bwaves (unexplained diff vs previous) (percentage) -13.98% 1.860 1.600 - -8.05% -
410.bwaves (max) (percentage) -13.66% 1.830 1.580 - -10.73% -
459.GemsFDTD (max) -11.96% 184.000 162.000 - -71.97% -
437.leslie3d (max) -10.41% 663.000 594.000 - 6.07% -
470.lbm (max) -10.23% 88.000 79.000 - -91.15% -
445.gobmk (max) -10.17% 59.000 53.000 - 60.61% -
445.gobmk (max) (percentage) -10.17% 1.180 1.060 - 292.59% -
459.GemsFDTD (max) (percentage) -10.04% 2.590 2.330 - 2.19% -
444.namd (max) -10.00% 10.000 9.000 - -98.98% -
470.lbm (max) (percentage) -8.71% 2.410 2.200 - -59.85% -
456.hmmer (max) (percentage) -7.58% 0.660 0.610 - 17.31% -
456.hmmer (max) -7.41% 27.000 25.000 - -74.49% -
437.leslie3d (max) (percentage) -6.58% 5.470 5.110 - 64.84% -
444.namd (max) (percentage) -4.39% 1.140 1.090 - -80.22% -
437.leslie3d -4.34% 599.000 573.000 - 90.37% -
437.leslie3d (avg) -4.34% 599.000 573.000 - 90.37% -
462.libquantum (max) (percentage) -4.23% 1.420 1.360 - 1600.00% -
429.mcf -4.08% 49.000 47.000 - -16.07% -
429.mcf (avg) -4.08% 49.000 47.000 - -16.07% -
435.gromacs -2.31% 130.000 127.000 - -20.62% -
435.gromacs (avg) -2.31% 130.000 127.000 - -20.62% -
401.bzip2 -2.08% 48.000 47.000 - 4.44% -
401.bzip2 (avg) -2.08% 48.000 47.000 - 4.44% -
471.omnetpp -2.00% 50.000 49.000 - -55.05% -
471.omnetpp (avg) -2.00% 50.000 49.000 - -55.05% -
456.hmmer (avg) (percentage) -1.92% 0.520 0.510 - 70.00% -
473.astar -1.49% 67.000 66.000 - 29.41% -
473.astar (avg) -1.49% 67.000 66.000 - 29.41% -
471.omnetpp (avg) (percentage) -1.10% 1.820 1.800 - 52.54% -

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
465.tonto 1.86% 1437761.000 1464510.000 - 0.00% -
473.astar 1.78% 15549.000 15825.000 - 0.00% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
429.mcf (unexplained diff vs previous) (percentage) 5488.89% 0.090 5.030 - 34.85% -
450.soplex (unexplained diff vs previous) (percentage) 1743.18% 0.440 8.110 - 711.00% -
450.soplex (max) (percentage) 1604.55% 0.440 7.500 - 91.33% -
462.libquantum (max) (percentage) 1600.00% 0.080 1.360 - -4.23% -
429.mcf (max) (percentage) 1396.87% 0.320 4.790 - 33.06% -
403.gcc (max) (percentage) 1093.22% 0.590 7.040 - -0.14% -
462.libquantum (unexplained diff vs previous) (percentage) 1062.50% 0.080 0.930 - 0.00% -
450.soplex (avg) (percentage) 962.50% 0.240 2.550 - 2.82% -
473.astar (unexplained diff vs previous) (percentage) 853.19% 0.470 4.480 - 241.98% -
473.astar (max) (percentage) 812.77% 0.470 4.290 - 230.00% -
429.mcf (avg) (percentage) 735.42% 0.480 4.010 - 0.25% -
462.libquantum (avg) (percentage) 605.26% 0.190 1.340 - 0.00% -
401.bzip2 (avg) (percentage) 525.93% 0.270 1.690 - 0.60% -
429.mcf (unexplained diff vs previous) 490.00% 10.000 59.000 - 28.26% -
401.bzip2 (max) (percentage) 455.00% 0.400 2.220 - 9.36% -
401.bzip2 (unexplained diff vs previous) (percentage) 453.66% 0.410 2.270 - 9.13% -
403.gcc (avg) (percentage) 451.16% 0.430 2.370 - 0.00% -
445.gobmk (unexplained diff vs previous) (percentage) 433.33% 0.150 0.800 - -32.77% -
437.leslie3d (unexplained diff vs previous) (percentage) 313.59% 1.030 4.260 - -23.93% -
454.calculix (max) (percentage) 310.71% 0.840 3.450 - 0.00% -
445.gobmk (avg) (percentage) 295.45% 0.220 0.870 - 0.00% -
445.gobmk (max) (percentage) 292.59% 0.270 1.060 - -10.17% -
400.perlbench (avg) (percentage) 287.18% 0.390 1.510 - -0.66% -
433.milc (unexplained diff vs previous) (percentage) 275.71% 0.700 2.630 - 2.73% -
433.milc (max) (percentage) 260.56% 0.710 2.560 - 2.40% -
473.astar (avg) (percentage) 255.00% 0.400 1.420 - 2.90% -
464.h264ref (unexplained diff vs previous) (percentage) 250.00% 0.380 1.330 - 533.33% -
473.astar (unexplained diff vs previous) 242.62% 61.000 209.000 - 226.56% -
464.h264ref (max) (percentage) 238.46% 0.390 1.320 - 388.89% -
473.astar (max) 226.23% 61.000 199.000 - 215.87% -
458.sjeng (unexplained diff vs previous) (percentage) 220.00% 0.300 0.960 - 317.39% -
458.sjeng (max) (percentage) 216.67% 0.300 0.950 - 196.87% -
437.leslie3d (avg) (percentage) 195.21% 1.670 4.930 - -0.20% -
437.leslie3d (unexplained diff vs previous) 165.24% 187.000 496.000 - -26.95% -
458.sjeng (avg) (percentage) 165.22% 0.230 0.610 - 1.67% -
435.gromacs (unexplained diff vs previous) (percentage) 152.60% 1.730 4.370 - 1265.62% -
400.perlbench (unexplained diff vs previous) (percentage) 138.71% 0.310 0.740 - -58.66% -
435.gromacs (max) (percentage) 138.07% 1.760 4.190 - 87.05% -
445.gobmk (unexplained diff vs previous) 122.22% 18.000 40.000 - -33.33% -
483.xalancbmk (avg) (percentage) 103.57% 0.560 1.140 - 0.00% -
447.dealII (unexplained diff vs previous) (percentage) 97.33% 0.750 1.480 - 214.89% -
437.leslie3d 90.37% 301.000 573.000 - -4.34% -
437.leslie3d (avg) 90.37% 301.000 573.000 - -4.34% -
435.gromacs (avg) (percentage) 84.21% 0.950 1.750 - 2.34% -
400.perlbench (max) (percentage) 83.75% 0.800 1.470 - -17.88% -
464.h264ref (avg) (percentage) 79.49% 0.390 0.700 - 1.45% -
456.hmmer (avg) (percentage) 70.00% 0.300 0.510 - -1.92% -
454.calculix (avg) (percentage) 69.46% 2.030 3.440 - 0.00% -
433.milc (avg) (percentage) 65.22% 0.690 1.140 - 1.79% -
437.leslie3d (max) (percentage) 64.84% 3.100 5.110 - -6.58% -
483.xalancbmk (max) (percentage) 63.04% 0.920 1.500 - 0.00% -
445.gobmk (max) 60.61% 33.000 53.000 - -10.17% -
445.gobmk 59.26% 27.000 43.000 - 0.00% -
445.gobmk (avg) 59.26% 27.000 43.000 - 0.00% -
465.tonto (unexplained diff vs previous) (percentage) 56.64% 1.130 1.770 - 669.57% -
465.tonto (unexplained diff vs previous) 52.70% 148.000 226.000 - 653.33% -
471.omnetpp (avg) (percentage) 52.54% 1.180 1.800 - -1.10% -
458.sjeng (unexplained diff vs previous) 52.08% 48.000 73.000 - 305.56% -
429.mcf (max) 51.35% 37.000 56.000 - 27.27% -
447.dealII (avg) (percentage) 50.57% 0.870 1.310 - 0.77% -
458.sjeng (max) 50.00% 48.000 72.000 - 200.00% -
464.h264ref (unexplained diff vs previous) 39.66% 58.000 81.000 - 523.08% -
464.h264ref (max) 35.59% 59.000 80.000 - 400.00% -
453.povray (unexplained diff vs previous) (percentage) 34.06% 2.290 3.070 - 448.21% -
473.astar 29.41% 51.000 66.000 - -1.49% -
473.astar (avg) 29.41% 51.000 66.000 - -1.49% -
458.sjeng 27.78% 36.000 46.000 - 0.00% -
458.sjeng (avg) 27.78% 36.000 46.000 - 0.00% -
482.sphinx3 (max) (percentage) 22.86% 3.150 3.870 - -16.59% -
456.hmmer (max) (percentage) 17.31% 0.520 0.610 - -7.58% -
434.zeusmp (unexplained diff vs previous) (percentage) 15.56% 2.250 2.600 - 3614.29% -
453.povray (max) (percentage) 14.67% 2.590 2.970 - 143.44% -
434.zeusmp (max) (percentage) 10.43% 2.300 2.540 - 213.58% -
435.gromacs (unexplained diff vs previous) 9.25% 292.000 319.000 - 1229.17% -
437.leslie3d (max) 6.07% 560.000 594.000 - -10.41% -
401.bzip2 4.44% 45.000 47.000 - -2.08% -
401.bzip2 (avg) 4.44% 45.000 47.000 - -2.08% -
459.GemsFDTD (unexplained diff vs previous) (percentage) 3.91% 2.300 2.390 - 34.27% -
435.gromacs (max) 3.04% 296.000 305.000 - 79.41% -
459.GemsFDTD (max) (percentage) 2.19% 2.280 2.330 - -10.04% -
465.tonto (max) (percentage) 1.75% 1.710 1.740 - 228.30% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -17.24% 29.000 24.000 - 0.00% -
nb_execution_successful -17.24% 29.000 24.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
470.lbm -5.83% 10845.000 10213.000 - 0.00% -
437.leslie3d -3.79% 48001.000 46184.000 - 0.00% -
434.zeusmp -1.66% 141060.000 138714.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
462.libquantum -98.73% 17005.000 216.000 - -0.92% -
482.sphinx3 -97.56% 36586.000 892.000 - -1.33% -
450.soplex -96.47% 15709.000 555.000 - -7.50% -
444.namd -94.36% 15957.000 900.000 - -0.55% -
453.povray -92.94% 7395.000 522.000 - -2.97% -
433.milc -92.20% 13668.000 1066.000 - -2.56% -
429.mcf -90.00% 11727.000 1173.000 - -4.79% -
436.cactusADM -89.29% 24396.000 2614.000 - 1.24% -
434.zeusmp -86.97% 20932.000 2728.000 - -2.54% -
400.perlbench -86.66% 11215.000 1496.000 - -0.73% -
401.bzip2 -83.35% 16971.000 2825.000 - -2.22% -
447.dealII -79.23% 9101.000 1890.000 - -1.46% -
456.hmmer -77.96% 18995.000 4187.000 - -0.12% -
470.lbm -77.76% 16312.000 3628.000 - -1.63% -
459.GemsFDTD -72.57% 25364.000 6958.000 - -2.33% -
471.omnetpp -70.07% 9265.000 2773.000 - -0.29% -
473.astar -64.10% 12983.000 4661.000 - -4.29% -
410.bwaves -60.18% 14745.000 5872.000 - -1.58% -
464.h264ref -60.08% 15208.000 6071.000 - -1.32% -
445.gobmk -59.63% 12396.000 5004.000 - -0.79% -
435.gromacs -56.73% 16853.000 7293.000 - -4.19% -
458.sjeng -52.55% 16018.000 7600.000 - -0.95% -
437.leslie3d -35.59% 18070.000 11639.000 - -4.09% -
465.tonto -2.28% 13044.000 12746.000 - -1.74% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
444.namd (unexplained diff vs previous) -99.40% 834.000 5.000 - 400.00% -
444.namd (max) -98.98% 879.000 9.000 - -10.00% -
482.sphinx3 (unexplained diff vs previous) -98.93% 1118.000 12.000 - -72.73% -
482.sphinx3 -98.37% 859.000 14.000 - 0.00% -
482.sphinx3 (avg) -98.37% 859.000 14.000 - 0.00% -
444.namd -97.83% 414.000 9.000 - 0.00% -
444.namd (avg) -97.83% 414.000 9.000 - 0.00% -
436.cactusADM (max) -97.40% 1231.000 32.000 - 28.00% -
436.cactusADM (unexplained diff vs previous) -97.27% 1173.000 32.000 - 3100.00% -
482.sphinx3 (max) -97.05% 1152.000 34.000 - -17.07% -
436.cactusADM -96.41% 585.000 21.000 - 0.00% -
436.cactusADM (avg) -96.41% 585.000 21.000 - 0.00% -
416.gamess (max) (percentage) -96.18% 3.140 0.120 - 0.00% -
456.hmmer (unexplained diff vs previous) -94.90% 98.000 5.000 - -82.14% -
470.lbm -93.91% 608.000 37.000 - 0.00% -
470.lbm (avg) -93.91% 608.000 37.000 - 0.00% -
453.povray -93.81% 113.000 7.000 - 0.00% -
453.povray (avg) -93.81% 113.000 7.000 - 0.00% -
462.libquantum -93.75% 32.000 2.000 - 0.00% -
462.libquantum (avg) -93.75% 32.000 2.000 - 0.00% -
481.wrf (max) (percentage) -93.75% 4.160 0.260 - 0.00% -
470.lbm (unexplained diff vs previous) -92.70% 822.000 60.000 - -34.07% -
453.povray (max) -92.15% 191.000 15.000 - 150.00% -
470.lbm (max) -91.15% 893.000 79.000 - -10.23% -
453.povray (unexplained diff vs previous) -90.53% 169.000 16.000 - 433.33% -
434.zeusmp -89.80% 255.000 26.000 - 0.00% -
434.zeusmp (avg) -89.80% 255.000 26.000 - 0.00% -
444.namd (unexplained diff vs previous) (percentage) -89.29% 5.230 0.560 - 409.09% -
433.milc -87.23% 94.000 12.000 - 0.00% -
433.milc (avg) -87.23% 94.000 12.000 - 0.00% -
471.omnetpp (unexplained diff vs previous) -87.10% 62.000 8.000 - -70.37% -
462.libquantum (unexplained diff vs previous) -85.71% 14.000 2.000 - 0.00% -
434.zeusmp (max) -85.65% 481.000 69.000 - 213.64% -
434.zeusmp (unexplained diff vs previous) -84.89% 470.000 71.000 - 3450.00% -
462.libquantum (max) -84.62% 13.000 2.000 - -33.33% -
447.dealII (max) -82.00% 150.000 27.000 - 80.00% -
471.omnetpp (max) -81.98% 172.000 31.000 - -35.42% -
410.bwaves -81.66% 289.000 53.000 - 0.00% -
410.bwaves (avg) -81.66% 289.000 53.000 - 0.00% -
444.namd (max) (percentage) -80.22% 5.510 1.090 - -4.39% -
459.GemsFDTD -77.56% 352.000 79.000 - 0.00% -
459.GemsFDTD (avg) -77.56% 352.000 79.000 - 0.00% -
456.hmmer (unexplained diff vs previous) (percentage) -76.92% 0.520 0.120 - -82.09% -
400.perlbench (max) -76.40% 89.000 21.000 - -19.23% -
436.cactusADM (max) (percentage) -75.45% 5.050 1.240 - 27.84% -
436.cactusADM (unexplained diff vs previous) (percentage) -74.64% 4.810 1.220 - 2950.00% -
456.hmmer (max) -74.49% 98.000 25.000 - -7.41% -
433.milc (max) -72.16% 97.000 27.000 - 0.00% -
470.lbm (avg) (percentage) -72.12% 3.730 1.040 - 0.97% -
459.GemsFDTD (max) -71.97% 578.000 162.000 - -11.96% -
459.GemsFDTD (unexplained diff vs previous) -71.58% 584.000 166.000 - 30.71% -
433.milc (unexplained diff vs previous) -70.83% 96.000 28.000 - 0.00% -
447.dealII -69.62% 79.000 24.000 - 0.00% -
447.dealII (avg) -69.62% 79.000 24.000 - 0.00% -
400.perlbench (unexplained diff vs previous) -68.57% 35.000 11.000 - -59.26% -
470.lbm (unexplained diff vs previous) (percentage) -67.26% 5.040 1.650 - -33.20% -
436.cactusADM (avg) (percentage) -65.83% 2.400 0.820 - 0.00% -
410.bwaves (max) -64.62% 260.000 92.000 - -15.60% -
410.bwaves (unexplained diff vs previous) -63.42% 257.000 94.000 - -15.32% -
456.hmmer -62.50% 56.000 21.000 - 0.00% -
456.hmmer (avg) -62.50% 56.000 21.000 - 0.00% -
450.soplex -62.16% 37.000 14.000 - 0.00% -
450.soplex (avg) -62.16% 37.000 14.000 - 0.00% -
470.lbm (max) (percentage) -59.85% 5.480 2.200 - -8.71% -
444.namd (avg) (percentage) -59.62% 2.600 1.050 - -0.94% -
447.dealII (unexplained diff vs previous) -58.82% 68.000 28.000 - 211.11% -
471.omnetpp (unexplained diff vs previous) (percentage) -56.72% 0.670 0.290 - -70.10% -
482.sphinx3 (unexplained diff vs previous) (percentage) -55.88% 3.060 1.350 - -72.28% -
471.omnetpp -55.05% 109.000 49.000 - -2.00% -
471.omnetpp (avg) -55.05% 109.000 49.000 - -2.00% -
410.bwaves (avg) (percentage) -53.57% 1.960 0.910 - 1.11% -
400.perlbench -48.84% 43.000 22.000 - 0.00% -
400.perlbench (avg) -48.84% 43.000 22.000 - 0.00% -
416.gamess (avg) (percentage) -48.48% 1.650 0.850 - 0.00% -
450.soplex (max) -40.58% 69.000 41.000 - 78.26% -
471.omnetpp (max) (percentage) -38.71% 1.860 1.140 - -34.10% -
450.soplex (unexplained diff vs previous) -34.78% 69.000 45.000 - 650.00% -
465.tonto -31.76% 148.000 101.000 - 0.00% -
465.tonto (avg) -31.76% 148.000 101.000 - 0.00% -
482.sphinx3 (avg) (percentage) -31.06% 2.350 1.620 - 0.00% -
465.tonto (avg) (percentage) -29.82% 1.140 0.800 - 2.56% -
464.h264ref -28.81% 59.000 42.000 - 0.00% -
464.h264ref (avg) -28.81% 59.000 42.000 - 0.00% -
481.wrf (avg) (percentage) -28.02% 2.570 1.850 - 0.00% -
434.zeusmp (avg) (percentage) -21.31% 1.220 0.960 - 2.13% -
435.gromacs -20.62% 160.000 127.000 - -2.31% -
435.gromacs (avg) -20.62% 160.000 127.000 - -2.31% -
459.GemsFDTD (avg) (percentage) -17.99% 1.390 1.140 - 1.79% -
429.mcf -16.07% 56.000 47.000 - -4.08% -
429.mcf (avg) -16.07% 56.000 47.000 - -4.08% -
447.dealII (max) (percentage) -11.52% 1.650 1.460 - 78.05% -
410.bwaves (max) (percentage) -10.73% 1.770 1.580 - -13.66% -
453.povray (avg) (percentage) -8.50% 1.530 1.400 - 2.19% -
410.bwaves (unexplained diff vs previous) (percentage) -8.05% 1.740 1.600 - -13.98% -
401.bzip2 (max) -7.46% 67.000 62.000 - 6.90% -
401.bzip2 (unexplained diff vs previous) -7.25% 69.000 64.000 - 6.67% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 17.24% 29.000 34.000 - 0.00% -

Report Time: 0.39s
Execution (seconds)
Name Current %
400.perlbench 1496.000 -
401.bzip2 2825.000 -2.22%
410.bwaves 5872.000 -1.58%
429.mcf 1173.000 -4.79%
433.milc 1066.000 -2.56%
434.zeusmp 2728.000 -2.54%
435.gromacs 7293.000 -4.19%
436.cactusADM 2614.000 1.24%
437.leslie3d 11639.000 -4.09%
444.namd 900.000 -
445.gobmk 5004.000 -
447.dealII 1890.000 -1.46%
450.soplex 555.000 -7.50%
453.povray 522.000 -2.97%
456.hmmer 4187.000 -
458.sjeng 7600.000 -
459.GemsFDTD 6958.000 -2.33%
462.libquantum 216.000 -
464.h264ref 6071.000 -1.32%
465.tonto 12746.000 -1.74%
470.lbm 3628.000 -1.63%
471.omnetpp 2773.000 -
473.astar 4661.000 -4.29%
482.sphinx3 892.000 -1.33%
Geometric Mean 2574.221 -2.09%
Code Size (bytes)
Name Current %
400.perlbench 562078.000 -
401.bzip2 33398.000 -
410.bwaves 14723.000 -
429.mcf 7717.000 -
433.milc 47733.000 -
434.zeusmp 138714.000 -
435.gromacs 393002.000 -
436.cactusADM 256626.000 -
437.leslie3d 46184.000 -
444.namd 163131.000 -
445.gobmk 1087552.000 -
447.dealII 189727.000 -
450.soplex 135852.000 -
453.povray 493733.000 -
456.hmmer 74389.000 -
458.sjeng 81349.000 -
459.GemsFDTD 194087.000 -
462.libquantum 13118.000 -
464.h264ref 301482.000 -
465.tonto 1464510.000 -
470.lbm 10213.000 -
471.omnetpp 296077.000 -
473.astar 15825.000 -
482.sphinx3 79598.000 -
Geometric Mean 105775.523 -
sample variability
Name Current %
400.perlbench 22.000 -
400.perlbench (avg) 22.000 -
400.perlbench (avg) (percentage) 1.510 -
400.perlbench (max) 21.000 -19.23%
400.perlbench (max) (percentage) 1.470 -17.88%
400.perlbench (unexplained diff vs previous) 11.000 -59.26%
400.perlbench (unexplained diff vs previous) (percentage) 0.740 -58.66%
401.bzip2 47.000 -2.08%
401.bzip2 (avg) 47.000 -2.08%
401.bzip2 (avg) (percentage) 1.690 -
401.bzip2 (max) 62.000 6.90%
401.bzip2 (max) (percentage) 2.220 9.36%
401.bzip2 (unexplained diff vs previous) 64.000 6.67%
401.bzip2 (unexplained diff vs previous) (percentage) 2.270 9.13%
403.gcc (avg) (percentage) 2.370 -
403.gcc (max) (percentage) 7.040 -
410.bwaves 53.000 -
410.bwaves (avg) 53.000 -
410.bwaves (avg) (percentage) 0.910 1.11%
410.bwaves (max) 92.000 -15.60%
410.bwaves (max) (percentage) 1.580 -13.66%
410.bwaves (unexplained diff vs previous) 94.000 -15.32%
410.bwaves (unexplained diff vs previous) (percentage) 1.600 -13.98%
416.gamess (avg) (percentage) 0.850 -
416.gamess (max) (percentage) 0.120 -
429.mcf 47.000 -4.08%
429.mcf (avg) 47.000 -4.08%
429.mcf (avg) (percentage) 4.010 -
429.mcf (max) 56.000 27.27%
429.mcf (max) (percentage) 4.790 33.06%
429.mcf (unexplained diff vs previous) 59.000 28.26%
429.mcf (unexplained diff vs previous) (percentage) 5.030 34.85%
433.milc 12.000 -
433.milc (avg) 12.000 -
433.milc (avg) (percentage) 1.140 1.79%
433.milc (max) 27.000 -
433.milc (max) (percentage) 2.560 2.40%
433.milc (unexplained diff vs previous) 28.000 -
433.milc (unexplained diff vs previous) (percentage) 2.630 2.73%
434.zeusmp 26.000 -
434.zeusmp (avg) 26.000 -
434.zeusmp (avg) (percentage) 0.960 2.13%
434.zeusmp (max) 69.000 213.64%
434.zeusmp (max) (percentage) 2.540 213.58%
434.zeusmp (unexplained diff vs previous) 71.000 3450.00%
434.zeusmp (unexplained diff vs previous) (percentage) 2.600 3614.29%
435.gromacs 127.000 -2.31%
435.gromacs (avg) 127.000 -2.31%
435.gromacs (avg) (percentage) 1.750 2.34%
435.gromacs (max) 305.000 79.41%
435.gromacs (max) (percentage) 4.190 87.05%
435.gromacs (unexplained diff vs previous) 319.000 1229.17%
435.gromacs (unexplained diff vs previous) (percentage) 4.370 1265.62%
436.cactusADM 21.000 -
436.cactusADM (avg) 21.000 -
436.cactusADM (avg) (percentage) 0.820 -
436.cactusADM (max) 32.000 28.00%
436.cactusADM (max) (percentage) 1.240 27.84%
436.cactusADM (unexplained diff vs previous) 32.000 3100.00%
436.cactusADM (unexplained diff vs previous) (percentage) 1.220 2950.00%
437.leslie3d 573.000 -4.34%
437.leslie3d (avg) 573.000 -4.34%
437.leslie3d (avg) (percentage) 4.930 -
437.leslie3d (max) 594.000 -10.41%
437.leslie3d (max) (percentage) 5.110 -6.58%
437.leslie3d (unexplained diff vs previous) 496.000 -26.95%
437.leslie3d (unexplained diff vs previous) (percentage) 4.260 -23.93%
444.namd 9.000 -
444.namd (avg) 9.000 -
444.namd (avg) (percentage) 1.050 -
444.namd (max) 9.000 -10.00%
444.namd (max) (percentage) 1.090 -4.39%
444.namd (unexplained diff vs previous) 5.000 400.00%
444.namd (unexplained diff vs previous) (percentage) 0.560 409.09%
445.gobmk 43.000 -
445.gobmk (avg) 43.000 -
445.gobmk (avg) (percentage) 0.870 -
445.gobmk (max) 53.000 -10.17%
445.gobmk (max) (percentage) 1.060 -10.17%
445.gobmk (unexplained diff vs previous) 40.000 -33.33%
445.gobmk (unexplained diff vs previous) (percentage) 0.800 -32.77%
447.dealII 24.000 -
447.dealII (avg) 24.000 -
447.dealII (avg) (percentage) 1.310 -
447.dealII (max) 27.000 80.00%
447.dealII (max) (percentage) 1.460 78.05%
447.dealII (unexplained diff vs previous) 28.000 211.11%
447.dealII (unexplained diff vs previous) (percentage) 1.480 214.89%
450.soplex 14.000 -
450.soplex (avg) 14.000 -
450.soplex (avg) (percentage) 2.550 2.82%
450.soplex (max) 41.000 78.26%
450.soplex (max) (percentage) 7.500 91.33%
450.soplex (unexplained diff vs previous) 45.000 650.00%
450.soplex (unexplained diff vs previous) (percentage) 8.110 711.00%
453.povray 7.000 -
453.povray (avg) 7.000 -
453.povray (avg) (percentage) 1.400 2.19%
453.povray (max) 15.000 150.00%
453.povray (max) (percentage) 2.970 143.44%
453.povray (unexplained diff vs previous) 16.000 433.33%
453.povray (unexplained diff vs previous) (percentage) 3.070 448.21%
454.calculix (avg) (percentage) 3.440 -
454.calculix (max) (percentage) 3.450 -
456.hmmer 21.000 -
456.hmmer (avg) 21.000 -
456.hmmer (avg) (percentage) 0.510 -1.92%
456.hmmer (max) 25.000 -7.41%
456.hmmer (max) (percentage) 0.610 -7.58%
456.hmmer (unexplained diff vs previous) 5.000 -82.14%
456.hmmer (unexplained diff vs previous) (percentage) 0.120 -82.09%
458.sjeng 46.000 -
458.sjeng (avg) 46.000 -
458.sjeng (avg) (percentage) 0.610 1.67%
458.sjeng (max) 72.000 200.00%
458.sjeng (max) (percentage) 0.950 196.87%
458.sjeng (unexplained diff vs previous) 73.000 305.56%
458.sjeng (unexplained diff vs previous) (percentage) 0.960 317.39%
459.GemsFDTD 79.000 -
459.GemsFDTD (avg) 79.000 -
459.GemsFDTD (avg) (percentage) 1.140 1.79%
459.GemsFDTD (max) 162.000 -11.96%
459.GemsFDTD (max) (percentage) 2.330 -10.04%
459.GemsFDTD (unexplained diff vs previous) 166.000 30.71%
459.GemsFDTD (unexplained diff vs previous) (percentage) 2.390 34.27%
462.libquantum 2.000 -
462.libquantum (avg) 2.000 -
462.libquantum (avg) (percentage) 1.340 -
462.libquantum (max) 2.000 -33.33%
462.libquantum (max) (percentage) 1.360 -4.23%
462.libquantum (unexplained diff vs previous) 2.000 -
462.libquantum (unexplained diff vs previous) (percentage) 0.930 -
464.h264ref 42.000 -
464.h264ref (avg) 42.000 -
464.h264ref (avg) (percentage) 0.700 1.45%
464.h264ref (max) 80.000 400.00%
464.h264ref (max) (percentage) 1.320 388.89%
464.h264ref (unexplained diff vs previous) 81.000 523.08%
464.h264ref (unexplained diff vs previous) (percentage) 1.330 533.33%
465.tonto 101.000 -
465.tonto (avg) 101.000 -
465.tonto (avg) (percentage) 0.800 2.56%
465.tonto (max) 221.000 225.00%
465.tonto (max) (percentage) 1.740 228.30%
465.tonto (unexplained diff vs previous) 226.000 653.33%
465.tonto (unexplained diff vs previous) (percentage) 1.770 669.57%
470.lbm 37.000 -
470.lbm (avg) 37.000 -
470.lbm (avg) (percentage) 1.040 -
470.lbm (max) 79.000 -10.23%
470.lbm (max) (percentage) 2.200 -8.71%
470.lbm (unexplained diff vs previous) 60.000 -34.07%
470.lbm (unexplained diff vs previous) (percentage) 1.650 -33.20%
471.omnetpp 49.000 -2.00%
471.omnetpp (avg) 49.000 -2.00%
471.omnetpp (avg) (percentage) 1.800 -1.10%
471.omnetpp (max) 31.000 -35.42%
471.omnetpp (max) (percentage) 1.140 -34.10%
471.omnetpp (unexplained diff vs previous) 8.000 -70.37%
471.omnetpp (unexplained diff vs previous) (percentage) 0.290 -70.10%
473.astar 66.000 -1.49%
473.astar (avg) 66.000 -1.49%
473.astar (avg) (percentage) 1.420 2.90%
473.astar (max) 199.000 215.87%
473.astar (max) (percentage) 4.290 230.00%
473.astar (unexplained diff vs previous) 209.000 226.56%
473.astar (unexplained diff vs previous) (percentage) 4.480 241.98%
481.wrf (avg) (percentage) 1.850 -
481.wrf (max) (percentage) 0.260 -
482.sphinx3 14.000 -
482.sphinx3 (avg) 14.000 -
482.sphinx3 (avg) (percentage) 1.620 -
482.sphinx3 (max) 34.000 -17.07%
482.sphinx3 (max) (percentage) 3.870 -16.59%
482.sphinx3 (unexplained diff vs previous) 12.000 -72.73%
482.sphinx3 (unexplained diff vs previous) (percentage) 1.350 -72.28%
483.xalancbmk (avg) (percentage) 1.140 -
483.xalancbmk (max) (percentage) 1.500 -
Geometric Mean 8.762 46.64%