Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=350609bb98cee92c6b4fbd334b99066683b9e5c1 (+ 7 commits)
git_gcc https://gcc.gnu.org/git/gcc.git (6aba48a8cc128e54ee243d451ac9a843ff41c4f9) (unchanged)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=ff806e9233e3e1ae08834dd23d609399712953b3 (+ 5 commits)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/bfa40f51f6440f26bf7686eca23a2c2e126e3084 (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-arm-master-Os_LTO-build/312/
View Options
Report
Filter

gnu-arm-master-Os_LTO test results

Run Order Start Time Duration
Current 0312 (2-changed-components) 2025-01-05T16:53:17 0:00:00
Previous 0310 (binutils-2_41-release-05241-g2cf6f573190) 2025-01-04T19:42:55 0:00:00
Baseline 0001 (3-changed-components) 2022-12-30T06:27:35 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 114 85
Performance Improvements 41 125
Unchanged Tests 1081 1026
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
437.leslie3d 10.15% 11084.000 12209.000 - -32.43% -
429.mcf 6.60% 1167.000 1244.000 - -89.39% -
450.soplex 5.84% 565.000 598.000 - -96.19% -
473.astar 4.28% 4645.000 4844.000 - -62.69% -
435.gromacs 3.79% 7366.000 7645.000 - -54.64% -
401.bzip2 3.34% 2812.000 2906.000 - -82.88% -
471.omnetpp 2.78% 2698.000 2773.000 - -70.07% -
465.tonto 2.75% 12706.000 13056.000 - 0.09% -
459.GemsFDTD 2.66% 6943.000 7128.000 - -71.90% -
482.sphinx3 2.48% 888.000 910.000 - -97.51% -
453.povray 1.69% 532.000 541.000 - -92.68% -
444.namd 1.68% 895.000 910.000 - -94.30% -
470.lbm 1.60% 3625.000 3683.000 - -77.42% -
445.gobmk 1.59% 5018.000 5098.000 - -58.87% -
400.perlbench 1.50% 1533.000 1556.000 - -86.13% -
434.zeusmp 1.46% 2742.000 2782.000 - -86.71% -
433.milc 1.30% 1073.000 1087.000 - -92.05% -
410.bwaves 1.19% 5904.000 5974.000 - -59.48% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
471.omnetpp (unexplained diff vs previous) 2400.00% 3.000 75.000 - 20.97% -
471.omnetpp (unexplained diff vs previous) (percentage) 2354.55% 0.110 2.700 - 302.99% -
445.gobmk (unexplained diff vs previous) 788.89% 9.000 80.000 - 344.44% -
445.gobmk (unexplained diff vs previous) (percentage) 772.22% 0.180 1.570 - 946.67% -
456.hmmer (unexplained diff vs previous) 130.00% 10.000 23.000 - -76.53% -
456.hmmer (unexplained diff vs previous) (percentage) 129.17% 0.240 0.550 - 5.77% -
444.namd (max) 114.29% 7.000 15.000 - -98.29% -
437.leslie3d (max) 89.16% 655.000 1239.000 - 121.25% -
444.namd (max) (percentage) 88.76% 0.890 1.680 - -69.51% -
444.namd (unexplained diff vs previous) 87.50% 8.000 15.000 - -98.20% -
444.namd (unexplained diff vs previous) (percentage) 85.39% 0.890 1.650 - -68.45% -
437.leslie3d (max) (percentage) 71.74% 5.910 10.150 - 227.42% -
450.soplex (unexplained diff vs previous) 65.00% 20.000 33.000 - -52.17% -
437.leslie3d (unexplained diff vs previous) 61.64% 696.000 1125.000 - 501.60% -
445.gobmk (max) 58.82% 51.000 81.000 - 145.45% -
450.soplex (unexplained diff vs previous) (percentage) 55.93% 3.540 5.520 - 1154.55% -
450.soplex (max) 54.55% 22.000 34.000 - -50.72% -
445.gobmk (max) (percentage) 54.37% 1.030 1.590 - 488.89% -
456.hmmer (max) 53.33% 15.000 23.000 - -76.53% -
456.hmmer (max) (percentage) 52.78% 0.360 0.550 - 5.77% -
459.GemsFDTD (max) 48.82% 127.000 189.000 - -67.30% -
437.leslie3d (unexplained diff vs previous) (percentage) 46.66% 6.280 9.210 - 794.17% -
450.soplex (max) (percentage) 44.91% 4.030 5.840 - 1227.27% -
459.GemsFDTD (max) (percentage) 44.57% 1.840 2.660 - 16.67% -
465.tonto (max) 43.03% 251.000 359.000 - 60.99% -
459.GemsFDTD (unexplained diff vs previous) 42.31% 130.000 185.000 - -68.32% -
459.GemsFDTD (unexplained diff vs previous) (percentage) 39.04% 1.870 2.600 - 13.04% -
465.tonto (max) (percentage) 38.89% 1.980 2.750 - 60.82% -
434.zeusmp (unexplained diff vs previous) 37.93% 29.000 40.000 - -91.49% -
465.tonto (unexplained diff vs previous) 36.19% 257.000 350.000 - 136.49% -
434.zeusmp (unexplained diff vs previous) (percentage) 35.85% 1.060 1.440 - -36.00% -
465.tonto (unexplained diff vs previous) (percentage) 32.67% 2.020 2.680 - 137.17% -
401.bzip2 (max) 25.97% 77.000 97.000 - 44.78% -
400.perlbench (max) 21.05% 19.000 23.000 - -74.16% -
401.bzip2 (max) (percentage) 20.58% 2.770 3.340 - 735.00% -
435.gromacs (max) 20.42% 240.000 289.000 - -2.36% -
401.bzip2 (unexplained diff vs previous) 17.50% 80.000 94.000 - 36.23% -
400.perlbench (max) (percentage) 16.28% 1.290 1.500 - 87.50% -
435.gromacs (max) (percentage) 16.26% 3.260 3.790 - 115.34% -
400.perlbench (unexplained diff vs previous) 15.00% 20.000 23.000 - -34.29% -
473.astar (max) 15.00% 180.000 207.000 - 239.34% -
434.zeusmp (max) 14.29% 35.000 40.000 - -91.68% -
400.perlbench (unexplained diff vs previous) (percentage) 13.85% 1.300 1.480 - 377.42% -
401.bzip2 (unexplained diff vs previous) (percentage) 13.73% 2.840 3.230 - 687.80% -
434.zeusmp (max) (percentage) 13.18% 1.290 1.460 - -36.52% -
435.gromacs (unexplained diff vs previous) 12.50% 248.000 279.000 - -4.45% -
464.h264ref (max) 12.50% 40.000 45.000 - -23.73% -
437.leslie3d 11.76% 544.000 608.000 - 101.99% -
437.leslie3d (avg) 11.76% 544.000 608.000 - 101.99% -
464.h264ref (max) (percentage) 10.45% 0.670 0.740 - 89.74% -
473.astar (max) (percentage) 10.03% 3.890 4.280 - 810.64% -
464.h264ref (unexplained diff vs previous) 9.76% 41.000 45.000 - -22.41% -
447.dealII (max) (percentage) 9.52% 0.630 0.690 - -58.18% -
447.dealII (unexplained diff vs previous) (percentage) 9.52% 0.630 0.690 - -8.00% -
447.dealII (max) 9.09% 11.000 12.000 - -92.00% -
464.h264ref (unexplained diff vs previous) (percentage) 8.96% 0.670 0.730 - 92.11% -
429.mcf 8.51% 47.000 51.000 - -8.93% -
429.mcf (avg) 8.51% 47.000 51.000 - -8.93% -
447.dealII (unexplained diff vs previous) 8.33% 12.000 13.000 - -80.88% -
435.gromacs (unexplained diff vs previous) (percentage) 8.31% 3.370 3.650 - 110.98% -
473.astar 7.35% 68.000 73.000 - 43.14% -
473.astar (avg) 7.35% 68.000 73.000 - 43.14% -
450.soplex 7.14% 14.000 15.000 - -59.46% -
450.soplex (avg) 7.14% 14.000 15.000 - -59.46% -
465.tonto 6.60% 106.000 113.000 - -23.65% -
465.tonto (avg) 6.60% 106.000 113.000 - -23.65% -
401.bzip2 6.52% 46.000 49.000 - 8.89% -
401.bzip2 (avg) 6.52% 46.000 49.000 - 8.89% -
435.gromacs 6.25% 128.000 136.000 - -15.00% -
435.gromacs (avg) 6.25% 128.000 136.000 - -15.00% -
473.astar (unexplained diff vs previous) 5.85% 188.000 199.000 - 226.23% -
459.GemsFDTD 5.06% 79.000 83.000 - -76.42% -
459.GemsFDTD (avg) 5.06% 79.000 83.000 - -76.42% -
400.perlbench 4.55% 22.000 23.000 - -46.51% -
400.perlbench (avg) 4.55% 22.000 23.000 - -46.51% -
465.tonto (avg) (percentage) 3.57% 0.840 0.870 - -23.68% -
473.astar (avg) (percentage) 2.72% 1.470 1.510 - 277.50% -
470.lbm 2.70% 37.000 38.000 - -93.75% -
470.lbm (avg) 2.70% 37.000 38.000 - -93.75% -
445.gobmk 2.33% 43.000 44.000 - 62.96% -
445.gobmk (avg) 2.33% 43.000 44.000 - 62.96% -
458.sjeng 2.13% 47.000 48.000 - 33.33% -
458.sjeng (avg) 2.13% 47.000 48.000 - 33.33% -
471.omnetpp 2.08% 48.000 49.000 - -55.05% -
471.omnetpp (avg) 2.08% 48.000 49.000 - -55.05% -
410.bwaves 1.85% 54.000 55.000 - -80.97% -
410.bwaves (avg) 1.85% 54.000 55.000 - -80.97% -
459.GemsFDTD (avg) (percentage) 1.74% 1.150 1.170 - -15.83% -
435.gromacs (avg) (percentage) 1.71% 1.750 1.780 - 87.37% -
450.soplex (avg) (percentage) 1.54% 2.600 2.640 - 1000.00% -
473.astar (unexplained diff vs previous) (percentage) 1.48% 4.050 4.110 - 774.47% -
437.leslie3d (avg) (percentage) 1.43% 4.910 4.980 - 198.20% -
429.mcf (max) 1.23% 81.000 82.000 - 121.62% -
401.bzip2 (avg) (percentage) 1.20% 1.670 1.690 - 525.93% -
445.gobmk (avg) (percentage) 1.16% 0.860 0.870 - 295.45% -
410.bwaves (avg) (percentage) 1.09% 0.920 0.930 - -52.55% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
462.libquantum (unexplained diff vs previous) (percentage) -50.54% 1.860 0.920 - 1050.00% -
462.libquantum (unexplained diff vs previous) -50.00% 4.000 2.000 - -85.71% -
453.povray (unexplained diff vs previous) (percentage) -48.13% 3.200 1.660 - -27.51% -
453.povray (unexplained diff vs previous) -47.06% 17.000 9.000 - -94.67% -
482.sphinx3 (unexplained diff vs previous) (percentage) -36.81% 3.830 2.420 - -20.92% -
482.sphinx3 (unexplained diff vs previous) -35.29% 34.000 22.000 - -98.03% -
462.libquantum (max) -33.33% 3.000 2.000 - -84.62% -
462.libquantum (max) (percentage) -25.14% 1.830 1.370 - 1612.50% -
433.milc (unexplained diff vs previous) (percentage) -23.21% 1.680 1.290 - 84.29% -
433.milc (unexplained diff vs previous) -22.22% 18.000 14.000 - -85.42% -
410.bwaves (unexplained diff vs previous) (percentage) -21.48% 1.490 1.170 - -32.76% -
410.bwaves (unexplained diff vs previous) -20.45% 88.000 70.000 - -72.76% -
453.povray (max) -18.75% 16.000 13.000 - -93.19% -
429.mcf (unexplained diff vs previous) (percentage) -17.02% 7.460 6.190 - 6777.78% -
453.povray (max) (percentage) -16.77% 3.100 2.580 - -0.39% -
436.cactusADM (max) -16.67% 18.000 15.000 - -98.78% -
436.cactusADM (max) (percentage) -12.86% 0.700 0.610 - -87.92% -
433.milc (max) (percentage) -12.73% 1.650 1.440 - 102.82% -
458.sjeng (unexplained diff vs previous) (percentage) -12.64% 0.870 0.760 - 153.33% -
470.lbm (unexplained diff vs previous) (percentage) -12.29% 1.790 1.570 - -68.85% -
458.sjeng (unexplained diff vs previous) -12.12% 66.000 58.000 - 20.83% -
470.lbm (max) (percentage) -12.02% 1.830 1.610 - -70.62% -
433.milc (max) -11.76% 17.000 15.000 - -84.54% -
429.mcf (unexplained diff vs previous) -11.49% 87.000 77.000 - 670.00% -
436.cactusADM (unexplained diff vs previous) -11.11% 18.000 16.000 - -98.64% -
470.lbm (unexplained diff vs previous) -10.77% 65.000 58.000 - -92.94% -
470.lbm (max) -10.61% 66.000 59.000 - -93.39% -
436.cactusADM (unexplained diff vs previous) (percentage) -10.14% 0.690 0.620 - -87.11% -
471.omnetpp (max) (percentage) -8.46% 4.020 3.680 - 97.85% -
482.sphinx3 (max) (percentage) -6.62% 3.930 3.670 - 16.51% -
410.bwaves (max) (percentage) -6.41% 1.560 1.460 - -17.51% -
458.sjeng (max) (percentage) -5.60% 1.250 1.180 - 293.33% -
471.omnetpp (max) -5.56% 108.000 102.000 - -40.70% -
410.bwaves (max) -5.43% 92.000 87.000 - -66.54% -
429.mcf (max) (percentage) -5.31% 6.970 6.600 - 1962.50% -
436.cactusADM -4.76% 21.000 20.000 - -96.58% -
436.cactusADM (avg) -4.76% 21.000 20.000 - -96.58% -
458.sjeng (max) -4.26% 94.000 90.000 - 87.50% -
447.dealII -4.17% 24.000 23.000 - -70.89% -
447.dealII (avg) -4.17% 24.000 23.000 - -70.89% -
482.sphinx3 (max) -2.94% 34.000 33.000 - -97.14% -

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
465.tonto 3.00% 1437761.000 1480858.000 - 0.00% -
436.cactusADM 2.03% 256976.000 262186.000 - 0.00% -
453.povray 1.89% 489013.000 498245.000 - 0.00% -
473.astar 1.67% 15549.000 15809.000 - 0.00% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
429.mcf (unexplained diff vs previous) (percentage) 6777.78% 0.090 6.190 - -17.02% -
429.mcf (max) (percentage) 1962.50% 0.320 6.600 - -5.31% -
462.libquantum (max) (percentage) 1612.50% 0.080 1.370 - -25.14% -
450.soplex (max) (percentage) 1227.27% 0.440 5.840 - 44.91% -
450.soplex (unexplained diff vs previous) (percentage) 1154.55% 0.440 5.520 - 55.93% -
403.gcc (max) (percentage) 1079.66% 0.590 6.960 - -0.14% -
462.libquantum (unexplained diff vs previous) (percentage) 1050.00% 0.080 0.920 - -50.54% -
450.soplex (avg) (percentage) 1000.00% 0.240 2.640 - 1.54% -
445.gobmk (unexplained diff vs previous) (percentage) 946.67% 0.150 1.570 - 772.22% -
473.astar (max) (percentage) 810.64% 0.470 4.280 - 10.03% -
437.leslie3d (unexplained diff vs previous) (percentage) 794.17% 1.030 9.210 - 46.66% -
473.astar (unexplained diff vs previous) (percentage) 774.47% 0.470 4.110 - 1.48% -
429.mcf (avg) (percentage) 762.50% 0.480 4.140 - 0.98% -
401.bzip2 (max) (percentage) 735.00% 0.400 3.340 - 20.58% -
401.bzip2 (unexplained diff vs previous) (percentage) 687.80% 0.410 3.230 - 13.73% -
429.mcf (unexplained diff vs previous) 670.00% 10.000 77.000 - -11.49% -
462.libquantum (avg) (percentage) 605.26% 0.190 1.340 - -0.74% -
401.bzip2 (avg) (percentage) 525.93% 0.270 1.690 - 1.20% -
437.leslie3d (unexplained diff vs previous) 501.60% 187.000 1125.000 - 61.64% -
445.gobmk (max) (percentage) 488.89% 0.270 1.590 - 54.37% -
403.gcc (avg) (percentage) 451.16% 0.430 2.370 - 0.00% -
400.perlbench (unexplained diff vs previous) (percentage) 377.42% 0.310 1.480 - 13.85% -
445.gobmk (unexplained diff vs previous) 344.44% 18.000 80.000 - 788.89% -
454.calculix (max) (percentage) 309.52% 0.840 3.440 - 0.00% -
471.omnetpp (unexplained diff vs previous) (percentage) 302.99% 0.670 2.700 - 2354.55% -
445.gobmk (avg) (percentage) 295.45% 0.220 0.870 - 1.16% -
458.sjeng (max) (percentage) 293.33% 0.300 1.180 - -5.60% -
400.perlbench (avg) (percentage) 279.49% 0.390 1.480 - 0.00% -
473.astar (avg) (percentage) 277.50% 0.400 1.510 - 2.72% -
473.astar (max) 239.34% 61.000 207.000 - 15.00% -
437.leslie3d (max) (percentage) 227.42% 3.100 10.150 - 71.74% -
473.astar (unexplained diff vs previous) 226.23% 61.000 199.000 - 5.85% -
437.leslie3d (avg) (percentage) 198.20% 1.670 4.980 - 1.43% -
458.sjeng (avg) (percentage) 173.91% 0.230 0.630 - 0.00% -
458.sjeng (unexplained diff vs previous) (percentage) 153.33% 0.300 0.760 - -12.64% -
445.gobmk (max) 145.45% 33.000 81.000 - 58.82% -
465.tonto (unexplained diff vs previous) (percentage) 137.17% 1.130 2.680 - 32.67% -
465.tonto (unexplained diff vs previous) 136.49% 148.000 350.000 - 36.19% -
429.mcf (max) 121.62% 37.000 82.000 - 1.23% -
437.leslie3d (max) 121.25% 560.000 1239.000 - 89.16% -
435.gromacs (max) (percentage) 115.34% 1.760 3.790 - 16.26% -
435.gromacs (unexplained diff vs previous) (percentage) 110.98% 1.730 3.650 - 8.31% -
483.xalancbmk (avg) (percentage) 103.57% 0.560 1.140 - 0.00% -
433.milc (max) (percentage) 102.82% 0.710 1.440 - -12.73% -
437.leslie3d 101.99% 301.000 608.000 - 11.76% -
437.leslie3d (avg) 101.99% 301.000 608.000 - 11.76% -
471.omnetpp (max) (percentage) 97.85% 1.860 3.680 - -8.46% -
464.h264ref (unexplained diff vs previous) (percentage) 92.11% 0.380 0.730 - 8.96% -
464.h264ref (max) (percentage) 89.74% 0.390 0.740 - 10.45% -
458.sjeng (max) 87.50% 48.000 90.000 - -4.26% -
400.perlbench (max) (percentage) 87.50% 0.800 1.500 - 16.28% -
435.gromacs (avg) (percentage) 87.37% 0.950 1.780 - 1.71% -
433.milc (unexplained diff vs previous) (percentage) 84.29% 0.700 1.290 - -23.21% -
464.h264ref (avg) (percentage) 79.49% 0.390 0.700 - 0.00% -
456.hmmer (avg) (percentage) 70.00% 0.300 0.510 - 0.00% -
454.calculix (avg) (percentage) 69.46% 2.030 3.440 - 0.00% -
433.milc (avg) (percentage) 66.67% 0.690 1.150 - 0.00% -
483.xalancbmk (max) (percentage) 63.04% 0.920 1.500 - 0.00% -
445.gobmk 62.96% 27.000 44.000 - 2.33% -
445.gobmk (avg) 62.96% 27.000 44.000 - 2.33% -
465.tonto (max) 60.99% 223.000 359.000 - 43.03% -
465.tonto (max) (percentage) 60.82% 1.710 2.750 - 38.89% -
471.omnetpp (avg) (percentage) 52.54% 1.180 1.800 - 0.56% -
447.dealII (avg) (percentage) 45.98% 0.870 1.270 - 0.00% -
401.bzip2 (max) 44.78% 67.000 97.000 - 25.97% -
473.astar 43.14% 51.000 73.000 - 7.35% -
473.astar (avg) 43.14% 51.000 73.000 - 7.35% -
401.bzip2 (unexplained diff vs previous) 36.23% 69.000 94.000 - 17.50% -
458.sjeng 33.33% 36.000 48.000 - 2.13% -
458.sjeng (avg) 33.33% 36.000 48.000 - 2.13% -
471.omnetpp (unexplained diff vs previous) 20.97% 62.000 75.000 - 2400.00% -
458.sjeng (unexplained diff vs previous) 20.83% 48.000 58.000 - -12.12% -
459.GemsFDTD (max) (percentage) 16.67% 2.280 2.660 - 44.57% -
482.sphinx3 (max) (percentage) 16.51% 3.150 3.670 - -6.62% -
459.GemsFDTD (unexplained diff vs previous) (percentage) 13.04% 2.300 2.600 - 39.04% -
401.bzip2 8.89% 45.000 49.000 - 6.52% -
401.bzip2 (avg) 8.89% 45.000 49.000 - 6.52% -
456.hmmer (max) (percentage) 5.77% 0.520 0.550 - 52.78% -
456.hmmer (unexplained diff vs previous) (percentage) 5.77% 0.520 0.550 - 129.17% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -17.24% 29.000 24.000 - 0.00% -
nb_execution_successful -17.24% 29.000 24.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
470.lbm -5.79% 10845.000 10217.000 - 0.00% -
437.leslie3d -4.04% 48001.000 46064.000 - 0.00% -
434.zeusmp -1.97% 141060.000 138278.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
462.libquantum -98.72% 17005.000 217.000 - 0.93% -
482.sphinx3 -97.51% 36586.000 910.000 - 2.48% -
450.soplex -96.19% 15709.000 598.000 - 5.84% -
444.namd -94.30% 15957.000 910.000 - 1.68% -
453.povray -92.68% 7395.000 541.000 - 1.69% -
433.milc -92.05% 13668.000 1087.000 - 1.30% -
436.cactusADM -89.40% 24396.000 2587.000 - -0.61% -
429.mcf -89.39% 11727.000 1244.000 - 6.60% -
434.zeusmp -86.71% 20932.000 2782.000 - 1.46% -
400.perlbench -86.13% 11215.000 1556.000 - 1.50% -
401.bzip2 -82.88% 16971.000 2906.000 - 3.34% -
447.dealII -79.31% 9101.000 1883.000 - -0.69% -
456.hmmer -77.94% 18995.000 4190.000 - 0.55% -
470.lbm -77.42% 16312.000 3683.000 - 1.60% -
459.GemsFDTD -71.90% 25364.000 7128.000 - 2.66% -
471.omnetpp -70.07% 9265.000 2773.000 - 2.78% -
473.astar -62.69% 12983.000 4844.000 - 4.28% -
464.h264ref -59.65% 15208.000 6137.000 - 0.74% -
410.bwaves -59.48% 14745.000 5974.000 - 1.19% -
445.gobmk -58.87% 12396.000 5098.000 - 1.59% -
435.gromacs -54.64% 16853.000 7645.000 - 3.79% -
458.sjeng -52.35% 16018.000 7632.000 - 0.77% -
437.leslie3d -32.43% 18070.000 12209.000 - 10.15% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
436.cactusADM (max) -98.78% 1231.000 15.000 - -16.67% -
436.cactusADM (unexplained diff vs previous) -98.64% 1173.000 16.000 - -11.11% -
444.namd (max) -98.29% 879.000 15.000 - 114.29% -
482.sphinx3 -98.25% 859.000 15.000 - 0.00% -
482.sphinx3 (avg) -98.25% 859.000 15.000 - 0.00% -
444.namd (unexplained diff vs previous) -98.20% 834.000 15.000 - 87.50% -
482.sphinx3 (unexplained diff vs previous) -98.03% 1118.000 22.000 - -35.29% -
444.namd -97.83% 414.000 9.000 - 0.00% -
444.namd (avg) -97.83% 414.000 9.000 - 0.00% -
482.sphinx3 (max) -97.14% 1152.000 33.000 - -2.94% -
436.cactusADM -96.58% 585.000 20.000 - -4.76% -
436.cactusADM (avg) -96.58% 585.000 20.000 - -4.76% -
416.gamess (max) (percentage) -96.18% 3.140 0.120 - 0.00% -
453.povray (unexplained diff vs previous) -94.67% 169.000 9.000 - -47.06% -
453.povray -93.81% 113.000 7.000 - 0.00% -
453.povray (avg) -93.81% 113.000 7.000 - 0.00% -
462.libquantum -93.75% 32.000 2.000 - 0.00% -
462.libquantum (avg) -93.75% 32.000 2.000 - 0.00% -
470.lbm -93.75% 608.000 38.000 - 2.70% -
470.lbm (avg) -93.75% 608.000 38.000 - 2.70% -
481.wrf (max) (percentage) -93.75% 4.160 0.260 - 0.00% -
470.lbm (max) -93.39% 893.000 59.000 - -10.61% -
453.povray (max) -93.19% 191.000 13.000 - -18.75% -
470.lbm (unexplained diff vs previous) -92.94% 822.000 58.000 - -10.77% -
447.dealII (max) -92.00% 150.000 12.000 - 9.09% -
434.zeusmp (max) -91.68% 481.000 40.000 - 14.29% -
434.zeusmp (unexplained diff vs previous) -91.49% 470.000 40.000 - 37.93% -
434.zeusmp -89.80% 255.000 26.000 - 0.00% -
434.zeusmp (avg) -89.80% 255.000 26.000 - 0.00% -
436.cactusADM (max) (percentage) -87.92% 5.050 0.610 - -12.86% -
433.milc -87.23% 94.000 12.000 - 0.00% -
433.milc (avg) -87.23% 94.000 12.000 - 0.00% -
436.cactusADM (unexplained diff vs previous) (percentage) -87.11% 4.810 0.620 - -10.14% -
462.libquantum (unexplained diff vs previous) -85.71% 14.000 2.000 - -50.00% -
433.milc (unexplained diff vs previous) -85.42% 96.000 14.000 - -22.22% -
462.libquantum (max) -84.62% 13.000 2.000 - -33.33% -
433.milc (max) -84.54% 97.000 15.000 - -11.76% -
410.bwaves -80.97% 289.000 55.000 - 1.85% -
410.bwaves (avg) -80.97% 289.000 55.000 - 1.85% -
447.dealII (unexplained diff vs previous) -80.88% 68.000 13.000 - 8.33% -
456.hmmer (max) -76.53% 98.000 23.000 - 53.33% -
456.hmmer (unexplained diff vs previous) -76.53% 98.000 23.000 - 130.00% -
459.GemsFDTD -76.42% 352.000 83.000 - 5.06% -
459.GemsFDTD (avg) -76.42% 352.000 83.000 - 5.06% -
400.perlbench (max) -74.16% 89.000 23.000 - 21.05% -
410.bwaves (unexplained diff vs previous) -72.76% 257.000 70.000 - -20.45% -
470.lbm (avg) (percentage) -71.85% 3.730 1.050 - 0.96% -
447.dealII -70.89% 79.000 23.000 - -4.17% -
447.dealII (avg) -70.89% 79.000 23.000 - -4.17% -
470.lbm (max) (percentage) -70.62% 5.480 1.610 - -12.02% -
444.namd (max) (percentage) -69.51% 5.510 1.680 - 88.76% -
470.lbm (unexplained diff vs previous) (percentage) -68.85% 5.040 1.570 - -12.29% -
444.namd (unexplained diff vs previous) (percentage) -68.45% 5.230 1.650 - 85.39% -
459.GemsFDTD (unexplained diff vs previous) -68.32% 584.000 185.000 - 42.31% -
459.GemsFDTD (max) -67.30% 578.000 189.000 - 48.82% -
410.bwaves (max) -66.54% 260.000 87.000 - -5.43% -
436.cactusADM (avg) (percentage) -66.25% 2.400 0.810 - 0.00% -
456.hmmer -62.50% 56.000 21.000 - 0.00% -
456.hmmer (avg) -62.50% 56.000 21.000 - 0.00% -
444.namd (avg) (percentage) -60.00% 2.600 1.040 - 0.00% -
450.soplex -59.46% 37.000 15.000 - 7.14% -
450.soplex (avg) -59.46% 37.000 15.000 - 7.14% -
447.dealII (max) (percentage) -58.18% 1.650 0.690 - 9.52% -
471.omnetpp -55.05% 109.000 49.000 - 2.08% -
471.omnetpp (avg) -55.05% 109.000 49.000 - 2.08% -
410.bwaves (avg) (percentage) -52.55% 1.960 0.930 - 1.09% -
450.soplex (unexplained diff vs previous) -52.17% 69.000 33.000 - 65.00% -
450.soplex (max) -50.72% 69.000 34.000 - 54.55% -
416.gamess (avg) (percentage) -48.48% 1.650 0.850 - 0.00% -
400.perlbench -46.51% 43.000 23.000 - 4.55% -
400.perlbench (avg) -46.51% 43.000 23.000 - 4.55% -
471.omnetpp (max) -40.70% 172.000 102.000 - -5.56% -
434.zeusmp (max) (percentage) -36.52% 2.300 1.460 - 13.18% -
434.zeusmp (unexplained diff vs previous) (percentage) -36.00% 2.250 1.440 - 35.85% -
400.perlbench (unexplained diff vs previous) -34.29% 35.000 23.000 - 15.00% -
410.bwaves (unexplained diff vs previous) (percentage) -32.76% 1.740 1.170 - -21.48% -
464.h264ref -28.81% 59.000 42.000 - 0.00% -
464.h264ref (avg) -28.81% 59.000 42.000 - 0.00% -
481.wrf (avg) (percentage) -28.02% 2.570 1.850 - 0.00% -
453.povray (unexplained diff vs previous) (percentage) -27.51% 2.290 1.660 - -48.13% -
482.sphinx3 (avg) (percentage) -27.23% 2.350 1.710 - 0.59% -
464.h264ref (max) -23.73% 59.000 45.000 - 12.50% -
465.tonto (avg) (percentage) -23.68% 1.140 0.870 - 3.57% -
465.tonto -23.65% 148.000 113.000 - 6.60% -
465.tonto (avg) -23.65% 148.000 113.000 - 6.60% -
464.h264ref (unexplained diff vs previous) -22.41% 58.000 45.000 - 9.76% -
482.sphinx3 (unexplained diff vs previous) (percentage) -20.92% 3.060 2.420 - -36.81% -
434.zeusmp (avg) (percentage) -20.49% 1.220 0.970 - 0.00% -
410.bwaves (max) (percentage) -17.51% 1.770 1.460 - -6.41% -
459.GemsFDTD (avg) (percentage) -15.83% 1.390 1.170 - 1.74% -
435.gromacs -15.00% 160.000 136.000 - 6.25% -
435.gromacs (avg) -15.00% 160.000 136.000 - 6.25% -
429.mcf -8.93% 56.000 51.000 - 8.51% -
429.mcf (avg) -8.93% 56.000 51.000 - 8.51% -
447.dealII (unexplained diff vs previous) (percentage) -8.00% 0.750 0.690 - 9.52% -
453.povray (avg) (percentage) -4.58% 1.530 1.460 - 0.00% -
435.gromacs (unexplained diff vs previous) -4.45% 292.000 279.000 - 12.50% -
435.gromacs (max) -2.36% 296.000 289.000 - 20.42% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 17.24% 29.000 34.000 - 0.00% -

Report Time: 0.39s
Execution (seconds)
Name Current %
400.perlbench 1556.000 1.50%
401.bzip2 2906.000 3.34%
410.bwaves 5974.000 1.19%
429.mcf 1244.000 6.60%
433.milc 1087.000 1.30%
434.zeusmp 2782.000 1.46%
435.gromacs 7645.000 3.79%
436.cactusADM 2587.000 -
437.leslie3d 12209.000 10.15%
444.namd 910.000 1.68%
445.gobmk 5098.000 1.59%
447.dealII 1883.000 -
450.soplex 598.000 5.84%
453.povray 541.000 1.69%
456.hmmer 4190.000 -
458.sjeng 7632.000 -
459.GemsFDTD 7128.000 2.66%
462.libquantum 217.000 -
464.h264ref 6137.000 -
465.tonto 13056.000 2.75%
470.lbm 3683.000 1.60%
471.omnetpp 2773.000 2.78%
473.astar 4844.000 4.28%
482.sphinx3 910.000 2.48%
Geometric Mean 2633.415 2.41%
Code Size (bytes)
Name Current %
400.perlbench 567954.000 -
401.bzip2 33422.000 -
410.bwaves 14695.000 -
429.mcf 7713.000 -
433.milc 47821.000 -
434.zeusmp 138278.000 -
435.gromacs 395982.000 -
436.cactusADM 262186.000 -
437.leslie3d 46064.000 -
444.namd 163187.000 -
445.gobmk 1092644.000 -
447.dealII 190307.000 -
450.soplex 136116.000 -
453.povray 498245.000 -
456.hmmer 74905.000 -
458.sjeng 81817.000 -
459.GemsFDTD 194255.000 -
462.libquantum 13114.000 -
464.h264ref 301730.000 -
465.tonto 1480858.000 -
470.lbm 10217.000 -
471.omnetpp 297877.000 -
473.astar 15809.000 -
482.sphinx3 80426.000 -
Geometric Mean 106189.755 -
sample variability
Name Current %
400.perlbench 23.000 4.55%
400.perlbench (avg) 23.000 4.55%
400.perlbench (avg) (percentage) 1.480 -
400.perlbench (max) 23.000 21.05%
400.perlbench (max) (percentage) 1.500 16.28%
400.perlbench (unexplained diff vs previous) 23.000 15.00%
400.perlbench (unexplained diff vs previous) (percentage) 1.480 13.85%
401.bzip2 49.000 6.52%
401.bzip2 (avg) 49.000 6.52%
401.bzip2 (avg) (percentage) 1.690 1.20%
401.bzip2 (max) 97.000 25.97%
401.bzip2 (max) (percentage) 3.340 20.58%
401.bzip2 (unexplained diff vs previous) 94.000 17.50%
401.bzip2 (unexplained diff vs previous) (percentage) 3.230 13.73%
403.gcc (avg) (percentage) 2.370 -
403.gcc (max) (percentage) 6.960 -
410.bwaves 55.000 1.85%
410.bwaves (avg) 55.000 1.85%
410.bwaves (avg) (percentage) 0.930 1.09%
410.bwaves (max) 87.000 -5.43%
410.bwaves (max) (percentage) 1.460 -6.41%
410.bwaves (unexplained diff vs previous) 70.000 -20.45%
410.bwaves (unexplained diff vs previous) (percentage) 1.170 -21.48%
416.gamess (avg) (percentage) 0.850 -
416.gamess (max) (percentage) 0.120 -
429.mcf 51.000 8.51%
429.mcf (avg) 51.000 8.51%
429.mcf (avg) (percentage) 4.140 -
429.mcf (max) 82.000 1.23%
429.mcf (max) (percentage) 6.600 -5.31%
429.mcf (unexplained diff vs previous) 77.000 -11.49%
429.mcf (unexplained diff vs previous) (percentage) 6.190 -17.02%
433.milc 12.000 -
433.milc (avg) 12.000 -
433.milc (avg) (percentage) 1.150 -
433.milc (max) 15.000 -11.76%
433.milc (max) (percentage) 1.440 -12.73%
433.milc (unexplained diff vs previous) 14.000 -22.22%
433.milc (unexplained diff vs previous) (percentage) 1.290 -23.21%
434.zeusmp 26.000 -
434.zeusmp (avg) 26.000 -
434.zeusmp (avg) (percentage) 0.970 -
434.zeusmp (max) 40.000 14.29%
434.zeusmp (max) (percentage) 1.460 13.18%
434.zeusmp (unexplained diff vs previous) 40.000 37.93%
434.zeusmp (unexplained diff vs previous) (percentage) 1.440 35.85%
435.gromacs 136.000 6.25%
435.gromacs (avg) 136.000 6.25%
435.gromacs (avg) (percentage) 1.780 1.71%
435.gromacs (max) 289.000 20.42%
435.gromacs (max) (percentage) 3.790 16.26%
435.gromacs (unexplained diff vs previous) 279.000 12.50%
435.gromacs (unexplained diff vs previous) (percentage) 3.650 8.31%
436.cactusADM 20.000 -4.76%
436.cactusADM (avg) 20.000 -4.76%
436.cactusADM (avg) (percentage) 0.810 -
436.cactusADM (max) 15.000 -16.67%
436.cactusADM (max) (percentage) 0.610 -12.86%
436.cactusADM (unexplained diff vs previous) 16.000 -11.11%
436.cactusADM (unexplained diff vs previous) (percentage) 0.620 -10.14%
437.leslie3d 608.000 11.76%
437.leslie3d (avg) 608.000 11.76%
437.leslie3d (avg) (percentage) 4.980 1.43%
437.leslie3d (max) 1239.000 89.16%
437.leslie3d (max) (percentage) 10.150 71.74%
437.leslie3d (unexplained diff vs previous) 1125.000 61.64%
437.leslie3d (unexplained diff vs previous) (percentage) 9.210 46.66%
444.namd 9.000 -
444.namd (avg) 9.000 -
444.namd (avg) (percentage) 1.040 -
444.namd (max) 15.000 114.29%
444.namd (max) (percentage) 1.680 88.76%
444.namd (unexplained diff vs previous) 15.000 87.50%
444.namd (unexplained diff vs previous) (percentage) 1.650 85.39%
445.gobmk 44.000 2.33%
445.gobmk (avg) 44.000 2.33%
445.gobmk (avg) (percentage) 0.870 1.16%
445.gobmk (max) 81.000 58.82%
445.gobmk (max) (percentage) 1.590 54.37%
445.gobmk (unexplained diff vs previous) 80.000 788.89%
445.gobmk (unexplained diff vs previous) (percentage) 1.570 772.22%
447.dealII 23.000 -4.17%
447.dealII (avg) 23.000 -4.17%
447.dealII (avg) (percentage) 1.270 -
447.dealII (max) 12.000 9.09%
447.dealII (max) (percentage) 0.690 9.52%
447.dealII (unexplained diff vs previous) 13.000 8.33%
447.dealII (unexplained diff vs previous) (percentage) 0.690 9.52%
450.soplex 15.000 7.14%
450.soplex (avg) 15.000 7.14%
450.soplex (avg) (percentage) 2.640 1.54%
450.soplex (max) 34.000 54.55%
450.soplex (max) (percentage) 5.840 44.91%
450.soplex (unexplained diff vs previous) 33.000 65.00%
450.soplex (unexplained diff vs previous) (percentage) 5.520 55.93%
453.povray 7.000 -
453.povray (avg) 7.000 -
453.povray (avg) (percentage) 1.460 -
453.povray (max) 13.000 -18.75%
453.povray (max) (percentage) 2.580 -16.77%
453.povray (unexplained diff vs previous) 9.000 -47.06%
453.povray (unexplained diff vs previous) (percentage) 1.660 -48.13%
454.calculix (avg) (percentage) 3.440 -
454.calculix (max) (percentage) 3.440 -
456.hmmer 21.000 -
456.hmmer (avg) 21.000 -
456.hmmer (avg) (percentage) 0.510 -
456.hmmer (max) 23.000 53.33%
456.hmmer (max) (percentage) 0.550 52.78%
456.hmmer (unexplained diff vs previous) 23.000 130.00%
456.hmmer (unexplained diff vs previous) (percentage) 0.550 129.17%
458.sjeng 48.000 2.13%
458.sjeng (avg) 48.000 2.13%
458.sjeng (avg) (percentage) 0.630 -
458.sjeng (max) 90.000 -4.26%
458.sjeng (max) (percentage) 1.180 -5.60%
458.sjeng (unexplained diff vs previous) 58.000 -12.12%
458.sjeng (unexplained diff vs previous) (percentage) 0.760 -12.64%
459.GemsFDTD 83.000 5.06%
459.GemsFDTD (avg) 83.000 5.06%
459.GemsFDTD (avg) (percentage) 1.170 1.74%
459.GemsFDTD (max) 189.000 48.82%
459.GemsFDTD (max) (percentage) 2.660 44.57%
459.GemsFDTD (unexplained diff vs previous) 185.000 42.31%
459.GemsFDTD (unexplained diff vs previous) (percentage) 2.600 39.04%
462.libquantum 2.000 -
462.libquantum (avg) 2.000 -
462.libquantum (avg) (percentage) 1.340 -
462.libquantum (max) 2.000 -33.33%
462.libquantum (max) (percentage) 1.370 -25.14%
462.libquantum (unexplained diff vs previous) 2.000 -50.00%
462.libquantum (unexplained diff vs previous) (percentage) 0.920 -50.54%
464.h264ref 42.000 -
464.h264ref (avg) 42.000 -
464.h264ref (avg) (percentage) 0.700 -
464.h264ref (max) 45.000 12.50%
464.h264ref (max) (percentage) 0.740 10.45%
464.h264ref (unexplained diff vs previous) 45.000 9.76%
464.h264ref (unexplained diff vs previous) (percentage) 0.730 8.96%
465.tonto 113.000 6.60%
465.tonto (avg) 113.000 6.60%
465.tonto (avg) (percentage) 0.870 3.57%
465.tonto (max) 359.000 43.03%
465.tonto (max) (percentage) 2.750 38.89%
465.tonto (unexplained diff vs previous) 350.000 36.19%
465.tonto (unexplained diff vs previous) (percentage) 2.680 32.67%
470.lbm 38.000 2.70%
470.lbm (avg) 38.000 2.70%
470.lbm (avg) (percentage) 1.050 -
470.lbm (max) 59.000 -10.61%
470.lbm (max) (percentage) 1.610 -12.02%
470.lbm (unexplained diff vs previous) 58.000 -10.77%
470.lbm (unexplained diff vs previous) (percentage) 1.570 -12.29%
471.omnetpp 49.000 2.08%
471.omnetpp (avg) 49.000 2.08%
471.omnetpp (avg) (percentage) 1.800 -
471.omnetpp (max) 102.000 -5.56%
471.omnetpp (max) (percentage) 3.680 -8.46%
471.omnetpp (unexplained diff vs previous) 75.000 2400.00%
471.omnetpp (unexplained diff vs previous) (percentage) 2.700 2354.55%
473.astar 73.000 7.35%
473.astar (avg) 73.000 7.35%
473.astar (avg) (percentage) 1.510 2.72%
473.astar (max) 207.000 15.00%
473.astar (max) (percentage) 4.280 10.03%
473.astar (unexplained diff vs previous) 199.000 5.85%
473.astar (unexplained diff vs previous) (percentage) 4.110 1.48%
481.wrf (avg) (percentage) 1.850 -
481.wrf (max) (percentage) 0.260 -
482.sphinx3 15.000 -
482.sphinx3 (avg) 15.000 -
482.sphinx3 (avg) (percentage) 1.710 -
482.sphinx3 (max) 33.000 -2.94%
482.sphinx3 (max) (percentage) 3.670 -6.62%
482.sphinx3 (unexplained diff vs previous) 22.000 -35.29%
482.sphinx3 (unexplained diff vs previous) (percentage) 2.420 -36.81%
483.xalancbmk (avg) (percentage) 1.140 -
483.xalancbmk (max) (percentage) 1.500 -
Geometric Mean 9.259 12.24%