Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=837e225ba1992f9745e5bbbd5e8443243a7f475f (+ 131 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/c75ee0bffabfd6056e29e7a421ae8e9615639a8f (+ 175 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=a885fc2d6897d3baa438e2594a92f0125f1258a9 (+ 25 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=9832a080bcc5e00aab98b704b1ad303857072ab6 (+ 84 commits)
test_url https://ci.linaro.org/job/tcwg_bmk_ci_gnu-build-tcwg_bmk_apm-gnu-master-arm-spec2k6-Os_LTO/168/
View Options
Report
Filter

gnu-arm-master-Os_LTO test results

Run Order Start Time Duration
Current 0168 (4-changed-components) 2022-10-13T03:00:25 0:00:00
Previous 0165 (3-changed-components) 2022-10-05T15:37:46 0:00:00
Baseline 0001 (3-changed-components) 2022-12-30T06:27:35 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 34 126
Performance Improvements 142 85
Unchanged Tests 1060 1025
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
416.gamess (unexplained diff vs previous) (percentage) 1700.00% 0.010 0.180 - -94.10% -
416.gamess (unexplained diff vs previous) 1600.00% 3.000 51.000 - -94.31% -
436.cactusADM (unexplained diff vs previous) (percentage) 725.00% 0.040 0.330 - -93.14% -
436.cactusADM (unexplained diff vs previous) 670.00% 10.000 77.000 - -93.44% -
471.omnetpp (unexplained diff vs previous) (percentage) 247.37% 0.570 1.980 - 195.52% -
471.omnetpp (unexplained diff vs previous) 237.74% 53.000 179.000 - 188.71% -
445.gobmk (unexplained diff vs previous) 200.00% 2.000 6.000 - -66.67% -
456.hmmer (unexplained diff vs previous) 151.85% 27.000 68.000 - -30.61% -
445.gobmk (unexplained diff vs previous) (percentage) 150.00% 0.020 0.050 - -66.67% -
456.hmmer (unexplained diff vs previous) (percentage) 142.86% 0.140 0.340 - -34.62% -
437.leslie3d (unexplained diff vs previous) (percentage) 140.00% 0.100 0.240 - -76.70% -
437.leslie3d (unexplained diff vs previous) 133.33% 18.000 42.000 - -77.54% -
401.bzip2 (unexplained diff vs previous) 128.57% 7.000 16.000 - -76.81% -
401.bzip2 (unexplained diff vs previous) (percentage) 125.00% 0.040 0.090 - -78.05% -
429.mcf (unexplained diff vs previous) 94.29% 35.000 68.000 - 580.00% -
429.mcf (unexplained diff vs previous) (percentage) 93.33% 0.300 0.580 - 544.44% -
471.omnetpp (max) (percentage) 76.36% 1.100 1.940 - 4.30% -
471.omnetpp (max) 73.27% 101.000 175.000 - 1.74% -
462.libquantum (unexplained diff vs previous) 40.00% 5.000 7.000 - -50.00% -
462.libquantum (unexplained diff vs previous) (percentage) 33.33% 0.030 0.040 - -50.00% -
434.zeusmp (unexplained diff vs previous) (percentage) 25.00% 0.440 0.550 - -75.56% -
434.zeusmp (unexplained diff vs previous) 24.44% 90.000 112.000 - -76.17% -
429.mcf (max) (percentage) 20.83% 0.480 0.580 - 81.25% -
429.mcf (max) 19.64% 56.000 67.000 - 81.08% -
400.perlbench (unexplained diff vs previous) (percentage) 14.63% 0.410 0.470 - 51.61% -
400.perlbench (unexplained diff vs previous) 12.77% 47.000 53.000 - 51.43% -
456.hmmer (max) 9.84% 61.000 67.000 - -31.63% -
456.hmmer (max) (percentage) 9.68% 0.310 0.340 - -34.62% -
433.milc (avg) (percentage) 2.70% 1.110 1.140 - 65.22% -
400.perlbench 2.22% 45.000 46.000 - 6.98% -
400.perlbench (avg) 2.22% 45.000 46.000 - 6.98% -
471.omnetpp (avg) (percentage) 1.76% 1.700 1.730 - 46.61% -
433.milc 1.32% 152.000 154.000 - 63.83% -
433.milc (avg) 1.32% 152.000 154.000 - 63.83% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
471.omnetpp -1.94% 9239.000 9060.000 - -2.21% -
410.bwaves -1.53% 14684.000 14459.000 - -1.94% -
433.milc -1.40% 13758.000 13566.000 - -0.75% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
459.GemsFDTD (unexplained diff vs previous) (percentage) -98.39% 2.490 0.040 - -98.26% -
473.astar (unexplained diff vs previous) -98.33% 60.000 1.000 - -98.36% -
459.GemsFDTD (unexplained diff vs previous) -98.30% 647.000 11.000 - -98.12% -
473.astar (unexplained diff vs previous) (percentage) -97.83% 0.460 0.010 - -97.87% -
482.sphinx3 (unexplained diff vs previous) (percentage) -97.67% 3.430 0.080 - -97.39% -
482.sphinx3 (unexplained diff vs previous) -97.60% 1291.000 31.000 - -97.23% -
470.lbm (unexplained diff vs previous) (percentage) -97.54% 4.870 0.120 - -97.62% -
470.lbm (unexplained diff vs previous) -97.49% 835.000 21.000 - -97.45% -
435.gromacs (unexplained diff vs previous) (percentage) -93.75% 0.160 0.010 - -99.42% -
435.gromacs (unexplained diff vs previous) -92.59% 27.000 2.000 - -99.32% -
453.povray (unexplained diff vs previous) -91.82% 220.000 18.000 - -89.35% -
453.povray (unexplained diff vs previous) (percentage) -91.72% 2.900 0.240 - -89.52% -
481.wrf (unexplained diff vs previous) (percentage) -90.93% 4.410 0.400 - -90.17% -
481.wrf (unexplained diff vs previous) -90.92% 1013.000 92.000 - -89.71% -
403.gcc (unexplained diff vs previous) (percentage) -89.47% 1.140 0.120 - -79.31% -
403.gcc (unexplained diff vs previous) -89.32% 103.000 11.000 - -78.85% -
464.h264ref (unexplained diff vs previous) -82.35% 17.000 3.000 - -94.83% -
464.h264ref (unexplained diff vs previous) (percentage) -81.82% 0.110 0.020 - -94.74% -
444.namd (unexplained diff vs previous) (percentage) -75.00% 0.200 0.050 - -99.04% -
444.namd (unexplained diff vs previous) -73.33% 30.000 8.000 - -99.04% -
450.soplex (max) -64.06% 64.000 23.000 - -66.67% -
450.soplex (max) (percentage) -63.41% 0.410 0.150 - -65.91% -
464.h264ref (max) (percentage) -61.90% 0.210 0.080 - -79.49% -
464.h264ref (max) -61.29% 31.000 12.000 - -79.66% -
435.gromacs (max) -36.32% 223.000 142.000 - -52.03% -
435.gromacs (max) (percentage) -36.30% 1.350 0.860 - -51.14% -
450.soplex (unexplained diff vs previous) -25.93% 27.000 20.000 - -71.01% -
450.soplex (unexplained diff vs previous) (percentage) -23.53% 0.170 0.130 - -70.45% -
481.wrf (avg) (percentage) -18.33% 4.200 3.430 - 33.46% -
459.GemsFDTD (avg) (percentage) -18.33% 2.510 2.050 - 47.48% -
453.povray (avg) (percentage) -18.32% 2.620 2.140 - 39.87% -
459.GemsFDTD -18.25% 652.000 533.000 - 51.42% -
459.GemsFDTD (avg) -18.25% 652.000 533.000 - 51.42% -
453.povray -18.18% 198.000 162.000 - 43.36% -
453.povray (avg) -18.18% 198.000 162.000 - 43.36% -
481.wrf -18.05% 964.000 790.000 - 39.82% -
481.wrf (avg) -18.05% 964.000 790.000 - 39.82% -
473.astar (max) (percentage) -17.39% 0.460 0.380 - -19.15% -
435.gromacs -17.00% 247.000 205.000 - 28.12% -
435.gromacs (avg) -17.00% 247.000 205.000 - 28.12% -
473.astar (max) -16.95% 59.000 49.000 - -19.67% -
435.gromacs (avg) (percentage) -16.78% 1.490 1.240 - 30.53% -
464.h264ref -14.53% 117.000 100.000 - 69.49% -
464.h264ref (avg) -14.53% 117.000 100.000 - 69.49% -
464.h264ref (avg) (percentage) -14.10% 0.780 0.670 - 71.79% -
444.namd -13.88% 533.000 459.000 - 10.87% -
444.namd (avg) -13.88% 533.000 459.000 - 10.87% -
444.namd (avg) (percentage) -13.68% 3.510 3.030 - 16.54% -
403.gcc -13.33% 75.000 65.000 - 71.05% -
403.gcc (avg) -13.33% 75.000 65.000 - 71.05% -
482.sphinx3 (avg) (percentage) -13.15% 3.650 3.170 - 34.89% -
403.gcc (avg) (percentage) -13.10% 0.840 0.730 - 69.77% -
482.sphinx3 -13.05% 1372.000 1193.000 - 38.88% -
482.sphinx3 (avg) -13.05% 1372.000 1193.000 - 38.88% -
470.lbm -13.02% 860.000 748.000 - 23.03% -
470.lbm (avg) -13.02% 860.000 748.000 - 23.03% -
470.lbm (avg) (percentage) -12.95% 5.020 4.370 - 17.16% -
437.leslie3d -12.56% 406.000 355.000 - 17.94% -
437.leslie3d (avg) -12.56% 406.000 355.000 - 17.94% -
454.calculix (max) (percentage) -12.52% 5.750 5.030 - 498.81% -
454.calculix (max) -12.45% 1727.000 1512.000 - 455.88% -
482.sphinx3 (max) (percentage) -12.36% 3.560 3.120 - -0.95% -
436.cactusADM -12.33% 681.000 597.000 - 2.05% -
436.cactusADM (avg) -12.33% 681.000 597.000 - 2.05% -
482.sphinx3 (max) -12.26% 1338.000 1174.000 - 1.91% -
437.leslie3d (avg) (percentage) -12.23% 2.290 2.010 - 20.36% -
416.gamess (avg) (percentage) -12.12% 1.980 1.740 - 5.45% -
416.gamess -12.06% 564.000 496.000 - 2.27% -
416.gamess (avg) -12.06% 564.000 496.000 - 2.27% -
436.cactusADM (avg) (percentage) -11.95% 2.930 2.580 - 7.50% -
473.astar (avg) (percentage) -11.86% 0.590 0.520 - 30.00% -
473.astar -11.84% 76.000 67.000 - 31.37% -
473.astar (avg) -11.84% 76.000 67.000 - 31.37% -
410.bwaves (unexplained diff vs previous) -11.76% 255.000 225.000 - -12.45% -
410.bwaves (max) -11.44% 306.000 271.000 - 4.23% -
436.cactusADM (max) -11.37% 818.000 725.000 - -41.10% -
444.namd (max) -11.26% 586.000 520.000 - -40.84% -
444.namd (max) (percentage) -11.14% 3.860 3.430 - -37.75% -
436.cactusADM (max) (percentage) -11.08% 3.520 3.130 - -38.02% -
403.gcc (max) -10.68% 103.000 92.000 - 76.92% -
445.gobmk (avg) (percentage) -10.53% 0.190 0.170 - -22.73% -
403.gcc (max) (percentage) -10.43% 1.150 1.030 - 74.58% -
410.bwaves (unexplained diff vs previous) (percentage) -10.34% 1.740 1.560 - -10.34% -
434.zeusmp (max) -10.16% 364.000 327.000 - -32.02% -
410.bwaves (max) (percentage) -10.05% 2.090 1.880 - 6.21% -
401.bzip2 (avg) (percentage) -9.80% 0.510 0.460 - 70.37% -
462.libquantum (avg) (percentage) -9.68% 0.310 0.280 - 47.37% -
462.libquantum -9.62% 52.000 47.000 - 46.88% -
462.libquantum (avg) -9.62% 52.000 47.000 - 46.88% -
434.zeusmp (max) (percentage) -9.60% 1.770 1.600 - -30.43% -
401.bzip2 -9.30% 86.000 78.000 - 73.33% -
401.bzip2 (avg) -9.30% 86.000 78.000 - 73.33% -
447.dealII (max) (percentage) -8.97% 0.780 0.710 - -56.97% -
437.leslie3d (max) -8.70% 839.000 766.000 - 36.79% -
445.gobmk -8.70% 23.000 21.000 - -22.22% -
445.gobmk (avg) -8.70% 23.000 21.000 - -22.22% -
416.gamess (max) (percentage) -8.58% 2.680 2.450 - -21.97% -
447.dealII (max) -8.57% 70.000 64.000 - -57.33% -
434.zeusmp -8.48% 283.000 259.000 - 1.57% -
434.zeusmp (avg) -8.48% 283.000 259.000 - 1.57% -
450.soplex -8.47% 59.000 54.000 - 45.95% -
450.soplex (avg) -8.47% 59.000 54.000 - 45.95% -
437.leslie3d (max) (percentage) -8.46% 4.730 4.330 - 39.68% -
453.povray (max) -8.41% 226.000 207.000 - 8.38% -
416.gamess (max) -8.39% 763.000 699.000 - -24.27% -
453.povray (max) (percentage) -8.36% 2.990 2.740 - 5.79% -
459.GemsFDTD (max) -8.30% 663.000 608.000 - 5.19% -
459.GemsFDTD (max) (percentage) -8.24% 2.550 2.340 - 2.63% -
429.mcf -8.18% 159.000 146.000 - 160.71% -
429.mcf (avg) -8.18% 159.000 146.000 - 160.71% -
401.bzip2 (max) -8.00% 25.000 23.000 - -65.67% -
434.zeusmp (avg) (percentage) -7.97% 1.380 1.270 - 4.10% -
450.soplex (avg) (percentage) -7.89% 0.380 0.350 - 45.83% -
429.mcf (avg) (percentage) -7.41% 1.350 1.250 - 160.42% -
465.tonto (max) -7.36% 258.000 239.000 - 7.17% -
481.wrf (max) (percentage) -7.14% 4.620 4.290 - 3.12% -
400.perlbench (max) -6.94% 72.000 67.000 - -24.72% -
481.wrf (max) -6.79% 1060.000 988.000 - 8.10% -
470.lbm (max) -6.40% 1063.000 995.000 - 11.42% -
465.tonto (max) (percentage) -6.37% 2.510 2.350 - 37.43% -
470.lbm (max) (percentage) -6.29% 6.200 5.810 - 6.02% -
400.perlbench (max) (percentage) -6.25% 0.640 0.600 - -25.00% -
483.xalancbmk (max) -6.00% 50.000 47.000 - -35.62% -
433.milc (max) -5.03% 199.000 189.000 - 94.85% -
445.gobmk (max) (percentage) -5.00% 0.200 0.190 - -29.63% -
483.xalancbmk (max) (percentage) -4.84% 0.620 0.590 - -35.87% -
445.gobmk (max) -4.17% 24.000 23.000 - -30.30% -
456.hmmer -3.80% 79.000 76.000 - 35.71% -
456.hmmer (avg) -3.80% 79.000 76.000 - 35.71% -
433.milc (max) (percentage) -3.45% 1.450 1.400 - 97.18% -
410.bwaves -2.76% 254.000 247.000 - -14.53% -
410.bwaves (avg) -2.76% 254.000 247.000 - -14.53% -
456.hmmer (avg) (percentage) -2.50% 0.400 0.390 - 30.00% -
433.milc (unexplained diff vs previous) -2.04% 196.000 192.000 - 100.00% -
458.sjeng (max) -1.86% 377.000 370.000 - 670.83% -
458.sjeng (max) (percentage) -1.70% 2.350 2.310 - 670.00% -
465.tonto -1.30% 154.000 152.000 - 2.70% -
465.tonto (avg) -1.30% 154.000 152.000 - 2.70% -
410.bwaves (avg) (percentage) -1.16% 1.730 1.710 - -12.76% -

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
434.zeusmp 2.31% 141060.000 144324.000 - 0.00% -
450.soplex 1.10% 135596.000 137094.000 - 0.00% -
459.GemsFDTD 1.07% 195766.000 197862.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
470.lbm 5.01% 16312.000 17129.000 - -0.12% -
481.wrf 4.83% 21991.000 23053.000 - 0.40% -
456.hmmer 3.79% 18995.000 19714.000 - -0.34% -
482.sphinx3 2.87% 36586.000 37635.000 - 0.08% -
459.GemsFDTD 2.60% 25364.000 26024.000 - 0.04% -
453.povray 2.38% 7395.000 7571.000 - -0.24% -
403.gcc 1.52% 8890.000 9025.000 - -0.12% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
458.sjeng (max) 670.83% 48.000 370.000 - -1.86% -
458.sjeng (max) (percentage) 670.00% 0.300 2.310 - -1.70% -
429.mcf (unexplained diff vs previous) 580.00% 10.000 68.000 - 94.29% -
429.mcf (unexplained diff vs previous) (percentage) 544.44% 0.090 0.580 - 93.33% -
454.calculix (max) (percentage) 498.81% 0.840 5.030 - -12.52% -
454.calculix (max) 455.88% 272.000 1512.000 - -12.45% -
471.omnetpp (unexplained diff vs previous) (percentage) 195.52% 0.670 1.980 - 247.37% -
471.omnetpp (unexplained diff vs previous) 188.71% 62.000 179.000 - 237.74% -
454.calculix (avg) (percentage) 165.52% 2.030 5.390 - 0.00% -
429.mcf 160.71% 56.000 146.000 - -8.18% -
429.mcf (avg) 160.71% 56.000 146.000 - -8.18% -
429.mcf (avg) (percentage) 160.42% 0.480 1.250 - -7.41% -
458.sjeng 158.33% 36.000 93.000 - 0.00% -
458.sjeng (avg) 158.33% 36.000 93.000 - 0.00% -
458.sjeng (avg) (percentage) 152.17% 0.230 0.580 - 0.00% -
454.calculix 145.83% 659.000 1620.000 - 0.06% -
454.calculix (avg) 145.83% 659.000 1620.000 - 0.06% -
433.milc (unexplained diff vs previous) (percentage) 102.86% 0.700 1.420 - 0.00% -
433.milc (unexplained diff vs previous) 100.00% 96.000 192.000 - -2.04% -
433.milc (max) (percentage) 97.18% 0.710 1.400 - -3.45% -
433.milc (max) 94.85% 97.000 189.000 - -5.03% -
483.xalancbmk 93.18% 44.000 85.000 - 0.00% -
483.xalancbmk (avg) 93.18% 44.000 85.000 - 0.00% -
462.libquantum (max) 92.31% 13.000 25.000 - 0.00% -
462.libquantum (max) (percentage) 87.50% 0.080 0.150 - 0.00% -
483.xalancbmk (avg) (percentage) 87.50% 0.560 1.050 - 0.00% -
429.mcf (max) (percentage) 81.25% 0.320 0.580 - 20.83% -
429.mcf (max) 81.08% 37.000 67.000 - 19.64% -
403.gcc (max) 76.92% 52.000 92.000 - -10.68% -
403.gcc (max) (percentage) 74.58% 0.590 1.030 - -10.43% -
401.bzip2 73.33% 45.000 78.000 - -9.30% -
401.bzip2 (avg) 73.33% 45.000 78.000 - -9.30% -
464.h264ref (avg) (percentage) 71.79% 0.390 0.670 - -14.10% -
403.gcc 71.05% 38.000 65.000 - -13.33% -
403.gcc (avg) 71.05% 38.000 65.000 - -13.33% -
401.bzip2 (avg) (percentage) 70.37% 0.270 0.460 - -9.80% -
403.gcc (avg) (percentage) 69.77% 0.430 0.730 - -13.10% -
464.h264ref 69.49% 59.000 100.000 - -14.53% -
464.h264ref (avg) 69.49% 59.000 100.000 - -14.53% -
433.milc (avg) (percentage) 65.22% 0.690 1.140 - 2.70% -
433.milc 63.83% 94.000 154.000 - 1.32% -
433.milc (avg) 63.83% 94.000 154.000 - 1.32% -
400.perlbench (unexplained diff vs previous) (percentage) 51.61% 0.310 0.470 - 14.63% -
400.perlbench (unexplained diff vs previous) 51.43% 35.000 53.000 - 12.77% -
459.GemsFDTD 51.42% 352.000 533.000 - -18.25% -
459.GemsFDTD (avg) 51.42% 352.000 533.000 - -18.25% -
459.GemsFDTD (avg) (percentage) 47.48% 1.390 2.050 - -18.33% -
462.libquantum (avg) (percentage) 47.37% 0.190 0.280 - -9.68% -
462.libquantum 46.88% 32.000 47.000 - -9.62% -
462.libquantum (avg) 46.88% 32.000 47.000 - -9.62% -
471.omnetpp (avg) (percentage) 46.61% 1.180 1.730 - 1.76% -
450.soplex 45.95% 37.000 54.000 - -8.47% -
450.soplex (avg) 45.95% 37.000 54.000 - -8.47% -
450.soplex (avg) (percentage) 45.83% 0.240 0.350 - -7.89% -
453.povray 43.36% 113.000 162.000 - -18.18% -
453.povray (avg) 43.36% 113.000 162.000 - -18.18% -
471.omnetpp 43.12% 109.000 156.000 - -0.64% -
471.omnetpp (avg) 43.12% 109.000 156.000 - -0.64% -
453.povray (avg) (percentage) 39.87% 1.530 2.140 - -18.32% -
481.wrf 39.82% 565.000 790.000 - -18.05% -
481.wrf (avg) 39.82% 565.000 790.000 - -18.05% -
437.leslie3d (max) (percentage) 39.68% 3.100 4.330 - -8.46% -
482.sphinx3 38.88% 859.000 1193.000 - -13.05% -
482.sphinx3 (avg) 38.88% 859.000 1193.000 - -13.05% -
465.tonto (max) (percentage) 37.43% 1.710 2.350 - -6.37% -
437.leslie3d (max) 36.79% 560.000 766.000 - -8.70% -
456.hmmer 35.71% 56.000 76.000 - -3.80% -
456.hmmer (avg) 35.71% 56.000 76.000 - -3.80% -
482.sphinx3 (avg) (percentage) 34.89% 2.350 3.170 - -13.15% -
481.wrf (avg) (percentage) 33.46% 2.570 3.430 - -18.33% -
465.tonto (avg) (percentage) 31.58% 1.140 1.500 - 0.00% -
473.astar 31.37% 51.000 67.000 - -11.84% -
473.astar (avg) 31.37% 51.000 67.000 - -11.84% -
435.gromacs (avg) (percentage) 30.53% 0.950 1.240 - -16.78% -
456.hmmer (avg) (percentage) 30.00% 0.300 0.390 - -2.50% -
473.astar (avg) (percentage) 30.00% 0.400 0.520 - -11.86% -
435.gromacs 28.12% 160.000 205.000 - -17.00% -
435.gromacs (avg) 28.12% 160.000 205.000 - -17.00% -
470.lbm 23.03% 608.000 748.000 - -13.02% -
470.lbm (avg) 23.03% 608.000 748.000 - -13.02% -
437.leslie3d (avg) (percentage) 20.36% 1.670 2.010 - -12.23% -
437.leslie3d 17.94% 301.000 355.000 - -12.56% -
437.leslie3d (avg) 17.94% 301.000 355.000 - -12.56% -
470.lbm (avg) (percentage) 17.16% 3.730 4.370 - -12.95% -
444.namd (avg) (percentage) 16.54% 2.600 3.030 - -13.68% -
470.lbm (max) 11.42% 893.000 995.000 - -6.40% -
444.namd 10.87% 414.000 459.000 - -13.88% -
444.namd (avg) 10.87% 414.000 459.000 - -13.88% -
453.povray (max) 8.38% 191.000 207.000 - -8.41% -
481.wrf (max) 8.10% 914.000 988.000 - -6.79% -
436.cactusADM (avg) (percentage) 7.50% 2.400 2.580 - -11.95% -
465.tonto (max) 7.17% 223.000 239.000 - -7.36% -
400.perlbench 6.98% 43.000 46.000 - 2.22% -
400.perlbench (avg) 6.98% 43.000 46.000 - 2.22% -
410.bwaves (max) (percentage) 6.21% 1.770 1.880 - -10.05% -
470.lbm (max) (percentage) 6.02% 5.480 5.810 - -6.29% -
453.povray (max) (percentage) 5.79% 2.590 2.740 - -8.36% -
416.gamess (avg) (percentage) 5.45% 1.650 1.740 - -12.12% -
459.GemsFDTD (max) 5.19% 578.000 608.000 - -8.30% -
400.perlbench (avg) (percentage) 5.13% 0.390 0.410 - 2.50% -
471.omnetpp (max) (percentage) 4.30% 1.860 1.940 - 76.36% -
410.bwaves (max) 4.23% 260.000 271.000 - -11.44% -
434.zeusmp (avg) (percentage) 4.10% 1.220 1.270 - -7.97% -
481.wrf (max) (percentage) 3.12% 4.160 4.290 - -7.14% -
465.tonto 2.70% 148.000 152.000 - -1.30% -
465.tonto (avg) 2.70% 148.000 152.000 - -1.30% -
459.GemsFDTD (max) (percentage) 2.63% 2.280 2.340 - -8.24% -
416.gamess 2.27% 485.000 496.000 - -12.06% -
416.gamess (avg) 2.27% 485.000 496.000 - -12.06% -
436.cactusADM 2.05% 585.000 597.000 - -12.33% -
436.cactusADM (avg) 2.05% 585.000 597.000 - -12.33% -
482.sphinx3 (max) 1.91% 1152.000 1174.000 - -12.26% -
471.omnetpp (max) 1.74% 172.000 175.000 - 73.27% -
434.zeusmp 1.57% 255.000 259.000 - -8.48% -
434.zeusmp (avg) 1.57% 255.000 259.000 - -8.48% -
447.dealII (avg) (percentage) 1.15% 0.870 0.880 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
465.tonto -21.93% 13044.000 10183.000 - -0.95% -
454.calculix -7.48% 32491.000 30062.000 - 0.07% -
436.cactusADM -5.01% 24396.000 23173.000 - -0.33% -
444.namd -4.86% 15957.000 15181.000 - -0.05% -
416.gamess -2.94% 29409.000 28543.000 - 0.18% -
434.zeusmp -2.23% 20932.000 20465.000 - -0.54% -
471.omnetpp -2.21% 9265.000 9060.000 - -1.94% -
437.leslie3d -2.04% 18070.000 17701.000 - -0.24% -
410.bwaves -1.94% 14745.000 14459.000 - -1.53% -
435.gromacs -1.63% 16853.000 16579.000 - -0.01% -
464.h264ref -1.06% 15208.000 15047.000 - -0.02% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
435.gromacs (unexplained diff vs previous) (percentage) -99.42% 1.730 0.010 - -93.75% -
435.gromacs (unexplained diff vs previous) -99.32% 292.000 2.000 - -92.59% -
444.namd (unexplained diff vs previous) (percentage) -99.04% 5.230 0.050 - -75.00% -
444.namd (unexplained diff vs previous) -99.04% 834.000 8.000 - -73.33% -
473.astar (unexplained diff vs previous) -98.36% 61.000 1.000 - -98.33% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -98.26% 2.300 0.040 - -98.39% -
459.GemsFDTD (unexplained diff vs previous) -98.12% 584.000 11.000 - -98.30% -
473.astar (unexplained diff vs previous) (percentage) -97.87% 0.470 0.010 - -97.83% -
470.lbm (unexplained diff vs previous) (percentage) -97.62% 5.040 0.120 - -97.54% -
470.lbm (unexplained diff vs previous) -97.45% 822.000 21.000 - -97.49% -
482.sphinx3 (unexplained diff vs previous) (percentage) -97.39% 3.060 0.080 - -97.67% -
482.sphinx3 (unexplained diff vs previous) -97.23% 1118.000 31.000 - -97.60% -
464.h264ref (unexplained diff vs previous) -94.83% 58.000 3.000 - -82.35% -
464.h264ref (unexplained diff vs previous) (percentage) -94.74% 0.380 0.020 - -81.82% -
416.gamess (unexplained diff vs previous) -94.31% 896.000 51.000 - 1600.00% -
416.gamess (unexplained diff vs previous) (percentage) -94.10% 3.050 0.180 - 1700.00% -
436.cactusADM (unexplained diff vs previous) -93.44% 1173.000 77.000 - 670.00% -
436.cactusADM (unexplained diff vs previous) (percentage) -93.14% 4.810 0.330 - 725.00% -
481.wrf (unexplained diff vs previous) (percentage) -90.17% 4.070 0.400 - -90.93% -
481.wrf (unexplained diff vs previous) -89.71% 894.000 92.000 - -90.92% -
453.povray (unexplained diff vs previous) (percentage) -89.52% 2.290 0.240 - -91.72% -
453.povray (unexplained diff vs previous) -89.35% 169.000 18.000 - -91.82% -
464.h264ref (max) -79.66% 59.000 12.000 - -61.29% -
464.h264ref (max) (percentage) -79.49% 0.390 0.080 - -61.90% -
403.gcc (unexplained diff vs previous) (percentage) -79.31% 0.580 0.120 - -89.47% -
403.gcc (unexplained diff vs previous) -78.85% 52.000 11.000 - -89.32% -
401.bzip2 (unexplained diff vs previous) (percentage) -78.05% 0.410 0.090 - 125.00% -
437.leslie3d (unexplained diff vs previous) -77.54% 187.000 42.000 - 133.33% -
401.bzip2 (unexplained diff vs previous) -76.81% 69.000 16.000 - 128.57% -
437.leslie3d (unexplained diff vs previous) (percentage) -76.70% 1.030 0.240 - 140.00% -
434.zeusmp (unexplained diff vs previous) -76.17% 470.000 112.000 - 24.44% -
434.zeusmp (unexplained diff vs previous) (percentage) -75.56% 2.250 0.550 - 25.00% -
450.soplex (unexplained diff vs previous) -71.01% 69.000 20.000 - -25.93% -
450.soplex (unexplained diff vs previous) (percentage) -70.45% 0.440 0.130 - -23.53% -
445.gobmk (unexplained diff vs previous) -66.67% 18.000 6.000 - 200.00% -
445.gobmk (unexplained diff vs previous) (percentage) -66.67% 0.150 0.050 - 150.00% -
450.soplex (max) -66.67% 69.000 23.000 - -64.06% -
450.soplex (max) (percentage) -65.91% 0.440 0.150 - -63.41% -
401.bzip2 (max) -65.67% 67.000 23.000 - -8.00% -
401.bzip2 (max) (percentage) -65.00% 0.400 0.140 - -6.67% -
447.dealII (max) -57.33% 150.000 64.000 - -8.57% -
447.dealII (max) (percentage) -56.97% 1.650 0.710 - -8.97% -
435.gromacs (max) -52.03% 296.000 142.000 - -36.32% -
435.gromacs (max) (percentage) -51.14% 1.760 0.860 - -36.30% -
462.libquantum (unexplained diff vs previous) -50.00% 14.000 7.000 - 40.00% -
462.libquantum (unexplained diff vs previous) (percentage) -50.00% 0.080 0.040 - 33.33% -
436.cactusADM (max) -41.10% 1231.000 725.000 - -11.37% -
444.namd (max) -40.84% 879.000 520.000 - -11.26% -
436.cactusADM (max) (percentage) -38.02% 5.050 3.130 - -11.08% -
444.namd (max) (percentage) -37.75% 5.510 3.430 - -11.14% -
483.xalancbmk (max) (percentage) -35.87% 0.920 0.590 - -4.84% -
483.xalancbmk (max) -35.62% 73.000 47.000 - -6.00% -
456.hmmer (max) (percentage) -34.62% 0.520 0.340 - 9.68% -
456.hmmer (unexplained diff vs previous) (percentage) -34.62% 0.520 0.340 - 142.86% -
434.zeusmp (max) -32.02% 481.000 327.000 - -10.16% -
456.hmmer (max) -31.63% 98.000 67.000 - 9.84% -
456.hmmer (unexplained diff vs previous) -30.61% 98.000 68.000 - 151.85% -
434.zeusmp (max) (percentage) -30.43% 2.300 1.600 - -9.60% -
445.gobmk (max) -30.30% 33.000 23.000 - -4.17% -
445.gobmk (max) (percentage) -29.63% 0.270 0.190 - -5.00% -
400.perlbench (max) (percentage) -25.00% 0.800 0.600 - -6.25% -
400.perlbench (max) -24.72% 89.000 67.000 - -6.94% -
416.gamess (max) -24.27% 923.000 699.000 - -8.39% -
445.gobmk (avg) (percentage) -22.73% 0.220 0.170 - -10.53% -
445.gobmk -22.22% 27.000 21.000 - -8.70% -
445.gobmk (avg) -22.22% 27.000 21.000 - -8.70% -
416.gamess (max) (percentage) -21.97% 3.140 2.450 - -8.58% -
473.astar (max) -19.67% 61.000 49.000 - -16.95% -
473.astar (max) (percentage) -19.15% 0.470 0.380 - -17.39% -
410.bwaves -14.53% 289.000 247.000 - -2.76% -
410.bwaves (avg) -14.53% 289.000 247.000 - -2.76% -
410.bwaves (avg) (percentage) -12.76% 1.960 1.710 - -1.16% -
410.bwaves (unexplained diff vs previous) -12.45% 257.000 225.000 - -11.76% -
410.bwaves (unexplained diff vs previous) (percentage) -10.34% 1.740 1.560 - -10.34% -

Report Time: 0.38s
Execution (seconds)
Name Current %
400.perlbench 11273.000 -
401.bzip2 16978.000 -
403.gcc 9025.000 -
410.bwaves 14459.000 -1.53%
416.gamess 28543.000 -
429.mcf 11710.000 -
433.milc 13566.000 -1.40%
434.zeusmp 20465.000 -
435.gromacs 16579.000 -
436.cactusADM 23173.000 -
437.leslie3d 17701.000 -
444.namd 15181.000 -
445.gobmk 12441.000 -
447.dealII 9023.000 -
450.soplex 15648.000 -
453.povray 7571.000 -
454.calculix 30062.000 -
456.hmmer 19714.000 -
458.sjeng 16052.000 -
459.GemsFDTD 26024.000 -
462.libquantum 16942.000 -
464.h264ref 15047.000 -
465.tonto 10183.000 -
470.lbm 17129.000 -
471.omnetpp 9060.000 -1.94%
473.astar 12915.000 -
481.wrf 23053.000 -
482.sphinx3 37635.000 -
483.xalancbmk 8100.000 -
Geometric Mean 15426.107 -
Code Size (bytes)
Name Current %
400.perlbench 563607.000 -
401.bzip2 33660.000 -
403.gcc 1585363.000 -
410.bwaves 14714.000 -
416.gamess 4554282.000 -
429.mcf 7709.000 -
433.milc 47497.000 -
434.zeusmp 144324.000 -
435.gromacs 395282.000 -
436.cactusADM 256992.000 -
437.leslie3d 48073.000 -
444.namd 162762.000 -
445.gobmk 1088288.000 -
447.dealII 191138.000 -
450.soplex 137094.000 -
453.povray 489087.000 -
454.calculix 682027.000 -
456.hmmer 74993.000 -
458.sjeng 81121.000 -
459.GemsFDTD 197862.000 -
462.libquantum 13106.000 -
464.h264ref 301288.000 -
465.tonto 1437941.000 -
470.lbm 10845.000 -
471.omnetpp 297260.000 -
473.astar 15549.000 -
481.wrf 1540771.000 -
482.sphinx3 80002.000 -
483.xalancbmk 1460114.000 -
Geometric Mean 170174.692 -
sample variability
Name Current %
400.perlbench 46.000 2.22%
400.perlbench (avg) 46.000 2.22%
400.perlbench (avg) (percentage) 0.410 -
400.perlbench (max) 67.000 -6.94%
400.perlbench (max) (percentage) 0.600 -6.25%
400.perlbench (unexplained diff vs previous) 53.000 12.77%
400.perlbench (unexplained diff vs previous) (percentage) 0.470 14.63%
401.bzip2 78.000 -9.30%
401.bzip2 (avg) 78.000 -9.30%
401.bzip2 (avg) (percentage) 0.460 -9.80%
401.bzip2 (max) 23.000 -8.00%
401.bzip2 (max) (percentage) 0.140 -
401.bzip2 (unexplained diff vs previous) 16.000 128.57%
401.bzip2 (unexplained diff vs previous) (percentage) 0.090 125.00%
403.gcc 65.000 -13.33%
403.gcc (avg) 65.000 -13.33%
403.gcc (avg) (percentage) 0.730 -13.10%
403.gcc (max) 92.000 -10.68%
403.gcc (max) (percentage) 1.030 -10.43%
403.gcc (unexplained diff vs previous) 11.000 -89.32%
403.gcc (unexplained diff vs previous) (percentage) 0.120 -89.47%
410.bwaves 247.000 -2.76%
410.bwaves (avg) 247.000 -2.76%
410.bwaves (avg) (percentage) 1.710 -1.16%
410.bwaves (max) 271.000 -11.44%
410.bwaves (max) (percentage) 1.880 -10.05%
410.bwaves (unexplained diff vs previous) 225.000 -11.76%
410.bwaves (unexplained diff vs previous) (percentage) 1.560 -10.34%
416.gamess 496.000 -12.06%
416.gamess (avg) 496.000 -12.06%
416.gamess (avg) (percentage) 1.740 -12.12%
416.gamess (max) 699.000 -8.39%
416.gamess (max) (percentage) 2.450 -8.58%
416.gamess (unexplained diff vs previous) 51.000 1600.00%
416.gamess (unexplained diff vs previous) (percentage) 0.180 1700.00%
429.mcf 146.000 -8.18%
429.mcf (avg) 146.000 -8.18%
429.mcf (avg) (percentage) 1.250 -7.41%
429.mcf (max) 67.000 19.64%
429.mcf (max) (percentage) 0.580 20.83%
429.mcf (unexplained diff vs previous) 68.000 94.29%
429.mcf (unexplained diff vs previous) (percentage) 0.580 93.33%
433.milc 154.000 1.32%
433.milc (avg) 154.000 1.32%
433.milc (avg) (percentage) 1.140 2.70%
433.milc (max) 189.000 -5.03%
433.milc (max) (percentage) 1.400 -3.45%
433.milc (unexplained diff vs previous) 192.000 -2.04%
433.milc (unexplained diff vs previous) (percentage) 1.420 -
434.zeusmp 259.000 -8.48%
434.zeusmp (avg) 259.000 -8.48%
434.zeusmp (avg) (percentage) 1.270 -7.97%
434.zeusmp (max) 327.000 -10.16%
434.zeusmp (max) (percentage) 1.600 -9.60%
434.zeusmp (unexplained diff vs previous) 112.000 24.44%
434.zeusmp (unexplained diff vs previous) (percentage) 0.550 25.00%
435.gromacs 205.000 -17.00%
435.gromacs (avg) 205.000 -17.00%
435.gromacs (avg) (percentage) 1.240 -16.78%
435.gromacs (max) 142.000 -36.32%
435.gromacs (max) (percentage) 0.860 -36.30%
435.gromacs (unexplained diff vs previous) 2.000 -92.59%
435.gromacs (unexplained diff vs previous) (percentage) 0.010 -93.75%
436.cactusADM 597.000 -12.33%
436.cactusADM (avg) 597.000 -12.33%
436.cactusADM (avg) (percentage) 2.580 -11.95%
436.cactusADM (max) 725.000 -11.37%
436.cactusADM (max) (percentage) 3.130 -11.08%
436.cactusADM (unexplained diff vs previous) 77.000 670.00%
436.cactusADM (unexplained diff vs previous) (percentage) 0.330 725.00%
437.leslie3d 355.000 -12.56%
437.leslie3d (avg) 355.000 -12.56%
437.leslie3d (avg) (percentage) 2.010 -12.23%
437.leslie3d (max) 766.000 -8.70%
437.leslie3d (max) (percentage) 4.330 -8.46%
437.leslie3d (unexplained diff vs previous) 42.000 133.33%
437.leslie3d (unexplained diff vs previous) (percentage) 0.240 140.00%
444.namd 459.000 -13.88%
444.namd (avg) 459.000 -13.88%
444.namd (avg) (percentage) 3.030 -13.68%
444.namd (max) 520.000 -11.26%
444.namd (max) (percentage) 3.430 -11.14%
444.namd (unexplained diff vs previous) 8.000 -73.33%
444.namd (unexplained diff vs previous) (percentage) 0.050 -75.00%
445.gobmk 21.000 -8.70%
445.gobmk (avg) 21.000 -8.70%
445.gobmk (avg) (percentage) 0.170 -10.53%
445.gobmk (max) 23.000 -4.17%
445.gobmk (max) (percentage) 0.190 -5.00%
445.gobmk (unexplained diff vs previous) 6.000 200.00%
445.gobmk (unexplained diff vs previous) (percentage) 0.050 150.00%
447.dealII 79.000 -
447.dealII (avg) 79.000 -
447.dealII (avg) (percentage) 0.880 -
447.dealII (max) 64.000 -8.57%
447.dealII (max) (percentage) 0.710 -8.97%
450.soplex 54.000 -8.47%
450.soplex (avg) 54.000 -8.47%
450.soplex (avg) (percentage) 0.350 -7.89%
450.soplex (max) 23.000 -64.06%
450.soplex (max) (percentage) 0.150 -63.41%
450.soplex (unexplained diff vs previous) 20.000 -25.93%
450.soplex (unexplained diff vs previous) (percentage) 0.130 -23.53%
453.povray 162.000 -18.18%
453.povray (avg) 162.000 -18.18%
453.povray (avg) (percentage) 2.140 -18.32%
453.povray (max) 207.000 -8.41%
453.povray (max) (percentage) 2.740 -8.36%
453.povray (unexplained diff vs previous) 18.000 -91.82%
453.povray (unexplained diff vs previous) (percentage) 0.240 -91.72%
454.calculix 1620.000 -
454.calculix (avg) 1620.000 -
454.calculix (avg) (percentage) 5.390 -
454.calculix (max) 1512.000 -12.45%
454.calculix (max) (percentage) 5.030 -12.52%
456.hmmer 76.000 -3.80%
456.hmmer (avg) 76.000 -3.80%
456.hmmer (avg) (percentage) 0.390 -2.50%
456.hmmer (max) 67.000 9.84%
456.hmmer (max) (percentage) 0.340 9.68%
456.hmmer (unexplained diff vs previous) 68.000 151.85%
456.hmmer (unexplained diff vs previous) (percentage) 0.340 142.86%
458.sjeng 93.000 -
458.sjeng (avg) 93.000 -
458.sjeng (avg) (percentage) 0.580 -
458.sjeng (max) 370.000 -1.86%
458.sjeng (max) (percentage) 2.310 -1.70%
459.GemsFDTD 533.000 -18.25%
459.GemsFDTD (avg) 533.000 -18.25%
459.GemsFDTD (avg) (percentage) 2.050 -18.33%
459.GemsFDTD (max) 608.000 -8.30%
459.GemsFDTD (max) (percentage) 2.340 -8.24%
459.GemsFDTD (unexplained diff vs previous) 11.000 -98.30%
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.040 -98.39%
462.libquantum 47.000 -9.62%
462.libquantum (avg) 47.000 -9.62%
462.libquantum (avg) (percentage) 0.280 -9.68%
462.libquantum (max) 25.000 -
462.libquantum (max) (percentage) 0.150 -
462.libquantum (unexplained diff vs previous) 7.000 40.00%
462.libquantum (unexplained diff vs previous) (percentage) 0.040 33.33%
464.h264ref 100.000 -14.53%
464.h264ref (avg) 100.000 -14.53%
464.h264ref (avg) (percentage) 0.670 -14.10%
464.h264ref (max) 12.000 -61.29%
464.h264ref (max) (percentage) 0.080 -61.90%
464.h264ref (unexplained diff vs previous) 3.000 -82.35%
464.h264ref (unexplained diff vs previous) (percentage) 0.020 -81.82%
465.tonto 152.000 -1.30%
465.tonto (avg) 152.000 -1.30%
465.tonto (avg) (percentage) 1.500 -
465.tonto (max) 239.000 -7.36%
465.tonto (max) (percentage) 2.350 -6.37%
470.lbm 748.000 -13.02%
470.lbm (avg) 748.000 -13.02%
470.lbm (avg) (percentage) 4.370 -12.95%
470.lbm (max) 995.000 -6.40%
470.lbm (max) (percentage) 5.810 -6.29%
470.lbm (unexplained diff vs previous) 21.000 -97.49%
470.lbm (unexplained diff vs previous) (percentage) 0.120 -97.54%
471.omnetpp 156.000 -
471.omnetpp (avg) 156.000 -
471.omnetpp (avg) (percentage) 1.730 1.76%
471.omnetpp (max) 175.000 73.27%
471.omnetpp (max) (percentage) 1.940 76.36%
471.omnetpp (unexplained diff vs previous) 179.000 237.74%
471.omnetpp (unexplained diff vs previous) (percentage) 1.980 247.37%
473.astar 67.000 -11.84%
473.astar (avg) 67.000 -11.84%
473.astar (avg) (percentage) 0.520 -11.86%
473.astar (max) 49.000 -16.95%
473.astar (max) (percentage) 0.380 -17.39%
473.astar (unexplained diff vs previous) 1.000 -98.33%
473.astar (unexplained diff vs previous) (percentage) 0.010 -97.83%
481.wrf 790.000 -18.05%
481.wrf (avg) 790.000 -18.05%
481.wrf (avg) (percentage) 3.430 -18.33%
481.wrf (max) 988.000 -6.79%
481.wrf (max) (percentage) 4.290 -7.14%
481.wrf (unexplained diff vs previous) 92.000 -90.92%
481.wrf (unexplained diff vs previous) (percentage) 0.400 -90.93%
482.sphinx3 1193.000 -13.05%
482.sphinx3 (avg) 1193.000 -13.05%
482.sphinx3 (avg) (percentage) 3.170 -13.15%
482.sphinx3 (max) 1174.000 -12.26%
482.sphinx3 (max) (percentage) 3.120 -12.36%
482.sphinx3 (unexplained diff vs previous) 31.000 -97.60%
482.sphinx3 (unexplained diff vs previous) (percentage) 0.080 -97.67%
483.xalancbmk 85.000 -
483.xalancbmk (avg) 85.000 -
483.xalancbmk (avg) (percentage) 1.050 -
483.xalancbmk (max) 47.000 -6.00%
483.xalancbmk (max) (percentage) 0.590 -4.84%
Geometric Mean 12.447 -22.99%