Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=19cacf672930cee20feaf1f3468e3d5ac3099ffd (+ 25 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/d634e6088f139ee700d79ec73b1ad6436096a6ff (+ 31 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=16439f419b270184ec501c531bf20d83b6745fb0 (+ 26 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=773e23b4ee1ad9cd0502d3969e2f2598b1ccc6fe (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-aarch64-master-Os-build/29/
View Options
Report
Filter

gnu-aarch64-master-Os test results

Run Order Start Time Duration
Current 0029 (3-changed-components) 2023-04-02T09:09:39 0:00:00
Previous 0028 (basepoints/gcc-13-06963-ge11cde0381c5) 2023-03-31T13:07:24 0:00:00
Baseline 0001 (3-changed-components) 2023-01-01T08:38:47 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 69 97
Performance Improvements 111 120
Added Tests 2 0
Unchanged Tests 1054 1019
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
429.mcf 20.04% 1542.000 1851.000 - -89.21% -
436.cactusADM 2.77% 2093.000 2151.000 - -87.74% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
429.mcf (unexplained diff vs previous) 2990.00% 10.000 309.000 - 232.26% -
429.mcf (unexplained diff vs previous) (percentage) 2467.69% 0.650 16.690 - 2990.74% -
410.bwaves (unexplained diff vs previous) (percentage) 1310.00% 0.100 1.410 - 1310.00% -
410.bwaves (unexplained diff vs previous) 1300.00% 6.000 84.000 - 460.00% -
473.astar (unexplained diff vs previous) (percentage) 1165.62% 0.320 4.050 - 20150.00% -
473.astar (unexplained diff vs previous) 1105.26% 19.000 229.000 - 7533.33% -
444.namd (unexplained diff vs previous) 600.00% 1.000 7.000 - -99.00% -
444.namd (unexplained diff vs previous) (percentage) 600.00% 0.140 0.980 - -87.32% -
458.sjeng (unexplained diff vs previous) 489.47% 19.000 112.000 - 1144.44% -
458.sjeng (unexplained diff vs previous) (percentage) 488.00% 0.250 1.470 - 2350.00% -
459.GemsFDTD (unexplained diff vs previous) (percentage) 441.82% 0.550 2.980 - 1319.05% -
401.bzip2 (unexplained diff vs previous) (percentage) 425.35% 0.710 3.730 - 328.74% -
459.GemsFDTD (unexplained diff vs previous) 423.53% 34.000 178.000 - 270.83% -
401.bzip2 (unexplained diff vs previous) 409.52% 21.000 107.000 - -18.94% -
450.soplex (unexplained diff vs previous) (percentage) 364.74% 1.560 7.250 - 260.70% -
450.soplex (unexplained diff vs previous) 333.33% 9.000 39.000 - -87.46% -
464.h264ref (unexplained diff vs previous) (percentage) 323.53% 0.170 0.720 - 620.00% -
464.h264ref (unexplained diff vs previous) 320.00% 10.000 42.000 - 180.00% -
447.dealII (unexplained diff vs previous) (percentage) 264.00% 0.250 0.910 - 16.67% -
447.dealII (unexplained diff vs previous) 260.00% 5.000 18.000 - -76.32% -
433.milc (unexplained diff vs previous) (percentage) 188.30% 0.940 2.710 - -17.38% -
433.milc (unexplained diff vs previous) 181.82% 11.000 31.000 - -92.71% -
436.cactusADM (max) 168.18% 22.000 59.000 - -89.31% -
434.zeusmp (unexplained diff vs previous) (percentage) 160.36% 1.110 2.890 - 24.03% -
436.cactusADM (max) (percentage) 154.13% 1.090 2.770 - -12.06% -
435.gromacs (unexplained diff vs previous) (percentage) 153.78% 1.190 3.020 - 46.60% -
434.zeusmp (unexplained diff vs previous) 153.57% 28.000 71.000 - -76.95% -
436.cactusADM (unexplained diff vs previous) 152.17% 23.000 58.000 - -89.82% -
471.omnetpp (unexplained diff vs previous) (percentage) 148.00% 1.250 3.100 - 1191.67% -
435.gromacs (unexplained diff vs previous) 147.67% 86.000 213.000 - -33.02% -
436.cactusADM (unexplained diff vs previous) (percentage) 145.45% 1.100 2.700 - -16.92% -
471.omnetpp (unexplained diff vs previous) 140.54% 37.000 89.000 - 242.31% -
470.lbm (unexplained diff vs previous) (percentage) 128.12% 0.640 1.460 - 1227.27% -
470.lbm (unexplained diff vs previous) 125.00% 24.000 54.000 - 285.71% -
433.milc (max) 114.29% 14.000 30.000 - -92.70% -
433.milc (max) (percentage) 107.87% 1.270 2.640 - -16.72% -
456.hmmer (unexplained diff vs previous) 100.00% 10.000 20.000 - -75.90% -
456.hmmer (unexplained diff vs previous) (percentage) 100.00% 0.350 0.700 - -6.67% -
456.hmmer (max) (percentage) 97.14% 0.350 0.690 - -45.67% -
434.zeusmp (max) (percentage) 91.16% 1.470 2.810 - 23.25% -
456.hmmer (max) 90.00% 10.000 19.000 - -86.43% -
482.sphinx3 (unexplained diff vs previous) (percentage) 88.89% 1.800 3.400 - 448.39% -
434.zeusmp (max) 86.49% 37.000 69.000 - -77.08% -
482.sphinx3 (unexplained diff vs previous) 82.35% 17.000 31.000 - -83.33% -
437.leslie3d (unexplained diff vs previous) (percentage) 60.57% 5.580 8.960 - 291.27% -
462.libquantum (unexplained diff vs previous) (percentage) 53.42% 1.460 2.240 - 22300.00% -
462.libquantum (unexplained diff vs previous) 50.00% 2.000 3.000 - 200.00% -
437.leslie3d (unexplained diff vs previous) 47.34% 638.000 940.000 - 174.05% -
429.mcf 28.00% 100.000 128.000 - 42.22% -
429.mcf (avg) 28.00% 100.000 128.000 - 42.22% -
429.mcf (max) 27.15% 291.000 370.000 - 302.17% -
450.soplex (max) (percentage) 24.49% 5.430 6.760 - 243.15% -
410.bwaves (max) (percentage) 21.93% 1.140 1.390 - 561.90% -
410.bwaves (max) 20.29% 69.000 83.000 - 176.67% -
458.sjeng (max) (percentage) 19.83% 1.210 1.450 - 559.09% -
458.sjeng (max) 18.28% 93.000 110.000 - 254.84% -
450.soplex (max) 16.13% 31.000 36.000 - -88.16% -
473.astar (max) (percentage) 8.64% 3.590 3.900 - 2685.71% -
429.mcf (max) (percentage) 6.14% 18.880 20.040 - 3611.11% -
429.mcf (avg) (percentage) 5.96% 6.540 6.930 - 1207.55% -
473.astar (max) 4.27% 211.000 220.000 - 1000.00% -
482.sphinx3 (max) (percentage) 3.79% 3.170 3.290 - 123.81% -
437.leslie3d (avg) (percentage) 3.49% 4.010 4.150 - 74.37% -
436.cactusADM 2.82% 71.000 73.000 - -74.91% -
436.cactusADM (avg) 2.82% 71.000 73.000 - -74.91% -
473.astar (avg) (percentage) 1.54% 2.600 2.640 - 1289.47% -
450.soplex (avg) (percentage) 1.20% 5.010 5.070 - 308.87% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
437.leslie3d -8.22% 11435.000 10495.000 - -30.06% -
450.soplex -6.76% 577.000 538.000 - -96.52% -
403.gcc -6.56% 61.000 57.000 - -99.37% -
483.xalancbmk -5.06% 4351.000 4131.000 - -63.02% -
473.astar -3.90% 5879.000 5650.000 - -62.16% -
401.bzip2 -3.59% 2978.000 2871.000 - -81.09% -
482.sphinx3 -3.29% 942.000 911.000 - -96.96% -
454.calculix -3.23% 62.000 60.000 - -99.74% -
465.tonto -3.06% 11049.000 10711.000 - 30.54% -
471.omnetpp -3.01% 2957.000 2868.000 - -73.29% -
435.gromacs -2.94% 7256.000 7043.000 - -54.32% -
459.GemsFDTD -2.90% 6143.000 5965.000 - -74.46% -
434.zeusmp -2.81% 2528.000 2457.000 - -81.40% -
433.milc -2.64% 1176.000 1145.000 - -91.18% -
453.povray -2.57% 545.000 531.000 - -91.89% -
445.gobmk -2.19% 5290.000 5174.000 - -56.87% -
462.libquantum -2.19% 137.000 134.000 - -98.85% -
481.wrf -1.55% 5497.000 5412.000 - -67.85% -
458.sjeng -1.45% 7746.000 7634.000 - -46.52% -
470.lbm -1.44% 3755.000 3701.000 - -71.13% -
410.bwaves -1.39% 6061.000 5977.000 - -59.49% -
400.perlbench -1.29% 1628.000 1607.000 - -84.91% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
454.calculix (max) -25.00% 4.000 3.000 - -99.72% -
453.povray (max) -16.67% 6.000 5.000 - -96.97% -
437.leslie3d (max) -12.36% 1578.000 1383.000 - 294.02% -
445.gobmk (max) -11.11% 81.000 72.000 - -60.66% -
471.omnetpp (max) -9.24% 119.000 108.000 - -83.69% -
447.dealII (max) -9.09% 22.000 20.000 - -81.31% -
435.gromacs (max) -9.03% 277.000 252.000 - -18.97% -
459.GemsFDTD (max) -9.00% 200.000 182.000 - 30.00% -
481.wrf (max) -8.70% 115.000 105.000 - -80.19% -
465.tonto (max) -8.53% 293.000 268.000 - -8.53% -
445.gobmk (max) (percentage) -8.44% 1.540 1.410 - -7.84% -
444.namd (max) -8.33% 12.000 11.000 - -98.31% -
470.lbm (max) -7.69% 78.000 72.000 - -88.97% -
481.wrf (max) (percentage) -7.14% 2.100 1.950 - -38.10% -
435.gromacs (max) (percentage) -6.53% 3.830 3.580 - 77.23% -
459.GemsFDTD (max) (percentage) -6.42% 3.270 3.060 - 410.00% -
401.bzip2 (max) -6.36% 110.000 103.000 - -22.56% -
403.gcc (max) (percentage) -6.33% 7.740 7.250 - 906.94% -
453.povray (max) (percentage) -6.31% 1.110 1.040 - -58.89% -
462.libquantum (max) (percentage) -6.27% 2.710 2.540 - 296.88% -
447.dealII (max) (percentage) -6.25% 1.120 1.050 - -4.55% -
444.namd -5.88% 34.000 32.000 - -90.99% -
444.namd (avg) -5.88% 34.000 32.000 - -90.99% -
483.xalancbmk -5.88% 51.000 48.000 - -35.14% -
483.xalancbmk (avg) -5.88% 51.000 48.000 - -35.14% -
470.lbm (max) (percentage) -5.77% 2.080 1.960 - -61.57% -
464.h264ref (max) -5.75% 87.000 82.000 - 32.26% -
471.omnetpp (max) (percentage) -5.71% 4.030 3.800 - -38.41% -
465.tonto (max) (percentage) -5.64% 2.660 2.510 - -29.89% -
483.xalancbmk (max) -5.54% 289.000 273.000 - 506.67% -
400.perlbench (max) -5.41% 37.000 35.000 - -89.86% -
482.sphinx3 -5.41% 37.000 35.000 - -91.97% -
482.sphinx3 (avg) -5.41% 37.000 35.000 - -91.97% -
464.h264ref (max) (percentage) -5.37% 1.490 1.410 - 227.91% -
444.namd (max) (percentage) -5.11% 1.760 1.670 - -76.74% -
437.leslie3d -5.02% 458.000 435.000 - 21.85% -
437.leslie3d (avg) -5.02% 458.000 435.000 - 21.85% -
453.povray -5.00% 20.000 19.000 - -76.54% -
453.povray (avg) -5.00% 20.000 19.000 - -76.54% -
437.leslie3d (max) (percentage) -4.49% 13.800 13.180 - 463.25% -
454.calculix (max) (percentage) -4.43% 6.540 6.250 - 32.98% -
433.milc -4.17% 48.000 46.000 - -79.09% -
433.milc (avg) -4.17% 48.000 46.000 - -79.09% -
450.soplex -3.57% 28.000 27.000 - -85.86% -
450.soplex (avg) -3.57% 28.000 27.000 - -85.86% -
464.h264ref -3.45% 145.000 140.000 - 79.49% -
464.h264ref (avg) -3.45% 145.000 140.000 - 79.49% -
471.omnetpp -3.45% 116.000 112.000 - -34.12% -
471.omnetpp (avg) -3.45% 116.000 112.000 - -34.12% -
434.zeusmp -3.41% 88.000 85.000 - -56.41% -
434.zeusmp (avg) -3.41% 88.000 85.000 - -56.41% -
401.bzip2 (max) (percentage) -3.23% 3.710 3.590 - 307.95% -
435.gromacs -3.23% 248.000 240.000 - -9.77% -
435.gromacs (avg) -3.23% 248.000 240.000 - -9.77% -
447.dealII -3.23% 62.000 60.000 - -42.31% -
447.dealII (avg) -3.23% 62.000 60.000 - -42.31% -
401.bzip2 -3.19% 94.000 91.000 - 37.88% -
401.bzip2 (avg) -3.19% 94.000 91.000 - 37.88% -
470.lbm -3.15% 127.000 123.000 - -59.41% -
470.lbm (avg) -3.15% 127.000 123.000 - -59.41% -
410.bwaves -3.09% 162.000 157.000 - -1.88% -
410.bwaves (avg) -3.09% 162.000 157.000 - -1.88% -
459.GemsFDTD -3.05% 197.000 191.000 - -9.05% -
459.GemsFDTD (avg) -3.05% 197.000 191.000 - -9.05% -
456.hmmer -2.99% 67.000 65.000 - -13.33% -
456.hmmer (avg) -2.99% 67.000 65.000 - -13.33% -
465.tonto -2.84% 282.000 274.000 - 100.00% -
465.tonto (avg) -2.84% 282.000 274.000 - 100.00% -
464.h264ref (avg) (percentage) -2.83% 2.470 2.400 - 344.44% -
444.namd (avg) (percentage) -2.76% 4.710 4.580 - 16.54% -
416.gamess (max) -2.73% 183.000 178.000 - -72.87% -
416.gamess (max) (percentage) -2.70% 1.480 1.440 - -50.17% -
447.dealII (avg) (percentage) -2.54% 3.150 3.070 - 186.92% -
456.hmmer (avg) (percentage) -2.14% 2.340 2.290 - 236.76% -
473.astar -1.97% 152.000 149.000 - 432.14% -
473.astar (avg) -1.97% 152.000 149.000 - 432.14% -
470.lbm (avg) (percentage) -1.76% 3.400 3.340 - 40.93% -
400.perlbench (max) (percentage) -1.75% 2.280 2.240 - -30.86% -
445.gobmk -1.61% 124.000 122.000 - 32.61% -
445.gobmk (avg) -1.61% 124.000 122.000 - 32.61% -
481.wrf -1.55% 194.000 191.000 - -39.94% -
481.wrf (avg) -1.55% 194.000 191.000 - -39.94% -
410.bwaves (avg) (percentage) -1.49% 2.680 2.640 - 142.20% -
458.sjeng -1.49% 134.000 132.000 - 180.85% -
458.sjeng (avg) -1.49% 134.000 132.000 - 180.85% -
400.perlbench -1.45% 69.000 68.000 - -56.41% -
400.perlbench (avg) -1.45% 69.000 68.000 - -56.41% -
433.milc (avg) (percentage) -1.21% 4.140 4.090 - 140.59% -
462.libquantum (avg) (percentage) -1.16% 3.440 3.400 - 423.08% -

Added Tests - sample variability
403.gcc (unexplained diff vs previous)
403.gcc (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
465.tonto 30.54% 8205.000 10711.000 - -3.06% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
462.libquantum (unexplained diff vs previous) (percentage) 22300.00% 0.010 2.240 - 53.42% -
473.astar (unexplained diff vs previous) (percentage) 20150.00% 0.020 4.050 - 1165.62% -
473.astar (unexplained diff vs previous) 7533.33% 3.000 229.000 - 1105.26% -
429.mcf (max) (percentage) 3611.11% 0.540 20.040 - 6.14% -
429.mcf (unexplained diff vs previous) (percentage) 2990.74% 0.540 16.690 - 2467.69% -
473.astar (max) (percentage) 2685.71% 0.140 3.900 - 8.64% -
458.sjeng (unexplained diff vs previous) (percentage) 2350.00% 0.060 1.470 - 488.00% -
483.xalancbmk (max) (percentage) 1512.20% 0.410 6.610 - -0.60% -
459.GemsFDTD (unexplained diff vs previous) (percentage) 1319.05% 0.210 2.980 - 441.82% -
410.bwaves (unexplained diff vs previous) (percentage) 1310.00% 0.100 1.410 - 1310.00% -
473.astar (avg) (percentage) 1289.47% 0.190 2.640 - 1.54% -
470.lbm (unexplained diff vs previous) (percentage) 1227.27% 0.110 1.460 - 128.12% -
429.mcf (avg) (percentage) 1207.55% 0.530 6.930 - 5.96% -
471.omnetpp (unexplained diff vs previous) (percentage) 1191.67% 0.240 3.100 - 148.00% -
458.sjeng (unexplained diff vs previous) 1144.44% 9.000 112.000 - 489.47% -
473.astar (max) 1000.00% 20.000 220.000 - 4.27% -
403.gcc (avg) (percentage) 963.93% 0.610 6.490 - 0.15% -
403.gcc (max) (percentage) 906.94% 0.720 7.250 - -6.33% -
403.gcc (unexplained diff vs previous) (percentage) 875.00% 0.720 7.020 - 0.00% -
401.bzip2 (avg) (percentage) 622.73% 0.440 3.180 - 0.63% -
464.h264ref (unexplained diff vs previous) (percentage) 620.00% 0.100 0.720 - 323.53% -
410.bwaves (max) (percentage) 561.90% 0.210 1.390 - 21.93% -
458.sjeng (max) (percentage) 559.09% 0.220 1.450 - 19.83% -
483.xalancbmk (max) 506.67% 45.000 273.000 - -5.54% -
437.leslie3d (max) (percentage) 463.25% 2.340 13.180 - -4.49% -
410.bwaves (unexplained diff vs previous) 460.00% 15.000 84.000 - 1300.00% -
482.sphinx3 (unexplained diff vs previous) (percentage) 448.39% 0.620 3.400 - 88.89% -
473.astar 432.14% 28.000 149.000 - -1.97% -
473.astar (avg) 432.14% 28.000 149.000 - -1.97% -
458.sjeng (avg) (percentage) 424.24% 0.330 1.730 - -0.57% -
462.libquantum (avg) (percentage) 423.08% 0.650 3.400 - -1.16% -
459.GemsFDTD (max) (percentage) 410.00% 0.600 3.060 - -6.42% -
464.h264ref (avg) (percentage) 344.44% 0.540 2.400 - -2.83% -
401.bzip2 (unexplained diff vs previous) (percentage) 328.74% 0.870 3.730 - 425.35% -
450.soplex (avg) (percentage) 308.87% 1.240 5.070 - 1.20% -
401.bzip2 (max) (percentage) 307.95% 0.880 3.590 - -3.23% -
429.mcf (max) 302.17% 92.000 370.000 - 27.15% -
462.libquantum (max) (percentage) 296.88% 0.640 2.540 - -6.27% -
437.leslie3d (max) 294.02% 351.000 1383.000 - -12.36% -
437.leslie3d (unexplained diff vs previous) (percentage) 291.27% 2.290 8.960 - 60.57% -
470.lbm (unexplained diff vs previous) 285.71% 14.000 54.000 - 125.00% -
459.GemsFDTD (unexplained diff vs previous) 270.83% 48.000 178.000 - 423.53% -
450.soplex (unexplained diff vs previous) (percentage) 260.70% 2.010 7.250 - 364.74% -
459.GemsFDTD (avg) (percentage) 256.67% 0.900 3.210 - -0.31% -
458.sjeng (max) 254.84% 31.000 110.000 - 18.28% -
450.soplex (max) (percentage) 243.15% 1.970 6.760 - 24.49% -
471.omnetpp (unexplained diff vs previous) 242.31% 26.000 89.000 - 140.54% -
456.hmmer (avg) (percentage) 236.76% 0.680 2.290 - -2.14% -
429.mcf (unexplained diff vs previous) 232.26% 93.000 309.000 - 2990.00% -
464.h264ref (max) (percentage) 227.91% 0.430 1.410 - -5.37% -
445.gobmk (avg) (percentage) 206.49% 0.770 2.360 - 0.00% -
453.povray (avg) (percentage) 200.80% 1.250 3.760 - 0.00% -
462.libquantum (unexplained diff vs previous) 200.00% 1.000 3.000 - 50.00% -
400.perlbench (avg) (percentage) 189.80% 1.470 4.260 - 0.00% -
447.dealII (avg) (percentage) 186.92% 1.070 3.070 - -2.54% -
458.sjeng 180.85% 47.000 132.000 - -1.49% -
458.sjeng (avg) 180.85% 47.000 132.000 - -1.49% -
464.h264ref (unexplained diff vs previous) 180.00% 15.000 42.000 - 320.00% -
410.bwaves (max) 176.67% 30.000 83.000 - 20.29% -
437.leslie3d (unexplained diff vs previous) 174.05% 343.000 940.000 - 47.34% -
482.sphinx3 (avg) (percentage) 167.81% 1.460 3.910 - -0.51% -
454.calculix (avg) (percentage) 158.21% 2.010 5.190 - 0.00% -
471.omnetpp (avg) (percentage) 145.91% 1.590 3.910 - -0.51% -
410.bwaves (avg) (percentage) 142.20% 1.090 2.640 - -1.49% -
433.milc (avg) (percentage) 140.59% 1.700 4.090 - -1.21% -
434.zeusmp (avg) (percentage) 134.46% 1.480 3.470 - -0.86% -
482.sphinx3 (max) (percentage) 123.81% 1.470 3.290 - 3.79% -
436.cactusADM (avg) (percentage) 104.82% 1.660 3.400 - -0.58% -
465.tonto 100.00% 137.000 274.000 - -2.84% -
465.tonto (avg) 100.00% 137.000 274.000 - -2.84% -
435.gromacs (avg) (percentage) 97.11% 1.730 3.410 - -0.58% -
481.wrf (avg) (percentage) 87.30% 1.890 3.540 - 0.00% -
464.h264ref 79.49% 78.000 140.000 - -3.45% -
464.h264ref (avg) 79.49% 78.000 140.000 - -3.45% -
435.gromacs (max) (percentage) 77.23% 2.020 3.580 - -6.53% -
483.xalancbmk (avg) (percentage) 76.12% 0.670 1.180 - 0.00% -
437.leslie3d (avg) (percentage) 74.37% 2.380 4.150 - 3.49% -
465.tonto (avg) (percentage) 53.29% 1.670 2.560 - 0.00% -
435.gromacs (unexplained diff vs previous) (percentage) 46.60% 2.060 3.020 - 153.78% -
429.mcf 42.22% 90.000 128.000 - 28.00% -
429.mcf (avg) 42.22% 90.000 128.000 - 28.00% -
470.lbm (avg) (percentage) 40.93% 2.370 3.340 - -1.76% -
401.bzip2 37.88% 66.000 91.000 - -3.19% -
401.bzip2 (avg) 37.88% 66.000 91.000 - -3.19% -
454.calculix (max) (percentage) 32.98% 4.700 6.250 - -4.43% -
445.gobmk 32.61% 92.000 122.000 - -1.61% -
445.gobmk (avg) 32.61% 92.000 122.000 - -1.61% -
464.h264ref (max) 32.26% 62.000 82.000 - -5.75% -
459.GemsFDTD (max) 30.00% 140.000 182.000 - -9.00% -
434.zeusmp (unexplained diff vs previous) (percentage) 24.03% 2.330 2.890 - 160.36% -
434.zeusmp (max) (percentage) 23.25% 2.280 2.810 - 91.16% -
437.leslie3d 21.85% 357.000 435.000 - -5.02% -
437.leslie3d (avg) 21.85% 357.000 435.000 - -5.02% -
447.dealII (unexplained diff vs previous) (percentage) 16.67% 0.780 0.910 - 264.00% -
444.namd (avg) (percentage) 16.54% 3.930 4.580 - -2.76% -
416.gamess (avg) (percentage) 11.98% 2.170 2.430 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
458.sjeng -6.89% 120221.000 111941.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
454.calculix -99.74% 22860.000 60.000 - -3.23% -
403.gcc -99.37% 9010.000 57.000 - -6.56% -
462.libquantum -98.85% 11614.000 134.000 - -2.19% -
482.sphinx3 -96.96% 29928.000 911.000 - -3.29% -
450.soplex -96.52% 15466.000 538.000 - -6.76% -
444.namd -92.09% 9050.000 716.000 - -0.97% -
453.povray -91.89% 6544.000 531.000 - -2.57% -
433.milc -91.18% 12976.000 1145.000 - -2.64% -
429.mcf -89.21% 17158.000 1851.000 - 20.04% -
436.cactusADM -87.74% 17544.000 2151.000 - 2.77% -
400.perlbench -84.91% 10650.000 1607.000 - -1.29% -
434.zeusmp -81.40% 13211.000 2457.000 - -2.81% -
401.bzip2 -81.09% 15185.000 2871.000 - -3.59% -
447.dealII -79.80% 9751.000 1970.000 - -0.91% -
459.GemsFDTD -74.46% 23356.000 5965.000 - -2.90% -
456.hmmer -73.96% 11046.000 2876.000 - -0.69% -
471.omnetpp -73.29% 10739.000 2868.000 - -3.01% -
470.lbm -71.13% 12819.000 3701.000 - -1.44% -
481.wrf -67.85% 16834.000 5412.000 - -1.55% -
483.xalancbmk -63.02% 11172.000 4131.000 - -5.06% -
473.astar -62.16% 14932.000 5650.000 - -3.90% -
464.h264ref -59.91% 14556.000 5835.000 - -0.71% -
410.bwaves -59.49% 14755.000 5977.000 - -1.39% -
445.gobmk -56.87% 11995.000 5174.000 - -2.19% -
435.gromacs -54.32% 15419.000 7043.000 - -2.94% -
458.sjeng -46.52% 14275.000 7634.000 - -1.45% -
416.gamess -45.43% 22704.000 12390.000 - -0.02% -
437.leslie3d -30.06% 15005.000 10495.000 - -8.22% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
454.calculix (max) -99.72% 1074.000 3.000 - -25.00% -
454.calculix -99.35% 459.000 3.000 - 0.00% -
454.calculix (avg) -99.35% 459.000 3.000 - 0.00% -
444.namd (unexplained diff vs previous) -99.00% 700.000 7.000 - 600.00% -
444.namd (max) -98.31% 649.000 11.000 - -8.33% -
453.povray (max) -96.97% 165.000 5.000 - -16.67% -
462.libquantum (max) -95.95% 74.000 3.000 - 0.00% -
462.libquantum -94.67% 75.000 4.000 - 0.00% -
462.libquantum (avg) -94.67% 75.000 4.000 - 0.00% -
403.gcc -94.44% 54.000 3.000 - 0.00% -
403.gcc (avg) -94.44% 54.000 3.000 - 0.00% -
403.gcc (unexplained diff vs previous) -93.85% 65.000 4.000 - 0.00% -
403.gcc (max) -93.75% 64.000 4.000 - 0.00% -
482.sphinx3 (max) -93.39% 439.000 29.000 - 0.00% -
433.milc (unexplained diff vs previous) -92.71% 425.000 31.000 - 181.82% -
433.milc (max) -92.70% 411.000 30.000 - 114.29% -
482.sphinx3 -91.97% 436.000 35.000 - -5.41% -
482.sphinx3 (avg) -91.97% 436.000 35.000 - -5.41% -
444.namd -90.99% 355.000 32.000 - -5.88% -
444.namd (avg) -90.99% 355.000 32.000 - -5.88% -
400.perlbench (max) -89.86% 345.000 35.000 - -5.41% -
436.cactusADM (unexplained diff vs previous) -89.82% 570.000 58.000 - 152.17% -
436.cactusADM (max) -89.31% 552.000 59.000 - 168.18% -
470.lbm (max) -88.97% 653.000 72.000 - -7.69% -
450.soplex (max) -88.16% 304.000 36.000 - 16.13% -
450.soplex (unexplained diff vs previous) -87.46% 311.000 39.000 - 333.33% -
444.namd (unexplained diff vs previous) (percentage) -87.32% 7.730 0.980 - 600.00% -
456.hmmer (max) -86.43% 140.000 19.000 - 90.00% -
450.soplex -85.86% 191.000 27.000 - -3.57% -
450.soplex (avg) -85.86% 191.000 27.000 - -3.57% -
471.omnetpp (max) -83.69% 662.000 108.000 - -9.24% -
482.sphinx3 (unexplained diff vs previous) -83.33% 186.000 31.000 - 82.35% -
447.dealII (max) -81.31% 107.000 20.000 - -9.09% -
481.wrf (max) -80.19% 530.000 105.000 - -8.70% -
433.milc -79.09% 220.000 46.000 - -4.17% -
433.milc (avg) -79.09% 220.000 46.000 - -4.17% -
434.zeusmp (max) -77.08% 301.000 69.000 - 86.49% -
434.zeusmp (unexplained diff vs previous) -76.95% 308.000 71.000 - 153.57% -
444.namd (max) (percentage) -76.74% 7.180 1.670 - -5.11% -
453.povray -76.54% 81.000 19.000 - -5.00% -
453.povray (avg) -76.54% 81.000 19.000 - -5.00% -
447.dealII (unexplained diff vs previous) -76.32% 76.000 18.000 - 260.00% -
456.hmmer (unexplained diff vs previous) -75.90% 83.000 20.000 - 100.00% -
436.cactusADM -74.91% 291.000 73.000 - 2.82% -
436.cactusADM (avg) -74.91% 291.000 73.000 - 2.82% -
416.gamess (max) -72.87% 656.000 178.000 - -2.73% -
470.lbm (max) (percentage) -61.57% 5.100 1.960 - -5.77% -
445.gobmk (max) -60.66% 183.000 72.000 - -11.11% -
470.lbm -59.41% 303.000 123.000 - -3.15% -
470.lbm (avg) -59.41% 303.000 123.000 - -3.15% -
453.povray (max) (percentage) -58.89% 2.530 1.040 - -6.31% -
400.perlbench -56.41% 156.000 68.000 - -1.45% -
400.perlbench (avg) -56.41% 156.000 68.000 - -1.45% -
434.zeusmp -56.41% 195.000 85.000 - -3.41% -
434.zeusmp (avg) -56.41% 195.000 85.000 - -3.41% -
416.gamess (max) (percentage) -50.17% 2.890 1.440 - -2.70% -
456.hmmer (max) (percentage) -45.67% 1.270 0.690 - 97.14% -
447.dealII -42.31% 104.000 60.000 - -3.23% -
447.dealII (avg) -42.31% 104.000 60.000 - -3.23% -
481.wrf -39.94% 318.000 191.000 - -1.55% -
481.wrf (avg) -39.94% 318.000 191.000 - -1.55% -
416.gamess -38.82% 492.000 301.000 - 0.00% -
416.gamess (avg) -38.82% 492.000 301.000 - 0.00% -
471.omnetpp (max) (percentage) -38.41% 6.170 3.800 - -5.71% -
481.wrf (max) (percentage) -38.10% 3.150 1.950 - -7.14% -
483.xalancbmk -35.14% 74.000 48.000 - -5.88% -
483.xalancbmk (avg) -35.14% 74.000 48.000 - -5.88% -
471.omnetpp -34.12% 170.000 112.000 - -3.45% -
471.omnetpp (avg) -34.12% 170.000 112.000 - -3.45% -
435.gromacs (unexplained diff vs previous) -33.02% 318.000 213.000 - 147.67% -
400.perlbench (max) (percentage) -30.86% 3.240 2.240 - -1.75% -
465.tonto (max) (percentage) -29.89% 3.580 2.510 - -5.64% -
401.bzip2 (max) -22.56% 133.000 103.000 - -6.36% -
435.gromacs (max) -18.97% 311.000 252.000 - -9.03% -
401.bzip2 (unexplained diff vs previous) -18.94% 132.000 107.000 - 409.52% -
433.milc (unexplained diff vs previous) (percentage) -17.38% 3.280 2.710 - 188.30% -
436.cactusADM (unexplained diff vs previous) (percentage) -16.92% 3.250 2.700 - 145.45% -
433.milc (max) (percentage) -16.72% 3.170 2.640 - 107.87% -
456.hmmer -13.33% 75.000 65.000 - -2.99% -
456.hmmer (avg) -13.33% 75.000 65.000 - -2.99% -
436.cactusADM (max) (percentage) -12.06% 3.150 2.770 - 154.13% -
435.gromacs -9.77% 266.000 240.000 - -3.23% -
435.gromacs (avg) -9.77% 266.000 240.000 - -3.23% -
459.GemsFDTD -9.05% 210.000 191.000 - -3.05% -
459.GemsFDTD (avg) -9.05% 210.000 191.000 - -3.05% -
465.tonto (max) -8.53% 293.000 268.000 - -8.53% -
445.gobmk (max) (percentage) -7.84% 1.530 1.410 - -8.44% -
456.hmmer (unexplained diff vs previous) (percentage) -6.67% 0.750 0.700 - 100.00% -
447.dealII (max) (percentage) -4.55% 1.100 1.050 - -6.25% -
410.bwaves -1.88% 160.000 157.000 - -3.09% -
410.bwaves (avg) -1.88% 160.000 157.000 - -3.09% -

Report Time: 0.39s
Execution (seconds)
Name Current %
400.perlbench 1607.000 -1.29%
401.bzip2 2871.000 -3.59%
403.gcc 57.000 -6.56%
410.bwaves 5977.000 -1.39%
416.gamess 12390.000 -
429.mcf 1851.000 20.04%
433.milc 1145.000 -2.64%
434.zeusmp 2457.000 -2.81%
435.gromacs 7043.000 -2.94%
436.cactusADM 2151.000 2.77%
437.leslie3d 10495.000 -8.22%
444.namd 716.000 -
445.gobmk 5174.000 -2.19%
447.dealII 1970.000 -
450.soplex 538.000 -6.76%
453.povray 531.000 -2.57%
454.calculix 60.000 -3.23%
456.hmmer 2876.000 -
458.sjeng 7634.000 -1.45%
459.GemsFDTD 5965.000 -2.90%
462.libquantum 134.000 -2.19%
464.h264ref 5835.000 -
465.tonto 10711.000 -3.06%
470.lbm 3701.000 -1.44%
471.omnetpp 2868.000 -3.01%
473.astar 5650.000 -3.90%
481.wrf 5412.000 -1.55%
482.sphinx3 911.000 -3.29%
483.xalancbmk 4131.000 -5.06%
Geometric Mean 2114.616 -1.91%
Code Size (bytes)
Name Current %
400.perlbench 934212.000 -
401.bzip2 49892.000 -
403.gcc 2678225.000 -
410.bwaves 17876.000 -
416.gamess 6256171.000 -
429.mcf 10943.000 -
433.milc 95862.000 -
434.zeusmp 165703.000 -
435.gromacs 678497.000 -
436.cactusADM 553666.000 -
437.leslie3d 65169.000 -
444.namd 190970.000 -
445.gobmk 1399443.000 -
447.dealII 2121744.000 -
450.soplex 260512.000 -
453.povray 704285.000 -
454.calculix 1276935.000 -
456.hmmer 231140.000 -
458.sjeng 111941.000 -
459.GemsFDTD 254113.000 -
462.libquantum 31313.000 -
464.h264ref 432224.000 -
465.tonto 2875081.000 -
470.lbm 10908.000 -
471.omnetpp 566625.000 -
473.astar 32056.000 -
481.wrf 2639040.000 -
482.sphinx3 152712.000 -
483.xalancbmk 3281707.000 -
Geometric Mean 297321.302 -
sample variability
Name Current %
400.perlbench 68.000 -1.45%
400.perlbench (avg) 68.000 -1.45%
400.perlbench (avg) (percentage) 4.260 -
400.perlbench (max) 35.000 -5.41%
400.perlbench (max) (percentage) 2.240 -1.75%
401.bzip2 91.000 -3.19%
401.bzip2 (avg) 91.000 -3.19%
401.bzip2 (avg) (percentage) 3.180 -
401.bzip2 (max) 103.000 -6.36%
401.bzip2 (max) (percentage) 3.590 -3.23%
401.bzip2 (unexplained diff vs previous) 107.000 409.52%
401.bzip2 (unexplained diff vs previous) (percentage) 3.730 425.35%
403.gcc 3.000 -
403.gcc (avg) 3.000 -
403.gcc (avg) (percentage) 6.490 -
403.gcc (max) 4.000 -
403.gcc (max) (percentage) 7.250 -6.33%
403.gcc (unexplained diff vs previous) 4.000 -
403.gcc (unexplained diff vs previous) (percentage) 7.020 -
410.bwaves 157.000 -3.09%
410.bwaves (avg) 157.000 -3.09%
410.bwaves (avg) (percentage) 2.640 -1.49%
410.bwaves (max) 83.000 20.29%
410.bwaves (max) (percentage) 1.390 21.93%
410.bwaves (unexplained diff vs previous) 84.000 1300.00%
410.bwaves (unexplained diff vs previous) (percentage) 1.410 1310.00%
416.gamess 301.000 -
416.gamess (avg) 301.000 -
416.gamess (avg) (percentage) 2.430 -
416.gamess (max) 178.000 -2.73%
416.gamess (max) (percentage) 1.440 -2.70%
429.mcf 128.000 28.00%
429.mcf (avg) 128.000 28.00%
429.mcf (avg) (percentage) 6.930 5.96%
429.mcf (max) 370.000 27.15%
429.mcf (max) (percentage) 20.040 6.14%
429.mcf (unexplained diff vs previous) 309.000 2990.00%
429.mcf (unexplained diff vs previous) (percentage) 16.690 2467.69%
433.milc 46.000 -4.17%
433.milc (avg) 46.000 -4.17%
433.milc (avg) (percentage) 4.090 -1.21%
433.milc (max) 30.000 114.29%
433.milc (max) (percentage) 2.640 107.87%
433.milc (unexplained diff vs previous) 31.000 181.82%
433.milc (unexplained diff vs previous) (percentage) 2.710 188.30%
434.zeusmp 85.000 -3.41%
434.zeusmp (avg) 85.000 -3.41%
434.zeusmp (avg) (percentage) 3.470 -
434.zeusmp (max) 69.000 86.49%
434.zeusmp (max) (percentage) 2.810 91.16%
434.zeusmp (unexplained diff vs previous) 71.000 153.57%
434.zeusmp (unexplained diff vs previous) (percentage) 2.890 160.36%
435.gromacs 240.000 -3.23%
435.gromacs (avg) 240.000 -3.23%
435.gromacs (avg) (percentage) 3.410 -
435.gromacs (max) 252.000 -9.03%
435.gromacs (max) (percentage) 3.580 -6.53%
435.gromacs (unexplained diff vs previous) 213.000 147.67%
435.gromacs (unexplained diff vs previous) (percentage) 3.020 153.78%
436.cactusADM 73.000 2.82%
436.cactusADM (avg) 73.000 2.82%
436.cactusADM (avg) (percentage) 3.400 -
436.cactusADM (max) 59.000 168.18%
436.cactusADM (max) (percentage) 2.770 154.13%
436.cactusADM (unexplained diff vs previous) 58.000 152.17%
436.cactusADM (unexplained diff vs previous) (percentage) 2.700 145.45%
437.leslie3d 435.000 -5.02%
437.leslie3d (avg) 435.000 -5.02%
437.leslie3d (avg) (percentage) 4.150 3.49%
437.leslie3d (max) 1383.000 -12.36%
437.leslie3d (max) (percentage) 13.180 -4.49%
437.leslie3d (unexplained diff vs previous) 940.000 47.34%
437.leslie3d (unexplained diff vs previous) (percentage) 8.960 60.57%
444.namd 32.000 -5.88%
444.namd (avg) 32.000 -5.88%
444.namd (avg) (percentage) 4.580 -2.76%
444.namd (max) 11.000 -8.33%
444.namd (max) (percentage) 1.670 -5.11%
444.namd (unexplained diff vs previous) 7.000 600.00%
444.namd (unexplained diff vs previous) (percentage) 0.980 600.00%
445.gobmk 122.000 -1.61%
445.gobmk (avg) 122.000 -1.61%
445.gobmk (avg) (percentage) 2.360 -
445.gobmk (max) 72.000 -11.11%
445.gobmk (max) (percentage) 1.410 -8.44%
447.dealII 60.000 -3.23%
447.dealII (avg) 60.000 -3.23%
447.dealII (avg) (percentage) 3.070 -2.54%
447.dealII (max) 20.000 -9.09%
447.dealII (max) (percentage) 1.050 -6.25%
447.dealII (unexplained diff vs previous) 18.000 260.00%
447.dealII (unexplained diff vs previous) (percentage) 0.910 264.00%
450.soplex 27.000 -3.57%
450.soplex (avg) 27.000 -3.57%
450.soplex (avg) (percentage) 5.070 1.20%
450.soplex (max) 36.000 16.13%
450.soplex (max) (percentage) 6.760 24.49%
450.soplex (unexplained diff vs previous) 39.000 333.33%
450.soplex (unexplained diff vs previous) (percentage) 7.250 364.74%
453.povray 19.000 -5.00%
453.povray (avg) 19.000 -5.00%
453.povray (avg) (percentage) 3.760 -
453.povray (max) 5.000 -16.67%
453.povray (max) (percentage) 1.040 -6.31%
454.calculix 3.000 -
454.calculix (avg) 3.000 -
454.calculix (avg) (percentage) 5.190 -
454.calculix (max) 3.000 -25.00%
454.calculix (max) (percentage) 6.250 -4.43%
456.hmmer 65.000 -2.99%
456.hmmer (avg) 65.000 -2.99%
456.hmmer (avg) (percentage) 2.290 -2.14%
456.hmmer (max) 19.000 90.00%
456.hmmer (max) (percentage) 0.690 97.14%
456.hmmer (unexplained diff vs previous) 20.000 100.00%
456.hmmer (unexplained diff vs previous) (percentage) 0.700 100.00%
458.sjeng 132.000 -1.49%
458.sjeng (avg) 132.000 -1.49%
458.sjeng (avg) (percentage) 1.730 -
458.sjeng (max) 110.000 18.28%
458.sjeng (max) (percentage) 1.450 19.83%
458.sjeng (unexplained diff vs previous) 112.000 489.47%
458.sjeng (unexplained diff vs previous) (percentage) 1.470 488.00%
459.GemsFDTD 191.000 -3.05%
459.GemsFDTD (avg) 191.000 -3.05%
459.GemsFDTD (avg) (percentage) 3.210 -
459.GemsFDTD (max) 182.000 -9.00%
459.GemsFDTD (max) (percentage) 3.060 -6.42%
459.GemsFDTD (unexplained diff vs previous) 178.000 423.53%
459.GemsFDTD (unexplained diff vs previous) (percentage) 2.980 441.82%
462.libquantum 4.000 -
462.libquantum (avg) 4.000 -
462.libquantum (avg) (percentage) 3.400 -1.16%
462.libquantum (max) 3.000 -
462.libquantum (max) (percentage) 2.540 -6.27%
462.libquantum (unexplained diff vs previous) 3.000 50.00%
462.libquantum (unexplained diff vs previous) (percentage) 2.240 53.42%
464.h264ref 140.000 -3.45%
464.h264ref (avg) 140.000 -3.45%
464.h264ref (avg) (percentage) 2.400 -2.83%
464.h264ref (max) 82.000 -5.75%
464.h264ref (max) (percentage) 1.410 -5.37%
464.h264ref (unexplained diff vs previous) 42.000 320.00%
464.h264ref (unexplained diff vs previous) (percentage) 0.720 323.53%
465.tonto 274.000 -2.84%
465.tonto (avg) 274.000 -2.84%
465.tonto (avg) (percentage) 2.560 -
465.tonto (max) 268.000 -8.53%
465.tonto (max) (percentage) 2.510 -5.64%
470.lbm 123.000 -3.15%
470.lbm (avg) 123.000 -3.15%
470.lbm (avg) (percentage) 3.340 -1.76%
470.lbm (max) 72.000 -7.69%
470.lbm (max) (percentage) 1.960 -5.77%
470.lbm (unexplained diff vs previous) 54.000 125.00%
470.lbm (unexplained diff vs previous) (percentage) 1.460 128.12%
471.omnetpp 112.000 -3.45%
471.omnetpp (avg) 112.000 -3.45%
471.omnetpp (avg) (percentage) 3.910 -
471.omnetpp (max) 108.000 -9.24%
471.omnetpp (max) (percentage) 3.800 -5.71%
471.omnetpp (unexplained diff vs previous) 89.000 140.54%
471.omnetpp (unexplained diff vs previous) (percentage) 3.100 148.00%
473.astar 149.000 -1.97%
473.astar (avg) 149.000 -1.97%
473.astar (avg) (percentage) 2.640 1.54%
473.astar (max) 220.000 4.27%
473.astar (max) (percentage) 3.900 8.64%
473.astar (unexplained diff vs previous) 229.000 1105.26%
473.astar (unexplained diff vs previous) (percentage) 4.050 1165.62%
481.wrf 191.000 -1.55%
481.wrf (avg) 191.000 -1.55%
481.wrf (avg) (percentage) 3.540 -
481.wrf (max) 105.000 -8.70%
481.wrf (max) (percentage) 1.950 -7.14%
482.sphinx3 35.000 -5.41%
482.sphinx3 (avg) 35.000 -5.41%
482.sphinx3 (avg) (percentage) 3.910 -
482.sphinx3 (max) 29.000 -
482.sphinx3 (max) (percentage) 3.290 3.79%
482.sphinx3 (unexplained diff vs previous) 31.000 82.35%
482.sphinx3 (unexplained diff vs previous) (percentage) 3.400 88.89%
483.xalancbmk 48.000 -5.88%
483.xalancbmk (avg) 48.000 -5.88%
483.xalancbmk (avg) (percentage) 1.180 -
483.xalancbmk (max) 273.000 -5.54%
483.xalancbmk (max) (percentage) 6.610 -
Geometric Mean 17.165 35.54%