Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=d1bd9787f9ad8c49fb463d8d53411aeb5f9c179b (+ 14 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/b7d05f13e86bf49bfb78c9876deba388efc6082e (+ 67 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=5dd3bda59c2d9da138f0d98808d087cdb95cdc17 (+ 1 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=288a2f83ed42ce91cf92c2b08dad298a3da0cd9a (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-aarch64-master-Os-build/139/
View Options
Report
Filter

gnu-aarch64-master-Os test results

Run Order Start Time Duration
Current 0139 (3-changed-components) 2023-11-04T20:51:09 0:00:00
Previous 0137 (basepoints/gcc-14-05110-g7ab79a40b54) 2023-11-02T11:36:44 0:00:00
Baseline 0001 (3-changed-components) 2023-01-01T08:38:47 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 141 86
Performance Improvements 21 139
Added Tests 8 0
Unchanged Tests 1066 1011
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
437.leslie3d 9.95% 10699.000 11764.000 - -21.60% -
403.gcc 8.93% 56.000 61.000 - -99.32% -
450.soplex 7.48% 548.000 589.000 - -96.19% -
435.gromacs 5.59% 6909.000 7295.000 - -52.69% -
482.sphinx3 3.88% 903.000 938.000 - -96.87% -
473.astar 3.81% 5694.000 5911.000 - -60.41% -
465.tonto 3.20% 10758.000 11102.000 - 35.31% -
462.libquantum 2.99% 134.000 138.000 - -98.81% -
471.omnetpp 2.85% 2912.000 2995.000 - -72.11% -
401.bzip2 2.84% 2855.000 2936.000 - -80.67% -
459.GemsFDTD 2.46% 6011.000 6159.000 - -73.63% -
481.wrf 2.18% 5416.000 5534.000 - -67.13% -
433.milc 2.10% 1142.000 1166.000 - -91.01% -
434.zeusmp 2.02% 2527.000 2578.000 - -80.49% -
447.dealII 1.73% 1964.000 1998.000 - -79.51% -
454.calculix 1.64% 61.000 62.000 - -99.73% -
410.bwaves 1.60% 5940.000 6035.000 - -59.10% -
444.namd 1.54% 715.000 726.000 - -91.98% -
445.gobmk 1.49% 5163.000 5240.000 - -56.32% -
458.sjeng 1.24% 7734.000 7830.000 - -45.15% -
470.lbm 1.16% 3708.000 3751.000 - -70.74% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
434.zeusmp (unexplained diff vs previous) 5000.00% 1.000 51.000 - -83.44% -
434.zeusmp (unexplained diff vs previous) (percentage) 4850.00% 0.040 1.980 - -15.02% -
473.astar (unexplained diff vs previous) 4240.00% 5.000 217.000 - 7133.33% -
473.astar (unexplained diff vs previous) (percentage) 3977.78% 0.090 3.670 - 18250.00% -
429.mcf (unexplained diff vs previous) (percentage) 2940.00% 0.750 22.800 - 4122.22% -
445.gobmk (unexplained diff vs previous) 2466.67% 3.000 77.000 - -58.60% -
429.mcf (unexplained diff vs previous) 2385.71% 14.000 348.000 - 274.19% -
429.mcf (max) (percentage) 2376.00% 0.750 18.570 - 3338.89% -
445.gobmk (unexplained diff vs previous) (percentage) 2350.00% 0.060 1.470 - -5.16% -
401.bzip2 (unexplained diff vs previous) 1925.00% 4.000 81.000 - -38.64% -
429.mcf (max) 1921.43% 14.000 283.000 - 207.61% -
401.bzip2 (unexplained diff vs previous) (percentage) 1871.43% 0.140 2.760 - 217.24% -
465.tonto (unexplained diff vs previous) 1710.53% 19.000 344.000 - 446.03% -
465.tonto (unexplained diff vs previous) (percentage) 1622.22% 0.180 3.100 - 302.60% -
473.astar (max) 1507.14% 14.000 225.000 - 1025.00% -
473.astar (max) (percentage) 1365.38% 0.260 3.810 - 2621.43% -
458.sjeng (unexplained diff vs previous) (percentage) 1130.00% 0.100 1.230 - 1950.00% -
458.sjeng (unexplained diff vs previous) 1100.00% 8.000 96.000 - 966.67% -
401.bzip2 (max) 1085.71% 7.000 83.000 - -37.59% -
416.gamess (unexplained diff vs previous) 1000.00% 5.000 55.000 - -91.86% -
416.gamess (unexplained diff vs previous) (percentage) 1000.00% 0.040 0.440 - -85.23% -
450.soplex (max) 1000.00% 4.000 44.000 - -85.53% -
401.bzip2 (max) (percentage) 951.85% 0.270 2.840 - 222.73% -
450.soplex (unexplained diff vs previous) 925.00% 4.000 41.000 - -86.82% -
450.soplex (max) (percentage) 910.81% 0.740 7.480 - 279.70% -
458.sjeng (max) 870.00% 10.000 97.000 - 212.90% -
450.soplex (unexplained diff vs previous) (percentage) 853.42% 0.730 6.960 - 246.27% -
482.sphinx3 (max) 800.00% 4.000 36.000 - -91.80% -
458.sjeng (max) (percentage) 785.71% 0.140 1.240 - 463.64% -
482.sphinx3 (unexplained diff vs previous) 775.00% 4.000 35.000 - -81.18% -
482.sphinx3 (unexplained diff vs previous) (percentage) 747.73% 0.440 3.730 - 501.61% -
482.sphinx3 (max) (percentage) 743.48% 0.460 3.880 - 163.95% -
465.tonto (max) 582.69% 52.000 355.000 - 21.16% -
465.tonto (max) (percentage) 553.06% 0.490 3.200 - -10.61% -
445.gobmk (max) 550.00% 12.000 78.000 - -57.38% -
445.gobmk (max) (percentage) 520.83% 0.240 1.490 - -2.61% -
470.lbm (max) 514.29% 7.000 43.000 - -93.42% -
470.lbm (max) (percentage) 510.53% 0.190 1.160 - -77.25% -
459.GemsFDTD (max) 387.10% 31.000 151.000 - 7.86% -
433.milc (unexplained diff vs previous) 380.00% 5.000 24.000 - -94.35% -
459.GemsFDTD (unexplained diff vs previous) 377.42% 31.000 148.000 - 208.33% -
433.milc (unexplained diff vs previous) (percentage) 368.18% 0.440 2.060 - -37.20% -
459.GemsFDTD (max) (percentage) 364.15% 0.530 2.460 - 310.00% -
459.GemsFDTD (unexplained diff vs previous) (percentage) 361.54% 0.520 2.400 - 1042.86% -
471.omnetpp (unexplained diff vs previous) 336.84% 19.000 83.000 - 219.23% -
471.omnetpp (unexplained diff vs previous) (percentage) 326.15% 0.650 2.770 - 1054.17% -
434.zeusmp (max) 300.00% 13.000 52.000 - -82.72% -
462.libquantum (max) 300.00% 1.000 4.000 - -94.59% -
434.zeusmp (max) (percentage) 281.13% 0.530 2.020 - -11.40% -
416.gamess (max) 223.53% 17.000 55.000 - -91.62% -
416.gamess (max) (percentage) 214.29% 0.140 0.440 - -84.78% -
410.bwaves (max) 166.67% 36.000 96.000 - 220.00% -
433.milc (max) 166.67% 9.000 24.000 - -94.16% -
410.bwaves (unexplained diff vs previous) 163.89% 36.000 95.000 - 533.33% -
410.bwaves (max) (percentage) 162.30% 0.610 1.600 - 661.90% -
410.bwaves (unexplained diff vs previous) (percentage) 157.38% 0.610 1.570 - 1470.00% -
433.milc (max) (percentage) 147.06% 0.850 2.100 - -33.75% -
462.libquantum (max) (percentage) 130.00% 1.300 2.990 - 367.19% -
464.h264ref (max) 103.85% 26.000 53.000 - -14.52% -
471.omnetpp (max) 102.38% 42.000 85.000 - -87.16% -
464.h264ref (max) (percentage) 102.22% 0.450 0.910 - 111.63% -
447.dealII (max) 100.00% 17.000 34.000 - -68.22% -
447.dealII (max) (percentage) 96.59% 0.880 1.730 - 57.27% -
471.omnetpp (max) (percentage) 93.88% 1.470 2.850 - -53.81% -
403.gcc (max) 66.67% 3.000 5.000 - -92.19% -
403.gcc (max) (percentage) 44.73% 6.170 8.930 - 1140.28% -
456.hmmer (max) 40.00% 15.000 21.000 - -85.00% -
456.hmmer (unexplained diff vs previous) 31.25% 16.000 21.000 - -74.70% -
456.hmmer (max) (percentage) 30.91% 0.550 0.720 - -43.31% -
456.hmmer (unexplained diff vs previous) (percentage) 30.91% 0.550 0.720 - -4.00% -
437.leslie3d (unexplained diff vs previous) 29.56% 822.000 1065.000 - 210.50% -
436.cactusADM (unexplained diff vs previous) (percentage) 21.43% 0.700 0.850 - -73.85% -
436.cactusADM (max) 21.43% 14.000 17.000 - -96.92% -
436.cactusADM (max) (percentage) 20.00% 0.700 0.840 - -73.33% -
436.cactusADM (unexplained diff vs previous) 20.00% 15.000 18.000 - -96.84% -
437.leslie3d (unexplained diff vs previous) (percentage) 17.84% 7.680 9.050 - 295.20% -
437.leslie3d 12.70% 496.000 559.000 - 56.58% -
437.leslie3d (avg) 12.70% 496.000 559.000 - 56.58% -
450.soplex 11.76% 17.000 19.000 - -90.05% -
450.soplex (avg) 11.76% 17.000 19.000 - -90.05% -
465.tonto 6.71% 149.000 159.000 - 16.06% -
465.tonto (avg) 6.71% 149.000 159.000 - 16.06% -
444.namd 6.67% 15.000 16.000 - -95.49% -
444.namd (avg) 6.67% 15.000 16.000 - -95.49% -
435.gromacs 6.12% 147.000 156.000 - -41.35% -
435.gromacs (avg) 6.12% 147.000 156.000 - -41.35% -
473.astar 6.06% 99.000 105.000 - 275.00% -
473.astar (avg) 6.06% 99.000 105.000 - 275.00% -
401.bzip2 5.66% 53.000 56.000 - -15.15% -
401.bzip2 (avg) 5.66% 53.000 56.000 - -15.15% -
437.leslie3d (max) 4.82% 1308.000 1371.000 - 290.60% -
482.sphinx3 4.76% 21.000 22.000 - -94.95% -
482.sphinx3 (avg) 4.76% 21.000 22.000 - -94.95% -
429.mcf (avg) (percentage) 4.38% 5.480 5.720 - 979.25% -
459.GemsFDTD 3.88% 103.000 107.000 - -49.05% -
459.GemsFDTD (avg) 3.88% 103.000 107.000 - -49.05% -
465.tonto (avg) (percentage) 3.60% 1.390 1.440 - -13.77% -
403.gcc (avg) (percentage) 3.14% 5.730 5.910 - 868.85% -
450.soplex (avg) (percentage) 2.80% 3.210 3.300 - 166.13% -
471.omnetpp 2.70% 74.000 76.000 - -55.29% -
471.omnetpp (avg) 2.70% 74.000 76.000 - -55.29% -
437.leslie3d (avg) (percentage) 2.59% 4.640 4.760 - 100.00% -
410.bwaves 2.41% 83.000 85.000 - -46.88% -
410.bwaves (avg) 2.41% 83.000 85.000 - -46.88% -
434.zeusmp 2.22% 45.000 46.000 - -76.41% -
434.zeusmp (avg) 2.22% 45.000 46.000 - -76.41% -
481.wrf 1.90% 105.000 107.000 - -66.35% -
481.wrf (avg) 1.90% 105.000 107.000 - -66.35% -
470.lbm 1.72% 58.000 59.000 - -80.53% -
470.lbm (avg) 1.72% 58.000 59.000 - -80.53% -
473.astar (avg) (percentage) 1.71% 1.750 1.780 - 836.84% -
445.gobmk 1.43% 70.000 71.000 - -22.83% -
445.gobmk (avg) 1.43% 70.000 71.000 - -22.83% -
458.sjeng 1.39% 72.000 73.000 - 55.32% -
458.sjeng (avg) 1.39% 72.000 73.000 - 55.32% -
482.sphinx3 (avg) (percentage) 1.25% 2.400 2.430 - 66.44% -
459.GemsFDTD (avg) (percentage) 1.16% 1.720 1.740 - 93.33% -
435.gromacs (max) 1.12% 89.000 90.000 - -71.06% -
401.bzip2 (avg) (percentage) 1.06% 1.890 1.910 - 334.09% -
462.libquantum (avg) (percentage) 1.03% 1.950 1.970 - 203.08% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
429.mcf -18.57% 1874.000 1526.000 - -91.11% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
429.mcf -14.71% 102.000 87.000 - -3.33% -
429.mcf (avg) -14.71% 102.000 87.000 - -3.33% -
453.povray (max) (percentage) -10.87% 0.920 0.820 - -67.59% -
444.namd (max) (percentage) -5.06% 0.790 0.750 - -89.55% -
437.leslie3d (max) (percentage) -4.66% 12.230 11.660 - 398.29% -
435.gromacs (max) (percentage) -4.62% 1.300 1.240 - -38.61% -
481.wrf (max) (percentage) -4.11% 0.730 0.700 - -77.78% -
454.calculix (max) (percentage) -3.42% 5.840 5.640 - 20.00% -
436.cactusADM -2.86% 35.000 34.000 - -88.32% -
436.cactusADM (avg) -2.86% 35.000 34.000 - -88.32% -
481.wrf (max) -2.56% 39.000 38.000 - -92.83% -
400.perlbench -2.38% 42.000 41.000 - -73.72% -
400.perlbench (avg) -2.38% 42.000 41.000 - -73.72% -
453.povray (avg) (percentage) -2.18% 2.290 2.240 - 79.20% -
400.perlbench (avg) (percentage) -1.82% 2.740 2.690 - 82.99% -
416.gamess (avg) (percentage) -1.77% 1.130 1.110 - -48.85% -
400.perlbench (max) (percentage) -1.54% 1.950 1.920 - -40.74% -
416.gamess -1.42% 141.000 139.000 - -71.75% -
416.gamess (avg) -1.42% 141.000 139.000 - -71.75% -
436.cactusADM (avg) (percentage) -1.21% 1.650 1.630 - -1.81% -

Added Tests - sample variability
400.perlbench (unexplained diff vs previous)
400.perlbench (unexplained diff vs previous) (percentage)
403.gcc (unexplained diff vs previous)
403.gcc (unexplained diff vs previous) (percentage)
447.dealII (unexplained diff vs previous)
447.dealII (unexplained diff vs previous) (percentage)
464.h264ref (unexplained diff vs previous)
464.h264ref (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
400.perlbench 1.16% 930652.000 941436.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
465.tonto 35.31% 8205.000 11102.000 - 3.20% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
462.libquantum (unexplained diff vs previous) (percentage) 28900.00% 0.010 2.900 - 0.00% -
473.astar (unexplained diff vs previous) (percentage) 18250.00% 0.020 3.670 - 3977.78% -
473.astar (unexplained diff vs previous) 7133.33% 3.000 217.000 - 4240.00% -
429.mcf (unexplained diff vs previous) (percentage) 4122.22% 0.540 22.800 - 2940.00% -
429.mcf (max) (percentage) 3338.89% 0.540 18.570 - 2376.00% -
473.astar (max) (percentage) 2621.43% 0.140 3.810 - 1365.38% -
458.sjeng (unexplained diff vs previous) (percentage) 1950.00% 0.060 1.230 - 1130.00% -
410.bwaves (unexplained diff vs previous) (percentage) 1470.00% 0.100 1.570 - 157.38% -
483.xalancbmk (max) (percentage) 1331.71% 0.410 5.870 - 0.00% -
403.gcc (max) (percentage) 1140.28% 0.720 8.930 - 44.73% -
471.omnetpp (unexplained diff vs previous) (percentage) 1054.17% 0.240 2.770 - 326.15% -
459.GemsFDTD (unexplained diff vs previous) (percentage) 1042.86% 0.210 2.400 - 361.54% -
403.gcc (unexplained diff vs previous) (percentage) 1038.89% 0.720 8.200 - 0.00% -
473.astar (max) 1025.00% 20.000 225.000 - 1507.14% -
429.mcf (avg) (percentage) 979.25% 0.530 5.720 - 4.38% -
458.sjeng (unexplained diff vs previous) 966.67% 9.000 96.000 - 1100.00% -
470.lbm (unexplained diff vs previous) (percentage) 945.45% 0.110 1.150 - 0.00% -
453.povray (unexplained diff vs previous) (percentage) 900.00% 0.020 0.200 - 0.00% -
403.gcc (avg) (percentage) 868.85% 0.610 5.910 - 3.14% -
473.astar (avg) (percentage) 836.84% 0.190 1.780 - 1.71% -
464.h264ref (unexplained diff vs previous) (percentage) 810.00% 0.100 0.910 - 0.00% -
410.bwaves (max) (percentage) 661.90% 0.210 1.600 - 162.30% -
410.bwaves (unexplained diff vs previous) 533.33% 15.000 95.000 - 163.89% -
482.sphinx3 (unexplained diff vs previous) (percentage) 501.61% 0.620 3.730 - 747.73% -
458.sjeng (max) (percentage) 463.64% 0.220 1.240 - 785.71% -
465.tonto (unexplained diff vs previous) 446.03% 63.000 344.000 - 1710.53% -
437.leslie3d (max) (percentage) 398.29% 2.340 11.660 - -4.66% -
462.libquantum (max) (percentage) 367.19% 0.640 2.990 - 130.00% -
401.bzip2 (avg) (percentage) 334.09% 0.440 1.910 - 1.06% -
459.GemsFDTD (max) (percentage) 310.00% 0.600 2.460 - 364.15% -
465.tonto (unexplained diff vs previous) (percentage) 302.60% 0.770 3.100 - 1622.22% -
462.libquantum (unexplained diff vs previous) 300.00% 1.000 4.000 - 0.00% -
437.leslie3d (unexplained diff vs previous) (percentage) 295.20% 2.290 9.050 - 17.84% -
437.leslie3d (max) 290.60% 351.000 1371.000 - 4.82% -
450.soplex (max) (percentage) 279.70% 1.970 7.480 - 910.81% -
473.astar 275.00% 28.000 105.000 - 6.06% -
473.astar (avg) 275.00% 28.000 105.000 - 6.06% -
429.mcf (unexplained diff vs previous) 274.19% 93.000 348.000 - 2385.71% -
464.h264ref (unexplained diff vs previous) 253.33% 15.000 53.000 - 0.00% -
450.soplex (unexplained diff vs previous) (percentage) 246.27% 2.010 6.960 - 853.42% -
401.bzip2 (max) (percentage) 222.73% 0.880 2.840 - 951.85% -
410.bwaves (max) 220.00% 30.000 96.000 - 166.67% -
471.omnetpp (unexplained diff vs previous) 219.23% 26.000 83.000 - 336.84% -
401.bzip2 (unexplained diff vs previous) (percentage) 217.24% 0.870 2.760 - 1871.43% -
458.sjeng (max) 212.90% 31.000 97.000 - 870.00% -
437.leslie3d (unexplained diff vs previous) 210.50% 343.000 1065.000 - 29.56% -
459.GemsFDTD (unexplained diff vs previous) 208.33% 48.000 148.000 - 377.42% -
429.mcf (max) 207.61% 92.000 283.000 - 1921.43% -
470.lbm (unexplained diff vs previous) 207.14% 14.000 43.000 - 0.00% -
462.libquantum (avg) (percentage) 203.08% 0.650 1.970 - 1.03% -
458.sjeng (avg) (percentage) 184.85% 0.330 0.940 - 0.00% -
450.soplex (avg) (percentage) 166.13% 1.240 3.300 - 2.80% -
482.sphinx3 (max) (percentage) 163.95% 1.470 3.880 - 743.48% -
464.h264ref (avg) (percentage) 122.22% 0.540 1.200 - -0.83% -
447.dealII (unexplained diff vs previous) (percentage) 117.95% 0.780 1.700 - 0.00% -
464.h264ref (max) (percentage) 111.63% 0.430 0.910 - 102.22% -
437.leslie3d (avg) (percentage) 100.00% 2.380 4.760 - 2.59% -
459.GemsFDTD (avg) (percentage) 93.33% 0.900 1.740 - 1.16% -
400.perlbench (avg) (percentage) 82.99% 1.470 2.690 - -1.82% -
454.calculix (avg) (percentage) 81.09% 2.010 3.640 - 0.00% -
453.povray (avg) (percentage) 79.20% 1.250 2.240 - -2.18% -
445.gobmk (avg) (percentage) 77.92% 0.770 1.370 - 0.00% -
483.xalancbmk (avg) (percentage) 76.12% 0.670 1.180 - 0.00% -
482.sphinx3 (avg) (percentage) 66.44% 1.460 2.430 - 1.25% -
447.dealII (avg) (percentage) 66.36% 1.070 1.780 - -0.56% -
456.hmmer (avg) (percentage) 63.24% 0.680 1.110 - -0.89% -
471.omnetpp (avg) (percentage) 61.01% 1.590 2.560 - 0.00% -
447.dealII (max) (percentage) 57.27% 1.100 1.730 - 96.59% -
437.leslie3d 56.58% 357.000 559.000 - 12.70% -
437.leslie3d (avg) 56.58% 357.000 559.000 - 12.70% -
458.sjeng 55.32% 47.000 73.000 - 1.39% -
458.sjeng (avg) 55.32% 47.000 73.000 - 1.39% -
410.bwaves (avg) (percentage) 29.36% 1.090 1.410 - 0.71% -
435.gromacs (avg) (percentage) 23.70% 1.730 2.140 - 0.00% -
434.zeusmp (avg) (percentage) 22.30% 1.480 1.810 - 0.00% -
465.tonto (max) 21.16% 293.000 355.000 - 582.69% -
454.calculix (max) (percentage) 20.00% 4.700 5.640 - -3.42% -
465.tonto 16.06% 137.000 159.000 - 6.71% -
465.tonto (avg) 16.06% 137.000 159.000 - 6.71% -
433.milc (avg) (percentage) 15.88% 1.700 1.970 - 0.00% -
459.GemsFDTD (max) 7.86% 140.000 151.000 - 387.10% -
481.wrf (avg) (percentage) 3.17% 1.890 1.950 - 0.00% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -3.45% 29.000 28.000 - 0.00% -
nb_execution_successful -3.45% 29.000 28.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
458.sjeng -3.57% 120221.000 115929.000 - 0.00% -
464.h264ref -2.37% 428364.000 418224.000 - 0.00% -
434.zeusmp -1.65% 165699.000 162969.000 - 0.00% -
459.GemsFDTD -1.57% 253716.000 249721.000 - 0.00% -
410.bwaves -1.34% 17880.000 17640.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
454.calculix -99.73% 22860.000 62.000 - 1.64% -
403.gcc -99.32% 9010.000 61.000 - 8.93% -
462.libquantum -98.81% 11614.000 138.000 - 2.99% -
482.sphinx3 -96.87% 29928.000 938.000 - 3.88% -
450.soplex -96.19% 15466.000 589.000 - 7.48% -
453.povray -92.47% 6544.000 493.000 - 0.20% -
444.namd -91.98% 9050.000 726.000 - 1.54% -
429.mcf -91.11% 17158.000 1526.000 - -18.57% -
433.milc -91.01% 12976.000 1166.000 - 2.10% -
436.cactusADM -87.90% 17544.000 2122.000 - -0.84% -
400.perlbench -85.44% 10650.000 1551.000 - 0.98% -
401.bzip2 -80.67% 15185.000 2936.000 - 2.84% -
434.zeusmp -80.49% 13211.000 2578.000 - 2.02% -
447.dealII -79.51% 9751.000 1998.000 - 1.73% -
459.GemsFDTD -73.63% 23356.000 6159.000 - 2.46% -
456.hmmer -73.50% 11046.000 2927.000 - 0.72% -
471.omnetpp -72.11% 10739.000 2995.000 - 2.85% -
470.lbm -70.74% 12819.000 3751.000 - 1.16% -
481.wrf -67.13% 16834.000 5534.000 - 2.18% -
473.astar -60.41% 14932.000 5911.000 - 3.81% -
464.h264ref -59.84% 14556.000 5846.000 - 0.91% -
410.bwaves -59.10% 14755.000 6035.000 - 1.60% -
445.gobmk -56.32% 11995.000 5240.000 - 1.49% -
435.gromacs -52.69% 15419.000 7295.000 - 5.59% -
458.sjeng -45.15% 14275.000 7830.000 - 1.24% -
416.gamess -44.63% 22704.000 12571.000 - 0.44% -
437.leslie3d -21.60% 15005.000 11764.000 - 9.95% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
454.calculix (max) -99.72% 1074.000 3.000 - 0.00% -
454.calculix -99.56% 459.000 2.000 - 0.00% -
454.calculix (avg) -99.56% 459.000 2.000 - 0.00% -
444.namd (max) -99.23% 649.000 5.000 - 0.00% -
453.povray (max) -97.58% 165.000 4.000 - 0.00% -
462.libquantum -97.33% 75.000 2.000 - 0.00% -
462.libquantum (avg) -97.33% 75.000 2.000 - 0.00% -
436.cactusADM (max) -96.92% 552.000 17.000 - 21.43% -
436.cactusADM (unexplained diff vs previous) -96.84% 570.000 18.000 - 20.00% -
400.perlbench (unexplained diff vs previous) -95.80% 357.000 15.000 - 0.00% -
444.namd -95.49% 355.000 16.000 - 6.67% -
444.namd (avg) -95.49% 355.000 16.000 - 6.67% -
482.sphinx3 -94.95% 436.000 22.000 - 4.76% -
482.sphinx3 (avg) -94.95% 436.000 22.000 - 4.76% -
462.libquantum (max) -94.59% 74.000 4.000 - 300.00% -
403.gcc -94.44% 54.000 3.000 - 0.00% -
403.gcc (avg) -94.44% 54.000 3.000 - 0.00% -
433.milc (unexplained diff vs previous) -94.35% 425.000 24.000 - 380.00% -
433.milc (max) -94.16% 411.000 24.000 - 166.67% -
470.lbm (max) -93.42% 653.000 43.000 - 514.29% -
481.wrf (max) -92.83% 530.000 38.000 - -2.56% -
403.gcc (unexplained diff vs previous) -92.31% 65.000 5.000 - 0.00% -
403.gcc (max) -92.19% 64.000 5.000 - 66.67% -
416.gamess (unexplained diff vs previous) -91.86% 676.000 55.000 - 1000.00% -
482.sphinx3 (max) -91.80% 439.000 36.000 - 800.00% -
416.gamess (max) -91.62% 656.000 55.000 - 223.53% -
400.perlbench (max) -91.59% 345.000 29.000 - 0.00% -
450.soplex -90.05% 191.000 19.000 - 11.76% -
450.soplex (avg) -90.05% 191.000 19.000 - 11.76% -
433.milc -90.00% 220.000 22.000 - 0.00% -
433.milc (avg) -90.00% 220.000 22.000 - 0.00% -
444.namd (max) (percentage) -89.55% 7.180 0.750 - -5.06% -
436.cactusADM -88.32% 291.000 34.000 - -2.86% -
436.cactusADM (avg) -88.32% 291.000 34.000 - -2.86% -
471.omnetpp (max) -87.16% 662.000 85.000 - 102.38% -
450.soplex (unexplained diff vs previous) -86.82% 311.000 41.000 - 925.00% -
453.povray -86.42% 81.000 11.000 - 0.00% -
453.povray (avg) -86.42% 81.000 11.000 - 0.00% -
450.soplex (max) -85.53% 304.000 44.000 - 1000.00% -
416.gamess (unexplained diff vs previous) (percentage) -85.23% 2.980 0.440 - 1000.00% -
456.hmmer (max) -85.00% 140.000 21.000 - 40.00% -
416.gamess (max) (percentage) -84.78% 2.890 0.440 - 214.29% -
434.zeusmp (unexplained diff vs previous) -83.44% 308.000 51.000 - 5000.00% -
434.zeusmp (max) -82.72% 301.000 52.000 - 300.00% -
482.sphinx3 (unexplained diff vs previous) -81.18% 186.000 35.000 - 775.00% -
470.lbm -80.53% 303.000 59.000 - 1.72% -
470.lbm (avg) -80.53% 303.000 59.000 - 1.72% -
481.wrf (max) (percentage) -77.78% 3.150 0.700 - -4.11% -
470.lbm (max) (percentage) -77.25% 5.100 1.160 - 510.53% -
434.zeusmp -76.41% 195.000 46.000 - 2.22% -
434.zeusmp (avg) -76.41% 195.000 46.000 - 2.22% -
456.hmmer (unexplained diff vs previous) -74.70% 83.000 21.000 - 31.25% -
436.cactusADM (unexplained diff vs previous) (percentage) -73.85% 3.250 0.850 - 21.43% -
400.perlbench -73.72% 156.000 41.000 - -2.38% -
400.perlbench (avg) -73.72% 156.000 41.000 - -2.38% -
436.cactusADM (max) (percentage) -73.33% 3.150 0.840 - 20.00% -
416.gamess -71.75% 492.000 139.000 - -1.42% -
416.gamess (avg) -71.75% 492.000 139.000 - -1.42% -
435.gromacs (max) -71.06% 311.000 90.000 - 1.12% -
400.perlbench (unexplained diff vs previous) (percentage) -71.04% 3.350 0.970 - 0.00% -
447.dealII (max) -68.22% 107.000 34.000 - 100.00% -
453.povray (max) (percentage) -67.59% 2.530 0.820 - -10.87% -
481.wrf -66.35% 318.000 107.000 - 1.90% -
481.wrf (avg) -66.35% 318.000 107.000 - 1.90% -
447.dealII -66.35% 104.000 35.000 - 0.00% -
447.dealII (avg) -66.35% 104.000 35.000 - 0.00% -
445.gobmk (unexplained diff vs previous) -58.60% 186.000 77.000 - 2466.67% -
445.gobmk (max) -57.38% 183.000 78.000 - 550.00% -
456.hmmer -57.33% 75.000 32.000 - 0.00% -
456.hmmer (avg) -57.33% 75.000 32.000 - 0.00% -
471.omnetpp -55.29% 170.000 76.000 - 2.70% -
471.omnetpp (avg) -55.29% 170.000 76.000 - 2.70% -
447.dealII (unexplained diff vs previous) -55.26% 76.000 34.000 - 0.00% -
471.omnetpp (max) (percentage) -53.81% 6.170 2.850 - 93.88% -
459.GemsFDTD -49.05% 210.000 107.000 - 3.88% -
459.GemsFDTD (avg) -49.05% 210.000 107.000 - 3.88% -
416.gamess (avg) (percentage) -48.85% 2.170 1.110 - -1.77% -
410.bwaves -46.88% 160.000 85.000 - 2.41% -
410.bwaves (avg) -46.88% 160.000 85.000 - 2.41% -
444.namd (avg) (percentage) -43.51% 3.930 2.220 - 0.00% -
456.hmmer (max) (percentage) -43.31% 1.270 0.720 - 30.91% -
435.gromacs -41.35% 266.000 156.000 - 6.12% -
435.gromacs (avg) -41.35% 266.000 156.000 - 6.12% -
400.perlbench (max) (percentage) -40.74% 3.240 1.920 - -1.54% -
401.bzip2 (unexplained diff vs previous) -38.64% 132.000 81.000 - 1925.00% -
435.gromacs (max) (percentage) -38.61% 2.020 1.240 - -4.62% -
401.bzip2 (max) -37.59% 133.000 83.000 - 1085.71% -
433.milc (unexplained diff vs previous) (percentage) -37.20% 3.280 2.060 - 368.18% -
433.milc (max) (percentage) -33.75% 3.170 2.100 - 147.06% -
470.lbm (avg) (percentage) -33.33% 2.370 1.580 - -0.63% -
445.gobmk -22.83% 92.000 71.000 - 1.43% -
445.gobmk (avg) -22.83% 92.000 71.000 - 1.43% -
401.bzip2 -15.15% 66.000 56.000 - 5.66% -
401.bzip2 (avg) -15.15% 66.000 56.000 - 5.66% -
434.zeusmp (unexplained diff vs previous) (percentage) -15.02% 2.330 1.980 - 4850.00% -
464.h264ref (max) -14.52% 62.000 53.000 - 103.85% -
465.tonto (avg) (percentage) -13.77% 1.670 1.440 - 3.60% -
434.zeusmp (max) (percentage) -11.40% 2.280 2.020 - 281.13% -
465.tonto (max) (percentage) -10.61% 3.580 3.200 - 553.06% -
464.h264ref -10.26% 78.000 70.000 - 0.00% -
464.h264ref (avg) -10.26% 78.000 70.000 - 0.00% -
445.gobmk (unexplained diff vs previous) (percentage) -5.16% 1.550 1.470 - 2350.00% -
456.hmmer (unexplained diff vs previous) (percentage) -4.00% 0.750 0.720 - 30.91% -
429.mcf -3.33% 90.000 87.000 - -14.71% -
429.mcf (avg) -3.33% 90.000 87.000 - -14.71% -
445.gobmk (max) (percentage) -2.61% 1.530 1.490 - 520.83% -
436.cactusADM (avg) (percentage) -1.81% 1.660 1.630 - -1.21% -

Report Time: 0.37s
Execution (seconds)
Name Current %
400.perlbench 1551.000 -
401.bzip2 2936.000 2.84%
403.gcc 61.000 8.93%
410.bwaves 6035.000 1.60%
416.gamess 12571.000 -
429.mcf 1526.000 -18.57%
433.milc 1166.000 2.10%
434.zeusmp 2578.000 2.02%
435.gromacs 7295.000 5.59%
436.cactusADM 2122.000 -
437.leslie3d 11764.000 9.95%
444.namd 726.000 1.54%
445.gobmk 5240.000 1.49%
447.dealII 1998.000 1.73%
450.soplex 589.000 7.48%
453.povray 493.000 -
454.calculix 62.000 1.64%
456.hmmer 2927.000 -
458.sjeng 7830.000 1.24%
459.GemsFDTD 6159.000 2.46%
462.libquantum 138.000 2.99%
464.h264ref 5846.000 -
465.tonto 11102.000 3.20%
470.lbm 3751.000 1.16%
471.omnetpp 2995.000 2.85%
473.astar 5911.000 3.81%
481.wrf 5534.000 2.18%
482.sphinx3 938.000 3.88%
Geometric Mean 2099.821 1.83%
Code Size (bytes)
Name Current %
400.perlbench 941436.000 -
401.bzip2 49698.000 -
403.gcc 2671145.000 -
410.bwaves 17640.000 -
416.gamess 6241643.000 -
429.mcf 10979.000 -
433.milc 95589.000 -
434.zeusmp 162969.000 -
435.gromacs 677973.000 -
436.cactusADM 551244.000 -
437.leslie3d 64764.000 -
444.namd 190754.000 -
445.gobmk 1399537.000 -
447.dealII 2122042.000 -
450.soplex 259980.000 -
453.povray 702162.000 -
454.calculix 1268827.000 -
456.hmmer 230496.000 -
458.sjeng 115929.000 -
459.GemsFDTD 249721.000 -
462.libquantum 31321.000 -
464.h264ref 418224.000 -
465.tonto 2868541.000 -
470.lbm 10916.000 -
471.omnetpp 566294.000 -
473.astar 32056.000 -
481.wrf 2617288.000 -
482.sphinx3 152548.000 -
Geometric Mean 272070.283 -
sample variability
Name Current %
400.perlbench 41.000 -2.38%
400.perlbench (avg) 41.000 -2.38%
400.perlbench (avg) (percentage) 2.690 -1.82%
400.perlbench (max) 29.000 -
400.perlbench (max) (percentage) 1.920 -1.54%
400.perlbench (unexplained diff vs previous) 15.000 -
400.perlbench (unexplained diff vs previous) (percentage) 0.970 -
401.bzip2 56.000 5.66%
401.bzip2 (avg) 56.000 5.66%
401.bzip2 (avg) (percentage) 1.910 1.06%
401.bzip2 (max) 83.000 1085.71%
401.bzip2 (max) (percentage) 2.840 951.85%
401.bzip2 (unexplained diff vs previous) 81.000 1925.00%
401.bzip2 (unexplained diff vs previous) (percentage) 2.760 1871.43%
403.gcc 3.000 -
403.gcc (avg) 3.000 -
403.gcc (avg) (percentage) 5.910 3.14%
403.gcc (max) 5.000 66.67%
403.gcc (max) (percentage) 8.930 44.73%
403.gcc (unexplained diff vs previous) 5.000 -
403.gcc (unexplained diff vs previous) (percentage) 8.200 -
410.bwaves 85.000 2.41%
410.bwaves (avg) 85.000 2.41%
410.bwaves (avg) (percentage) 1.410 -
410.bwaves (max) 96.000 166.67%
410.bwaves (max) (percentage) 1.600 162.30%
410.bwaves (unexplained diff vs previous) 95.000 163.89%
410.bwaves (unexplained diff vs previous) (percentage) 1.570 157.38%
416.gamess 139.000 -1.42%
416.gamess (avg) 139.000 -1.42%
416.gamess (avg) (percentage) 1.110 -1.77%
416.gamess (max) 55.000 223.53%
416.gamess (max) (percentage) 0.440 214.29%
416.gamess (unexplained diff vs previous) 55.000 1000.00%
416.gamess (unexplained diff vs previous) (percentage) 0.440 1000.00%
429.mcf 87.000 -14.71%
429.mcf (avg) 87.000 -14.71%
429.mcf (avg) (percentage) 5.720 4.38%
429.mcf (max) 283.000 1921.43%
429.mcf (max) (percentage) 18.570 2376.00%
429.mcf (unexplained diff vs previous) 348.000 2385.71%
429.mcf (unexplained diff vs previous) (percentage) 22.800 2940.00%
433.milc 22.000 -
433.milc (avg) 22.000 -
433.milc (avg) (percentage) 1.970 -
433.milc (max) 24.000 166.67%
433.milc (max) (percentage) 2.100 147.06%
433.milc (unexplained diff vs previous) 24.000 380.00%
433.milc (unexplained diff vs previous) (percentage) 2.060 368.18%
434.zeusmp 46.000 2.22%
434.zeusmp (avg) 46.000 2.22%
434.zeusmp (avg) (percentage) 1.810 -
434.zeusmp (max) 52.000 300.00%
434.zeusmp (max) (percentage) 2.020 281.13%
434.zeusmp (unexplained diff vs previous) 51.000 5000.00%
434.zeusmp (unexplained diff vs previous) (percentage) 1.980 4850.00%
435.gromacs 156.000 6.12%
435.gromacs (avg) 156.000 6.12%
435.gromacs (avg) (percentage) 2.140 -
435.gromacs (max) 90.000 1.12%
435.gromacs (max) (percentage) 1.240 -4.62%
436.cactusADM 34.000 -2.86%
436.cactusADM (avg) 34.000 -2.86%
436.cactusADM (avg) (percentage) 1.630 -1.21%
436.cactusADM (max) 17.000 21.43%
436.cactusADM (max) (percentage) 0.840 20.00%
436.cactusADM (unexplained diff vs previous) 18.000 20.00%
436.cactusADM (unexplained diff vs previous) (percentage) 0.850 21.43%
437.leslie3d 559.000 12.70%
437.leslie3d (avg) 559.000 12.70%
437.leslie3d (avg) (percentage) 4.760 2.59%
437.leslie3d (max) 1371.000 4.82%
437.leslie3d (max) (percentage) 11.660 -4.66%
437.leslie3d (unexplained diff vs previous) 1065.000 29.56%
437.leslie3d (unexplained diff vs previous) (percentage) 9.050 17.84%
444.namd 16.000 6.67%
444.namd (avg) 16.000 6.67%
444.namd (avg) (percentage) 2.220 -
444.namd (max) 5.000 -
444.namd (max) (percentage) 0.750 -5.06%
445.gobmk 71.000 1.43%
445.gobmk (avg) 71.000 1.43%
445.gobmk (avg) (percentage) 1.370 -
445.gobmk (max) 78.000 550.00%
445.gobmk (max) (percentage) 1.490 520.83%
445.gobmk (unexplained diff vs previous) 77.000 2466.67%
445.gobmk (unexplained diff vs previous) (percentage) 1.470 2350.00%
447.dealII 35.000 -
447.dealII (avg) 35.000 -
447.dealII (avg) (percentage) 1.780 -
447.dealII (max) 34.000 100.00%
447.dealII (max) (percentage) 1.730 96.59%
447.dealII (unexplained diff vs previous) 34.000 -
447.dealII (unexplained diff vs previous) (percentage) 1.700 -
450.soplex 19.000 11.76%
450.soplex (avg) 19.000 11.76%
450.soplex (avg) (percentage) 3.300 2.80%
450.soplex (max) 44.000 1000.00%
450.soplex (max) (percentage) 7.480 910.81%
450.soplex (unexplained diff vs previous) 41.000 925.00%
450.soplex (unexplained diff vs previous) (percentage) 6.960 853.42%
453.povray 11.000 -
453.povray (avg) 11.000 -
453.povray (avg) (percentage) 2.240 -2.18%
453.povray (max) 4.000 -
453.povray (max) (percentage) 0.820 -10.87%
453.povray (unexplained diff vs previous) 1.000 -
453.povray (unexplained diff vs previous) (percentage) 0.200 -
454.calculix 2.000 -
454.calculix (avg) 2.000 -
454.calculix (avg) (percentage) 3.640 -
454.calculix (max) 3.000 -
454.calculix (max) (percentage) 5.640 -3.42%
456.hmmer 32.000 -
456.hmmer (avg) 32.000 -
456.hmmer (avg) (percentage) 1.110 -
456.hmmer (max) 21.000 40.00%
456.hmmer (max) (percentage) 0.720 30.91%
456.hmmer (unexplained diff vs previous) 21.000 31.25%
456.hmmer (unexplained diff vs previous) (percentage) 0.720 30.91%
458.sjeng 73.000 1.39%
458.sjeng (avg) 73.000 1.39%
458.sjeng (avg) (percentage) 0.940 -
458.sjeng (max) 97.000 870.00%
458.sjeng (max) (percentage) 1.240 785.71%
458.sjeng (unexplained diff vs previous) 96.000 1100.00%
458.sjeng (unexplained diff vs previous) (percentage) 1.230 1130.00%
459.GemsFDTD 107.000 3.88%
459.GemsFDTD (avg) 107.000 3.88%
459.GemsFDTD (avg) (percentage) 1.740 1.16%
459.GemsFDTD (max) 151.000 387.10%
459.GemsFDTD (max) (percentage) 2.460 364.15%
459.GemsFDTD (unexplained diff vs previous) 148.000 377.42%
459.GemsFDTD (unexplained diff vs previous) (percentage) 2.400 361.54%
462.libquantum 2.000 -
462.libquantum (avg) 2.000 -
462.libquantum (avg) (percentage) 1.970 1.03%
462.libquantum (max) 4.000 300.00%
462.libquantum (max) (percentage) 2.990 130.00%
462.libquantum (unexplained diff vs previous) 4.000 -
462.libquantum (unexplained diff vs previous) (percentage) 2.900 -
464.h264ref 70.000 -
464.h264ref (avg) 70.000 -
464.h264ref (avg) (percentage) 1.200 -
464.h264ref (max) 53.000 103.85%
464.h264ref (max) (percentage) 0.910 102.22%
464.h264ref (unexplained diff vs previous) 53.000 -
464.h264ref (unexplained diff vs previous) (percentage) 0.910 -
465.tonto 159.000 6.71%
465.tonto (avg) 159.000 6.71%
465.tonto (avg) (percentage) 1.440 3.60%
465.tonto (max) 355.000 582.69%
465.tonto (max) (percentage) 3.200 553.06%
465.tonto (unexplained diff vs previous) 344.000 1710.53%
465.tonto (unexplained diff vs previous) (percentage) 3.100 1622.22%
470.lbm 59.000 1.72%
470.lbm (avg) 59.000 1.72%
470.lbm (avg) (percentage) 1.580 -
470.lbm (max) 43.000 514.29%
470.lbm (max) (percentage) 1.160 510.53%
470.lbm (unexplained diff vs previous) 43.000 -
470.lbm (unexplained diff vs previous) (percentage) 1.150 -
471.omnetpp 76.000 2.70%
471.omnetpp (avg) 76.000 2.70%
471.omnetpp (avg) (percentage) 2.560 -
471.omnetpp (max) 85.000 102.38%
471.omnetpp (max) (percentage) 2.850 93.88%
471.omnetpp (unexplained diff vs previous) 83.000 336.84%
471.omnetpp (unexplained diff vs previous) (percentage) 2.770 326.15%
473.astar 105.000 6.06%
473.astar (avg) 105.000 6.06%
473.astar (avg) (percentage) 1.780 1.71%
473.astar (max) 225.000 1507.14%
473.astar (max) (percentage) 3.810 1365.38%
473.astar (unexplained diff vs previous) 217.000 4240.00%
473.astar (unexplained diff vs previous) (percentage) 3.670 3977.78%
481.wrf 107.000 1.90%
481.wrf (avg) 107.000 1.90%
481.wrf (avg) (percentage) 1.950 -
481.wrf (max) 38.000 -2.56%
481.wrf (max) (percentage) 0.700 -4.11%
482.sphinx3 22.000 4.76%
482.sphinx3 (avg) 22.000 4.76%
482.sphinx3 (avg) (percentage) 2.430 1.25%
482.sphinx3 (max) 36.000 800.00%
482.sphinx3 (max) (percentage) 3.880 743.48%
482.sphinx3 (unexplained diff vs previous) 35.000 775.00%
482.sphinx3 (unexplained diff vs previous) (percentage) 3.730 747.73%
483.xalancbmk (avg) (percentage) 1.180 -
483.xalancbmk (max) (percentage) 5.870 -
Geometric Mean 11.703 180.98%