Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=63224e96d0cd9e726bcd1d6d512255d92b7c5317 (unchanged)
git_gcc https://github.com/gcc-mirror/gcc/commit/1c188877bfc5a4aee3f777f0d4d60500bc222b54 (unchanged)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=1d44530a5be2442e064baa48139adc9fdfb1fc6b (+ 9 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=aa0a1382849d5a6e2e65d29335e24bb3aa6ef655 (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-aarch64-master-Os-build/57/
Filter

gnu-aarch64-master-Os test results

Run Order Start Time Duration
Current 0057 (glibc-2.37.9000-00529-g1d44530a5be) 2023-06-13T05:36:02 0:00:00
Previous 0052 (3-changed-components) 2023-06-10T17:17:55 0:00:00
Baseline 0001 (3-changed-components) 2023-01-01T08:38:47 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 33 77
Performance Improvements 141 152
Unchanged Tests 1062 1007
Total Tests 1236

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
435.gromacs 2.24% 7178.000 7339.000 - -52.40% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
401.bzip2 (unexplained diff vs previous) 1100.00% 2.000 24.000 - -81.82% -
401.bzip2 (unexplained diff vs previous) (percentage) 1057.14% 0.070 0.810 - -6.90% -
435.gromacs (unexplained diff vs previous) 283.33% 42.000 161.000 - -49.37% -
435.gromacs (unexplained diff vs previous) (percentage) 271.19% 0.590 2.190 - 6.31% -
465.tonto (unexplained diff vs previous) (percentage) 197.14% 0.350 1.040 - 35.06% -
465.tonto (unexplained diff vs previous) 192.31% 39.000 114.000 - 80.95% -
450.soplex (unexplained diff vs previous) (percentage) 165.12% 0.860 2.280 - 13.43% -
450.soplex (unexplained diff vs previous) 160.00% 5.000 13.000 - -95.82% -
470.lbm (max) 153.85% 13.000 33.000 - -94.95% -
470.lbm (unexplained diff vs previous) 153.85% 13.000 33.000 - 135.71% -
470.lbm (max) (percentage) 151.43% 0.350 0.880 - -82.75% -
470.lbm (unexplained diff vs previous) (percentage) 151.43% 0.350 0.880 - 700.00% -
447.dealII (unexplained diff vs previous) (percentage) 120.00% 0.250 0.550 - -29.49% -
447.dealII (unexplained diff vs previous) 120.00% 5.000 11.000 - -85.53% -
433.milc (unexplained diff vs previous) 100.00% 2.000 4.000 - -99.06% -
433.milc (unexplained diff vs previous) (percentage) 100.00% 0.170 0.340 - -89.63% -
447.dealII (max) 57.14% 7.000 11.000 - -89.72% -
471.omnetpp (unexplained diff vs previous) (percentage) 43.23% 1.550 2.220 - 825.00% -
447.dealII (max) (percentage) 41.03% 0.390 0.550 - -50.00% -
471.omnetpp (unexplained diff vs previous) 40.43% 47.000 66.000 - 153.85% -
473.astar (unexplained diff vs previous) (percentage) 34.34% 0.990 1.330 - 6550.00% -
473.astar (unexplained diff vs previous) 32.20% 59.000 78.000 - 2500.00% -
444.namd (max) 25.00% 4.000 5.000 - -99.23% -
444.namd (max) (percentage) 23.21% 0.560 0.690 - -90.39% -
454.calculix (max) (percentage) 20.93% 2.580 3.120 - -33.62% -
471.omnetpp (max) (percentage) 11.86% 1.940 2.170 - -64.83% -
416.gamess (unexplained diff vs previous) 11.76% 17.000 19.000 - -97.19% -
471.omnetpp (max) 10.34% 58.000 64.000 - -90.33% -
481.wrf (unexplained diff vs previous) (percentage) 6.06% 0.660 0.700 - 4.48% -
481.wrf (unexplained diff vs previous) 5.41% 37.000 39.000 - -65.18% -
435.gromacs 1.44% 208.000 211.000 - -20.68% -
435.gromacs (avg) 1.44% 208.000 211.000 - -20.68% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
454.calculix -3.12% 64.000 62.000 - -99.73% -
483.xalancbmk -2.37% 4262.000 4161.000 - -62.76% -
450.soplex -2.23% 584.000 571.000 - -96.31% -
471.omnetpp -2.17% 3038.000 2972.000 - -72.33% -
453.povray -1.82% 550.000 540.000 - -91.75% -
403.gcc -1.69% 59.000 58.000 - -99.36% -
473.astar -1.31% 5951.000 5873.000 - -60.67% -
465.tonto -1.03% 11046.000 10932.000 - 33.24% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
437.leslie3d (unexplained diff vs previous) (percentage) -99.52% 18.590 0.090 - -96.07% -
437.leslie3d (unexplained diff vs previous) -99.49% 1967.000 10.000 - -97.08% -
429.mcf (max) -95.29% 191.000 9.000 - -90.22% -
429.mcf (max) (percentage) -94.93% 12.620 0.640 - 18.52% -
445.gobmk (unexplained diff vs previous) (percentage) -88.10% 1.260 0.150 - -90.32% -
445.gobmk (unexplained diff vs previous) -87.88% 66.000 8.000 - -95.70% -
429.mcf (unexplained diff vs previous) (percentage) -84.88% 0.860 0.130 - -75.93% -
429.mcf (unexplained diff vs previous) -84.62% 13.000 2.000 - -97.85% -
464.h264ref (unexplained diff vs previous) (percentage) -81.48% 0.270 0.050 - -50.00% -
464.h264ref (unexplained diff vs previous) -81.25% 16.000 3.000 - -80.00% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -80.95% 0.420 0.080 - -61.90% -
459.GemsFDTD (unexplained diff vs previous) -80.77% 26.000 5.000 - -89.58% -
400.perlbench (unexplained diff vs previous) (percentage) -80.65% 0.310 0.060 - -98.21% -
400.perlbench (unexplained diff vs previous) -80.00% 5.000 1.000 - -99.72% -
410.bwaves (unexplained diff vs previous) -67.86% 28.000 9.000 - -40.00% -
410.bwaves (unexplained diff vs previous) (percentage) -67.39% 0.460 0.150 - 50.00% -
436.cactusADM (unexplained diff vs previous) -59.09% 22.000 9.000 - -98.42% -
436.cactusADM (unexplained diff vs previous) (percentage) -58.65% 1.040 0.430 - -86.77% -
410.bwaves (max) -55.56% 45.000 20.000 - -33.33% -
410.bwaves (max) (percentage) -54.67% 0.750 0.340 - 61.90% -
458.sjeng (max) (percentage) -50.00% 0.620 0.310 - 40.91% -
482.sphinx3 (unexplained diff vs previous) -50.00% 6.000 3.000 - -98.39% -
482.sphinx3 (unexplained diff vs previous) (percentage) -50.00% 0.640 0.320 - -48.39% -
458.sjeng (max) -48.94% 47.000 24.000 - -22.58% -
453.povray (max) -40.00% 15.000 9.000 - -94.55% -
436.cactusADM (max) -38.46% 26.000 16.000 - -97.10% -
436.cactusADM (max) (percentage) -36.80% 1.250 0.790 - -74.92% -
453.povray (max) (percentage) -35.00% 2.800 1.820 - -28.06% -
458.sjeng (unexplained diff vs previous) (percentage) -34.29% 0.350 0.230 - 283.33% -
458.sjeng (unexplained diff vs previous) -33.33% 27.000 18.000 - 100.00% -
456.hmmer (unexplained diff vs previous) -30.00% 10.000 7.000 - -91.57% -
456.hmmer (unexplained diff vs previous) (percentage) -29.41% 0.340 0.240 - -68.00% -
445.gobmk (max) (percentage) -18.05% 1.330 1.090 - -28.76% -
456.hmmer (max) (percentage) -17.65% 0.340 0.280 - -77.95% -
445.gobmk (max) -17.39% 69.000 57.000 - -68.85% -
456.hmmer (max) -11.11% 9.000 8.000 - -94.29% -
453.povray (unexplained diff vs previous) -9.09% 11.000 10.000 - 900.00% -
464.h264ref (max) (percentage) -8.82% 0.340 0.310 - -27.91% -
437.leslie3d (max) -8.63% 1796.000 1641.000 - 367.52% -
437.leslie3d (max) (percentage) -8.54% 16.980 15.530 - 563.68% -
482.sphinx3 (max) -8.00% 25.000 23.000 - -94.76% -
416.gamess (max) -7.69% 26.000 24.000 - -96.34% -
473.astar (max) -7.58% 132.000 122.000 - 510.00% -
453.povray (unexplained diff vs previous) (percentage) -7.50% 2.000 1.850 - 9150.00% -
459.GemsFDTD (max) -6.76% 74.000 69.000 - -50.71% -
433.milc (max) (percentage) -6.67% 1.350 1.260 - -60.25% -
433.milc (max) -6.67% 15.000 14.000 - -96.59% -
482.sphinx3 (max) (percentage) -6.32% 2.690 2.520 - 71.43% -
473.astar (max) (percentage) -6.28% 2.230 2.090 - 1392.86% -
450.soplex (max) -6.25% 16.000 15.000 - -95.07% -
462.libquantum (max) (percentage) -6.03% 1.990 1.870 - 192.19% -
434.zeusmp (max) (percentage) -6.02% 0.830 0.780 - -65.79% -
459.GemsFDTD (max) (percentage) -5.79% 1.210 1.140 - 90.00% -
401.bzip2 (max) -5.63% 71.000 67.000 - -49.62% -
464.h264ref (max) -5.26% 19.000 18.000 - -70.97% -
401.bzip2 (max) (percentage) -5.04% 2.380 2.260 - 156.82% -
434.zeusmp (max) -5.00% 20.000 19.000 - -93.69% -
400.perlbench (avg) (percentage) -4.02% 3.480 3.340 - 127.21% -
450.soplex (max) (percentage) -4.01% 2.740 2.630 - 33.50% -
450.soplex -4.00% 25.000 24.000 - -87.43% -
450.soplex (avg) -4.00% 25.000 24.000 - -87.43% -
436.cactusADM -3.92% 51.000 49.000 - -83.16% -
436.cactusADM (avg) -3.92% 51.000 49.000 - -83.16% -
435.gromacs (max) (percentage) -3.86% 2.850 2.740 - 35.64% -
400.perlbench -3.57% 56.000 54.000 - -65.38% -
400.perlbench (avg) -3.57% 56.000 54.000 - -65.38% -
482.sphinx3 -3.45% 29.000 28.000 - -93.58% -
482.sphinx3 (avg) -3.45% 29.000 28.000 - -93.58% -
416.gamess (avg) (percentage) -3.41% 1.760 1.700 - -21.66% -
481.wrf -3.25% 154.000 149.000 - -53.14% -
481.wrf (avg) -3.25% 154.000 149.000 - -53.14% -
416.gamess -3.21% 218.000 211.000 - -57.11% -
416.gamess (avg) -3.21% 218.000 211.000 - -57.11% -
434.zeusmp -3.12% 64.000 62.000 - -68.21% -
434.zeusmp (avg) -3.12% 64.000 62.000 - -68.21% -
465.tonto -3.10% 226.000 219.000 - 59.85% -
465.tonto (avg) -3.10% 226.000 219.000 - 59.85% -
445.gobmk -3.03% 99.000 96.000 - 4.35% -
445.gobmk (avg) -3.03% 99.000 96.000 - 4.35% -
471.omnetpp -3.00% 100.000 97.000 - -42.94% -
471.omnetpp (avg) -3.00% 100.000 97.000 - -42.94% -
433.milc -2.94% 34.000 33.000 - -85.00% -
433.milc (avg) -2.94% 34.000 33.000 - -85.00% -
458.sjeng (avg) (percentage) -2.92% 1.370 1.330 - 303.03% -
464.h264ref -2.88% 104.000 101.000 - 29.49% -
464.h264ref (avg) -2.88% 104.000 101.000 - 29.49% -
458.sjeng -2.86% 105.000 102.000 - 117.02% -
458.sjeng (avg) -2.86% 105.000 102.000 - 117.02% -
473.astar -2.86% 140.000 136.000 - 385.71% -
473.astar (avg) -2.86% 140.000 136.000 - 385.71% -
464.h264ref (avg) (percentage) -2.81% 1.780 1.730 - 220.37% -
437.leslie3d -2.78% 504.000 490.000 - 37.25% -
437.leslie3d (avg) -2.78% 504.000 490.000 - 37.25% -
437.leslie3d (avg) (percentage) -2.73% 4.770 4.640 - 94.96% -
483.xalancbmk (max) -2.68% 261.000 254.000 - 464.44% -
481.wrf (max) (percentage) -2.67% 0.750 0.730 - -76.83% -
429.mcf -2.65% 113.000 110.000 - 22.22% -
429.mcf (avg) -2.65% 113.000 110.000 - 22.22% -
401.bzip2 -2.63% 76.000 74.000 - 12.12% -
401.bzip2 (avg) -2.63% 76.000 74.000 - 12.12% -
459.GemsFDTD -2.63% 152.000 148.000 - -29.52% -
459.GemsFDTD (avg) -2.63% 152.000 148.000 - -29.52% -
445.gobmk (avg) (percentage) -2.63% 1.900 1.850 - 140.26% -
447.dealII (avg) (percentage) -2.55% 2.350 2.290 - 114.02% -
481.wrf (avg) (percentage) -2.53% 2.770 2.700 - 42.86% -
481.wrf (max) -2.44% 41.000 40.000 - -92.45% -
459.GemsFDTD (avg) (percentage) -2.42% 2.480 2.420 - 168.89% -
434.zeusmp (avg) (percentage) -2.35% 2.550 2.490 - 68.24% -
465.tonto (max) -2.34% 128.000 125.000 - -57.34% -
482.sphinx3 (avg) (percentage) -2.22% 3.160 3.090 - 111.64% -
447.dealII -2.17% 46.000 45.000 - -56.73% -
447.dealII (avg) -2.17% 46.000 45.000 - -56.73% -
429.mcf (avg) (percentage) -2.14% 7.460 7.300 - 1277.36% -
456.hmmer -2.13% 47.000 46.000 - -38.67% -
456.hmmer (avg) -2.13% 47.000 46.000 - -38.67% -
436.cactusADM (avg) (percentage) -2.07% 2.410 2.360 - 42.17% -
433.milc (avg) (percentage) -2.03% 2.950 2.890 - 70.00% -
483.xalancbmk -2.00% 50.000 49.000 - -33.78% -
483.xalancbmk (avg) -2.00% 50.000 49.000 - -33.78% -
410.bwaves (avg) (percentage) -1.99% 2.010 1.970 - 80.73% -
401.bzip2 (avg) (percentage) -1.95% 2.560 2.510 - 470.45% -
465.tonto (avg) (percentage) -1.95% 2.050 2.010 - 20.36% -
444.namd (avg) (percentage) -1.94% 3.100 3.040 - -22.65% -
456.hmmer (avg) (percentage) -1.85% 1.620 1.590 - 133.82% -
400.perlbench (max) (percentage) -1.77% 2.260 2.220 - -31.48% -
410.bwaves -1.65% 121.000 119.000 - -25.62% -
410.bwaves (avg) -1.65% 121.000 119.000 - -25.62% -
462.libquantum (avg) (percentage) -1.50% 2.660 2.620 - 303.08% -
435.gromacs (max) -1.47% 204.000 201.000 - -35.37% -
470.lbm (avg) (percentage) -1.32% 2.270 2.240 - -5.49% -
453.povray (avg) (percentage) -1.32% 3.030 2.990 - 139.20% -
473.astar (avg) (percentage) -1.27% 2.360 2.330 - 1126.32% -
450.soplex (avg) (percentage) -1.15% 4.330 4.280 - 245.16% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
465.tonto 33.24% 8205.000 10932.000 - -1.03% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
454.calculix (unexplained diff vs previous) (percentage) 16050.00% 0.020 3.230 - 0.00% -
453.povray (unexplained diff vs previous) (percentage) 9150.00% 0.020 1.850 - -7.50% -
462.libquantum (unexplained diff vs previous) (percentage) 7100.00% 0.010 0.720 - 0.00% -
473.astar (unexplained diff vs previous) (percentage) 6550.00% 0.020 1.330 - 34.34% -
473.astar (unexplained diff vs previous) 2500.00% 3.000 78.000 - 32.20% -
473.astar (max) (percentage) 1392.86% 0.140 2.090 - -6.28% -
483.xalancbmk (max) (percentage) 1392.68% 0.410 6.120 - -0.33% -
429.mcf (avg) (percentage) 1277.36% 0.530 7.300 - -2.14% -
473.astar (avg) (percentage) 1126.32% 0.190 2.330 - -1.27% -
453.povray (unexplained diff vs previous) 900.00% 1.000 10.000 - -9.09% -
471.omnetpp (unexplained diff vs previous) (percentage) 825.00% 0.240 2.220 - 43.23% -
403.gcc (avg) (percentage) 791.80% 0.610 5.440 - 0.00% -
470.lbm (unexplained diff vs previous) (percentage) 700.00% 0.110 0.880 - 151.43% -
403.gcc (max) (percentage) 641.67% 0.720 5.340 - -0.74% -
437.leslie3d (max) (percentage) 563.68% 2.340 15.530 - -8.54% -
473.astar (max) 510.00% 20.000 122.000 - -7.58% -
401.bzip2 (avg) (percentage) 470.45% 0.440 2.510 - -1.95% -
483.xalancbmk (max) 464.44% 45.000 254.000 - -2.68% -
473.astar 385.71% 28.000 136.000 - -2.86% -
473.astar (avg) 385.71% 28.000 136.000 - -2.86% -
437.leslie3d (max) 367.52% 351.000 1641.000 - -8.63% -
462.libquantum (avg) (percentage) 303.08% 0.650 2.620 - -1.50% -
458.sjeng (avg) (percentage) 303.03% 0.330 1.330 - -2.92% -
458.sjeng (unexplained diff vs previous) (percentage) 283.33% 0.060 0.230 - -34.29% -
450.soplex (avg) (percentage) 245.16% 1.240 4.280 - -1.15% -
464.h264ref (avg) (percentage) 220.37% 0.540 1.730 - -2.81% -
462.libquantum (max) (percentage) 192.19% 0.640 1.870 - -6.03% -
459.GemsFDTD (avg) (percentage) 168.89% 0.900 2.420 - -2.42% -
401.bzip2 (max) (percentage) 156.82% 0.880 2.260 - -5.04% -
471.omnetpp (unexplained diff vs previous) 153.85% 26.000 66.000 - 40.43% -
445.gobmk (avg) (percentage) 140.26% 0.770 1.850 - -2.63% -
453.povray (avg) (percentage) 139.20% 1.250 2.990 - -1.32% -
470.lbm (unexplained diff vs previous) 135.71% 14.000 33.000 - 153.85% -
456.hmmer (avg) (percentage) 133.82% 0.680 1.590 - -1.85% -
400.perlbench (avg) (percentage) 127.21% 1.470 3.340 - -4.02% -
458.sjeng 117.02% 47.000 102.000 - -2.86% -
458.sjeng (avg) 117.02% 47.000 102.000 - -2.86% -
447.dealII (avg) (percentage) 114.02% 1.070 2.290 - -2.55% -
482.sphinx3 (avg) (percentage) 111.64% 1.460 3.090 - -2.22% -
471.omnetpp (avg) (percentage) 106.29% 1.590 3.280 - -0.91% -
458.sjeng (unexplained diff vs previous) 100.00% 9.000 18.000 - -33.33% -
454.calculix (avg) (percentage) 96.02% 2.010 3.940 - -0.76% -
437.leslie3d (avg) (percentage) 94.96% 2.380 4.640 - -2.73% -
459.GemsFDTD (max) (percentage) 90.00% 0.600 1.140 - -5.79% -
465.tonto (unexplained diff vs previous) 80.95% 63.000 114.000 - 192.31% -
410.bwaves (avg) (percentage) 80.73% 1.090 1.970 - -1.99% -
483.xalancbmk (avg) (percentage) 76.12% 0.670 1.180 - 0.00% -
482.sphinx3 (max) (percentage) 71.43% 1.470 2.520 - -6.32% -
433.milc (avg) (percentage) 70.00% 1.700 2.890 - -2.03% -
434.zeusmp (avg) (percentage) 68.24% 1.480 2.490 - -2.35% -
435.gromacs (avg) (percentage) 66.47% 1.730 2.880 - -0.69% -
410.bwaves (max) (percentage) 61.90% 0.210 0.340 - -54.67% -
465.tonto 59.85% 137.000 219.000 - -3.10% -
465.tonto (avg) 59.85% 137.000 219.000 - -3.10% -
410.bwaves (unexplained diff vs previous) (percentage) 50.00% 0.100 0.150 - -67.39% -
481.wrf (avg) (percentage) 42.86% 1.890 2.700 - -2.53% -
436.cactusADM (avg) (percentage) 42.17% 1.660 2.360 - -2.07% -
458.sjeng (max) (percentage) 40.91% 0.220 0.310 - -50.00% -
437.leslie3d 37.25% 357.000 490.000 - -2.78% -
437.leslie3d (avg) 37.25% 357.000 490.000 - -2.78% -
435.gromacs (max) (percentage) 35.64% 2.020 2.740 - -3.86% -
465.tonto (unexplained diff vs previous) (percentage) 35.06% 0.770 1.040 - 197.14% -
450.soplex (max) (percentage) 33.50% 1.970 2.630 - -4.01% -
464.h264ref 29.49% 78.000 101.000 - -2.88% -
464.h264ref (avg) 29.49% 78.000 101.000 - -2.88% -
429.mcf 22.22% 90.000 110.000 - -2.65% -
429.mcf (avg) 22.22% 90.000 110.000 - -2.65% -
465.tonto (avg) (percentage) 20.36% 1.670 2.010 - -1.95% -
429.mcf (max) (percentage) 18.52% 0.540 0.640 - -94.93% -
450.soplex (unexplained diff vs previous) (percentage) 13.43% 2.010 2.280 - 165.12% -
401.bzip2 12.12% 66.000 74.000 - -2.63% -
401.bzip2 (avg) 12.12% 66.000 74.000 - -2.63% -
435.gromacs (unexplained diff vs previous) (percentage) 6.31% 2.060 2.190 - 271.19% -
481.wrf (unexplained diff vs previous) (percentage) 4.48% 0.670 0.700 - 6.06% -
445.gobmk 4.35% 92.000 96.000 - -3.03% -
445.gobmk (avg) 4.35% 92.000 96.000 - -3.03% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
458.sjeng -6.99% 120221.000 111821.000 - 0.00% -
464.h264ref -1.06% 428364.000 423816.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
454.calculix -99.73% 22860.000 62.000 - -3.12% -
403.gcc -99.36% 9010.000 58.000 - -1.69% -
462.libquantum -98.81% 11614.000 138.000 - -0.72% -
482.sphinx3 -96.87% 29928.000 937.000 - -0.32% -
450.soplex -96.31% 15466.000 571.000 - -2.23% -
444.namd -91.92% 9050.000 731.000 - 0.69% -
453.povray -91.75% 6544.000 540.000 - -1.82% -
429.mcf -91.15% 17158.000 1518.000 - 0.13% -
433.milc -91.00% 12976.000 1168.000 - 0.34% -
436.cactusADM -87.97% 17544.000 2110.000 - -0.42% -
400.perlbench -84.76% 10650.000 1623.000 - 0.06% -
434.zeusmp -80.90% 13211.000 2523.000 - 0.12% -
401.bzip2 -80.47% 15185.000 2966.000 - -0.80% -
447.dealII -79.49% 9751.000 2000.000 - 0.55% -
459.GemsFDTD -73.72% 23356.000 6137.000 - 0.08% -
456.hmmer -73.47% 11046.000 2930.000 - -0.24% -
471.omnetpp -72.33% 10739.000 2972.000 - -2.17% -
470.lbm -70.65% 12819.000 3762.000 - 0.88% -
481.wrf -67.10% 16834.000 5539.000 - -0.70% -
483.xalancbmk -62.76% 11172.000 4161.000 - -2.37% -
473.astar -60.67% 14932.000 5873.000 - -1.31% -
464.h264ref -59.77% 14556.000 5856.000 - 0.05% -
410.bwaves -58.96% 14755.000 6055.000 - -0.15% -
445.gobmk -56.31% 11995.000 5241.000 - 0.15% -
435.gromacs -52.40% 15419.000 7339.000 - 2.24% -
458.sjeng -45.77% 14275.000 7742.000 - 0.23% -
416.gamess -45.22% 22704.000 12437.000 - 0.15% -
437.leslie3d -29.54% 15005.000 10573.000 - -0.09% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
454.calculix (max) -99.91% 1074.000 1.000 - 0.00% -
400.perlbench (unexplained diff vs previous) -99.72% 357.000 1.000 - -80.00% -
454.calculix -99.56% 459.000 2.000 - 0.00% -
454.calculix (avg) -99.56% 459.000 2.000 - 0.00% -
444.namd (unexplained diff vs previous) -99.29% 700.000 5.000 - 0.00% -
444.namd (max) -99.23% 649.000 5.000 - 25.00% -
433.milc (unexplained diff vs previous) -99.06% 425.000 4.000 - 100.00% -
434.zeusmp (unexplained diff vs previous) -99.03% 308.000 3.000 - 0.00% -
436.cactusADM (unexplained diff vs previous) -98.42% 570.000 9.000 - -59.09% -
482.sphinx3 (unexplained diff vs previous) -98.39% 186.000 3.000 - -50.00% -
400.perlbench (unexplained diff vs previous) (percentage) -98.21% 3.350 0.060 - -80.65% -
429.mcf (unexplained diff vs previous) -97.85% 93.000 2.000 - -84.62% -
462.libquantum (max) -97.30% 74.000 2.000 - 0.00% -
416.gamess (unexplained diff vs previous) -97.19% 676.000 19.000 - 11.76% -
436.cactusADM (max) -97.10% 552.000 16.000 - -38.46% -
437.leslie3d (unexplained diff vs previous) -97.08% 343.000 10.000 - -99.49% -
433.milc (max) -96.59% 411.000 14.000 - -6.67% -
416.gamess (max) -96.34% 656.000 24.000 - -7.69% -
437.leslie3d (unexplained diff vs previous) (percentage) -96.07% 2.290 0.090 - -99.52% -
462.libquantum -96.00% 75.000 3.000 - 0.00% -
462.libquantum (avg) -96.00% 75.000 3.000 - 0.00% -
450.soplex (unexplained diff vs previous) -95.82% 311.000 13.000 - 160.00% -
445.gobmk (unexplained diff vs previous) -95.70% 186.000 8.000 - -87.88% -
403.gcc (max) -95.31% 64.000 3.000 - 0.00% -
450.soplex (max) -95.07% 304.000 15.000 - -6.25% -
416.gamess (unexplained diff vs previous) (percentage) -94.97% 2.980 0.150 - 7.14% -
470.lbm (max) -94.95% 653.000 33.000 - 153.85% -
434.zeusmp (unexplained diff vs previous) (percentage) -94.85% 2.330 0.120 - 0.00% -
482.sphinx3 (max) -94.76% 439.000 23.000 - -8.00% -
453.povray (max) -94.55% 165.000 9.000 - -40.00% -
403.gcc -94.44% 54.000 3.000 - 0.00% -
403.gcc (avg) -94.44% 54.000 3.000 - 0.00% -
456.hmmer (max) -94.29% 140.000 8.000 - -11.11% -
444.namd -93.80% 355.000 22.000 - 0.00% -
444.namd (avg) -93.80% 355.000 22.000 - 0.00% -
434.zeusmp (max) -93.69% 301.000 19.000 - -5.00% -
482.sphinx3 -93.58% 436.000 28.000 - -3.45% -
482.sphinx3 (avg) -93.58% 436.000 28.000 - -3.45% -
416.gamess (max) (percentage) -93.08% 2.890 0.200 - -4.76% -
481.wrf (max) -92.45% 530.000 40.000 - -2.44% -
456.hmmer (unexplained diff vs previous) -91.57% 83.000 7.000 - -30.00% -
444.namd (unexplained diff vs previous) (percentage) -91.20% 7.730 0.680 - 0.00% -
444.namd (max) (percentage) -90.39% 7.180 0.690 - 23.21% -
471.omnetpp (max) -90.33% 662.000 64.000 - 10.34% -
445.gobmk (unexplained diff vs previous) (percentage) -90.32% 1.550 0.150 - -88.10% -
429.mcf (max) -90.22% 92.000 9.000 - -95.29% -
447.dealII (max) -89.72% 107.000 11.000 - 57.14% -
433.milc (unexplained diff vs previous) (percentage) -89.63% 3.280 0.340 - 100.00% -
459.GemsFDTD (unexplained diff vs previous) -89.58% 48.000 5.000 - -80.77% -
400.perlbench (max) -89.57% 345.000 36.000 - 0.00% -
450.soplex -87.43% 191.000 24.000 - -4.00% -
450.soplex (avg) -87.43% 191.000 24.000 - -4.00% -
436.cactusADM (unexplained diff vs previous) (percentage) -86.77% 3.250 0.430 - -58.65% -
447.dealII (unexplained diff vs previous) -85.53% 76.000 11.000 - 120.00% -
433.milc -85.00% 220.000 33.000 - -2.94% -
433.milc (avg) -85.00% 220.000 33.000 - -2.94% -
436.cactusADM -83.16% 291.000 49.000 - -3.92% -
436.cactusADM (avg) -83.16% 291.000 49.000 - -3.92% -
470.lbm (max) (percentage) -82.75% 5.100 0.880 - 151.43% -
401.bzip2 (unexplained diff vs previous) -81.82% 132.000 24.000 - 1100.00% -
453.povray -80.25% 81.000 16.000 - 0.00% -
453.povray (avg) -80.25% 81.000 16.000 - 0.00% -
464.h264ref (unexplained diff vs previous) -80.00% 15.000 3.000 - -81.25% -
456.hmmer (max) (percentage) -77.95% 1.270 0.280 - -17.65% -
481.wrf (max) (percentage) -76.83% 3.150 0.730 - -2.67% -
429.mcf (unexplained diff vs previous) (percentage) -75.93% 0.540 0.130 - -84.88% -
436.cactusADM (max) (percentage) -74.92% 3.150 0.790 - -36.80% -
470.lbm -72.28% 303.000 84.000 - 0.00% -
470.lbm (avg) -72.28% 303.000 84.000 - 0.00% -
464.h264ref (max) -70.97% 62.000 18.000 - -5.26% -
445.gobmk (max) -68.85% 183.000 57.000 - -17.39% -
434.zeusmp -68.21% 195.000 62.000 - -3.12% -
434.zeusmp (avg) -68.21% 195.000 62.000 - -3.12% -
456.hmmer (unexplained diff vs previous) (percentage) -68.00% 0.750 0.240 - -29.41% -
465.tonto (max) (percentage) -67.88% 3.580 1.150 - -0.86% -
434.zeusmp (max) (percentage) -65.79% 2.280 0.780 - -6.02% -
400.perlbench -65.38% 156.000 54.000 - -3.57% -
400.perlbench (avg) -65.38% 156.000 54.000 - -3.57% -
481.wrf (unexplained diff vs previous) -65.18% 112.000 39.000 - 5.41% -
471.omnetpp (max) (percentage) -64.83% 6.170 2.170 - 11.86% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -61.90% 0.210 0.080 - -80.95% -
433.milc (max) (percentage) -60.25% 3.170 1.260 - -6.67% -
454.calculix (unexplained diff vs previous) -60.00% 5.000 2.000 - 0.00% -
465.tonto (max) -57.34% 293.000 125.000 - -2.34% -
416.gamess -57.11% 492.000 211.000 - -3.21% -
416.gamess (avg) -57.11% 492.000 211.000 - -3.21% -
447.dealII -56.73% 104.000 45.000 - -2.17% -
447.dealII (avg) -56.73% 104.000 45.000 - -2.17% -
481.wrf -53.14% 318.000 149.000 - -3.25% -
481.wrf (avg) -53.14% 318.000 149.000 - -3.25% -
459.GemsFDTD (max) -50.71% 140.000 69.000 - -6.76% -
447.dealII (max) (percentage) -50.00% 1.100 0.550 - 41.03% -
464.h264ref (unexplained diff vs previous) (percentage) -50.00% 0.100 0.050 - -81.48% -
401.bzip2 (max) -49.62% 133.000 67.000 - -5.63% -
435.gromacs (unexplained diff vs previous) -49.37% 318.000 161.000 - 283.33% -
482.sphinx3 (unexplained diff vs previous) (percentage) -48.39% 0.620 0.320 - -50.00% -
471.omnetpp -42.94% 170.000 97.000 - -3.00% -
471.omnetpp (avg) -42.94% 170.000 97.000 - -3.00% -
410.bwaves (unexplained diff vs previous) -40.00% 15.000 9.000 - -67.86% -
456.hmmer -38.67% 75.000 46.000 - -2.13% -
456.hmmer (avg) -38.67% 75.000 46.000 - -2.13% -
435.gromacs (max) -35.37% 311.000 201.000 - -1.47% -
483.xalancbmk -33.78% 74.000 49.000 - -2.00% -
483.xalancbmk (avg) -33.78% 74.000 49.000 - -2.00% -
454.calculix (max) (percentage) -33.62% 4.700 3.120 - 20.93% -
410.bwaves (max) -33.33% 30.000 20.000 - -55.56% -
400.perlbench (max) (percentage) -31.48% 3.240 2.220 - -1.77% -
459.GemsFDTD -29.52% 210.000 148.000 - -2.63% -
459.GemsFDTD (avg) -29.52% 210.000 148.000 - -2.63% -
447.dealII (unexplained diff vs previous) (percentage) -29.49% 0.780 0.550 - 120.00% -
445.gobmk (max) (percentage) -28.76% 1.530 1.090 - -18.05% -
453.povray (max) (percentage) -28.06% 2.530 1.820 - -35.00% -
464.h264ref (max) (percentage) -27.91% 0.430 0.310 - -8.82% -
410.bwaves -25.62% 160.000 119.000 - -1.65% -
410.bwaves (avg) -25.62% 160.000 119.000 - -1.65% -
444.namd (avg) (percentage) -22.65% 3.930 3.040 - -1.94% -
458.sjeng (max) -22.58% 31.000 24.000 - -48.94% -
416.gamess (avg) (percentage) -21.66% 2.170 1.700 - -3.41% -
435.gromacs -20.68% 266.000 211.000 - 1.44% -
435.gromacs (avg) -20.68% 266.000 211.000 - 1.44% -
401.bzip2 (unexplained diff vs previous) (percentage) -6.90% 0.870 0.810 - 1057.14% -
470.lbm (avg) (percentage) -5.49% 2.370 2.240 - -1.32% -


Report Time: 0.39s
Name Current %
400.perlbench 1623.000 -
401.bzip2 2966.000 -
403.gcc 58.000 -1.69%
410.bwaves 6055.000 -
416.gamess 12437.000 -
429.mcf 1518.000 -
433.milc 1168.000 -
434.zeusmp 2523.000 -
435.gromacs 7339.000 2.24%
436.cactusADM 2110.000 -
437.leslie3d 10573.000 -
444.namd 731.000 -
445.gobmk 5241.000 -
447.dealII 2000.000 -
450.soplex 571.000 -2.23%
453.povray 540.000 -1.82%
454.calculix 62.000 -3.12%
456.hmmer 2930.000 -
458.sjeng 7742.000 -
459.GemsFDTD 6137.000 -
462.libquantum 138.000 -
464.h264ref 5856.000 -
465.tonto 10932.000 -1.03%
470.lbm 3762.000 -
471.omnetpp 2972.000 -2.17%
473.astar 5873.000 -1.31%
481.wrf 5539.000 -
482.sphinx3 937.000 -
483.xalancbmk 4161.000 -2.37%
Geometric Mean 2142.182 -
Name Current %
400.perlbench 929980.000 -
401.bzip2 49748.000 -
403.gcc 2678117.000 -
410.bwaves 17732.000 -
416.gamess 6246395.000 -
429.mcf 10951.000 -
433.milc 95822.000 -
434.zeusmp 165643.000 -
435.gromacs 678393.000 -
436.cactusADM 553198.000 -
437.leslie3d 65185.000 -
444.namd 190898.000 -
445.gobmk 1399583.000 -
447.dealII 2122473.000 -
450.soplex 260218.000 -
453.povray 712529.000 -
454.calculix 1272103.000 -
456.hmmer 231108.000 -
458.sjeng 111821.000 -
459.GemsFDTD 253069.000 -
462.libquantum 31329.000 -
464.h264ref 423816.000 -
465.tonto 2869577.000 -
470.lbm 10908.000 -
471.omnetpp 566590.000 -
473.astar 32056.000 -
481.wrf 2634840.000 -
482.sphinx3 152636.000 -
483.xalancbmk 3282904.000 -
Geometric Mean 296918.580 -
Name Current %
400.perlbench 54.000 -3.57%
400.perlbench (avg) 54.000 -3.57%
400.perlbench (avg) (percentage) 3.340 -4.02%
400.perlbench (max) 36.000 -
400.perlbench (max) (percentage) 2.220 -1.77%
400.perlbench (unexplained diff vs previous) 1.000 -80.00%
400.perlbench (unexplained diff vs previous) (percentage) 0.060 -80.65%
401.bzip2 74.000 -2.63%
401.bzip2 (avg) 74.000 -2.63%
401.bzip2 (avg) (percentage) 2.510 -1.95%
401.bzip2 (max) 67.000 -5.63%
401.bzip2 (max) (percentage) 2.260 -5.04%
401.bzip2 (unexplained diff vs previous) 24.000 1100.00%
401.bzip2 (unexplained diff vs previous) (percentage) 0.810 1057.14%
403.gcc 3.000 -
403.gcc (avg) 3.000 -
403.gcc (avg) (percentage) 5.440 -
403.gcc (max) 3.000 -
403.gcc (max) (percentage) 5.340 -
410.bwaves 119.000 -1.65%
410.bwaves (avg) 119.000 -1.65%
410.bwaves (avg) (percentage) 1.970 -1.99%
410.bwaves (max) 20.000 -55.56%
410.bwaves (max) (percentage) 0.340 -54.67%
410.bwaves (unexplained diff vs previous) 9.000 -67.86%
410.bwaves (unexplained diff vs previous) (percentage) 0.150 -67.39%
416.gamess 211.000 -3.21%
416.gamess (avg) 211.000 -3.21%
416.gamess (avg) (percentage) 1.700 -3.41%
416.gamess (max) 24.000 -7.69%
416.gamess (max) (percentage) 0.200 -
416.gamess (unexplained diff vs previous) 19.000 11.76%
416.gamess (unexplained diff vs previous) (percentage) 0.150 -
429.mcf 110.000 -2.65%
429.mcf (avg) 110.000 -2.65%
429.mcf (avg) (percentage) 7.300 -2.14%
429.mcf (max) 9.000 -95.29%
429.mcf (max) (percentage) 0.640 -94.93%
429.mcf (unexplained diff vs previous) 2.000 -84.62%
429.mcf (unexplained diff vs previous) (percentage) 0.130 -84.88%
433.milc 33.000 -2.94%
433.milc (avg) 33.000 -2.94%
433.milc (avg) (percentage) 2.890 -2.03%
433.milc (max) 14.000 -6.67%
433.milc (max) (percentage) 1.260 -6.67%
433.milc (unexplained diff vs previous) 4.000 100.00%
433.milc (unexplained diff vs previous) (percentage) 0.340 100.00%
434.zeusmp 62.000 -3.12%
434.zeusmp (avg) 62.000 -3.12%
434.zeusmp (avg) (percentage) 2.490 -2.35%
434.zeusmp (max) 19.000 -5.00%
434.zeusmp (max) (percentage) 0.780 -6.02%
434.zeusmp (unexplained diff vs previous) 3.000 -
434.zeusmp (unexplained diff vs previous) (percentage) 0.120 -
435.gromacs 211.000 1.44%
435.gromacs (avg) 211.000 1.44%
435.gromacs (avg) (percentage) 2.880 -
435.gromacs (max) 201.000 -1.47%
435.gromacs (max) (percentage) 2.740 -3.86%
435.gromacs (unexplained diff vs previous) 161.000 283.33%
435.gromacs (unexplained diff vs previous) (percentage) 2.190 271.19%
436.cactusADM 49.000 -3.92%
436.cactusADM (avg) 49.000 -3.92%
436.cactusADM (avg) (percentage) 2.360 -2.07%
436.cactusADM (max) 16.000 -38.46%
436.cactusADM (max) (percentage) 0.790 -36.80%
436.cactusADM (unexplained diff vs previous) 9.000 -59.09%
436.cactusADM (unexplained diff vs previous) (percentage) 0.430 -58.65%
437.leslie3d 490.000 -2.78%
437.leslie3d (avg) 490.000 -2.78%
437.leslie3d (avg) (percentage) 4.640 -2.73%
437.leslie3d (max) 1641.000 -8.63%
437.leslie3d (max) (percentage) 15.530 -8.54%
437.leslie3d (unexplained diff vs previous) 10.000 -99.49%
437.leslie3d (unexplained diff vs previous) (percentage) 0.090 -99.52%
444.namd 22.000 -
444.namd (avg) 22.000 -
444.namd (avg) (percentage) 3.040 -1.94%
444.namd (max) 5.000 25.00%
444.namd (max) (percentage) 0.690 23.21%
444.namd (unexplained diff vs previous) 5.000 -
444.namd (unexplained diff vs previous) (percentage) 0.680 -
445.gobmk 96.000 -3.03%
445.gobmk (avg) 96.000 -3.03%
445.gobmk (avg) (percentage) 1.850 -2.63%
445.gobmk (max) 57.000 -17.39%
445.gobmk (max) (percentage) 1.090 -18.05%
445.gobmk (unexplained diff vs previous) 8.000 -87.88%
445.gobmk (unexplained diff vs previous) (percentage) 0.150 -88.10%
447.dealII 45.000 -2.17%
447.dealII (avg) 45.000 -2.17%
447.dealII (avg) (percentage) 2.290 -2.55%
447.dealII (max) 11.000 57.14%
447.dealII (max) (percentage) 0.550 41.03%
447.dealII (unexplained diff vs previous) 11.000 120.00%
447.dealII (unexplained diff vs previous) (percentage) 0.550 120.00%
450.soplex 24.000 -4.00%
450.soplex (avg) 24.000 -4.00%
450.soplex (avg) (percentage) 4.280 -1.15%
450.soplex (max) 15.000 -6.25%
450.soplex (max) (percentage) 2.630 -4.01%
450.soplex (unexplained diff vs previous) 13.000 160.00%
450.soplex (unexplained diff vs previous) (percentage) 2.280 165.12%
453.povray 16.000 -
453.povray (avg) 16.000 -
453.povray (avg) (percentage) 2.990 -1.32%
453.povray (max) 9.000 -40.00%
453.povray (max) (percentage) 1.820 -35.00%
453.povray (unexplained diff vs previous) 10.000 -9.09%
453.povray (unexplained diff vs previous) (percentage) 1.850 -7.50%
454.calculix 2.000 -
454.calculix (avg) 2.000 -
454.calculix (avg) (percentage) 3.940 -
454.calculix (max) 1.000 -
454.calculix (max) (percentage) 3.120 20.93%
454.calculix (unexplained diff vs previous) 2.000 -
454.calculix (unexplained diff vs previous) (percentage) 3.230 -
456.hmmer 46.000 -2.13%
456.hmmer (avg) 46.000 -2.13%
456.hmmer (avg) (percentage) 1.590 -1.85%
456.hmmer (max) 8.000 -11.11%
456.hmmer (max) (percentage) 0.280 -17.65%
456.hmmer (unexplained diff vs previous) 7.000 -30.00%
456.hmmer (unexplained diff vs previous) (percentage) 0.240 -29.41%
458.sjeng 102.000 -2.86%
458.sjeng (avg) 102.000 -2.86%
458.sjeng (avg) (percentage) 1.330 -2.92%
458.sjeng (max) 24.000 -48.94%
458.sjeng (max) (percentage) 0.310 -50.00%
458.sjeng (unexplained diff vs previous) 18.000 -33.33%
458.sjeng (unexplained diff vs previous) (percentage) 0.230 -34.29%
459.GemsFDTD 148.000 -2.63%
459.GemsFDTD (avg) 148.000 -2.63%
459.GemsFDTD (avg) (percentage) 2.420 -2.42%
459.GemsFDTD (max) 69.000 -6.76%
459.GemsFDTD (max) (percentage) 1.140 -5.79%
459.GemsFDTD (unexplained diff vs previous) 5.000 -80.77%
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.080 -80.95%
462.libquantum 3.000 -
462.libquantum (avg) 3.000 -
462.libquantum (avg) (percentage) 2.620 -1.50%
462.libquantum (max) 2.000 -
462.libquantum (max) (percentage) 1.870 -6.03%
462.libquantum (unexplained diff vs previous) 1.000 -
462.libquantum (unexplained diff vs previous) (percentage) 0.720 -
464.h264ref 101.000 -2.88%
464.h264ref (avg) 101.000 -2.88%
464.h264ref (avg) (percentage) 1.730 -2.81%
464.h264ref (max) 18.000 -5.26%
464.h264ref (max) (percentage) 0.310 -8.82%
464.h264ref (unexplained diff vs previous) 3.000 -81.25%
464.h264ref (unexplained diff vs previous) (percentage) 0.050 -81.48%
465.tonto 219.000 -3.10%
465.tonto (avg) 219.000 -3.10%
465.tonto (avg) (percentage) 2.010 -1.95%
465.tonto (max) 125.000 -2.34%
465.tonto (max) (percentage) 1.150 -
465.tonto (unexplained diff vs previous) 114.000 192.31%
465.tonto (unexplained diff vs previous) (percentage) 1.040 197.14%
470.lbm 84.000 -
470.lbm (avg) 84.000 -
470.lbm (avg) (percentage) 2.240 -1.32%
470.lbm (max) 33.000 153.85%
470.lbm (max) (percentage) 0.880 151.43%
470.lbm (unexplained diff vs previous) 33.000 153.85%
470.lbm (unexplained diff vs previous) (percentage) 0.880 151.43%
471.omnetpp 97.000 -3.00%
471.omnetpp (avg) 97.000 -3.00%
471.omnetpp (avg) (percentage) 3.280 -
471.omnetpp (max) 64.000 10.34%
471.omnetpp (max) (percentage) 2.170 11.86%
471.omnetpp (unexplained diff vs previous) 66.000 40.43%
471.omnetpp (unexplained diff vs previous) (percentage) 2.220 43.23%
473.astar 136.000 -2.86%
473.astar (avg) 136.000 -2.86%
473.astar (avg) (percentage) 2.330 -1.27%
473.astar (max) 122.000 -7.58%
473.astar (max) (percentage) 2.090 -6.28%
473.astar (unexplained diff vs previous) 78.000 32.20%
473.astar (unexplained diff vs previous) (percentage) 1.330 34.34%
481.wrf 149.000 -3.25%
481.wrf (avg) 149.000 -3.25%
481.wrf (avg) (percentage) 2.700 -2.53%
481.wrf (max) 40.000 -2.44%
481.wrf (max) (percentage) 0.730 -2.67%
481.wrf (unexplained diff vs previous) 39.000 5.41%
481.wrf (unexplained diff vs previous) (percentage) 0.700 6.06%
482.sphinx3 28.000 -3.45%
482.sphinx3 (avg) 28.000 -3.45%
482.sphinx3 (avg) (percentage) 3.090 -2.22%
482.sphinx3 (max) 23.000 -8.00%
482.sphinx3 (max) (percentage) 2.520 -6.32%
482.sphinx3 (unexplained diff vs previous) 3.000 -50.00%
482.sphinx3 (unexplained diff vs previous) (percentage) 0.320 -50.00%
483.xalancbmk 49.000 -2.00%
483.xalancbmk (avg) 49.000 -2.00%
483.xalancbmk (avg) (percentage) 1.180 -
483.xalancbmk (max) 254.000 -2.68%
483.xalancbmk (max) (percentage) 6.120 -
Geometric Mean 7.404 5.58%