Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=a13886e2198beb78b81c59839043b021ce6df78a (+ 40 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/847f5addc4d07a2f3b95f5daa50ab4a64dfd957d (+ 84 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=7fe6734d28feb18acb3c50b13a5f5a52f66d39cf (+ 25 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=7c38e9d294b9de3d49422cf0f263f1779822956f (+ 112 commits)
test_url https://ci.linaro.org/job/tcwg_bmk_ci_gnu-build-tcwg_bmk_apm-gnu-master-aarch64-spec2k6-Os/297/
View Options
Report
Filter

gnu-aarch64-master-Os test results

Run Order Start Time Duration
Current 0297 (4-changed-components) 2022-10-02T22:47:42 0:00:00
Previous 0296 (4-changed-components) 2022-09-29T12:55:44 0:00:00
Baseline 0001 (3-changed-components) 2023-01-01T08:38:47 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 51 96
Performance Improvements 116 106
Added Tests 4 0
Unchanged Tests 1065 1034
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
482.sphinx3 (unexplained diff vs previous) (percentage) 4157.14% 0.070 2.980 - 380.65% -
482.sphinx3 (unexplained diff vs previous) 4047.62% 21.000 871.000 - 368.28% -
481.wrf (unexplained diff vs previous) (percentage) 1713.04% 0.230 4.170 - 522.39% -
481.wrf (unexplained diff vs previous) 1620.51% 39.000 671.000 - 499.11% -
436.cactusADM (unexplained diff vs previous) 557.14% 7.000 46.000 - -91.93% -
436.cactusADM (unexplained diff vs previous) (percentage) 550.00% 0.040 0.260 - -92.00% -
470.lbm (unexplained diff vs previous) (percentage) 446.00% 1.000 5.460 - 4863.64% -
470.lbm (unexplained diff vs previous) 416.28% 129.000 666.000 - 4657.14% -
462.libquantum (unexplained diff vs previous) 100.00% 31.000 62.000 - 6100.00% -
462.libquantum (unexplained diff vs previous) (percentage) 100.00% 0.270 0.540 - 5300.00% -
482.sphinx3 (max) (percentage) 88.89% 1.530 2.890 - 96.60% -
482.sphinx3 (max) 83.48% 460.000 844.000 - 92.26% -
470.lbm (max) (percentage) 79.86% 2.880 5.180 - 1.57% -
470.lbm (max) 70.81% 370.000 632.000 - -3.22% -
473.astar (unexplained diff vs previous) 50.00% 12.000 18.000 - 500.00% -
473.astar (unexplained diff vs previous) (percentage) 50.00% 0.080 0.120 - 500.00% -
447.dealII (unexplained diff vs previous) (percentage) 45.90% 0.610 0.890 - 14.10% -
447.dealII (unexplained diff vs previous) 45.76% 59.000 86.000 - 13.16% -
483.xalancbmk (max) 44.83% 58.000 84.000 - 86.67% -
483.xalancbmk (max) (percentage) 42.00% 0.500 0.710 - 73.17% -
458.sjeng (max) 32.97% 91.000 121.000 - 290.32% -
458.sjeng (max) (percentage) 31.75% 0.630 0.830 - 277.27% -
481.wrf (max) (percentage) 30.29% 3.070 4.000 - 26.98% -
458.sjeng (unexplained diff vs previous) 30.11% 93.000 121.000 - 1244.44% -
458.sjeng (unexplained diff vs previous) (percentage) 28.12% 0.640 0.820 - 1266.67% -
481.wrf (max) 25.05% 515.000 644.000 - 21.51% -
434.zeusmp (unexplained diff vs previous) (percentage) 21.05% 0.380 0.460 - -80.26% -
434.zeusmp (unexplained diff vs previous) 19.61% 51.000 61.000 - -80.19% -
465.tonto (unexplained diff vs previous) (percentage) 18.30% 2.240 2.650 - 244.16% -
465.tonto (unexplained diff vs previous) 15.59% 186.000 215.000 - 241.27% -
481.wrf (avg) (percentage) 14.94% 1.740 2.000 - 5.82% -
465.tonto (avg) (percentage) 12.88% 1.320 1.490 - -10.78% -
465.tonto (max) (percentage) 12.66% 2.290 2.580 - -27.93% -
483.xalancbmk 11.90% 42.000 47.000 - -36.49% -
483.xalancbmk (avg) 11.90% 42.000 47.000 - -36.49% -
483.xalancbmk (avg) (percentage) 11.11% 0.360 0.400 - -40.30% -
481.wrf 10.65% 291.000 322.000 - 1.26% -
481.wrf (avg) 10.65% 291.000 322.000 - 1.26% -
465.tonto 10.09% 109.000 120.000 - -12.41% -
465.tonto (avg) 10.09% 109.000 120.000 - -12.41% -
465.tonto (max) 10.00% 190.000 209.000 - -28.67% -
482.sphinx3 (avg) (percentage) 9.09% 1.430 1.560 - 6.85% -
458.sjeng 7.35% 68.000 73.000 - 55.32% -
458.sjeng (avg) 7.35% 68.000 73.000 - 55.32% -
470.lbm (avg) (percentage) 6.76% 2.810 3.000 - 26.58% -
458.sjeng (avg) (percentage) 6.38% 0.470 0.500 - 51.52% -
473.astar (max) 6.25% 16.000 17.000 - -15.00% -
482.sphinx3 5.81% 430.000 455.000 - 4.36% -
482.sphinx3 (avg) 5.81% 430.000 455.000 - 4.36% -
470.lbm 1.39% 361.000 366.000 - 20.79% -
470.lbm (avg) 1.39% 361.000 366.000 - 20.79% -

Performance Improvements - Code Size Δ Previous Current σ Δ (B) σ (B)
453.povray -1.14% 717264.000 709076.000 - -0.01% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
470.lbm -5.18% 12869.000 12203.000 - -4.81% -
454.calculix -4.37% 22472.000 21490.000 - -5.99% -
456.hmmer -4.36% 11196.000 10708.000 - -3.06% -
481.wrf -4.00% 16779.000 16108.000 - -4.31% -
482.sphinx3 -2.89% 30089.000 29218.000 - -2.37% -
465.tonto -2.58% 8318.000 8103.000 - -1.24% -
453.povray -2.58% 6467.000 6300.000 - -3.73% -
437.leslie3d -1.70% 14217.000 13976.000 - -6.86% -
410.bwaves -1.25% 14941.000 14754.000 - -0.01% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
433.milc (unexplained diff vs previous) -67.39% 46.000 15.000 - -96.47% -
433.milc (unexplained diff vs previous) (percentage) -65.71% 0.350 0.120 - -96.34% -
471.omnetpp (unexplained diff vs previous) (percentage) -52.63% 0.760 0.360 - 50.00% -
471.omnetpp (unexplained diff vs previous) -51.85% 81.000 39.000 - 50.00% -
459.GemsFDTD (max) (percentage) -39.80% 0.980 0.590 - -1.67% -
459.GemsFDTD (max) -39.74% 229.000 138.000 - -1.43% -
410.bwaves (unexplained diff vs previous) -35.96% 292.000 187.000 - 1146.67% -
410.bwaves (unexplained diff vs previous) (percentage) -34.87% 1.950 1.270 - 1170.00% -
444.namd (unexplained diff vs previous) (percentage) -25.53% 0.470 0.350 - -95.47% -
444.namd (unexplained diff vs previous) -23.81% 42.000 32.000 - -95.43% -
450.soplex (unexplained diff vs previous) (percentage) -17.65% 0.340 0.280 - -86.07% -
410.bwaves (max) -17.48% 286.000 236.000 - 686.67% -
471.omnetpp (max) -17.28% 81.000 67.000 - -89.88% -
471.omnetpp (max) (percentage) -17.11% 0.760 0.630 - -89.79% -
410.bwaves (max) (percentage) -16.67% 1.920 1.600 - 661.90% -
450.soplex (unexplained diff vs previous) -15.38% 52.000 44.000 - -85.85% -
429.mcf (unexplained diff vs previous) -10.94% 64.000 57.000 - -38.71% -
429.mcf (unexplained diff vs previous) (percentage) -10.81% 0.370 0.330 - -38.89% -
433.milc (max) -10.09% 317.000 285.000 - -30.66% -
433.milc (max) (percentage) -9.88% 2.430 2.190 - -30.91% -
435.gromacs (max) -9.78% 317.000 286.000 - -8.04% -
435.gromacs (max) (percentage) -9.62% 2.080 1.880 - -6.93% -
454.calculix (max) -9.28% 862.000 782.000 - -27.19% -
429.mcf (max) -9.28% 97.000 88.000 - -4.35% -
429.mcf (max) (percentage) -8.77% 0.570 0.520 - -3.70% -
401.bzip2 -8.57% 105.000 96.000 - 45.45% -
401.bzip2 (avg) -8.57% 105.000 96.000 - 45.45% -
401.bzip2 (avg) (percentage) -8.57% 0.700 0.640 - 45.45% -
456.hmmer (max) -8.49% 106.000 97.000 - -30.71% -
444.namd (avg) (percentage) -8.20% 3.660 3.360 - -14.50% -
401.bzip2 (max) (percentage) -8.16% 0.490 0.450 - -48.86% -
401.bzip2 (max) -8.11% 74.000 68.000 - -48.87% -
444.namd -7.90% 329.000 303.000 - -14.65% -
444.namd (avg) -7.90% 329.000 303.000 - -14.65% -
433.milc -7.87% 254.000 234.000 - 6.36% -
433.milc (avg) -7.87% 254.000 234.000 - 6.36% -
436.cactusADM -7.76% 348.000 321.000 - 10.31% -
436.cactusADM (avg) -7.76% 348.000 321.000 - 10.31% -
433.milc (avg) (percentage) -7.69% 1.950 1.800 - 5.88% -
436.cactusADM (avg) (percentage) -7.58% 1.980 1.830 - 10.24% -
403.gcc (max) -7.41% 27.000 25.000 - -60.94% -
450.soplex -7.30% 178.000 165.000 - -13.61% -
450.soplex (avg) -7.30% 178.000 165.000 - -13.61% -
453.povray (max) -7.10% 169.000 157.000 - -4.85% -
445.gobmk (max) (percentage) -7.09% 1.270 1.180 - -22.88% -
450.soplex (avg) (percentage) -6.96% 1.150 1.070 - -13.71% -
429.mcf -6.94% 245.000 228.000 - 153.33% -
429.mcf (avg) -6.94% 245.000 228.000 - 153.33% -
434.zeusmp -6.72% 238.000 222.000 - 13.85% -
434.zeusmp (avg) -6.72% 238.000 222.000 - 13.85% -
403.gcc (max) (percentage) -6.67% 0.300 0.280 - -61.11% -
445.gobmk (max) -6.58% 152.000 142.000 - -22.40% -
444.namd (max) (percentage) -6.48% 6.640 6.210 - -13.51% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -6.35% 0.630 0.590 - 180.95% -
429.mcf (avg) (percentage) -6.29% 1.430 1.340 - 152.83% -
444.namd (max) -6.19% 598.000 561.000 - -13.56% -
434.zeusmp (avg) (percentage) -6.15% 1.790 1.680 - 13.51% -
471.omnetpp (avg) (percentage) -6.13% 1.630 1.530 - -3.77% -
459.GemsFDTD (unexplained diff vs previous) -6.12% 147.000 138.000 - 187.50% -
436.cactusADM (max) -5.93% 472.000 444.000 - -19.57% -
471.omnetpp -5.75% 174.000 164.000 - -3.53% -
471.omnetpp (avg) -5.75% 174.000 164.000 - -3.53% -
436.cactusADM (max) (percentage) -5.60% 2.680 2.530 - -19.68% -
462.libquantum -5.38% 130.000 123.000 - 64.00% -
462.libquantum (avg) -5.38% 130.000 123.000 - 64.00% -
447.dealII (max) -5.26% 171.000 162.000 - 51.40% -
454.calculix (max) (percentage) -5.21% 3.840 3.640 - -22.55% -
450.soplex (max) -4.94% 263.000 250.000 - -17.76% -
473.astar -4.92% 61.000 58.000 - 107.14% -
473.astar (avg) -4.92% 61.000 58.000 - 107.14% -
473.astar (avg) (percentage) -4.88% 0.410 0.390 - 105.26% -
434.zeusmp (max) -4.81% 291.000 277.000 - -7.97% -
462.libquantum (max) -4.76% 84.000 80.000 - 8.11% -
400.perlbench (max) (percentage) -4.71% 0.850 0.810 - -75.00% -
450.soplex (max) (percentage) -4.71% 1.700 1.620 - -17.77% -
459.GemsFDTD (avg) (percentage) -4.65% 1.290 1.230 - 36.67% -
453.povray (max) (percentage) -4.58% 2.620 2.500 - -1.19% -
434.zeusmp (max) (percentage) -4.57% 2.190 2.090 - -8.33% -
454.calculix -4.51% 510.000 487.000 - 6.10% -
454.calculix (avg) -4.51% 510.000 487.000 - 6.10% -
462.libquantum (avg) (percentage) -4.46% 1.120 1.070 - 64.62% -
400.perlbench (max) -4.40% 91.000 87.000 - -74.78% -
456.hmmer -4.29% 70.000 67.000 - -10.67% -
456.hmmer (avg) -4.29% 70.000 67.000 - -10.67% -
456.hmmer (max) (percentage) -4.21% 0.950 0.910 - -28.35% -
464.h264ref (max) -4.17% 48.000 46.000 - -25.81% -
462.libquantum (max) (percentage) -4.11% 0.730 0.700 - 9.37% -
459.GemsFDTD -3.99% 301.000 289.000 - 37.62% -
459.GemsFDTD (avg) -3.99% 301.000 289.000 - 37.62% -
447.dealII (max) (percentage) -3.98% 1.760 1.690 - 53.64% -
416.gamess (max) -3.46% 722.000 697.000 - 6.25% -
416.gamess (max) (percentage) -3.43% 3.210 3.100 - 7.27% -
453.povray -3.30% 91.000 88.000 - 8.64% -
453.povray (avg) -3.30% 91.000 88.000 - 8.64% -
464.h264ref (max) (percentage) -3.03% 0.330 0.320 - -25.58% -
447.dealII -2.91% 103.000 100.000 - -3.85% -
447.dealII (avg) -2.91% 103.000 100.000 - -3.85% -
410.bwaves -2.71% 221.000 215.000 - 34.38% -
410.bwaves (avg) -2.71% 221.000 215.000 - 34.38% -
403.gcc -2.13% 47.000 46.000 - -14.81% -
403.gcc (avg) -2.13% 47.000 46.000 - -14.81% -
447.dealII (avg) (percentage) -1.89% 1.060 1.040 - -2.80% -
437.leslie3d (max) -1.64% 244.000 240.000 - -31.62% -
437.leslie3d -1.45% 207.000 204.000 - -42.86% -
437.leslie3d (avg) -1.45% 207.000 204.000 - -42.86% -
410.bwaves (avg) (percentage) -1.35% 1.480 1.460 - 33.94% -

Added Tests - sample variability
401.bzip2 (unexplained diff vs previous)
401.bzip2 (unexplained diff vs previous) (percentage)
483.xalancbmk (unexplained diff vs previous)
483.xalancbmk (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
450.soplex 2.59% 260647.000 267397.000 - 0.00% -
400.perlbench 2.12% 930652.000 950364.000 - 0.43% -
459.GemsFDTD 1.31% 253716.000 257028.000 - 0.00% -
471.omnetpp 1.15% 566534.000 573038.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
483.xalancbmk 6.03% 11172.000 11846.000 - 0.71% -
458.sjeng 2.80% 14275.000 14674.000 - 0.83% -
400.perlbench 1.36% 10650.000 10795.000 - 0.19% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
462.libquantum (unexplained diff vs previous) 6100.00% 1.000 62.000 - 100.00% -
462.libquantum (unexplained diff vs previous) (percentage) 5300.00% 0.010 0.540 - 100.00% -
470.lbm (unexplained diff vs previous) (percentage) 4863.64% 0.110 5.460 - 446.00% -
470.lbm (unexplained diff vs previous) 4657.14% 14.000 666.000 - 416.28% -
458.sjeng (unexplained diff vs previous) (percentage) 1266.67% 0.060 0.820 - 28.12% -
458.sjeng (unexplained diff vs previous) 1244.44% 9.000 121.000 - 30.11% -
410.bwaves (unexplained diff vs previous) (percentage) 1170.00% 0.100 1.270 - -34.87% -
410.bwaves (unexplained diff vs previous) 1146.67% 15.000 187.000 - -35.96% -
410.bwaves (max) 686.67% 30.000 236.000 - -17.48% -
410.bwaves (max) (percentage) 661.90% 0.210 1.600 - -16.67% -
481.wrf (unexplained diff vs previous) (percentage) 522.39% 0.670 4.170 - 1713.04% -
473.astar (unexplained diff vs previous) 500.00% 3.000 18.000 - 50.00% -
473.astar (unexplained diff vs previous) (percentage) 500.00% 0.020 0.120 - 50.00% -
481.wrf (unexplained diff vs previous) 499.11% 112.000 671.000 - 1620.51% -
482.sphinx3 (unexplained diff vs previous) (percentage) 380.65% 0.620 2.980 - 4157.14% -
482.sphinx3 (unexplained diff vs previous) 368.28% 186.000 871.000 - 4047.62% -
458.sjeng (max) 290.32% 31.000 121.000 - 32.97% -
458.sjeng (max) (percentage) 277.27% 0.220 0.830 - 31.75% -
465.tonto (unexplained diff vs previous) (percentage) 244.16% 0.770 2.650 - 18.30% -
465.tonto (unexplained diff vs previous) 241.27% 63.000 215.000 - 15.59% -
459.GemsFDTD (unexplained diff vs previous) 187.50% 48.000 138.000 - -6.12% -
459.GemsFDTD (unexplained diff vs previous) (percentage) 180.95% 0.210 0.590 - -6.35% -
429.mcf 153.33% 90.000 228.000 - -6.94% -
429.mcf (avg) 153.33% 90.000 228.000 - -6.94% -
429.mcf (avg) (percentage) 152.83% 0.530 1.340 - -6.29% -
473.astar 107.14% 28.000 58.000 - -4.92% -
473.astar (avg) 107.14% 28.000 58.000 - -4.92% -
473.astar (avg) (percentage) 105.26% 0.190 0.390 - -4.88% -
482.sphinx3 (max) (percentage) 96.60% 1.470 2.890 - 88.89% -
482.sphinx3 (max) 92.26% 439.000 844.000 - 83.48% -
464.h264ref 87.18% 78.000 146.000 - 0.00% -
464.h264ref (avg) 87.18% 78.000 146.000 - 0.00% -
483.xalancbmk (max) 86.67% 45.000 84.000 - 44.83% -
464.h264ref (avg) (percentage) 85.19% 0.540 1.000 - 0.00% -
483.xalancbmk (unexplained diff vs previous) 82.61% 46.000 84.000 - 0.00% -
483.xalancbmk (max) (percentage) 73.17% 0.410 0.710 - 42.00% -
483.xalancbmk (unexplained diff vs previous) (percentage) 73.17% 0.410 0.710 - 0.00% -
462.libquantum (avg) (percentage) 64.62% 0.650 1.070 - -4.46% -
462.libquantum 64.00% 75.000 123.000 - -5.38% -
462.libquantum (avg) 64.00% 75.000 123.000 - -5.38% -
458.sjeng 55.32% 47.000 73.000 - 7.35% -
458.sjeng (avg) 55.32% 47.000 73.000 - 7.35% -
447.dealII (max) (percentage) 53.64% 1.100 1.690 - -3.98% -
458.sjeng (avg) (percentage) 51.52% 0.330 0.500 - 6.38% -
447.dealII (max) 51.40% 107.000 162.000 - -5.26% -
471.omnetpp (unexplained diff vs previous) 50.00% 26.000 39.000 - -51.85% -
471.omnetpp (unexplained diff vs previous) (percentage) 50.00% 0.240 0.360 - -52.63% -
401.bzip2 (avg) (percentage) 45.45% 0.440 0.640 - -8.57% -
401.bzip2 45.45% 66.000 96.000 - -8.57% -
401.bzip2 (avg) 45.45% 66.000 96.000 - -8.57% -
459.GemsFDTD 37.62% 210.000 289.000 - -3.99% -
459.GemsFDTD (avg) 37.62% 210.000 289.000 - -3.99% -
459.GemsFDTD (avg) (percentage) 36.67% 0.900 1.230 - -4.65% -
410.bwaves 34.38% 160.000 215.000 - -2.71% -
410.bwaves (avg) 34.38% 160.000 215.000 - -2.71% -
410.bwaves (avg) (percentage) 33.94% 1.090 1.460 - -1.35% -
481.wrf (max) (percentage) 26.98% 3.150 4.000 - 30.29% -
470.lbm (avg) (percentage) 26.58% 2.370 3.000 - 6.76% -
481.wrf (max) 21.51% 530.000 644.000 - 25.05% -
470.lbm 20.79% 303.000 366.000 - 1.39% -
470.lbm (avg) 20.79% 303.000 366.000 - 1.39% -
447.dealII (unexplained diff vs previous) (percentage) 14.10% 0.780 0.890 - 45.90% -
434.zeusmp 13.85% 195.000 222.000 - -6.72% -
434.zeusmp (avg) 13.85% 195.000 222.000 - -6.72% -
434.zeusmp (avg) (percentage) 13.51% 1.480 1.680 - -6.15% -
447.dealII (unexplained diff vs previous) 13.16% 76.000 86.000 - 45.76% -
454.calculix (avg) (percentage) 12.94% 2.010 2.270 - 0.00% -
453.povray (avg) (percentage) 12.80% 1.250 1.410 - 0.00% -
436.cactusADM 10.31% 291.000 321.000 - -7.76% -
436.cactusADM (avg) 10.31% 291.000 321.000 - -7.76% -
436.cactusADM (avg) (percentage) 10.24% 1.660 1.830 - -7.58% -
462.libquantum (max) (percentage) 9.37% 0.640 0.700 - -4.11% -
453.povray 8.64% 81.000 88.000 - -3.30% -
453.povray (avg) 8.64% 81.000 88.000 - -3.30% -
462.libquantum (max) 8.11% 74.000 80.000 - -4.76% -
416.gamess (max) (percentage) 7.27% 2.890 3.100 - -3.43% -
482.sphinx3 (avg) (percentage) 6.85% 1.460 1.560 - 9.09% -
433.milc 6.36% 220.000 234.000 - -7.87% -
433.milc (avg) 6.36% 220.000 234.000 - -7.87% -
416.gamess (max) 6.25% 656.000 697.000 - -3.46% -
454.calculix 6.10% 459.000 487.000 - -4.51% -
454.calculix (avg) 6.10% 459.000 487.000 - -4.51% -
433.milc (avg) (percentage) 5.88% 1.700 1.800 - -7.69% -
481.wrf (avg) (percentage) 5.82% 1.890 2.000 - 14.94% -
482.sphinx3 4.36% 436.000 455.000 - 5.81% -
482.sphinx3 (avg) 4.36% 436.000 455.000 - 5.81% -
470.lbm (max) (percentage) 1.57% 5.100 5.180 - 79.86% -
481.wrf 1.26% 318.000 322.000 - 10.65% -
481.wrf (avg) 1.26% 318.000 322.000 - 10.65% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
458.sjeng -3.34% 120221.000 116201.000 - 0.00% -
464.h264ref -1.08% 428364.000 423752.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d -6.86% 15005.000 13976.000 - -1.70% -
454.calculix -5.99% 22860.000 21490.000 - -4.37% -
470.lbm -4.81% 12819.000 12203.000 - -5.18% -
481.wrf -4.31% 16834.000 16108.000 - -4.00% -
453.povray -3.73% 6544.000 6300.000 - -2.58% -
456.hmmer -3.06% 11046.000 10708.000 - -4.36% -
482.sphinx3 -2.37% 29928.000 29218.000 - -2.89% -
465.tonto -1.24% 8205.000 8103.000 - -2.58% -
447.dealII -1.14% 9751.000 9640.000 - -0.88% -
435.gromacs -1.13% 15419.000 15244.000 - -0.07% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
433.milc (unexplained diff vs previous) -96.47% 425.000 15.000 - -67.39% -
433.milc (unexplained diff vs previous) (percentage) -96.34% 3.280 0.120 - -65.71% -
444.namd (unexplained diff vs previous) (percentage) -95.47% 7.730 0.350 - -25.53% -
444.namd (unexplained diff vs previous) -95.43% 700.000 32.000 - -23.81% -
401.bzip2 (unexplained diff vs previous) -93.18% 132.000 9.000 - 0.00% -
401.bzip2 (unexplained diff vs previous) (percentage) -93.10% 0.870 0.060 - 0.00% -
436.cactusADM (unexplained diff vs previous) (percentage) -92.00% 3.250 0.260 - 550.00% -
436.cactusADM (unexplained diff vs previous) -91.93% 570.000 46.000 - 557.14% -
471.omnetpp (max) -89.88% 662.000 67.000 - -17.28% -
471.omnetpp (max) (percentage) -89.79% 6.170 0.630 - -17.11% -
450.soplex (unexplained diff vs previous) (percentage) -86.07% 2.010 0.280 - -17.65% -
450.soplex (unexplained diff vs previous) -85.85% 311.000 44.000 - -15.38% -
434.zeusmp (unexplained diff vs previous) (percentage) -80.26% 2.330 0.460 - 21.05% -
434.zeusmp (unexplained diff vs previous) -80.19% 308.000 61.000 - 19.61% -
400.perlbench (max) (percentage) -75.00% 3.240 0.810 - -4.71% -
400.perlbench (max) -74.78% 345.000 87.000 - -4.40% -
403.gcc (max) (percentage) -61.11% 0.720 0.280 - -6.67% -
403.gcc (max) -60.94% 64.000 25.000 - -7.41% -
401.bzip2 (max) -48.87% 133.000 68.000 - -8.11% -
401.bzip2 (max) (percentage) -48.86% 0.880 0.450 - -8.16% -
437.leslie3d -42.86% 357.000 204.000 - -1.45% -
437.leslie3d (avg) -42.86% 357.000 204.000 - -1.45% -
483.xalancbmk (avg) (percentage) -40.30% 0.670 0.400 - 11.11% -
429.mcf (unexplained diff vs previous) (percentage) -38.89% 0.540 0.330 - -10.81% -
429.mcf (unexplained diff vs previous) -38.71% 93.000 57.000 - -10.94% -
437.leslie3d (avg) (percentage) -38.66% 2.380 1.460 - 0.00% -
483.xalancbmk -36.49% 74.000 47.000 - 11.90% -
483.xalancbmk (avg) -36.49% 74.000 47.000 - 11.90% -
437.leslie3d (max) -31.62% 351.000 240.000 - -1.64% -
433.milc (max) (percentage) -30.91% 3.170 2.190 - -9.88% -
456.hmmer (max) -30.71% 140.000 97.000 - -8.49% -
433.milc (max) -30.66% 411.000 285.000 - -10.09% -
465.tonto (max) -28.67% 293.000 209.000 - 10.00% -
456.hmmer (max) (percentage) -28.35% 1.270 0.910 - -4.21% -
465.tonto (max) (percentage) -27.93% 3.580 2.580 - 12.66% -
454.calculix (max) -27.19% 1074.000 782.000 - -9.28% -
437.leslie3d (max) (percentage) -26.50% 2.340 1.720 - 0.00% -
464.h264ref (max) -25.81% 62.000 46.000 - -4.17% -
464.h264ref (max) (percentage) -25.58% 0.430 0.320 - -3.03% -
445.gobmk (max) (percentage) -22.88% 1.530 1.180 - -7.09% -
454.calculix (max) (percentage) -22.55% 4.700 3.640 - -5.21% -
445.gobmk (max) -22.40% 183.000 142.000 - -6.58% -
416.gamess -21.34% 492.000 387.000 - 0.00% -
416.gamess (avg) -21.34% 492.000 387.000 - 0.00% -
416.gamess (avg) (percentage) -20.74% 2.170 1.720 - 0.00% -
436.cactusADM (max) (percentage) -19.68% 3.150 2.530 - -5.60% -
436.cactusADM (max) -19.57% 552.000 444.000 - -5.93% -
450.soplex (max) (percentage) -17.77% 1.970 1.620 - -4.71% -
450.soplex (max) -17.76% 304.000 250.000 - -4.94% -
400.perlbench (avg) (percentage) -16.33% 1.470 1.230 - 0.00% -
400.perlbench -15.38% 156.000 132.000 - 0.00% -
400.perlbench (avg) -15.38% 156.000 132.000 - 0.00% -
473.astar (max) -15.00% 20.000 17.000 - 6.25% -
403.gcc -14.81% 54.000 46.000 - -2.13% -
403.gcc (avg) -14.81% 54.000 46.000 - -2.13% -
403.gcc (avg) (percentage) -14.75% 0.610 0.520 - 0.00% -
444.namd -14.65% 355.000 303.000 - -7.90% -
444.namd (avg) -14.65% 355.000 303.000 - -7.90% -
444.namd (avg) (percentage) -14.50% 3.930 3.360 - -8.20% -
473.astar (max) (percentage) -14.29% 0.140 0.120 - 9.09% -
445.gobmk (avg) (percentage) -14.29% 0.770 0.660 - 0.00% -
445.gobmk -14.13% 92.000 79.000 - 0.00% -
445.gobmk (avg) -14.13% 92.000 79.000 - 0.00% -
450.soplex (avg) (percentage) -13.71% 1.240 1.070 - -6.96% -
450.soplex -13.61% 191.000 165.000 - -7.30% -
450.soplex (avg) -13.61% 191.000 165.000 - -7.30% -
444.namd (max) -13.56% 649.000 561.000 - -6.19% -
444.namd (max) (percentage) -13.51% 7.180 6.210 - -6.48% -
465.tonto -12.41% 137.000 120.000 - 10.09% -
465.tonto (avg) -12.41% 137.000 120.000 - 10.09% -
465.tonto (avg) (percentage) -10.78% 1.670 1.490 - 12.88% -
456.hmmer -10.67% 75.000 67.000 - -4.29% -
456.hmmer (avg) -10.67% 75.000 67.000 - -4.29% -
434.zeusmp (max) (percentage) -8.33% 2.280 2.090 - -4.57% -
435.gromacs (max) -8.04% 311.000 286.000 - -9.78% -
434.zeusmp (max) -7.97% 301.000 277.000 - -4.81% -
456.hmmer (avg) (percentage) -7.35% 0.680 0.630 - 0.00% -
435.gromacs (max) (percentage) -6.93% 2.020 1.880 - -9.62% -
435.gromacs -6.02% 266.000 250.000 - 0.00% -
435.gromacs (avg) -6.02% 266.000 250.000 - 0.00% -
435.gromacs (avg) (percentage) -5.20% 1.730 1.640 - 0.00% -
453.povray (max) -4.85% 165.000 157.000 - -7.10% -
429.mcf (max) -4.35% 92.000 88.000 - -9.28% -
447.dealII -3.85% 104.000 100.000 - -2.91% -
447.dealII (avg) -3.85% 104.000 100.000 - -2.91% -
471.omnetpp (avg) (percentage) -3.77% 1.590 1.530 - -6.13% -
429.mcf (max) (percentage) -3.70% 0.540 0.520 - -8.77% -
471.omnetpp -3.53% 170.000 164.000 - -5.75% -
471.omnetpp (avg) -3.53% 170.000 164.000 - -5.75% -
470.lbm (max) -3.22% 653.000 632.000 - 70.81% -
447.dealII (avg) (percentage) -2.80% 1.070 1.040 - -1.89% -
459.GemsFDTD (max) (percentage) -1.67% 0.600 0.590 - -39.80% -
459.GemsFDTD (max) -1.43% 140.000 138.000 - -39.74% -
453.povray (max) (percentage) -1.19% 2.530 2.500 - -4.58% -

Report Time: 0.40s
Execution (seconds)
Name Current %
400.perlbench 10795.000 -
401.bzip2 15112.000 -
403.gcc 9036.000 -
410.bwaves 14754.000 -1.25%
416.gamess 22513.000 -
429.mcf 17089.000 -
433.milc 13037.000 -
434.zeusmp 13259.000 -
435.gromacs 15244.000 -
436.cactusADM 17579.000 -
437.leslie3d 13976.000 -1.70%
444.namd 9041.000 -
445.gobmk 12048.000 -
447.dealII 9640.000 -
450.soplex 15460.000 -
453.povray 6300.000 -2.58%
454.calculix 21490.000 -4.37%
456.hmmer 10708.000 -4.36%
458.sjeng 14674.000 -
459.GemsFDTD 23540.000 -
462.libquantum 11549.000 -
464.h264ref 14629.000 -
465.tonto 8103.000 -2.58%
470.lbm 12203.000 -5.18%
471.omnetpp 10721.000 -
473.astar 14899.000 -
481.wrf 16108.000 -4.00%
482.sphinx3 29218.000 -2.89%
483.xalancbmk 11846.000 -
Geometric Mean 13539.344 -1.03%
Code Size (bytes)
Name Current %
400.perlbench 950364.000 -
401.bzip2 49872.000 -
403.gcc 2684647.000 -
410.bwaves 17880.000 -
416.gamess 6253503.000 -
429.mcf 10951.000 -
433.milc 95813.000 -
434.zeusmp 165607.000 -
435.gromacs 678589.000 -
436.cactusADM 553550.000 -
437.leslie3d 64945.000 -
444.namd 190967.000 -
445.gobmk 1403543.000 -
447.dealII 2113507.000 -
450.soplex 267397.000 -
453.povray 709076.000 -1.14%
454.calculix 1272194.000 -
456.hmmer 231177.000 -
458.sjeng 116201.000 -
459.GemsFDTD 257028.000 -
462.libquantum 31291.000 -
464.h264ref 423752.000 -
465.tonto 2870136.000 -
470.lbm 10932.000 -
471.omnetpp 573038.000 -
473.astar 32132.000 -
481.wrf 2635405.000 -
482.sphinx3 152767.000 -
483.xalancbmk 3286446.000 -
Geometric Mean 298205.986 -
sample variability
Name Current %
400.perlbench 132.000 -
400.perlbench (avg) 132.000 -
400.perlbench (avg) (percentage) 1.230 -
400.perlbench (max) 87.000 -4.40%
400.perlbench (max) (percentage) 0.810 -4.71%
401.bzip2 96.000 -8.57%
401.bzip2 (avg) 96.000 -8.57%
401.bzip2 (avg) (percentage) 0.640 -8.57%
401.bzip2 (max) 68.000 -8.11%
401.bzip2 (max) (percentage) 0.450 -8.16%
401.bzip2 (unexplained diff vs previous) 9.000 -
401.bzip2 (unexplained diff vs previous) (percentage) 0.060 -
403.gcc 46.000 -2.13%
403.gcc (avg) 46.000 -2.13%
403.gcc (avg) (percentage) 0.520 -
403.gcc (max) 25.000 -7.41%
403.gcc (max) (percentage) 0.280 -6.67%
410.bwaves 215.000 -2.71%
410.bwaves (avg) 215.000 -2.71%
410.bwaves (avg) (percentage) 1.460 -1.35%
410.bwaves (max) 236.000 -17.48%
410.bwaves (max) (percentage) 1.600 -16.67%
410.bwaves (unexplained diff vs previous) 187.000 -35.96%
410.bwaves (unexplained diff vs previous) (percentage) 1.270 -34.87%
416.gamess 387.000 -
416.gamess (avg) 387.000 -
416.gamess (avg) (percentage) 1.720 -
416.gamess (max) 697.000 -3.46%
416.gamess (max) (percentage) 3.100 -3.43%
429.mcf 228.000 -6.94%
429.mcf (avg) 228.000 -6.94%
429.mcf (avg) (percentage) 1.340 -6.29%
429.mcf (max) 88.000 -9.28%
429.mcf (max) (percentage) 0.520 -8.77%
429.mcf (unexplained diff vs previous) 57.000 -10.94%
429.mcf (unexplained diff vs previous) (percentage) 0.330 -10.81%
433.milc 234.000 -7.87%
433.milc (avg) 234.000 -7.87%
433.milc (avg) (percentage) 1.800 -7.69%
433.milc (max) 285.000 -10.09%
433.milc (max) (percentage) 2.190 -9.88%
433.milc (unexplained diff vs previous) 15.000 -67.39%
433.milc (unexplained diff vs previous) (percentage) 0.120 -65.71%
434.zeusmp 222.000 -6.72%
434.zeusmp (avg) 222.000 -6.72%
434.zeusmp (avg) (percentage) 1.680 -6.15%
434.zeusmp (max) 277.000 -4.81%
434.zeusmp (max) (percentage) 2.090 -4.57%
434.zeusmp (unexplained diff vs previous) 61.000 19.61%
434.zeusmp (unexplained diff vs previous) (percentage) 0.460 21.05%
435.gromacs 250.000 -
435.gromacs (avg) 250.000 -
435.gromacs (avg) (percentage) 1.640 -
435.gromacs (max) 286.000 -9.78%
435.gromacs (max) (percentage) 1.880 -9.62%
436.cactusADM 321.000 -7.76%
436.cactusADM (avg) 321.000 -7.76%
436.cactusADM (avg) (percentage) 1.830 -7.58%
436.cactusADM (max) 444.000 -5.93%
436.cactusADM (max) (percentage) 2.530 -5.60%
436.cactusADM (unexplained diff vs previous) 46.000 557.14%
436.cactusADM (unexplained diff vs previous) (percentage) 0.260 550.00%
437.leslie3d 204.000 -1.45%
437.leslie3d (avg) 204.000 -1.45%
437.leslie3d (avg) (percentage) 1.460 -
437.leslie3d (max) 240.000 -1.64%
437.leslie3d (max) (percentage) 1.720 -
444.namd 303.000 -7.90%
444.namd (avg) 303.000 -7.90%
444.namd (avg) (percentage) 3.360 -8.20%
444.namd (max) 561.000 -6.19%
444.namd (max) (percentage) 6.210 -6.48%
444.namd (unexplained diff vs previous) 32.000 -23.81%
444.namd (unexplained diff vs previous) (percentage) 0.350 -25.53%
445.gobmk 79.000 -
445.gobmk (avg) 79.000 -
445.gobmk (avg) (percentage) 0.660 -
445.gobmk (max) 142.000 -6.58%
445.gobmk (max) (percentage) 1.180 -7.09%
447.dealII 100.000 -2.91%
447.dealII (avg) 100.000 -2.91%
447.dealII (avg) (percentage) 1.040 -1.89%
447.dealII (max) 162.000 -5.26%
447.dealII (max) (percentage) 1.690 -3.98%
447.dealII (unexplained diff vs previous) 86.000 45.76%
447.dealII (unexplained diff vs previous) (percentage) 0.890 45.90%
450.soplex 165.000 -7.30%
450.soplex (avg) 165.000 -7.30%
450.soplex (avg) (percentage) 1.070 -6.96%
450.soplex (max) 250.000 -4.94%
450.soplex (max) (percentage) 1.620 -4.71%
450.soplex (unexplained diff vs previous) 44.000 -15.38%
450.soplex (unexplained diff vs previous) (percentage) 0.280 -17.65%
453.povray 88.000 -3.30%
453.povray (avg) 88.000 -3.30%
453.povray (avg) (percentage) 1.410 -
453.povray (max) 157.000 -7.10%
453.povray (max) (percentage) 2.500 -4.58%
454.calculix 487.000 -4.51%
454.calculix (avg) 487.000 -4.51%
454.calculix (avg) (percentage) 2.270 -
454.calculix (max) 782.000 -9.28%
454.calculix (max) (percentage) 3.640 -5.21%
456.hmmer 67.000 -4.29%
456.hmmer (avg) 67.000 -4.29%
456.hmmer (avg) (percentage) 0.630 -
456.hmmer (max) 97.000 -8.49%
456.hmmer (max) (percentage) 0.910 -4.21%
458.sjeng 73.000 7.35%
458.sjeng (avg) 73.000 7.35%
458.sjeng (avg) (percentage) 0.500 6.38%
458.sjeng (max) 121.000 32.97%
458.sjeng (max) (percentage) 0.830 31.75%
458.sjeng (unexplained diff vs previous) 121.000 30.11%
458.sjeng (unexplained diff vs previous) (percentage) 0.820 28.12%
459.GemsFDTD 289.000 -3.99%
459.GemsFDTD (avg) 289.000 -3.99%
459.GemsFDTD (avg) (percentage) 1.230 -4.65%
459.GemsFDTD (max) 138.000 -39.74%
459.GemsFDTD (max) (percentage) 0.590 -39.80%
459.GemsFDTD (unexplained diff vs previous) 138.000 -6.12%
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.590 -6.35%
462.libquantum 123.000 -5.38%
462.libquantum (avg) 123.000 -5.38%
462.libquantum (avg) (percentage) 1.070 -4.46%
462.libquantum (max) 80.000 -4.76%
462.libquantum (max) (percentage) 0.700 -4.11%
462.libquantum (unexplained diff vs previous) 62.000 100.00%
462.libquantum (unexplained diff vs previous) (percentage) 0.540 100.00%
464.h264ref 146.000 -
464.h264ref (avg) 146.000 -
464.h264ref (avg) (percentage) 1.000 -
464.h264ref (max) 46.000 -4.17%
464.h264ref (max) (percentage) 0.320 -3.03%
465.tonto 120.000 10.09%
465.tonto (avg) 120.000 10.09%
465.tonto (avg) (percentage) 1.490 12.88%
465.tonto (max) 209.000 10.00%
465.tonto (max) (percentage) 2.580 12.66%
465.tonto (unexplained diff vs previous) 215.000 15.59%
465.tonto (unexplained diff vs previous) (percentage) 2.650 18.30%
470.lbm 366.000 1.39%
470.lbm (avg) 366.000 1.39%
470.lbm (avg) (percentage) 3.000 6.76%
470.lbm (max) 632.000 70.81%
470.lbm (max) (percentage) 5.180 79.86%
470.lbm (unexplained diff vs previous) 666.000 416.28%
470.lbm (unexplained diff vs previous) (percentage) 5.460 446.00%
471.omnetpp 164.000 -5.75%
471.omnetpp (avg) 164.000 -5.75%
471.omnetpp (avg) (percentage) 1.530 -6.13%
471.omnetpp (max) 67.000 -17.28%
471.omnetpp (max) (percentage) 0.630 -17.11%
471.omnetpp (unexplained diff vs previous) 39.000 -51.85%
471.omnetpp (unexplained diff vs previous) (percentage) 0.360 -52.63%
473.astar 58.000 -4.92%
473.astar (avg) 58.000 -4.92%
473.astar (avg) (percentage) 0.390 -4.88%
473.astar (max) 17.000 6.25%
473.astar (max) (percentage) 0.120 -
473.astar (unexplained diff vs previous) 18.000 50.00%
473.astar (unexplained diff vs previous) (percentage) 0.120 50.00%
481.wrf 322.000 10.65%
481.wrf (avg) 322.000 10.65%
481.wrf (avg) (percentage) 2.000 14.94%
481.wrf (max) 644.000 25.05%
481.wrf (max) (percentage) 4.000 30.29%
481.wrf (unexplained diff vs previous) 671.000 1620.51%
481.wrf (unexplained diff vs previous) (percentage) 4.170 1713.04%
482.sphinx3 455.000 5.81%
482.sphinx3 (avg) 455.000 5.81%
482.sphinx3 (avg) (percentage) 1.560 9.09%
482.sphinx3 (max) 844.000 83.48%
482.sphinx3 (max) (percentage) 2.890 88.89%
482.sphinx3 (unexplained diff vs previous) 871.000 4047.62%
482.sphinx3 (unexplained diff vs previous) (percentage) 2.980 4157.14%
483.xalancbmk 47.000 11.90%
483.xalancbmk (avg) 47.000 11.90%
483.xalancbmk (avg) (percentage) 0.400 11.11%
483.xalancbmk (max) 84.000 44.83%
483.xalancbmk (max) (percentage) 0.710 42.00%
483.xalancbmk (unexplained diff vs previous) 84.000 -
483.xalancbmk (unexplained diff vs previous) (percentage) 0.710 -
Geometric Mean 18.198 5.53%