Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=d59a54c2c350ba65c65dde5e2a8976918ac59046 (unchanged)
git_gcc https://github.com/gcc-mirror/gcc/commit/6c136d53e89e32fe9d22e41e5df89c08d3470049 (+ 53 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=f465b21b06a17e26c1af7d75603afc481ebce0f6 (unchanged)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=1026c1155e7fa777e6e74cbd8e602d46ae491a75 (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk_ci_gnu-build-tcwg_bmk_apm-gnu-master-aarch64-spec2k6-Os/271/
View Options
Report
Filter

gnu-aarch64-master-Os test results

Run Order Start Time Duration
Current 0271 (basepoints/gcc-13-02097-g6c136d53e89e) 2022-08-18T07:14:54 0:00:00
Previous 0270 (basepoints/gcc-13-02044-ge236d671d460) 2022-08-18T07:09:44 0:00:00
Baseline 0001 (3-changed-components) 2023-01-01T08:38:47 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 24 63
Performance Improvements 141 156
Added Tests 11 5
Unchanged Tests 1060 1012
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
473.astar (unexplained diff vs previous) (percentage) 300.00% 0.010 0.040 - 100.00% -
473.astar (unexplained diff vs previous) 250.00% 2.000 7.000 - 133.33% -
445.gobmk (max) 200.00% 16.000 48.000 - -73.77% -
445.gobmk (unexplained diff vs previous) 200.00% 16.000 48.000 - -74.19% -
445.gobmk (unexplained diff vs previous) (percentage) 200.00% 0.130 0.390 - -74.84% -
445.gobmk (max) (percentage) 185.71% 0.140 0.400 - -73.86% -
437.leslie3d (unexplained diff vs previous) (percentage) 128.57% 0.630 1.440 - -37.12% -
437.leslie3d (unexplained diff vs previous) 125.29% 87.000 196.000 - -42.86% -
462.libquantum (unexplained diff vs previous) (percentage) 114.29% 0.070 0.150 - 1400.00% -
462.libquantum (unexplained diff vs previous) 110.00% 10.000 21.000 - 2000.00% -
447.dealII (unexplained diff vs previous) (percentage) 93.75% 0.800 1.550 - 98.72% -
447.dealII (unexplained diff vs previous) 92.21% 77.000 148.000 - 94.74% -
447.dealII (avg) (percentage) 30.00% 0.700 0.910 - -14.95% -
447.dealII 28.36% 67.000 86.000 - -17.31% -
447.dealII (avg) 28.36% 67.000 86.000 - -17.31% -
445.gobmk 17.24% 29.000 34.000 - -63.04% -
445.gobmk (avg) 17.24% 29.000 34.000 - -63.04% -
445.gobmk (avg) (percentage) 16.67% 0.240 0.280 - -63.64% -
458.sjeng 8.33% 24.000 26.000 - -44.68% -
458.sjeng (avg) 8.33% 24.000 26.000 - -44.68% -
458.sjeng (avg) (percentage) 6.25% 0.160 0.170 - -48.48% -
456.hmmer (avg) (percentage) 6.17% 0.810 0.860 - 26.47% -
456.hmmer 4.71% 85.000 89.000 - 18.67% -
456.hmmer (avg) 4.71% 85.000 89.000 - 18.67% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
447.dealII -1.53% 9674.000 9526.000 - -2.31% -
437.leslie3d -1.42% 13813.000 13617.000 - -9.25% -
456.hmmer -1.02% 10557.000 10449.000 - -5.40% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
482.sphinx3 (unexplained diff vs previous) (percentage) -99.51% 2.030 0.010 - -98.39% -
482.sphinx3 (unexplained diff vs previous) -99.46% 557.000 3.000 - -98.39% -
433.milc (unexplained diff vs previous) (percentage) -98.94% 2.840 0.030 - -99.09% -
433.milc (unexplained diff vs previous) -98.87% 355.000 4.000 - -99.06% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -98.75% 4.010 0.050 - -76.19% -
459.GemsFDTD (unexplained diff vs previous) -98.71% 851.000 11.000 - -77.08% -
436.cactusADM (unexplained diff vs previous) (percentage) -98.67% 3.750 0.050 - -98.46% -
436.cactusADM (unexplained diff vs previous) -98.54% 687.000 10.000 - -98.25% -
434.zeusmp (unexplained diff vs previous) -98.32% 476.000 8.000 - -97.40% -
434.zeusmp (unexplained diff vs previous) (percentage) -98.25% 3.430 0.060 - -97.42% -
470.lbm (unexplained diff vs previous) -96.96% 460.000 14.000 - 0.00% -
470.lbm (unexplained diff vs previous) (percentage) -96.92% 3.250 0.100 - -9.09% -
435.gromacs (unexplained diff vs previous) (percentage) -90.44% 2.720 0.260 - -87.38% -
435.gromacs (unexplained diff vs previous) -90.31% 382.000 37.000 - -88.36% -
410.bwaves (unexplained diff vs previous) (percentage) -89.13% 1.380 0.150 - 50.00% -
410.bwaves (unexplained diff vs previous) -89.11% 202.000 22.000 - 46.67% -
454.calculix (unexplained diff vs previous) -85.71% 7.000 1.000 - -80.00% -
471.omnetpp (unexplained diff vs previous) (percentage) -82.14% 0.280 0.050 - -79.17% -
471.omnetpp (unexplained diff vs previous) -81.58% 38.000 7.000 - -73.08% -
450.soplex (unexplained diff vs previous) (percentage) -75.00% 0.200 0.050 - -97.51% -
450.soplex (unexplained diff vs previous) -73.33% 30.000 8.000 - -97.43% -
453.povray (unexplained diff vs previous) (percentage) -68.18% 0.220 0.070 - 250.00% -
453.povray (unexplained diff vs previous) -66.67% 15.000 5.000 - 400.00% -
471.omnetpp (max) -53.12% 96.000 45.000 - -93.20% -
471.omnetpp (max) (percentage) -52.78% 0.720 0.340 - -94.49% -
401.bzip2 (unexplained diff vs previous) -45.33% 75.000 41.000 - -68.94% -
401.bzip2 (unexplained diff vs previous) (percentage) -45.28% 0.530 0.290 - -66.67% -
464.h264ref (avg) (percentage) -39.53% 0.430 0.260 - -51.85% -
464.h264ref -39.29% 56.000 34.000 - -56.41% -
464.h264ref (avg) -39.29% 56.000 34.000 - -56.41% -
444.namd (unexplained diff vs previous) -38.36% 73.000 45.000 - -93.57% -
456.hmmer (unexplained diff vs previous) -38.29% 175.000 108.000 - 30.12% -
444.namd (unexplained diff vs previous) (percentage) -37.97% 0.790 0.490 - -93.66% -
456.hmmer (unexplained diff vs previous) (percentage) -37.95% 1.660 1.030 - 37.33% -
481.wrf -35.17% 472.000 306.000 - -3.77% -
481.wrf (avg) -35.17% 472.000 306.000 - -3.77% -
481.wrf (avg) (percentage) -34.98% 2.630 1.710 - -9.52% -
465.tonto -34.03% 144.000 95.000 - -30.66% -
465.tonto (avg) -34.03% 144.000 95.000 - -30.66% -
465.tonto (avg) (percentage) -33.77% 1.510 1.000 - -40.12% -
453.povray (max) (percentage) -27.07% 1.810 1.320 - -47.83% -
453.povray (max) -26.61% 124.000 91.000 - -44.85% -
454.calculix -25.45% 165.000 123.000 - -73.20% -
454.calculix (avg) -25.45% 165.000 123.000 - -73.20% -
454.calculix (avg) (percentage) -25.32% 0.790 0.590 - -70.65% -
454.calculix (max) -24.93% 710.000 533.000 - -50.37% -
454.calculix (max) (percentage) -24.85% 3.380 2.540 - -45.96% -
482.sphinx3 -24.69% 490.000 369.000 - -15.37% -
482.sphinx3 (avg) -24.69% 490.000 369.000 - -15.37% -
436.cactusADM -24.65% 357.000 269.000 - -7.56% -
436.cactusADM (avg) -24.65% 357.000 269.000 - -7.56% -
436.cactusADM (avg) (percentage) -24.62% 1.950 1.470 - -11.45% -
482.sphinx3 (avg) (percentage) -24.58% 1.790 1.350 - -7.53% -
429.mcf -24.55% 167.000 126.000 - 40.00% -
429.mcf (avg) -24.55% 167.000 126.000 - 40.00% -
434.zeusmp -24.49% 245.000 185.000 - -5.13% -
434.zeusmp (avg) -24.49% 245.000 185.000 - -5.13% -
429.mcf (avg) (percentage) -24.39% 0.820 0.620 - 16.98% -
459.GemsFDTD -24.36% 431.000 326.000 - 55.24% -
459.GemsFDTD (avg) -24.36% 431.000 326.000 - 55.24% -
434.zeusmp (avg) (percentage) -24.29% 1.770 1.340 - -9.46% -
433.milc -24.19% 186.000 141.000 - -35.91% -
433.milc (avg) -24.19% 186.000 141.000 - -35.91% -
433.milc (avg) (percentage) -24.16% 1.490 1.130 - -33.53% -
459.GemsFDTD (avg) (percentage) -24.14% 2.030 1.540 - 71.11% -
470.lbm -24.00% 325.000 247.000 - -18.48% -
470.lbm (avg) -24.00% 325.000 247.000 - -18.48% -
470.lbm (avg) (percentage) -23.91% 2.300 1.750 - -26.16% -
410.bwaves -22.70% 185.000 143.000 - -10.62% -
410.bwaves (avg) -22.70% 185.000 143.000 - -10.62% -
471.omnetpp (avg) (percentage) -22.22% 0.450 0.350 - -77.99% -
410.bwaves (avg) (percentage) -22.22% 1.260 0.980 - -10.09% -
450.soplex (avg) (percentage) -22.00% 0.500 0.390 - -68.55% -
450.soplex -21.92% 73.000 57.000 - -70.16% -
450.soplex (avg) -21.92% 73.000 57.000 - -70.16% -
471.omnetpp -21.67% 60.000 47.000 - -72.35% -
471.omnetpp (avg) -21.67% 60.000 47.000 - -72.35% -
453.povray (avg) (percentage) -21.15% 0.520 0.410 - -67.20% -
435.gromacs (avg) (percentage) -20.57% 1.410 1.120 - -35.26% -
435.gromacs -20.30% 197.000 157.000 - -40.98% -
435.gromacs (avg) -20.30% 197.000 157.000 - -40.98% -
453.povray -20.00% 35.000 28.000 - -65.43% -
453.povray (avg) -20.00% 35.000 28.000 - -65.43% -
444.namd -18.83% 154.000 125.000 - -64.79% -
444.namd (avg) -18.83% 154.000 125.000 - -64.79% -
465.tonto (max) -18.54% 151.000 123.000 - -58.02% -
465.tonto (max) (percentage) -18.24% 1.590 1.300 - -63.69% -
444.namd (avg) (percentage) -18.07% 1.660 1.360 - -65.39% -
433.milc (max) -16.81% 345.000 287.000 - -30.17% -
433.milc (max) (percentage) -16.67% 2.760 2.300 - -27.44% -
459.GemsFDTD (max) -16.65% 817.000 681.000 - 386.43% -
459.GemsFDTD (max) (percentage) -16.62% 3.850 3.210 - 435.00% -
481.wrf (max) -13.02% 553.000 481.000 - -9.25% -
410.bwaves (max) -12.75% 204.000 178.000 - 493.33% -
481.wrf (max) (percentage) -12.66% 3.080 2.690 - -14.60% -
470.lbm (max) -12.63% 475.000 415.000 - -36.45% -
470.lbm (max) (percentage) -12.50% 3.360 2.940 - -42.35% -
435.gromacs (max) (percentage) -12.45% 2.650 2.320 - 14.85% -
435.gromacs (max) -12.37% 372.000 326.000 - 4.82% -
410.bwaves (max) (percentage) -12.23% 1.390 1.220 - 480.95% -
456.hmmer (max) -11.24% 178.000 158.000 - 12.86% -
444.namd (max) -10.39% 77.000 69.000 - -89.37% -
429.mcf (max) -10.37% 299.000 268.000 - 191.30% -
401.bzip2 (avg) (percentage) -10.20% 0.490 0.440 - 0.00% -
429.mcf (max) (percentage) -10.20% 1.470 1.320 - 144.44% -
401.bzip2 -10.14% 69.000 62.000 - -6.06% -
401.bzip2 (avg) -10.14% 69.000 62.000 - -6.06% -
456.hmmer (max) (percentage) -10.06% 1.690 1.520 - 19.69% -
434.zeusmp (max) -10.00% 460.000 414.000 - 37.54% -
436.cactusADM (max) (percentage) -9.97% 3.610 3.250 - 3.17% -
434.zeusmp (max) (percentage) -9.94% 3.320 2.990 - 31.14% -
436.cactusADM (max) -9.83% 661.000 596.000 - 7.97% -
444.namd (max) (percentage) -9.64% 0.830 0.750 - -89.55% -
401.bzip2 (max) (percentage) -8.82% 0.680 0.620 - -29.55% -
482.sphinx3 (max) (percentage) -8.71% 2.410 2.200 - 49.66% -
482.sphinx3 (max) -8.65% 659.000 602.000 - 37.13% -
401.bzip2 (max) -8.33% 96.000 88.000 - -33.83% -
403.gcc (max) -8.33% 24.000 22.000 - -65.62% -
437.leslie3d (max) -7.92% 240.000 221.000 - -37.04% -
462.libquantum (max) -7.41% 27.000 25.000 - -66.22% -
403.gcc (max) (percentage) -7.14% 0.280 0.260 - -63.89% -
400.perlbench (max) (percentage) -6.48% 2.160 2.020 - -37.65% -
416.gamess (max) -6.45% 605.000 566.000 - -13.72% -
450.soplex (max) (percentage) -6.38% 0.470 0.440 - -77.66% -
437.leslie3d (max) (percentage) -6.32% 1.740 1.630 - -30.34% -
416.gamess (max) (percentage) -6.30% 2.700 2.530 - -12.46% -
483.xalancbmk (max) (percentage) -6.25% 0.640 0.600 - 46.34% -
483.xalancbmk (max) -5.95% 84.000 79.000 - 75.56% -
450.soplex (max) -5.80% 69.000 65.000 - -78.62% -
400.perlbench (max) -5.63% 231.000 218.000 - -36.81% -
464.h264ref (max) -5.48% 73.000 69.000 - 11.29% -
464.h264ref (max) (percentage) -5.36% 0.560 0.530 - 23.26% -
462.libquantum (max) (percentage) -5.00% 0.200 0.190 - -70.31% -
447.dealII (max) -3.33% 150.000 145.000 - 35.51% -
437.leslie3d -3.30% 212.000 205.000 - -42.58% -
437.leslie3d (avg) -3.30% 212.000 205.000 - -42.58% -
437.leslie3d (avg) (percentage) -1.95% 1.540 1.510 - -36.55% -
447.dealII (max) (percentage) -1.92% 1.560 1.530 - 39.09% -

Added Tests - sample variability
429.mcf (unexplained diff vs previous)
429.mcf (unexplained diff vs previous) (percentage)
454.calculix (unexplained diff vs previous) (percentage)
458.sjeng (unexplained diff vs previous)
458.sjeng (unexplained diff vs previous) (percentage)
464.h264ref (unexplained diff vs previous)
464.h264ref (unexplained diff vs previous) (percentage)
465.tonto (unexplained diff vs previous)
465.tonto (unexplained diff vs previous) (percentage)
481.wrf (unexplained diff vs previous)
481.wrf (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
450.soplex 2.60% 260647.000 267429.000 - 0.00% -
459.GemsFDTD 1.29% 253716.000 256984.000 - 0.00% -
471.omnetpp 1.15% 566534.000 573038.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
471.omnetpp 25.24% 10739.000 13449.000 - -0.05% -
429.mcf 18.77% 17158.000 20378.000 - 0.00% -
483.xalancbmk 18.35% 11172.000 13222.000 - 0.11% -
462.libquantum 17.75% 11614.000 13675.000 - 0.15% -
465.tonto 16.21% 8205.000 9535.000 - -0.19% -
470.lbm 10.25% 12819.000 14133.000 - -0.10% -
458.sjeng 7.51% 14275.000 15347.000 - 0.19% -
481.wrf 6.40% 16834.000 17911.000 - -0.26% -
473.astar 5.71% 14932.000 15784.000 - -0.04% -
453.povray 5.58% 6544.000 6909.000 - 0.07% -
434.zeusmp 4.85% 13211.000 13852.000 - -0.06% -
436.cactusADM 4.57% 17544.000 18345.000 - 0.05% -
444.namd 2.19% 9050.000 9248.000 - -0.48% -
445.gobmk 1.40% 11995.000 12163.000 - 0.40% -
400.perlbench 1.38% 10650.000 10797.000 - 0.82% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
462.libquantum (unexplained diff vs previous) 2000.00% 1.000 21.000 - 110.00% -
462.libquantum (unexplained diff vs previous) (percentage) 1400.00% 0.010 0.150 - 114.29% -
410.bwaves (max) 493.33% 30.000 178.000 - -12.75% -
410.bwaves (max) (percentage) 480.95% 0.210 1.220 - -12.23% -
459.GemsFDTD (max) (percentage) 435.00% 0.600 3.210 - -16.62% -
453.povray (unexplained diff vs previous) 400.00% 1.000 5.000 - -66.67% -
459.GemsFDTD (max) 386.43% 140.000 681.000 - -16.65% -
453.povray (unexplained diff vs previous) (percentage) 250.00% 0.020 0.070 - -68.18% -
458.sjeng (unexplained diff vs previous) 222.22% 9.000 29.000 - 0.00% -
458.sjeng (unexplained diff vs previous) (percentage) 216.67% 0.060 0.190 - 0.00% -
429.mcf (max) 191.30% 92.000 268.000 - -10.37% -
429.mcf (max) (percentage) 144.44% 0.540 1.320 - -10.20% -
473.astar (unexplained diff vs previous) 133.33% 3.000 7.000 - 250.00% -
473.astar (unexplained diff vs previous) (percentage) 100.00% 0.020 0.040 - 300.00% -
447.dealII (unexplained diff vs previous) (percentage) 98.72% 0.780 1.550 - 93.75% -
447.dealII (unexplained diff vs previous) 94.74% 76.000 148.000 - 92.21% -
483.xalancbmk (max) 75.56% 45.000 79.000 - -5.95% -
459.GemsFDTD (avg) (percentage) 71.11% 0.900 1.540 - -24.14% -
459.GemsFDTD 55.24% 210.000 326.000 - -24.36% -
459.GemsFDTD (avg) 55.24% 210.000 326.000 - -24.36% -
410.bwaves (unexplained diff vs previous) (percentage) 50.00% 0.100 0.150 - -89.13% -
482.sphinx3 (max) (percentage) 49.66% 1.470 2.200 - -8.71% -
410.bwaves (unexplained diff vs previous) 46.67% 15.000 22.000 - -89.11% -
483.xalancbmk (max) (percentage) 46.34% 0.410 0.600 - -6.25% -
429.mcf 40.00% 90.000 126.000 - -24.55% -
429.mcf (avg) 40.00% 90.000 126.000 - -24.55% -
447.dealII (max) (percentage) 39.09% 1.100 1.530 - -1.92% -
434.zeusmp (max) 37.54% 301.000 414.000 - -10.00% -
456.hmmer (unexplained diff vs previous) (percentage) 37.33% 0.750 1.030 - -37.95% -
482.sphinx3 (max) 37.13% 439.000 602.000 - -8.65% -
447.dealII (max) 35.51% 107.000 145.000 - -3.33% -
434.zeusmp (max) (percentage) 31.14% 2.280 2.990 - -9.94% -
456.hmmer (unexplained diff vs previous) 30.12% 83.000 108.000 - -38.29% -
456.hmmer (avg) (percentage) 26.47% 0.680 0.860 - 6.17% -
464.h264ref (max) (percentage) 23.26% 0.430 0.530 - -5.36% -
456.hmmer (max) (percentage) 19.69% 1.270 1.520 - -10.06% -
456.hmmer 18.67% 75.000 89.000 - 4.71% -
456.hmmer (avg) 18.67% 75.000 89.000 - 4.71% -
429.mcf (avg) (percentage) 16.98% 0.530 0.620 - -24.39% -
435.gromacs (max) (percentage) 14.85% 2.020 2.320 - -12.45% -
456.hmmer (max) 12.86% 140.000 158.000 - -11.24% -
464.h264ref (max) 11.29% 62.000 69.000 - -5.48% -
436.cactusADM (max) 7.97% 552.000 596.000 - -9.83% -
435.gromacs (max) 4.82% 311.000 326.000 - -12.37% -
436.cactusADM (max) (percentage) 3.17% 3.150 3.250 - -9.97% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
458.sjeng -6.76% 120221.000 112097.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
464.h264ref -9.54% 14556.000 13167.000 - 0.00% -
437.leslie3d -9.25% 15005.000 13617.000 - -1.42% -
459.GemsFDTD -9.12% 23356.000 21227.000 - -0.05% -
435.gromacs -8.72% 15419.000 14075.000 - 0.26% -
482.sphinx3 -8.51% 29928.000 27382.000 - 0.01% -
454.calculix -8.10% 22860.000 21008.000 - -0.00% -
401.bzip2 -6.13% 15185.000 14254.000 - 0.29% -
456.hmmer -5.40% 11046.000 10449.000 - -1.02% -
450.soplex -4.30% 15466.000 14801.000 - 0.05% -
433.milc -3.68% 12976.000 12498.000 - -0.03% -
403.gcc -3.19% 9010.000 8723.000 - 0.32% -
447.dealII -2.31% 9751.000 9526.000 - -1.53% -
416.gamess -1.43% 22704.000 22379.000 - -0.26% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
433.milc (unexplained diff vs previous) (percentage) -99.09% 3.280 0.030 - -98.94% -
433.milc (unexplained diff vs previous) -99.06% 425.000 4.000 - -98.87% -
436.cactusADM (unexplained diff vs previous) (percentage) -98.46% 3.250 0.050 - -98.67% -
482.sphinx3 (unexplained diff vs previous) -98.39% 186.000 3.000 - -99.46% -
482.sphinx3 (unexplained diff vs previous) (percentage) -98.39% 0.620 0.010 - -99.51% -
436.cactusADM (unexplained diff vs previous) -98.25% 570.000 10.000 - -98.54% -
450.soplex (unexplained diff vs previous) (percentage) -97.51% 2.010 0.050 - -75.00% -
450.soplex (unexplained diff vs previous) -97.43% 311.000 8.000 - -73.33% -
434.zeusmp (unexplained diff vs previous) (percentage) -97.42% 2.330 0.060 - -98.25% -
434.zeusmp (unexplained diff vs previous) -97.40% 308.000 8.000 - -98.32% -
471.omnetpp (max) (percentage) -94.49% 6.170 0.340 - -52.78% -
444.namd (unexplained diff vs previous) (percentage) -93.66% 7.730 0.490 - -37.97% -
444.namd (unexplained diff vs previous) -93.57% 700.000 45.000 - -38.36% -
471.omnetpp (max) -93.20% 662.000 45.000 - -53.12% -
444.namd (max) (percentage) -89.55% 7.180 0.750 - -9.64% -
444.namd (max) -89.37% 649.000 69.000 - -10.39% -
435.gromacs (unexplained diff vs previous) -88.36% 318.000 37.000 - -90.31% -
435.gromacs (unexplained diff vs previous) (percentage) -87.38% 2.060 0.260 - -90.44% -
454.calculix (unexplained diff vs previous) -80.00% 5.000 1.000 - -85.71% -
471.omnetpp (unexplained diff vs previous) (percentage) -79.17% 0.240 0.050 - -82.14% -
473.astar (avg) (percentage) -78.95% 0.190 0.040 - 0.00% -
450.soplex (max) -78.62% 304.000 65.000 - -5.80% -
473.astar -78.57% 28.000 6.000 - 0.00% -
473.astar (avg) -78.57% 28.000 6.000 - 0.00% -
471.omnetpp (avg) (percentage) -77.99% 1.590 0.350 - -22.22% -
450.soplex (max) (percentage) -77.66% 1.970 0.440 - -6.38% -
459.GemsFDTD (unexplained diff vs previous) -77.08% 48.000 11.000 - -98.71% -
462.libquantum (avg) (percentage) -76.92% 0.650 0.150 - 0.00% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -76.19% 0.210 0.050 - -98.75% -
465.tonto (unexplained diff vs previous) (percentage) -75.32% 0.770 0.190 - 0.00% -
445.gobmk (unexplained diff vs previous) (percentage) -74.84% 1.550 0.390 - 200.00% -
445.gobmk (unexplained diff vs previous) -74.19% 186.000 48.000 - 200.00% -
445.gobmk (max) (percentage) -73.86% 1.530 0.400 - 185.71% -
445.gobmk (max) -73.77% 183.000 48.000 - 200.00% -
462.libquantum -73.33% 75.000 20.000 - 0.00% -
462.libquantum (avg) -73.33% 75.000 20.000 - 0.00% -
454.calculix -73.20% 459.000 123.000 - -25.45% -
454.calculix (avg) -73.20% 459.000 123.000 - -25.45% -
471.omnetpp (unexplained diff vs previous) -73.08% 26.000 7.000 - -81.58% -
471.omnetpp -72.35% 170.000 47.000 - -21.67% -
471.omnetpp (avg) -72.35% 170.000 47.000 - -21.67% -
465.tonto (unexplained diff vs previous) -71.43% 63.000 18.000 - 0.00% -
454.calculix (avg) (percentage) -70.65% 2.010 0.590 - -25.32% -
462.libquantum (max) (percentage) -70.31% 0.640 0.190 - -5.00% -
450.soplex -70.16% 191.000 57.000 - -21.92% -
450.soplex (avg) -70.16% 191.000 57.000 - -21.92% -
401.bzip2 (unexplained diff vs previous) -68.94% 132.000 41.000 - -45.33% -
450.soplex (avg) (percentage) -68.55% 1.240 0.390 - -22.00% -
453.povray (avg) (percentage) -67.20% 1.250 0.410 - -21.15% -
401.bzip2 (unexplained diff vs previous) (percentage) -66.67% 0.870 0.290 - -45.28% -
462.libquantum (max) -66.22% 74.000 25.000 - -7.41% -
403.gcc (max) -65.62% 64.000 22.000 - -8.33% -
453.povray -65.43% 81.000 28.000 - -20.00% -
453.povray (avg) -65.43% 81.000 28.000 - -20.00% -
444.namd (avg) (percentage) -65.39% 3.930 1.360 - -18.07% -
444.namd -64.79% 355.000 125.000 - -18.83% -
444.namd (avg) -64.79% 355.000 125.000 - -18.83% -
403.gcc (max) (percentage) -63.89% 0.720 0.260 - -7.14% -
465.tonto (max) (percentage) -63.69% 3.580 1.300 - -18.24% -
445.gobmk (avg) (percentage) -63.64% 0.770 0.280 - 16.67% -
445.gobmk -63.04% 92.000 34.000 - 17.24% -
445.gobmk (avg) -63.04% 92.000 34.000 - 17.24% -
481.wrf (unexplained diff vs previous) (percentage) -61.19% 0.670 0.260 - 0.00% -
481.wrf (unexplained diff vs previous) -58.04% 112.000 47.000 - 0.00% -
465.tonto (max) -58.02% 293.000 123.000 - -18.54% -
464.h264ref -56.41% 78.000 34.000 - -39.29% -
464.h264ref (avg) -56.41% 78.000 34.000 - -39.29% -
464.h264ref (avg) (percentage) -51.85% 0.540 0.260 - -39.53% -
454.calculix (max) -50.37% 1074.000 533.000 - -24.93% -
473.astar (max) (percentage) -50.00% 0.140 0.070 - 0.00% -
458.sjeng (avg) (percentage) -48.48% 0.330 0.170 - 6.25% -
453.povray (max) (percentage) -47.83% 2.530 1.320 - -27.07% -
403.gcc -46.30% 54.000 29.000 - 0.00% -
403.gcc (avg) -46.30% 54.000 29.000 - 0.00% -
454.calculix (max) (percentage) -45.96% 4.700 2.540 - -24.85% -
473.astar (max) -45.00% 20.000 11.000 - 0.00% -
453.povray (max) -44.85% 165.000 91.000 - -26.61% -
458.sjeng -44.68% 47.000 26.000 - 8.33% -
458.sjeng (avg) -44.68% 47.000 26.000 - 8.33% -
403.gcc (avg) (percentage) -44.26% 0.610 0.340 - 0.00% -
437.leslie3d (unexplained diff vs previous) -42.86% 343.000 196.000 - 125.29% -
437.leslie3d -42.58% 357.000 205.000 - -3.30% -
437.leslie3d (avg) -42.58% 357.000 205.000 - -3.30% -
470.lbm (max) (percentage) -42.35% 5.100 2.940 - -12.50% -
435.gromacs -40.98% 266.000 157.000 - -20.30% -
435.gromacs (avg) -40.98% 266.000 157.000 - -20.30% -
465.tonto (avg) (percentage) -40.12% 1.670 1.000 - -33.77% -
400.perlbench (max) (percentage) -37.65% 3.240 2.020 - -6.48% -
483.xalancbmk (avg) (percentage) -37.31% 0.670 0.420 - 0.00% -
437.leslie3d (unexplained diff vs previous) (percentage) -37.12% 2.290 1.440 - 128.57% -
437.leslie3d (max) -37.04% 351.000 221.000 - -7.92% -
400.perlbench (max) -36.81% 345.000 218.000 - -5.63% -
437.leslie3d (avg) (percentage) -36.55% 2.380 1.510 - -1.95% -
470.lbm (max) -36.45% 653.000 415.000 - -12.63% -
433.milc -35.91% 220.000 141.000 - -24.19% -
433.milc (avg) -35.91% 220.000 141.000 - -24.19% -
435.gromacs (avg) (percentage) -35.26% 1.730 1.120 - -20.57% -
416.gamess -34.15% 492.000 324.000 - -0.31% -
416.gamess (avg) -34.15% 492.000 324.000 - -0.31% -
401.bzip2 (max) -33.83% 133.000 88.000 - -8.33% -
433.milc (avg) (percentage) -33.53% 1.700 1.130 - -24.16% -
416.gamess (avg) (percentage) -33.18% 2.170 1.450 - 0.00% -
465.tonto -30.66% 137.000 95.000 - -34.03% -
465.tonto (avg) -30.66% 137.000 95.000 - -34.03% -
437.leslie3d (max) (percentage) -30.34% 2.340 1.630 - -6.32% -
433.milc (max) -30.17% 411.000 287.000 - -16.81% -
401.bzip2 (max) (percentage) -29.55% 0.880 0.620 - -8.82% -
433.milc (max) (percentage) -27.44% 3.170 2.300 - -16.67% -
470.lbm (avg) (percentage) -26.16% 2.370 1.750 - -23.91% -
483.xalancbmk -25.68% 74.000 55.000 - 0.00% -
483.xalancbmk (avg) -25.68% 74.000 55.000 - 0.00% -
470.lbm -18.48% 303.000 247.000 - -24.00% -
470.lbm (avg) -18.48% 303.000 247.000 - -24.00% -
447.dealII -17.31% 104.000 86.000 - 28.36% -
447.dealII (avg) -17.31% 104.000 86.000 - 28.36% -
482.sphinx3 -15.37% 436.000 369.000 - -24.69% -
482.sphinx3 (avg) -15.37% 436.000 369.000 - -24.69% -
447.dealII (avg) (percentage) -14.95% 1.070 0.910 - 30.00% -
481.wrf (max) (percentage) -14.60% 3.150 2.690 - -12.66% -
416.gamess (max) -13.72% 656.000 566.000 - -6.45% -
458.sjeng (max) (percentage) -13.64% 0.220 0.190 - 0.00% -
416.gamess (max) (percentage) -12.46% 2.890 2.530 - -6.30% -
436.cactusADM (avg) (percentage) -11.45% 1.660 1.470 - -24.62% -
410.bwaves -10.62% 160.000 143.000 - -22.70% -
410.bwaves (avg) -10.62% 160.000 143.000 - -22.70% -
410.bwaves (avg) (percentage) -10.09% 1.090 0.980 - -22.22% -
481.wrf (avg) (percentage) -9.52% 1.890 1.710 - -34.98% -
434.zeusmp (avg) (percentage) -9.46% 1.480 1.340 - -24.29% -
481.wrf (max) -9.25% 530.000 481.000 - -13.02% -
400.perlbench (avg) (percentage) -8.84% 1.470 1.340 - 0.00% -
400.perlbench -7.69% 156.000 144.000 - 0.70% -
400.perlbench (avg) -7.69% 156.000 144.000 - 0.70% -
436.cactusADM -7.56% 291.000 269.000 - -24.65% -
436.cactusADM (avg) -7.56% 291.000 269.000 - -24.65% -
482.sphinx3 (avg) (percentage) -7.53% 1.460 1.350 - -24.58% -
458.sjeng (max) -6.45% 31.000 29.000 - 0.00% -
401.bzip2 -6.06% 66.000 62.000 - -10.14% -
401.bzip2 (avg) -6.06% 66.000 62.000 - -10.14% -
434.zeusmp -5.13% 195.000 185.000 - -24.49% -
434.zeusmp (avg) -5.13% 195.000 185.000 - -24.49% -
481.wrf -3.77% 318.000 306.000 - -35.17% -
481.wrf (avg) -3.77% 318.000 306.000 - -35.17% -

Added Tests - sample variability
429.mcf (unexplained diff vs previous)
429.mcf (unexplained diff vs previous) (percentage)
454.calculix (unexplained diff vs previous) (percentage)
464.h264ref (unexplained diff vs previous)
464.h264ref (unexplained diff vs previous) (percentage)

Report Time: 0.40s
Execution (seconds)
Name Current %
400.perlbench 10797.000 -
401.bzip2 14254.000 -
403.gcc 8723.000 -
410.bwaves 14664.000 -
416.gamess 22379.000 -
429.mcf 20378.000 -
433.milc 12498.000 -
434.zeusmp 13852.000 -
435.gromacs 14075.000 -
436.cactusADM 18345.000 -
437.leslie3d 13617.000 -1.42%
444.namd 9248.000 -
445.gobmk 12163.000 -
447.dealII 9526.000 -1.53%
450.soplex 14801.000 -
453.povray 6909.000 -
454.calculix 21008.000 -
456.hmmer 10449.000 -1.02%
458.sjeng 15347.000 -
459.GemsFDTD 21227.000 -
462.libquantum 13675.000 -
464.h264ref 13167.000 -
465.tonto 9535.000 -
470.lbm 14133.000 -
471.omnetpp 13449.000 -
473.astar 15784.000 -
481.wrf 17911.000 -
482.sphinx3 27382.000 -
483.xalancbmk 13222.000 -
Geometric Mean 13908.796 -
Code Size (bytes)
Name Current %
400.perlbench 933980.000 -
401.bzip2 49876.000 -
403.gcc 2697415.000 -
410.bwaves 17880.000 -
416.gamess 6266447.000 -
429.mcf 10951.000 -
433.milc 95813.000 -
434.zeusmp 165607.000 -
435.gromacs 678629.000 -
436.cactusADM 553558.000 -
437.leslie3d 64933.000 -
444.namd 190967.000 -
445.gobmk 1399427.000 -
447.dealII 2113487.000 -
450.soplex 267429.000 -
453.povray 705068.000 -
454.calculix 1272374.000 -
456.hmmer 231177.000 -
458.sjeng 112097.000 -
459.GemsFDTD 256984.000 -
462.libquantum 31291.000 -
464.h264ref 427916.000 -
465.tonto 2875120.000 -
470.lbm 10932.000 -
471.omnetpp 573038.000 -
473.astar 32132.000 -
481.wrf 2643741.000 -
482.sphinx3 152767.000 -
483.xalancbmk 3294630.000 -
Geometric Mean 297816.190 -
sample variability
Name Current %
400.perlbench 144.000 -
400.perlbench (avg) 144.000 -
400.perlbench (avg) (percentage) 1.340 -
400.perlbench (max) 218.000 -5.63%
400.perlbench (max) (percentage) 2.020 -6.48%
401.bzip2 62.000 -10.14%
401.bzip2 (avg) 62.000 -10.14%
401.bzip2 (avg) (percentage) 0.440 -10.20%
401.bzip2 (max) 88.000 -8.33%
401.bzip2 (max) (percentage) 0.620 -8.82%
401.bzip2 (unexplained diff vs previous) 41.000 -45.33%
401.bzip2 (unexplained diff vs previous) (percentage) 0.290 -45.28%
403.gcc 29.000 -
403.gcc (avg) 29.000 -
403.gcc (avg) (percentage) 0.340 -
403.gcc (max) 22.000 -8.33%
403.gcc (max) (percentage) 0.260 -7.14%
410.bwaves 143.000 -22.70%
410.bwaves (avg) 143.000 -22.70%
410.bwaves (avg) (percentage) 0.980 -22.22%
410.bwaves (max) 178.000 -12.75%
410.bwaves (max) (percentage) 1.220 -12.23%
410.bwaves (unexplained diff vs previous) 22.000 -89.11%
410.bwaves (unexplained diff vs previous) (percentage) 0.150 -89.13%
416.gamess 324.000 -
416.gamess (avg) 324.000 -
416.gamess (avg) (percentage) 1.450 -
416.gamess (max) 566.000 -6.45%
416.gamess (max) (percentage) 2.530 -6.30%
429.mcf 126.000 -24.55%
429.mcf (avg) 126.000 -24.55%
429.mcf (avg) (percentage) 0.620 -24.39%
429.mcf (max) 268.000 -10.37%
429.mcf (max) (percentage) 1.320 -10.20%
429.mcf (unexplained diff vs previous) 0.000 -
429.mcf (unexplained diff vs previous) (percentage) 0.000 -
433.milc 141.000 -24.19%
433.milc (avg) 141.000 -24.19%
433.milc (avg) (percentage) 1.130 -24.16%
433.milc (max) 287.000 -16.81%
433.milc (max) (percentage) 2.300 -16.67%
433.milc (unexplained diff vs previous) 4.000 -98.87%
433.milc (unexplained diff vs previous) (percentage) 0.030 -98.94%
434.zeusmp 185.000 -24.49%
434.zeusmp (avg) 185.000 -24.49%
434.zeusmp (avg) (percentage) 1.340 -24.29%
434.zeusmp (max) 414.000 -10.00%
434.zeusmp (max) (percentage) 2.990 -9.94%
434.zeusmp (unexplained diff vs previous) 8.000 -98.32%
434.zeusmp (unexplained diff vs previous) (percentage) 0.060 -98.25%
435.gromacs 157.000 -20.30%
435.gromacs (avg) 157.000 -20.30%
435.gromacs (avg) (percentage) 1.120 -20.57%
435.gromacs (max) 326.000 -12.37%
435.gromacs (max) (percentage) 2.320 -12.45%
435.gromacs (unexplained diff vs previous) 37.000 -90.31%
435.gromacs (unexplained diff vs previous) (percentage) 0.260 -90.44%
436.cactusADM 269.000 -24.65%
436.cactusADM (avg) 269.000 -24.65%
436.cactusADM (avg) (percentage) 1.470 -24.62%
436.cactusADM (max) 596.000 -9.83%
436.cactusADM (max) (percentage) 3.250 -9.97%
436.cactusADM (unexplained diff vs previous) 10.000 -98.54%
436.cactusADM (unexplained diff vs previous) (percentage) 0.050 -98.67%
437.leslie3d 205.000 -3.30%
437.leslie3d (avg) 205.000 -3.30%
437.leslie3d (avg) (percentage) 1.510 -1.95%
437.leslie3d (max) 221.000 -7.92%
437.leslie3d (max) (percentage) 1.630 -6.32%
437.leslie3d (unexplained diff vs previous) 196.000 125.29%
437.leslie3d (unexplained diff vs previous) (percentage) 1.440 128.57%
444.namd 125.000 -18.83%
444.namd (avg) 125.000 -18.83%
444.namd (avg) (percentage) 1.360 -18.07%
444.namd (max) 69.000 -10.39%
444.namd (max) (percentage) 0.750 -9.64%
444.namd (unexplained diff vs previous) 45.000 -38.36%
444.namd (unexplained diff vs previous) (percentage) 0.490 -37.97%
445.gobmk 34.000 17.24%
445.gobmk (avg) 34.000 17.24%
445.gobmk (avg) (percentage) 0.280 16.67%
445.gobmk (max) 48.000 200.00%
445.gobmk (max) (percentage) 0.400 185.71%
445.gobmk (unexplained diff vs previous) 48.000 200.00%
445.gobmk (unexplained diff vs previous) (percentage) 0.390 200.00%
447.dealII 86.000 28.36%
447.dealII (avg) 86.000 28.36%
447.dealII (avg) (percentage) 0.910 30.00%
447.dealII (max) 145.000 -3.33%
447.dealII (max) (percentage) 1.530 -1.92%
447.dealII (unexplained diff vs previous) 148.000 92.21%
447.dealII (unexplained diff vs previous) (percentage) 1.550 93.75%
450.soplex 57.000 -21.92%
450.soplex (avg) 57.000 -21.92%
450.soplex (avg) (percentage) 0.390 -22.00%
450.soplex (max) 65.000 -5.80%
450.soplex (max) (percentage) 0.440 -6.38%
450.soplex (unexplained diff vs previous) 8.000 -73.33%
450.soplex (unexplained diff vs previous) (percentage) 0.050 -75.00%
453.povray 28.000 -20.00%
453.povray (avg) 28.000 -20.00%
453.povray (avg) (percentage) 0.410 -21.15%
453.povray (max) 91.000 -26.61%
453.povray (max) (percentage) 1.320 -27.07%
453.povray (unexplained diff vs previous) 5.000 -66.67%
453.povray (unexplained diff vs previous) (percentage) 0.070 -68.18%
454.calculix 123.000 -25.45%
454.calculix (avg) 123.000 -25.45%
454.calculix (avg) (percentage) 0.590 -25.32%
454.calculix (max) 533.000 -24.93%
454.calculix (max) (percentage) 2.540 -24.85%
454.calculix (unexplained diff vs previous) 1.000 -85.71%
454.calculix (unexplained diff vs previous) (percentage) 0.000 -
456.hmmer 89.000 4.71%
456.hmmer (avg) 89.000 4.71%
456.hmmer (avg) (percentage) 0.860 6.17%
456.hmmer (max) 158.000 -11.24%
456.hmmer (max) (percentage) 1.520 -10.06%
456.hmmer (unexplained diff vs previous) 108.000 -38.29%
456.hmmer (unexplained diff vs previous) (percentage) 1.030 -37.95%
458.sjeng 26.000 8.33%
458.sjeng (avg) 26.000 8.33%
458.sjeng (avg) (percentage) 0.170 6.25%
458.sjeng (max) 29.000 -
458.sjeng (max) (percentage) 0.190 -
458.sjeng (unexplained diff vs previous) 29.000 -
458.sjeng (unexplained diff vs previous) (percentage) 0.190 -
459.GemsFDTD 326.000 -24.36%
459.GemsFDTD (avg) 326.000 -24.36%
459.GemsFDTD (avg) (percentage) 1.540 -24.14%
459.GemsFDTD (max) 681.000 -16.65%
459.GemsFDTD (max) (percentage) 3.210 -16.62%
459.GemsFDTD (unexplained diff vs previous) 11.000 -98.71%
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.050 -98.75%
462.libquantum 20.000 -
462.libquantum (avg) 20.000 -
462.libquantum (avg) (percentage) 0.150 -
462.libquantum (max) 25.000 -7.41%
462.libquantum (max) (percentage) 0.190 -5.00%
462.libquantum (unexplained diff vs previous) 21.000 110.00%
462.libquantum (unexplained diff vs previous) (percentage) 0.150 114.29%
464.h264ref 34.000 -39.29%
464.h264ref (avg) 34.000 -39.29%
464.h264ref (avg) (percentage) 0.260 -39.53%
464.h264ref (max) 69.000 -5.48%
464.h264ref (max) (percentage) 0.530 -5.36%
464.h264ref (unexplained diff vs previous) 0.000 -
464.h264ref (unexplained diff vs previous) (percentage) 0.000 -
465.tonto 95.000 -34.03%
465.tonto (avg) 95.000 -34.03%
465.tonto (avg) (percentage) 1.000 -33.77%
465.tonto (max) 123.000 -18.54%
465.tonto (max) (percentage) 1.300 -18.24%
465.tonto (unexplained diff vs previous) 18.000 -
465.tonto (unexplained diff vs previous) (percentage) 0.190 -
470.lbm 247.000 -24.00%
470.lbm (avg) 247.000 -24.00%
470.lbm (avg) (percentage) 1.750 -23.91%
470.lbm (max) 415.000 -12.63%
470.lbm (max) (percentage) 2.940 -12.50%
470.lbm (unexplained diff vs previous) 14.000 -96.96%
470.lbm (unexplained diff vs previous) (percentage) 0.100 -96.92%
471.omnetpp 47.000 -21.67%
471.omnetpp (avg) 47.000 -21.67%
471.omnetpp (avg) (percentage) 0.350 -22.22%
471.omnetpp (max) 45.000 -53.12%
471.omnetpp (max) (percentage) 0.340 -52.78%
471.omnetpp (unexplained diff vs previous) 7.000 -81.58%
471.omnetpp (unexplained diff vs previous) (percentage) 0.050 -82.14%
473.astar 6.000 -
473.astar (avg) 6.000 -
473.astar (avg) (percentage) 0.040 -
473.astar (max) 11.000 -
473.astar (max) (percentage) 0.070 -
473.astar (unexplained diff vs previous) 7.000 250.00%
473.astar (unexplained diff vs previous) (percentage) 0.040 300.00%
481.wrf 306.000 -35.17%
481.wrf (avg) 306.000 -35.17%
481.wrf (avg) (percentage) 1.710 -34.98%
481.wrf (max) 481.000 -13.02%
481.wrf (max) (percentage) 2.690 -12.66%
481.wrf (unexplained diff vs previous) 47.000 -
481.wrf (unexplained diff vs previous) (percentage) 0.260 -
482.sphinx3 369.000 -24.69%
482.sphinx3 (avg) 369.000 -24.69%
482.sphinx3 (avg) (percentage) 1.350 -24.58%
482.sphinx3 (max) 602.000 -8.65%
482.sphinx3 (max) (percentage) 2.200 -8.71%
482.sphinx3 (unexplained diff vs previous) 3.000 -99.46%
482.sphinx3 (unexplained diff vs previous) (percentage) 0.010 -99.51%
483.xalancbmk 55.000 -
483.xalancbmk (avg) 55.000 -
483.xalancbmk (avg) (percentage) 0.420 -
483.xalancbmk (max) 79.000 -5.95%
483.xalancbmk (max) (percentage) 0.600 -6.25%
Geometric Mean 6.675 -54.73%