Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=16c8122639ca0948f56fce125b3ad46e122d1edc (+ 40 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/ac7c9954ece9a75c5e7c3b76a4800f2432002487 (unchanged)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=f0dbe112f532be2101bb392f67f9f164cade25b0 (+ 17 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=7e83b5e75b20f49d4940bf35dfc1e38f3f95e5dc (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_vect-spec2k6--gnu-aarch64-master-O3-build/33/
View Options
Report
Filter

gnu-aarch64-master-O3 test results

Run Order Start Time Duration
Current 0033 (2-changed-components) 2023-05-06T19:54:47 0:00:00
Previous 0030 (3-changed-components) 2023-05-02T22:34:22 0:00:00
Baseline 0001 (4-changed-components) 2023-03-07T16:12:14 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 42 22
Performance Improvements 145 9
Added Tests 5 149
Unchanged Tests 1044 1056
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
435.gromacs 3.22% 5187.000 5354.000 - 8.18% -
483.xalancbmk 1.72% 3319.000 3376.000 - 5.11% -
482.sphinx3 1.55% 772.000 784.000 - 4.26% -
450.soplex 1.14% 528.000 534.000 - -1.29% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
434.zeusmp (unexplained diff vs previous) 1600.00% 1.000 17.000 - 0.00% -
434.zeusmp (unexplained diff vs previous) (percentage) 1516.67% 0.060 0.970 - 0.00% -
435.gromacs (unexplained diff vs previous) 943.75% 16.000 167.000 - 0.00% -
435.gromacs (unexplained diff vs previous) (percentage) 906.45% 0.310 3.120 - 0.00% -
433.milc (unexplained diff vs previous) 200.00% 2.000 6.000 - 0.00% -
470.lbm (unexplained diff vs previous) 200.00% 5.000 15.000 - 0.00% -
470.lbm (unexplained diff vs previous) (percentage) 193.33% 0.150 0.440 - 0.00% -
433.milc (unexplained diff vs previous) (percentage) 190.00% 0.200 0.580 - 0.00% -
454.calculix (unexplained diff vs previous) (percentage) 108.33% 1.920 4.000 - 0.00% -
454.calculix (unexplained diff vs previous) 100.00% 1.000 2.000 - 0.00% -
481.wrf (unexplained diff vs previous) (percentage) 72.96% 2.700 4.670 - 0.00% -
481.wrf (unexplained diff vs previous) 65.48% 84.000 139.000 - 0.00% -
481.wrf (max) (percentage) 61.01% 2.770 4.460 - 0.00% -
481.wrf (max) 53.49% 86.000 132.000 - 0.00% -
465.tonto (unexplained diff vs previous) (percentage) 52.94% 0.170 0.260 - 0.00% -
465.tonto (unexplained diff vs previous) 50.00% 14.000 21.000 - 0.00% -
482.sphinx3 (unexplained diff vs previous) 50.00% 8.000 12.000 - 0.00% -
482.sphinx3 (unexplained diff vs previous) (percentage) 47.12% 1.040 1.530 - 0.00% -
473.astar (unexplained diff vs previous) 43.75% 32.000 46.000 - 0.00% -
473.astar (unexplained diff vs previous) (percentage) 43.08% 0.650 0.930 - 0.00% -
459.GemsFDTD (unexplained diff vs previous) 40.00% 10.000 14.000 - 0.00% -
437.leslie3d (unexplained diff vs previous) (percentage) 35.27% 2.070 2.800 - 0.00% -
459.GemsFDTD (unexplained diff vs previous) (percentage) 34.78% 0.230 0.310 - 0.00% -
454.calculix (max) (percentage) 34.62% 2.860 3.850 - 0.00% -
437.leslie3d (unexplained diff vs previous) 31.51% 146.000 192.000 - 0.00% -
481.wrf (avg) (percentage) 30.38% 1.580 2.060 - 0.00% -
481.wrf 24.49% 49.000 61.000 - 0.00% -
481.wrf (avg) 24.49% 49.000 61.000 - 0.00% -
483.xalancbmk (unexplained diff vs previous) 16.33% 49.000 57.000 - 0.00% -
483.xalancbmk (unexplained diff vs previous) (percentage) 14.19% 1.480 1.690 - 0.00% -
454.calculix (avg) (percentage) 11.79% 2.120 2.370 - 0.00% -
483.xalancbmk 4.65% 43.000 45.000 - 0.00% -
483.xalancbmk (avg) 4.65% 43.000 45.000 - 0.00% -
483.xalancbmk (avg) (percentage) 3.03% 1.320 1.360 - 0.00% -
435.gromacs 2.89% 173.000 178.000 - 0.00% -
435.gromacs (avg) 2.89% 173.000 178.000 - 0.00% -
429.mcf (unexplained diff vs previous) (percentage) 1.79% 1.680 1.710 - 0.00% -
462.libquantum (unexplained diff vs previous) (percentage) 1.67% 1.200 1.220 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
481.wrf -4.46% 3114.000 2975.000 - 2.94% -
454.calculix -3.85% 52.000 50.000 - 8.70% -
437.leslie3d -2.72% 7052.000 6860.000 - -0.87% -
403.gcc -1.75% 57.000 56.000 - 12.00% -
429.mcf -1.68% 1431.000 1407.000 - -29.65% -
462.libquantum -1.20% 83.000 82.000 - 5.13% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
401.bzip2 (unexplained diff vs previous) -90.91% 33.000 3.000 - 0.00% -
401.bzip2 (unexplained diff vs previous) (percentage) -90.83% 1.200 0.110 - 0.00% -
410.bwaves (unexplained diff vs previous) (percentage) -85.25% 0.610 0.090 - 0.00% -
410.bwaves (unexplained diff vs previous) -84.62% 26.000 4.000 - 0.00% -
436.cactusADM (max) (percentage) -83.04% 2.240 0.380 - 0.00% -
436.cactusADM (max) -82.86% 35.000 6.000 - 0.00% -
462.libquantum (max) (percentage) -78.14% 5.490 1.200 - 0.00% -
444.namd (unexplained diff vs previous) -77.78% 9.000 2.000 - 0.00% -
444.namd (unexplained diff vs previous) (percentage) -77.46% 1.420 0.320 - 0.00% -
453.povray (unexplained diff vs previous) (percentage) -72.76% 2.680 0.730 - 0.00% -
453.povray (unexplained diff vs previous) -72.73% 11.000 3.000 - 0.00% -
464.h264ref (max) -69.88% 83.000 25.000 - 0.00% -
464.h264ref (max) (percentage) -69.08% 2.070 0.640 - 0.00% -
403.gcc (unexplained diff vs previous) -66.67% 3.000 1.000 - 0.00% -
403.gcc (unexplained diff vs previous) (percentage) -65.97% 5.260 1.790 - 0.00% -
400.perlbench (unexplained diff vs previous) (percentage) -65.45% 1.650 0.570 - 0.00% -
445.gobmk (unexplained diff vs previous) (percentage) -65.24% 1.870 0.650 - 0.00% -
400.perlbench (unexplained diff vs previous) -65.22% 23.000 8.000 - 0.00% -
445.gobmk (unexplained diff vs previous) -64.77% 88.000 31.000 - 0.00% -
471.omnetpp (unexplained diff vs previous) -63.41% 41.000 15.000 - 0.00% -
471.omnetpp (unexplained diff vs previous) (percentage) -63.37% 1.720 0.630 - 0.00% -
456.hmmer (max) -58.33% 24.000 10.000 - 0.00% -
456.hmmer (max) (percentage) -54.84% 1.240 0.560 - 0.00% -
444.namd (max) -41.67% 12.000 7.000 - 0.00% -
444.namd (max) (percentage) -40.00% 2.000 1.200 - 0.00% -
456.hmmer (unexplained diff vs previous) -38.46% 13.000 8.000 - 0.00% -
456.hmmer (unexplained diff vs previous) (percentage) -37.88% 0.660 0.410 - 0.00% -
403.gcc (max) -33.33% 3.000 2.000 - 0.00% -
458.sjeng (unexplained diff vs previous) -33.33% 33.000 22.000 - 0.00% -
458.sjeng (unexplained diff vs previous) (percentage) -32.00% 0.500 0.340 - 0.00% -
471.omnetpp (max) -30.59% 85.000 59.000 - 0.00% -
471.omnetpp (max) (percentage) -29.97% 3.570 2.500 - 0.00% -
464.h264ref (unexplained diff vs previous) (percentage) -29.87% 0.770 0.540 - 0.00% -
464.h264ref (unexplained diff vs previous) -29.03% 31.000 22.000 - 0.00% -
450.soplex (unexplained diff vs previous) (percentage) -26.32% 1.520 1.120 - 0.00% -
450.soplex (unexplained diff vs previous) -25.00% 8.000 6.000 - 0.00% -
416.gamess (unexplained diff vs previous) (percentage) -23.08% 0.130 0.100 - 0.00% -
416.gamess (unexplained diff vs previous) -21.43% 14.000 11.000 - 0.00% -
445.gobmk (max) (percentage) -16.94% 1.830 1.520 - 0.00% -
445.gobmk (max) -16.28% 86.000 72.000 - 0.00% -
447.dealII (avg) (percentage) -15.45% 1.100 0.930 - 0.00% -
447.dealII -14.29% 14.000 12.000 - 0.00% -
447.dealII (avg) -14.29% 14.000 12.000 - 0.00% -
400.perlbench -13.79% 29.000 25.000 - 0.00% -
400.perlbench (avg) -13.79% 29.000 25.000 - 0.00% -
416.gamess (avg) (percentage) -13.04% 0.230 0.200 - 0.00% -
416.gamess -12.50% 24.000 21.000 - 0.00% -
416.gamess (avg) -12.50% 24.000 21.000 - 0.00% -
453.povray -12.50% 8.000 7.000 - 0.00% -
453.povray (avg) -12.50% 8.000 7.000 - 0.00% -
465.tonto -12.50% 112.000 98.000 - 0.00% -
465.tonto (avg) -12.50% 112.000 98.000 - 0.00% -
400.perlbench (avg) (percentage) -12.32% 2.110 1.850 - 0.00% -
465.tonto (avg) (percentage) -12.32% 1.380 1.210 - 0.00% -
403.gcc (avg) (percentage) -11.68% 4.880 4.310 - 0.00% -
401.bzip2 -10.53% 57.000 51.000 - 0.00% -
401.bzip2 (avg) -10.53% 57.000 51.000 - 0.00% -
401.bzip2 (avg) (percentage) -10.48% 2.100 1.880 - 0.00% -
447.dealII (max) -9.52% 21.000 19.000 - 0.00% -
437.leslie3d (max) -9.25% 822.000 746.000 - 0.00% -
437.leslie3d -8.51% 470.000 430.000 - 0.00% -
437.leslie3d (avg) -8.51% 470.000 430.000 - 0.00% -
453.povray (avg) (percentage) -8.50% 2.000 1.830 - 0.00% -
410.bwaves -8.47% 59.000 54.000 - 0.00% -
410.bwaves (avg) -8.47% 59.000 54.000 - 0.00% -
436.cactusADM (avg) (percentage) -8.43% 0.830 0.760 - 0.00% -
447.dealII (max) (percentage) -8.07% 1.610 1.480 - 0.00% -
410.bwaves (avg) (percentage) -7.91% 1.390 1.280 - 0.00% -
429.mcf -7.84% 102.000 94.000 - 0.00% -
429.mcf (avg) -7.84% 102.000 94.000 - 0.00% -
436.cactusADM -7.69% 13.000 12.000 - 0.00% -
436.cactusADM (avg) -7.69% 13.000 12.000 - 0.00% -
450.soplex -7.69% 13.000 12.000 - 0.00% -
450.soplex (avg) -7.69% 13.000 12.000 - 0.00% -
459.GemsFDTD -7.41% 54.000 50.000 - 0.00% -
459.GemsFDTD (avg) -7.41% 54.000 50.000 - 0.00% -
459.GemsFDTD (avg) (percentage) -7.38% 1.220 1.130 - 0.00% -
471.omnetpp -7.27% 55.000 51.000 - 0.00% -
471.omnetpp (avg) -7.27% 55.000 51.000 - 0.00% -
458.sjeng (max) (percentage) -7.01% 1.570 1.460 - 0.00% -
444.namd (avg) (percentage) -6.98% 0.860 0.800 - 0.00% -
458.sjeng (max) -6.86% 102.000 95.000 - 0.00% -
437.leslie3d (max) (percentage) -6.69% 11.660 10.880 - 0.00% -
429.mcf (avg) (percentage) -6.28% 7.160 6.710 - 0.00% -
453.povray (max) (percentage) -6.13% 2.610 2.450 - 0.00% -
458.sjeng (avg) (percentage) -6.10% 0.820 0.770 - 0.00% -
471.omnetpp (avg) (percentage) -6.06% 2.310 2.170 - 0.00% -
437.leslie3d (avg) (percentage) -6.00% 6.670 6.270 - 0.00% -
464.h264ref -5.88% 34.000 32.000 - 0.00% -
464.h264ref (avg) -5.88% 34.000 32.000 - 0.00% -
429.mcf (max) -5.84% 274.000 258.000 - 0.00% -
464.h264ref (avg) (percentage) -5.81% 0.860 0.810 - 0.00% -
450.soplex (max) (percentage) -5.76% 3.990 3.760 - 0.00% -
433.milc (max) (percentage) -5.74% 2.440 2.300 - 0.00% -
458.sjeng -5.66% 53.000 50.000 - 0.00% -
458.sjeng (avg) -5.66% 53.000 50.000 - 0.00% -
445.gobmk (avg) (percentage) -5.65% 1.240 1.170 - 0.00% -
450.soplex (avg) (percentage) -5.62% 2.490 2.350 - 0.00% -
403.gcc (max) (percentage) -5.58% 5.560 5.250 - 0.00% -
410.bwaves (max) (percentage) -5.57% 3.590 3.390 - 0.00% -
400.perlbench (max) (percentage) -5.31% 2.260 2.140 - 0.00% -
410.bwaves (max) -5.26% 152.000 144.000 - 0.00% -
473.astar (max) (percentage) -5.24% 5.730 5.430 - 0.00% -
483.xalancbmk (max) (percentage) -5.18% 4.250 4.030 - 0.00% -
445.gobmk -5.17% 58.000 55.000 - 0.00% -
445.gobmk (avg) -5.17% 58.000 55.000 - 0.00% -
433.milc (avg) (percentage) -5.11% 1.370 1.300 - 0.00% -
470.lbm (max) (percentage) -5.03% 1.990 1.890 - 0.00% -
401.bzip2 (max) -4.95% 101.000 96.000 - 0.00% -
459.GemsFDTD (max) (percentage) -4.95% 3.030 2.880 - 0.00% -
434.zeusmp -4.76% 21.000 20.000 - 0.00% -
434.zeusmp (avg) -4.76% 21.000 20.000 - 0.00% -
450.soplex (max) -4.76% 21.000 20.000 - 0.00% -
482.sphinx3 (max) (percentage) -4.71% 2.970 2.830 - 0.00% -
470.lbm (avg) (percentage) -4.55% 1.100 1.050 - 0.00% -
470.lbm (max) -4.55% 66.000 63.000 - 0.00% -
459.GemsFDTD (max) -4.48% 134.000 128.000 - 0.00% -
473.astar (avg) (percentage) -4.37% 2.060 1.970 - 0.00% -
473.astar (max) -4.29% 280.000 268.000 - 0.00% -
433.milc (max) -4.17% 24.000 23.000 - 0.00% -
401.bzip2 (max) (percentage) -4.09% 3.670 3.520 - 0.00% -
435.gromacs (max) (percentage) -4.08% 6.870 6.590 - 0.00% -
429.mcf (max) (percentage) -3.97% 19.160 18.400 - 0.00% -
434.zeusmp (max) (percentage) -3.93% 3.310 3.180 - 0.00% -
462.libquantum (avg) (percentage) -3.72% 2.150 2.070 - 0.00% -
483.xalancbmk (max) -3.55% 141.000 136.000 - 0.00% -
434.zeusmp (max) -3.51% 57.000 55.000 - 0.00% -
400.perlbench (max) -3.23% 31.000 30.000 - 0.00% -
465.tonto (max) (percentage) -3.04% 3.290 3.190 - 0.00% -
473.astar -3.00% 100.000 97.000 - 0.00% -
473.astar (avg) -3.00% 100.000 97.000 - 0.00% -
465.tonto (max) -3.00% 267.000 259.000 - 0.00% -
470.lbm -2.78% 36.000 35.000 - 0.00% -
470.lbm (avg) -2.78% 36.000 35.000 - 0.00% -
434.zeusmp (avg) (percentage) -2.48% 1.210 1.180 - 0.00% -
416.gamess (max) (percentage) -2.22% 0.450 0.440 - 0.00% -
416.gamess (max) -2.13% 47.000 46.000 - 0.00% -
456.hmmer (avg) (percentage) -1.85% 0.540 0.530 - 0.00% -
435.gromacs (max) -1.12% 356.000 352.000 - 0.00% -

Added Tests - sample variability
436.cactusADM (unexplained diff vs previous)
436.cactusADM (unexplained diff vs previous) (percentage)
447.dealII (unexplained diff vs previous)
447.dealII (unexplained diff vs previous) (percentage)
462.libquantum (max)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
458.sjeng 3.88% 163891.000 170243.000 - 0.00% -
433.milc 2.86% 135823.000 139703.000 - 0.00% -
434.zeusmp 1.31% 308615.000 312655.000 - 0.00% -
459.GemsFDTD 1.19% 369814.000 374222.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
403.gcc 12.00% 50.000 56.000 - -1.75% -
454.calculix 8.70% 46.000 50.000 - -3.85% -
435.gromacs 8.18% 4949.000 5354.000 - 3.22% -
473.astar 6.26% 4651.000 4942.000 - 0.94% -
462.libquantum 5.13% 78.000 82.000 - -1.20% -
483.xalancbmk 5.11% 3212.000 3376.000 - 1.72% -
482.sphinx3 4.26% 752.000 784.000 - 1.55% -
465.tonto 3.23% 7891.000 8146.000 - 0.26% -
459.GemsFDTD 3.18% 4314.000 4451.000 - 0.32% -
470.lbm 2.99% 3274.000 3372.000 - 0.45% -
481.wrf 2.94% 2890.000 2975.000 - -4.46% -
464.h264ref 2.85% 3931.000 4043.000 - 0.55% -
401.bzip2 2.68% 2682.000 2754.000 - -0.11% -
445.gobmk 2.31% 4640.000 4747.000 - 0.66% -
400.perlbench 1.45% 1383.000 1403.000 - 0.57% -
471.omnetpp 1.15% 2341.000 2368.000 - -0.63% -
458.sjeng 1.12% 6447.000 6519.000 - -0.34% -
456.hmmer 1.04% 1928.000 1948.000 - -0.41% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
482.sphinx3 -2.04% 203848.000 199688.000 - 0.00% -
435.gromacs -1.21% 955190.000 943622.000 - 0.00% -
400.perlbench -1.10% 1281371.000 1267286.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
429.mcf -29.65% 2000.000 1407.000 - -1.68% -
436.cactusADM -3.63% 1654.000 1594.000 - 0.00% -
433.milc -3.02% 1059.000 1027.000 - 0.59% -
416.gamess -1.34% 10705.000 10562.000 - -0.10% -
450.soplex -1.29% 541.000 534.000 - 1.14% -
453.povray -1.20% 418.000 413.000 - 0.73% -

Added Tests - sample variability
400.perlbench
400.perlbench (avg)
400.perlbench (avg) (percentage)
400.perlbench (max)
400.perlbench (max) (percentage)
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
403.gcc
403.gcc (avg)
403.gcc (avg) (percentage)
403.gcc (max)
403.gcc (max) (percentage)
403.gcc (unexplained diff vs previous)
403.gcc (unexplained diff vs previous) (percentage)
410.bwaves
410.bwaves (avg)
410.bwaves (avg) (percentage)
410.bwaves (max)
410.bwaves (max) (percentage)
416.gamess
416.gamess (avg)
416.gamess (avg) (percentage)
416.gamess (max)
416.gamess (max) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
433.milc
433.milc (avg)
433.milc (avg) (percentage)
433.milc (max)
433.milc (max) (percentage)
434.zeusmp
434.zeusmp (avg)
434.zeusmp (avg) (percentage)
434.zeusmp (max)
434.zeusmp (max) (percentage)
435.gromacs
435.gromacs (avg)
435.gromacs (avg) (percentage)
435.gromacs (max)
435.gromacs (max) (percentage)
436.cactusADM
436.cactusADM (avg)
436.cactusADM (avg) (percentage)
436.cactusADM (max)
436.cactusADM (max) (percentage)
436.cactusADM (unexplained diff vs previous)
436.cactusADM (unexplained diff vs previous) (percentage)
437.leslie3d
437.leslie3d (avg)
437.leslie3d (avg) (percentage)
437.leslie3d (max)
437.leslie3d (max) (percentage)
444.namd
444.namd (avg)
444.namd (avg) (percentage)
444.namd (max)
444.namd (max) (percentage)
445.gobmk
445.gobmk (avg)
445.gobmk (avg) (percentage)
445.gobmk (max)
445.gobmk (max) (percentage)
447.dealII
447.dealII (avg)
447.dealII (avg) (percentage)
447.dealII (max)
447.dealII (max) (percentage)
450.soplex
450.soplex (avg)
450.soplex (avg) (percentage)
450.soplex (max)
450.soplex (max) (percentage)
453.povray
453.povray (avg)
453.povray (avg) (percentage)
453.povray (max)
453.povray (max) (percentage)
454.calculix
454.calculix (avg)
454.calculix (avg) (percentage)
454.calculix (max)
454.calculix (max) (percentage)
456.hmmer
456.hmmer (avg)
456.hmmer (avg) (percentage)
456.hmmer (max)
456.hmmer (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
459.GemsFDTD
459.GemsFDTD (avg)
459.GemsFDTD (avg) (percentage)
459.GemsFDTD (max)
459.GemsFDTD (max) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)
464.h264ref
464.h264ref (avg)
464.h264ref (avg) (percentage)
464.h264ref (max)
464.h264ref (max) (percentage)
465.tonto
465.tonto (avg)
465.tonto (avg) (percentage)
465.tonto (max)
465.tonto (max) (percentage)
470.lbm
470.lbm (avg)
470.lbm (avg) (percentage)
470.lbm (max)
470.lbm (max) (percentage)
471.omnetpp
471.omnetpp (avg)
471.omnetpp (avg) (percentage)
471.omnetpp (max)
471.omnetpp (max) (percentage)
473.astar
473.astar (avg)
473.astar (avg) (percentage)
473.astar (max)
473.astar (max) (percentage)
481.wrf
481.wrf (avg)
481.wrf (avg) (percentage)
481.wrf (max)
481.wrf (max) (percentage)
482.sphinx3
482.sphinx3 (avg)
482.sphinx3 (avg) (percentage)
482.sphinx3 (max)
482.sphinx3 (max) (percentage)
483.xalancbmk
483.xalancbmk (avg)
483.xalancbmk (avg) (percentage)
483.xalancbmk (max)
483.xalancbmk (max) (percentage)

Report Time: 0.37s
Execution (seconds)
Name Current %
400.perlbench 1403.000 -
401.bzip2 2754.000 -
403.gcc 56.000 -1.75%
410.bwaves 4258.000 -
416.gamess 10562.000 -
429.mcf 1407.000 -1.68%
433.milc 1027.000 -
434.zeusmp 1754.000 -
435.gromacs 5354.000 3.22%
436.cactusADM 1594.000 -
437.leslie3d 6860.000 -2.72%
444.namd 633.000 -
445.gobmk 4747.000 -
447.dealII 1314.000 -
450.soplex 534.000 1.14%
453.povray 413.000 -
454.calculix 50.000 -3.85%
456.hmmer 1948.000 -
458.sjeng 6519.000 -
459.GemsFDTD 4451.000 -
462.libquantum 82.000 -1.20%
464.h264ref 4043.000 -
465.tonto 8146.000 -
470.lbm 3372.000 -
471.omnetpp 2368.000 -
473.astar 4942.000 -
481.wrf 2975.000 -4.46%
482.sphinx3 784.000 1.55%
483.xalancbmk 3376.000 1.72%
Geometric Mean 1672.085 -
Code Size (bytes)
Name Current %
400.perlbench 1267286.000 -
401.bzip2 83645.000 -
403.gcc 3482468.000 -
410.bwaves 24380.000 -
416.gamess 8486835.000 -
429.mcf 12136.000 -
433.milc 139703.000 -
434.zeusmp 312655.000 -
435.gromacs 943622.000 -
436.cactusADM 857165.000 -
437.leslie3d 109634.000 -
444.namd 236518.000 -
445.gobmk 1663535.000 -
447.dealII 3197424.000 -
450.soplex 424742.000 -
453.povray 990982.000 -
454.calculix 1652353.000 -
456.hmmer 324711.000 -
458.sjeng 170243.000 -
459.GemsFDTD 374222.000 -
462.libquantum 40624.000 -
464.h264ref 736746.000 -
465.tonto 3964891.000 -
470.lbm 12741.000 -
471.omnetpp 682828.000 -
473.astar 41737.000 -
481.wrf 5102220.000 -
482.sphinx3 199688.000 -
483.xalancbmk 4650962.000 -
Geometric Mean 421624.293 -
sample variability
Name Current %
400.perlbench 25.000 -13.79%
400.perlbench (avg) 25.000 -13.79%
400.perlbench (avg) (percentage) 1.850 -12.32%
400.perlbench (max) 30.000 -3.23%
400.perlbench (max) (percentage) 2.140 -5.31%
400.perlbench (unexplained diff vs previous) 8.000 -65.22%
400.perlbench (unexplained diff vs previous) (percentage) 0.570 -65.45%
401.bzip2 51.000 -10.53%
401.bzip2 (avg) 51.000 -10.53%
401.bzip2 (avg) (percentage) 1.880 -10.48%
401.bzip2 (max) 96.000 -4.95%
401.bzip2 (max) (percentage) 3.520 -4.09%
401.bzip2 (unexplained diff vs previous) 3.000 -90.91%
401.bzip2 (unexplained diff vs previous) (percentage) 0.110 -90.83%
403.gcc 2.000 -
403.gcc (avg) 2.000 -
403.gcc (avg) (percentage) 4.310 -11.68%
403.gcc (max) 2.000 -33.33%
403.gcc (max) (percentage) 5.250 -5.58%
403.gcc (unexplained diff vs previous) 1.000 -66.67%
403.gcc (unexplained diff vs previous) (percentage) 1.790 -65.97%
410.bwaves 54.000 -8.47%
410.bwaves (avg) 54.000 -8.47%
410.bwaves (avg) (percentage) 1.280 -7.91%
410.bwaves (max) 144.000 -5.26%
410.bwaves (max) (percentage) 3.390 -5.57%
410.bwaves (unexplained diff vs previous) 4.000 -84.62%
410.bwaves (unexplained diff vs previous) (percentage) 0.090 -85.25%
416.gamess 21.000 -12.50%
416.gamess (avg) 21.000 -12.50%
416.gamess (avg) (percentage) 0.200 -13.04%
416.gamess (max) 46.000 -2.13%
416.gamess (max) (percentage) 0.440 -2.22%
416.gamess (unexplained diff vs previous) 11.000 -21.43%
416.gamess (unexplained diff vs previous) (percentage) 0.100 -23.08%
429.mcf 94.000 -7.84%
429.mcf (avg) 94.000 -7.84%
429.mcf (avg) (percentage) 6.710 -6.28%
429.mcf (max) 258.000 -5.84%
429.mcf (max) (percentage) 18.400 -3.97%
429.mcf (unexplained diff vs previous) 24.000 -
429.mcf (unexplained diff vs previous) (percentage) 1.710 1.79%
433.milc 13.000 -
433.milc (avg) 13.000 -
433.milc (avg) (percentage) 1.300 -5.11%
433.milc (max) 23.000 -4.17%
433.milc (max) (percentage) 2.300 -5.74%
433.milc (unexplained diff vs previous) 6.000 200.00%
433.milc (unexplained diff vs previous) (percentage) 0.580 190.00%
434.zeusmp 20.000 -4.76%
434.zeusmp (avg) 20.000 -4.76%
434.zeusmp (avg) (percentage) 1.180 -2.48%
434.zeusmp (max) 55.000 -3.51%
434.zeusmp (max) (percentage) 3.180 -3.93%
434.zeusmp (unexplained diff vs previous) 17.000 1600.00%
434.zeusmp (unexplained diff vs previous) (percentage) 0.970 1516.67%
435.gromacs 178.000 2.89%
435.gromacs (avg) 178.000 2.89%
435.gromacs (avg) (percentage) 3.340 -
435.gromacs (max) 352.000 -1.12%
435.gromacs (max) (percentage) 6.590 -4.08%
435.gromacs (unexplained diff vs previous) 167.000 943.75%
435.gromacs (unexplained diff vs previous) (percentage) 3.120 906.45%
436.cactusADM 12.000 -7.69%
436.cactusADM (avg) 12.000 -7.69%
436.cactusADM (avg) (percentage) 0.760 -8.43%
436.cactusADM (max) 6.000 -82.86%
436.cactusADM (max) (percentage) 0.380 -83.04%
436.cactusADM (unexplained diff vs previous) 0.000 -
436.cactusADM (unexplained diff vs previous) (percentage) 0.000 -
437.leslie3d 430.000 -8.51%
437.leslie3d (avg) 430.000 -8.51%
437.leslie3d (avg) (percentage) 6.270 -6.00%
437.leslie3d (max) 746.000 -9.25%
437.leslie3d (max) (percentage) 10.880 -6.69%
437.leslie3d (unexplained diff vs previous) 192.000 31.51%
437.leslie3d (unexplained diff vs previous) (percentage) 2.800 35.27%
444.namd 5.000 -
444.namd (avg) 5.000 -
444.namd (avg) (percentage) 0.800 -6.98%
444.namd (max) 7.000 -41.67%
444.namd (max) (percentage) 1.200 -40.00%
444.namd (unexplained diff vs previous) 2.000 -77.78%
444.namd (unexplained diff vs previous) (percentage) 0.320 -77.46%
445.gobmk 55.000 -5.17%
445.gobmk (avg) 55.000 -5.17%
445.gobmk (avg) (percentage) 1.170 -5.65%
445.gobmk (max) 72.000 -16.28%
445.gobmk (max) (percentage) 1.520 -16.94%
445.gobmk (unexplained diff vs previous) 31.000 -64.77%
445.gobmk (unexplained diff vs previous) (percentage) 0.650 -65.24%
447.dealII 12.000 -14.29%
447.dealII (avg) 12.000 -14.29%
447.dealII (avg) (percentage) 0.930 -15.45%
447.dealII (max) 19.000 -9.52%
447.dealII (max) (percentage) 1.480 -8.07%
447.dealII (unexplained diff vs previous) 2.000 -
447.dealII (unexplained diff vs previous) (percentage) 0.150 -
450.soplex 12.000 -7.69%
450.soplex (avg) 12.000 -7.69%
450.soplex (avg) (percentage) 2.350 -5.62%
450.soplex (max) 20.000 -4.76%
450.soplex (max) (percentage) 3.760 -5.76%
450.soplex (unexplained diff vs previous) 6.000 -25.00%
450.soplex (unexplained diff vs previous) (percentage) 1.120 -26.32%
453.povray 7.000 -12.50%
453.povray (avg) 7.000 -12.50%
453.povray (avg) (percentage) 1.830 -8.50%
453.povray (max) 10.000 -
453.povray (max) (percentage) 2.450 -6.13%
453.povray (unexplained diff vs previous) 3.000 -72.73%
453.povray (unexplained diff vs previous) (percentage) 0.730 -72.76%
454.calculix 1.000 -
454.calculix (avg) 1.000 -
454.calculix (avg) (percentage) 2.370 11.79%
454.calculix (max) 1.000 -
454.calculix (max) (percentage) 3.850 34.62%
454.calculix (unexplained diff vs previous) 2.000 100.00%
454.calculix (unexplained diff vs previous) (percentage) 4.000 108.33%
456.hmmer 10.000 -
456.hmmer (avg) 10.000 -
456.hmmer (avg) (percentage) 0.530 -1.85%
456.hmmer (max) 10.000 -58.33%
456.hmmer (max) (percentage) 0.560 -54.84%
456.hmmer (unexplained diff vs previous) 8.000 -38.46%
456.hmmer (unexplained diff vs previous) (percentage) 0.410 -37.88%
458.sjeng 50.000 -5.66%
458.sjeng (avg) 50.000 -5.66%
458.sjeng (avg) (percentage) 0.770 -6.10%
458.sjeng (max) 95.000 -6.86%
458.sjeng (max) (percentage) 1.460 -7.01%
458.sjeng (unexplained diff vs previous) 22.000 -33.33%
458.sjeng (unexplained diff vs previous) (percentage) 0.340 -32.00%
459.GemsFDTD 50.000 -7.41%
459.GemsFDTD (avg) 50.000 -7.41%
459.GemsFDTD (avg) (percentage) 1.130 -7.38%
459.GemsFDTD (max) 128.000 -4.48%
459.GemsFDTD (max) (percentage) 2.880 -4.95%
459.GemsFDTD (unexplained diff vs previous) 14.000 40.00%
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.310 34.78%
462.libquantum 1.000 -
462.libquantum (avg) 1.000 -
462.libquantum (avg) (percentage) 2.070 -3.72%
462.libquantum (max) 0.000 -
462.libquantum (max) (percentage) 1.200 -78.14%
462.libquantum (unexplained diff vs previous) 1.000 -
462.libquantum (unexplained diff vs previous) (percentage) 1.220 1.67%
464.h264ref 32.000 -5.88%
464.h264ref (avg) 32.000 -5.88%
464.h264ref (avg) (percentage) 0.810 -5.81%
464.h264ref (max) 25.000 -69.88%
464.h264ref (max) (percentage) 0.640 -69.08%
464.h264ref (unexplained diff vs previous) 22.000 -29.03%
464.h264ref (unexplained diff vs previous) (percentage) 0.540 -29.87%
465.tonto 98.000 -12.50%
465.tonto (avg) 98.000 -12.50%
465.tonto (avg) (percentage) 1.210 -12.32%
465.tonto (max) 259.000 -3.00%
465.tonto (max) (percentage) 3.190 -3.04%
465.tonto (unexplained diff vs previous) 21.000 50.00%
465.tonto (unexplained diff vs previous) (percentage) 0.260 52.94%
470.lbm 35.000 -2.78%
470.lbm (avg) 35.000 -2.78%
470.lbm (avg) (percentage) 1.050 -4.55%
470.lbm (max) 63.000 -4.55%
470.lbm (max) (percentage) 1.890 -5.03%
470.lbm (unexplained diff vs previous) 15.000 200.00%
470.lbm (unexplained diff vs previous) (percentage) 0.440 193.33%
471.omnetpp 51.000 -7.27%
471.omnetpp (avg) 51.000 -7.27%
471.omnetpp (avg) (percentage) 2.170 -6.06%
471.omnetpp (max) 59.000 -30.59%
471.omnetpp (max) (percentage) 2.500 -29.97%
471.omnetpp (unexplained diff vs previous) 15.000 -63.41%
471.omnetpp (unexplained diff vs previous) (percentage) 0.630 -63.37%
473.astar 97.000 -3.00%
473.astar (avg) 97.000 -3.00%
473.astar (avg) (percentage) 1.970 -4.37%
473.astar (max) 268.000 -4.29%
473.astar (max) (percentage) 5.430 -5.24%
473.astar (unexplained diff vs previous) 46.000 43.75%
473.astar (unexplained diff vs previous) (percentage) 0.930 43.08%
481.wrf 61.000 24.49%
481.wrf (avg) 61.000 24.49%
481.wrf (avg) (percentage) 2.060 30.38%
481.wrf (max) 132.000 53.49%
481.wrf (max) (percentage) 4.460 61.01%
481.wrf (unexplained diff vs previous) 139.000 65.48%
481.wrf (unexplained diff vs previous) (percentage) 4.670 72.96%
482.sphinx3 12.000 -
482.sphinx3 (avg) 12.000 -
482.sphinx3 (avg) (percentage) 1.610 -
482.sphinx3 (max) 22.000 -
482.sphinx3 (max) (percentage) 2.830 -4.71%
482.sphinx3 (unexplained diff vs previous) 12.000 50.00%
482.sphinx3 (unexplained diff vs previous) (percentage) 1.530 47.12%
483.xalancbmk 45.000 4.65%
483.xalancbmk (avg) 45.000 4.65%
483.xalancbmk (avg) (percentage) 1.360 3.03%
483.xalancbmk (max) 136.000 -3.55%
483.xalancbmk (max) (percentage) 4.030 -5.18%
483.xalancbmk (unexplained diff vs previous) 57.000 16.33%
483.xalancbmk (unexplained diff vs previous) (percentage) 1.690 14.19%
Geometric Mean 5.803 -25.89%