Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=34e2d487d89ad4a6f5c8a01370a884435388d17e (+ 33 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/ac7c9954ece9a75c5e7c3b76a4800f2432002487 (+ 100 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=1a62d7e5c396aa755f10d283dc3a6bc0eb496be4 (+ 7 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=7e83b5e75b20f49d4940bf35dfc1e38f3f95e5dc (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_vect-spec2k6--gnu-aarch64-master-O3-build/30/
View Options
Report
Filter

gnu-aarch64-master-O3 test results

Run Order Start Time Duration
Current 0030 (3-changed-components) 2023-05-02T22:34:22 0:00:00
Previous 0029 (-00000-) 2023-05-01T03:52:45 0:00:00
Baseline 0001 (4-changed-components) 2023-03-07T16:12:14 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 47 22
Performance Improvements 143 10
Added Tests 2 147
Unchanged Tests 1044 1057
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
403.gcc 5.56% 54.000 57.000 - 14.00% -
481.wrf 2.77% 3030.000 3114.000 - 7.75% -
437.leslie3d 2.11% 6906.000 7052.000 - 1.91% -
454.calculix 1.96% 51.000 52.000 - 13.04% -
471.omnetpp 1.75% 2342.000 2383.000 - 1.79% -
444.namd 1.44% 626.000 635.000 - 0.00% -
462.libquantum 1.22% 82.000 83.000 - 6.41% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
483.xalancbmk (unexplained diff vs previous) (percentage) 4833.33% 0.030 1.480 - 0.00% -
483.xalancbmk (unexplained diff vs previous) 4800.00% 1.000 49.000 - 0.00% -
481.wrf (unexplained diff vs previous) 1300.00% 6.000 84.000 - 0.00% -
481.wrf (unexplained diff vs previous) (percentage) 1250.00% 0.200 2.700 - 0.00% -
453.povray (unexplained diff vs previous) (percentage) 1016.67% 0.240 2.680 - 0.00% -
453.povray (unexplained diff vs previous) 1000.00% 1.000 11.000 - 0.00% -
456.hmmer (unexplained diff vs previous) 225.00% 4.000 13.000 - 0.00% -
456.hmmer (unexplained diff vs previous) (percentage) 214.29% 0.210 0.660 - 0.00% -
444.namd (unexplained diff vs previous) 200.00% 3.000 9.000 - 0.00% -
444.namd (unexplained diff vs previous) (percentage) 195.83% 0.480 1.420 - 0.00% -
436.cactusADM (unexplained diff vs previous) 166.67% 3.000 8.000 - 0.00% -
436.cactusADM (unexplained diff vs previous) (percentage) 163.16% 0.190 0.500 - 0.00% -
470.lbm (unexplained diff vs previous) 150.00% 2.000 5.000 - 0.00% -
470.lbm (unexplained diff vs previous) (percentage) 150.00% 0.060 0.150 - 0.00% -
464.h264ref (unexplained diff vs previous) (percentage) 108.11% 0.370 0.770 - 0.00% -
464.h264ref (unexplained diff vs previous) 106.67% 15.000 31.000 - 0.00% -
403.gcc (max) 50.00% 2.000 3.000 - 0.00% -
481.wrf (max) 43.33% 60.000 86.000 - 0.00% -
481.wrf (max) (percentage) 37.81% 2.010 2.770 - 0.00% -
481.wrf 25.64% 39.000 49.000 - 0.00% -
481.wrf (avg) 25.64% 39.000 49.000 - 0.00% -
444.namd 25.00% 4.000 5.000 - 0.00% -
444.namd (avg) 25.00% 4.000 5.000 - 0.00% -
481.wrf (avg) (percentage) 21.54% 1.300 1.580 - 0.00% -
403.gcc (max) (percentage) 18.80% 4.680 5.560 - 0.00% -
453.povray (max) (percentage) 15.49% 2.260 2.610 - 0.00% -
459.GemsFDTD (unexplained diff vs previous) (percentage) 15.00% 0.200 0.230 - 0.00% -
453.povray 14.29% 7.000 8.000 - 0.00% -
453.povray (avg) 14.29% 7.000 8.000 - 0.00% -
453.povray (max) 11.11% 9.000 10.000 - 0.00% -
459.GemsFDTD (unexplained diff vs previous) 11.11% 9.000 10.000 - 0.00% -
471.omnetpp (unexplained diff vs previous) 10.81% 37.000 41.000 - 0.00% -
444.namd (avg) (percentage) 8.86% 0.790 0.860 - 0.00% -
471.omnetpp (unexplained diff vs previous) (percentage) 8.86% 1.580 1.720 - 0.00% -
445.gobmk (avg) (percentage) 6.90% 1.160 1.240 - 0.00% -
445.gobmk 5.45% 55.000 58.000 - 0.00% -
445.gobmk (avg) 5.45% 55.000 58.000 - 0.00% -
453.povray (avg) (percentage) 5.26% 1.900 2.000 - 0.00% -
403.gcc (avg) (percentage) 4.05% 4.690 4.880 - 0.00% -
456.hmmer (avg) (percentage) 1.89% 0.530 0.540 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
453.povray -2.61% 421.000 410.000 - -1.91% -
445.gobmk -1.83% 4804.000 4716.000 - 1.64% -
429.mcf -1.65% 1455.000 1431.000 - -28.45% -
447.dealII -1.64% 1338.000 1316.000 - -0.68% -
400.perlbench -1.62% 1418.000 1395.000 - 0.87% -
450.soplex -1.49% 536.000 528.000 - -2.40% -
483.xalancbmk -1.45% 3368.000 3319.000 - 3.33% -
401.bzip2 -1.18% 2790.000 2757.000 - 2.80% -
482.sphinx3 -1.03% 780.000 772.000 - 2.66% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
465.tonto (unexplained diff vs previous) (percentage) -86.61% 1.270 0.170 - 0.00% -
465.tonto (unexplained diff vs previous) -86.41% 103.000 14.000 - 0.00% -
437.leslie3d (unexplained diff vs previous) (percentage) -86.14% 14.930 2.070 - 0.00% -
437.leslie3d (unexplained diff vs previous) -85.84% 1031.000 146.000 - 0.00% -
435.gromacs (unexplained diff vs previous) -84.62% 104.000 16.000 - 0.00% -
435.gromacs (unexplained diff vs previous) (percentage) -84.50% 2.000 0.310 - 0.00% -
416.gamess (unexplained diff vs previous) (percentage) -72.34% 0.470 0.130 - 0.00% -
416.gamess (unexplained diff vs previous) -72.00% 50.000 14.000 - 0.00% -
473.astar (unexplained diff vs previous) (percentage) -63.69% 1.790 0.650 - 0.00% -
473.astar (unexplained diff vs previous) -63.22% 87.000 32.000 - 0.00% -
433.milc (unexplained diff vs previous) -50.00% 4.000 2.000 - 0.00% -
433.milc (unexplained diff vs previous) (percentage) -48.72% 0.390 0.200 - 0.00% -
401.bzip2 (unexplained diff vs previous) -44.07% 59.000 33.000 - 0.00% -
401.bzip2 (unexplained diff vs previous) (percentage) -43.13% 2.110 1.200 - 0.00% -
400.perlbench (unexplained diff vs previous) -34.29% 35.000 23.000 - 0.00% -
400.perlbench (unexplained diff vs previous) (percentage) -33.20% 2.470 1.650 - 0.00% -
429.mcf (unexplained diff vs previous) -31.43% 35.000 24.000 - 0.00% -
445.gobmk (max) -30.65% 124.000 86.000 - 0.00% -
429.mcf (unexplained diff vs previous) (percentage) -30.29% 2.410 1.680 - 0.00% -
445.gobmk (max) (percentage) -29.62% 2.600 1.830 - 0.00% -
450.soplex (unexplained diff vs previous) -27.27% 11.000 8.000 - 0.00% -
482.sphinx3 (unexplained diff vs previous) -27.27% 11.000 8.000 - 0.00% -
482.sphinx3 (unexplained diff vs previous) (percentage) -26.24% 1.410 1.040 - 0.00% -
450.soplex (unexplained diff vs previous) (percentage) -25.85% 2.050 1.520 - 0.00% -
458.sjeng (unexplained diff vs previous) (percentage) -23.08% 0.650 0.500 - 0.00% -
458.sjeng (unexplained diff vs previous) -21.43% 42.000 33.000 - 0.00% -
465.tonto (avg) (percentage) -15.85% 1.640 1.380 - 0.00% -
465.tonto -15.79% 133.000 112.000 - 0.00% -
465.tonto (avg) -15.79% 133.000 112.000 - 0.00% -
416.gamess (avg) (percentage) -14.81% 0.270 0.230 - 0.00% -
416.gamess -14.29% 28.000 24.000 - 0.00% -
416.gamess (avg) -14.29% 28.000 24.000 - 0.00% -
400.perlbench (max) -13.89% 36.000 31.000 - 0.00% -
433.milc -13.33% 15.000 13.000 - 0.00% -
433.milc (avg) -13.33% 15.000 13.000 - 0.00% -
400.perlbench (max) (percentage) -13.08% 2.600 2.260 - 0.00% -
410.bwaves (unexplained diff vs previous) (percentage) -11.59% 0.690 0.610 - 0.00% -
435.gromacs -11.28% 195.000 173.000 - 0.00% -
435.gromacs (avg) -11.28% 195.000 173.000 - 0.00% -
433.milc (max) -11.11% 27.000 24.000 - 0.00% -
435.gromacs (avg) (percentage) -10.67% 3.750 3.350 - 0.00% -
410.bwaves (unexplained diff vs previous) -10.34% 29.000 26.000 - 0.00% -
437.leslie3d (max) (percentage) -10.24% 12.990 11.660 - 0.00% -
459.GemsFDTD -10.00% 60.000 54.000 - 0.00% -
459.GemsFDTD (avg) -10.00% 60.000 54.000 - 0.00% -
458.sjeng (max) (percentage) -9.77% 1.740 1.570 - 0.00% -
458.sjeng (max) -9.73% 113.000 102.000 - 0.00% -
434.zeusmp (avg) (percentage) -9.70% 1.340 1.210 - 0.00% -
459.GemsFDTD (avg) (percentage) -9.63% 1.350 1.220 - 0.00% -
434.zeusmp -8.70% 23.000 21.000 - 0.00% -
434.zeusmp (avg) -8.70% 23.000 21.000 - 0.00% -
450.soplex (max) -8.70% 23.000 21.000 - 0.00% -
437.leslie3d (max) -8.36% 897.000 822.000 - 0.00% -
482.sphinx3 (max) -8.33% 24.000 22.000 - 0.00% -
429.mcf -8.11% 111.000 102.000 - 0.00% -
429.mcf (avg) -8.11% 111.000 102.000 - 0.00% -
436.cactusADM (max) -7.89% 38.000 35.000 - 0.00% -
483.xalancbmk (max) -7.84% 153.000 141.000 - 0.00% -
437.leslie3d (avg) (percentage) -7.75% 7.230 6.670 - 0.00% -
429.mcf (max) -7.74% 297.000 274.000 - 0.00% -
444.namd (max) -7.69% 13.000 12.000 - 0.00% -
470.lbm -7.69% 39.000 36.000 - 0.00% -
470.lbm (avg) -7.69% 39.000 36.000 - 0.00% -
482.sphinx3 -7.69% 13.000 12.000 - 0.00% -
482.sphinx3 (avg) -7.69% 13.000 12.000 - 0.00% -
433.milc (max) (percentage) -7.58% 2.640 2.440 - 0.00% -
410.bwaves (max) (percentage) -7.47% 3.880 3.590 - 0.00% -
436.cactusADM (max) (percentage) -7.44% 2.420 2.240 - 0.00% -
450.soplex (max) (percentage) -7.42% 4.310 3.990 - 0.00% -
410.bwaves (max) -7.32% 164.000 152.000 - 0.00% -
470.lbm (max) -7.04% 71.000 66.000 - 0.00% -
433.milc (avg) (percentage) -6.80% 1.470 1.370 - 0.00% -
473.astar (avg) (percentage) -6.79% 2.210 2.060 - 0.00% -
470.lbm (avg) (percentage) -6.78% 1.180 1.100 - 0.00% -
429.mcf (avg) (percentage) -6.65% 7.670 7.160 - 0.00% -
462.libquantum (max) (percentage) -6.63% 5.880 5.490 - 0.00% -
482.sphinx3 (max) (percentage) -6.60% 3.180 2.970 - 0.00% -
483.xalancbmk (max) (percentage) -6.59% 4.550 4.250 - 0.00% -
401.bzip2 -6.56% 61.000 57.000 - 0.00% -
401.bzip2 (avg) -6.56% 61.000 57.000 - 0.00% -
473.astar -6.54% 107.000 100.000 - 0.00% -
473.astar (avg) -6.54% 107.000 100.000 - 0.00% -
400.perlbench -6.45% 31.000 29.000 - 0.00% -
400.perlbench (avg) -6.45% 31.000 29.000 - 0.00% -
445.gobmk (unexplained diff vs previous) -6.38% 94.000 88.000 - 0.00% -
473.astar (max) (percentage) -6.37% 6.120 5.730 - 0.00% -
429.mcf (max) (percentage) -6.26% 20.440 19.160 - 0.00% -
470.lbm (max) (percentage) -6.13% 2.120 1.990 - 0.00% -
444.namd (max) (percentage) -6.10% 2.130 2.000 - 0.00% -
456.hmmer (max) (percentage) -6.06% 1.320 1.240 - 0.00% -
437.leslie3d -5.81% 499.000 470.000 - 0.00% -
437.leslie3d (avg) -5.81% 499.000 470.000 - 0.00% -
400.perlbench (avg) (percentage) -5.80% 2.240 2.110 - 0.00% -
473.astar (max) -5.72% 297.000 280.000 - 0.00% -
459.GemsFDTD (max) -5.63% 142.000 134.000 - 0.00% -
459.GemsFDTD (max) (percentage) -5.61% 3.210 3.030 - 0.00% -
401.bzip2 (max) -5.61% 107.000 101.000 - 0.00% -
401.bzip2 (avg) (percentage) -5.41% 2.220 2.100 - 0.00% -
401.bzip2 (max) (percentage) -5.17% 3.870 3.670 - 0.00% -
435.gromacs (max) -5.07% 375.000 356.000 - 0.00% -
434.zeusmp (max) -5.00% 60.000 57.000 - 0.00% -
471.omnetpp (max) (percentage) -4.80% 3.750 3.570 - 0.00% -
410.bwaves (avg) (percentage) -4.79% 1.460 1.390 - 0.00% -
435.gromacs (max) (percentage) -4.72% 7.210 6.870 - 0.00% -
434.zeusmp (max) (percentage) -4.61% 3.470 3.310 - 0.00% -
464.h264ref (max) (percentage) -4.61% 2.170 2.070 - 0.00% -
436.cactusADM (avg) (percentage) -4.60% 0.870 0.830 - 0.00% -
464.h264ref (max) -4.60% 87.000 83.000 - 0.00% -
450.soplex (avg) (percentage) -4.60% 2.610 2.490 - 0.00% -
445.gobmk (unexplained diff vs previous) (percentage) -4.59% 1.960 1.870 - 0.00% -
447.dealII (max) -4.55% 22.000 21.000 - 0.00% -
416.gamess (max) (percentage) -4.26% 0.470 0.450 - 0.00% -
416.gamess (max) -4.08% 49.000 47.000 - 0.00% -
462.libquantum (avg) (percentage) -4.02% 2.240 2.150 - 0.00% -
456.hmmer (max) -4.00% 25.000 24.000 - 0.00% -
458.sjeng -3.64% 55.000 53.000 - 0.00% -
458.sjeng (avg) -3.64% 55.000 53.000 - 0.00% -
447.dealII (max) (percentage) -3.59% 1.670 1.610 - 0.00% -
482.sphinx3 (avg) (percentage) -3.59% 1.670 1.610 - 0.00% -
458.sjeng (avg) (percentage) -3.53% 0.850 0.820 - 0.00% -
410.bwaves -3.28% 61.000 59.000 - 0.00% -
410.bwaves (avg) -3.28% 61.000 59.000 - 0.00% -
465.tonto (max) -3.26% 276.000 267.000 - 0.00% -
465.tonto (max) (percentage) -3.24% 3.400 3.290 - 0.00% -
464.h264ref -2.86% 35.000 34.000 - 0.00% -
464.h264ref (avg) -2.86% 35.000 34.000 - 0.00% -
471.omnetpp (max) -2.30% 87.000 85.000 - 0.00% -
483.xalancbmk -2.27% 44.000 43.000 - 0.00% -
483.xalancbmk (avg) -2.27% 44.000 43.000 - 0.00% -
471.omnetpp (avg) (percentage) -2.12% 2.360 2.310 - 0.00% -
454.calculix (max) (percentage) -2.05% 2.920 2.860 - 0.00% -
462.libquantum (unexplained diff vs previous) (percentage) -1.64% 1.220 1.200 - 0.00% -
454.calculix (avg) (percentage) -1.40% 2.150 2.120 - 0.00% -
464.h264ref (avg) (percentage) -1.15% 0.870 0.860 - 0.00% -

Added Tests - sample variability
403.gcc (unexplained diff vs previous)
403.gcc (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
458.sjeng 3.88% 163891.000 170243.000 - 0.00% -
433.milc 2.86% 135823.000 139703.000 - 0.00% -
434.zeusmp 1.31% 308615.000 312655.000 - 0.00% -
459.GemsFDTD 1.19% 369814.000 374222.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
403.gcc 14.00% 50.000 57.000 - 5.56% -
454.calculix 13.04% 46.000 52.000 - 1.96% -
481.wrf 7.75% 2890.000 3114.000 - 2.77% -
462.libquantum 6.41% 78.000 83.000 - 1.22% -
473.astar 5.27% 4651.000 4896.000 - 0.66% -
435.gromacs 4.81% 4949.000 5187.000 - -0.31% -
483.xalancbmk 3.33% 3212.000 3319.000 - -1.45% -
465.tonto 2.97% 7891.000 8125.000 - -0.17% -
459.GemsFDTD 2.85% 4314.000 4437.000 - -0.22% -
401.bzip2 2.80% 2682.000 2757.000 - -1.18% -
482.sphinx3 2.66% 752.000 772.000 - -1.03% -
470.lbm 2.54% 3274.000 3357.000 - 0.15% -
464.h264ref 2.29% 3931.000 4021.000 - -0.77% -
437.leslie3d 1.91% 6920.000 7052.000 - 2.11% -
471.omnetpp 1.79% 2341.000 2383.000 - 1.75% -
445.gobmk 1.64% 4640.000 4716.000 - -1.83% -
458.sjeng 1.46% 6447.000 6541.000 - 0.51% -
456.hmmer 1.45% 1928.000 1956.000 - 0.67% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
482.sphinx3 -2.04% 203848.000 199688.000 - 0.00% -
435.gromacs -1.21% 955190.000 943622.000 - 0.00% -
400.perlbench -1.10% 1281371.000 1267286.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
429.mcf -28.45% 2000.000 1431.000 - -1.65% -
436.cactusADM -3.63% 1654.000 1594.000 - 0.50% -
433.milc -3.59% 1059.000 1021.000 - -0.20% -
450.soplex -2.40% 541.000 528.000 - -1.49% -
453.povray -1.91% 418.000 410.000 - -2.61% -
434.zeusmp -1.25% 1759.000 1737.000 - -0.06% -
416.gamess -1.23% 10705.000 10573.000 - -0.13% -

Added Tests - sample variability
400.perlbench
400.perlbench (avg)
400.perlbench (avg) (percentage)
400.perlbench (max)
400.perlbench (max) (percentage)
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
403.gcc
403.gcc (avg)
403.gcc (avg) (percentage)
403.gcc (max)
403.gcc (max) (percentage)
403.gcc (unexplained diff vs previous)
403.gcc (unexplained diff vs previous) (percentage)
410.bwaves
410.bwaves (avg)
410.bwaves (avg) (percentage)
410.bwaves (max)
410.bwaves (max) (percentage)
416.gamess
416.gamess (avg)
416.gamess (avg) (percentage)
416.gamess (max)
416.gamess (max) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
433.milc
433.milc (avg)
433.milc (avg) (percentage)
433.milc (max)
433.milc (max) (percentage)
434.zeusmp
434.zeusmp (avg)
434.zeusmp (avg) (percentage)
434.zeusmp (max)
434.zeusmp (max) (percentage)
435.gromacs
435.gromacs (avg)
435.gromacs (avg) (percentage)
435.gromacs (max)
435.gromacs (max) (percentage)
436.cactusADM
436.cactusADM (avg)
436.cactusADM (avg) (percentage)
436.cactusADM (max)
436.cactusADM (max) (percentage)
437.leslie3d
437.leslie3d (avg)
437.leslie3d (avg) (percentage)
437.leslie3d (max)
437.leslie3d (max) (percentage)
444.namd
444.namd (avg)
444.namd (avg) (percentage)
444.namd (max)
444.namd (max) (percentage)
445.gobmk
445.gobmk (avg)
445.gobmk (avg) (percentage)
445.gobmk (max)
445.gobmk (max) (percentage)
447.dealII
447.dealII (avg)
447.dealII (avg) (percentage)
447.dealII (max)
447.dealII (max) (percentage)
450.soplex
450.soplex (avg)
450.soplex (avg) (percentage)
450.soplex (max)
450.soplex (max) (percentage)
453.povray
453.povray (avg)
453.povray (avg) (percentage)
453.povray (max)
453.povray (max) (percentage)
454.calculix
454.calculix (avg)
454.calculix (avg) (percentage)
454.calculix (max)
454.calculix (max) (percentage)
456.hmmer
456.hmmer (avg)
456.hmmer (avg) (percentage)
456.hmmer (max)
456.hmmer (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
459.GemsFDTD
459.GemsFDTD (avg)
459.GemsFDTD (avg) (percentage)
459.GemsFDTD (max)
459.GemsFDTD (max) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)
464.h264ref
464.h264ref (avg)
464.h264ref (avg) (percentage)
464.h264ref (max)
464.h264ref (max) (percentage)
465.tonto
465.tonto (avg)
465.tonto (avg) (percentage)
465.tonto (max)
465.tonto (max) (percentage)
470.lbm
470.lbm (avg)
470.lbm (avg) (percentage)
470.lbm (max)
470.lbm (max) (percentage)
471.omnetpp
471.omnetpp (avg)
471.omnetpp (avg) (percentage)
471.omnetpp (max)
471.omnetpp (max) (percentage)
473.astar
473.astar (avg)
473.astar (avg) (percentage)
473.astar (max)
473.astar (max) (percentage)
481.wrf
481.wrf (avg)
481.wrf (avg) (percentage)
481.wrf (max)
481.wrf (max) (percentage)
482.sphinx3
482.sphinx3 (avg)
482.sphinx3 (avg) (percentage)
482.sphinx3 (max)
482.sphinx3 (max) (percentage)
483.xalancbmk
483.xalancbmk (avg)
483.xalancbmk (avg) (percentage)
483.xalancbmk (max)
483.xalancbmk (max) (percentage)

Report Time: 0.36s
Execution (seconds)
Name Current %
400.perlbench 1395.000 -1.62%
401.bzip2 2757.000 -1.18%
403.gcc 57.000 5.56%
410.bwaves 4254.000 -
416.gamess 10573.000 -
429.mcf 1431.000 -1.65%
433.milc 1021.000 -
434.zeusmp 1737.000 -
435.gromacs 5187.000 -
436.cactusADM 1594.000 -
437.leslie3d 7052.000 2.11%
444.namd 635.000 1.44%
445.gobmk 4716.000 -1.83%
447.dealII 1316.000 -1.64%
450.soplex 528.000 -1.49%
453.povray 410.000 -2.61%
454.calculix 52.000 1.96%
456.hmmer 1956.000 -
458.sjeng 6541.000 -
459.GemsFDTD 4437.000 -
462.libquantum 83.000 1.22%
464.h264ref 4021.000 -
465.tonto 8125.000 -
470.lbm 3357.000 -
471.omnetpp 2383.000 1.75%
473.astar 4896.000 -
481.wrf 3114.000 2.77%
482.sphinx3 772.000 -1.03%
483.xalancbmk 3319.000 -1.45%
Geometric Mean 1674.582 -
Code Size (bytes)
Name Current %
400.perlbench 1267286.000 -
401.bzip2 83645.000 -
403.gcc 3482468.000 -
410.bwaves 24380.000 -
416.gamess 8486835.000 -
429.mcf 12136.000 -
433.milc 139703.000 -
434.zeusmp 312655.000 -
435.gromacs 943622.000 -
436.cactusADM 857181.000 -
437.leslie3d 109634.000 -
444.namd 236518.000 -
445.gobmk 1663535.000 -
447.dealII 3197424.000 -
450.soplex 424742.000 -
453.povray 990982.000 -
454.calculix 1652353.000 -
456.hmmer 324711.000 -
458.sjeng 170243.000 -
459.GemsFDTD 374222.000 -
462.libquantum 40624.000 -
464.h264ref 736746.000 -
465.tonto 3964891.000 -
470.lbm 12741.000 -
471.omnetpp 682828.000 -
473.astar 41737.000 -
481.wrf 5102220.000 -
482.sphinx3 199688.000 -
483.xalancbmk 4650962.000 -
Geometric Mean 421624.564 -
sample variability
Name Current %
400.perlbench 29.000 -6.45%
400.perlbench (avg) 29.000 -6.45%
400.perlbench (avg) (percentage) 2.110 -5.80%
400.perlbench (max) 31.000 -13.89%
400.perlbench (max) (percentage) 2.260 -13.08%
400.perlbench (unexplained diff vs previous) 23.000 -34.29%
400.perlbench (unexplained diff vs previous) (percentage) 1.650 -33.20%
401.bzip2 57.000 -6.56%
401.bzip2 (avg) 57.000 -6.56%
401.bzip2 (avg) (percentage) 2.100 -5.41%
401.bzip2 (max) 101.000 -5.61%
401.bzip2 (max) (percentage) 3.670 -5.17%
401.bzip2 (unexplained diff vs previous) 33.000 -44.07%
401.bzip2 (unexplained diff vs previous) (percentage) 1.200 -43.13%
403.gcc 2.000 -
403.gcc (avg) 2.000 -
403.gcc (avg) (percentage) 4.880 4.05%
403.gcc (max) 3.000 50.00%
403.gcc (max) (percentage) 5.560 18.80%
403.gcc (unexplained diff vs previous) 3.000 -
403.gcc (unexplained diff vs previous) (percentage) 5.260 -
410.bwaves 59.000 -3.28%
410.bwaves (avg) 59.000 -3.28%
410.bwaves (avg) (percentage) 1.390 -4.79%
410.bwaves (max) 152.000 -7.32%
410.bwaves (max) (percentage) 3.590 -7.47%
410.bwaves (unexplained diff vs previous) 26.000 -10.34%
410.bwaves (unexplained diff vs previous) (percentage) 0.610 -11.59%
416.gamess 24.000 -14.29%
416.gamess (avg) 24.000 -14.29%
416.gamess (avg) (percentage) 0.230 -14.81%
416.gamess (max) 47.000 -4.08%
416.gamess (max) (percentage) 0.450 -4.26%
416.gamess (unexplained diff vs previous) 14.000 -72.00%
416.gamess (unexplained diff vs previous) (percentage) 0.130 -72.34%
429.mcf 102.000 -8.11%
429.mcf (avg) 102.000 -8.11%
429.mcf (avg) (percentage) 7.160 -6.65%
429.mcf (max) 274.000 -7.74%
429.mcf (max) (percentage) 19.160 -6.26%
429.mcf (unexplained diff vs previous) 24.000 -31.43%
429.mcf (unexplained diff vs previous) (percentage) 1.680 -30.29%
433.milc 13.000 -13.33%
433.milc (avg) 13.000 -13.33%
433.milc (avg) (percentage) 1.370 -6.80%
433.milc (max) 24.000 -11.11%
433.milc (max) (percentage) 2.440 -7.58%
433.milc (unexplained diff vs previous) 2.000 -50.00%
433.milc (unexplained diff vs previous) (percentage) 0.200 -48.72%
434.zeusmp 21.000 -8.70%
434.zeusmp (avg) 21.000 -8.70%
434.zeusmp (avg) (percentage) 1.210 -9.70%
434.zeusmp (max) 57.000 -5.00%
434.zeusmp (max) (percentage) 3.310 -4.61%
434.zeusmp (unexplained diff vs previous) 1.000 -
434.zeusmp (unexplained diff vs previous) (percentage) 0.060 -
435.gromacs 173.000 -11.28%
435.gromacs (avg) 173.000 -11.28%
435.gromacs (avg) (percentage) 3.350 -10.67%
435.gromacs (max) 356.000 -5.07%
435.gromacs (max) (percentage) 6.870 -4.72%
435.gromacs (unexplained diff vs previous) 16.000 -84.62%
435.gromacs (unexplained diff vs previous) (percentage) 0.310 -84.50%
436.cactusADM 13.000 -
436.cactusADM (avg) 13.000 -
436.cactusADM (avg) (percentage) 0.830 -4.60%
436.cactusADM (max) 35.000 -7.89%
436.cactusADM (max) (percentage) 2.240 -7.44%
436.cactusADM (unexplained diff vs previous) 8.000 166.67%
436.cactusADM (unexplained diff vs previous) (percentage) 0.500 163.16%
437.leslie3d 470.000 -5.81%
437.leslie3d (avg) 470.000 -5.81%
437.leslie3d (avg) (percentage) 6.670 -7.75%
437.leslie3d (max) 822.000 -8.36%
437.leslie3d (max) (percentage) 11.660 -10.24%
437.leslie3d (unexplained diff vs previous) 146.000 -85.84%
437.leslie3d (unexplained diff vs previous) (percentage) 2.070 -86.14%
444.namd 5.000 25.00%
444.namd (avg) 5.000 25.00%
444.namd (avg) (percentage) 0.860 8.86%
444.namd (max) 12.000 -7.69%
444.namd (max) (percentage) 2.000 -6.10%
444.namd (unexplained diff vs previous) 9.000 200.00%
444.namd (unexplained diff vs previous) (percentage) 1.420 195.83%
445.gobmk 58.000 5.45%
445.gobmk (avg) 58.000 5.45%
445.gobmk (avg) (percentage) 1.240 6.90%
445.gobmk (max) 86.000 -30.65%
445.gobmk (max) (percentage) 1.830 -29.62%
445.gobmk (unexplained diff vs previous) 88.000 -6.38%
445.gobmk (unexplained diff vs previous) (percentage) 1.870 -4.59%
447.dealII 14.000 -
447.dealII (avg) 14.000 -
447.dealII (avg) (percentage) 1.100 -
447.dealII (max) 21.000 -4.55%
447.dealII (max) (percentage) 1.610 -3.59%
450.soplex 13.000 -
450.soplex (avg) 13.000 -
450.soplex (avg) (percentage) 2.490 -4.60%
450.soplex (max) 21.000 -8.70%
450.soplex (max) (percentage) 3.990 -7.42%
450.soplex (unexplained diff vs previous) 8.000 -27.27%
450.soplex (unexplained diff vs previous) (percentage) 1.520 -25.85%
453.povray 8.000 14.29%
453.povray (avg) 8.000 14.29%
453.povray (avg) (percentage) 2.000 5.26%
453.povray (max) 10.000 11.11%
453.povray (max) (percentage) 2.610 15.49%
453.povray (unexplained diff vs previous) 11.000 1000.00%
453.povray (unexplained diff vs previous) (percentage) 2.680 1016.67%
454.calculix 1.000 -
454.calculix (avg) 1.000 -
454.calculix (avg) (percentage) 2.120 -1.40%
454.calculix (max) 1.000 -
454.calculix (max) (percentage) 2.860 -2.05%
454.calculix (unexplained diff vs previous) 1.000 -
454.calculix (unexplained diff vs previous) (percentage) 1.920 -
456.hmmer 10.000 -
456.hmmer (avg) 10.000 -
456.hmmer (avg) (percentage) 0.540 1.89%
456.hmmer (max) 24.000 -4.00%
456.hmmer (max) (percentage) 1.240 -6.06%
456.hmmer (unexplained diff vs previous) 13.000 225.00%
456.hmmer (unexplained diff vs previous) (percentage) 0.660 214.29%
458.sjeng 53.000 -3.64%
458.sjeng (avg) 53.000 -3.64%
458.sjeng (avg) (percentage) 0.820 -3.53%
458.sjeng (max) 102.000 -9.73%
458.sjeng (max) (percentage) 1.570 -9.77%
458.sjeng (unexplained diff vs previous) 33.000 -21.43%
458.sjeng (unexplained diff vs previous) (percentage) 0.500 -23.08%
459.GemsFDTD 54.000 -10.00%
459.GemsFDTD (avg) 54.000 -10.00%
459.GemsFDTD (avg) (percentage) 1.220 -9.63%
459.GemsFDTD (max) 134.000 -5.63%
459.GemsFDTD (max) (percentage) 3.030 -5.61%
459.GemsFDTD (unexplained diff vs previous) 10.000 11.11%
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.230 15.00%
462.libquantum 1.000 -
462.libquantum (avg) 1.000 -
462.libquantum (avg) (percentage) 2.150 -4.02%
462.libquantum (max) 4.000 -
462.libquantum (max) (percentage) 5.490 -6.63%
462.libquantum (unexplained diff vs previous) 1.000 -
462.libquantum (unexplained diff vs previous) (percentage) 1.200 -1.64%
464.h264ref 34.000 -2.86%
464.h264ref (avg) 34.000 -2.86%
464.h264ref (avg) (percentage) 0.860 -1.15%
464.h264ref (max) 83.000 -4.60%
464.h264ref (max) (percentage) 2.070 -4.61%
464.h264ref (unexplained diff vs previous) 31.000 106.67%
464.h264ref (unexplained diff vs previous) (percentage) 0.770 108.11%
465.tonto 112.000 -15.79%
465.tonto (avg) 112.000 -15.79%
465.tonto (avg) (percentage) 1.380 -15.85%
465.tonto (max) 267.000 -3.26%
465.tonto (max) (percentage) 3.290 -3.24%
465.tonto (unexplained diff vs previous) 14.000 -86.41%
465.tonto (unexplained diff vs previous) (percentage) 0.170 -86.61%
470.lbm 36.000 -7.69%
470.lbm (avg) 36.000 -7.69%
470.lbm (avg) (percentage) 1.100 -6.78%
470.lbm (max) 66.000 -7.04%
470.lbm (max) (percentage) 1.990 -6.13%
470.lbm (unexplained diff vs previous) 5.000 150.00%
470.lbm (unexplained diff vs previous) (percentage) 0.150 150.00%
471.omnetpp 55.000 -
471.omnetpp (avg) 55.000 -
471.omnetpp (avg) (percentage) 2.310 -2.12%
471.omnetpp (max) 85.000 -2.30%
471.omnetpp (max) (percentage) 3.570 -4.80%
471.omnetpp (unexplained diff vs previous) 41.000 10.81%
471.omnetpp (unexplained diff vs previous) (percentage) 1.720 8.86%
473.astar 100.000 -6.54%
473.astar (avg) 100.000 -6.54%
473.astar (avg) (percentage) 2.060 -6.79%
473.astar (max) 280.000 -5.72%
473.astar (max) (percentage) 5.730 -6.37%
473.astar (unexplained diff vs previous) 32.000 -63.22%
473.astar (unexplained diff vs previous) (percentage) 0.650 -63.69%
481.wrf 49.000 25.64%
481.wrf (avg) 49.000 25.64%
481.wrf (avg) (percentage) 1.580 21.54%
481.wrf (max) 86.000 43.33%
481.wrf (max) (percentage) 2.770 37.81%
481.wrf (unexplained diff vs previous) 84.000 1300.00%
481.wrf (unexplained diff vs previous) (percentage) 2.700 1250.00%
482.sphinx3 12.000 -7.69%
482.sphinx3 (avg) 12.000 -7.69%
482.sphinx3 (avg) (percentage) 1.610 -3.59%
482.sphinx3 (max) 22.000 -8.33%
482.sphinx3 (max) (percentage) 2.970 -6.60%
482.sphinx3 (unexplained diff vs previous) 8.000 -27.27%
482.sphinx3 (unexplained diff vs previous) (percentage) 1.040 -26.24%
483.xalancbmk 43.000 -2.27%
483.xalancbmk (avg) 43.000 -2.27%
483.xalancbmk (avg) (percentage) 1.320 -
483.xalancbmk (max) 141.000 -7.84%
483.xalancbmk (max) (percentage) 4.250 -6.59%
483.xalancbmk (unexplained diff vs previous) 49.000 4800.00%
483.xalancbmk (unexplained diff vs previous) (percentage) 1.480 4833.33%
Geometric Mean 7.698 9.68%