Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=41770089162edd23ea7ae33b7952585316accde5 (unchanged)
git_gcc https://github.com/gcc-mirror/gcc/commit/af29d0d6b75f9e5ad69820488972027fe4634850 (+ 3 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=d2123d68275acc0f061e73d5f86ca504e0d5a344 (unchanged)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=569306fa74e3adbe699e8548698815473469e440 (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_vect-spec2k6--gnu-aarch64-master-O3_LTO-build/104/
View Options
Report
Filter

gnu-aarch64-master-O3_LTO test results

Run Order Start Time Duration
Current 0104 (basepoints/gcc-14-01908-gaf29d0d6b75) 2023-08-30T07:07:07 0:00:00
Previous 0102 (2-changed-components) 2023-08-27T12:01:14 0:00:00
Baseline 0001 (4-changed-components) 2023-03-08T03:13:34 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 50 22
Performance Improvements 136 6
Added Tests 2 149
Unchanged Tests 1048 1059
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
483.xalancbmk 3.60% 2753.000 2852.000 - 3.71% -
444.namd 3.51% 627.000 649.000 - 5.02% -
435.gromacs 3.01% 5176.000 5332.000 - 6.83% -
481.wrf 1.08% 3065.000 3098.000 - 3.30% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
464.h264ref (unexplained diff vs previous) 2600.00% 1.000 27.000 - 0.00% -
464.h264ref (unexplained diff vs previous) (percentage) 2200.00% 0.030 0.690 - 0.00% -
435.gromacs (unexplained diff vs previous) 550.00% 24.000 156.000 - 0.00% -
435.gromacs (unexplained diff vs previous) (percentage) 536.96% 0.460 2.930 - 0.00% -
450.soplex (unexplained diff vs previous) 400.00% 1.000 5.000 - 0.00% -
450.soplex (unexplained diff vs previous) (percentage) 384.21% 0.190 0.920 - 0.00% -
456.hmmer (unexplained diff vs previous) (percentage) 300.00% 0.050 0.200 - 0.00% -
456.hmmer (unexplained diff vs previous) 300.00% 1.000 4.000 - 0.00% -
459.GemsFDTD (unexplained diff vs previous) (percentage) 163.64% 0.110 0.290 - 0.00% -
459.GemsFDTD (unexplained diff vs previous) 160.00% 5.000 13.000 - 0.00% -
410.bwaves (unexplained diff vs previous) 150.00% 2.000 5.000 - 0.00% -
410.bwaves (unexplained diff vs previous) (percentage) 140.00% 0.050 0.120 - 0.00% -
433.milc (unexplained diff vs previous) 100.00% 3.000 6.000 - 0.00% -
433.milc (unexplained diff vs previous) (percentage) 100.00% 0.310 0.620 - 0.00% -
444.namd (max) 100.00% 11.000 22.000 - 0.00% -
435.gromacs (max) 95.12% 82.000 160.000 - 0.00% -
435.gromacs (max) (percentage) 88.12% 1.600 3.010 - 0.00% -
444.namd (max) (percentage) 87.70% 1.870 3.510 - 0.00% -
458.sjeng (unexplained diff vs previous) (percentage) 62.50% 0.080 0.130 - 0.00% -
458.sjeng (unexplained diff vs previous) 60.00% 5.000 8.000 - 0.00% -
433.milc (max) 50.00% 4.000 6.000 - 0.00% -
433.milc (max) (percentage) 34.78% 0.460 0.620 - 0.00% -
464.h264ref (max) (percentage) 30.77% 0.520 0.680 - 0.00% -
429.mcf (unexplained diff vs previous) (percentage) 30.00% 0.700 0.910 - 0.00% -
429.mcf (unexplained diff vs previous) 30.00% 10.000 13.000 - 0.00% -
464.h264ref (max) 30.00% 20.000 26.000 - 0.00% -
444.namd 16.67% 6.000 7.000 - 0.00% -
444.namd (avg) 16.67% 6.000 7.000 - 0.00% -
400.perlbench (unexplained diff vs previous) (percentage) 12.60% 1.270 1.430 - 0.00% -
445.gobmk (unexplained diff vs previous) 12.50% 32.000 36.000 - 0.00% -
444.namd (avg) (percentage) 12.50% 1.040 1.170 - 0.00% -
445.gobmk (unexplained diff vs previous) (percentage) 11.27% 0.710 0.790 - 0.00% -
400.perlbench (unexplained diff vs previous) 11.11% 18.000 20.000 - 0.00% -
483.xalancbmk (max) 10.87% 92.000 102.000 - 0.00% -
434.zeusmp (unexplained diff vs previous) (percentage) 8.11% 0.740 0.800 - 0.00% -
434.zeusmp (unexplained diff vs previous) 7.69% 13.000 14.000 - 0.00% -
483.xalancbmk (max) (percentage) 6.82% 3.370 3.600 - 0.00% -
483.xalancbmk 5.26% 76.000 80.000 - 0.00% -
483.xalancbmk (avg) 5.26% 76.000 80.000 - 0.00% -
435.gromacs 4.58% 131.000 137.000 - 0.00% -
435.gromacs (avg) 4.58% 131.000 137.000 - 0.00% -
483.xalancbmk (unexplained diff vs previous) 3.12% 96.000 99.000 - 0.00% -
403.gcc (unexplained diff vs previous) (percentage) 2.16% 1.850 1.890 - 0.00% -
483.xalancbmk (avg) (percentage) 1.81% 2.770 2.820 - 0.00% -
462.libquantum (unexplained diff vs previous) (percentage) 1.67% 1.200 1.220 - 0.00% -
435.gromacs (avg) (percentage) 1.18% 2.540 2.570 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
437.leslie3d -1.98% 7016.000 6877.000 - 2.18% -
403.gcc -1.85% 54.000 53.000 - 10.42% -
400.perlbench -1.41% 1418.000 1398.000 - 3.25% -
462.libquantum -1.20% 83.000 82.000 - 2.50% -
482.sphinx3 -1.03% 779.000 771.000 - 0.00% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
471.omnetpp (unexplained diff vs previous) -93.33% 60.000 4.000 - 0.00% -
471.omnetpp (unexplained diff vs previous) (percentage) -93.31% 2.840 0.190 - 0.00% -
447.dealII (unexplained diff vs previous) (percentage) -85.71% 1.400 0.200 - 0.00% -
447.dealII (unexplained diff vs previous) -85.71% 14.000 2.000 - 0.00% -
453.povray (unexplained diff vs previous) (percentage) -78.76% 3.720 0.790 - 0.00% -
453.povray (unexplained diff vs previous) -78.57% 14.000 3.000 - 0.00% -
416.gamess (unexplained diff vs previous) -78.12% 32.000 7.000 - 0.00% -
416.gamess (unexplained diff vs previous) (percentage) -77.42% 0.310 0.070 - 0.00% -
436.cactusADM (unexplained diff vs previous) (percentage) -56.14% 0.570 0.250 - 0.00% -
437.leslie3d (unexplained diff vs previous) -56.01% 316.000 139.000 - 0.00% -
436.cactusADM (unexplained diff vs previous) -55.56% 9.000 4.000 - 0.00% -
437.leslie3d (unexplained diff vs previous) (percentage) -55.11% 4.500 2.020 - 0.00% -
465.tonto (unexplained diff vs previous) (percentage) -54.41% 0.680 0.310 - 0.00% -
465.tonto (unexplained diff vs previous) -54.10% 61.000 28.000 - 0.00% -
403.gcc -50.00% 2.000 1.000 - 0.00% -
403.gcc (avg) -50.00% 2.000 1.000 - 0.00% -
473.astar (unexplained diff vs previous) (percentage) -46.88% 0.320 0.170 - 0.00% -
473.astar (unexplained diff vs previous) -46.67% 15.000 8.000 - 0.00% -
437.leslie3d (max) -43.51% 393.000 222.000 - 0.00% -
437.leslie3d (max) (percentage) -42.42% 5.610 3.230 - 0.00% -
482.sphinx3 (unexplained diff vs previous) -38.46% 13.000 8.000 - 0.00% -
482.sphinx3 (max) (percentage) -37.85% 2.510 1.560 - 0.00% -
482.sphinx3 (unexplained diff vs previous) (percentage) -37.72% 1.670 1.040 - 0.00% -
482.sphinx3 (max) -36.84% 19.000 12.000 - 0.00% -
447.dealII (max) -26.67% 15.000 11.000 - 0.00% -
447.dealII (max) (percentage) -25.32% 1.580 1.180 - 0.00% -
436.cactusADM (max) -22.22% 9.000 7.000 - 0.00% -
481.wrf (unexplained diff vs previous) (percentage) -20.15% 1.340 1.070 - 0.00% -
481.wrf (unexplained diff vs previous) -19.51% 41.000 33.000 - 0.00% -
416.gamess (max) -18.75% 32.000 26.000 - 0.00% -
436.cactusADM (max) (percentage) -17.54% 0.570 0.470 - 0.00% -
470.lbm (unexplained diff vs previous) (percentage) -16.22% 0.370 0.310 - 0.00% -
416.gamess (max) (percentage) -16.13% 0.310 0.260 - 0.00% -
470.lbm (unexplained diff vs previous) -15.38% 13.000 11.000 - 0.00% -
465.tonto (max) -13.11% 61.000 53.000 - 0.00% -
465.tonto (max) (percentage) -13.04% 0.690 0.600 - 0.00% -
401.bzip2 (unexplained diff vs previous) -12.50% 8.000 7.000 - 0.00% -
401.bzip2 (max) -11.76% 17.000 15.000 - 0.00% -
470.lbm (max) -11.54% 26.000 23.000 - 0.00% -
481.wrf (max) (percentage) -11.26% 1.510 1.340 - 0.00% -
456.hmmer -11.11% 9.000 8.000 - 0.00% -
456.hmmer (avg) -11.11% 9.000 8.000 - 0.00% -
401.bzip2 (max) (percentage) -10.94% 0.640 0.570 - 0.00% -
450.soplex (max) (percentage) -10.91% 1.100 0.980 - 0.00% -
481.wrf (max) -10.87% 46.000 41.000 - 0.00% -
401.bzip2 (unexplained diff vs previous) (percentage) -10.34% 0.290 0.260 - 0.00% -
453.povray (max) (percentage) -10.03% 3.590 3.230 - 0.00% -
470.lbm (max) (percentage) -9.46% 0.740 0.670 - 0.00% -
410.bwaves (max) (percentage) -9.38% 0.320 0.290 - 0.00% -
458.sjeng (max) (percentage) -9.09% 0.220 0.200 - 0.00% -
471.omnetpp (max) -8.62% 58.000 53.000 - 0.00% -
471.omnetpp (max) (percentage) -8.33% 2.760 2.530 - 0.00% -
456.hmmer (max) (percentage) -8.33% 0.240 0.220 - 0.00% -
429.mcf (max) -8.00% 25.000 23.000 - 0.00% -
410.bwaves (max) -7.69% 13.000 12.000 - 0.00% -
433.milc -7.69% 13.000 12.000 - 0.00% -
433.milc (avg) -7.69% 13.000 12.000 - 0.00% -
436.cactusADM -7.69% 13.000 12.000 - 0.00% -
436.cactusADM (avg) -7.69% 13.000 12.000 - 0.00% -
453.povray (max) -7.69% 13.000 12.000 - 0.00% -
458.sjeng (max) -7.69% 13.000 12.000 - 0.00% -
462.libquantum (max) (percentage) -7.48% 2.140 1.980 - 0.00% -
416.gamess (avg) (percentage) -7.41% 0.270 0.250 - 0.00% -
416.gamess -7.41% 27.000 25.000 - 0.00% -
416.gamess (avg) -7.41% 27.000 25.000 - 0.00% -
429.mcf (max) (percentage) -7.26% 1.790 1.660 - 0.00% -
445.gobmk (max) (percentage) -6.73% 1.040 0.970 - 0.00% -
445.gobmk (max) -6.38% 47.000 44.000 - 0.00% -
473.astar (max) (percentage) -6.34% 1.420 1.330 - 0.00% -
434.zeusmp (max) (percentage) -6.32% 1.900 1.780 - 0.00% -
400.perlbench (max) -6.25% 32.000 30.000 - 0.00% -
450.soplex -6.25% 16.000 15.000 - 0.00% -
450.soplex (avg) -6.25% 16.000 15.000 - 0.00% -
434.zeusmp (max) -6.06% 33.000 31.000 - 0.00% -
473.astar (max) -6.06% 66.000 62.000 - 0.00% -
454.calculix (avg) (percentage) -5.95% 3.360 3.160 - 0.00% -
437.leslie3d -5.35% 355.000 336.000 - 0.00% -
437.leslie3d (avg) -5.35% 355.000 336.000 - 0.00% -
401.bzip2 (avg) (percentage) -5.23% 1.530 1.450 - 0.00% -
465.tonto (avg) (percentage) -5.04% 1.190 1.130 - 0.00% -
473.astar (avg) (percentage) -4.95% 1.820 1.730 - 0.00% -
429.mcf -4.94% 81.000 77.000 - 0.00% -
429.mcf (avg) -4.94% 81.000 77.000 - 0.00% -
401.bzip2 -4.88% 41.000 39.000 - 0.00% -
401.bzip2 (avg) -4.88% 41.000 39.000 - 0.00% -
458.sjeng -4.88% 41.000 39.000 - 0.00% -
458.sjeng (avg) -4.88% 41.000 39.000 - 0.00% -
447.dealII (avg) (percentage) -4.76% 1.260 1.200 - 0.00% -
465.tonto -4.76% 105.000 100.000 - 0.00% -
465.tonto (avg) -4.76% 105.000 100.000 - 0.00% -
473.astar -4.71% 85.000 81.000 - 0.00% -
473.astar (avg) -4.71% 85.000 81.000 - 0.00% -
410.bwaves -4.62% 65.000 62.000 - 0.00% -
410.bwaves (avg) -4.62% 65.000 62.000 - 0.00% -
458.sjeng (avg) (percentage) -4.55% 0.660 0.630 - 0.00% -
471.omnetpp -4.55% 44.000 42.000 - 0.00% -
471.omnetpp (avg) -4.55% 44.000 42.000 - 0.00% -
459.GemsFDTD (avg) (percentage) -4.44% 1.800 1.720 - 0.00% -
456.hmmer (avg) (percentage) -4.35% 0.460 0.440 - 0.00% -
471.omnetpp (avg) (percentage) -4.27% 2.110 2.020 - 0.00% -
481.wrf (avg) (percentage) -4.20% 2.380 2.280 - 0.00% -
403.gcc (avg) (percentage) -4.11% 3.890 3.730 - 0.00% -
450.soplex (avg) (percentage) -4.00% 3.000 2.880 - 0.00% -
400.perlbench -4.00% 25.000 24.000 - 0.00% -
400.perlbench (avg) -4.00% 25.000 24.000 - 0.00% -
429.mcf (avg) (percentage) -3.87% 5.690 5.470 - 0.00% -
453.povray (avg) (percentage) -3.86% 2.070 1.990 - 0.00% -
410.bwaves (avg) (percentage) -3.82% 1.570 1.510 - 0.00% -
459.GemsFDTD -3.80% 79.000 76.000 - 0.00% -
459.GemsFDTD (avg) -3.80% 79.000 76.000 - 0.00% -
470.lbm (avg) (percentage) -3.45% 1.160 1.120 - 0.00% -
437.leslie3d (avg) (percentage) -3.36% 5.060 4.890 - 0.00% -
403.gcc (max) (percentage) -3.10% 4.510 4.370 - 0.00% -
433.milc (avg) (percentage) -2.96% 1.350 1.310 - 0.00% -
459.GemsFDTD (max) -2.94% 34.000 33.000 - 0.00% -
464.h264ref -2.94% 34.000 33.000 - 0.00% -
464.h264ref (avg) -2.94% 34.000 33.000 - 0.00% -
481.wrf -2.78% 72.000 70.000 - 0.00% -
481.wrf (avg) -2.78% 72.000 70.000 - 0.00% -
459.GemsFDTD (max) (percentage) -2.60% 0.770 0.750 - 0.00% -
470.lbm -2.50% 40.000 39.000 - 0.00% -
470.lbm (avg) -2.50% 40.000 39.000 - 0.00% -
445.gobmk (avg) (percentage) -2.48% 1.210 1.180 - 0.00% -
436.cactusADM (avg) (percentage) -2.44% 0.820 0.800 - 0.00% -
482.sphinx3 (avg) (percentage) -2.29% 1.750 1.710 - 0.00% -
464.h264ref (avg) (percentage) -2.27% 0.880 0.860 - 0.00% -
400.perlbench (max) (percentage) -2.21% 2.260 2.210 - 0.00% -
462.libquantum (avg) (percentage) -2.02% 1.980 1.940 - 0.00% -
445.gobmk -1.85% 54.000 53.000 - 0.00% -
445.gobmk (avg) -1.85% 54.000 53.000 - 0.00% -
400.perlbench (avg) (percentage) -1.67% 1.800 1.770 - 0.00% -

Added Tests - sample variability
454.calculix (unexplained diff vs previous)
454.calculix (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
464.h264ref 2.41% 699384.000 716224.000 - 0.00% -
434.zeusmp 1.25% 296597.000 300301.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
403.gcc 10.42% 48.000 53.000 - -1.85% -
450.soplex 9.74% 493.000 541.000 - 0.93% -
435.gromacs 6.83% 4991.000 5332.000 - 3.01% -
444.namd 5.02% 618.000 649.000 - 3.51% -
445.gobmk 4.72% 4363.000 4569.000 - 0.79% -
433.milc 4.40% 932.000 973.000 - 0.62% -
401.bzip2 4.29% 2612.000 2724.000 - 0.26% -
410.bwaves 3.83% 4016.000 4170.000 - -0.12% -
483.xalancbmk 3.71% 2750.000 2852.000 - 3.60% -
465.tonto 3.57% 8627.000 8935.000 - 0.31% -
481.wrf 3.30% 2999.000 3098.000 - 1.08% -
400.perlbench 3.25% 1354.000 1398.000 - -1.41% -
473.astar 2.66% 4586.000 4708.000 - -0.17% -
471.omnetpp 2.58% 2057.000 2110.000 - -0.19% -
462.libquantum 2.50% 80.000 82.000 - -1.20% -
456.hmmer 2.41% 1948.000 1995.000 - -0.20% -
437.leslie3d 2.18% 6730.000 6877.000 - -1.98% -
434.zeusmp 2.17% 1709.000 1746.000 - -0.80% -
458.sjeng 1.45% 6134.000 6223.000 - -0.13% -
453.povray 1.07% 375.000 379.000 - 0.80% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
462.libquantum -2.20% 22168.000 21680.000 - 0.00% -
458.sjeng -2.06% 156546.000 153314.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
429.mcf -20.56% 1790.000 1422.000 - -0.91% -
470.lbm -3.81% 3644.000 3505.000 - -0.31% -
459.GemsFDTD -3.39% 4574.000 4419.000 - -0.29% -
436.cactusADM -2.16% 1621.000 1586.000 - -0.25% -

Added Tests - sample variability
400.perlbench
400.perlbench (avg)
400.perlbench (avg) (percentage)
400.perlbench (max)
400.perlbench (max) (percentage)
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
403.gcc
403.gcc (avg)
403.gcc (avg) (percentage)
403.gcc (max)
403.gcc (max) (percentage)
403.gcc (unexplained diff vs previous)
403.gcc (unexplained diff vs previous) (percentage)
410.bwaves
410.bwaves (avg)
410.bwaves (avg) (percentage)
410.bwaves (max)
410.bwaves (max) (percentage)
416.gamess
416.gamess (avg)
416.gamess (avg) (percentage)
416.gamess (max)
416.gamess (max) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
433.milc
433.milc (avg)
433.milc (avg) (percentage)
433.milc (max)
433.milc (max) (percentage)
434.zeusmp
434.zeusmp (avg)
434.zeusmp (avg) (percentage)
434.zeusmp (max)
434.zeusmp (max) (percentage)
435.gromacs
435.gromacs (avg)
435.gromacs (avg) (percentage)
435.gromacs (max)
435.gromacs (max) (percentage)
436.cactusADM
436.cactusADM (avg)
436.cactusADM (avg) (percentage)
436.cactusADM (max)
436.cactusADM (max) (percentage)
437.leslie3d
437.leslie3d (avg)
437.leslie3d (avg) (percentage)
437.leslie3d (max)
437.leslie3d (max) (percentage)
444.namd
444.namd (avg)
444.namd (avg) (percentage)
444.namd (max)
444.namd (max) (percentage)
445.gobmk
445.gobmk (avg)
445.gobmk (avg) (percentage)
445.gobmk (max)
445.gobmk (max) (percentage)
447.dealII
447.dealII (avg)
447.dealII (avg) (percentage)
447.dealII (max)
447.dealII (max) (percentage)
450.soplex
450.soplex (avg)
450.soplex (avg) (percentage)
450.soplex (max)
450.soplex (max) (percentage)
453.povray
453.povray (avg)
453.povray (avg) (percentage)
453.povray (max)
453.povray (max) (percentage)
454.calculix
454.calculix (avg)
454.calculix (avg) (percentage)
454.calculix (max)
454.calculix (max) (percentage)
454.calculix (unexplained diff vs previous)
454.calculix (unexplained diff vs previous) (percentage)
456.hmmer
456.hmmer (avg)
456.hmmer (avg) (percentage)
456.hmmer (max)
456.hmmer (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
459.GemsFDTD
459.GemsFDTD (avg)
459.GemsFDTD (avg) (percentage)
459.GemsFDTD (max)
459.GemsFDTD (max) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)
464.h264ref
464.h264ref (avg)
464.h264ref (avg) (percentage)
464.h264ref (max)
464.h264ref (max) (percentage)
465.tonto
465.tonto (avg)
465.tonto (avg) (percentage)
465.tonto (max)
465.tonto (max) (percentage)
470.lbm
470.lbm (avg)
470.lbm (avg) (percentage)
470.lbm (max)
470.lbm (max) (percentage)
471.omnetpp
471.omnetpp (avg)
471.omnetpp (avg) (percentage)
471.omnetpp (max)
471.omnetpp (max) (percentage)
473.astar
473.astar (avg)
473.astar (avg) (percentage)
473.astar (max)
473.astar (max) (percentage)
481.wrf
481.wrf (avg)
481.wrf (avg) (percentage)
481.wrf (max)
481.wrf (max) (percentage)
482.sphinx3
482.sphinx3 (avg)
482.sphinx3 (avg) (percentage)
482.sphinx3 (max)
482.sphinx3 (max) (percentage)
483.xalancbmk
483.xalancbmk (avg)
483.xalancbmk (avg) (percentage)
483.xalancbmk (max)
483.xalancbmk (max) (percentage)

Report Time: 0.37s
Execution (seconds)
Name Current %
400.perlbench 1398.000 -1.41%
401.bzip2 2724.000 -
403.gcc 53.000 -1.85%
410.bwaves 4170.000 -
416.gamess 10346.000 -
429.mcf 1422.000 -
433.milc 973.000 -
434.zeusmp 1746.000 -
435.gromacs 5332.000 3.01%
436.cactusADM 1586.000 -
437.leslie3d 6877.000 -1.98%
444.namd 649.000 3.51%
445.gobmk 4569.000 -
447.dealII 1001.000 -
450.soplex 541.000 -
453.povray 379.000 -
454.calculix 49.000 -
456.hmmer 1995.000 -
458.sjeng 6223.000 -
459.GemsFDTD 4419.000 -
462.libquantum 82.000 -1.20%
464.h264ref 3935.000 -
465.tonto 8935.000 -
470.lbm 3505.000 -
471.omnetpp 2110.000 -
473.astar 4708.000 -
481.wrf 3098.000 1.08%
482.sphinx3 771.000 -1.03%
483.xalancbmk 2852.000 3.60%
Geometric Mean 1627.782 -
Code Size (bytes)
Name Current %
400.perlbench 1324584.000 -
401.bzip2 72721.000 -
403.gcc 3923640.000 -
410.bwaves 26011.000 -
416.gamess 8071961.000 -
429.mcf 10024.000 -
433.milc 93489.000 -
434.zeusmp 300301.000 -
435.gromacs 736835.000 -
436.cactusADM 528289.000 -
437.leslie3d 100192.000 -
444.namd 234661.000 -
445.gobmk 1873455.000 -
447.dealII 476137.000 -
450.soplex 325931.000 -
453.povray 1079457.000 -
454.calculix 1148284.000 -
456.hmmer 165965.000 -
458.sjeng 153314.000 -
459.GemsFDTD 376872.000 -
462.libquantum 21680.000 -
464.h264ref 716224.000 -
465.tonto 2787600.000 -
470.lbm 11164.000 -
471.omnetpp 653230.000 -
473.astar 31081.000 -
481.wrf 3975294.000 -
482.sphinx3 153476.000 -
483.xalancbmk 3492531.000 -
Geometric Mean 333486.143 -
sample variability
Name Current %
400.perlbench 24.000 -4.00%
400.perlbench (avg) 24.000 -4.00%
400.perlbench (avg) (percentage) 1.770 -1.67%
400.perlbench (max) 30.000 -6.25%
400.perlbench (max) (percentage) 2.210 -2.21%
400.perlbench (unexplained diff vs previous) 20.000 11.11%
400.perlbench (unexplained diff vs previous) (percentage) 1.430 12.60%
401.bzip2 39.000 -4.88%
401.bzip2 (avg) 39.000 -4.88%
401.bzip2 (avg) (percentage) 1.450 -5.23%
401.bzip2 (max) 15.000 -11.76%
401.bzip2 (max) (percentage) 0.570 -10.94%
401.bzip2 (unexplained diff vs previous) 7.000 -12.50%
401.bzip2 (unexplained diff vs previous) (percentage) 0.260 -10.34%
403.gcc 1.000 -50.00%
403.gcc (avg) 1.000 -50.00%
403.gcc (avg) (percentage) 3.730 -4.11%
403.gcc (max) 2.000 -
403.gcc (max) (percentage) 4.370 -3.10%
403.gcc (unexplained diff vs previous) 1.000 -
403.gcc (unexplained diff vs previous) (percentage) 1.890 2.16%
410.bwaves 62.000 -4.62%
410.bwaves (avg) 62.000 -4.62%
410.bwaves (avg) (percentage) 1.510 -3.82%
410.bwaves (max) 12.000 -7.69%
410.bwaves (max) (percentage) 0.290 -9.38%
410.bwaves (unexplained diff vs previous) 5.000 150.00%
410.bwaves (unexplained diff vs previous) (percentage) 0.120 140.00%
416.gamess 25.000 -7.41%
416.gamess (avg) 25.000 -7.41%
416.gamess (avg) (percentage) 0.250 -7.41%
416.gamess (max) 26.000 -18.75%
416.gamess (max) (percentage) 0.260 -16.13%
416.gamess (unexplained diff vs previous) 7.000 -78.12%
416.gamess (unexplained diff vs previous) (percentage) 0.070 -77.42%
429.mcf 77.000 -4.94%
429.mcf (avg) 77.000 -4.94%
429.mcf (avg) (percentage) 5.470 -3.87%
429.mcf (max) 23.000 -8.00%
429.mcf (max) (percentage) 1.660 -7.26%
429.mcf (unexplained diff vs previous) 13.000 30.00%
429.mcf (unexplained diff vs previous) (percentage) 0.910 30.00%
433.milc 12.000 -7.69%
433.milc (avg) 12.000 -7.69%
433.milc (avg) (percentage) 1.310 -2.96%
433.milc (max) 6.000 50.00%
433.milc (max) (percentage) 0.620 34.78%
433.milc (unexplained diff vs previous) 6.000 100.00%
433.milc (unexplained diff vs previous) (percentage) 0.620 100.00%
434.zeusmp 19.000 -
434.zeusmp (avg) 19.000 -
434.zeusmp (avg) (percentage) 1.100 -
434.zeusmp (max) 31.000 -6.06%
434.zeusmp (max) (percentage) 1.780 -6.32%
434.zeusmp (unexplained diff vs previous) 14.000 7.69%
434.zeusmp (unexplained diff vs previous) (percentage) 0.800 8.11%
435.gromacs 137.000 4.58%
435.gromacs (avg) 137.000 4.58%
435.gromacs (avg) (percentage) 2.570 1.18%
435.gromacs (max) 160.000 95.12%
435.gromacs (max) (percentage) 3.010 88.12%
435.gromacs (unexplained diff vs previous) 156.000 550.00%
435.gromacs (unexplained diff vs previous) (percentage) 2.930 536.96%
436.cactusADM 12.000 -7.69%
436.cactusADM (avg) 12.000 -7.69%
436.cactusADM (avg) (percentage) 0.800 -2.44%
436.cactusADM (max) 7.000 -22.22%
436.cactusADM (max) (percentage) 0.470 -17.54%
436.cactusADM (unexplained diff vs previous) 4.000 -55.56%
436.cactusADM (unexplained diff vs previous) (percentage) 0.250 -56.14%
437.leslie3d 336.000 -5.35%
437.leslie3d (avg) 336.000 -5.35%
437.leslie3d (avg) (percentage) 4.890 -3.36%
437.leslie3d (max) 222.000 -43.51%
437.leslie3d (max) (percentage) 3.230 -42.42%
437.leslie3d (unexplained diff vs previous) 139.000 -56.01%
437.leslie3d (unexplained diff vs previous) (percentage) 2.020 -55.11%
444.namd 7.000 16.67%
444.namd (avg) 7.000 16.67%
444.namd (avg) (percentage) 1.170 12.50%
444.namd (max) 22.000 100.00%
444.namd (max) (percentage) 3.510 87.70%
444.namd (unexplained diff vs previous) 22.000 -
444.namd (unexplained diff vs previous) (percentage) 3.390 -
445.gobmk 53.000 -1.85%
445.gobmk (avg) 53.000 -1.85%
445.gobmk (avg) (percentage) 1.180 -2.48%
445.gobmk (max) 44.000 -6.38%
445.gobmk (max) (percentage) 0.970 -6.73%
445.gobmk (unexplained diff vs previous) 36.000 12.50%
445.gobmk (unexplained diff vs previous) (percentage) 0.790 11.27%
447.dealII 12.000 -
447.dealII (avg) 12.000 -
447.dealII (avg) (percentage) 1.200 -4.76%
447.dealII (max) 11.000 -26.67%
447.dealII (max) (percentage) 1.180 -25.32%
447.dealII (unexplained diff vs previous) 2.000 -85.71%
447.dealII (unexplained diff vs previous) (percentage) 0.200 -85.71%
450.soplex 15.000 -6.25%
450.soplex (avg) 15.000 -6.25%
450.soplex (avg) (percentage) 2.880 -4.00%
450.soplex (max) 5.000 -
450.soplex (max) (percentage) 0.980 -10.91%
450.soplex (unexplained diff vs previous) 5.000 400.00%
450.soplex (unexplained diff vs previous) (percentage) 0.920 384.21%
453.povray 7.000 -
453.povray (avg) 7.000 -
453.povray (avg) (percentage) 1.990 -3.86%
453.povray (max) 12.000 -7.69%
453.povray (max) (percentage) 3.230 -10.03%
453.povray (unexplained diff vs previous) 3.000 -78.57%
453.povray (unexplained diff vs previous) (percentage) 0.790 -78.76%
454.calculix 1.000 -
454.calculix (avg) 1.000 -
454.calculix (avg) (percentage) 3.160 -5.95%
454.calculix (max) 1.000 -
454.calculix (max) (percentage) 2.940 -
454.calculix (unexplained diff vs previous) 0.000 -
454.calculix (unexplained diff vs previous) (percentage) 0.000 -
456.hmmer 8.000 -11.11%
456.hmmer (avg) 8.000 -11.11%
456.hmmer (avg) (percentage) 0.440 -4.35%
456.hmmer (max) 4.000 -
456.hmmer (max) (percentage) 0.220 -8.33%
456.hmmer (unexplained diff vs previous) 4.000 300.00%
456.hmmer (unexplained diff vs previous) (percentage) 0.200 300.00%
458.sjeng 39.000 -4.88%
458.sjeng (avg) 39.000 -4.88%
458.sjeng (avg) (percentage) 0.630 -4.55%
458.sjeng (max) 12.000 -7.69%
458.sjeng (max) (percentage) 0.200 -9.09%
458.sjeng (unexplained diff vs previous) 8.000 60.00%
458.sjeng (unexplained diff vs previous) (percentage) 0.130 62.50%
459.GemsFDTD 76.000 -3.80%
459.GemsFDTD (avg) 76.000 -3.80%
459.GemsFDTD (avg) (percentage) 1.720 -4.44%
459.GemsFDTD (max) 33.000 -2.94%
459.GemsFDTD (max) (percentage) 0.750 -2.60%
459.GemsFDTD (unexplained diff vs previous) 13.000 160.00%
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.290 163.64%
462.libquantum 1.000 -
462.libquantum (avg) 1.000 -
462.libquantum (avg) (percentage) 1.940 -2.02%
462.libquantum (max) 1.000 -
462.libquantum (max) (percentage) 1.980 -7.48%
462.libquantum (unexplained diff vs previous) 1.000 -
462.libquantum (unexplained diff vs previous) (percentage) 1.220 1.67%
464.h264ref 33.000 -2.94%
464.h264ref (avg) 33.000 -2.94%
464.h264ref (avg) (percentage) 0.860 -2.27%
464.h264ref (max) 26.000 30.00%
464.h264ref (max) (percentage) 0.680 30.77%
464.h264ref (unexplained diff vs previous) 27.000 2600.00%
464.h264ref (unexplained diff vs previous) (percentage) 0.690 2200.00%
465.tonto 100.000 -4.76%
465.tonto (avg) 100.000 -4.76%
465.tonto (avg) (percentage) 1.130 -5.04%
465.tonto (max) 53.000 -13.11%
465.tonto (max) (percentage) 0.600 -13.04%
465.tonto (unexplained diff vs previous) 28.000 -54.10%
465.tonto (unexplained diff vs previous) (percentage) 0.310 -54.41%
470.lbm 39.000 -2.50%
470.lbm (avg) 39.000 -2.50%
470.lbm (avg) (percentage) 1.120 -3.45%
470.lbm (max) 23.000 -11.54%
470.lbm (max) (percentage) 0.670 -9.46%
470.lbm (unexplained diff vs previous) 11.000 -15.38%
470.lbm (unexplained diff vs previous) (percentage) 0.310 -16.22%
471.omnetpp 42.000 -4.55%
471.omnetpp (avg) 42.000 -4.55%
471.omnetpp (avg) (percentage) 2.020 -4.27%
471.omnetpp (max) 53.000 -8.62%
471.omnetpp (max) (percentage) 2.530 -8.33%
471.omnetpp (unexplained diff vs previous) 4.000 -93.33%
471.omnetpp (unexplained diff vs previous) (percentage) 0.190 -93.31%
473.astar 81.000 -4.71%
473.astar (avg) 81.000 -4.71%
473.astar (avg) (percentage) 1.730 -4.95%
473.astar (max) 62.000 -6.06%
473.astar (max) (percentage) 1.330 -6.34%
473.astar (unexplained diff vs previous) 8.000 -46.67%
473.astar (unexplained diff vs previous) (percentage) 0.170 -46.88%
481.wrf 70.000 -2.78%
481.wrf (avg) 70.000 -2.78%
481.wrf (avg) (percentage) 2.280 -4.20%
481.wrf (max) 41.000 -10.87%
481.wrf (max) (percentage) 1.340 -11.26%
481.wrf (unexplained diff vs previous) 33.000 -19.51%
481.wrf (unexplained diff vs previous) (percentage) 1.070 -20.15%
482.sphinx3 13.000 -
482.sphinx3 (avg) 13.000 -
482.sphinx3 (avg) (percentage) 1.710 -2.29%
482.sphinx3 (max) 12.000 -36.84%
482.sphinx3 (max) (percentage) 1.560 -37.85%
482.sphinx3 (unexplained diff vs previous) 8.000 -38.46%
482.sphinx3 (unexplained diff vs previous) (percentage) 1.040 -37.72%
483.xalancbmk 80.000 5.26%
483.xalancbmk (avg) 80.000 5.26%
483.xalancbmk (avg) (percentage) 2.820 1.81%
483.xalancbmk (max) 102.000 10.87%
483.xalancbmk (max) (percentage) 3.600 6.82%
483.xalancbmk (unexplained diff vs previous) 99.000 3.12%
483.xalancbmk (unexplained diff vs previous) (percentage) 3.470 -
Geometric Mean 4.701 -2.36%