Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=84f7f8940760d0eaeb51a38b345db369b4207e5b (unchanged)
git_gcc https://github.com/gcc-mirror/gcc/commit/b666d86b41c85a1756bf43951661a03f670a6852 (+ 127 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=8d7b6b4cb27d4dec1dd5f7960298c1699275f962 (unchanged)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=30e92e8838a078df359a97e36d048f06bbd5bec1 (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-aarch64-master-Os_LTO-build/245/
View Options
Report
Filter

gnu-aarch64-master-Os_LTO test results

Run Order Start Time Duration
Current 0245 (basepoints/gcc-15-00701-gb666d86b41c) 2024-05-19T08:38:38 0:00:00
Previous 0244 (basepoints/gcc-15-00574-gb8e3574e683) 2024-05-17T16:59:50 0:00:00
Baseline 0001 (4-changed-components) 2023-02-20T22:48:24 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 21 15
Performance Improvements 59 166
Added Tests 8 0
Unchanged Tests 1148 1055
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Code Size Δ Previous Current σ Δ (B) σ (B)
459.GemsFDTD 1.47% 237576.000 241060.000 - -1.50% -
400.perlbench 1.38% 894483.000 906859.000 - 1.46% -

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
471.omnetpp 4.32% 2685.000 2801.000 - 2.83% -
462.libquantum 2.22% 135.000 138.000 - -1.43% -
482.sphinx3 1.44% 831.000 843.000 - -10.79% -
453.povray 1.30% 539.000 546.000 - -0.18% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
471.omnetpp (unexplained diff vs previous) 480.00% 20.000 116.000 0.000 -98.91% 0.000
471.omnetpp (unexplained diff vs previous) (percentage) 459.46% 0.740 4.140 0.000 -98.94% 0.000
471.omnetpp (max) 168.89% 45.000 121.000 - -94.42% -
471.omnetpp (max) (percentage) 157.14% 1.680 4.320 - -94.58% -
410.bwaves (unexplained diff vs previous) 152.94% 17.000 43.000 0.000 -99.45% 0.000
410.bwaves (unexplained diff vs previous) (percentage) 148.28% 0.290 0.720 0.000 -99.48% 0.000
437.leslie3d (max) (percentage) 83.47% 6.290 11.540 - -30.40% -
437.leslie3d (max) 62.34% 786.000 1276.000 - -33.85% -
410.bwaves (max) 43.33% 30.000 43.000 - -98.69% -
410.bwaves (max) (percentage) 43.14% 0.510 0.730 - -98.74% -
473.astar (max) 6.67% 15.000 16.000 - -99.53% -
471.omnetpp 5.08% 59.000 62.000 - -72.20% -
471.omnetpp (avg) 5.08% 59.000 62.000 - -72.20% -
437.leslie3d (avg) (percentage) 2.61% 4.590 4.710 - 54.43% -
471.omnetpp (avg) (percentage) 1.36% 2.200 2.230 - -72.80% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
437.leslie3d -11.54% 12501.000 11059.000 - -4.99% -
450.soplex -2.02% 595.000 583.000 - 2.82% -
456.hmmer -1.48% 2977.000 2933.000 - 1.77% -
445.gobmk -1.33% 5119.000 5051.000 - 0.56% -
465.tonto -1.13% 11726.000 11594.000 - 5.97% -
464.h264ref -1.07% 5808.000 5746.000 - -0.26% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
444.namd (unexplained diff vs previous) -60.00% 5.000 2.000 0.000 -99.98% 0.000
444.namd (unexplained diff vs previous) (percentage) -60.00% 0.650 0.260 0.000 -99.98% 0.000
473.astar (unexplained diff vs previous) (percentage) -46.15% 0.130 0.070 0.000 -99.96% 0.000
473.astar (unexplained diff vs previous) -42.86% 7.000 4.000 0.000 -99.96% 0.000
456.hmmer (max) -20.00% 5.000 4.000 - -99.81% -
482.sphinx3 (max) -20.00% 5.000 4.000 - -99.56% -
433.milc (max) -16.67% 6.000 5.000 - -99.52% -
437.leslie3d -9.25% 573.000 520.000 - 46.48% -
437.leslie3d (avg) -9.25% 573.000 520.000 - 46.48% -
464.h264ref (max) -7.69% 13.000 12.000 - -99.62% -
433.milc (max) (percentage) -7.27% 0.550 0.510 - -99.44% -
429.mcf (max) -7.14% 56.000 52.000 - -96.07% -
450.soplex -6.67% 15.000 14.000 - -61.11% -
450.soplex (avg) -6.67% 15.000 14.000 - -61.11% -
429.mcf (max) (percentage) -6.51% 2.920 2.730 - -97.06% -
444.namd (max) (percentage) -6.25% 0.640 0.600 - -99.35% -
435.gromacs (max) -6.25% 48.000 45.000 - -98.74% -
447.dealII (max) -6.25% 16.000 15.000 - -98.92% -
465.tonto (max) -6.19% 97.000 91.000 - -95.69% -
458.sjeng (max) (percentage) -5.56% 0.360 0.340 - -99.29% -
445.gobmk (max) (percentage) -5.26% 0.760 0.720 - -98.63% -
445.gobmk (max) -5.26% 38.000 36.000 - -98.64% -
482.sphinx3 (max) (percentage) -4.84% 0.620 0.590 - -99.39% -
453.povray (max) (percentage) -4.82% 1.660 1.580 - -98.27% -
465.tonto (max) (percentage) -4.82% 0.830 0.790 - -95.91% -
401.bzip2 (max) (percentage) -4.76% 0.840 0.800 - -98.98% -
435.gromacs (max) (percentage) -4.48% 0.670 0.640 - -98.70% -
464.h264ref (max) (percentage) -4.35% 0.230 0.220 - -99.59% -
401.bzip2 (max) -4.17% 24.000 23.000 - -99.01% -
436.cactusADM (max) (percentage) -4.10% 1.220 1.170 - -98.68% -
436.cactusADM (max) -4.00% 25.000 24.000 - -98.70% -
458.sjeng (max) -3.85% 26.000 25.000 - -99.31% -
400.perlbench (max) -3.12% 32.000 31.000 - -97.78% -
450.soplex (max) (percentage) -3.08% 1.300 1.260 - -98.69% -
462.libquantum (max) (percentage) -2.60% 2.310 2.250 - -97.73% -
400.perlbench (max) (percentage) -2.44% 2.050 2.000 - -97.62% -
459.GemsFDTD (max) (percentage) -2.41% 0.830 0.810 - -98.87% -
470.lbm -2.38% 42.000 41.000 - -82.85% -
470.lbm (avg) -2.38% 42.000 41.000 - -82.85% -
459.GemsFDTD (max) -2.27% 44.000 43.000 - -99.03% -
447.dealII (max) (percentage) -2.02% 0.990 0.970 - -98.79% -
464.h264ref -1.85% 54.000 53.000 - -81.91% -
464.h264ref (avg) -1.85% 54.000 53.000 - -81.91% -
470.lbm (avg) (percentage) -1.79% 1.120 1.100 - -82.62% -
434.zeusmp (avg) (percentage) -1.63% 1.230 1.210 - -79.32% -
433.milc (avg) (percentage) -1.37% 1.460 1.440 - -76.20% -
465.tonto -1.25% 160.000 158.000 - -56.71% -
465.tonto (avg) -1.25% 160.000 158.000 - -56.71% -
473.astar (avg) (percentage) -1.20% 1.660 1.640 - -60.58% -
473.astar -1.14% 88.000 87.000 - -59.15% -
473.astar (avg) -1.14% 88.000 87.000 - -59.15% -
454.calculix (max) (percentage) -1.11% 0.900 0.890 - -99.11% -
481.wrf (max) (percentage) -1.02% 0.980 0.970 - -98.59% -

Added Tests - sample variability
434.zeusmp (unexplained diff vs previous)
434.zeusmp (unexplained diff vs previous) (percentage)
436.cactusADM (unexplained diff vs previous)
436.cactusADM (unexplained diff vs previous) (percentage)
437.leslie3d (unexplained diff vs previous)
437.leslie3d (unexplained diff vs previous) (percentage)
462.libquantum (unexplained diff vs previous)
462.libquantum (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
400.perlbench 1.46% 893848.000 906859.000 - 1.38% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
429.mcf 35.96% 1424.000 1936.000 - -0.26% -
465.tonto 5.97% 10941.000 11594.000 - -1.13% -
410.bwaves 5.47% 5652.000 5961.000 - 0.73% -
473.astar 4.06% 5128.000 5336.000 - 0.08% -
444.namd 3.48% 747.000 773.000 - 0.26% -
471.omnetpp 2.83% 2724.000 2801.000 - 4.32% -
450.soplex 2.82% 567.000 583.000 - -2.02% -
436.cactusADM 1.92% 2083.000 2123.000 - 0.86% -
456.hmmer 1.77% 2882.000 2933.000 - -1.48% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d (avg) (percentage) 54.43% 3.050 4.710 - 2.61% -
437.leslie3d 46.48% 355.000 520.000 - -9.25% -
437.leslie3d (avg) 46.48% 355.000 520.000 - -9.25% -
429.mcf 9.17% 109.000 119.000 - 0.00% -
429.mcf (avg) 9.17% 109.000 119.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
434.zeusmp -2.48% 152037.000 148271.000 - 0.00% -
437.leslie3d -1.63% 59479.000 58510.000 - 0.00% -
462.libquantum -1.59% 16085.000 15829.000 - 0.00% -
464.h264ref -1.51% 387748.000 381880.000 - -0.12% -
459.GemsFDTD -1.50% 244728.000 241060.000 - 1.47% -
470.lbm -1.44% 9691.000 9551.000 - 0.00% -
453.povray -1.41% 661389.000 652073.000 - -0.07% -
410.bwaves -1.26% 16760.000 16548.000 - 0.00% -
435.gromacs -1.12% 499261.000 493649.000 - -0.03% -
433.milc -1.10% 61382.000 60709.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
459.GemsFDTD -13.54% 6173.000 5337.000 - -0.24% -
482.sphinx3 -10.79% 945.000 843.000 - 1.44% -
437.leslie3d -4.99% 11640.000 11059.000 - -11.54% -
447.dealII -4.87% 1724.000 1640.000 - -0.12% -
400.perlbench -4.75% 1663.000 1584.000 - 0.38% -
458.sjeng -1.90% 7567.000 7423.000 - 0.39% -
435.gromacs -1.68% 7269.000 7147.000 - -0.32% -
462.libquantum -1.43% 140.000 138.000 - 2.22% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
433.milc (unexplained diff vs previous) (percentage) -99.98% 980.800 0.170 0.000 0.00% 0.000
433.milc (unexplained diff vs previous) -99.98% 11289.000 2.000 0.000 0.00% 0.000
462.libquantum (unexplained diff vs previous) -99.98% 13518.000 3.000 0.000 0.00% 0.000
462.libquantum (unexplained diff vs previous) (percentage) -99.98% 9655.710 2.170 0.000 0.00% 0.000
444.namd (unexplained diff vs previous) (percentage) -99.98% 1118.610 0.260 0.000 -60.00% 0.000
444.namd (unexplained diff vs previous) -99.98% 8356.000 2.000 0.000 -60.00% 0.000
473.astar (unexplained diff vs previous) (percentage) -99.96% 197.850 0.070 0.000 -46.15% 0.000
473.astar (unexplained diff vs previous) -99.96% 10146.000 4.000 0.000 -42.86% 0.000
470.lbm (unexplained diff vs previous) -99.96% 9990.000 4.000 0.000 0.00% 0.000
470.lbm (unexplained diff vs previous) (percentage) -99.96% 263.730 0.110 0.000 0.00% 0.000
434.zeusmp (unexplained diff vs previous) -99.89% 11280.000 12.000 0.000 0.00% 0.000
434.zeusmp (unexplained diff vs previous) (percentage) -99.89% 448.690 0.480 0.000 0.00% 0.000
436.cactusADM (unexplained diff vs previous) (percentage) -99.89% 787.130 0.850 0.000 0.00% 0.000
436.cactusADM (unexplained diff vs previous) -99.89% 16396.000 18.000 0.000 0.00% 0.000
456.hmmer (max) -99.81% 2120.000 4.000 - -20.00% -
470.lbm (max) -99.78% 2746.000 6.000 - 0.00% -
456.hmmer (max) (percentage) -99.77% 73.590 0.170 - 0.00% -
470.lbm (max) (percentage) -99.77% 72.510 0.170 - -5.56% -
464.h264ref (max) -99.62% 3127.000 12.000 - -7.69% -
464.h264ref (max) (percentage) -99.59% 54.290 0.220 - -4.35% -
482.sphinx3 (max) -99.56% 911.000 4.000 - -20.00% -
473.astar (max) (percentage) -99.55% 66.430 0.300 - 0.00% -
473.astar (max) -99.53% 3406.000 16.000 - 6.67% -
433.milc (max) -99.52% 1044.000 5.000 - -16.67% -
410.bwaves (unexplained diff vs previous) (percentage) -99.48% 137.900 0.720 0.000 148.28% 0.000
410.bwaves (unexplained diff vs previous) -99.45% 7794.000 43.000 0.000 152.94% 0.000
433.milc (max) (percentage) -99.44% 90.750 0.510 - -7.27% -
444.namd (max) -99.42% 685.000 4.000 - 0.00% -
482.sphinx3 (max) (percentage) -99.39% 96.500 0.590 - -4.84% -
444.namd (max) (percentage) -99.35% 91.790 0.600 - -6.25% -
434.zeusmp (max) -99.32% 2055.000 14.000 - 0.00% -
434.zeusmp (max) (percentage) -99.32% 81.770 0.560 - -1.75% -
458.sjeng (max) -99.31% 3602.000 25.000 - -3.85% -
458.sjeng (max) (percentage) -99.29% 47.610 0.340 - -5.56% -
454.calculix (max) (percentage) -99.11% 99.730 0.890 - -1.11% -
459.GemsFDTD (max) -99.03% 4411.000 43.000 - -2.27% -
401.bzip2 (max) -99.01% 2313.000 23.000 - -4.17% -
401.bzip2 (max) (percentage) -98.98% 78.650 0.800 - -4.76% -
471.omnetpp (unexplained diff vs previous) (percentage) -98.94% 391.300 4.140 0.000 459.46% 0.000
447.dealII (max) -98.92% 1384.000 15.000 - -6.25% -
471.omnetpp (unexplained diff vs previous) -98.91% 10659.000 116.000 0.000 480.00% 0.000
459.GemsFDTD (max) (percentage) -98.87% 71.460 0.810 - -2.41% -
416.gamess (max) (percentage) -98.81% 38.550 0.460 - -2.13% -
447.dealII (max) (percentage) -98.79% 80.280 0.970 - -2.02% -
410.bwaves (max) (percentage) -98.74% 57.970 0.730 - 43.14% -
435.gromacs (max) -98.74% 3573.000 45.000 - -6.25% -
450.soplex (max) -98.72% 545.000 7.000 - 0.00% -
436.cactusADM (max) -98.70% 1848.000 24.000 - -4.00% -
435.gromacs (max) (percentage) -98.70% 49.160 0.640 - -4.48% -
450.soplex (max) (percentage) -98.69% 96.240 1.260 - -3.08% -
410.bwaves (max) -98.69% 3276.000 43.000 - 43.33% -
436.cactusADM (max) (percentage) -98.68% 88.730 1.170 - -4.10% -
445.gobmk (max) -98.64% 2643.000 36.000 - -5.26% -
445.gobmk (max) (percentage) -98.63% 52.630 0.720 - -5.26% -
481.wrf (max) (percentage) -98.59% 68.700 0.970 - -1.02% -
453.povray (max) -98.40% 499.000 8.000 - 0.00% -
453.povray (max) (percentage) -98.27% 91.250 1.580 - -4.82% -
462.libquantum (max) -97.83% 138.000 3.000 - 0.00% -
400.perlbench (max) -97.78% 1397.000 31.000 - -3.12% -
462.libquantum (max) (percentage) -97.73% 98.970 2.250 - -2.60% -
400.perlbench (max) (percentage) -97.62% 84.060 2.000 - -2.44% -
483.xalancbmk (max) (percentage) -97.42% 68.670 1.770 - 0.00% -
429.mcf (max) (percentage) -97.06% 92.890 2.730 - -6.51% -
429.mcf (max) -96.07% 1322.000 52.000 - -7.14% -
465.tonto (max) (percentage) -95.91% 19.310 0.790 - -4.82% -
465.tonto (max) -95.69% 2112.000 91.000 - -6.19% -
403.gcc (max) (percentage) -95.63% 99.360 4.340 - -0.69% -
471.omnetpp (max) (percentage) -94.58% 79.650 4.320 - 157.14% -
471.omnetpp (max) -94.42% 2169.000 121.000 - 168.89% -
444.namd -83.82% 68.000 11.000 - 0.00% -
444.namd (avg) -83.82% 68.000 11.000 - 0.00% -
456.hmmer (avg) (percentage) -83.67% 4.410 0.720 - 0.00% -
456.hmmer -83.46% 127.000 21.000 - 0.00% -
456.hmmer (avg) -83.46% 127.000 21.000 - 0.00% -
444.namd (avg) (percentage) -83.30% 9.220 1.540 - -0.65% -
470.lbm -82.85% 239.000 41.000 - -2.38% -
470.lbm (avg) -82.85% 239.000 41.000 - -2.38% -
416.gamess (avg) (percentage) -82.81% 4.420 0.760 - 0.00% -
470.lbm (avg) (percentage) -82.62% 6.330 1.100 - -1.79% -
464.h264ref -81.91% 293.000 53.000 - -1.85% -
464.h264ref (avg) -81.91% 293.000 53.000 - -1.85% -
464.h264ref (avg) (percentage) -81.73% 5.090 0.930 - 0.00% -
462.libquantum -80.00% 10.000 2.000 - 0.00% -
462.libquantum (avg) -80.00% 10.000 2.000 - 0.00% -
482.sphinx3 -79.73% 74.000 15.000 - 0.00% -
482.sphinx3 (avg) -79.73% 74.000 15.000 - 0.00% -
434.zeusmp -79.59% 147.000 30.000 - 0.00% -
434.zeusmp (avg) -79.59% 147.000 30.000 - 0.00% -
434.zeusmp (avg) (percentage) -79.32% 5.850 1.210 - -1.63% -
453.povray -78.57% 42.000 9.000 - 0.00% -
453.povray (avg) -78.57% 42.000 9.000 - 0.00% -
459.GemsFDTD -78.33% 360.000 78.000 - 0.00% -
459.GemsFDTD (avg) -78.33% 360.000 78.000 - 0.00% -
458.sjeng -78.01% 241.000 53.000 - 0.00% -
458.sjeng (avg) -78.01% 241.000 53.000 - 0.00% -
453.povray (avg) (percentage) -77.85% 7.810 1.730 - 0.00% -
447.dealII -77.78% 99.000 22.000 - 0.00% -
447.dealII (avg) -77.78% 99.000 22.000 - 0.00% -
458.sjeng (avg) (percentage) -77.43% 3.190 0.720 - 0.00% -
433.milc -76.81% 69.000 16.000 - 0.00% -
433.milc (avg) -76.81% 69.000 16.000 - 0.00% -
462.libquantum (avg) (percentage) -76.76% 7.660 1.780 - 0.00% -
482.sphinx3 (avg) (percentage) -76.67% 7.930 1.850 - 0.00% -
433.milc (avg) (percentage) -76.20% 6.050 1.440 - -1.37% -
447.dealII (avg) (percentage) -75.74% 5.770 1.400 - 0.00% -
436.cactusADM (avg) (percentage) -75.42% 5.980 1.470 - -0.68% -
410.bwaves (avg) (percentage) -75.28% 4.410 1.090 - 0.00% -
436.cactusADM -75.00% 124.000 31.000 - 0.00% -
436.cactusADM (avg) -75.00% 124.000 31.000 - 0.00% -
459.GemsFDTD (avg) (percentage) -74.83% 5.840 1.470 - 0.00% -
445.gobmk (avg) (percentage) -74.68% 3.910 0.990 - 0.00% -
445.gobmk -74.49% 196.000 50.000 - 0.00% -
445.gobmk (avg) -74.49% 196.000 50.000 - 0.00% -
410.bwaves -74.30% 249.000 64.000 - 0.00% -
410.bwaves (avg) -74.30% 249.000 64.000 - 0.00% -
471.omnetpp (avg) (percentage) -72.80% 8.200 2.230 - 1.36% -
471.omnetpp -72.20% 223.000 62.000 - 5.08% -
471.omnetpp (avg) -72.20% 223.000 62.000 - 5.08% -
481.wrf (avg) (percentage) -71.15% 6.240 1.800 - 0.00% -
401.bzip2 -67.70% 161.000 52.000 - 0.00% -
401.bzip2 (avg) -67.70% 161.000 52.000 - 0.00% -
401.bzip2 (avg) (percentage) -67.15% 5.480 1.800 - 0.00% -
400.perlbench -66.67% 105.000 35.000 - 0.00% -
400.perlbench (avg) -66.67% 105.000 35.000 - 0.00% -
400.perlbench (avg) (percentage) -64.57% 6.350 2.250 - 0.00% -
435.gromacs -64.31% 367.000 131.000 - 0.00% -
435.gromacs (avg) -64.31% 367.000 131.000 - 0.00% -
435.gromacs (avg) (percentage) -63.64% 5.060 1.840 - 0.00% -
450.soplex -61.11% 36.000 14.000 - -6.67% -
450.soplex (avg) -61.11% 36.000 14.000 - -6.67% -
450.soplex (avg) (percentage) -60.65% 6.430 2.530 - 0.00% -
473.astar (avg) (percentage) -60.58% 4.160 1.640 - -1.20% -
473.astar -59.15% 213.000 87.000 - -1.14% -
473.astar (avg) -59.15% 213.000 87.000 - -1.14% -
465.tonto (avg) (percentage) -58.98% 3.340 1.370 - 0.00% -
465.tonto -56.71% 365.000 158.000 - -1.25% -
465.tonto (avg) -56.71% 365.000 158.000 - -1.25% -
454.calculix (avg) (percentage) -55.11% 8.020 3.600 - 0.00% -
483.xalancbmk (avg) (percentage) -54.46% 6.500 2.960 - 0.00% -
437.leslie3d (unexplained diff vs previous) -37.68% 2314.000 1442.000 0.000 0.00% 0.000
437.leslie3d (unexplained diff vs previous) (percentage) -34.41% 19.880 13.040 0.000 0.00% 0.000
437.leslie3d (max) -33.85% 1929.000 1276.000 - 62.34% -
403.gcc (avg) (percentage) -30.46% 7.320 5.090 - 0.00% -
437.leslie3d (max) (percentage) -30.40% 16.580 11.540 - 83.47% -
429.mcf (avg) (percentage) -19.56% 7.670 6.170 - 0.00% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 134.48% 29.000 68.000 - 0.00% -
nb_compile_successful 65.52% 29.000 48.000 - 0.00% -
nb_execution_successful 65.52% 29.000 48.000 - 0.00% -

Report Time: 0.38s
Execution (seconds)
Name Current %
400.perlbench 1584.000 -
401.bzip2 2943.000 -
410.bwaves 5961.000 -
429.mcf 1936.000 -
433.milc 1158.000 -
434.zeusmp 2524.000 -
435.gromacs 7147.000 -
436.cactusADM 2123.000 -
437.leslie3d 11059.000 -11.54%
444.namd 773.000 -
445.gobmk 5051.000 -1.33%
447.dealII 1640.000 -
450.soplex 583.000 -2.02%
453.povray 546.000 1.30%
456.hmmer 2933.000 -1.48%
458.sjeng 7423.000 -
459.GemsFDTD 5337.000 -
462.libquantum 138.000 2.22%
464.h264ref 5746.000 -1.07%
465.tonto 11594.000 -1.13%
470.lbm 3797.000 -
471.omnetpp 2801.000 4.32%
473.astar 5336.000 -
482.sphinx3 843.000 1.44%
Geometric Mean 2473.405 -
Code Size (bytes)
Name Current %
400.perlbench 906859.000 1.38%
401.bzip2 43835.000 -
410.bwaves 16548.000 -
429.mcf 9055.000 -
433.milc 60709.000 -
434.zeusmp 148271.000 -
435.gromacs 493649.000 -
436.cactusADM 350575.000 -
437.leslie3d 58510.000 -
444.namd 189548.000 -
445.gobmk 1383162.000 -
447.dealII 309588.000 -
450.soplex 205231.000 -
453.povray 652073.000 -
456.hmmer 108227.000 -
458.sjeng 103124.000 -
459.GemsFDTD 241060.000 1.47%
462.libquantum 15829.000 -
464.h264ref 381880.000 -
465.tonto 1936910.000 -
470.lbm 9551.000 -
471.omnetpp 476222.000 -
473.astar 22888.000 -
482.sphinx3 112175.000 -
Geometric Mean 137725.195 -
sample variability
Name Current %
400.perlbench 35.000 -
400.perlbench (avg) 35.000 -
400.perlbench (avg) (percentage) 2.250 -
400.perlbench (max) 31.000 -3.12%
400.perlbench (max) (percentage) 2.000 -2.44%
401.bzip2 52.000 -
401.bzip2 (avg) 52.000 -
401.bzip2 (avg) (percentage) 1.800 -
401.bzip2 (max) 23.000 -4.17%
401.bzip2 (max) (percentage) 0.800 -4.76%
403.gcc (avg) (percentage) 5.090 -
403.gcc (max) (percentage) 4.340 -
410.bwaves 64.000 -
410.bwaves (avg) 64.000 -
410.bwaves (avg) (percentage) 1.090 -
410.bwaves (max) 43.000 43.33%
410.bwaves (max) (percentage) 0.730 43.14%
410.bwaves (unexplained diff vs previous) 43.000 152.94%
410.bwaves (unexplained diff vs previous) (percentage) 0.720 148.28%
416.gamess (avg) (percentage) 0.760 -
416.gamess (max) (percentage) 0.460 -
429.mcf 119.000 -
429.mcf (avg) 119.000 -
429.mcf (avg) (percentage) 6.170 -
429.mcf (max) 52.000 -7.14%
429.mcf (max) (percentage) 2.730 -6.51%
433.milc 16.000 -
433.milc (avg) 16.000 -
433.milc (avg) (percentage) 1.440 -1.37%
433.milc (max) 5.000 -16.67%
433.milc (max) (percentage) 0.510 -7.27%
433.milc (unexplained diff vs previous) 2.000 -
433.milc (unexplained diff vs previous) (percentage) 0.170 -
434.zeusmp 30.000 -
434.zeusmp (avg) 30.000 -
434.zeusmp (avg) (percentage) 1.210 -1.63%
434.zeusmp (max) 14.000 -
434.zeusmp (max) (percentage) 0.560 -
434.zeusmp (unexplained diff vs previous) 12.000 -
434.zeusmp (unexplained diff vs previous) (percentage) 0.480 -
435.gromacs 131.000 -
435.gromacs (avg) 131.000 -
435.gromacs (avg) (percentage) 1.840 -
435.gromacs (max) 45.000 -6.25%
435.gromacs (max) (percentage) 0.640 -4.48%
436.cactusADM 31.000 -
436.cactusADM (avg) 31.000 -
436.cactusADM (avg) (percentage) 1.470 -
436.cactusADM (max) 24.000 -4.00%
436.cactusADM (max) (percentage) 1.170 -4.10%
436.cactusADM (unexplained diff vs previous) 18.000 -
436.cactusADM (unexplained diff vs previous) (percentage) 0.850 -
437.leslie3d 520.000 -9.25%
437.leslie3d (avg) 520.000 -9.25%
437.leslie3d (avg) (percentage) 4.710 2.61%
437.leslie3d (max) 1276.000 62.34%
437.leslie3d (max) (percentage) 11.540 83.47%
437.leslie3d (unexplained diff vs previous) 1442.000 -
437.leslie3d (unexplained diff vs previous) (percentage) 13.040 -
444.namd 11.000 -
444.namd (avg) 11.000 -
444.namd (avg) (percentage) 1.540 -
444.namd (max) 4.000 -
444.namd (max) (percentage) 0.600 -6.25%
444.namd (unexplained diff vs previous) 2.000 -60.00%
444.namd (unexplained diff vs previous) (percentage) 0.260 -60.00%
445.gobmk 50.000 -
445.gobmk (avg) 50.000 -
445.gobmk (avg) (percentage) 0.990 -
445.gobmk (max) 36.000 -5.26%
445.gobmk (max) (percentage) 0.720 -5.26%
447.dealII 22.000 -
447.dealII (avg) 22.000 -
447.dealII (avg) (percentage) 1.400 -
447.dealII (max) 15.000 -6.25%
447.dealII (max) (percentage) 0.970 -2.02%
450.soplex 14.000 -6.67%
450.soplex (avg) 14.000 -6.67%
450.soplex (avg) (percentage) 2.530 -
450.soplex (max) 7.000 -
450.soplex (max) (percentage) 1.260 -3.08%
453.povray 9.000 -
453.povray (avg) 9.000 -
453.povray (avg) (percentage) 1.730 -
453.povray (max) 8.000 -
453.povray (max) (percentage) 1.580 -4.82%
454.calculix (avg) (percentage) 3.600 -
454.calculix (max) (percentage) 0.890 -1.11%
456.hmmer 21.000 -
456.hmmer (avg) 21.000 -
456.hmmer (avg) (percentage) 0.720 -
456.hmmer (max) 4.000 -20.00%
456.hmmer (max) (percentage) 0.170 -
458.sjeng 53.000 -
458.sjeng (avg) 53.000 -
458.sjeng (avg) (percentage) 0.720 -
458.sjeng (max) 25.000 -3.85%
458.sjeng (max) (percentage) 0.340 -5.56%
459.GemsFDTD 78.000 -
459.GemsFDTD (avg) 78.000 -
459.GemsFDTD (avg) (percentage) 1.470 -
459.GemsFDTD (max) 43.000 -2.27%
459.GemsFDTD (max) (percentage) 0.810 -2.41%
462.libquantum 2.000 -
462.libquantum (avg) 2.000 -
462.libquantum (avg) (percentage) 1.780 -
462.libquantum (max) 3.000 -
462.libquantum (max) (percentage) 2.250 -2.60%
462.libquantum (unexplained diff vs previous) 3.000 -
462.libquantum (unexplained diff vs previous) (percentage) 2.170 -
464.h264ref 53.000 -1.85%
464.h264ref (avg) 53.000 -1.85%
464.h264ref (avg) (percentage) 0.930 -
464.h264ref (max) 12.000 -7.69%
464.h264ref (max) (percentage) 0.220 -4.35%
465.tonto 158.000 -1.25%
465.tonto (avg) 158.000 -1.25%
465.tonto (avg) (percentage) 1.370 -
465.tonto (max) 91.000 -6.19%
465.tonto (max) (percentage) 0.790 -4.82%
470.lbm 41.000 -2.38%
470.lbm (avg) 41.000 -2.38%
470.lbm (avg) (percentage) 1.100 -1.79%
470.lbm (max) 6.000 -
470.lbm (max) (percentage) 0.170 -
470.lbm (unexplained diff vs previous) 4.000 -
470.lbm (unexplained diff vs previous) (percentage) 0.110 -
471.omnetpp 62.000 5.08%
471.omnetpp (avg) 62.000 5.08%
471.omnetpp (avg) (percentage) 2.230 1.36%
471.omnetpp (max) 121.000 168.89%
471.omnetpp (max) (percentage) 4.320 157.14%
471.omnetpp (unexplained diff vs previous) 116.000 480.00%
471.omnetpp (unexplained diff vs previous) (percentage) 4.140 459.46%
473.astar 87.000 -1.14%
473.astar (avg) 87.000 -1.14%
473.astar (avg) (percentage) 1.640 -1.20%
473.astar (max) 16.000 6.67%
473.astar (max) (percentage) 0.300 -
473.astar (unexplained diff vs previous) 4.000 -42.86%
473.astar (unexplained diff vs previous) (percentage) 0.070 -46.15%
481.wrf (avg) (percentage) 1.800 -
481.wrf (max) (percentage) 0.970 -1.02%
482.sphinx3 15.000 -
482.sphinx3 (avg) 15.000 -
482.sphinx3 (avg) (percentage) 1.850 -
482.sphinx3 (max) 4.000 -20.00%
482.sphinx3 (max) (percentage) 0.590 -4.84%
483.xalancbmk (avg) (percentage) 2.960 -
483.xalancbmk (max) (percentage) 1.770 -
Geometric Mean 6.513 17.10%