Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=84f7f8940760d0eaeb51a38b345db369b4207e5b (unchanged)
git_gcc https://github.com/gcc-mirror/gcc/commit/b8e3574e68310f68116f157a35d5650600d13718 (+ 39 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=8d7b6b4cb27d4dec1dd5f7960298c1699275f962 (unchanged)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=30e92e8838a078df359a97e36d048f06bbd5bec1 (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-aarch64-master-Os_LTO-build/244/
View Options
Report
Filter

gnu-aarch64-master-Os_LTO test results

Run Order Start Time Duration
Current 0244 (basepoints/gcc-15-00574-gb8e3574e683) 2024-05-17T16:59:50 0:00:00
Previous 0242 (3-changed-components) 2024-05-16T09:59:26 0:00:00
Baseline 0001 (4-changed-components) 2023-02-20T22:48:24 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 16 15
Performance Improvements 67 160
Added Tests 2 2
Unchanged Tests 1151 1059
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Code Size Δ Previous Current σ Δ (B) σ (B)
400.perlbench 1.38% 882291.000 894483.000 - 0.07% -

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
437.leslie3d 15.20% 10852.000 12501.000 - 7.40% -
464.h264ref 1.56% 5719.000 5808.000 - 0.82% -
429.mcf 1.09% 1920.000 1941.000 - 36.31% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
471.omnetpp (unexplained diff vs previous) (percentage) 236.36% 0.220 0.740 0.000 -99.81% 0.000
471.omnetpp (unexplained diff vs previous) 233.33% 6.000 20.000 0.000 -99.81% 0.000
444.namd (unexplained diff vs previous) 25.00% 4.000 5.000 0.000 -99.94% 0.000
444.namd (unexplained diff vs previous) (percentage) 25.00% 0.520 0.650 0.000 -99.94% 0.000
444.namd (max) (percentage) 23.08% 0.520 0.640 - -99.30% -
437.leslie3d 15.06% 498.000 573.000 - 61.41% -
437.leslie3d (avg) 15.06% 498.000 573.000 - 61.41% -
437.leslie3d (max) 9.93% 715.000 786.000 - -59.25% -
464.h264ref 1.89% 53.000 54.000 - -81.57% -
464.h264ref (avg) 1.89% 53.000 54.000 - -81.57% -
459.GemsFDTD 1.30% 77.000 78.000 - -78.33% -
459.GemsFDTD (avg) 1.30% 77.000 78.000 - -78.33% -

Performance Improvements - Code Size Δ Previous Current σ Δ (B) σ (B)
462.libquantum -1.40% 16053.000 15829.000 - -1.59% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
453.povray -3.23% 557.000 539.000 - -1.46% -
462.libquantum -2.17% 138.000 135.000 - -3.57% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
429.mcf (max) -89.74% 546.000 56.000 - -95.76% -
429.mcf (max) (percentage) -89.74% 28.460 2.920 - -96.86% -
433.milc (unexplained diff vs previous) (percentage) -71.67% 0.600 0.170 0.000 -99.98% 0.000
433.milc (unexplained diff vs previous) -71.43% 7.000 2.000 0.000 -99.98% 0.000
470.lbm (max) -68.42% 19.000 6.000 - -99.78% -
429.mcf (unexplained diff vs previous) (percentage) -67.07% 3.280 1.080 0.000 -99.92% 0.000
429.mcf (unexplained diff vs previous) -66.67% 63.000 21.000 0.000 -99.89% 0.000
470.lbm (max) (percentage) -65.38% 0.520 0.180 - -99.75% -
473.astar (max) -48.28% 29.000 15.000 - -99.56% -
473.astar (max) (percentage) -46.43% 0.560 0.300 - -99.55% -
410.bwaves (unexplained diff vs previous) -45.16% 31.000 17.000 0.000 -99.78% 0.000
410.bwaves (unexplained diff vs previous) (percentage) -44.23% 0.520 0.290 0.000 -99.79% 0.000
473.astar (unexplained diff vs previous) (percentage) -31.58% 0.190 0.130 0.000 -99.93% 0.000
410.bwaves (max) (percentage) -31.08% 0.740 0.510 - -99.12% -
410.bwaves (max) -30.23% 43.000 30.000 - -99.08% -
473.astar (unexplained diff vs previous) -30.00% 10.000 7.000 0.000 -99.93% 0.000
450.soplex (max) -12.50% 8.000 7.000 - -98.72% -
453.povray (max) -11.11% 9.000 8.000 - -98.40% -
471.omnetpp (max) (percentage) -10.16% 1.870 1.680 - -97.89% -
471.omnetpp (max) -10.00% 50.000 45.000 - -97.93% -
444.namd -8.33% 12.000 11.000 - -83.82% -
444.namd (avg) -8.33% 12.000 11.000 - -83.82% -
433.milc (max) (percentage) -8.33% 0.600 0.550 - -99.39% -
464.h264ref (max) (percentage) -8.00% 0.250 0.230 - -99.58% -
458.sjeng (max) (percentage) -7.69% 0.390 0.360 - -99.24% -
458.sjeng (max) -7.14% 28.000 26.000 - -99.28% -
464.h264ref (max) -7.14% 14.000 13.000 - -99.58% -
453.povray (max) (percentage) -6.74% 1.780 1.660 - -98.18% -
465.tonto (max) (percentage) -6.74% 0.890 0.830 - -95.70% -
482.sphinx3 (max) (percentage) -6.06% 0.660 0.620 - -99.36% -
433.milc -5.88% 17.000 16.000 - -76.81% -
433.milc (avg) -5.88% 17.000 16.000 - -76.81% -
465.tonto (max) -5.83% 103.000 97.000 - -95.41% -
445.gobmk (max) (percentage) -5.00% 0.800 0.760 - -98.56% -
445.gobmk (max) -5.00% 40.000 38.000 - -98.56% -
437.leslie3d (max) (percentage) -4.55% 6.590 6.290 - -62.06% -
401.bzip2 (max) (percentage) -4.55% 0.880 0.840 - -98.93% -
450.soplex (max) (percentage) -4.41% 1.360 1.300 - -98.65% -
447.dealII -4.35% 23.000 22.000 - -77.78% -
447.dealII (avg) -4.35% 23.000 22.000 - -77.78% -
435.gromacs (max) (percentage) -4.29% 0.700 0.670 - -98.64% -
401.bzip2 (max) -4.00% 25.000 24.000 - -98.96% -
435.gromacs (max) -4.00% 50.000 48.000 - -98.66% -
436.cactusADM (max) (percentage) -3.94% 1.270 1.220 - -98.63% -
436.cactusADM (max) -3.85% 26.000 25.000 - -98.65% -
462.libquantum (max) (percentage) -3.75% 2.400 2.310 - -97.67% -
400.perlbench (max) (percentage) -3.30% 2.120 2.050 - -97.56% -
434.zeusmp -3.23% 31.000 30.000 - -79.59% -
434.zeusmp (avg) -3.23% 31.000 30.000 - -79.59% -
400.perlbench (max) -3.03% 33.000 32.000 - -97.71% -
447.dealII (max) (percentage) -2.94% 1.020 0.990 - -98.77% -
459.GemsFDTD (max) (percentage) -2.35% 0.850 0.830 - -98.84% -
459.GemsFDTD (max) -2.22% 45.000 44.000 - -99.00% -
416.gamess (max) (percentage) -2.08% 0.480 0.470 - -98.78% -
410.bwaves (avg) (percentage) -1.80% 1.110 1.090 - -75.28% -
471.omnetpp -1.67% 60.000 59.000 - -73.54% -
471.omnetpp (avg) -1.67% 60.000 59.000 - -73.54% -
410.bwaves -1.54% 65.000 64.000 - -74.30% -
410.bwaves (avg) -1.54% 65.000 64.000 - -74.30% -
429.mcf (avg) (percentage) -1.28% 6.250 6.170 - -19.56% -
444.namd (avg) (percentage) -1.27% 1.570 1.550 - -83.19% -
473.astar (avg) (percentage) -1.19% 1.680 1.660 - -60.10% -
473.astar -1.12% 89.000 88.000 - -58.69% -
473.astar (avg) -1.12% 89.000 88.000 - -58.69% -

Added Tests - sample variability
470.lbm (unexplained diff vs previous)
470.lbm (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
429.mcf 36.31% 1424.000 1941.000 - 1.09% -
437.leslie3d 7.40% 11640.000 12501.000 - 15.20% -
465.tonto 7.17% 10941.000 11726.000 - 0.46% -
450.soplex 4.94% 567.000 595.000 - -0.34% -
410.bwaves 4.71% 5652.000 5918.000 - -0.29% -
473.astar 3.98% 5128.000 5332.000 - -0.13% -
456.hmmer 3.30% 2882.000 2977.000 - 0.57% -
444.namd 3.21% 747.000 771.000 - -0.64% -
445.gobmk 1.91% 5023.000 5119.000 - 0.67% -
436.cactusADM 1.06% 2083.000 2105.000 - -0.28% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d 61.41% 355.000 573.000 - 15.06% -
437.leslie3d (avg) 61.41% 355.000 573.000 - 15.06% -
437.leslie3d (avg) (percentage) 50.49% 3.050 4.590 - 0.00% -
429.mcf 9.17% 109.000 119.000 - -0.83% -
429.mcf (avg) 9.17% 109.000 119.000 - -0.83% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
459.GemsFDTD -2.92% 244728.000 237576.000 - -0.63% -
434.zeusmp -2.48% 152037.000 148271.000 - -0.08% -
437.leslie3d -1.63% 59479.000 58510.000 - -0.23% -
462.libquantum -1.59% 16085.000 15829.000 - -1.40% -
470.lbm -1.44% 9691.000 9551.000 - 0.00% -
464.h264ref -1.40% 387748.000 382320.000 - -0.04% -
453.povray -1.34% 661389.000 652545.000 - -0.60% -
410.bwaves -1.26% 16760.000 16548.000 - 0.00% -
433.milc -1.10% 61382.000 60709.000 - -0.16% -
435.gromacs -1.10% 499261.000 493793.000 - -0.03% -
458.sjeng -1.03% 104048.000 102976.000 - -0.21% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
459.GemsFDTD -13.33% 6173.000 5350.000 - 0.83% -
482.sphinx3 -12.06% 945.000 831.000 - -0.84% -
400.perlbench -5.11% 1663.000 1578.000 - 0.38% -
447.dealII -4.76% 1724.000 1642.000 - -0.67% -
462.libquantum -3.57% 140.000 135.000 - -2.17% -
458.sjeng -2.29% 7567.000 7394.000 - -0.50% -
453.povray -1.46% 547.000 539.000 - -3.23% -
471.omnetpp -1.43% 2724.000 2685.000 - -0.74% -
435.gromacs -1.36% 7269.000 7170.000 - -0.18% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
433.milc (unexplained diff vs previous) (percentage) -99.98% 980.800 0.170 0.000 -71.67% 0.000
433.milc (unexplained diff vs previous) -99.98% 11289.000 2.000 0.000 -71.43% 0.000
444.namd (unexplained diff vs previous) (percentage) -99.94% 1118.610 0.650 0.000 25.00% 0.000
444.namd (unexplained diff vs previous) -99.94% 8356.000 5.000 0.000 25.00% 0.000
473.astar (unexplained diff vs previous) (percentage) -99.93% 197.850 0.130 0.000 -31.58% 0.000
473.astar (unexplained diff vs previous) -99.93% 10146.000 7.000 0.000 -30.00% 0.000
429.mcf (unexplained diff vs previous) (percentage) -99.92% 1305.690 1.080 0.000 -67.07% 0.000
429.mcf (unexplained diff vs previous) -99.89% 18593.000 21.000 0.000 -66.67% 0.000
471.omnetpp (unexplained diff vs previous) -99.81% 10659.000 20.000 0.000 233.33% 0.000
471.omnetpp (unexplained diff vs previous) (percentage) -99.81% 391.300 0.740 0.000 236.36% 0.000
410.bwaves (unexplained diff vs previous) (percentage) -99.79% 137.900 0.290 0.000 -44.23% 0.000
410.bwaves (unexplained diff vs previous) -99.78% 7794.000 17.000 0.000 -45.16% 0.000
470.lbm (max) -99.78% 2746.000 6.000 - -68.42% -
456.hmmer (max) (percentage) -99.77% 73.590 0.170 - 0.00% -
456.hmmer (max) -99.76% 2120.000 5.000 - 0.00% -
470.lbm (max) (percentage) -99.75% 72.510 0.180 - -65.38% -
464.h264ref (max) -99.58% 3127.000 13.000 - -7.14% -
464.h264ref (max) (percentage) -99.58% 54.290 0.230 - -8.00% -
473.astar (max) -99.56% 3406.000 15.000 - -48.28% -
473.astar (max) (percentage) -99.55% 66.430 0.300 - -46.43% -
482.sphinx3 (max) -99.45% 911.000 5.000 - 0.00% -
433.milc (max) -99.43% 1044.000 6.000 - 0.00% -
444.namd (max) -99.42% 685.000 4.000 - 0.00% -
433.milc (max) (percentage) -99.39% 90.750 0.550 - -8.33% -
482.sphinx3 (max) (percentage) -99.36% 96.500 0.620 - -6.06% -
434.zeusmp (max) -99.32% 2055.000 14.000 - 0.00% -
434.zeusmp (max) (percentage) -99.30% 81.770 0.570 - 0.00% -
444.namd (max) (percentage) -99.30% 91.790 0.640 - 23.08% -
458.sjeng (max) -99.28% 3602.000 26.000 - -7.14% -
458.sjeng (max) (percentage) -99.24% 47.610 0.360 - -7.69% -
410.bwaves (max) (percentage) -99.12% 57.970 0.510 - -31.08% -
454.calculix (max) (percentage) -99.10% 99.730 0.900 - 0.00% -
410.bwaves (max) -99.08% 3276.000 30.000 - -30.23% -
459.GemsFDTD (max) -99.00% 4411.000 44.000 - -2.22% -
401.bzip2 (max) -98.96% 2313.000 24.000 - -4.00% -
401.bzip2 (max) (percentage) -98.93% 78.650 0.840 - -4.55% -
447.dealII (max) -98.84% 1384.000 16.000 - 0.00% -
459.GemsFDTD (max) (percentage) -98.84% 71.460 0.830 - -2.35% -
416.gamess (max) (percentage) -98.78% 38.550 0.470 - -2.08% -
447.dealII (max) (percentage) -98.77% 80.280 0.990 - -2.94% -
450.soplex (max) -98.72% 545.000 7.000 - -12.50% -
435.gromacs (max) -98.66% 3573.000 48.000 - -4.00% -
450.soplex (max) (percentage) -98.65% 96.240 1.300 - -4.41% -
436.cactusADM (max) -98.65% 1848.000 25.000 - -3.85% -
435.gromacs (max) (percentage) -98.64% 49.160 0.670 - -4.29% -
436.cactusADM (max) (percentage) -98.63% 88.730 1.220 - -3.94% -
481.wrf (max) (percentage) -98.57% 68.700 0.980 - 0.00% -
445.gobmk (max) -98.56% 2643.000 38.000 - -5.00% -
445.gobmk (max) (percentage) -98.56% 52.630 0.760 - -5.00% -
453.povray (max) -98.40% 499.000 8.000 - -11.11% -
453.povray (max) (percentage) -98.18% 91.250 1.660 - -6.74% -
471.omnetpp (max) -97.93% 2169.000 45.000 - -10.00% -
471.omnetpp (max) (percentage) -97.89% 79.650 1.680 - -10.16% -
462.libquantum (max) -97.83% 138.000 3.000 - 0.00% -
400.perlbench (max) -97.71% 1397.000 32.000 - -3.03% -
462.libquantum (max) (percentage) -97.67% 98.970 2.310 - -3.75% -
400.perlbench (max) (percentage) -97.56% 84.060 2.050 - -3.30% -
483.xalancbmk (max) (percentage) -97.42% 68.670 1.770 - 0.00% -
429.mcf (max) (percentage) -96.86% 92.890 2.920 - -89.74% -
429.mcf (max) -95.76% 1322.000 56.000 - -89.74% -
465.tonto (max) (percentage) -95.70% 19.310 0.830 - -6.74% -
403.gcc (max) (percentage) -95.60% 99.360 4.370 - -0.68% -
465.tonto (max) -95.41% 2112.000 97.000 - -5.83% -
444.namd -83.82% 68.000 11.000 - -8.33% -
444.namd (avg) -83.82% 68.000 11.000 - -8.33% -
456.hmmer (avg) (percentage) -83.67% 4.410 0.720 - 0.00% -
456.hmmer -83.46% 127.000 21.000 - 0.00% -
456.hmmer (avg) -83.46% 127.000 21.000 - 0.00% -
444.namd (avg) (percentage) -83.19% 9.220 1.550 - -1.27% -
416.gamess (avg) (percentage) -82.81% 4.420 0.760 - 0.00% -
470.lbm -82.43% 239.000 42.000 - 0.00% -
470.lbm (avg) -82.43% 239.000 42.000 - 0.00% -
470.lbm (avg) (percentage) -82.31% 6.330 1.120 - -0.88% -
464.h264ref (avg) (percentage) -81.73% 5.090 0.930 - 0.00% -
464.h264ref -81.57% 293.000 54.000 - 1.89% -
464.h264ref (avg) -81.57% 293.000 54.000 - 1.89% -
462.libquantum -80.00% 10.000 2.000 - 0.00% -
462.libquantum (avg) -80.00% 10.000 2.000 - 0.00% -
482.sphinx3 -79.73% 74.000 15.000 - 0.00% -
482.sphinx3 (avg) -79.73% 74.000 15.000 - 0.00% -
434.zeusmp -79.59% 147.000 30.000 - -3.23% -
434.zeusmp (avg) -79.59% 147.000 30.000 - -3.23% -
434.zeusmp (avg) (percentage) -78.97% 5.850 1.230 - 0.00% -
453.povray -78.57% 42.000 9.000 - 0.00% -
453.povray (avg) -78.57% 42.000 9.000 - 0.00% -
459.GemsFDTD -78.33% 360.000 78.000 - 1.30% -
459.GemsFDTD (avg) -78.33% 360.000 78.000 - 1.30% -
458.sjeng -78.01% 241.000 53.000 - 0.00% -
458.sjeng (avg) -78.01% 241.000 53.000 - 0.00% -
453.povray (avg) (percentage) -77.85% 7.810 1.730 - 0.00% -
447.dealII -77.78% 99.000 22.000 - -4.35% -
447.dealII (avg) -77.78% 99.000 22.000 - -4.35% -
458.sjeng (avg) (percentage) -77.43% 3.190 0.720 - 0.00% -
433.milc -76.81% 69.000 16.000 - -5.88% -
433.milc (avg) -76.81% 69.000 16.000 - -5.88% -
462.libquantum (avg) (percentage) -76.76% 7.660 1.780 - 0.00% -
482.sphinx3 (avg) (percentage) -76.67% 7.930 1.850 - 0.00% -
433.milc (avg) (percentage) -75.87% 6.050 1.460 - -0.68% -
447.dealII (avg) (percentage) -75.74% 5.770 1.400 - 0.00% -
410.bwaves (avg) (percentage) -75.28% 4.410 1.090 - -1.80% -
436.cactusADM (avg) (percentage) -75.25% 5.980 1.480 - 0.00% -
436.cactusADM -75.00% 124.000 31.000 - 0.00% -
436.cactusADM (avg) -75.00% 124.000 31.000 - 0.00% -
459.GemsFDTD (avg) (percentage) -74.83% 5.840 1.470 - 0.00% -
445.gobmk (avg) (percentage) -74.68% 3.910 0.990 - 0.00% -
445.gobmk -74.49% 196.000 50.000 - 0.00% -
445.gobmk (avg) -74.49% 196.000 50.000 - 0.00% -
410.bwaves -74.30% 249.000 64.000 - -1.54% -
410.bwaves (avg) -74.30% 249.000 64.000 - -1.54% -
471.omnetpp -73.54% 223.000 59.000 - -1.67% -
471.omnetpp (avg) -73.54% 223.000 59.000 - -1.67% -
471.omnetpp (avg) (percentage) -73.17% 8.200 2.200 - -0.90% -
481.wrf (avg) (percentage) -71.15% 6.240 1.800 - 0.00% -
401.bzip2 -67.70% 161.000 52.000 - 0.00% -
401.bzip2 (avg) -67.70% 161.000 52.000 - 0.00% -
401.bzip2 (avg) (percentage) -67.15% 5.480 1.800 - 0.00% -
400.perlbench -66.67% 105.000 35.000 - 0.00% -
400.perlbench (avg) -66.67% 105.000 35.000 - 0.00% -
400.perlbench (avg) (percentage) -64.57% 6.350 2.250 - 0.00% -
435.gromacs -64.31% 367.000 131.000 - -0.76% -
435.gromacs (avg) -64.31% 367.000 131.000 - -0.76% -
435.gromacs (avg) (percentage) -63.64% 5.060 1.840 - 0.00% -
437.leslie3d (max) (percentage) -62.06% 16.580 6.290 - -4.55% -
450.soplex (avg) (percentage) -60.65% 6.430 2.530 - 0.00% -
473.astar (avg) (percentage) -60.10% 4.160 1.660 - -1.19% -
437.leslie3d (max) -59.25% 1929.000 786.000 - 9.93% -
465.tonto (avg) (percentage) -58.98% 3.340 1.370 - 0.00% -
473.astar -58.69% 213.000 88.000 - -1.12% -
473.astar (avg) -58.69% 213.000 88.000 - -1.12% -
450.soplex -58.33% 36.000 15.000 - 0.00% -
450.soplex (avg) -58.33% 36.000 15.000 - 0.00% -
465.tonto -56.16% 365.000 160.000 - 0.63% -
465.tonto (avg) -56.16% 365.000 160.000 - 0.63% -
454.calculix (avg) (percentage) -55.11% 8.020 3.600 - 0.00% -
483.xalancbmk (avg) (percentage) -54.46% 6.500 2.960 - 0.00% -
403.gcc (avg) (percentage) -30.46% 7.320 5.090 - 0.00% -
429.mcf (avg) (percentage) -19.56% 7.670 6.170 - -1.28% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 134.48% 29.000 68.000 - 0.00% -
nb_compile_successful 65.52% 29.000 48.000 - 0.00% -
nb_execution_successful 65.52% 29.000 48.000 - 0.00% -

Added Tests - sample variability
470.lbm (unexplained diff vs previous)
470.lbm (unexplained diff vs previous) (percentage)

Report Time: 0.39s
Execution (seconds)
Name Current %
400.perlbench 1578.000 -
401.bzip2 2943.000 -
410.bwaves 5918.000 -
429.mcf 1941.000 1.09%
433.milc 1156.000 -
434.zeusmp 2512.000 -
435.gromacs 7170.000 -
436.cactusADM 2105.000 -
437.leslie3d 12501.000 15.20%
444.namd 771.000 -
445.gobmk 5119.000 -
447.dealII 1642.000 -
450.soplex 595.000 -
453.povray 539.000 -3.23%
456.hmmer 2977.000 -
458.sjeng 7394.000 -
459.GemsFDTD 5350.000 -
462.libquantum 135.000 -2.17%
464.h264ref 5808.000 1.56%
465.tonto 11726.000 -
470.lbm 3793.000 -
471.omnetpp 2685.000 -
473.astar 5332.000 -
482.sphinx3 831.000 -
Geometric Mean 2481.335 -
Code Size (bytes)
Name Current %
400.perlbench 894483.000 1.38%
401.bzip2 43835.000 -
410.bwaves 16548.000 -
429.mcf 9055.000 -
433.milc 60709.000 -
434.zeusmp 148271.000 -
435.gromacs 493793.000 -
436.cactusADM 350835.000 -
437.leslie3d 58510.000 -
444.namd 189548.000 -
445.gobmk 1379766.000 -
447.dealII 309884.000 -
450.soplex 205587.000 -
453.povray 652545.000 -
456.hmmer 108331.000 -
458.sjeng 102976.000 -
459.GemsFDTD 237576.000 -
462.libquantum 15829.000 -1.40%
464.h264ref 382320.000 -
465.tonto 1944842.000 -
470.lbm 9551.000 -
471.omnetpp 476698.000 -
473.astar 22888.000 -
482.sphinx3 112263.000 -
Geometric Mean 137611.811 -
sample variability
Name Current %
400.perlbench 35.000 -
400.perlbench (avg) 35.000 -
400.perlbench (avg) (percentage) 2.250 -
400.perlbench (max) 32.000 -3.03%
400.perlbench (max) (percentage) 2.050 -3.30%
401.bzip2 52.000 -
401.bzip2 (avg) 52.000 -
401.bzip2 (avg) (percentage) 1.800 -
401.bzip2 (max) 24.000 -4.00%
401.bzip2 (max) (percentage) 0.840 -4.55%
403.gcc (avg) (percentage) 5.090 -
403.gcc (max) (percentage) 4.370 -
410.bwaves 64.000 -1.54%
410.bwaves (avg) 64.000 -1.54%
410.bwaves (avg) (percentage) 1.090 -1.80%
410.bwaves (max) 30.000 -30.23%
410.bwaves (max) (percentage) 0.510 -31.08%
410.bwaves (unexplained diff vs previous) 17.000 -45.16%
410.bwaves (unexplained diff vs previous) (percentage) 0.290 -44.23%
416.gamess (avg) (percentage) 0.760 -
416.gamess (max) (percentage) 0.470 -2.08%
429.mcf 119.000 -
429.mcf (avg) 119.000 -
429.mcf (avg) (percentage) 6.170 -1.28%
429.mcf (max) 56.000 -89.74%
429.mcf (max) (percentage) 2.920 -89.74%
429.mcf (unexplained diff vs previous) 21.000 -66.67%
429.mcf (unexplained diff vs previous) (percentage) 1.080 -67.07%
433.milc 16.000 -5.88%
433.milc (avg) 16.000 -5.88%
433.milc (avg) (percentage) 1.460 -
433.milc (max) 6.000 -
433.milc (max) (percentage) 0.550 -8.33%
433.milc (unexplained diff vs previous) 2.000 -71.43%
433.milc (unexplained diff vs previous) (percentage) 0.170 -71.67%
434.zeusmp 30.000 -3.23%
434.zeusmp (avg) 30.000 -3.23%
434.zeusmp (avg) (percentage) 1.230 -
434.zeusmp (max) 14.000 -
434.zeusmp (max) (percentage) 0.570 -
435.gromacs 131.000 -
435.gromacs (avg) 131.000 -
435.gromacs (avg) (percentage) 1.840 -
435.gromacs (max) 48.000 -4.00%
435.gromacs (max) (percentage) 0.670 -4.29%
436.cactusADM 31.000 -
436.cactusADM (avg) 31.000 -
436.cactusADM (avg) (percentage) 1.480 -
436.cactusADM (max) 25.000 -3.85%
436.cactusADM (max) (percentage) 1.220 -3.94%
437.leslie3d 573.000 15.06%
437.leslie3d (avg) 573.000 15.06%
437.leslie3d (avg) (percentage) 4.590 -
437.leslie3d (max) 786.000 9.93%
437.leslie3d (max) (percentage) 6.290 -4.55%
444.namd 11.000 -8.33%
444.namd (avg) 11.000 -8.33%
444.namd (avg) (percentage) 1.550 -1.27%
444.namd (max) 4.000 -
444.namd (max) (percentage) 0.640 23.08%
444.namd (unexplained diff vs previous) 5.000 25.00%
444.namd (unexplained diff vs previous) (percentage) 0.650 25.00%
445.gobmk 50.000 -
445.gobmk (avg) 50.000 -
445.gobmk (avg) (percentage) 0.990 -
445.gobmk (max) 38.000 -5.00%
445.gobmk (max) (percentage) 0.760 -5.00%
447.dealII 22.000 -4.35%
447.dealII (avg) 22.000 -4.35%
447.dealII (avg) (percentage) 1.400 -
447.dealII (max) 16.000 -
447.dealII (max) (percentage) 0.990 -2.94%
450.soplex 15.000 -
450.soplex (avg) 15.000 -
450.soplex (avg) (percentage) 2.530 -
450.soplex (max) 7.000 -12.50%
450.soplex (max) (percentage) 1.300 -4.41%
453.povray 9.000 -
453.povray (avg) 9.000 -
453.povray (avg) (percentage) 1.730 -
453.povray (max) 8.000 -11.11%
453.povray (max) (percentage) 1.660 -6.74%
454.calculix (avg) (percentage) 3.600 -
454.calculix (max) (percentage) 0.900 -
456.hmmer 21.000 -
456.hmmer (avg) 21.000 -
456.hmmer (avg) (percentage) 0.720 -
456.hmmer (max) 5.000 -
456.hmmer (max) (percentage) 0.170 -
458.sjeng 53.000 -
458.sjeng (avg) 53.000 -
458.sjeng (avg) (percentage) 0.720 -
458.sjeng (max) 26.000 -7.14%
458.sjeng (max) (percentage) 0.360 -7.69%
459.GemsFDTD 78.000 1.30%
459.GemsFDTD (avg) 78.000 1.30%
459.GemsFDTD (avg) (percentage) 1.470 -
459.GemsFDTD (max) 44.000 -2.22%
459.GemsFDTD (max) (percentage) 0.830 -2.35%
462.libquantum 2.000 -
462.libquantum (avg) 2.000 -
462.libquantum (avg) (percentage) 1.780 -
462.libquantum (max) 3.000 -
462.libquantum (max) (percentage) 2.310 -3.75%
464.h264ref 54.000 1.89%
464.h264ref (avg) 54.000 1.89%
464.h264ref (avg) (percentage) 0.930 -
464.h264ref (max) 13.000 -7.14%
464.h264ref (max) (percentage) 0.230 -8.00%
465.tonto 160.000 -
465.tonto (avg) 160.000 -
465.tonto (avg) (percentage) 1.370 -
465.tonto (max) 97.000 -5.83%
465.tonto (max) (percentage) 0.830 -6.74%
470.lbm 42.000 -
470.lbm (avg) 42.000 -
470.lbm (avg) (percentage) 1.120 -
470.lbm (max) 6.000 -68.42%
470.lbm (max) (percentage) 0.180 -65.38%
470.lbm (unexplained diff vs previous) 0.000 -
470.lbm (unexplained diff vs previous) (percentage) 0.000 -
471.omnetpp 59.000 -1.67%
471.omnetpp (avg) 59.000 -1.67%
471.omnetpp (avg) (percentage) 2.200 -
471.omnetpp (max) 45.000 -10.00%
471.omnetpp (max) (percentage) 1.680 -10.16%
471.omnetpp (unexplained diff vs previous) 20.000 233.33%
471.omnetpp (unexplained diff vs previous) (percentage) 0.740 236.36%
473.astar 88.000 -1.12%
473.astar (avg) 88.000 -1.12%
473.astar (avg) (percentage) 1.660 -1.19%
473.astar (max) 15.000 -48.28%
473.astar (max) (percentage) 0.300 -46.43%
473.astar (unexplained diff vs previous) 7.000 -30.00%
473.astar (unexplained diff vs previous) (percentage) 0.130 -31.58%
481.wrf (avg) (percentage) 1.800 -
481.wrf (max) (percentage) 0.980 -
482.sphinx3 15.000 -
482.sphinx3 (avg) 15.000 -
482.sphinx3 (avg) (percentage) 1.850 -
482.sphinx3 (max) 5.000 -
482.sphinx3 (max) (percentage) 0.620 -6.06%
483.xalancbmk (avg) (percentage) 2.960 -
483.xalancbmk (max) (percentage) 1.770 -
Geometric Mean 5.550 -22.49%