Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=e3e1e1231d79eeda44b24f2805205ea4ee1644ff (+ 399 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/0beb16117547420a29541a00cd1db5047f1d7577 (+ 972 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=2bd00179885928fd95fcabfafc50e7b5c6e660d2 (+ 82 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=288a2f83ed42ce91cf92c2b08dad298a3da0cd9a (+ 1410 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-aarch64-master-Os-build/129/
View Options
Report
Filter

gnu-aarch64-master-Os test results

Run Order Start Time Duration
Current 0129 (4-changed-components) 2023-10-06T14:55:22 0:00:00
Previous 0109 (basepoints/gcc-14-03999-g3c834d85f2e) 2023-09-15T01:02:02 0:00:00
Baseline 0001 (3-changed-components) 2023-01-01T08:38:47 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 31 66
Performance Improvements 94 122
Added Tests 4 0
Unchanged Tests 1107 1048
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Code Size Δ Previous Current σ Δ (B) σ (B)
464.h264ref 1.88% 418956.000 426828.000 - -0.36% -

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
429.mcf 22.24% 1533.000 1874.000 - -89.08% -
436.cactusADM 1.14% 2112.000 2136.000 - -87.82% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
429.mcf (max) 2500.00% 16.000 416.000 - 352.17% -
429.mcf (max) (percentage) 1940.37% 1.090 22.240 - 4018.52% -
410.bwaves (unexplained diff vs previous) (percentage) 457.58% 0.330 1.840 - 1740.00% -
410.bwaves (unexplained diff vs previous) 445.00% 20.000 109.000 - 626.67% -
473.astar (unexplained diff vs previous) (percentage) 277.78% 0.900 3.400 - 16900.00% -
473.astar (max) (percentage) 269.66% 0.890 3.290 - 2250.00% -
473.astar (unexplained diff vs previous) 266.04% 53.000 194.000 - 6366.67% -
473.astar (max) 259.62% 52.000 187.000 - 835.00% -
410.bwaves (max) (percentage) 227.27% 0.550 1.800 - 757.14% -
410.bwaves (max) 221.21% 33.000 106.000 - 253.33% -
433.milc (max) 171.43% 7.000 19.000 - -95.38% -
433.milc (unexplained diff vs previous) (percentage) 153.62% 0.690 1.750 - -46.65% -
433.milc (max) (percentage) 152.94% 0.680 1.720 - -45.74% -
433.milc (unexplained diff vs previous) 150.00% 8.000 20.000 - -95.29% -
470.lbm (max) 126.32% 19.000 43.000 - -93.42% -
470.lbm (max) (percentage) 125.00% 0.520 1.170 - -77.06% -
429.mcf 29.41% 85.000 110.000 - 22.22% -
429.mcf (avg) 29.41% 85.000 110.000 - 22.22% -
471.omnetpp (unexplained diff vs previous) (percentage) 12.66% 3.080 3.470 - 1345.83% -
471.omnetpp (max) (percentage) 12.42% 2.980 3.350 - -45.71% -
471.omnetpp (unexplained diff vs previous) 8.89% 90.000 98.000 - 276.92% -
471.omnetpp (max) 8.05% 87.000 94.000 - -85.80% -
429.mcf (avg) (percentage) 5.95% 5.550 5.880 - 1009.43% -
436.cactusADM 2.70% 37.000 38.000 - -86.94% -
436.cactusADM (avg) 2.70% 37.000 38.000 - -86.94% -
473.astar (avg) (percentage) 1.61% 1.860 1.890 - 894.74% -

Performance Regressions - Score Δ Previous Current σ Δ (B) σ (B)
nb_compile_successful -3.45% 29.000 28.000 - -3.45% -
nb_execution_successful -3.45% 29.000 28.000 - -3.45% -

Performance Improvements - Code Size Δ Previous Current σ Δ (B) σ (B)
458.sjeng -3.49% 116113.000 112057.000 - -6.79% -
434.zeusmp -1.59% 166459.000 163813.000 - -1.14% -
436.cactusADM -1.12% 557982.000 551752.000 - -0.48% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
450.soplex -5.53% 579.000 547.000 - -96.46% -
435.gromacs -3.92% 7264.000 6979.000 - -54.74% -
471.omnetpp -3.35% 2926.000 2828.000 - -73.67% -
473.astar -3.29% 5903.000 5709.000 - -61.77% -
400.perlbench -3.21% 1587.000 1536.000 - -85.58% -
465.tonto -2.35% 10995.000 10737.000 - 30.86% -
462.libquantum -2.16% 139.000 136.000 - -98.83% -
482.sphinx3 -2.04% 933.000 914.000 - -96.95% -
458.sjeng -1.81% 7733.000 7593.000 - -46.81% -
410.bwaves -1.80% 6047.000 5938.000 - -59.76% -
444.namd -1.79% 725.000 712.000 - -92.13% -
433.milc -1.72% 1161.000 1141.000 - -91.21% -
403.gcc -1.67% 60.000 59.000 - -99.35% -
454.calculix -1.59% 63.000 62.000 - -99.73% -
445.gobmk -1.45% 5232.000 5156.000 - -57.02% -
459.GemsFDTD -1.37% 6137.000 6053.000 - -74.08% -
401.bzip2 -1.21% 2965.000 2929.000 - -80.71% -
470.lbm -1.17% 3751.000 3707.000 - -71.08% -
447.dealII -1.14% 2012.000 1989.000 - -79.60% -
481.wrf -1.12% 5528.000 5466.000 - -67.53% -
464.h264ref -1.12% 5903.000 5837.000 - -59.90% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
403.gcc (max) -25.00% 4.000 3.000 - -95.31% -
444.namd (max) -20.00% 5.000 4.000 - -99.38% -
450.soplex (max) -12.50% 8.000 7.000 - -97.70% -
450.soplex -10.00% 20.000 18.000 - -90.58% -
450.soplex (avg) -10.00% 20.000 18.000 - -90.58% -
456.hmmer (max) -10.00% 10.000 9.000 - -93.57% -
435.gromacs (max) -8.05% 87.000 80.000 - -74.28% -
482.sphinx3 (max) -7.69% 26.000 24.000 - -94.53% -
400.perlbench (max) -7.32% 41.000 38.000 - -88.99% -
465.tonto (max) -6.78% 59.000 55.000 - -81.23% -
464.h264ref (max) -6.67% 30.000 28.000 - -54.84% -
450.soplex (max) (percentage) -6.12% 1.470 1.380 - -29.95% -
444.namd -5.88% 17.000 16.000 - -95.49% -
444.namd (avg) -5.88% 17.000 16.000 - -95.49% -
481.wrf (max) -5.71% 35.000 33.000 - -93.77% -
456.hmmer (max) (percentage) -5.56% 0.360 0.340 - -73.23% -
436.cactusADM (max) (percentage) -5.41% 1.110 1.050 - -66.67% -
401.bzip2 (max) -5.41% 37.000 35.000 - -73.68% -
458.sjeng (max) -5.41% 37.000 35.000 - 12.90% -
416.gamess (max) (percentage) -5.26% 0.190 0.180 - -93.77% -
447.dealII (max) -5.26% 19.000 18.000 - -83.18% -
459.GemsFDTD (max) (percentage) -5.13% 0.390 0.370 - -38.33% -
482.sphinx3 (max) (percentage) -4.56% 2.850 2.720 - 85.03% -
416.gamess (max) -4.35% 23.000 22.000 - -96.65% -
436.cactusADM (max) -4.35% 23.000 22.000 - -96.01% -
459.GemsFDTD (max) -4.35% 23.000 22.000 - -84.29% -
400.perlbench (max) (percentage) -4.17% 2.640 2.530 - -21.91% -
444.namd (max) (percentage) -4.17% 0.720 0.690 - -90.39% -
433.milc -4.17% 24.000 23.000 - -89.55% -
433.milc (avg) -4.17% 24.000 23.000 - -89.55% -
447.dealII (max) (percentage) -4.17% 0.960 0.920 - -16.36% -
462.libquantum (max) (percentage) -4.13% 1.210 1.160 - 81.25% -
445.gobmk (max) -4.00% 25.000 24.000 - -86.89% -
401.bzip2 (max) (percentage) -3.94% 1.270 1.220 - 38.64% -
437.leslie3d (max) -3.94% 1016.000 976.000 - 178.06% -
464.h264ref (max) (percentage) -3.92% 0.510 0.490 - 13.95% -
465.tonto (max) (percentage) -3.70% 0.540 0.520 - -85.47% -
435.gromacs -3.70% 162.000 156.000 - -41.35% -
435.gromacs (avg) -3.70% 162.000 156.000 - -41.35% -
434.zeusmp (max) (percentage) -3.45% 0.580 0.560 - -75.44% -
437.leslie3d (max) (percentage) -3.34% 9.270 8.960 - 282.91% -
435.gromacs (max) (percentage) -3.33% 1.200 1.160 - -42.57% -
453.povray (max) (percentage) -3.14% 1.910 1.850 - -26.88% -
481.wrf (max) (percentage) -3.13% 0.640 0.620 - -80.32% -
471.omnetpp -2.60% 77.000 75.000 - -55.88% -
471.omnetpp (avg) -2.60% 77.000 75.000 - -55.88% -
465.tonto -2.38% 168.000 164.000 - 19.71% -
465.tonto (avg) -2.38% 168.000 164.000 - 19.71% -
400.perlbench -2.22% 45.000 44.000 - -71.79% -
400.perlbench (avg) -2.22% 45.000 44.000 - -71.79% -
454.calculix (max) (percentage) -2.22% 3.150 3.080 - -34.47% -
403.gcc (max) (percentage) -2.19% 6.850 6.700 - 830.56% -
445.gobmk (max) (percentage) -2.08% 0.480 0.470 - -69.28% -
458.sjeng (max) (percentage) -2.08% 0.480 0.470 - 113.64% -
473.astar -1.83% 109.000 107.000 - 282.14% -
473.astar (avg) -1.83% 109.000 107.000 - 282.14% -
459.GemsFDTD -1.77% 113.000 111.000 - -47.14% -
459.GemsFDTD (avg) -1.77% 113.000 111.000 - -47.14% -
401.bzip2 -1.64% 61.000 60.000 - -9.09% -
401.bzip2 (avg) -1.64% 61.000 60.000 - -9.09% -
470.lbm -1.56% 64.000 63.000 - -79.21% -
470.lbm (avg) -1.56% 64.000 63.000 - -79.21% -
464.h264ref -1.32% 76.000 75.000 - -3.85% -
464.h264ref (avg) -1.32% 76.000 75.000 - -3.85% -
445.gobmk -1.28% 78.000 77.000 - -16.30% -
445.gobmk (avg) -1.28% 78.000 77.000 - -16.30% -
458.sjeng -1.28% 78.000 77.000 - 63.83% -
458.sjeng (avg) -1.28% 78.000 77.000 - 63.83% -
410.bwaves -1.11% 90.000 89.000 - -44.38% -
410.bwaves (avg) -1.11% 90.000 89.000 - -44.38% -

Added Tests - sample variability
429.mcf (unexplained diff vs previous)
429.mcf (unexplained diff vs previous) (percentage)
470.lbm (unexplained diff vs previous)
470.lbm (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
447.dealII 1.53% 2118940.000 2151297.000 - -0.11% -
465.tonto 1.30% 2876104.000 2913377.000 - 0.49% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
465.tonto 30.86% 8205.000 10737.000 - -2.35% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
473.astar (unexplained diff vs previous) (percentage) 16900.00% 0.020 3.400 - 277.78% -
473.astar (unexplained diff vs previous) 6366.67% 3.000 194.000 - 266.04% -
429.mcf (max) (percentage) 4018.52% 0.540 22.240 - 1940.37% -
429.mcf (unexplained diff vs previous) (percentage) 3270.37% 0.540 18.200 - 0.00% -
473.astar (max) (percentage) 2250.00% 0.140 3.290 - 269.66% -
410.bwaves (unexplained diff vs previous) (percentage) 1740.00% 0.100 1.840 - 457.58% -
471.omnetpp (unexplained diff vs previous) (percentage) 1345.83% 0.240 3.470 - 12.66% -
483.xalancbmk (max) (percentage) 1341.46% 0.410 5.910 - -0.17% -
429.mcf (avg) (percentage) 1009.43% 0.530 5.880 - 5.95% -
470.lbm (unexplained diff vs previous) (percentage) 981.82% 0.110 1.190 - 0.00% -
473.astar (avg) (percentage) 894.74% 0.190 1.890 - 1.61% -
403.gcc (avg) (percentage) 839.34% 0.610 5.730 - 0.00% -
473.astar (max) 835.00% 20.000 187.000 - 259.62% -
403.gcc (max) (percentage) 830.56% 0.720 6.700 - -2.19% -
410.bwaves (max) (percentage) 757.14% 0.210 1.800 - 227.27% -
410.bwaves (unexplained diff vs previous) 626.67% 15.000 109.000 - 445.00% -
401.bzip2 (avg) (percentage) 368.18% 0.440 2.060 - 0.00% -
429.mcf (max) 352.17% 92.000 416.000 - 2500.00% -
437.leslie3d (max) (percentage) 282.91% 2.340 8.960 - -3.34% -
473.astar 282.14% 28.000 107.000 - -1.83% -
473.astar (avg) 282.14% 28.000 107.000 - -1.83% -
471.omnetpp (unexplained diff vs previous) 276.92% 26.000 98.000 - 8.89% -
429.mcf (unexplained diff vs previous) 266.67% 93.000 341.000 - 0.00% -
410.bwaves (max) 253.33% 30.000 106.000 - 221.21% -
462.libquantum (avg) (percentage) 218.46% 0.650 2.070 - 0.00% -
470.lbm (unexplained diff vs previous) 214.29% 14.000 44.000 - 0.00% -
458.sjeng (avg) (percentage) 209.09% 0.330 1.020 - 0.00% -
450.soplex (avg) (percentage) 179.03% 1.240 3.460 - 0.00% -
437.leslie3d (max) 178.06% 351.000 976.000 - -3.94% -
464.h264ref (avg) (percentage) 140.74% 0.540 1.300 - 0.00% -
458.sjeng (max) (percentage) 113.64% 0.220 0.470 - -2.08% -
459.GemsFDTD (avg) (percentage) 105.56% 0.900 1.850 - 0.00% -
453.povray (avg) (percentage) 98.40% 1.250 2.480 - 0.00% -
400.perlbench (avg) (percentage) 96.60% 1.470 2.890 - 0.00% -
445.gobmk (avg) (percentage) 94.81% 0.770 1.500 - 0.00% -
437.leslie3d (avg) (percentage) 90.34% 2.380 4.530 - 0.00% -
482.sphinx3 (max) (percentage) 85.03% 1.470 2.720 - -4.56% -
462.libquantum (max) (percentage) 81.25% 0.640 1.160 - -4.13% -
456.hmmer (avg) (percentage) 76.47% 0.680 1.200 - 0.00% -
483.xalancbmk (avg) (percentage) 76.12% 0.670 1.180 - 0.00% -
482.sphinx3 (avg) (percentage) 76.03% 1.460 2.570 - 0.00% -
447.dealII (avg) (percentage) 75.70% 1.070 1.880 - 0.00% -
454.calculix (avg) (percentage) 73.63% 2.010 3.490 - 0.00% -
471.omnetpp (avg) (percentage) 67.92% 1.590 2.670 - 0.38% -
458.sjeng 63.83% 47.000 77.000 - -1.28% -
458.sjeng (avg) 63.83% 47.000 77.000 - -1.28% -
401.bzip2 (max) (percentage) 38.64% 0.880 1.220 - -3.94% -
437.leslie3d 38.10% 357.000 493.000 - -0.60% -
437.leslie3d (avg) 38.10% 357.000 493.000 - -0.60% -
410.bwaves (avg) (percentage) 37.61% 1.090 1.500 - 0.67% -
435.gromacs (avg) (percentage) 29.48% 1.730 2.240 - 0.00% -
434.zeusmp (avg) (percentage) 29.05% 1.480 1.910 - 0.00% -
433.milc (avg) (percentage) 23.53% 1.700 2.100 - 0.00% -
429.mcf 22.22% 90.000 110.000 - 29.41% -
429.mcf (avg) 22.22% 90.000 110.000 - 29.41% -
465.tonto 19.71% 137.000 164.000 - -2.38% -
465.tonto (avg) 19.71% 137.000 164.000 - -2.38% -
464.h264ref (max) (percentage) 13.95% 0.430 0.490 - -3.92% -
458.sjeng (max) 12.90% 31.000 35.000 - -5.41% -
481.wrf (avg) (percentage) 9.52% 1.890 2.070 - 0.00% -
436.cactusADM (avg) (percentage) 7.23% 1.660 1.780 - 0.00% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -3.45% 29.000 28.000 - -3.45% -
nb_execution_successful -3.45% 29.000 28.000 - -3.45% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
458.sjeng -6.79% 120221.000 112057.000 - -3.49% -
434.zeusmp -1.14% 165699.000 163813.000 - -1.59% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
454.calculix -99.73% 22860.000 62.000 - -1.59% -
403.gcc -99.35% 9010.000 59.000 - -1.67% -
462.libquantum -98.83% 11614.000 136.000 - -2.16% -
482.sphinx3 -96.95% 29928.000 914.000 - -2.04% -
450.soplex -96.46% 15466.000 547.000 - -5.53% -
453.povray -92.42% 6544.000 496.000 - 0.81% -
444.namd -92.13% 9050.000 712.000 - -1.79% -
433.milc -91.21% 12976.000 1141.000 - -1.72% -
429.mcf -89.08% 17158.000 1874.000 - 22.24% -
436.cactusADM -87.82% 17544.000 2136.000 - 1.14% -
400.perlbench -85.58% 10650.000 1536.000 - -3.21% -
434.zeusmp -80.92% 13211.000 2521.000 - -0.20% -
401.bzip2 -80.71% 15185.000 2929.000 - -1.21% -
447.dealII -79.60% 9751.000 1989.000 - -1.14% -
459.GemsFDTD -74.08% 23356.000 6053.000 - -1.37% -
471.omnetpp -73.67% 10739.000 2828.000 - -3.35% -
456.hmmer -73.54% 11046.000 2923.000 - -0.14% -
470.lbm -71.08% 12819.000 3707.000 - -1.17% -
481.wrf -67.53% 16834.000 5466.000 - -1.12% -
473.astar -61.77% 14932.000 5709.000 - -3.29% -
464.h264ref -59.90% 14556.000 5837.000 - -1.12% -
410.bwaves -59.76% 14755.000 5938.000 - -1.80% -
445.gobmk -57.02% 11995.000 5156.000 - -1.45% -
435.gromacs -54.74% 15419.000 6979.000 - -3.92% -
458.sjeng -46.81% 14275.000 7593.000 - -1.81% -
416.gamess -44.86% 22704.000 12520.000 - 0.32% -
437.leslie3d -27.33% 15005.000 10904.000 - -0.53% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
454.calculix (max) -99.91% 1074.000 1.000 - 0.00% -
454.calculix -99.56% 459.000 2.000 - 0.00% -
454.calculix (avg) -99.56% 459.000 2.000 - 0.00% -
444.namd (max) -99.38% 649.000 4.000 - -20.00% -
462.libquantum (max) -98.65% 74.000 1.000 - 0.00% -
450.soplex (max) -97.70% 304.000 7.000 - -12.50% -
462.libquantum -97.33% 75.000 2.000 - 0.00% -
462.libquantum (avg) -97.33% 75.000 2.000 - 0.00% -
416.gamess (max) -96.65% 656.000 22.000 - -4.35% -
436.cactusADM (max) -96.01% 552.000 22.000 - -4.35% -
444.namd -95.49% 355.000 16.000 - -5.88% -
444.namd (avg) -95.49% 355.000 16.000 - -5.88% -
433.milc (max) -95.38% 411.000 19.000 - 171.43% -
434.zeusmp (max) -95.35% 301.000 14.000 - 0.00% -
403.gcc (max) -95.31% 64.000 3.000 - -25.00% -
433.milc (unexplained diff vs previous) -95.29% 425.000 20.000 - 150.00% -
482.sphinx3 -94.72% 436.000 23.000 - 0.00% -
482.sphinx3 (avg) -94.72% 436.000 23.000 - 0.00% -
453.povray (max) -94.55% 165.000 9.000 - 0.00% -
482.sphinx3 (max) -94.53% 439.000 24.000 - -7.69% -
403.gcc -94.44% 54.000 3.000 - 0.00% -
403.gcc (avg) -94.44% 54.000 3.000 - 0.00% -
481.wrf (max) -93.77% 530.000 33.000 - -5.71% -
416.gamess (max) (percentage) -93.77% 2.890 0.180 - -5.26% -
456.hmmer (max) -93.57% 140.000 9.000 - -10.00% -
470.lbm (max) -93.42% 653.000 43.000 - 126.32% -
450.soplex -90.58% 191.000 18.000 - -10.00% -
450.soplex (avg) -90.58% 191.000 18.000 - -10.00% -
444.namd (max) (percentage) -90.39% 7.180 0.690 - -4.17% -
433.milc -89.55% 220.000 23.000 - -4.17% -
433.milc (avg) -89.55% 220.000 23.000 - -4.17% -
400.perlbench (max) -88.99% 345.000 38.000 - -7.32% -
436.cactusADM -86.94% 291.000 38.000 - 2.70% -
436.cactusADM (avg) -86.94% 291.000 38.000 - 2.70% -
445.gobmk (max) -86.89% 183.000 24.000 - -4.00% -
471.omnetpp (max) -85.80% 662.000 94.000 - 8.05% -
465.tonto (max) (percentage) -85.47% 3.580 0.520 - -3.70% -
453.povray -85.19% 81.000 12.000 - 0.00% -
453.povray (avg) -85.19% 81.000 12.000 - 0.00% -
459.GemsFDTD (max) -84.29% 140.000 22.000 - -4.35% -
447.dealII (max) -83.18% 107.000 18.000 - -5.26% -
465.tonto (max) -81.23% 293.000 55.000 - -6.78% -
481.wrf (max) (percentage) -80.32% 3.150 0.620 - -3.13% -
470.lbm -79.21% 303.000 63.000 - -1.56% -
470.lbm (avg) -79.21% 303.000 63.000 - -1.56% -
470.lbm (max) (percentage) -77.06% 5.100 1.170 - 125.00% -
434.zeusmp (max) (percentage) -75.44% 2.280 0.560 - -3.45% -
434.zeusmp -75.38% 195.000 48.000 - 0.00% -
434.zeusmp (avg) -75.38% 195.000 48.000 - 0.00% -
435.gromacs (max) -74.28% 311.000 80.000 - -8.05% -
401.bzip2 (max) -73.68% 133.000 35.000 - -5.41% -
456.hmmer (max) (percentage) -73.23% 1.270 0.340 - -5.56% -
400.perlbench -71.79% 156.000 44.000 - -2.22% -
400.perlbench (avg) -71.79% 156.000 44.000 - -2.22% -
445.gobmk (max) (percentage) -69.28% 1.530 0.470 - -2.08% -
416.gamess -68.90% 492.000 153.000 - 0.00% -
416.gamess (avg) -68.90% 492.000 153.000 - 0.00% -
436.cactusADM (max) (percentage) -66.67% 3.150 1.050 - -5.41% -
481.wrf -64.47% 318.000 113.000 - -0.88% -
481.wrf (avg) -64.47% 318.000 113.000 - -0.88% -
447.dealII -64.42% 104.000 37.000 - 0.00% -
447.dealII (avg) -64.42% 104.000 37.000 - 0.00% -
471.omnetpp -55.88% 170.000 75.000 - -2.60% -
471.omnetpp (avg) -55.88% 170.000 75.000 - -2.60% -
464.h264ref (max) -54.84% 62.000 28.000 - -6.67% -
456.hmmer -53.33% 75.000 35.000 - 0.00% -
456.hmmer (avg) -53.33% 75.000 35.000 - 0.00% -
459.GemsFDTD -47.14% 210.000 111.000 - -1.77% -
459.GemsFDTD (avg) -47.14% 210.000 111.000 - -1.77% -
433.milc (unexplained diff vs previous) (percentage) -46.65% 3.280 1.750 - 153.62% -
433.milc (max) (percentage) -45.74% 3.170 1.720 - 152.94% -
471.omnetpp (max) (percentage) -45.71% 6.170 3.350 - 12.42% -
410.bwaves -44.38% 160.000 89.000 - -1.11% -
410.bwaves (avg) -44.38% 160.000 89.000 - -1.11% -
416.gamess (avg) (percentage) -43.32% 2.170 1.230 - 0.00% -
435.gromacs (max) (percentage) -42.57% 2.020 1.160 - -3.33% -
435.gromacs -41.35% 266.000 156.000 - -3.70% -
435.gromacs (avg) -41.35% 266.000 156.000 - -3.70% -
444.namd (avg) (percentage) -39.69% 3.930 2.370 - 0.00% -
459.GemsFDTD (max) (percentage) -38.33% 0.600 0.370 - -5.13% -
454.calculix (max) (percentage) -34.47% 4.700 3.080 - -2.22% -
450.soplex (max) (percentage) -29.95% 1.970 1.380 - -6.12% -
470.lbm (avg) (percentage) -27.85% 2.370 1.710 - -0.58% -
453.povray (max) (percentage) -26.88% 2.530 1.850 - -3.14% -
400.perlbench (max) (percentage) -21.91% 3.240 2.530 - -4.17% -
447.dealII (max) (percentage) -16.36% 1.100 0.920 - -4.17% -
445.gobmk -16.30% 92.000 77.000 - -1.28% -
445.gobmk (avg) -16.30% 92.000 77.000 - -1.28% -
401.bzip2 -9.09% 66.000 60.000 - -1.64% -
401.bzip2 (avg) -9.09% 66.000 60.000 - -1.64% -
465.tonto (avg) (percentage) -8.38% 1.670 1.530 - 0.00% -
464.h264ref -3.85% 78.000 75.000 - -1.32% -
464.h264ref (avg) -3.85% 78.000 75.000 - -1.32% -

Report Time: 0.39s
Execution (seconds)
Name Current %
400.perlbench 1536.000 -3.21%
401.bzip2 2929.000 -1.21%
403.gcc 59.000 -1.67%
410.bwaves 5938.000 -1.80%
416.gamess 12520.000 -
429.mcf 1874.000 22.24%
433.milc 1141.000 -1.72%
434.zeusmp 2521.000 -
435.gromacs 6979.000 -3.92%
436.cactusADM 2136.000 1.14%
437.leslie3d 10904.000 -
444.namd 712.000 -1.79%
445.gobmk 5156.000 -1.45%
447.dealII 1989.000 -1.14%
450.soplex 547.000 -5.53%
453.povray 496.000 -
454.calculix 62.000 -1.59%
456.hmmer 2923.000 -
458.sjeng 7593.000 -1.81%
459.GemsFDTD 6053.000 -1.37%
462.libquantum 136.000 -2.16%
464.h264ref 5837.000 -1.12%
465.tonto 10737.000 -2.35%
470.lbm 3707.000 -1.17%
471.omnetpp 2828.000 -3.35%
473.astar 5709.000 -3.29%
481.wrf 5466.000 -1.12%
482.sphinx3 914.000 -2.04%
Geometric Mean 2072.459 -
Code Size (bytes)
Name Current %
400.perlbench 922012.000 -
401.bzip2 49782.000 -
403.gcc 2677445.000 -
410.bwaves 17732.000 -
416.gamess 6283071.000 -
429.mcf 11035.000 -
433.milc 96077.000 -
434.zeusmp 163813.000 -1.59%
435.gromacs 680013.000 -
436.cactusADM 551752.000 -1.12%
437.leslie3d 64896.000 -
444.namd 191010.000 -
445.gobmk 1401181.000 -
447.dealII 2151297.000 -
450.soplex 261849.000 -
453.povray 711758.000 -
454.calculix 1276447.000 -
456.hmmer 231052.000 -
458.sjeng 112057.000 -3.49%
459.GemsFDTD 251321.000 -
462.libquantum 31313.000 -
464.h264ref 426828.000 1.88%
465.tonto 2913377.000 -
470.lbm 10928.000 -
471.omnetpp 567942.000 -
473.astar 32220.000 -
481.wrf 2626020.000 -
482.sphinx3 152828.000 -
Geometric Mean 272887.412 -
Score
Name Current %
nb_compile_successful 28.000 -3.45%
nb_execution_successful 28.000 -3.45%
nb_total_tests 29.000 -
Geometric Mean 28.329 -2.31%
sample variability
Name Current %
400.perlbench 44.000 -2.22%
400.perlbench (avg) 44.000 -2.22%
400.perlbench (avg) (percentage) 2.890 -
400.perlbench (max) 38.000 -7.32%
400.perlbench (max) (percentage) 2.530 -4.17%
401.bzip2 60.000 -1.64%
401.bzip2 (avg) 60.000 -1.64%
401.bzip2 (avg) (percentage) 2.060 -
401.bzip2 (max) 35.000 -5.41%
401.bzip2 (max) (percentage) 1.220 -3.94%
403.gcc 3.000 -
403.gcc (avg) 3.000 -
403.gcc (avg) (percentage) 5.730 -
403.gcc (max) 3.000 -25.00%
403.gcc (max) (percentage) 6.700 -2.19%
410.bwaves 89.000 -1.11%
410.bwaves (avg) 89.000 -1.11%
410.bwaves (avg) (percentage) 1.500 -
410.bwaves (max) 106.000 221.21%
410.bwaves (max) (percentage) 1.800 227.27%
410.bwaves (unexplained diff vs previous) 109.000 445.00%
410.bwaves (unexplained diff vs previous) (percentage) 1.840 457.58%
416.gamess 153.000 -
416.gamess (avg) 153.000 -
416.gamess (avg) (percentage) 1.230 -
416.gamess (max) 22.000 -4.35%
416.gamess (max) (percentage) 0.180 -5.26%
429.mcf 110.000 29.41%
429.mcf (avg) 110.000 29.41%
429.mcf (avg) (percentage) 5.880 5.95%
429.mcf (max) 416.000 2500.00%
429.mcf (max) (percentage) 22.240 1940.37%
429.mcf (unexplained diff vs previous) 341.000 -
429.mcf (unexplained diff vs previous) (percentage) 18.200 -
433.milc 23.000 -4.17%
433.milc (avg) 23.000 -4.17%
433.milc (avg) (percentage) 2.100 -
433.milc (max) 19.000 171.43%
433.milc (max) (percentage) 1.720 152.94%
433.milc (unexplained diff vs previous) 20.000 150.00%
433.milc (unexplained diff vs previous) (percentage) 1.750 153.62%
434.zeusmp 48.000 -
434.zeusmp (avg) 48.000 -
434.zeusmp (avg) (percentage) 1.910 -
434.zeusmp (max) 14.000 -
434.zeusmp (max) (percentage) 0.560 -3.45%
435.gromacs 156.000 -3.70%
435.gromacs (avg) 156.000 -3.70%
435.gromacs (avg) (percentage) 2.240 -
435.gromacs (max) 80.000 -8.05%
435.gromacs (max) (percentage) 1.160 -3.33%
436.cactusADM 38.000 2.70%
436.cactusADM (avg) 38.000 2.70%
436.cactusADM (avg) (percentage) 1.780 -
436.cactusADM (max) 22.000 -4.35%
436.cactusADM (max) (percentage) 1.050 -5.41%
437.leslie3d 493.000 -
437.leslie3d (avg) 493.000 -
437.leslie3d (avg) (percentage) 4.530 -
437.leslie3d (max) 976.000 -3.94%
437.leslie3d (max) (percentage) 8.960 -3.34%
444.namd 16.000 -5.88%
444.namd (avg) 16.000 -5.88%
444.namd (avg) (percentage) 2.370 -
444.namd (max) 4.000 -20.00%
444.namd (max) (percentage) 0.690 -4.17%
445.gobmk 77.000 -1.28%
445.gobmk (avg) 77.000 -1.28%
445.gobmk (avg) (percentage) 1.500 -
445.gobmk (max) 24.000 -4.00%
445.gobmk (max) (percentage) 0.470 -2.08%
447.dealII 37.000 -
447.dealII (avg) 37.000 -
447.dealII (avg) (percentage) 1.880 -
447.dealII (max) 18.000 -5.26%
447.dealII (max) (percentage) 0.920 -4.17%
450.soplex 18.000 -10.00%
450.soplex (avg) 18.000 -10.00%
450.soplex (avg) (percentage) 3.460 -
450.soplex (max) 7.000 -12.50%
450.soplex (max) (percentage) 1.380 -6.12%
453.povray 12.000 -
453.povray (avg) 12.000 -
453.povray (avg) (percentage) 2.480 -
453.povray (max) 9.000 -
453.povray (max) (percentage) 1.850 -3.14%
454.calculix 2.000 -
454.calculix (avg) 2.000 -
454.calculix (avg) (percentage) 3.490 -
454.calculix (max) 1.000 -
454.calculix (max) (percentage) 3.080 -2.22%
456.hmmer 35.000 -
456.hmmer (avg) 35.000 -
456.hmmer (avg) (percentage) 1.200 -
456.hmmer (max) 9.000 -10.00%
456.hmmer (max) (percentage) 0.340 -5.56%
458.sjeng 77.000 -1.28%
458.sjeng (avg) 77.000 -1.28%
458.sjeng (avg) (percentage) 1.020 -
458.sjeng (max) 35.000 -5.41%
458.sjeng (max) (percentage) 0.470 -2.08%
459.GemsFDTD 111.000 -1.77%
459.GemsFDTD (avg) 111.000 -1.77%
459.GemsFDTD (avg) (percentage) 1.850 -
459.GemsFDTD (max) 22.000 -4.35%
459.GemsFDTD (max) (percentage) 0.370 -5.13%
462.libquantum 2.000 -
462.libquantum (avg) 2.000 -
462.libquantum (avg) (percentage) 2.070 -
462.libquantum (max) 1.000 -
462.libquantum (max) (percentage) 1.160 -4.13%
464.h264ref 75.000 -1.32%
464.h264ref (avg) 75.000 -1.32%
464.h264ref (avg) (percentage) 1.300 -
464.h264ref (max) 28.000 -6.67%
464.h264ref (max) (percentage) 0.490 -3.92%
465.tonto 164.000 -2.38%
465.tonto (avg) 164.000 -2.38%
465.tonto (avg) (percentage) 1.530 -
465.tonto (max) 55.000 -6.78%
465.tonto (max) (percentage) 0.520 -3.70%
470.lbm 63.000 -1.56%
470.lbm (avg) 63.000 -1.56%
470.lbm (avg) (percentage) 1.710 -
470.lbm (max) 43.000 126.32%
470.lbm (max) (percentage) 1.170 125.00%
470.lbm (unexplained diff vs previous) 44.000 -
470.lbm (unexplained diff vs previous) (percentage) 1.190 -
471.omnetpp 75.000 -2.60%
471.omnetpp (avg) 75.000 -2.60%
471.omnetpp (avg) (percentage) 2.670 -
471.omnetpp (max) 94.000 8.05%
471.omnetpp (max) (percentage) 3.350 12.42%
471.omnetpp (unexplained diff vs previous) 98.000 8.89%
471.omnetpp (unexplained diff vs previous) (percentage) 3.470 12.66%
473.astar 107.000 -1.83%
473.astar (avg) 107.000 -1.83%
473.astar (avg) (percentage) 1.890 1.61%
473.astar (max) 187.000 259.62%
473.astar (max) (percentage) 3.290 269.66%
473.astar (unexplained diff vs previous) 194.000 266.04%
473.astar (unexplained diff vs previous) (percentage) 3.400 277.78%
481.wrf 113.000 -
481.wrf (avg) 113.000 -
481.wrf (avg) (percentage) 2.070 -
481.wrf (max) 33.000 -5.71%
481.wrf (max) (percentage) 0.620 -3.13%
482.sphinx3 23.000 -
482.sphinx3 (avg) 23.000 -
482.sphinx3 (avg) (percentage) 2.570 -
482.sphinx3 (max) 24.000 -7.69%
482.sphinx3 (max) (percentage) 2.720 -4.56%
483.xalancbmk (avg) (percentage) 1.180 -
483.xalancbmk (max) (percentage) 5.910 -
Geometric Mean 10.756 17.00%