Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=3a98808c164b36c7023bd80fc6b019cbe6274365 (unchanged)
git_gcc https://github.com/gcc-mirror/gcc/commit/7450b25566b7a738edff6f554d97ba6e3dd95ac9 (+ 67 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=94628de77888c3292fc103840731ff85f283368e (unchanged)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=6f8a482afd392741964fb56590457f81e82b5a5a (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk_ci_gnu-build-tcwg_bmk_apm-gnu-master-aarch64-spec2k6-Os/343/
View Options
Report
Filter

gnu-aarch64-master-Os test results

Run Order Start Time Duration
Current 0343 (basepoints/gcc-13-04684-g7450b25566b) 2022-12-24T00:12:16 0:00:00
Previous 0341 (basepoints/gcc-13-04617-gdc582d2ef32) 2022-12-23T08:21:45 0:00:00
Baseline 0001 (3-changed-components) 2023-01-01T08:38:47 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 82 125
Performance Improvements 59 50
Added Tests 9 0
Unchanged Tests 1086 1061
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Code Size Δ Previous Current σ Δ (B) σ (B)
458.sjeng 7.38% 111961.000 120221.000 - 0.00% -

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
444.namd 7.83% 9057.000 9766.000 - 7.91% -
471.omnetpp 7.61% 9826.000 10574.000 - -1.54% -
433.milc 3.56% 12939.000 13400.000 - 3.27% -
436.cactusADM 3.29% 17560.000 18138.000 - 3.39% -
416.gamess 3.03% 22713.000 23401.000 - 3.07% -
435.gromacs 2.70% 15416.000 15832.000 - 2.68% -
434.zeusmp 2.18% 13241.000 13529.000 - 2.41% -
482.sphinx3 2.03% 28440.000 29017.000 - -3.04% -
450.soplex 1.88% 15458.000 15749.000 - 1.83% -
459.GemsFDTD 1.86% 22817.000 23241.000 - -0.49% -
456.hmmer 1.78% 10860.000 11053.000 - 0.06% -
400.perlbench 1.72% 10811.000 10997.000 - 3.26% -
447.dealII 1.69% 9735.000 9900.000 - 1.53% -
445.gobmk 1.30% 12016.000 12172.000 - 1.48% -
462.libquantum 1.29% 11428.000 11575.000 - -0.34% -
437.leslie3d 1.25% 15157.000 15347.000 - 2.28% -
410.bwaves 1.00% 14687.000 14834.000 - 0.54% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
429.mcf (unexplained diff vs previous) (percentage) 3800.00% 0.010 0.390 - -27.78% -
429.mcf (unexplained diff vs previous) 3200.00% 2.000 66.000 - -29.03% -
436.cactusADM (unexplained diff vs previous) 2308.33% 24.000 578.000 - 1.40% -
436.cactusADM (unexplained diff vs previous) (percentage) 2178.57% 0.140 3.190 - -1.85% -
429.mcf (max) 407.69% 13.000 66.000 - -28.26% -
429.mcf (max) (percentage) 387.50% 0.080 0.390 - -27.78% -
433.milc (unexplained diff vs previous) 339.05% 105.000 461.000 - 8.47% -
433.milc (unexplained diff vs previous) (percentage) 324.69% 0.810 3.440 - 4.88% -
410.bwaves (unexplained diff vs previous) 219.57% 46.000 147.000 - 880.00% -
410.bwaves (unexplained diff vs previous) (percentage) 219.35% 0.310 0.990 - 890.00% -
401.bzip2 (max) 91.78% 73.000 140.000 - 5.26% -
401.bzip2 (max) (percentage) 89.80% 0.490 0.930 - 5.68% -
433.milc (max) 82.76% 261.000 477.000 - 16.06% -
433.milc (max) (percentage) 76.24% 2.020 3.560 - 12.30% -
410.bwaves (max) 74.12% 85.000 148.000 - 393.33% -
410.bwaves (max) (percentage) 72.41% 0.580 1.000 - 376.19% -
436.cactusADM (max) 41.57% 421.000 596.000 - 7.97% -
436.cactusADM (max) (percentage) 37.08% 2.400 3.290 - 4.44% -
471.omnetpp 30.28% 142.000 185.000 - 8.82% -
471.omnetpp (avg) 30.28% 142.000 185.000 - 8.82% -
471.omnetpp (avg) (percentage) 20.69% 1.450 1.750 - 10.06% -
433.milc 9.13% 219.000 239.000 - 8.64% -
433.milc (avg) 9.13% 219.000 239.000 - 8.64% -
436.cactusADM 8.25% 291.000 315.000 - 8.25% -
436.cactusADM (avg) 8.25% 291.000 315.000 - 8.25% -
401.bzip2 8.20% 61.000 66.000 - 0.00% -
401.bzip2 (avg) 8.20% 61.000 66.000 - 0.00% -
444.namd 7.89% 380.000 410.000 - 15.49% -
444.namd (avg) 7.89% 380.000 410.000 - 15.49% -
401.bzip2 (avg) (percentage) 7.32% 0.410 0.440 - 0.00% -
433.milc (avg) (percentage) 5.29% 1.700 1.790 - 5.29% -
462.libquantum 4.94% 81.000 85.000 - 13.33% -
462.libquantum (avg) 4.94% 81.000 85.000 - 13.33% -
436.cactusADM (avg) (percentage) 4.82% 1.660 1.740 - 4.82% -
462.libquantum (avg) (percentage) 4.23% 0.710 0.740 - 13.85% -
482.sphinx3 3.99% 426.000 443.000 - 1.61% -
482.sphinx3 (avg) 3.99% 426.000 443.000 - 1.61% -
416.gamess 3.07% 522.000 538.000 - 9.35% -
416.gamess (avg) 3.07% 522.000 538.000 - 9.35% -
435.gromacs 2.71% 295.000 303.000 - 13.91% -
435.gromacs (avg) 2.71% 295.000 303.000 - 13.91% -
434.zeusmp 2.38% 210.000 215.000 - 10.26% -
434.zeusmp (avg) 2.38% 210.000 215.000 - 10.26% -
459.GemsFDTD 2.22% 225.000 230.000 - 9.52% -
459.GemsFDTD (avg) 2.22% 225.000 230.000 - 9.52% -
450.soplex 2.04% 196.000 200.000 - 4.71% -
450.soplex (avg) 2.04% 196.000 200.000 - 4.71% -
482.sphinx3 (avg) (percentage) 2.00% 1.500 1.530 - 4.79% -
458.sjeng 2.00% 50.000 51.000 - 8.51% -
458.sjeng (avg) 2.00% 50.000 51.000 - 8.51% -
447.dealII 1.82% 110.000 112.000 - 7.69% -
447.dealII (avg) 1.82% 110.000 112.000 - 7.69% -
403.gcc 1.79% 56.000 57.000 - 5.56% -
403.gcc (avg) 1.79% 56.000 57.000 - 5.56% -
456.hmmer 1.47% 68.000 69.000 - -8.00% -
456.hmmer (avg) 1.47% 68.000 69.000 - -8.00% -
437.leslie3d 1.38% 363.000 368.000 - 3.08% -
437.leslie3d (avg) 1.38% 363.000 368.000 - 3.08% -
400.perlbench 1.25% 160.000 162.000 - 3.85% -
400.perlbench (avg) 1.25% 160.000 162.000 - 3.85% -
483.xalancbmk 1.25% 80.000 81.000 - 9.46% -
483.xalancbmk (avg) 1.25% 80.000 81.000 - 9.46% -
445.gobmk 1.09% 92.000 93.000 - 1.09% -
445.gobmk (avg) 1.09% 92.000 93.000 - 1.09% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
470.lbm (unexplained diff vs previous) (percentage) -99.55% 6.640 0.030 - -72.73% -
470.lbm (unexplained diff vs previous) -99.50% 802.000 4.000 - -71.43% -
471.omnetpp (unexplained diff vs previous) (percentage) -30.75% 10.210 7.070 - 2845.83% -
471.omnetpp (unexplained diff vs previous) -25.42% 1003.000 748.000 - 2776.92% -
482.sphinx3 (max) (percentage) -18.47% 2.490 2.030 - 38.10% -
462.libquantum (unexplained diff vs previous) (percentage) -17.53% 1.540 1.270 - 12600.00% -
482.sphinx3 (max) -16.81% 708.000 589.000 - 34.17% -
470.lbm (max) -16.76% 752.000 626.000 - -4.13% -
470.lbm (max) (percentage) -16.69% 6.230 5.190 - 1.76% -
471.omnetpp (max) (percentage) -16.63% 9.260 7.720 - 25.12% -
462.libquantum (unexplained diff vs previous) -16.48% 176.000 147.000 - 14600.00% -
462.libquantum (max) (percentage) -15.13% 1.520 1.290 - 101.56% -
462.libquantum (max) -13.87% 173.000 149.000 - 101.35% -
434.zeusmp (max) (percentage) -11.04% 1.540 1.370 - -39.91% -
471.omnetpp (max) -10.23% 909.000 816.000 - 23.26% -
453.povray (max) -10.00% 100.000 90.000 - -45.45% -
453.povray (max) (percentage) -8.92% 1.570 1.430 - -43.48% -
434.zeusmp (max) -8.87% 203.000 185.000 - -38.54% -
481.wrf (max) (percentage) -8.60% 4.420 4.040 - 28.25% -
454.calculix (max) (percentage) -8.48% 4.600 4.210 - -10.43% -
465.tonto (max) (percentage) -8.33% 2.160 1.980 - -44.69% -
454.calculix (max) -7.68% 990.000 914.000 - -14.90% -
465.tonto (max) -7.60% 171.000 158.000 - -46.08% -
445.gobmk (max) (percentage) -7.52% 1.330 1.230 - -19.61% -
458.sjeng (max) (percentage) -7.50% 0.400 0.370 - 68.18% -
444.namd (max) (percentage) -7.50% 6.670 6.170 - -14.07% -
435.gromacs (max) (percentage) -7.44% 2.150 1.990 - -1.49% -
416.gamess (max) (percentage) -7.36% 2.580 2.390 - -17.30% -
458.sjeng (max) -7.14% 56.000 52.000 - 67.74% -
473.astar (max) -6.45% 31.000 29.000 - 45.00% -
445.gobmk (max) -6.29% 159.000 149.000 - -18.58% -
403.gcc (max) (percentage) -5.81% 0.860 0.810 - 12.50% -
483.xalancbmk (max) (percentage) -5.71% 0.350 0.330 - -19.51% -
403.gcc (max) -5.19% 77.000 73.000 - 14.06% -
483.xalancbmk (max) -5.13% 39.000 37.000 - -17.78% -
470.lbm (avg) (percentage) -5.12% 2.540 2.410 - 1.69% -
470.lbm -4.90% 306.000 291.000 - -3.96% -
470.lbm (avg) -4.90% 306.000 291.000 - -3.96% -
435.gromacs (max) -4.83% 331.000 315.000 - 1.29% -
437.leslie3d (max) (percentage) -4.75% 4.000 3.810 - 62.82% -
416.gamess (max) -4.44% 585.000 559.000 - -14.79% -
400.perlbench (max) (percentage) -4.02% 1.740 1.670 - -48.46% -
450.soplex (max) (percentage) -3.70% 1.350 1.300 - -34.01% -
437.leslie3d (max) -3.63% 606.000 584.000 - 66.38% -
464.h264ref (max) -2.86% 105.000 102.000 - 64.52% -
464.h264ref (max) (percentage) -2.74% 0.730 0.710 - 65.12% -
400.perlbench (max) -2.66% 188.000 183.000 - -46.96% -
459.GemsFDTD (max) (percentage) -2.30% 0.870 0.850 - 41.67% -
456.hmmer (max) (percentage) -2.08% 0.480 0.470 - -62.99% -
429.mcf -2.02% 99.000 97.000 - 7.78% -
429.mcf (avg) -2.02% 99.000 97.000 - 7.78% -
450.soplex (max) -1.92% 208.000 204.000 - -32.89% -
456.hmmer (max) -1.92% 52.000 51.000 - -63.57% -
429.mcf (avg) (percentage) -1.72% 0.580 0.570 - 7.55% -
447.dealII (max) (percentage) -1.35% 1.480 1.460 - 32.73% -
453.povray -1.20% 83.000 82.000 - 1.23% -
453.povray (avg) -1.20% 83.000 82.000 - 1.23% -

Performance Improvements - Score Δ Previous Current σ Δ (B) σ (B)
nb_compile_successful 3.57% 28.000 29.000 - 0.00% -
nb_execution_successful 3.57% 28.000 29.000 - 0.00% -

Added Tests - Code Size
481.wrf

Added Tests - Execution
481.wrf

Added Tests - sample variability
401.bzip2 (unexplained diff vs previous)
401.bzip2 (unexplained diff vs previous) (percentage)
481.wrf
481.wrf (avg)
481.wrf (max)
482.sphinx3 (unexplained diff vs previous)
482.sphinx3 (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
444.namd 7.91% 9050.000 9766.000 - 7.83% -
436.cactusADM 3.39% 17544.000 18138.000 - 3.29% -
433.milc 3.27% 12976.000 13400.000 - 3.56% -
400.perlbench 3.26% 10650.000 10997.000 - 1.72% -
416.gamess 3.07% 22704.000 23401.000 - 3.03% -
435.gromacs 2.68% 15419.000 15832.000 - 2.70% -
434.zeusmp 2.41% 13211.000 13529.000 - 2.18% -
437.leslie3d 2.28% 15005.000 15347.000 - 1.25% -
450.soplex 1.83% 15466.000 15749.000 - 1.88% -
447.dealII 1.53% 9751.000 9900.000 - 1.69% -
445.gobmk 1.48% 11995.000 12172.000 - 1.30% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
462.libquantum (unexplained diff vs previous) 14600.00% 1.000 147.000 - -16.48% -
462.libquantum (unexplained diff vs previous) (percentage) 12600.00% 0.010 1.270 - -17.53% -
471.omnetpp (unexplained diff vs previous) (percentage) 2845.83% 0.240 7.070 - -30.75% -
471.omnetpp (unexplained diff vs previous) 2776.92% 26.000 748.000 - -25.42% -
410.bwaves (unexplained diff vs previous) (percentage) 890.00% 0.100 0.990 - 219.35% -
410.bwaves (unexplained diff vs previous) 880.00% 15.000 147.000 - 219.57% -
410.bwaves (max) 393.33% 30.000 148.000 - 74.12% -
410.bwaves (max) (percentage) 376.19% 0.210 1.000 - 72.41% -
482.sphinx3 (unexplained diff vs previous) (percentage) 220.97% 0.620 1.990 - 0.00% -
482.sphinx3 (unexplained diff vs previous) 210.22% 186.000 577.000 - 0.00% -
462.libquantum (max) (percentage) 101.56% 0.640 1.290 - -15.13% -
462.libquantum (max) 101.35% 74.000 149.000 - -13.87% -
458.sjeng (max) (percentage) 68.18% 0.220 0.370 - -7.50% -
458.sjeng (max) 67.74% 31.000 52.000 - -7.14% -
437.leslie3d (max) 66.38% 351.000 584.000 - -3.63% -
464.h264ref (max) (percentage) 65.12% 0.430 0.710 - -2.74% -
464.h264ref (max) 64.52% 62.000 102.000 - -2.86% -
437.leslie3d (max) (percentage) 62.82% 2.340 3.810 - -4.75% -
473.astar (max) 45.00% 20.000 29.000 - -6.45% -
473.astar (max) (percentage) 42.86% 0.140 0.200 - -4.76% -
459.GemsFDTD (max) (percentage) 41.67% 0.600 0.850 - -2.30% -
459.GemsFDTD (max) 40.71% 140.000 197.000 - -0.51% -
482.sphinx3 (max) (percentage) 38.10% 1.470 2.030 - -18.47% -
447.dealII (max) 34.58% 107.000 144.000 - 0.00% -
482.sphinx3 (max) 34.17% 439.000 589.000 - -16.81% -
447.dealII (max) (percentage) 32.73% 1.100 1.460 - -1.35% -
481.wrf (max) (percentage) 28.25% 3.150 4.040 - -8.60% -
471.omnetpp (max) (percentage) 25.12% 6.170 7.720 - -16.63% -
471.omnetpp (max) 23.26% 662.000 816.000 - -10.23% -
481.wrf (max) 21.89% 530.000 646.000 - 0.00% -
433.milc (max) 16.06% 411.000 477.000 - 82.76% -
444.namd 15.49% 355.000 410.000 - 7.89% -
444.namd (avg) 15.49% 355.000 410.000 - 7.89% -
403.gcc (max) 14.06% 64.000 73.000 - -5.19% -
435.gromacs 13.91% 266.000 303.000 - 2.71% -
435.gromacs (avg) 13.91% 266.000 303.000 - 2.71% -
462.libquantum (avg) (percentage) 13.85% 0.650 0.740 - 4.23% -
410.bwaves 13.75% 160.000 182.000 - 0.00% -
410.bwaves (avg) 13.75% 160.000 182.000 - 0.00% -
462.libquantum 13.33% 75.000 85.000 - 4.94% -
462.libquantum (avg) 13.33% 75.000 85.000 - 4.94% -
410.bwaves (avg) (percentage) 12.84% 1.090 1.230 - -0.81% -
403.gcc (max) (percentage) 12.50% 0.720 0.810 - -5.81% -
433.milc (max) (percentage) 12.30% 3.170 3.560 - 76.24% -
435.gromacs (avg) (percentage) 10.98% 1.730 1.920 - 0.00% -
473.astar 10.71% 28.000 31.000 - 0.00% -
473.astar (avg) 10.71% 28.000 31.000 - 0.00% -
473.astar (avg) (percentage) 10.53% 0.190 0.210 - 0.00% -
434.zeusmp 10.26% 195.000 215.000 - 2.38% -
434.zeusmp (avg) 10.26% 195.000 215.000 - 2.38% -
471.omnetpp (avg) (percentage) 10.06% 1.590 1.750 - 20.69% -
459.GemsFDTD (avg) (percentage) 10.00% 0.900 0.990 - 0.00% -
459.GemsFDTD 9.52% 210.000 230.000 - 2.22% -
459.GemsFDTD (avg) 9.52% 210.000 230.000 - 2.22% -
483.xalancbmk 9.46% 74.000 81.000 - 1.25% -
483.xalancbmk (avg) 9.46% 74.000 81.000 - 1.25% -
416.gamess 9.35% 492.000 538.000 - 3.07% -
416.gamess (avg) 9.35% 492.000 538.000 - 3.07% -
464.h264ref (avg) (percentage) 9.26% 0.540 0.590 - 0.00% -
458.sjeng (avg) (percentage) 9.09% 0.330 0.360 - 0.00% -
464.h264ref 8.97% 78.000 85.000 - 0.00% -
464.h264ref (avg) 8.97% 78.000 85.000 - 0.00% -
471.omnetpp 8.82% 170.000 185.000 - 30.28% -
471.omnetpp (avg) 8.82% 170.000 185.000 - 30.28% -
433.milc 8.64% 220.000 239.000 - 9.13% -
433.milc (avg) 8.64% 220.000 239.000 - 9.13% -
458.sjeng 8.51% 47.000 51.000 - 2.00% -
458.sjeng (avg) 8.51% 47.000 51.000 - 2.00% -
433.milc (unexplained diff vs previous) 8.47% 425.000 461.000 - 339.05% -
436.cactusADM 8.25% 291.000 315.000 - 8.25% -
436.cactusADM (avg) 8.25% 291.000 315.000 - 8.25% -
436.cactusADM (max) 7.97% 552.000 596.000 - 41.57% -
429.mcf 7.78% 90.000 97.000 - -2.02% -
429.mcf (avg) 7.78% 90.000 97.000 - -2.02% -
447.dealII 7.69% 104.000 112.000 - 1.82% -
447.dealII (avg) 7.69% 104.000 112.000 - 1.82% -
429.mcf (avg) (percentage) 7.55% 0.530 0.570 - -1.72% -
483.xalancbmk (avg) (percentage) 7.46% 0.670 0.720 - 0.00% -
434.zeusmp (avg) (percentage) 7.43% 1.480 1.590 - 0.00% -
401.bzip2 (unexplained diff vs previous) (percentage) 6.90% 0.870 0.930 - 0.00% -
444.namd (avg) (percentage) 6.87% 3.930 4.200 - 0.00% -
447.dealII (avg) (percentage) 6.54% 1.070 1.140 - 0.00% -
401.bzip2 (unexplained diff vs previous) 6.06% 132.000 140.000 - 0.00% -
416.gamess (avg) (percentage) 5.99% 2.170 2.300 - 0.00% -
401.bzip2 (max) (percentage) 5.68% 0.880 0.930 - 89.80% -
403.gcc 5.56% 54.000 57.000 - 1.79% -
403.gcc (avg) 5.56% 54.000 57.000 - 1.79% -
433.milc (avg) (percentage) 5.29% 1.700 1.790 - 5.29% -
401.bzip2 (max) 5.26% 133.000 140.000 - 91.78% -
433.milc (unexplained diff vs previous) (percentage) 4.88% 3.280 3.440 - 324.69% -
436.cactusADM (avg) (percentage) 4.82% 1.660 1.740 - 4.82% -
482.sphinx3 (avg) (percentage) 4.79% 1.460 1.530 - 2.00% -
450.soplex 4.71% 191.000 200.000 - 2.04% -
450.soplex (avg) 4.71% 191.000 200.000 - 2.04% -
436.cactusADM (max) (percentage) 4.44% 3.150 3.290 - 37.08% -
453.povray (avg) (percentage) 4.00% 1.250 1.300 - 0.00% -
400.perlbench 3.85% 156.000 162.000 - 1.25% -
400.perlbench (avg) 3.85% 156.000 162.000 - 1.25% -
403.gcc (avg) (percentage) 3.28% 0.610 0.630 - 0.00% -
437.leslie3d 3.08% 357.000 368.000 - 1.38% -
437.leslie3d (avg) 3.08% 357.000 368.000 - 1.38% -
450.soplex (avg) (percentage) 2.42% 1.240 1.270 - 0.00% -
481.wrf (avg) (percentage) 2.12% 1.890 1.930 - 0.00% -
454.calculix (avg) (percentage) 1.99% 2.010 2.050 - 0.00% -
470.lbm (max) (percentage) 1.76% 5.100 5.190 - -16.69% -
470.lbm (avg) (percentage) 1.69% 2.370 2.410 - -5.12% -
482.sphinx3 1.61% 436.000 443.000 - 3.99% -
482.sphinx3 (avg) 1.61% 436.000 443.000 - 3.99% -
436.cactusADM (unexplained diff vs previous) 1.40% 570.000 578.000 - 2308.33% -
435.gromacs (max) 1.29% 311.000 315.000 - -4.83% -
453.povray 1.23% 81.000 82.000 - -1.20% -
453.povray (avg) 1.23% 81.000 82.000 - -1.20% -
445.gobmk 1.09% 92.000 93.000 - 1.09% -
445.gobmk (avg) 1.09% 92.000 93.000 - 1.09% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
470.lbm -5.78% 12819.000 12078.000 - 0.03% -
481.wrf -4.95% 16834.000 16000.000 - 0.00% -
454.calculix -4.94% 22860.000 21731.000 - 0.97% -
453.povray -3.13% 6544.000 6339.000 - -0.81% -
482.sphinx3 -3.04% 29928.000 29017.000 - 2.03% -
465.tonto -2.25% 8205.000 8020.000 - 0.88% -
471.omnetpp -1.54% 10739.000 10574.000 - 7.61% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
470.lbm (unexplained diff vs previous) (percentage) -72.73% 0.110 0.030 - -99.55% -
470.lbm (unexplained diff vs previous) -71.43% 14.000 4.000 - -99.50% -
456.hmmer (max) -63.57% 140.000 51.000 - -1.92% -
456.hmmer (max) (percentage) -62.99% 1.270 0.470 - -2.08% -
400.perlbench (max) (percentage) -48.46% 3.240 1.670 - -4.02% -
400.perlbench (max) -46.96% 345.000 183.000 - -2.66% -
465.tonto (max) -46.08% 293.000 158.000 - -7.60% -
453.povray (max) -45.45% 165.000 90.000 - -10.00% -
465.tonto (max) (percentage) -44.69% 3.580 1.980 - -8.33% -
453.povray (max) (percentage) -43.48% 2.530 1.430 - -8.92% -
434.zeusmp (max) (percentage) -39.91% 2.280 1.370 - -11.04% -
434.zeusmp (max) -38.54% 301.000 185.000 - -8.87% -
450.soplex (max) (percentage) -34.01% 1.970 1.300 - -3.70% -
450.soplex (max) -32.89% 304.000 204.000 - -1.92% -
429.mcf (unexplained diff vs previous) -29.03% 93.000 66.000 - 3200.00% -
429.mcf (max) -28.26% 92.000 66.000 - 407.69% -
429.mcf (max) (percentage) -27.78% 0.540 0.390 - 387.50% -
429.mcf (unexplained diff vs previous) (percentage) -27.78% 0.540 0.390 - 3800.00% -
445.gobmk (max) (percentage) -19.61% 1.530 1.230 - -7.52% -
483.xalancbmk (max) (percentage) -19.51% 0.410 0.330 - -5.71% -
445.gobmk (max) -18.58% 183.000 149.000 - -6.29% -
483.xalancbmk (max) -17.78% 45.000 37.000 - -5.13% -
416.gamess (max) (percentage) -17.30% 2.890 2.390 - -7.36% -
454.calculix (max) -14.90% 1074.000 914.000 - -7.68% -
416.gamess (max) -14.79% 656.000 559.000 - -4.44% -
444.namd (max) (percentage) -14.07% 7.180 6.170 - -7.50% -
454.calculix (max) (percentage) -10.43% 4.700 4.210 - -8.48% -
465.tonto -8.76% 137.000 125.000 - 0.81% -
465.tonto (avg) -8.76% 137.000 125.000 - 0.81% -
456.hmmer -8.00% 75.000 69.000 - 1.47% -
456.hmmer (avg) -8.00% 75.000 69.000 - 1.47% -
456.hmmer (avg) (percentage) -7.35% 0.680 0.630 - 0.00% -
444.namd (max) -7.24% 649.000 602.000 - -0.33% -
465.tonto (avg) (percentage) -6.59% 1.670 1.560 - 0.00% -
470.lbm (max) -4.13% 653.000 626.000 - -16.76% -
470.lbm -3.96% 303.000 291.000 - -4.90% -
470.lbm (avg) -3.96% 303.000 291.000 - -4.90% -
481.wrf -3.14% 318.000 308.000 - 0.00% -
481.wrf (avg) -3.14% 318.000 308.000 - 0.00% -
454.calculix -3.05% 459.000 445.000 - 0.91% -
454.calculix (avg) -3.05% 459.000 445.000 - 0.91% -
436.cactusADM (unexplained diff vs previous) (percentage) -1.85% 3.250 3.190 - 2178.57% -
435.gromacs (max) (percentage) -1.49% 2.020 1.990 - -7.44% -

Report Time: 0.38s
Execution (seconds)
Name Current %
400.perlbench 10997.000 1.72%
401.bzip2 15124.000 -
403.gcc 9062.000 -
410.bwaves 14834.000 1.00%
416.gamess 23401.000 3.03%
429.mcf 17047.000 -
433.milc 13400.000 3.56%
434.zeusmp 13529.000 2.18%
435.gromacs 15832.000 2.70%
436.cactusADM 18138.000 3.29%
437.leslie3d 15347.000 1.25%
444.namd 9766.000 7.83%
445.gobmk 12172.000 1.30%
447.dealII 9900.000 1.69%
450.soplex 15749.000 1.88%
453.povray 6339.000 -
454.calculix 21731.000 -
456.hmmer 11053.000 1.78%
458.sjeng 14279.000 -
459.GemsFDTD 23241.000 1.86%
462.libquantum 11575.000 1.29%
464.h264ref 14472.000 -
465.tonto 8020.000 -
470.lbm 12078.000 -
471.omnetpp 10574.000 7.61%
473.astar 14956.000 -
481.wrf 16000.000 -
482.sphinx3 29017.000 2.03%
483.xalancbmk 11264.000 -
Geometric Mean 13686.048 2.33%
Code Size (bytes)
Name Current %
400.perlbench 930652.000 -
401.bzip2 49904.000 -
403.gcc 2679123.000 -
410.bwaves 17880.000 -
416.gamess 6246871.000 -
429.mcf 10951.000 -
433.milc 95873.000 -
434.zeusmp 165699.000 -
435.gromacs 679165.000 -
436.cactusADM 554386.000 -
437.leslie3d 65177.000 -
444.namd 191059.000 -
445.gobmk 1399655.000 -
447.dealII 2111137.000 -
450.soplex 260679.000 -
453.povray 709140.000 -
454.calculix 1273298.000 -
456.hmmer 231209.000 -
458.sjeng 120221.000 7.38%
459.GemsFDTD 254400.000 -
462.libquantum 31307.000 -
464.h264ref 424256.000 -
465.tonto 2874148.000 -
470.lbm 10908.000 -
471.omnetpp 566594.000 -
473.astar 32064.000 -
481.wrf 2643457.000 -
482.sphinx3 152775.000 -
483.xalancbmk 3278590.000 -
Geometric Mean 297875.234 8.36%
Score
Name Current %
nb_compile_successful 29.000 3.57%
nb_execution_successful 29.000 3.57%
nb_total_tests 29.000 -
Geometric Mean 29.000 2.37%
sample variability
Name Current %
400.perlbench 162.000 1.25%
400.perlbench (avg) 162.000 1.25%
400.perlbench (avg) (percentage) 1.480 -
400.perlbench (max) 183.000 -2.66%
400.perlbench (max) (percentage) 1.670 -4.02%
401.bzip2 66.000 8.20%
401.bzip2 (avg) 66.000 8.20%
401.bzip2 (avg) (percentage) 0.440 7.32%
401.bzip2 (max) 140.000 91.78%
401.bzip2 (max) (percentage) 0.930 89.80%
401.bzip2 (unexplained diff vs previous) 140.000 -
401.bzip2 (unexplained diff vs previous) (percentage) 0.930 -
403.gcc 57.000 1.79%
403.gcc (avg) 57.000 1.79%
403.gcc (avg) (percentage) 0.630 -
403.gcc (max) 73.000 -5.19%
403.gcc (max) (percentage) 0.810 -5.81%
410.bwaves 182.000 -
410.bwaves (avg) 182.000 -
410.bwaves (avg) (percentage) 1.230 -
410.bwaves (max) 148.000 74.12%
410.bwaves (max) (percentage) 1.000 72.41%
410.bwaves (unexplained diff vs previous) 147.000 219.57%
410.bwaves (unexplained diff vs previous) (percentage) 0.990 219.35%
416.gamess 538.000 3.07%
416.gamess (avg) 538.000 3.07%
416.gamess (avg) (percentage) 2.300 -
416.gamess (max) 559.000 -4.44%
416.gamess (max) (percentage) 2.390 -7.36%
429.mcf 97.000 -2.02%
429.mcf (avg) 97.000 -2.02%
429.mcf (avg) (percentage) 0.570 -1.72%
429.mcf (max) 66.000 407.69%
429.mcf (max) (percentage) 0.390 387.50%
429.mcf (unexplained diff vs previous) 66.000 3200.00%
429.mcf (unexplained diff vs previous) (percentage) 0.390 3800.00%
433.milc 239.000 9.13%
433.milc (avg) 239.000 9.13%
433.milc (avg) (percentage) 1.790 5.29%
433.milc (max) 477.000 82.76%
433.milc (max) (percentage) 3.560 76.24%
433.milc (unexplained diff vs previous) 461.000 339.05%
433.milc (unexplained diff vs previous) (percentage) 3.440 324.69%
434.zeusmp 215.000 2.38%
434.zeusmp (avg) 215.000 2.38%
434.zeusmp (avg) (percentage) 1.590 -
434.zeusmp (max) 185.000 -8.87%
434.zeusmp (max) (percentage) 1.370 -11.04%
435.gromacs 303.000 2.71%
435.gromacs (avg) 303.000 2.71%
435.gromacs (avg) (percentage) 1.920 -
435.gromacs (max) 315.000 -4.83%
435.gromacs (max) (percentage) 1.990 -7.44%
436.cactusADM 315.000 8.25%
436.cactusADM (avg) 315.000 8.25%
436.cactusADM (avg) (percentage) 1.740 4.82%
436.cactusADM (max) 596.000 41.57%
436.cactusADM (max) (percentage) 3.290 37.08%
436.cactusADM (unexplained diff vs previous) 578.000 2308.33%
436.cactusADM (unexplained diff vs previous) (percentage) 3.190 2178.57%
437.leslie3d 368.000 1.38%
437.leslie3d (avg) 368.000 1.38%
437.leslie3d (avg) (percentage) 2.400 -
437.leslie3d (max) 584.000 -3.63%
437.leslie3d (max) (percentage) 3.810 -4.75%
444.namd 410.000 7.89%
444.namd (avg) 410.000 7.89%
444.namd (avg) (percentage) 4.200 -
444.namd (max) 602.000 -
444.namd (max) (percentage) 6.170 -7.50%
445.gobmk 93.000 1.09%
445.gobmk (avg) 93.000 1.09%
445.gobmk (avg) (percentage) 0.770 -
445.gobmk (max) 149.000 -6.29%
445.gobmk (max) (percentage) 1.230 -7.52%
447.dealII 112.000 1.82%
447.dealII (avg) 112.000 1.82%
447.dealII (avg) (percentage) 1.140 -
447.dealII (max) 144.000 -
447.dealII (max) (percentage) 1.460 -1.35%
450.soplex 200.000 2.04%
450.soplex (avg) 200.000 2.04%
450.soplex (avg) (percentage) 1.270 -
450.soplex (max) 204.000 -1.92%
450.soplex (max) (percentage) 1.300 -3.70%
453.povray 82.000 -1.20%
453.povray (avg) 82.000 -1.20%
453.povray (avg) (percentage) 1.300 -
453.povray (max) 90.000 -10.00%
453.povray (max) (percentage) 1.430 -8.92%
454.calculix 445.000 -
454.calculix (avg) 445.000 -
454.calculix (avg) (percentage) 2.050 -
454.calculix (max) 914.000 -7.68%
454.calculix (max) (percentage) 4.210 -8.48%
456.hmmer 69.000 1.47%
456.hmmer (avg) 69.000 1.47%
456.hmmer (avg) (percentage) 0.630 -
456.hmmer (max) 51.000 -1.92%
456.hmmer (max) (percentage) 0.470 -2.08%
458.sjeng 51.000 2.00%
458.sjeng (avg) 51.000 2.00%
458.sjeng (avg) (percentage) 0.360 -
458.sjeng (max) 52.000 -7.14%
458.sjeng (max) (percentage) 0.370 -7.50%
459.GemsFDTD 230.000 2.22%
459.GemsFDTD (avg) 230.000 2.22%
459.GemsFDTD (avg) (percentage) 0.990 -
459.GemsFDTD (max) 197.000 -
459.GemsFDTD (max) (percentage) 0.850 -2.30%
462.libquantum 85.000 4.94%
462.libquantum (avg) 85.000 4.94%
462.libquantum (avg) (percentage) 0.740 4.23%
462.libquantum (max) 149.000 -13.87%
462.libquantum (max) (percentage) 1.290 -15.13%
462.libquantum (unexplained diff vs previous) 147.000 -16.48%
462.libquantum (unexplained diff vs previous) (percentage) 1.270 -17.53%
464.h264ref 85.000 -
464.h264ref (avg) 85.000 -
464.h264ref (avg) (percentage) 0.590 -
464.h264ref (max) 102.000 -2.86%
464.h264ref (max) (percentage) 0.710 -2.74%
465.tonto 125.000 -
465.tonto (avg) 125.000 -
465.tonto (avg) (percentage) 1.560 -
465.tonto (max) 158.000 -7.60%
465.tonto (max) (percentage) 1.980 -8.33%
470.lbm 291.000 -4.90%
470.lbm (avg) 291.000 -4.90%
470.lbm (avg) (percentage) 2.410 -5.12%
470.lbm (max) 626.000 -16.76%
470.lbm (max) (percentage) 5.190 -16.69%
470.lbm (unexplained diff vs previous) 4.000 -99.50%
470.lbm (unexplained diff vs previous) (percentage) 0.030 -99.55%
471.omnetpp 185.000 30.28%
471.omnetpp (avg) 185.000 30.28%
471.omnetpp (avg) (percentage) 1.750 20.69%
471.omnetpp (max) 816.000 -10.23%
471.omnetpp (max) (percentage) 7.720 -16.63%
471.omnetpp (unexplained diff vs previous) 748.000 -25.42%
471.omnetpp (unexplained diff vs previous) (percentage) 7.070 -30.75%
473.astar 31.000 -
473.astar (avg) 31.000 -
473.astar (avg) (percentage) 0.210 -
473.astar (max) 29.000 -6.45%
473.astar (max) (percentage) 0.200 -
481.wrf 308.000 -
481.wrf (avg) 308.000 -
481.wrf (avg) (percentage) 1.930 -
481.wrf (max) 646.000 -
481.wrf (max) (percentage) 4.040 -8.60%
482.sphinx3 443.000 3.99%
482.sphinx3 (avg) 443.000 3.99%
482.sphinx3 (avg) (percentage) 1.530 2.00%
482.sphinx3 (max) 589.000 -16.81%
482.sphinx3 (max) (percentage) 2.030 -18.47%
482.sphinx3 (unexplained diff vs previous) 577.000 -
482.sphinx3 (unexplained diff vs previous) (percentage) 1.990 -
483.xalancbmk 81.000 1.25%
483.xalancbmk (avg) 81.000 1.25%
483.xalancbmk (avg) (percentage) 0.720 -
483.xalancbmk (max) 37.000 -5.13%
483.xalancbmk (max) (percentage) 0.330 -5.71%
Geometric Mean 22.663 14.37%