Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=ec6f962151998434f9cc743386f2a49a1ce1a0f6 (unchanged)
git_gcc https://github.com/gcc-mirror/gcc/commit/55e94561e97ed0bce4774aa1c6b5d5d82209a379 (+ 1 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=dc1a77269c971652a8a5167ec366792eae052e65 (unchanged)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=378e271eb0f3f02d1e81bd813ec97c106238613e (unchanged)
regression GNU-1055
test_url https://ci.linaro.org/job/tcwg_bmk-code_vect-spec2k6--gnu-aarch64-master-O3_LTO-build/190/
View Options
Report
Filter

gnu-aarch64-master-O3_LTO test results

Run Order Start Time Duration
Current 0190 (basepoints/gcc-14-06033-g55e94561e97) 2024-03-15T00:18:14 0:00:00
Previous 0188 (3-changed-components) 2024-03-06T00:35:56 0:00:00
Baseline 0001 (4-changed-components) 2023-03-08T03:13:34 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 42 29
Performance Improvements 113 7
Added Tests 6 141
Unchanged Tests 1039 1023
Total Tests 1200

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
450.soplex 2.42% 538.000 551.000 - 11.76% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
456.hmmer (unexplained diff vs previous) 400.00% 1.000 5.000 - 0.00% -
456.hmmer (unexplained diff vs previous) (percentage) 400.00% 0.050 0.250 - 0.00% -
429.mcf (unexplained diff vs previous) (percentage) 236.36% 0.440 1.480 - 0.00% -
429.mcf (unexplained diff vs previous) 233.33% 6.000 20.000 - 0.00% -
459.GemsFDTD (unexplained diff vs previous) (percentage) 203.70% 0.270 0.820 - 0.00% -
459.GemsFDTD (unexplained diff vs previous) 200.00% 12.000 36.000 - 0.00% -
470.lbm (max) 185.71% 7.000 20.000 - 0.00% -
401.bzip2 (unexplained diff vs previous) (percentage) 182.41% 1.080 3.050 - 0.00% -
401.bzip2 (unexplained diff vs previous) 173.33% 30.000 82.000 - 0.00% -
470.lbm (max) (percentage) 165.22% 0.230 0.610 - 0.00% -
470.lbm (unexplained diff vs previous) (percentage) 165.22% 0.230 0.610 - 0.00% -
470.lbm (unexplained diff vs previous) 162.50% 8.000 21.000 - 0.00% -
473.astar (unexplained diff vs previous) (percentage) 140.00% 0.300 0.720 - 0.00% -
473.astar (unexplained diff vs previous) 135.71% 14.000 33.000 - 0.00% -
401.bzip2 (max) (percentage) 86.16% 1.590 2.960 - 0.00% -
401.bzip2 (max) 83.72% 43.000 79.000 - 0.00% -
450.soplex (max) 62.50% 8.000 13.000 - 0.00% -
437.leslie3d (unexplained diff vs previous) (percentage) 59.65% 5.130 8.190 - 0.00% -
433.milc (max) (percentage) 49.38% 0.810 1.210 - 0.00% -
437.leslie3d (unexplained diff vs previous) 47.59% 374.000 552.000 - 0.00% -
450.soplex (max) (percentage) 46.67% 1.650 2.420 - 0.00% -
450.soplex (unexplained diff vs previous) 44.44% 9.000 13.000 - 0.00% -
450.soplex (unexplained diff vs previous) (percentage) 41.32% 1.670 2.360 - 0.00% -
437.leslie3d (max) (percentage) 39.93% 5.410 7.570 - 0.00% -
433.milc (max) 37.50% 8.000 11.000 - 0.00% -
403.gcc (unexplained diff vs previous) (percentage) 32.95% 10.530 14.000 - 0.00% -
437.leslie3d (max) 29.44% 394.000 510.000 - 0.00% -
403.gcc (unexplained diff vs previous) 16.67% 6.000 7.000 - 0.00% -
403.gcc (avg) (percentage) 13.16% 4.180 4.730 - 0.00% -
465.tonto (unexplained diff vs previous) (percentage) 10.67% 0.750 0.830 - 0.00% -
465.tonto (unexplained diff vs previous) 9.23% 65.000 71.000 - 0.00% -
401.bzip2 (avg) (percentage) 6.02% 1.330 1.410 - 0.00% -
434.zeusmp (unexplained diff vs previous) (percentage) 4.78% 2.090 2.190 - 0.00% -
434.zeusmp (avg) (percentage) 4.63% 1.080 1.130 - 0.00% -
403.gcc (max) (percentage) 4.42% 11.760 12.280 - 0.00% -
401.bzip2 2.78% 36.000 37.000 - 0.00% -
401.bzip2 (avg) 2.78% 36.000 37.000 - 0.00% -
434.zeusmp (unexplained diff vs previous) 2.70% 37.000 38.000 - 0.00% -
437.leslie3d (avg) (percentage) 2.48% 4.840 4.960 - 0.00% -

Performance Regressions - Score Δ Previous Current σ Δ (B) σ (B)
nb_compile_successful -3.85% 26.000 25.000 - -13.79% -
nb_execution_successful -3.85% 26.000 25.000 - -13.79% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
403.gcc -12.28% 57.000 50.000 - 4.17% -
437.leslie3d -7.57% 7293.000 6741.000 - 0.16% -
401.bzip2 -2.96% 2767.000 2685.000 - 2.79% -
434.zeusmp -2.14% 1774.000 1736.000 - 1.58% -
429.mcf -1.46% 1370.000 1350.000 - -24.58% -
433.milc -1.21% 991.000 979.000 - 5.04% -
482.sphinx3 -1.02% 788.000 780.000 - 1.17% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
435.gromacs (unexplained diff vs previous) -91.30% 115.000 10.000 - 0.00% -
435.gromacs (unexplained diff vs previous) (percentage) -91.11% 2.250 0.200 - 0.00% -
458.sjeng (max) -89.47% 19.000 2.000 - 0.00% -
458.sjeng (max) (percentage) -87.50% 0.320 0.040 - 0.00% -
400.perlbench (unexplained diff vs previous) (percentage) -70.93% 1.720 0.500 - 0.00% -
400.perlbench (unexplained diff vs previous) -70.83% 24.000 7.000 - 0.00% -
471.omnetpp (unexplained diff vs previous) (percentage) -67.02% 1.880 0.620 - 0.00% -
453.povray (unexplained diff vs previous) -66.67% 9.000 3.000 - 0.00% -
471.omnetpp (unexplained diff vs previous) -66.67% 42.000 14.000 - 0.00% -
453.povray (unexplained diff vs previous) (percentage) -66.53% 2.360 0.790 - 0.00% -
444.namd (unexplained diff vs previous) (percentage) -60.49% 0.810 0.320 - 0.00% -
444.namd (unexplained diff vs previous) -60.00% 5.000 2.000 - 0.00% -
444.namd (max) -50.00% 6.000 3.000 - 0.00% -
462.libquantum (max) -50.00% 2.000 1.000 - 0.00% -
410.bwaves (unexplained diff vs previous) -48.65% 37.000 19.000 - 0.00% -
410.bwaves (unexplained diff vs previous) (percentage) -47.83% 0.920 0.480 - 0.00% -
464.h264ref (unexplained diff vs previous) (percentage) -47.37% 0.380 0.200 - 0.00% -
464.h264ref (unexplained diff vs previous) -46.67% 15.000 8.000 - 0.00% -
436.cactusADM (unexplained diff vs previous) (percentage) -40.62% 0.320 0.190 - 0.00% -
436.cactusADM (unexplained diff vs previous) -40.00% 5.000 3.000 - 0.00% -
444.namd (max) (percentage) -40.00% 1.000 0.600 - 0.00% -
464.h264ref (max) (percentage) -39.13% 0.460 0.280 - 0.00% -
464.h264ref (max) -38.89% 18.000 11.000 - 0.00% -
482.sphinx3 (unexplained diff vs previous) -33.33% 12.000 8.000 - 0.00% -
482.sphinx3 (unexplained diff vs previous) (percentage) -32.24% 1.520 1.030 - 0.00% -
410.bwaves (max) (percentage) -25.27% 0.910 0.680 - 0.00% -
482.sphinx3 (max) (percentage) -25.16% 1.550 1.160 - 0.00% -
435.gromacs (max) (percentage) -25.00% 2.200 1.650 - 0.00% -
410.bwaves (max) -25.00% 36.000 27.000 - 0.00% -
435.gromacs (max) -25.00% 112.000 84.000 - 0.00% -
482.sphinx3 (max) -25.00% 12.000 9.000 - 0.00% -
453.povray (max) -22.22% 9.000 7.000 - 0.00% -
445.gobmk (unexplained diff vs previous) (percentage) -21.35% 0.890 0.700 - 0.00% -
445.gobmk (unexplained diff vs previous) -20.51% 39.000 31.000 - 0.00% -
456.hmmer (max) -16.67% 6.000 5.000 - 0.00% -
444.namd -14.29% 7.000 6.000 - 0.00% -
444.namd (avg) -14.29% 7.000 6.000 - 0.00% -
445.gobmk (max) (percentage) -13.48% 0.890 0.770 - 0.00% -
447.dealII (max) (percentage) -12.86% 0.700 0.610 - 0.00% -
445.gobmk (max) -12.82% 39.000 34.000 - 0.00% -
453.povray (max) (percentage) -12.45% 2.410 2.110 - 0.00% -
471.omnetpp (max) (percentage) -12.31% 1.950 1.710 - 0.00% -
471.omnetpp (max) -11.63% 43.000 38.000 - 0.00% -
436.cactusADM (max) (percentage) -10.81% 0.370 0.330 - 0.00% -
436.cactusADM -9.09% 11.000 10.000 - 0.00% -
436.cactusADM (avg) -9.09% 11.000 10.000 - 0.00% -
482.sphinx3 -8.33% 12.000 11.000 - 0.00% -
482.sphinx3 (avg) -8.33% 12.000 11.000 - 0.00% -
429.mcf (max) -6.98% 43.000 40.000 - 0.00% -
429.mcf (max) (percentage) -6.88% 3.200 2.980 - 0.00% -
459.GemsFDTD (max) -6.67% 45.000 42.000 - 0.00% -
462.libquantum (max) (percentage) -6.40% 2.500 2.340 - 0.00% -
456.hmmer (max) (percentage) -6.25% 0.320 0.300 - 0.00% -
458.sjeng -6.25% 32.000 30.000 - 0.00% -
458.sjeng (avg) -6.25% 32.000 30.000 - 0.00% -
465.tonto (max) -6.25% 112.000 105.000 - 0.00% -
481.wrf (max) (percentage) -5.95% 0.840 0.790 - 0.00% -
458.sjeng (avg) (percentage) -5.66% 0.530 0.500 - 0.00% -
447.dealII (avg) (percentage) -5.50% 1.090 1.030 - 0.00% -
465.tonto (max) (percentage) -5.38% 1.300 1.230 - 0.00% -
437.leslie3d -5.11% 352.000 334.000 - 0.00% -
437.leslie3d (avg) -5.11% 352.000 334.000 - 0.00% -
435.gromacs (avg) (percentage) -5.08% 2.360 2.240 - 0.00% -
435.gromacs -5.00% 120.000 114.000 - 0.00% -
435.gromacs (avg) -5.00% 120.000 114.000 - 0.00% -
459.GemsFDTD (max) (percentage) -4.85% 1.030 0.980 - 0.00% -
400.perlbench (max) -4.76% 42.000 40.000 - 0.00% -
429.mcf -4.69% 64.000 61.000 - 0.00% -
429.mcf (avg) -4.69% 64.000 61.000 - 0.00% -
462.libquantum (avg) (percentage) -4.40% 1.820 1.740 - 0.00% -
464.h264ref (avg) (percentage) -4.05% 0.740 0.710 - 0.00% -
400.perlbench -3.85% 26.000 25.000 - 0.00% -
400.perlbench (avg) -3.85% 26.000 25.000 - 0.00% -
410.bwaves -3.77% 53.000 51.000 - 0.00% -
410.bwaves (avg) -3.77% 53.000 51.000 - 0.00% -
400.perlbench (avg) (percentage) -3.72% 1.880 1.810 - 0.00% -
400.perlbench (max) (percentage) -3.65% 3.010 2.900 - 0.00% -
444.namd (avg) (percentage) -3.51% 1.140 1.100 - 0.00% -
464.h264ref -3.45% 29.000 28.000 - 0.00% -
464.h264ref (avg) -3.45% 29.000 28.000 - 0.00% -
459.GemsFDTD -3.17% 63.000 61.000 - 0.00% -
459.GemsFDTD (avg) -3.17% 63.000 61.000 - 0.00% -
465.tonto -3.12% 96.000 93.000 - 0.00% -
465.tonto (avg) -3.12% 96.000 93.000 - 0.00% -
470.lbm -3.12% 32.000 31.000 - 0.00% -
470.lbm (avg) -3.12% 32.000 31.000 - 0.00% -
453.povray (avg) (percentage) -3.11% 1.930 1.870 - 0.00% -
473.astar -3.03% 66.000 64.000 - 0.00% -
473.astar (avg) -3.03% 66.000 64.000 - 0.00% -
436.cactusADM (avg) (percentage) -2.86% 0.700 0.680 - 0.00% -
429.mcf (avg) (percentage) -2.77% 4.700 4.570 - 0.00% -
445.gobmk (avg) (percentage) -2.70% 1.110 1.080 - 0.00% -
471.omnetpp (avg) (percentage) -2.66% 1.880 1.830 - 0.00% -
456.hmmer (avg) (percentage) -2.56% 0.390 0.380 - 0.00% -
483.xalancbmk (max) (percentage) -2.50% 2.400 2.340 - 0.00% -
471.omnetpp -2.38% 42.000 41.000 - 0.00% -
471.omnetpp (avg) -2.38% 42.000 41.000 - 0.00% -
410.bwaves (avg) (percentage) -2.27% 1.320 1.290 - 0.00% -
470.lbm (avg) (percentage) -2.11% 0.950 0.930 - 0.00% -
459.GemsFDTD (avg) (percentage) -2.08% 1.440 1.410 - 0.00% -
473.astar (avg) (percentage) -2.08% 1.440 1.410 - 0.00% -
445.gobmk -2.08% 48.000 47.000 - 0.00% -
445.gobmk (avg) -2.08% 48.000 47.000 - 0.00% -
482.sphinx3 (avg) (percentage) -1.92% 1.560 1.530 - 0.00% -
465.tonto (avg) (percentage) -1.80% 1.110 1.090 - 0.00% -

Performance Improvements - Score Δ Previous Current σ Δ (B) σ (B)
nb_total_tests 3.12% 32.000 33.000 - 13.79% -

Added Tests - sample variability
447.dealII (unexplained diff vs previous)
447.dealII (unexplained diff vs previous) (percentage)
458.sjeng (unexplained diff vs previous)
458.sjeng (unexplained diff vs previous) (percentage)
462.libquantum (unexplained diff vs previous)
462.libquantum (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
429.mcf 11.29% 10100.000 11240.000 - 0.00% -
410.bwaves 9.62% 26143.000 28659.000 - 0.00% -
437.leslie3d 8.96% 100088.000 109060.000 - 0.00% -
436.cactusADM 3.83% 528577.000 548846.000 - 0.00% -
433.milc 3.33% 94049.000 97181.000 - 0.00% -
434.zeusmp 3.10% 296597.000 305781.000 - 0.00% -
447.dealII 2.81% 480818.000 494332.000 - 0.00% -
465.tonto 2.49% 2795025.000 2864757.000 - 0.00% -
464.h264ref 2.26% 699384.000 715192.000 - 0.00% -
482.sphinx3 1.53% 153776.000 156132.000 - 0.00% -
471.omnetpp 1.42% 652766.000 662024.000 - 0.00% -
453.povray 1.23% 1083050.000 1096405.000 - 0.00% -
450.soplex 1.15% 326173.000 329914.000 - 0.00% -
462.libquantum 1.05% 22168.000 22400.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
450.soplex 11.76% 493.000 551.000 - 2.42% -
471.omnetpp 9.48% 2057.000 2252.000 - 0.63% -
433.milc 5.04% 932.000 979.000 - -1.21% -
403.gcc 4.17% 48.000 50.000 - -12.28% -
401.bzip2 2.79% 2612.000 2685.000 - -2.96% -
400.perlbench 2.58% 1354.000 1389.000 - -0.50% -
462.libquantum 2.50% 80.000 82.000 - 0.00% -
435.gromacs 2.06% 4991.000 5094.000 - -0.20% -
456.hmmer 2.05% 1948.000 1988.000 - 0.25% -
445.gobmk 1.70% 4363.000 4437.000 - 0.70% -
434.zeusmp 1.58% 1709.000 1736.000 - -2.14% -
482.sphinx3 1.17% 771.000 780.000 - -1.02% -
453.povray 1.07% 375.000 379.000 - -0.79% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -13.79% 29.000 25.000 - -3.85% -
nb_execution_successful -13.79% 29.000 25.000 - -3.85% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
473.astar -1.75% 31105.000 30561.000 - 0.00% -
458.sjeng -1.50% 156546.000 154198.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
429.mcf -24.58% 1790.000 1350.000 - -1.46% -
470.lbm -6.04% 3644.000 3424.000 - -0.61% -
459.GemsFDTD -4.39% 4574.000 4373.000 - -0.82% -
436.cactusADM -2.65% 1621.000 1578.000 - 0.19% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 13.79% 29.000 33.000 - 3.12% -

Added Tests - sample variability
400.perlbench
400.perlbench (avg)
400.perlbench (avg) (percentage)
400.perlbench (max)
400.perlbench (max) (percentage)
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
403.gcc
403.gcc (avg)
403.gcc (avg) (percentage)
403.gcc (max)
403.gcc (max) (percentage)
403.gcc (unexplained diff vs previous)
403.gcc (unexplained diff vs previous) (percentage)
410.bwaves
410.bwaves (avg)
410.bwaves (avg) (percentage)
410.bwaves (max)
410.bwaves (max) (percentage)
416.gamess (avg) (percentage)
416.gamess (max) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
433.milc
433.milc (avg)
433.milc (avg) (percentage)
433.milc (max)
433.milc (max) (percentage)
434.zeusmp
434.zeusmp (avg)
434.zeusmp (avg) (percentage)
434.zeusmp (max)
434.zeusmp (max) (percentage)
435.gromacs
435.gromacs (avg)
435.gromacs (avg) (percentage)
435.gromacs (max)
435.gromacs (max) (percentage)
436.cactusADM
436.cactusADM (avg)
436.cactusADM (avg) (percentage)
436.cactusADM (max)
436.cactusADM (max) (percentage)
437.leslie3d
437.leslie3d (avg)
437.leslie3d (avg) (percentage)
437.leslie3d (max)
437.leslie3d (max) (percentage)
444.namd
444.namd (avg)
444.namd (avg) (percentage)
444.namd (max)
444.namd (max) (percentage)
445.gobmk
445.gobmk (avg)
445.gobmk (avg) (percentage)
445.gobmk (max)
445.gobmk (max) (percentage)
447.dealII
447.dealII (avg)
447.dealII (avg) (percentage)
447.dealII (max)
447.dealII (max) (percentage)
447.dealII (unexplained diff vs previous)
447.dealII (unexplained diff vs previous) (percentage)
450.soplex
450.soplex (avg)
450.soplex (avg) (percentage)
450.soplex (max)
450.soplex (max) (percentage)
453.povray
453.povray (avg)
453.povray (avg) (percentage)
453.povray (max)
453.povray (max) (percentage)
454.calculix (avg) (percentage)
454.calculix (max) (percentage)
456.hmmer
456.hmmer (avg)
456.hmmer (avg) (percentage)
456.hmmer (max)
456.hmmer (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
458.sjeng (unexplained diff vs previous)
458.sjeng (unexplained diff vs previous) (percentage)
459.GemsFDTD
459.GemsFDTD (avg)
459.GemsFDTD (avg) (percentage)
459.GemsFDTD (max)
459.GemsFDTD (max) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)
462.libquantum (unexplained diff vs previous)
462.libquantum (unexplained diff vs previous) (percentage)
464.h264ref
464.h264ref (avg)
464.h264ref (avg) (percentage)
464.h264ref (max)
464.h264ref (max) (percentage)
465.tonto
465.tonto (avg)
465.tonto (avg) (percentage)
465.tonto (max)
465.tonto (max) (percentage)
470.lbm
470.lbm (avg)
470.lbm (avg) (percentage)
470.lbm (max)
470.lbm (max) (percentage)
471.omnetpp
471.omnetpp (avg)
471.omnetpp (avg) (percentage)
471.omnetpp (max)
471.omnetpp (max) (percentage)
473.astar
473.astar (avg)
473.astar (avg) (percentage)
473.astar (max)
473.astar (max) (percentage)
481.wrf (avg) (percentage)
481.wrf (max) (percentage)
482.sphinx3
482.sphinx3 (avg)
482.sphinx3 (avg) (percentage)
482.sphinx3 (max)
482.sphinx3 (max) (percentage)
483.xalancbmk (avg) (percentage)
483.xalancbmk (max) (percentage)

Report Time: 0.36s
Execution (seconds)
Name Current %
400.perlbench 1389.000 -
401.bzip2 2685.000 -2.96%
403.gcc 50.000 -12.28%
410.bwaves 3998.000 -
429.mcf 1350.000 -1.46%
433.milc 979.000 -1.21%
434.zeusmp 1736.000 -2.14%
435.gromacs 5094.000 -
436.cactusADM 1578.000 -
437.leslie3d 6741.000 -7.57%
444.namd 623.000 -
445.gobmk 4437.000 -
447.dealII 988.000 -
450.soplex 551.000 2.42%
453.povray 379.000 -
456.hmmer 1988.000 -
458.sjeng 6091.000 -
459.GemsFDTD 4373.000 -
462.libquantum 82.000 -
464.h264ref 3953.000 -
465.tonto 8604.000 -
470.lbm 3424.000 -
471.omnetpp 2252.000 -
473.astar 4585.000 -
482.sphinx3 780.000 -1.02%
Geometric Mean 1634.256 -1.21%
Code Size (bytes)
Name Current %
400.perlbench 1337816.000 -
401.bzip2 73153.000 -
403.gcc 3959912.000 -
410.bwaves 28659.000 -
429.mcf 11240.000 -
433.milc 97181.000 -
434.zeusmp 305781.000 -
435.gromacs 729563.000 -
436.cactusADM 548846.000 -
437.leslie3d 109060.000 -
444.namd 236972.000 -
445.gobmk 1890099.000 -
447.dealII 494332.000 -
450.soplex 329914.000 -
453.povray 1096405.000 -
456.hmmer 166257.000 -
458.sjeng 154198.000 -
459.GemsFDTD 377342.000 -
462.libquantum 22400.000 -
464.h264ref 715192.000 -
465.tonto 2864757.000 -
470.lbm 11308.000 -
471.omnetpp 662024.000 -
473.astar 30561.000 -
482.sphinx3 156132.000 -
Geometric Mean 235794.797 -
Score
Name Current %
nb_compile_successful 25.000 -3.85%
nb_execution_successful 25.000 -3.85%
nb_total_tests 33.000 3.12%
Geometric Mean 27.424 -1.58%
sample variability
Name Current %
400.perlbench 25.000 -3.85%
400.perlbench (avg) 25.000 -3.85%
400.perlbench (avg) (percentage) 1.810 -3.72%
400.perlbench (max) 40.000 -4.76%
400.perlbench (max) (percentage) 2.900 -3.65%
400.perlbench (unexplained diff vs previous) 7.000 -70.83%
400.perlbench (unexplained diff vs previous) (percentage) 0.500 -70.93%
401.bzip2 37.000 2.78%
401.bzip2 (avg) 37.000 2.78%
401.bzip2 (avg) (percentage) 1.410 6.02%
401.bzip2 (max) 79.000 83.72%
401.bzip2 (max) (percentage) 2.960 86.16%
401.bzip2 (unexplained diff vs previous) 82.000 173.33%
401.bzip2 (unexplained diff vs previous) (percentage) 3.050 182.41%
403.gcc 2.000 -
403.gcc (avg) 2.000 -
403.gcc (avg) (percentage) 4.730 13.16%
403.gcc (max) 6.000 -
403.gcc (max) (percentage) 12.280 4.42%
403.gcc (unexplained diff vs previous) 7.000 16.67%
403.gcc (unexplained diff vs previous) (percentage) 14.000 32.95%
410.bwaves 51.000 -3.77%
410.bwaves (avg) 51.000 -3.77%
410.bwaves (avg) (percentage) 1.290 -2.27%
410.bwaves (max) 27.000 -25.00%
410.bwaves (max) (percentage) 0.680 -25.27%
410.bwaves (unexplained diff vs previous) 19.000 -48.65%
410.bwaves (unexplained diff vs previous) (percentage) 0.480 -47.83%
416.gamess (avg) (percentage) 0.250 -
416.gamess (max) (percentage) 0.190 -
429.mcf 61.000 -4.69%
429.mcf (avg) 61.000 -4.69%
429.mcf (avg) (percentage) 4.570 -2.77%
429.mcf (max) 40.000 -6.98%
429.mcf (max) (percentage) 2.980 -6.88%
429.mcf (unexplained diff vs previous) 20.000 233.33%
429.mcf (unexplained diff vs previous) (percentage) 1.480 236.36%
433.milc 11.000 -
433.milc (avg) 11.000 -
433.milc (avg) (percentage) 1.140 -
433.milc (max) 11.000 37.50%
433.milc (max) (percentage) 1.210 49.38%
433.milc (unexplained diff vs previous) 12.000 -
433.milc (unexplained diff vs previous) (percentage) 1.230 -
434.zeusmp 19.000 -
434.zeusmp (avg) 19.000 -
434.zeusmp (avg) (percentage) 1.130 4.63%
434.zeusmp (max) 37.000 -
434.zeusmp (max) (percentage) 2.140 -
434.zeusmp (unexplained diff vs previous) 38.000 2.70%
434.zeusmp (unexplained diff vs previous) (percentage) 2.190 4.78%
435.gromacs 114.000 -5.00%
435.gromacs (avg) 114.000 -5.00%
435.gromacs (avg) (percentage) 2.240 -5.08%
435.gromacs (max) 84.000 -25.00%
435.gromacs (max) (percentage) 1.650 -25.00%
435.gromacs (unexplained diff vs previous) 10.000 -91.30%
435.gromacs (unexplained diff vs previous) (percentage) 0.200 -91.11%
436.cactusADM 10.000 -9.09%
436.cactusADM (avg) 10.000 -9.09%
436.cactusADM (avg) (percentage) 0.680 -2.86%
436.cactusADM (max) 5.000 -
436.cactusADM (max) (percentage) 0.330 -10.81%
436.cactusADM (unexplained diff vs previous) 3.000 -40.00%
436.cactusADM (unexplained diff vs previous) (percentage) 0.190 -40.62%
437.leslie3d 334.000 -5.11%
437.leslie3d (avg) 334.000 -5.11%
437.leslie3d (avg) (percentage) 4.960 2.48%
437.leslie3d (max) 510.000 29.44%
437.leslie3d (max) (percentage) 7.570 39.93%
437.leslie3d (unexplained diff vs previous) 552.000 47.59%
437.leslie3d (unexplained diff vs previous) (percentage) 8.190 59.65%
444.namd 6.000 -14.29%
444.namd (avg) 6.000 -14.29%
444.namd (avg) (percentage) 1.100 -3.51%
444.namd (max) 3.000 -50.00%
444.namd (max) (percentage) 0.600 -40.00%
444.namd (unexplained diff vs previous) 2.000 -60.00%
444.namd (unexplained diff vs previous) (percentage) 0.320 -60.49%
445.gobmk 47.000 -2.08%
445.gobmk (avg) 47.000 -2.08%
445.gobmk (avg) (percentage) 1.080 -2.70%
445.gobmk (max) 34.000 -12.82%
445.gobmk (max) (percentage) 0.770 -13.48%
445.gobmk (unexplained diff vs previous) 31.000 -20.51%
445.gobmk (unexplained diff vs previous) (percentage) 0.700 -21.35%
447.dealII 10.000 -
447.dealII (avg) 10.000 -
447.dealII (avg) (percentage) 1.030 -5.50%
447.dealII (max) 6.000 -
447.dealII (max) (percentage) 0.610 -12.86%
447.dealII (unexplained diff vs previous) 0.000 -
447.dealII (unexplained diff vs previous) (percentage) 0.000 -
450.soplex 13.000 -
450.soplex (avg) 13.000 -
450.soplex (avg) (percentage) 2.540 -
450.soplex (max) 13.000 62.50%
450.soplex (max) (percentage) 2.420 46.67%
450.soplex (unexplained diff vs previous) 13.000 44.44%
450.soplex (unexplained diff vs previous) (percentage) 2.360 41.32%
453.povray 7.000 -
453.povray (avg) 7.000 -
453.povray (avg) (percentage) 1.870 -3.11%
453.povray (max) 7.000 -22.22%
453.povray (max) (percentage) 2.110 -12.45%
453.povray (unexplained diff vs previous) 3.000 -66.67%
453.povray (unexplained diff vs previous) (percentage) 0.790 -66.53%
454.calculix (avg) (percentage) 3.100 -
454.calculix (max) (percentage) 2.940 -
456.hmmer 7.000 -
456.hmmer (avg) 7.000 -
456.hmmer (avg) (percentage) 0.380 -2.56%
456.hmmer (max) 5.000 -16.67%
456.hmmer (max) (percentage) 0.300 -6.25%
456.hmmer (unexplained diff vs previous) 5.000 400.00%
456.hmmer (unexplained diff vs previous) (percentage) 0.250 400.00%
458.sjeng 30.000 -6.25%
458.sjeng (avg) 30.000 -6.25%
458.sjeng (avg) (percentage) 0.500 -5.66%
458.sjeng (max) 2.000 -89.47%
458.sjeng (max) (percentage) 0.040 -87.50%
458.sjeng (unexplained diff vs previous) 0.000 -
458.sjeng (unexplained diff vs previous) (percentage) 0.000 -
459.GemsFDTD 61.000 -3.17%
459.GemsFDTD (avg) 61.000 -3.17%
459.GemsFDTD (avg) (percentage) 1.410 -2.08%
459.GemsFDTD (max) 42.000 -6.67%
459.GemsFDTD (max) (percentage) 0.980 -4.85%
459.GemsFDTD (unexplained diff vs previous) 36.000 200.00%
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.820 203.70%
462.libquantum 1.000 -
462.libquantum (avg) 1.000 -
462.libquantum (avg) (percentage) 1.740 -4.40%
462.libquantum (max) 1.000 -50.00%
462.libquantum (max) (percentage) 2.340 -6.40%
462.libquantum (unexplained diff vs previous) 0.000 -
462.libquantum (unexplained diff vs previous) (percentage) 0.000 -
464.h264ref 28.000 -3.45%
464.h264ref (avg) 28.000 -3.45%
464.h264ref (avg) (percentage) 0.710 -4.05%
464.h264ref (max) 11.000 -38.89%
464.h264ref (max) (percentage) 0.280 -39.13%
464.h264ref (unexplained diff vs previous) 8.000 -46.67%
464.h264ref (unexplained diff vs previous) (percentage) 0.200 -47.37%
465.tonto 93.000 -3.12%
465.tonto (avg) 93.000 -3.12%
465.tonto (avg) (percentage) 1.090 -1.80%
465.tonto (max) 105.000 -6.25%
465.tonto (max) (percentage) 1.230 -5.38%
465.tonto (unexplained diff vs previous) 71.000 9.23%
465.tonto (unexplained diff vs previous) (percentage) 0.830 10.67%
470.lbm 31.000 -3.12%
470.lbm (avg) 31.000 -3.12%
470.lbm (avg) (percentage) 0.930 -2.11%
470.lbm (max) 20.000 185.71%
470.lbm (max) (percentage) 0.610 165.22%
470.lbm (unexplained diff vs previous) 21.000 162.50%
470.lbm (unexplained diff vs previous) (percentage) 0.610 165.22%
471.omnetpp 41.000 -2.38%
471.omnetpp (avg) 41.000 -2.38%
471.omnetpp (avg) (percentage) 1.830 -2.66%
471.omnetpp (max) 38.000 -11.63%
471.omnetpp (max) (percentage) 1.710 -12.31%
471.omnetpp (unexplained diff vs previous) 14.000 -66.67%
471.omnetpp (unexplained diff vs previous) (percentage) 0.620 -67.02%
473.astar 64.000 -3.03%
473.astar (avg) 64.000 -3.03%
473.astar (avg) (percentage) 1.410 -2.08%
473.astar (max) 33.000 -
473.astar (max) (percentage) 0.720 -
473.astar (unexplained diff vs previous) 33.000 135.71%
473.astar (unexplained diff vs previous) (percentage) 0.720 140.00%
481.wrf (avg) (percentage) 1.890 -
481.wrf (max) (percentage) 0.790 -5.95%
482.sphinx3 11.000 -8.33%
482.sphinx3 (avg) 11.000 -8.33%
482.sphinx3 (avg) (percentage) 1.530 -1.92%
482.sphinx3 (max) 9.000 -25.00%
482.sphinx3 (max) (percentage) 1.160 -25.16%
482.sphinx3 (unexplained diff vs previous) 8.000 -33.33%
482.sphinx3 (unexplained diff vs previous) (percentage) 1.030 -32.24%
483.xalancbmk (avg) (percentage) 2.740 -
483.xalancbmk (max) (percentage) 2.340 -2.50%
Geometric Mean 3.746 -25.54%