Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=baeb0a958cf865172111e9935a5a5148e72fbf9a (+ 18 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/abfc140579682598cd178eb9d0b0160bbfafc633 (+ 54 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=e7c14e542d8d858b824b5df4f4e3dc93695e6171 (+ 13 commits)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/e09f6f42432c3144acf9c954b3bc0d9212d88a6a (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-arm-master-O2-build/214/
Filter

gnu-arm-master-O2 test results

Run Order Start Time Duration
Current 0214 (3-changed-components) 2024-08-13T21:30:51 0:00:00
Previous 0213 (4-changed-components) 2024-08-10T00:46:58 0:00:00
Baseline 0001 (4-changed-components) 2023-03-23T16:47:15 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 80 16
Performance Improvements 44 13
Added Tests 30 130
Unchanged Tests 1022 1017
Total Tests 1176

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
434.zeusmp (unexplained diff vs previous) (percentage) 6475.00% 0.040 2.630 0.000 0.00% 0.000
434.zeusmp (unexplained diff vs previous) 6100.00% 1.000 62.000 0.000 0.00% 0.000
470.lbm (unexplained diff vs previous) (percentage) 4540.00% 0.050 2.320 0.000 0.00% 0.000
470.lbm (unexplained diff vs previous) 4300.00% 2.000 88.000 0.000 0.00% 0.000
459.GemsFDTD (unexplained diff vs previous) (percentage) 1100.00% 0.290 3.480 0.000 0.00% 0.000
459.GemsFDTD (unexplained diff vs previous) 1053.33% 15.000 173.000 0.000 0.00% 0.000
435.gromacs (unexplained diff vs previous) (percentage) 1045.71% 0.350 4.010 0.000 0.00% 0.000
435.gromacs (unexplained diff vs previous) 1000.00% 20.000 220.000 0.000 0.00% 0.000
429.mcf (unexplained diff vs previous) (percentage) 693.42% 0.760 6.030 0.000 0.00% 0.000
434.zeusmp (max) (percentage) 652.94% 0.340 2.560 - 0.00% -
434.zeusmp (max) 650.00% 8.000 60.000 - 0.00% -
429.mcf (unexplained diff vs previous) 644.44% 9.000 67.000 0.000 0.00% 0.000
459.GemsFDTD (max) (percentage) 380.00% 0.700 3.360 - 0.00% -
459.GemsFDTD (max) 361.11% 36.000 166.000 - 0.00% -
470.lbm (max) (percentage) 336.54% 0.520 2.270 - 0.00% -
470.lbm (max) 330.00% 20.000 86.000 - 0.00% -
433.milc (unexplained diff vs previous) (percentage) 284.44% 0.450 1.730 0.000 0.00% 0.000
433.milc (unexplained diff vs previous) 280.00% 5.000 19.000 0.000 0.00% 0.000
433.milc (max) (percentage) 277.78% 0.450 1.700 - 0.00% -
433.milc (max) 260.00% 5.000 18.000 - 0.00% -
401.bzip2 (max) (percentage) 161.36% 2.200 5.750 - 0.00% -
401.bzip2 (max) 145.90% 61.000 150.000 - 0.00% -
447.dealII (max) (percentage) 114.81% 1.350 2.900 - 0.00% -
447.dealII (max) 113.04% 23.000 49.000 - 0.00% -
436.cactusADM (unexplained diff vs previous) 100.00% 7.000 14.000 0.000 0.00% 0.000
436.cactusADM (max) (percentage) 96.67% 0.300 0.590 - 0.00% -
436.cactusADM (unexplained diff vs previous) (percentage) 96.67% 0.300 0.590 0.000 0.00% 0.000
436.cactusADM (max) 85.71% 7.000 13.000 - 0.00% -
473.astar (max) (percentage) 80.49% 2.460 4.440 - 0.00% -
473.astar (max) 72.80% 125.000 216.000 - 0.00% -
458.sjeng (max) (percentage) 71.74% 0.460 0.790 - 0.00% -
458.sjeng (max) 70.59% 34.000 58.000 - 0.00% -
464.h264ref (max) 62.50% 32.000 52.000 - 0.00% -
464.h264ref (max) (percentage) 62.50% 0.560 0.910 - 0.00% -
429.mcf (max) (percentage) 52.14% 3.740 5.690 - 0.00% -
465.tonto (max) (percentage) 52.12% 1.650 2.510 - 0.00% -
435.gromacs (max) (percentage) 49.61% 2.580 3.860 - 0.00% -
465.tonto (max) 48.47% 163.000 242.000 - 0.00% -
450.soplex (max) (percentage) 45.81% 4.650 6.780 - 0.00% -
435.gromacs (max) 43.54% 147.000 211.000 - 0.00% -
429.mcf (max) 43.18% 44.000 63.000 - 0.00% -
450.soplex (max) 36.00% 25.000 34.000 - 0.00% -
410.bwaves (max) (percentage) 27.96% 0.930 1.190 - 0.00% -
410.bwaves (max) 27.66% 47.000 60.000 - 0.00% -
437.leslie3d (unexplained diff vs previous) (percentage) 17.32% 1.790 2.100 0.000 0.00% 0.000
437.leslie3d (unexplained diff vs previous) 15.14% 185.000 213.000 0.000 0.00% 0.000
464.h264ref 10.53% 19.000 21.000 - 0.00% -
464.h264ref (avg) 10.53% 19.000 21.000 - 0.00% -
401.bzip2 (avg) (percentage) 9.80% 1.530 1.680 - 0.00% -
464.h264ref (avg) (percentage) 8.82% 0.340 0.370 - 0.00% -
459.GemsFDTD (avg) (percentage) 8.33% 0.840 0.910 - 0.00% -
473.astar (avg) (percentage) 7.14% 1.260 1.350 - 0.00% -
447.dealII (avg) (percentage) 7.07% 0.990 1.060 - 0.00% -
465.tonto (avg) (percentage) 6.59% 0.910 0.970 - 0.00% -
450.soplex (avg) (percentage) 6.39% 2.190 2.330 - 0.00% -
434.zeusmp (avg) (percentage) 6.25% 0.800 0.850 - 0.00% -
447.dealII 5.88% 17.000 18.000 - 0.00% -
447.dealII (avg) 5.88% 17.000 18.000 - 0.00% -
434.zeusmp 5.26% 19.000 20.000 - 0.00% -
434.zeusmp (avg) 5.26% 19.000 20.000 - 0.00% -
401.bzip2 4.76% 42.000 44.000 - 0.00% -
401.bzip2 (avg) 4.76% 42.000 44.000 - 0.00% -
459.GemsFDTD 4.65% 43.000 45.000 - 0.00% -
459.GemsFDTD (avg) 4.65% 43.000 45.000 - 0.00% -
470.lbm (avg) (percentage) 4.17% 0.720 0.750 - 0.00% -
470.lbm 3.70% 27.000 28.000 - 0.00% -
470.lbm (avg) 3.70% 27.000 28.000 - 0.00% -
465.tonto 3.33% 90.000 93.000 - 0.00% -
465.tonto (avg) 3.33% 90.000 93.000 - 0.00% -
482.sphinx3 (avg) (percentage) 3.31% 1.210 1.250 - 0.00% -
410.bwaves 2.94% 34.000 35.000 - 0.00% -
410.bwaves (avg) 2.94% 34.000 35.000 - 0.00% -
410.bwaves (avg) (percentage) 2.94% 0.680 0.700 - 0.00% -
435.gromacs (avg) (percentage) 2.60% 1.920 1.970 - 0.00% -
433.milc (avg) (percentage) 2.53% 0.790 0.810 - 0.00% -
482.sphinx3 (max) (percentage) 2.44% 2.460 2.520 - 0.00% -
436.cactusADM (avg) (percentage) 2.13% 0.470 0.480 - 0.00% -
473.astar 1.56% 64.000 65.000 - 0.00% -
473.astar (avg) 1.56% 64.000 65.000 - 0.00% -
445.gobmk (avg) (percentage) 1.49% 0.670 0.680 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
450.soplex -6.78% 546.000 509.000 - -1.17% -
401.bzip2 -5.75% 2781.000 2621.000 - 0.15% -
429.mcf -5.69% 1178.000 1111.000 - -0.45% -
473.astar -4.44% 5095.000 4869.000 - 3.29% -
435.gromacs -3.86% 5706.000 5486.000 - 1.09% -
459.GemsFDTD -3.36% 5143.000 4970.000 - -2.13% -
447.dealII -2.90% 1759.000 1708.000 - -2.79% -
434.zeusmp -2.56% 2421.000 2359.000 - -1.05% -
482.sphinx3 -2.52% 755.000 736.000 - -0.14% -
465.tonto -2.51% 9903.000 9654.000 - 1.47% -
470.lbm -2.27% 3884.000 3796.000 - -1.20% -
437.leslie3d -2.06% 10354.000 10141.000 - 2.84% -
433.milc -1.70% 1120.000 1101.000 - 0.46% -
471.omnetpp -1.26% 2462.000 2431.000 - 3.40% -
410.bwaves -1.19% 5120.000 5059.000 - -3.67% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
453.povray (max) -42.86% 7.000 4.000 - 0.00% -
471.omnetpp (unexplained diff vs previous) -39.22% 51.000 31.000 0.000 0.00% 0.000
471.omnetpp (unexplained diff vs previous) (percentage) -38.16% 2.070 1.280 0.000 0.00% 0.000
453.povray (max) (percentage) -34.66% 1.760 1.150 - 0.00% -
453.povray -25.00% 4.000 3.000 - 0.00% -
453.povray (avg) -25.00% 4.000 3.000 - 0.00% -
471.omnetpp (max) -17.31% 52.000 43.000 - 0.00% -
471.omnetpp (max) (percentage) -16.51% 2.120 1.770 - 0.00% -
462.libquantum (max) (percentage) -12.54% 3.430 3.000 - 0.00% -
400.perlbench (max) -8.82% 34.000 31.000 - 0.00% -
400.perlbench (max) (percentage) -8.41% 2.260 2.070 - 0.00% -
437.leslie3d (max) -6.66% 721.000 673.000 - 0.00% -
437.leslie3d (max) (percentage) -4.73% 6.970 6.640 - 0.00% -
400.perlbench -4.17% 24.000 23.000 - 0.00% -
400.perlbench (avg) -4.17% 24.000 23.000 - 0.00% -
429.mcf -4.17% 48.000 46.000 - 0.00% -
429.mcf (avg) -4.17% 48.000 46.000 - 0.00% -
437.leslie3d -3.87% 542.000 521.000 - 0.00% -
437.leslie3d (avg) -3.87% 542.000 521.000 - 0.00% -
453.povray (avg) (percentage) -3.12% 0.960 0.930 - 0.00% -
471.omnetpp -2.86% 35.000 34.000 - 0.00% -
471.omnetpp (avg) -2.86% 35.000 34.000 - 0.00% -
445.gobmk (max) -2.27% 44.000 43.000 - 0.00% -
445.gobmk (max) (percentage) -2.22% 0.900 0.880 - 0.00% -
437.leslie3d (avg) (percentage) -1.91% 5.240 5.140 - 0.00% -
456.hmmer (max) (percentage) -1.69% 0.590 0.580 - 0.00% -
462.libquantum (avg) (percentage) -1.63% 1.840 1.810 - 0.00% -
444.namd (avg) (percentage) -1.54% 0.650 0.640 - 0.00% -
400.perlbench (avg) (percentage) -1.26% 1.590 1.570 - 0.00% -

Added Tests - sample variability
400.perlbench (unexplained diff vs previous)
400.perlbench (unexplained diff vs previous) (percentage)
401.bzip2 (unexplained diff vs previous)
401.bzip2 (unexplained diff vs previous) (percentage)
410.bwaves (unexplained diff vs previous)
410.bwaves (unexplained diff vs previous) (percentage)
444.namd (unexplained diff vs previous)
444.namd (unexplained diff vs previous) (percentage)
445.gobmk (unexplained diff vs previous)
445.gobmk (unexplained diff vs previous) (percentage)
447.dealII (unexplained diff vs previous)
447.dealII (unexplained diff vs previous) (percentage)
450.soplex (unexplained diff vs previous)
450.soplex (unexplained diff vs previous) (percentage)
453.povray (unexplained diff vs previous)
453.povray (unexplained diff vs previous) (percentage)
456.hmmer (unexplained diff vs previous)
456.hmmer (unexplained diff vs previous) (percentage)
458.sjeng (unexplained diff vs previous)
458.sjeng (unexplained diff vs previous) (percentage)
462.libquantum (unexplained diff vs previous)
462.libquantum (unexplained diff vs previous) (percentage)
464.h264ref (unexplained diff vs previous)
464.h264ref (unexplained diff vs previous) (percentage)
465.tonto (unexplained diff vs previous)
465.tonto (unexplained diff vs previous) (percentage)
473.astar (unexplained diff vs previous)
473.astar (unexplained diff vs previous) (percentage)
482.sphinx3 (unexplained diff vs previous)
482.sphinx3 (unexplained diff vs previous) (percentage)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
410.bwaves 4.16% 23410.000 24383.000 - 0.00% -
465.tonto 3.31% 3107830.000 3210586.000 - 0.00% -
462.libquantum 3.00% 32503.000 33478.000 - 0.00% -
444.namd 2.76% 223054.000 229202.000 - 0.00% -
400.perlbench 2.01% 981846.000 1001535.000 - 0.00% -
447.dealII 1.44% 2447503.000 2482753.000 - 0.00% -
429.mcf 1.44% 10303.000 10451.000 - 0.00% -
471.omnetpp 1.34% 502628.000 509346.000 - 0.00% -
470.lbm 1.01% 11078.000 11190.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
400.perlbench 10.52% 1369.000 1513.000 - -0.92% -
458.sjeng 5.52% 7048.000 7437.000 - -0.79% -
471.omnetpp 3.40% 2351.000 2431.000 - -1.26% -
473.astar 3.29% 4714.000 4869.000 - -4.44% -
437.leslie3d 2.84% 9861.000 10141.000 - -2.06% -
465.tonto 1.47% 9514.000 9654.000 - -2.51% -
435.gromacs 1.09% 5427.000 5486.000 - -3.86% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d -4.54% 82727.000 78972.000 - 0.00% -
473.astar -1.24% 31376.000 30988.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
462.libquantum -9.01% 111.000 101.000 - -0.98% -
453.povray -4.47% 447.000 427.000 - -0.23% -
410.bwaves -3.67% 5252.000 5059.000 - -1.19% -
447.dealII -2.79% 1757.000 1708.000 - -2.90% -
459.GemsFDTD -2.13% 5078.000 4970.000 - -3.36% -
470.lbm -1.20% 3842.000 3796.000 - -2.27% -
450.soplex -1.17% 515.000 509.000 - -6.78% -
434.zeusmp -1.05% 2384.000 2359.000 - -2.56% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 134.48% 29.000 68.000 - 0.00% -
nb_compile_successful 65.52% 29.000 48.000 - 0.00% -
nb_execution_successful 65.52% 29.000 48.000 - 0.00% -

Added Tests - sample variability
400.perlbench
400.perlbench (avg)
400.perlbench (avg) (percentage)
400.perlbench (max)
400.perlbench (max) (percentage)
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
403.gcc (avg) (percentage)
403.gcc (max) (percentage)
410.bwaves
410.bwaves (avg)
410.bwaves (avg) (percentage)
410.bwaves (max)
410.bwaves (max) (percentage)
416.gamess (avg) (percentage)
416.gamess (max) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
433.milc
433.milc (avg)
433.milc (avg) (percentage)
433.milc (max)
433.milc (max) (percentage)
434.zeusmp
434.zeusmp (avg)
434.zeusmp (avg) (percentage)
434.zeusmp (max)
434.zeusmp (max) (percentage)
435.gromacs
435.gromacs (avg)
435.gromacs (avg) (percentage)
435.gromacs (max)
435.gromacs (max) (percentage)
436.cactusADM
436.cactusADM (avg)
436.cactusADM (avg) (percentage)
436.cactusADM (max)
436.cactusADM (max) (percentage)
437.leslie3d
437.leslie3d (avg)
437.leslie3d (avg) (percentage)
437.leslie3d (max)
437.leslie3d (max) (percentage)
444.namd
444.namd (avg)
444.namd (avg) (percentage)
444.namd (max)
444.namd (max) (percentage)
445.gobmk
445.gobmk (avg)
445.gobmk (avg) (percentage)
445.gobmk (max)
445.gobmk (max) (percentage)
447.dealII
447.dealII (avg)
447.dealII (avg) (percentage)
447.dealII (max)
447.dealII (max) (percentage)
450.soplex
450.soplex (avg)
450.soplex (avg) (percentage)
450.soplex (max)
450.soplex (max) (percentage)
453.povray
453.povray (avg)
453.povray (avg) (percentage)
453.povray (max)
453.povray (max) (percentage)
454.calculix (avg) (percentage)
454.calculix (max) (percentage)
456.hmmer
456.hmmer (avg)
456.hmmer (avg) (percentage)
456.hmmer (max)
456.hmmer (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
459.GemsFDTD
459.GemsFDTD (avg)
459.GemsFDTD (avg) (percentage)
459.GemsFDTD (max)
459.GemsFDTD (max) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)
464.h264ref
464.h264ref (avg)
464.h264ref (avg) (percentage)
464.h264ref (max)
464.h264ref (max) (percentage)
465.tonto
465.tonto (avg)
465.tonto (avg) (percentage)
465.tonto (max)
465.tonto (max) (percentage)
470.lbm
470.lbm (avg)
470.lbm (avg) (percentage)
470.lbm (max)
470.lbm (max) (percentage)
471.omnetpp
471.omnetpp (avg)
471.omnetpp (avg) (percentage)
471.omnetpp (max)
471.omnetpp (max) (percentage)
473.astar
473.astar (avg)
473.astar (avg) (percentage)
473.astar (max)
473.astar (max) (percentage)
481.wrf (avg) (percentage)
481.wrf (max) (percentage)
482.sphinx3
482.sphinx3 (avg)
482.sphinx3 (avg) (percentage)
482.sphinx3 (max)
482.sphinx3 (max) (percentage)
483.xalancbmk (avg) (percentage)
483.xalancbmk (max) (percentage)


Report Time: 0.36s
Name Current %
400.perlbench 1513.000 -
401.bzip2 2621.000 -5.75%
410.bwaves 5059.000 -1.19%
429.mcf 1111.000 -5.69%
433.milc 1101.000 -1.70%
434.zeusmp 2359.000 -2.56%
435.gromacs 5486.000 -3.86%
436.cactusADM 2369.000 -
437.leslie3d 10141.000 -2.06%
444.namd 763.000 -
445.gobmk 4932.000 -
447.dealII 1708.000 -2.90%
450.soplex 509.000 -6.78%
453.povray 427.000 -
456.hmmer 3472.000 -
458.sjeng 7437.000 -
459.GemsFDTD 4970.000 -3.36%
462.libquantum 101.000 -
464.h264ref 5782.000 -
465.tonto 9654.000 -2.51%
470.lbm 3796.000 -2.27%
471.omnetpp 2431.000 -1.26%
473.astar 4869.000 -4.44%
482.sphinx3 736.000 -2.52%
Geometric Mean 2240.129 -2.23%
Name Current %
400.perlbench 1001535.000 -
401.bzip2 52944.000 -
410.bwaves 24383.000 -
429.mcf 10451.000 -
433.milc 98922.000 -
434.zeusmp 233524.000 -
435.gromacs 744413.000 -
436.cactusADM 586719.000 -
437.leslie3d 78972.000 -
444.namd 229202.000 -
445.gobmk 1368757.000 -
447.dealII 2482753.000 -
450.soplex 300558.000 -
453.povray 760895.000 -
456.hmmer 235753.000 -
458.sjeng 125984.000 -
459.GemsFDTD 330657.000 -
462.libquantum 33478.000 -
464.h264ref 472420.000 -
465.tonto 3210586.000 -
470.lbm 11190.000 -
471.omnetpp 509346.000 -
473.astar 30988.000 -
482.sphinx3 153867.000 -
Geometric Mean 203680.860 -
Name Current %
400.perlbench 23.000 -4.17%
400.perlbench (avg) 23.000 -4.17%
400.perlbench (avg) (percentage) 1.570 -1.26%
400.perlbench (max) 31.000 -8.82%
400.perlbench (max) (percentage) 2.070 -8.41%
400.perlbench (unexplained diff vs previous) 14.000 -
400.perlbench (unexplained diff vs previous) (percentage) 0.930 -
401.bzip2 44.000 4.76%
401.bzip2 (avg) 44.000 4.76%
401.bzip2 (avg) (percentage) 1.680 9.80%
401.bzip2 (max) 150.000 145.90%
401.bzip2 (max) (percentage) 5.750 161.36%
401.bzip2 (unexplained diff vs previous) 160.000 -
401.bzip2 (unexplained diff vs previous) (percentage) 6.100 -
403.gcc (avg) (percentage) 7.670 -
403.gcc (max) (percentage) 13.170 -
410.bwaves 35.000 2.94%
410.bwaves (avg) 35.000 2.94%
410.bwaves (avg) (percentage) 0.700 2.94%
410.bwaves (max) 60.000 27.66%
410.bwaves (max) (percentage) 1.190 27.96%
410.bwaves (unexplained diff vs previous) 61.000 -
410.bwaves (unexplained diff vs previous) (percentage) 1.210 -
416.gamess (avg) (percentage) 0.200 -
416.gamess (max) (percentage) 0.220 -
429.mcf 46.000 -4.17%
429.mcf (avg) 46.000 -4.17%
429.mcf (avg) (percentage) 4.150 -
429.mcf (max) 63.000 43.18%
429.mcf (max) (percentage) 5.690 52.14%
429.mcf (unexplained diff vs previous) 67.000 644.44%
429.mcf (unexplained diff vs previous) (percentage) 6.030 693.42%
433.milc 8.000 -
433.milc (avg) 8.000 -
433.milc (avg) (percentage) 0.810 2.53%
433.milc (max) 18.000 260.00%
433.milc (max) (percentage) 1.700 277.78%
433.milc (unexplained diff vs previous) 19.000 280.00%
433.milc (unexplained diff vs previous) (percentage) 1.730 284.44%
434.zeusmp 20.000 5.26%
434.zeusmp (avg) 20.000 5.26%
434.zeusmp (avg) (percentage) 0.850 6.25%
434.zeusmp (max) 60.000 650.00%
434.zeusmp (max) (percentage) 2.560 652.94%
434.zeusmp (unexplained diff vs previous) 62.000 6100.00%
434.zeusmp (unexplained diff vs previous) (percentage) 2.630 6475.00%
435.gromacs 108.000 -
435.gromacs (avg) 108.000 -
435.gromacs (avg) (percentage) 1.970 2.60%
435.gromacs (max) 211.000 43.54%
435.gromacs (max) (percentage) 3.860 49.61%
435.gromacs (unexplained diff vs previous) 220.000 1000.00%
435.gromacs (unexplained diff vs previous) (percentage) 4.010 1045.71%
436.cactusADM 11.000 -
436.cactusADM (avg) 11.000 -
436.cactusADM (avg) (percentage) 0.480 2.13%
436.cactusADM (max) 13.000 85.71%
436.cactusADM (max) (percentage) 0.590 96.67%
436.cactusADM (unexplained diff vs previous) 14.000 100.00%
436.cactusADM (unexplained diff vs previous) (percentage) 0.590 96.67%
437.leslie3d 521.000 -3.87%
437.leslie3d (avg) 521.000 -3.87%
437.leslie3d (avg) (percentage) 5.140 -1.91%
437.leslie3d (max) 673.000 -6.66%
437.leslie3d (max) (percentage) 6.640 -4.73%
437.leslie3d (unexplained diff vs previous) 213.000 15.14%
437.leslie3d (unexplained diff vs previous) (percentage) 2.100 17.32%
444.namd 4.000 -
444.namd (avg) 4.000 -
444.namd (avg) (percentage) 0.640 -1.54%
444.namd (max) 4.000 -
444.namd (max) (percentage) 0.580 -
444.namd (unexplained diff vs previous) 2.000 -
444.namd (unexplained diff vs previous) (percentage) 0.260 -
445.gobmk 33.000 -
445.gobmk (avg) 33.000 -
445.gobmk (avg) (percentage) 0.680 1.49%
445.gobmk (max) 43.000 -2.27%
445.gobmk (max) (percentage) 0.880 -2.22%
445.gobmk (unexplained diff vs previous) 40.000 -
445.gobmk (unexplained diff vs previous) (percentage) 0.810 -
447.dealII 18.000 5.88%
447.dealII (avg) 18.000 5.88%
447.dealII (avg) (percentage) 1.060 7.07%
447.dealII (max) 49.000 113.04%
447.dealII (max) (percentage) 2.900 114.81%
447.dealII (unexplained diff vs previous) 51.000 -
447.dealII (unexplained diff vs previous) (percentage) 2.990 -
450.soplex 11.000 -
450.soplex (avg) 11.000 -
450.soplex (avg) (percentage) 2.330 6.39%
450.soplex (max) 34.000 36.00%
450.soplex (max) (percentage) 6.780 45.81%
450.soplex (unexplained diff vs previous) 37.000 -
450.soplex (unexplained diff vs previous) (percentage) 7.270 -
453.povray 3.000 -25.00%
453.povray (avg) 3.000 -25.00%
453.povray (avg) (percentage) 0.930 -3.12%
453.povray (max) 4.000 -42.86%
453.povray (max) (percentage) 1.150 -34.66%
453.povray (unexplained diff vs previous) 1.000 -
453.povray (unexplained diff vs previous) (percentage) 0.230 -
454.calculix (avg) (percentage) 3.250 -
454.calculix (max) (percentage) 3.190 -
456.hmmer 7.000 -
456.hmmer (avg) 7.000 -
456.hmmer (avg) (percentage) 0.220 -
456.hmmer (max) 20.000 -
456.hmmer (max) (percentage) 0.580 -1.69%
456.hmmer (unexplained diff vs previous) 1.000 -
456.hmmer (unexplained diff vs previous) (percentage) 0.030 -
458.sjeng 34.000 -
458.sjeng (avg) 34.000 -
458.sjeng (avg) (percentage) 0.470 -
458.sjeng (max) 58.000 70.59%
458.sjeng (max) (percentage) 0.790 71.74%
458.sjeng (unexplained diff vs previous) 59.000 -
458.sjeng (unexplained diff vs previous) (percentage) 0.790 -
459.GemsFDTD 45.000 4.65%
459.GemsFDTD (avg) 45.000 4.65%
459.GemsFDTD (avg) (percentage) 0.910 8.33%
459.GemsFDTD (max) 166.000 361.11%
459.GemsFDTD (max) (percentage) 3.360 380.00%
459.GemsFDTD (unexplained diff vs previous) 173.000 1053.33%
459.GemsFDTD (unexplained diff vs previous) (percentage) 3.480 1100.00%
462.libquantum 1.000 -
462.libquantum (avg) 1.000 -
462.libquantum (avg) (percentage) 1.810 -1.63%
462.libquantum (max) 3.000 -
462.libquantum (max) (percentage) 3.000 -12.54%
462.libquantum (unexplained diff vs previous) 1.000 -
462.libquantum (unexplained diff vs previous) (percentage) 0.990 -
464.h264ref 21.000 10.53%
464.h264ref (avg) 21.000 10.53%
464.h264ref (avg) (percentage) 0.370 8.82%
464.h264ref (max) 52.000 62.50%
464.h264ref (max) (percentage) 0.910 62.50%
464.h264ref (unexplained diff vs previous) 53.000 -
464.h264ref (unexplained diff vs previous) (percentage) 0.920 -
465.tonto 93.000 3.33%
465.tonto (avg) 93.000 3.33%
465.tonto (avg) (percentage) 0.970 6.59%
465.tonto (max) 242.000 48.47%
465.tonto (max) (percentage) 2.510 52.12%
465.tonto (unexplained diff vs previous) 249.000 -
465.tonto (unexplained diff vs previous) (percentage) 2.580 -
470.lbm 28.000 3.70%
470.lbm (avg) 28.000 3.70%
470.lbm (avg) (percentage) 0.750 4.17%
470.lbm (max) 86.000 330.00%
470.lbm (max) (percentage) 2.270 336.54%
470.lbm (unexplained diff vs previous) 88.000 4300.00%
470.lbm (unexplained diff vs previous) (percentage) 2.320 4540.00%
471.omnetpp 34.000 -2.86%
471.omnetpp (avg) 34.000 -2.86%
471.omnetpp (avg) (percentage) 1.430 -
471.omnetpp (max) 43.000 -17.31%
471.omnetpp (max) (percentage) 1.770 -16.51%
471.omnetpp (unexplained diff vs previous) 31.000 -39.22%
471.omnetpp (unexplained diff vs previous) (percentage) 1.280 -38.16%
473.astar 65.000 1.56%
473.astar (avg) 65.000 1.56%
473.astar (avg) (percentage) 1.350 7.14%
473.astar (max) 216.000 72.80%
473.astar (max) (percentage) 4.440 80.49%
473.astar (unexplained diff vs previous) 226.000 -
473.astar (unexplained diff vs previous) (percentage) 4.640 -
481.wrf (avg) (percentage) 1.430 -
481.wrf (max) (percentage) 0.680 -
482.sphinx3 9.000 -
482.sphinx3 (avg) 9.000 -
482.sphinx3 (avg) (percentage) 1.250 3.31%
482.sphinx3 (max) 18.000 -
482.sphinx3 (max) (percentage) 2.520 2.44%
482.sphinx3 (unexplained diff vs previous) 19.000 -
482.sphinx3 (unexplained diff vs previous) (percentage) 2.580 -
483.xalancbmk (avg) (percentage) 1.390 -
483.xalancbmk (max) (percentage) 1.040 -
Geometric Mean 7.307 34.26%