Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=8baaed84cbc1abf6797016f36c1d9842631c777e (+ 248 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/4ecfa6c4a9df19b364cbdf6d9de5f0b98c22bd8f (unchanged)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=1eae989cb7632760fd6f4008be73549da861b202 (+ 84 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=68eca432f6e41c1de6f4a7af6d60d9daa9f5eba1 (+ 378 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_vect-spec2k6--gnu-arm-master-O3_LTO-build/170/
View Options
Report
Filter

gnu-arm-master-O3_LTO test results

Run Order Start Time Duration
Current 0170 (3-changed-components) 2023-12-29T06:01:22 0:00:00
Previous 0164 (2-changed-components) 2023-12-17T15:39:49 0:00:00
Baseline 0001 (4-changed-components) 2023-03-04T00:55:39 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 25 28
Performance Improvements 128 8
Added Tests 4 138
Unchanged Tests 1019 1002
Total Tests 1176

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
403.gcc 1.85% 54.000 55.000 - 12.24% -
453.povray 1.61% 435.000 442.000 - 1.14% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
437.leslie3d (unexplained diff vs previous) (percentage) 646.30% 0.540 4.030 - 0.00% -
437.leslie3d (unexplained diff vs previous) 616.33% 49.000 351.000 - 0.00% -
464.h264ref (unexplained diff vs previous) 550.00% 2.000 13.000 - 0.00% -
464.h264ref (unexplained diff vs previous) (percentage) 550.00% 0.040 0.260 - 0.00% -
434.zeusmp (unexplained diff vs previous) (percentage) 415.38% 0.130 0.670 - 0.00% -
434.zeusmp (unexplained diff vs previous) 400.00% 3.000 15.000 - 0.00% -
401.bzip2 (unexplained diff vs previous) (percentage) 169.23% 0.390 1.050 - 0.00% -
401.bzip2 (unexplained diff vs previous) 163.64% 11.000 29.000 - 0.00% -
436.cactusADM (max) 160.00% 5.000 13.000 - 0.00% -
436.cactusADM (unexplained diff vs previous) 160.00% 5.000 13.000 - 0.00% -
436.cactusADM (max) (percentage) 154.55% 0.220 0.560 - 0.00% -
436.cactusADM (unexplained diff vs previous) (percentage) 154.55% 0.220 0.560 - 0.00% -
453.povray (unexplained diff vs previous) 133.33% 3.000 7.000 - 0.00% -
453.povray (unexplained diff vs previous) (percentage) 128.99% 0.690 1.580 - 0.00% -
410.bwaves (unexplained diff vs previous) 100.00% 9.000 18.000 - 0.00% -
410.bwaves (unexplained diff vs previous) (percentage) 100.00% 0.200 0.400 - 0.00% -
473.astar (unexplained diff vs previous) (percentage) 34.09% 0.440 0.590 - 0.00% -
450.soplex (unexplained diff vs previous) (percentage) 33.33% 0.570 0.760 - 0.00% -
450.soplex (unexplained diff vs previous) 33.33% 3.000 4.000 - 0.00% -
473.astar (unexplained diff vs previous) 33.33% 21.000 28.000 - 0.00% -
465.tonto (unexplained diff vs previous) (percentage) 28.00% 0.750 0.960 - 0.00% -
465.tonto (unexplained diff vs previous) 27.54% 69.000 88.000 - 0.00% -
444.namd (unexplained diff vs previous) (percentage) 1.56% 0.640 0.650 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
437.leslie3d -3.88% 9058.000 8707.000 - -1.29% -
401.bzip2 -1.04% 2790.000 2761.000 - 1.02% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
470.lbm (unexplained diff vs previous) (percentage) -90.91% 0.330 0.030 - 0.00% -
470.lbm (unexplained diff vs previous) -90.91% 11.000 1.000 - 0.00% -
400.perlbench (max) -85.71% 49.000 7.000 - 0.00% -
400.perlbench (max) (percentage) -84.76% 3.280 0.500 - 0.00% -
462.libquantum (unexplained diff vs previous) (percentage) -80.20% 4.950 0.980 - 0.00% -
462.libquantum (unexplained diff vs previous) -80.00% 5.000 1.000 - 0.00% -
416.gamess (unexplained diff vs previous) -77.42% 31.000 7.000 - 0.00% -
416.gamess (unexplained diff vs previous) (percentage) -77.27% 0.220 0.050 - 0.00% -
458.sjeng (unexplained diff vs previous) -72.50% 40.000 11.000 - 0.00% -
458.sjeng (unexplained diff vs previous) (percentage) -71.43% 0.560 0.160 - 0.00% -
470.lbm (max) -67.06% 85.000 28.000 - 0.00% -
470.lbm (max) (percentage) -66.93% 2.540 0.840 - 0.00% -
459.GemsFDTD (unexplained diff vs previous) -64.86% 37.000 13.000 - 0.00% -
459.GemsFDTD (max) -64.50% 200.000 71.000 - 0.00% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -64.38% 0.730 0.260 - 0.00% -
459.GemsFDTD (max) (percentage) -64.32% 3.980 1.420 - 0.00% -
435.gromacs (unexplained diff vs previous) (percentage) -57.45% 1.410 0.600 - 0.00% -
435.gromacs (unexplained diff vs previous) -56.96% 79.000 34.000 - 0.00% -
458.sjeng (max) (percentage) -51.04% 0.960 0.470 - 0.00% -
458.sjeng (max) -50.75% 67.000 33.000 - 0.00% -
444.namd (max) -37.50% 8.000 5.000 - 0.00% -
444.namd (max) (percentage) -33.94% 1.090 0.720 - 0.00% -
400.perlbench (unexplained diff vs previous) -30.00% 10.000 7.000 - 0.00% -
416.gamess (max) -29.03% 31.000 22.000 - 0.00% -
400.perlbench (unexplained diff vs previous) (percentage) -28.79% 0.660 0.470 - 0.00% -
416.gamess (max) (percentage) -27.27% 0.220 0.160 - 0.00% -
447.dealII (unexplained diff vs previous) -25.00% 4.000 3.000 - 0.00% -
447.dealII (unexplained diff vs previous) (percentage) -25.00% 0.360 0.270 - 0.00% -
462.libquantum (max) (percentage) -24.57% 5.210 3.930 - 0.00% -
445.gobmk (unexplained diff vs previous) -22.22% 9.000 7.000 - 0.00% -
445.gobmk (unexplained diff vs previous) (percentage) -20.00% 0.200 0.160 - 0.00% -
462.libquantum (max) -20.00% 5.000 4.000 - 0.00% -
435.gromacs (max) (percentage) -10.94% 2.560 2.280 - 0.00% -
435.gromacs (max) -10.49% 143.000 128.000 - 0.00% -
456.hmmer (unexplained diff vs previous) (percentage) -10.26% 0.390 0.350 - 0.00% -
437.leslie3d (max) -9.90% 697.000 628.000 - 0.00% -
456.hmmer (max) -9.09% 11.000 10.000 - 0.00% -
456.hmmer (unexplained diff vs previous) -8.33% 12.000 11.000 - 0.00% -
456.hmmer (max) (percentage) -7.89% 0.380 0.350 - 0.00% -
471.omnetpp (max) -6.35% 126.000 118.000 - 0.00% -
471.omnetpp (max) (percentage) -6.29% 6.200 5.810 - 0.00% -
437.leslie3d (max) (percentage) -6.23% 7.700 7.220 - 0.00% -
447.dealII -5.88% 17.000 16.000 - 0.00% -
447.dealII (avg) -5.88% 17.000 16.000 - 0.00% -
450.soplex -5.88% 17.000 16.000 - 0.00% -
450.soplex (avg) -5.88% 17.000 16.000 - 0.00% -
482.sphinx3 -5.88% 17.000 16.000 - 0.00% -
482.sphinx3 (avg) -5.88% 17.000 16.000 - 0.00% -
401.bzip2 (max) -5.69% 123.000 116.000 - 0.00% -
465.tonto (max) -5.62% 160.000 151.000 - 0.00% -
464.h264ref (max) (percentage) -5.17% 1.160 1.100 - 0.00% -
464.h264ref (max) -5.08% 59.000 56.000 - 0.00% -
434.zeusmp (max) -5.00% 40.000 38.000 - 0.00% -
429.mcf (max) -4.89% 184.000 175.000 - 0.00% -
429.mcf (max) (percentage) -4.77% 20.330 19.360 - 0.00% -
410.bwaves (max) -4.76% 168.000 160.000 - 0.00% -
416.gamess -4.76% 21.000 20.000 - 0.00% -
416.gamess (avg) -4.76% 21.000 20.000 - 0.00% -
401.bzip2 (max) (percentage) -4.75% 4.420 4.210 - 0.00% -
473.astar (max) -4.62% 195.000 186.000 - 0.00% -
465.tonto (max) (percentage) -4.60% 1.740 1.660 - 0.00% -
437.leslie3d -4.36% 413.000 395.000 - 0.00% -
437.leslie3d (avg) -4.36% 413.000 395.000 - 0.00% -
400.perlbench -4.17% 24.000 23.000 - 0.00% -
400.perlbench (avg) -4.17% 24.000 23.000 - 0.00% -
410.bwaves (max) (percentage) -4.08% 3.680 3.530 - 0.00% -
450.soplex (max) (percentage) -4.05% 7.160 6.870 - 0.00% -
433.milc (max) (percentage) -4.02% 4.230 4.060 - 0.00% -
445.gobmk (max) (percentage) -4.02% 2.240 2.150 - 0.00% -
445.gobmk (max) -4.00% 100.000 96.000 - 0.00% -
482.sphinx3 (max) (percentage) -3.92% 4.850 4.660 - 0.00% -
473.astar (max) (percentage) -3.90% 4.100 3.940 - 0.00% -
434.zeusmp (max) (percentage) -3.89% 1.800 1.730 - 0.00% -
447.dealII (avg) (percentage) -3.87% 1.550 1.490 - 0.00% -
445.gobmk (avg) (percentage) -3.85% 1.300 1.250 - 0.00% -
433.milc (avg) (percentage) -3.47% 1.440 1.390 - 0.00% -
445.gobmk -3.45% 58.000 56.000 - 0.00% -
445.gobmk (avg) -3.45% 58.000 56.000 - 0.00% -
459.GemsFDTD (avg) (percentage) -3.35% 1.790 1.730 - 0.00% -
459.GemsFDTD -3.33% 90.000 87.000 - 0.00% -
459.GemsFDTD (avg) -3.33% 90.000 87.000 - 0.00% -
435.gromacs (avg) (percentage) -3.31% 2.720 2.630 - 0.00% -
471.omnetpp (avg) (percentage) -3.29% 2.130 2.060 - 0.00% -
482.sphinx3 (max) -3.23% 31.000 30.000 - 0.00% -
453.povray (max) (percentage) -3.20% 2.500 2.420 - 0.00% -
473.astar -3.06% 98.000 95.000 - 0.00% -
473.astar (avg) -3.06% 98.000 95.000 - 0.00% -
400.perlbench (avg) (percentage) -3.05% 1.640 1.590 - 0.00% -
429.mcf (avg) (percentage) -3.00% 11.340 11.000 - 0.00% -
458.sjeng (avg) (percentage) -2.99% 0.670 0.650 - 0.00% -
410.bwaves -2.94% 68.000 66.000 - 0.00% -
410.bwaves (avg) -2.94% 68.000 66.000 - 0.00% -
429.mcf -2.94% 102.000 99.000 - 0.00% -
429.mcf (avg) -2.94% 102.000 99.000 - 0.00% -
450.soplex (avg) (percentage) -2.73% 3.300 3.210 - 0.00% -
433.milc (max) -2.70% 37.000 36.000 - 0.00% -
450.soplex (max) -2.70% 37.000 36.000 - 0.00% -
465.tonto -2.68% 112.000 109.000 - 0.00% -
465.tonto (avg) -2.68% 112.000 109.000 - 0.00% -
410.bwaves (avg) (percentage) -2.65% 1.510 1.470 - 0.00% -
435.gromacs -2.63% 152.000 148.000 - 0.00% -
435.gromacs (avg) -2.63% 152.000 148.000 - 0.00% -
470.lbm -2.56% 39.000 38.000 - 0.00% -
470.lbm (avg) -2.56% 39.000 38.000 - 0.00% -
470.lbm (avg) (percentage) -2.54% 1.180 1.150 - 0.00% -
464.h264ref (avg) (percentage) -2.47% 0.810 0.790 - 0.00% -
464.h264ref -2.44% 41.000 40.000 - 0.00% -
464.h264ref (avg) -2.44% 41.000 40.000 - 0.00% -
471.omnetpp -2.33% 43.000 42.000 - 0.00% -
471.omnetpp (avg) -2.33% 43.000 42.000 - 0.00% -
482.sphinx3 (avg) (percentage) -2.25% 2.670 2.610 - 0.00% -
458.sjeng -2.13% 47.000 46.000 - 0.00% -
458.sjeng (avg) -2.13% 47.000 46.000 - 0.00% -
462.libquantum (avg) (percentage) -2.04% 2.450 2.400 - 0.00% -
481.wrf (max) (percentage) -2.01% 4.970 4.870 - 0.00% -
401.bzip2 (avg) (percentage) -1.96% 2.040 2.000 - 0.00% -
454.calculix (max) (percentage) -1.96% 4.590 4.500 - 0.00% -
473.astar (avg) (percentage) -1.94% 2.060 2.020 - 0.00% -
447.dealII (max) (percentage) -1.80% 1.110 1.090 - 0.00% -
401.bzip2 -1.79% 56.000 55.000 - 0.00% -
401.bzip2 (avg) -1.79% 56.000 55.000 - 0.00% -
434.zeusmp (avg) (percentage) -1.67% 1.200 1.180 - 0.00% -
465.tonto (avg) (percentage) -1.64% 1.220 1.200 - 0.00% -
403.gcc (max) (percentage) -1.23% 6.530 6.450 - 0.00% -
444.namd (avg) (percentage) -1.08% 0.930 0.920 - 0.00% -

Performance Improvements - Score Δ Previous Current σ Δ (B) σ (B)
nb_total_tests 3.23% 31.000 32.000 - 14.29% -

Added Tests - sample variability
429.mcf (unexplained diff vs previous)
429.mcf (unexplained diff vs previous) (percentage)
471.omnetpp (unexplained diff vs previous)
471.omnetpp (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d 7.06% 95053.000 101761.000 - 0.00% -
447.dealII 4.72% 460638.000 482397.000 - 0.00% -
436.cactusADM 3.49% 520390.000 538530.000 - 0.00% -
433.milc 3.11% 105180.000 108452.000 - 0.00% -
444.namd 2.56% 232647.000 238594.000 - 0.00% -
416.gamess 2.51% 8947804.000 9172197.000 - 0.00% -
462.libquantum 1.94% 21437.000 21853.000 - 0.00% -
410.bwaves 1.89% 22757.000 23186.000 - 0.00% -
473.astar 1.80% 30208.000 30752.000 - 0.00% -
429.mcf 1.55% 10087.000 10243.000 - 0.00% -
464.h264ref 1.41% 782902.000 793966.000 - 0.00% -
445.gobmk 1.15% 1706409.000 1726029.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
400.perlbench 16.60% 1289.000 1503.000 - -0.46% -
447.dealII 14.31% 978.000 1118.000 - 0.27% -
403.gcc 12.24% 49.000 55.000 - 1.85% -
458.sjeng 6.99% 6628.000 7091.000 - 0.16% -
459.GemsFDTD 4.89% 4827.000 5063.000 - 0.26% -
473.astar 3.07% 4595.000 4736.000 - -0.59% -
435.gromacs 2.75% 5488.000 5639.000 - 0.61% -
482.sphinx3 2.68% 634.000 651.000 - 0.93% -
450.soplex 2.32% 517.000 529.000 - 0.76% -
416.gamess 1.87% 14028.000 14290.000 - -0.05% -
464.h264ref 1.74% 5004.000 5091.000 - -0.25% -
470.lbm 1.44% 3330.000 3378.000 - 0.03% -
453.povray 1.14% 437.000 442.000 - 1.61% -
401.bzip2 1.02% 2733.000 2761.000 - -1.04% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -7.14% 28.000 26.000 - 0.00% -
nb_execution_successful -7.14% 28.000 26.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
434.zeusmp -1.53% 325184.000 320212.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
429.mcf -25.21% 1214.000 908.000 - 0.00% -
462.libquantum -10.53% 114.000 102.000 - 0.99% -
456.hmmer -7.53% 3374.000 3120.000 - 0.35% -
433.milc -4.68% 940.000 896.000 - -0.11% -
436.cactusADM -1.40% 2359.000 2326.000 - 0.56% -
437.leslie3d -1.29% 8821.000 8707.000 - -3.88% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 14.29% 28.000 32.000 - 3.23% -

Added Tests - sample variability
400.perlbench
400.perlbench (avg)
400.perlbench (avg) (percentage)
400.perlbench (max)
400.perlbench (max) (percentage)
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
403.gcc
403.gcc (avg)
403.gcc (avg) (percentage)
403.gcc (max)
403.gcc (max) (percentage)
410.bwaves
410.bwaves (avg)
410.bwaves (avg) (percentage)
410.bwaves (max)
410.bwaves (max) (percentage)
416.gamess
416.gamess (avg)
416.gamess (avg) (percentage)
416.gamess (max)
416.gamess (max) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
429.mcf (unexplained diff vs previous)
429.mcf (unexplained diff vs previous) (percentage)
433.milc
433.milc (avg)
433.milc (avg) (percentage)
433.milc (max)
433.milc (max) (percentage)
434.zeusmp
434.zeusmp (avg)
434.zeusmp (avg) (percentage)
434.zeusmp (max)
434.zeusmp (max) (percentage)
435.gromacs
435.gromacs (avg)
435.gromacs (avg) (percentage)
435.gromacs (max)
435.gromacs (max) (percentage)
436.cactusADM
436.cactusADM (avg)
436.cactusADM (avg) (percentage)
436.cactusADM (max)
436.cactusADM (max) (percentage)
437.leslie3d
437.leslie3d (avg)
437.leslie3d (avg) (percentage)
437.leslie3d (max)
437.leslie3d (max) (percentage)
444.namd
444.namd (avg)
444.namd (avg) (percentage)
444.namd (max)
444.namd (max) (percentage)
445.gobmk
445.gobmk (avg)
445.gobmk (avg) (percentage)
445.gobmk (max)
445.gobmk (max) (percentage)
447.dealII
447.dealII (avg)
447.dealII (avg) (percentage)
447.dealII (max)
447.dealII (max) (percentage)
450.soplex
450.soplex (avg)
450.soplex (avg) (percentage)
450.soplex (max)
450.soplex (max) (percentage)
453.povray
453.povray (avg)
453.povray (avg) (percentage)
453.povray (max)
453.povray (max) (percentage)
454.calculix (avg) (percentage)
454.calculix (max) (percentage)
456.hmmer
456.hmmer (avg)
456.hmmer (avg) (percentage)
456.hmmer (max)
456.hmmer (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
459.GemsFDTD
459.GemsFDTD (avg)
459.GemsFDTD (avg) (percentage)
459.GemsFDTD (max)
459.GemsFDTD (max) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)
464.h264ref
464.h264ref (avg)
464.h264ref (avg) (percentage)
464.h264ref (max)
464.h264ref (max) (percentage)
465.tonto
465.tonto (avg)
465.tonto (avg) (percentage)
465.tonto (max)
465.tonto (max) (percentage)
470.lbm
470.lbm (avg)
470.lbm (avg) (percentage)
470.lbm (max)
470.lbm (max) (percentage)
471.omnetpp
471.omnetpp (avg)
471.omnetpp (avg) (percentage)
471.omnetpp (max)
471.omnetpp (max) (percentage)
471.omnetpp (unexplained diff vs previous)
471.omnetpp (unexplained diff vs previous) (percentage)
473.astar
473.astar (avg)
473.astar (avg) (percentage)
473.astar (max)
473.astar (max) (percentage)
481.wrf (avg) (percentage)
481.wrf (max) (percentage)
482.sphinx3
482.sphinx3 (avg)
482.sphinx3 (avg) (percentage)
482.sphinx3 (max)
482.sphinx3 (max) (percentage)

Report Time: 0.37s
Execution (seconds)
Name Current %
400.perlbench 1503.000 -
401.bzip2 2761.000 -1.04%
403.gcc 55.000 1.85%
410.bwaves 4548.000 -
416.gamess 14290.000 -
429.mcf 908.000 -
433.milc 896.000 -
434.zeusmp 2245.000 -
435.gromacs 5639.000 -
436.cactusADM 2326.000 -
437.leslie3d 8707.000 -3.88%
444.namd 771.000 -
445.gobmk 4480.000 -
447.dealII 1118.000 -
450.soplex 529.000 -
453.povray 442.000 1.61%
456.hmmer 3120.000 -
458.sjeng 7091.000 -
459.GemsFDTD 5063.000 -
462.libquantum 102.000 -
464.h264ref 5091.000 -
465.tonto 9135.000 -
470.lbm 3378.000 -
471.omnetpp 2044.000 -
473.astar 4736.000 -
482.sphinx3 651.000 -
Geometric Mean 1942.898 -
Code Size (bytes)
Name Current %
400.perlbench 1256633.000 -
401.bzip2 71700.000 -
403.gcc 3714421.000 -
410.bwaves 23186.000 -
416.gamess 9172197.000 -
429.mcf 10243.000 -
433.milc 108452.000 -
434.zeusmp 320212.000 -
435.gromacs 738688.000 -
436.cactusADM 538530.000 -
437.leslie3d 101761.000 -
444.namd 238594.000 -
445.gobmk 1726029.000 -
447.dealII 482397.000 -
450.soplex 328548.000 -
453.povray 1084688.000 -
456.hmmer 155735.000 -
458.sjeng 153511.000 -
459.GemsFDTD 398487.000 -
462.libquantum 21853.000 -
464.h264ref 793966.000 -
465.tonto 3087182.000 -
470.lbm 11043.000 -
471.omnetpp 587707.000 -
473.astar 30752.000 -
482.sphinx3 157067.000 -
Geometric Mean 266419.349 -
Score
Name Current %
nb_compile_successful 26.000 -
nb_execution_successful 26.000 -
nb_total_tests 32.000 3.23%
Geometric Mean 27.863 1.06%
sample variability
Name Current %
400.perlbench 23.000 -4.17%
400.perlbench (avg) 23.000 -4.17%
400.perlbench (avg) (percentage) 1.590 -3.05%
400.perlbench (max) 7.000 -85.71%
400.perlbench (max) (percentage) 0.500 -84.76%
400.perlbench (unexplained diff vs previous) 7.000 -30.00%
400.perlbench (unexplained diff vs previous) (percentage) 0.470 -28.79%
401.bzip2 55.000 -1.79%
401.bzip2 (avg) 55.000 -1.79%
401.bzip2 (avg) (percentage) 2.000 -1.96%
401.bzip2 (max) 116.000 -5.69%
401.bzip2 (max) (percentage) 4.210 -4.75%
401.bzip2 (unexplained diff vs previous) 29.000 163.64%
401.bzip2 (unexplained diff vs previous) (percentage) 1.050 169.23%
403.gcc 3.000 -
403.gcc (avg) 3.000 -
403.gcc (avg) (percentage) 5.650 -
403.gcc (max) 3.000 -
403.gcc (max) (percentage) 6.450 -1.23%
410.bwaves 66.000 -2.94%
410.bwaves (avg) 66.000 -2.94%
410.bwaves (avg) (percentage) 1.470 -2.65%
410.bwaves (max) 160.000 -4.76%
410.bwaves (max) (percentage) 3.530 -4.08%
410.bwaves (unexplained diff vs previous) 18.000 100.00%
410.bwaves (unexplained diff vs previous) (percentage) 0.400 100.00%
416.gamess 20.000 -4.76%
416.gamess (avg) 20.000 -4.76%
416.gamess (avg) (percentage) 0.140 -
416.gamess (max) 22.000 -29.03%
416.gamess (max) (percentage) 0.160 -27.27%
416.gamess (unexplained diff vs previous) 7.000 -77.42%
416.gamess (unexplained diff vs previous) (percentage) 0.050 -77.27%
429.mcf 99.000 -2.94%
429.mcf (avg) 99.000 -2.94%
429.mcf (avg) (percentage) 11.000 -3.00%
429.mcf (max) 175.000 -4.89%
429.mcf (max) (percentage) 19.360 -4.77%
429.mcf (unexplained diff vs previous) 0.000 -
429.mcf (unexplained diff vs previous) (percentage) 0.000 -
433.milc 12.000 -
433.milc (avg) 12.000 -
433.milc (avg) (percentage) 1.390 -3.47%
433.milc (max) 36.000 -2.70%
433.milc (max) (percentage) 4.060 -4.02%
433.milc (unexplained diff vs previous) 1.000 -
433.milc (unexplained diff vs previous) (percentage) 0.110 -
434.zeusmp 26.000 -
434.zeusmp (avg) 26.000 -
434.zeusmp (avg) (percentage) 1.180 -1.67%
434.zeusmp (max) 38.000 -5.00%
434.zeusmp (max) (percentage) 1.730 -3.89%
434.zeusmp (unexplained diff vs previous) 15.000 400.00%
434.zeusmp (unexplained diff vs previous) (percentage) 0.670 415.38%
435.gromacs 148.000 -2.63%
435.gromacs (avg) 148.000 -2.63%
435.gromacs (avg) (percentage) 2.630 -3.31%
435.gromacs (max) 128.000 -10.49%
435.gromacs (max) (percentage) 2.280 -10.94%
435.gromacs (unexplained diff vs previous) 34.000 -56.96%
435.gromacs (unexplained diff vs previous) (percentage) 0.600 -57.45%
436.cactusADM 11.000 -
436.cactusADM (avg) 11.000 -
436.cactusADM (avg) (percentage) 0.490 -
436.cactusADM (max) 13.000 160.00%
436.cactusADM (max) (percentage) 0.560 154.55%
436.cactusADM (unexplained diff vs previous) 13.000 160.00%
436.cactusADM (unexplained diff vs previous) (percentage) 0.560 154.55%
437.leslie3d 395.000 -4.36%
437.leslie3d (avg) 395.000 -4.36%
437.leslie3d (avg) (percentage) 4.540 -
437.leslie3d (max) 628.000 -9.90%
437.leslie3d (max) (percentage) 7.220 -6.23%
437.leslie3d (unexplained diff vs previous) 351.000 616.33%
437.leslie3d (unexplained diff vs previous) (percentage) 4.030 646.30%
444.namd 7.000 -
444.namd (avg) 7.000 -
444.namd (avg) (percentage) 0.920 -1.08%
444.namd (max) 5.000 -37.50%
444.namd (max) (percentage) 0.720 -33.94%
444.namd (unexplained diff vs previous) 5.000 -
444.namd (unexplained diff vs previous) (percentage) 0.650 1.56%
445.gobmk 56.000 -3.45%
445.gobmk (avg) 56.000 -3.45%
445.gobmk (avg) (percentage) 1.250 -3.85%
445.gobmk (max) 96.000 -4.00%
445.gobmk (max) (percentage) 2.150 -4.02%
445.gobmk (unexplained diff vs previous) 7.000 -22.22%
445.gobmk (unexplained diff vs previous) (percentage) 0.160 -20.00%
447.dealII 16.000 -5.88%
447.dealII (avg) 16.000 -5.88%
447.dealII (avg) (percentage) 1.490 -3.87%
447.dealII (max) 12.000 -
447.dealII (max) (percentage) 1.090 -1.80%
447.dealII (unexplained diff vs previous) 3.000 -25.00%
447.dealII (unexplained diff vs previous) (percentage) 0.270 -25.00%
450.soplex 16.000 -5.88%
450.soplex (avg) 16.000 -5.88%
450.soplex (avg) (percentage) 3.210 -2.73%
450.soplex (max) 36.000 -2.70%
450.soplex (max) (percentage) 6.870 -4.05%
450.soplex (unexplained diff vs previous) 4.000 33.33%
450.soplex (unexplained diff vs previous) (percentage) 0.760 33.33%
453.povray 6.000 -
453.povray (avg) 6.000 -
453.povray (avg) (percentage) 1.460 -
453.povray (max) 10.000 -
453.povray (max) (percentage) 2.420 -3.20%
453.povray (unexplained diff vs previous) 7.000 133.33%
453.povray (unexplained diff vs previous) (percentage) 1.580 128.99%
454.calculix (avg) (percentage) 2.820 -
454.calculix (max) (percentage) 4.500 -1.96%
456.hmmer 7.000 -
456.hmmer (avg) 7.000 -
456.hmmer (avg) (percentage) 0.240 -
456.hmmer (max) 10.000 -9.09%
456.hmmer (max) (percentage) 0.350 -7.89%
456.hmmer (unexplained diff vs previous) 11.000 -8.33%
456.hmmer (unexplained diff vs previous) (percentage) 0.350 -10.26%
458.sjeng 46.000 -2.13%
458.sjeng (avg) 46.000 -2.13%
458.sjeng (avg) (percentage) 0.650 -2.99%
458.sjeng (max) 33.000 -50.75%
458.sjeng (max) (percentage) 0.470 -51.04%
458.sjeng (unexplained diff vs previous) 11.000 -72.50%
458.sjeng (unexplained diff vs previous) (percentage) 0.160 -71.43%
459.GemsFDTD 87.000 -3.33%
459.GemsFDTD (avg) 87.000 -3.33%
459.GemsFDTD (avg) (percentage) 1.730 -3.35%
459.GemsFDTD (max) 71.000 -64.50%
459.GemsFDTD (max) (percentage) 1.420 -64.32%
459.GemsFDTD (unexplained diff vs previous) 13.000 -64.86%
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.260 -64.38%
462.libquantum 2.000 -
462.libquantum (avg) 2.000 -
462.libquantum (avg) (percentage) 2.400 -2.04%
462.libquantum (max) 4.000 -20.00%
462.libquantum (max) (percentage) 3.930 -24.57%
462.libquantum (unexplained diff vs previous) 1.000 -80.00%
462.libquantum (unexplained diff vs previous) (percentage) 0.980 -80.20%
464.h264ref 40.000 -2.44%
464.h264ref (avg) 40.000 -2.44%
464.h264ref (avg) (percentage) 0.790 -2.47%
464.h264ref (max) 56.000 -5.08%
464.h264ref (max) (percentage) 1.100 -5.17%
464.h264ref (unexplained diff vs previous) 13.000 550.00%
464.h264ref (unexplained diff vs previous) (percentage) 0.260 550.00%
465.tonto 109.000 -2.68%
465.tonto (avg) 109.000 -2.68%
465.tonto (avg) (percentage) 1.200 -1.64%
465.tonto (max) 151.000 -5.62%
465.tonto (max) (percentage) 1.660 -4.60%
465.tonto (unexplained diff vs previous) 88.000 27.54%
465.tonto (unexplained diff vs previous) (percentage) 0.960 28.00%
470.lbm 38.000 -2.56%
470.lbm (avg) 38.000 -2.56%
470.lbm (avg) (percentage) 1.150 -2.54%
470.lbm (max) 28.000 -67.06%
470.lbm (max) (percentage) 0.840 -66.93%
470.lbm (unexplained diff vs previous) 1.000 -90.91%
470.lbm (unexplained diff vs previous) (percentage) 0.030 -90.91%
471.omnetpp 42.000 -2.33%
471.omnetpp (avg) 42.000 -2.33%
471.omnetpp (avg) (percentage) 2.060 -3.29%
471.omnetpp (max) 118.000 -6.35%
471.omnetpp (max) (percentage) 5.810 -6.29%
471.omnetpp (unexplained diff vs previous) 0.000 -
471.omnetpp (unexplained diff vs previous) (percentage) 0.000 -
473.astar 95.000 -3.06%
473.astar (avg) 95.000 -3.06%
473.astar (avg) (percentage) 2.020 -1.94%
473.astar (max) 186.000 -4.62%
473.astar (max) (percentage) 3.940 -3.90%
473.astar (unexplained diff vs previous) 28.000 33.33%
473.astar (unexplained diff vs previous) (percentage) 0.590 34.09%
481.wrf (avg) (percentage) 1.520 -
481.wrf (max) (percentage) 4.870 -2.01%
482.sphinx3 16.000 -5.88%
482.sphinx3 (avg) 16.000 -5.88%
482.sphinx3 (avg) (percentage) 2.610 -2.25%
482.sphinx3 (max) 30.000 -3.23%
482.sphinx3 (max) (percentage) 4.660 -3.92%
482.sphinx3 (unexplained diff vs previous) 6.000 -
482.sphinx3 (unexplained diff vs previous) (percentage) 0.920 -
Geometric Mean 4.955 -10.51%