Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/67ff5ba9af9754261abe11d762af11532a816126 (+ 180 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--llvm-aarch64-master-Os-build/226/
Filter

llvm-aarch64-master-Os test results

Run Order Start Time Duration
Current 0226 (llvmorg-20-init-09657-g67ff5ba9af97) 2024-10-16T16:53:49 0:00:00
Previous 0225 (llvmorg-20-init-09477-g1b49ee73fc35) 2024-10-11T19:29:19 0:00:00
Baseline 0151 (llvmorg-19-init-07210-g0f5f931a9b32) 2024-04-03T14:28:02 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 45 5
Performance Improvements 81 14
Added Tests 30 153
Unchanged Tests 1020 1004
Total Tests 1176

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
403.gcc 3.64% 55.000 57.000 - -6.56% -
482.sphinx3 2.81% 782.000 804.000 - 0.75% -
462.libquantum 1.20% 83.000 84.000 - -5.62% -
445.gobmk 1.11% 4957.000 5012.000 - -1.07% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
444.namd (unexplained diff vs previous) (percentage) 520.69% 0.290 1.800 - 0.00% -
444.namd (unexplained diff vs previous) 500.00% 2.000 12.000 - 0.00% -
445.gobmk (max) 205.56% 18.000 55.000 - 0.00% -
445.gobmk (max) (percentage) 192.11% 0.380 1.110 - 0.00% -
471.omnetpp (unexplained diff vs previous) (percentage) 96.36% 0.550 1.080 - 0.00% -
471.omnetpp (unexplained diff vs previous) 92.86% 14.000 27.000 - 0.00% -
436.cactusADM (max) 71.43% 7.000 12.000 - 0.00% -
436.cactusADM (max) (percentage) 63.64% 0.110 0.180 - 0.00% -
481.wrf (max) 58.33% 36.000 57.000 - 0.00% -
482.sphinx3 (max) 57.14% 14.000 22.000 - 0.00% -
481.wrf (max) (percentage) 57.14% 0.140 0.220 - 0.00% -
445.gobmk 54.55% 11.000 17.000 - 0.00% -
445.gobmk (avg) 54.55% 11.000 17.000 - 0.00% -
435.gromacs (unexplained diff vs previous) 52.63% 19.000 29.000 - 0.00% -
482.sphinx3 (max) (percentage) 51.08% 1.860 2.810 - 0.00% -
435.gromacs (unexplained diff vs previous) (percentage) 45.45% 0.110 0.160 - 0.00% -
445.gobmk (avg) (percentage) 41.67% 0.240 0.340 - 0.00% -
453.povray 25.00% 4.000 5.000 - 0.00% -
453.povray (avg) 25.00% 4.000 5.000 - 0.00% -
482.sphinx3 (avg) (percentage) 15.38% 1.040 1.200 - 0.00% -
458.sjeng (unexplained diff vs previous) (percentage) 14.29% 0.910 1.040 - 0.00% -
458.sjeng (unexplained diff vs previous) 14.06% 64.000 73.000 - 0.00% -
458.sjeng (max) (percentage) 13.19% 0.910 1.030 - 0.00% -
458.sjeng (avg) (percentage) 12.82% 0.390 0.440 - 0.00% -
458.sjeng (max) 12.50% 64.000 72.000 - 0.00% -
482.sphinx3 12.50% 8.000 9.000 - 0.00% -
482.sphinx3 (avg) 12.50% 8.000 9.000 - 0.00% -
444.namd (avg) (percentage) 12.16% 0.740 0.830 - 0.00% -
444.namd (max) (percentage) 11.32% 1.590 1.770 - 0.00% -
458.sjeng 11.11% 27.000 30.000 - 0.00% -
458.sjeng (avg) 11.11% 27.000 30.000 - 0.00% -
416.gamess 10.26% 39.000 43.000 - 0.00% -
416.gamess (avg) 10.26% 39.000 43.000 - 0.00% -
444.namd (max) 10.00% 10.000 11.000 - 0.00% -
453.povray (avg) (percentage) 9.91% 1.110 1.220 - 0.00% -
465.tonto 7.78% 90.000 97.000 - 0.00% -
465.tonto (avg) 7.78% 90.000 97.000 - 0.00% -
465.tonto (avg) (percentage) 7.69% 0.130 0.140 - 0.00% -
416.gamess (max) 6.06% 66.000 70.000 - 0.00% -
403.gcc (avg) (percentage) 4.39% 2.960 3.090 - 0.00% -
450.soplex (unexplained diff vs previous) (percentage) 1.32% 0.760 0.770 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
453.povray -1.78% 450.000 442.000 - 0.68% -
444.namd -1.77% 678.000 666.000 - -1.77% -
471.omnetpp -1.06% 2537.000 2510.000 - -0.59% -
458.sjeng -1.03% 7070.000 6997.000 - -2.70% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
433.milc (unexplained diff vs previous) (percentage) -90.12% 0.810 0.080 - 0.00% -
433.milc (unexplained diff vs previous) -90.00% 10.000 1.000 - 0.00% -
470.lbm (unexplained diff vs previous) -83.78% 37.000 6.000 - 0.00% -
470.lbm (unexplained diff vs previous) (percentage) -83.62% 1.160 0.190 - 0.00% -
401.bzip2 (unexplained diff vs previous) -82.76% 29.000 5.000 - 0.00% -
401.bzip2 (unexplained diff vs previous) (percentage) -82.30% 1.130 0.200 - 0.00% -
462.libquantum (unexplained diff vs previous) (percentage) -67.04% 3.610 1.190 - 0.00% -
462.libquantum (unexplained diff vs previous) -66.67% 3.000 1.000 - 0.00% -
447.dealII (max) -65.00% 20.000 7.000 - 0.00% -
447.dealII (max) (percentage) -64.62% 1.300 0.460 - 0.00% -
450.soplex (max) -62.50% 8.000 3.000 - 0.00% -
450.soplex (max) (percentage) -53.66% 1.640 0.760 - 0.00% -
473.astar (max) -27.59% 29.000 21.000 - 0.00% -
473.astar (max) (percentage) -25.00% 0.560 0.420 - 0.00% -
410.bwaves (max) (percentage) -21.05% 0.190 0.150 - 0.00% -
410.bwaves (max) -20.00% 40.000 32.000 - 0.00% -
473.astar (unexplained diff vs previous) -18.52% 27.000 22.000 - 0.00% -
473.astar (unexplained diff vs previous) (percentage) -17.31% 0.520 0.430 - 0.00% -
462.libquantum (max) (percentage) -16.62% 3.490 2.910 - 0.00% -
470.lbm (max) -13.51% 37.000 32.000 - 0.00% -
470.lbm (max) (percentage) -12.82% 1.170 1.020 - 0.00% -
450.soplex -12.50% 8.000 7.000 - 0.00% -
450.soplex (avg) -12.50% 8.000 7.000 - 0.00% -
456.hmmer -12.50% 8.000 7.000 - 0.00% -
456.hmmer (avg) -12.50% 8.000 7.000 - 0.00% -
447.dealII -11.11% 9.000 8.000 - 0.00% -
447.dealII (avg) -11.11% 9.000 8.000 - 0.00% -
453.povray (max) -11.11% 9.000 8.000 - 0.00% -
433.milc (max) -10.00% 10.000 9.000 - 0.00% -
401.bzip2 -9.09% 22.000 20.000 - 0.00% -
401.bzip2 (avg) -9.09% 22.000 20.000 - 0.00% -
459.GemsFDTD -8.20% 61.000 56.000 - 0.00% -
459.GemsFDTD (avg) -8.20% 61.000 56.000 - 0.00% -
459.GemsFDTD (avg) (percentage) -7.69% 0.260 0.240 - 0.00% -
465.tonto (max) (percentage) -7.69% 0.260 0.240 - 0.00% -
456.hmmer (max) -7.69% 13.000 12.000 - 0.00% -
465.tonto (max) -7.22% 180.000 167.000 - 0.00% -
401.bzip2 (avg) (percentage) -6.98% 0.860 0.800 - 0.00% -
447.dealII (avg) (percentage) -6.56% 0.610 0.570 - 0.00% -
435.gromacs (max) (percentage) -6.38% 0.470 0.440 - 0.00% -
410.bwaves -6.25% 32.000 30.000 - 0.00% -
410.bwaves (avg) -6.25% 32.000 30.000 - 0.00% -
429.mcf (max) -6.25% 16.000 15.000 - 0.00% -
433.milc (max) (percentage) -6.10% 0.820 0.770 - 0.00% -
435.gromacs (max) -6.02% 83.000 78.000 - 0.00% -
437.leslie3d -5.61% 107.000 101.000 - 0.00% -
437.leslie3d (avg) -5.61% 107.000 101.000 - 0.00% -
433.milc (avg) (percentage) -5.56% 0.540 0.510 - 0.00% -
437.leslie3d (avg) (percentage) -5.26% 0.190 0.180 - 0.00% -
429.mcf (avg) (percentage) -4.95% 1.820 1.730 - 0.00% -
471.omnetpp (max) -4.84% 62.000 59.000 - 0.00% -
456.hmmer (max) (percentage) -4.26% 0.470 0.450 - 0.00% -
429.mcf -4.00% 25.000 24.000 - 0.00% -
429.mcf (avg) -4.00% 25.000 24.000 - 0.00% -
401.bzip2 (max) -3.85% 52.000 50.000 - 0.00% -
471.omnetpp (max) (percentage) -3.64% 2.470 2.380 - 0.00% -
459.GemsFDTD (max) (percentage) -3.57% 0.280 0.270 - 0.00% -
429.mcf (max) (percentage) -3.45% 1.160 1.120 - 0.00% -
401.bzip2 (max) (percentage) -3.43% 2.040 1.970 - 0.00% -
450.soplex (avg) (percentage) -3.25% 1.540 1.490 - 0.00% -
437.leslie3d (max) -3.23% 186.000 180.000 - 0.00% -
435.gromacs (avg) (percentage) -3.03% 0.330 0.320 - 0.00% -
437.leslie3d (max) (percentage) -3.03% 0.330 0.320 - 0.00% -
459.GemsFDTD (max) -3.03% 66.000 64.000 - 0.00% -
471.omnetpp -2.94% 34.000 33.000 - 0.00% -
471.omnetpp (avg) -2.94% 34.000 33.000 - 0.00% -
400.perlbench (max) -2.78% 36.000 35.000 - 0.00% -
473.astar -2.78% 36.000 35.000 - 0.00% -
473.astar (avg) -2.78% 36.000 35.000 - 0.00% -
403.gcc (max) (percentage) -2.62% 8.770 8.540 - 0.00% -
462.libquantum (avg) (percentage) -2.43% 2.060 2.010 - 0.00% -
470.lbm (avg) (percentage) -2.22% 0.450 0.440 - 0.00% -
453.povray (max) (percentage) -1.97% 2.030 1.990 - 0.00% -
435.gromacs -1.72% 58.000 57.000 - 0.00% -
435.gromacs (avg) -1.72% 58.000 57.000 - 0.00% -
473.astar (avg) (percentage) -1.43% 0.700 0.690 - 0.00% -
400.perlbench (max) (percentage) -1.35% 2.230 2.200 - 0.00% -

Added Tests - sample variability
403.gcc (unexplained diff vs previous)
403.gcc (unexplained diff vs previous) (percentage)
410.bwaves (unexplained diff vs previous)
410.bwaves (unexplained diff vs previous) (percentage)
416.gamess (unexplained diff vs previous)
416.gamess (unexplained diff vs previous) (percentage)
434.zeusmp (unexplained diff vs previous)
434.zeusmp (unexplained diff vs previous) (percentage)
436.cactusADM (unexplained diff vs previous)
436.cactusADM (unexplained diff vs previous) (percentage)
437.leslie3d (unexplained diff vs previous)
437.leslie3d (unexplained diff vs previous) (percentage)
445.gobmk (unexplained diff vs previous)
445.gobmk (unexplained diff vs previous) (percentage)
447.dealII (unexplained diff vs previous)
447.dealII (unexplained diff vs previous) (percentage)
453.povray (unexplained diff vs previous)
453.povray (unexplained diff vs previous) (percentage)
456.hmmer (unexplained diff vs previous)
456.hmmer (unexplained diff vs previous) (percentage)
459.GemsFDTD (unexplained diff vs previous)
459.GemsFDTD (unexplained diff vs previous) (percentage)
464.h264ref (unexplained diff vs previous)
464.h264ref (unexplained diff vs previous) (percentage)
465.tonto (unexplained diff vs previous)
465.tonto (unexplained diff vs previous) (percentage)
481.wrf (unexplained diff vs previous)
481.wrf (unexplained diff vs previous) (percentage)
482.sphinx3 (unexplained diff vs previous)
482.sphinx3 (unexplained diff vs previous) (percentage)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
459.GemsFDTD 3.13% 2149275.000 2216596.000 - 0.00% -
401.bzip2 1.64% 53812.000 54696.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
464.h264ref 4.68% 3935.000 4119.000 - -0.24% -
465.tonto 1.81% 68481.000 69720.000 - 0.22% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests -8.82% 34.000 31.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d -9.64% 1135066.000 1025625.000 - 0.00% -
410.bwaves -8.78% 670624.000 611720.000 - 0.00% -
434.zeusmp -6.51% 1365588.000 1276709.000 - 0.00% -
465.tonto -1.63% 14243435.000 14011765.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
429.mcf -25.78% 1920.000 1425.000 - 0.42% -
403.gcc -6.56% 61.000 57.000 - 3.64% -
462.libquantum -5.62% 89.000 84.000 - 1.20% -
458.sjeng -2.70% 7191.000 6997.000 - -1.03% -
444.namd -1.77% 678.000 666.000 - -1.77% -
447.dealII -1.62% 1600.000 1574.000 - -0.25% -
445.gobmk -1.07% 5066.000 5012.000 - 1.11% -
400.perlbench -1.04% 1641.000 1624.000 - -0.37% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful 12.50% 24.000 27.000 - 0.00% -
nb_execution_successful 12.50% 24.000 27.000 - 0.00% -

Added Tests - Code Size
416.gamess
435.gromacs
436.cactusADM
481.wrf

Added Tests - Execution
416.gamess
435.gromacs
436.cactusADM
481.wrf

Added Tests - sample variability
400.perlbench
400.perlbench (avg)
400.perlbench (avg) (percentage)
400.perlbench (max)
400.perlbench (max) (percentage)
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
403.gcc
403.gcc (avg)
403.gcc (avg) (percentage)
403.gcc (max)
403.gcc (max) (percentage)
410.bwaves
410.bwaves (avg)
410.bwaves (avg) (percentage)
410.bwaves (max)
410.bwaves (max) (percentage)
416.gamess
416.gamess (avg)
416.gamess (avg) (percentage)
416.gamess (max)
416.gamess (max) (percentage)
416.gamess (unexplained diff vs previous)
416.gamess (unexplained diff vs previous) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
433.milc
433.milc (avg)
433.milc (avg) (percentage)
433.milc (max)
433.milc (max) (percentage)
434.zeusmp
434.zeusmp (avg)
434.zeusmp (avg) (percentage)
434.zeusmp (max)
434.zeusmp (max) (percentage)
435.gromacs
435.gromacs (avg)
435.gromacs (avg) (percentage)
435.gromacs (max)
435.gromacs (max) (percentage)
435.gromacs (unexplained diff vs previous)
435.gromacs (unexplained diff vs previous) (percentage)
436.cactusADM
436.cactusADM (avg)
436.cactusADM (avg) (percentage)
436.cactusADM (max)
436.cactusADM (max) (percentage)
436.cactusADM (unexplained diff vs previous)
436.cactusADM (unexplained diff vs previous) (percentage)
437.leslie3d
437.leslie3d (avg)
437.leslie3d (avg) (percentage)
437.leslie3d (max)
437.leslie3d (max) (percentage)
444.namd
444.namd (avg)
444.namd (avg) (percentage)
444.namd (max)
444.namd (max) (percentage)
445.gobmk
445.gobmk (avg)
445.gobmk (avg) (percentage)
445.gobmk (max)
445.gobmk (max) (percentage)
447.dealII
447.dealII (avg)
447.dealII (avg) (percentage)
447.dealII (max)
447.dealII (max) (percentage)
450.soplex
450.soplex (avg)
450.soplex (avg) (percentage)
450.soplex (max)
450.soplex (max) (percentage)
453.povray
453.povray (avg)
453.povray (avg) (percentage)
453.povray (max)
453.povray (max) (percentage)
456.hmmer
456.hmmer (avg)
456.hmmer (avg) (percentage)
456.hmmer (max)
456.hmmer (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
459.GemsFDTD
459.GemsFDTD (avg)
459.GemsFDTD (avg) (percentage)
459.GemsFDTD (max)
459.GemsFDTD (max) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)
464.h264ref
464.h264ref (avg)
464.h264ref (avg) (percentage)
464.h264ref (max)
464.h264ref (max) (percentage)
465.tonto
465.tonto (avg)
465.tonto (avg) (percentage)
465.tonto (max)
465.tonto (max) (percentage)
470.lbm
470.lbm (avg)
470.lbm (avg) (percentage)
470.lbm (max)
470.lbm (max) (percentage)
471.omnetpp
471.omnetpp (avg)
471.omnetpp (avg) (percentage)
471.omnetpp (max)
471.omnetpp (max) (percentage)
473.astar
473.astar (avg)
473.astar (avg) (percentage)
473.astar (max)
473.astar (max) (percentage)
481.wrf
481.wrf (avg)
481.wrf (avg) (percentage)
481.wrf (max)
481.wrf (max) (percentage)
481.wrf (unexplained diff vs previous)
481.wrf (unexplained diff vs previous) (percentage)
482.sphinx3
482.sphinx3 (avg)
482.sphinx3 (avg) (percentage)
482.sphinx3 (max)
482.sphinx3 (max) (percentage)
483.xalancbmk (avg) (percentage)
483.xalancbmk (max) (percentage)


Report Time: 0.37s
Name Current %
400.perlbench 1624.000 -
401.bzip2 2561.000 -
403.gcc 57.000 3.64%
410.bwaves 21490.000 -
416.gamess 39151.000 -
429.mcf 1425.000 -
433.milc 1232.000 -
434.zeusmp 8530.000 -
435.gromacs 17833.000 -
436.cactusADM 6768.000 -
437.leslie3d 56454.000 -
444.namd 666.000 -1.77%
445.gobmk 5012.000 1.11%
447.dealII 1574.000 -
450.soplex 519.000 -
453.povray 442.000 -1.78%
456.hmmer 2837.000 -
458.sjeng 6997.000 -1.03%
459.GemsFDTD 23736.000 -
462.libquantum 84.000 1.20%
464.h264ref 4119.000 -
465.tonto 69720.000 -
470.lbm 3201.000 -
471.omnetpp 2510.000 -1.06%
473.astar 5170.000 -
481.wrf 26301.000 -
482.sphinx3 804.000 2.81%
Geometric Mean 3411.339 -
Name Current %
400.perlbench 1042398.000 -
401.bzip2 54696.000 -
403.gcc 2998684.000 -
410.bwaves 611720.000 -
416.gamess 12842095.000 -
429.mcf 11555.000 -
433.milc 103700.000 -
434.zeusmp 1276709.000 -
435.gromacs 990176.000 -
436.cactusADM 1258112.000 -
437.leslie3d 1025625.000 -
444.namd 194819.000 -
445.gobmk 1951502.000 -
447.dealII 2631133.000 -
450.soplex 305346.000 -
453.povray 772903.000 -
456.hmmer 251218.000 -
458.sjeng 124395.000 -
459.GemsFDTD 2216596.000 -
462.libquantum 35692.000 -
464.h264ref 460485.000 -
465.tonto 14011765.000 -
470.lbm 11396.000 -
471.omnetpp 633938.000 -
473.astar 34592.000 -
481.wrf 11020695.000 -
482.sphinx3 167565.000 -
Geometric Mean 491000.671 -
Name Current %
400.perlbench 38.000 -
400.perlbench (avg) 38.000 -
400.perlbench (avg) (percentage) 2.390 -
400.perlbench (max) 35.000 -2.78%
400.perlbench (max) (percentage) 2.200 -1.35%
401.bzip2 20.000 -9.09%
401.bzip2 (avg) 20.000 -9.09%
401.bzip2 (avg) (percentage) 0.800 -6.98%
401.bzip2 (max) 50.000 -3.85%
401.bzip2 (max) (percentage) 1.970 -3.43%
401.bzip2 (unexplained diff vs previous) 5.000 -82.76%
401.bzip2 (unexplained diff vs previous) (percentage) 0.200 -82.30%
403.gcc 1.000 -
403.gcc (avg) 1.000 -
403.gcc (avg) (percentage) 3.090 4.39%
403.gcc (max) 4.000 -
403.gcc (max) (percentage) 8.540 -2.62%
403.gcc (unexplained diff vs previous) 2.000 -
403.gcc (unexplained diff vs previous) (percentage) 3.510 -
410.bwaves 30.000 -6.25%
410.bwaves (avg) 30.000 -6.25%
410.bwaves (avg) (percentage) 0.140 -
410.bwaves (max) 32.000 -20.00%
410.bwaves (max) (percentage) 0.150 -21.05%
410.bwaves (unexplained diff vs previous) 7.000 -
410.bwaves (unexplained diff vs previous) (percentage) 0.030 -
416.gamess 43.000 10.26%
416.gamess (avg) 43.000 10.26%
416.gamess (avg) (percentage) 0.110 -
416.gamess (max) 70.000 6.06%
416.gamess (max) (percentage) 0.180 -
416.gamess (unexplained diff vs previous) 70.000 -
416.gamess (unexplained diff vs previous) (percentage) 0.180 -
429.mcf 24.000 -4.00%
429.mcf (avg) 24.000 -4.00%
429.mcf (avg) (percentage) 1.730 -4.95%
429.mcf (max) 15.000 -6.25%
429.mcf (max) (percentage) 1.120 -3.45%
429.mcf (unexplained diff vs previous) 6.000 -
429.mcf (unexplained diff vs previous) (percentage) 0.420 -
433.milc 6.000 -
433.milc (avg) 6.000 -
433.milc (avg) (percentage) 0.510 -5.56%
433.milc (max) 9.000 -10.00%
433.milc (max) (percentage) 0.770 -6.10%
433.milc (unexplained diff vs previous) 1.000 -90.00%
433.milc (unexplained diff vs previous) (percentage) 0.080 -90.12%
434.zeusmp 9.000 -
434.zeusmp (avg) 9.000 -
434.zeusmp (avg) (percentage) 0.110 -
434.zeusmp (max) 11.000 -
434.zeusmp (max) (percentage) 0.140 -
434.zeusmp (unexplained diff vs previous) 12.000 -
434.zeusmp (unexplained diff vs previous) (percentage) 0.140 -
435.gromacs 57.000 -1.72%
435.gromacs (avg) 57.000 -1.72%
435.gromacs (avg) (percentage) 0.320 -3.03%
435.gromacs (max) 78.000 -6.02%
435.gromacs (max) (percentage) 0.440 -6.38%
435.gromacs (unexplained diff vs previous) 29.000 52.63%
435.gromacs (unexplained diff vs previous) (percentage) 0.160 45.45%
436.cactusADM 8.000 -
436.cactusADM (avg) 8.000 -
436.cactusADM (avg) (percentage) 0.130 -
436.cactusADM (max) 12.000 71.43%
436.cactusADM (max) (percentage) 0.180 63.64%
436.cactusADM (unexplained diff vs previous) 12.000 -
436.cactusADM (unexplained diff vs previous) (percentage) 0.180 -
437.leslie3d 101.000 -5.61%
437.leslie3d (avg) 101.000 -5.61%
437.leslie3d (avg) (percentage) 0.180 -5.26%
437.leslie3d (max) 180.000 -3.23%
437.leslie3d (max) (percentage) 0.320 -3.03%
437.leslie3d (unexplained diff vs previous) 46.000 -
437.leslie3d (unexplained diff vs previous) (percentage) 0.080 -
444.namd 5.000 -
444.namd (avg) 5.000 -
444.namd (avg) (percentage) 0.830 12.16%
444.namd (max) 11.000 10.00%
444.namd (max) (percentage) 1.770 11.32%
444.namd (unexplained diff vs previous) 12.000 500.00%
444.namd (unexplained diff vs previous) (percentage) 1.800 520.69%
445.gobmk 17.000 54.55%
445.gobmk (avg) 17.000 54.55%
445.gobmk (avg) (percentage) 0.340 41.67%
445.gobmk (max) 55.000 205.56%
445.gobmk (max) (percentage) 1.110 192.11%
445.gobmk (unexplained diff vs previous) 55.000 -
445.gobmk (unexplained diff vs previous) (percentage) 1.100 -
447.dealII 8.000 -11.11%
447.dealII (avg) 8.000 -11.11%
447.dealII (avg) (percentage) 0.570 -6.56%
447.dealII (max) 7.000 -65.00%
447.dealII (max) (percentage) 0.460 -64.62%
447.dealII (unexplained diff vs previous) 4.000 -
447.dealII (unexplained diff vs previous) (percentage) 0.250 -
450.soplex 7.000 -12.50%
450.soplex (avg) 7.000 -12.50%
450.soplex (avg) (percentage) 1.490 -3.25%
450.soplex (max) 3.000 -62.50%
450.soplex (max) (percentage) 0.760 -53.66%
450.soplex (unexplained diff vs previous) 4.000 -
450.soplex (unexplained diff vs previous) (percentage) 0.770 1.32%
453.povray 5.000 25.00%
453.povray (avg) 5.000 25.00%
453.povray (avg) (percentage) 1.220 9.91%
453.povray (max) 8.000 -11.11%
453.povray (max) (percentage) 1.990 -1.97%
453.povray (unexplained diff vs previous) 8.000 -
453.povray (unexplained diff vs previous) (percentage) 1.810 -
456.hmmer 7.000 -12.50%
456.hmmer (avg) 7.000 -12.50%
456.hmmer (avg) (percentage) 0.280 -
456.hmmer (max) 12.000 -7.69%
456.hmmer (max) (percentage) 0.450 -4.26%
456.hmmer (unexplained diff vs previous) 5.000 -
456.hmmer (unexplained diff vs previous) (percentage) 0.180 -
458.sjeng 30.000 11.11%
458.sjeng (avg) 30.000 11.11%
458.sjeng (avg) (percentage) 0.440 12.82%
458.sjeng (max) 72.000 12.50%
458.sjeng (max) (percentage) 1.030 13.19%
458.sjeng (unexplained diff vs previous) 73.000 14.06%
458.sjeng (unexplained diff vs previous) (percentage) 1.040 14.29%
459.GemsFDTD 56.000 -8.20%
459.GemsFDTD (avg) 56.000 -8.20%
459.GemsFDTD (avg) (percentage) 0.240 -7.69%
459.GemsFDTD (max) 64.000 -3.03%
459.GemsFDTD (max) (percentage) 0.270 -3.57%
459.GemsFDTD (unexplained diff vs previous) 24.000 -
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.100 -
462.libquantum 1.000 -
462.libquantum (avg) 1.000 -
462.libquantum (avg) (percentage) 2.010 -2.43%
462.libquantum (max) 2.000 -
462.libquantum (max) (percentage) 2.910 -16.62%
462.libquantum (unexplained diff vs previous) 1.000 -66.67%
462.libquantum (unexplained diff vs previous) (percentage) 1.190 -67.04%
464.h264ref 11.000 -
464.h264ref (avg) 11.000 -
464.h264ref (avg) (percentage) 0.270 -
464.h264ref (max) 21.000 -
464.h264ref (max) (percentage) 0.530 -
464.h264ref (unexplained diff vs previous) 10.000 -
464.h264ref (unexplained diff vs previous) (percentage) 0.240 -
465.tonto 97.000 7.78%
465.tonto (avg) 97.000 7.78%
465.tonto (avg) (percentage) 0.140 7.69%
465.tonto (max) 167.000 -7.22%
465.tonto (max) (percentage) 0.240 -7.69%
465.tonto (unexplained diff vs previous) 151.000 -
465.tonto (unexplained diff vs previous) (percentage) 0.220 -
470.lbm 14.000 -
470.lbm (avg) 14.000 -
470.lbm (avg) (percentage) 0.440 -2.22%
470.lbm (max) 32.000 -13.51%
470.lbm (max) (percentage) 1.020 -12.82%
470.lbm (unexplained diff vs previous) 6.000 -83.78%
470.lbm (unexplained diff vs previous) (percentage) 0.190 -83.62%
471.omnetpp 33.000 -2.94%
471.omnetpp (avg) 33.000 -2.94%
471.omnetpp (avg) (percentage) 1.350 -
471.omnetpp (max) 59.000 -4.84%
471.omnetpp (max) (percentage) 2.380 -3.64%
471.omnetpp (unexplained diff vs previous) 27.000 92.86%
471.omnetpp (unexplained diff vs previous) (percentage) 1.080 96.36%
473.astar 35.000 -2.78%
473.astar (avg) 35.000 -2.78%
473.astar (avg) (percentage) 0.690 -1.43%
473.astar (max) 21.000 -27.59%
473.astar (max) (percentage) 0.420 -25.00%
473.astar (unexplained diff vs previous) 22.000 -18.52%
473.astar (unexplained diff vs previous) (percentage) 0.430 -17.31%
481.wrf 39.000 -
481.wrf (avg) 39.000 -
481.wrf (avg) (percentage) 0.150 -
481.wrf (max) 57.000 58.33%
481.wrf (max) (percentage) 0.220 57.14%
481.wrf (unexplained diff vs previous) 57.000 -
481.wrf (unexplained diff vs previous) (percentage) 0.220 -
482.sphinx3 9.000 12.50%
482.sphinx3 (avg) 9.000 12.50%
482.sphinx3 (avg) (percentage) 1.200 15.38%
482.sphinx3 (max) 22.000 57.14%
482.sphinx3 (max) (percentage) 2.810 51.08%
482.sphinx3 (unexplained diff vs previous) 22.000 -
482.sphinx3 (unexplained diff vs previous) (percentage) 2.740 -
483.xalancbmk (avg) (percentage) 1.100 -
483.xalancbmk (max) (percentage) 1.120 -
Geometric Mean 3.606 -13.35%