Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/6f0e9c4a5611d21cbcac4bb4f16dc90674838e1e (+ 2 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--llvm-aarch64-master-Os-build/251/
Filter

llvm-aarch64-master-Os test results

Run Order Start Time Duration
Current 0251 (llvmorg-20-init-15834-g6f0e9c4a5611) 2024-12-17T09:06:10 0:00:00
Previous 0249 (llvmorg-20-init-15832-gfbc18b85d6ce) 2024-12-16T03:10:06 0:00:00
Baseline 0151 (llvmorg-19-init-07210-g0f5f931a9b32) 2024-04-03T14:28:02 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 97 6
Performance Improvements 62 21
Added Tests 7 150
Unchanged Tests 998 987
Total Tests 1164

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
450.soplex 7.68% 482.000 519.000 - -0.76% -
462.libquantum 6.02% 83.000 88.000 - -1.12% -
400.perlbench 5.30% 1624.000 1710.000 - 4.20% -
453.povray 2.50% 440.000 451.000 - 2.73% -
433.milc 2.26% 1193.000 1220.000 - -1.69% -
471.omnetpp 2.13% 2484.000 2537.000 - 0.48% -
482.sphinx3 1.83% 767.000 781.000 - -2.13% -
444.namd 1.66% 664.000 675.000 - -0.44% -
473.astar 1.49% 5046.000 5121.000 - -1.35% -
458.sjeng 1.32% 6963.000 7055.000 - -1.89% -
447.dealII 1.22% 1561.000 1580.000 - -1.25% -
464.h264ref 1.13% 4060.000 4106.000 - 4.35% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
437.leslie3d (unexplained diff vs previous) 308.97% 78.000 319.000 - 0.00% -
437.leslie3d (unexplained diff vs previous) (percentage) 300.00% 0.180 0.720 - 0.00% -
462.libquantum (max) 150.00% 2.000 5.000 - 0.00% -
462.libquantum (unexplained diff vs previous) 150.00% 2.000 5.000 - 0.00% -
447.dealII (max) 137.50% 8.000 19.000 - 0.00% -
462.libquantum (unexplained diff vs previous) (percentage) 135.68% 2.410 5.680 - 0.00% -
453.povray (max) 120.00% 5.000 11.000 - 0.00% -
447.dealII (max) (percentage) 117.86% 0.560 1.220 - 0.00% -
458.sjeng (max) 102.17% 46.000 93.000 - 0.00% -
458.sjeng (max) (percentage) 97.01% 0.670 1.320 - 0.00% -
458.sjeng (unexplained diff vs previous) 95.74% 47.000 92.000 - 0.00% -
458.sjeng (unexplained diff vs previous) (percentage) 94.03% 0.670 1.300 - 0.00% -
453.povray (max) (percentage) 85.19% 1.350 2.500 - 0.00% -
462.libquantum (max) (percentage) 68.63% 3.570 6.020 - 0.00% -
444.namd (max) 57.14% 7.000 11.000 - 0.00% -
481.wrf (max) 51.52% 33.000 50.000 - 0.00% -
481.wrf (unexplained diff vs previous) 50.00% 34.000 51.000 - 0.00% -
481.wrf (max) (percentage) 50.00% 0.140 0.210 - 0.00% -
481.wrf (unexplained diff vs previous) (percentage) 50.00% 0.140 0.210 - 0.00% -
444.namd (max) (percentage) 48.21% 1.120 1.660 - 0.00% -
456.hmmer (max) 31.58% 19.000 25.000 - 0.00% -
456.hmmer (unexplained diff vs previous) 31.58% 19.000 25.000 - 0.00% -
456.hmmer (unexplained diff vs previous) (percentage) 29.41% 0.680 0.880 - 0.00% -
435.gromacs (max) 27.00% 100.000 127.000 - 0.00% -
435.gromacs (max) (percentage) 25.86% 0.580 0.730 - 0.00% -
456.hmmer (max) (percentage) 25.35% 0.710 0.890 - 0.00% -
444.namd 25.00% 4.000 5.000 - 0.00% -
444.namd (avg) 25.00% 4.000 5.000 - 0.00% -
435.gromacs (unexplained diff vs previous) 24.75% 101.000 126.000 - 0.00% -
435.gromacs (unexplained diff vs previous) (percentage) 24.14% 0.580 0.720 - 0.00% -
450.soplex (max) 21.88% 32.000 39.000 - 0.00% -
429.mcf (avg) (percentage) 20.55% 2.530 3.050 - 0.00% -
429.mcf (unexplained diff vs previous) (percentage) 20.12% 15.210 18.270 - 0.00% -
453.povray 20.00% 5.000 6.000 - 0.00% -
453.povray (avg) 20.00% 5.000 6.000 - 0.00% -
450.soplex 15.38% 13.000 15.000 - 0.00% -
450.soplex (avg) 15.38% 13.000 15.000 - 0.00% -
433.milc 14.29% 7.000 8.000 - 0.00% -
433.milc (avg) 14.29% 7.000 8.000 - 0.00% -
450.soplex (max) (percentage) 13.44% 6.770 7.680 - 0.00% -
456.hmmer 11.11% 9.000 10.000 - 0.00% -
456.hmmer (avg) 11.11% 9.000 10.000 - 0.00% -
464.h264ref 11.11% 18.000 20.000 - 0.00% -
464.h264ref (avg) 11.11% 18.000 20.000 - 0.00% -
464.h264ref (avg) (percentage) 11.11% 0.450 0.500 - 0.00% -
433.milc (avg) (percentage) 9.68% 0.620 0.680 - 0.00% -
458.sjeng 8.82% 34.000 37.000 - 0.00% -
458.sjeng (avg) 8.82% 34.000 37.000 - 0.00% -
400.perlbench 8.33% 24.000 26.000 - 0.00% -
400.perlbench (avg) 8.33% 24.000 26.000 - 0.00% -
437.leslie3d 8.20% 122.000 132.000 - 0.00% -
437.leslie3d (avg) 8.20% 122.000 132.000 - 0.00% -
458.sjeng (avg) (percentage) 8.16% 0.490 0.530 - 0.00% -
450.soplex (avg) (percentage) 7.72% 2.720 2.930 - 0.00% -
453.povray (avg) (percentage) 7.46% 1.340 1.440 - 0.00% -
437.leslie3d (avg) (percentage) 7.14% 0.280 0.300 - 0.00% -
444.namd (avg) (percentage) 6.76% 0.740 0.790 - 0.00% -
447.dealII 6.67% 15.000 16.000 - 0.00% -
447.dealII (avg) 6.67% 15.000 16.000 - 0.00% -
481.wrf 6.06% 33.000 35.000 - 0.00% -
481.wrf (avg) 6.06% 33.000 35.000 - 0.00% -
470.lbm 5.88% 17.000 18.000 - 0.00% -
470.lbm (avg) 5.88% 17.000 18.000 - 0.00% -
456.hmmer (avg) (percentage) 5.71% 0.350 0.370 - 0.00% -
450.soplex (unexplained diff vs previous) 5.71% 35.000 37.000 - 0.00% -
473.astar 5.41% 37.000 39.000 - 0.00% -
473.astar (avg) 5.41% 37.000 39.000 - 0.00% -
400.perlbench (max) 5.26% 38.000 40.000 - 0.00% -
462.libquantum (avg) (percentage) 4.65% 2.580 2.700 - 0.00% -
473.astar (avg) (percentage) 4.00% 0.750 0.780 - 0.00% -
459.GemsFDTD 4.00% 75.000 78.000 - 0.00% -
459.GemsFDTD (avg) 4.00% 75.000 78.000 - 0.00% -
435.gromacs 2.78% 72.000 74.000 - 0.00% -
435.gromacs (avg) 2.78% 72.000 74.000 - 0.00% -
459.GemsFDTD (avg) (percentage) 2.70% 0.370 0.380 - 0.00% -
471.omnetpp 2.70% 37.000 38.000 - 0.00% -
471.omnetpp (avg) 2.70% 37.000 38.000 - 0.00% -
435.gromacs (avg) (percentage) 2.38% 0.420 0.430 - 0.00% -
429.mcf 2.38% 42.000 43.000 - 0.00% -
429.mcf (avg) 2.38% 42.000 43.000 - 0.00% -
447.dealII (avg) (percentage) 1.98% 1.010 1.030 - 0.00% -
429.mcf (unexplained diff vs previous) 1.57% 254.000 258.000 - 0.00% -
471.omnetpp (avg) (percentage) 1.33% 1.500 1.520 - 0.00% -
465.tonto 1.04% 96.000 97.000 - 0.00% -
465.tonto (avg) 1.04% 96.000 97.000 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
429.mcf -15.45% 1670.000 1412.000 - -26.46% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
401.bzip2 (unexplained diff vs previous) -78.57% 14.000 3.000 - 0.00% -
401.bzip2 (unexplained diff vs previous) (percentage) -78.57% 0.560 0.120 - 0.00% -
434.zeusmp (unexplained diff vs previous) -69.70% 33.000 10.000 - 0.00% -
434.zeusmp (unexplained diff vs previous) (percentage) -69.23% 0.390 0.120 - 0.00% -
471.omnetpp (unexplained diff vs previous) (percentage) -54.47% 4.590 2.090 - 0.00% -
471.omnetpp (unexplained diff vs previous) -53.51% 114.000 53.000 - 0.00% -
410.bwaves (unexplained diff vs previous) (percentage) -50.00% 0.160 0.080 - 0.00% -
401.bzip2 (max) -47.62% 21.000 11.000 - 0.00% -
410.bwaves (unexplained diff vs previous) -46.88% 32.000 17.000 - 0.00% -
401.bzip2 (max) (percentage) -44.05% 0.840 0.470 - 0.00% -
473.astar (unexplained diff vs previous) (percentage) -32.41% 2.160 1.460 - 0.00% -
473.astar (unexplained diff vs previous) -31.19% 109.000 75.000 - 0.00% -
429.mcf (max) -27.09% 299.000 218.000 - 0.00% -
416.gamess (unexplained diff vs previous) (percentage) -25.00% 0.120 0.090 - 0.00% -
416.gamess (unexplained diff vs previous) -23.91% 46.000 35.000 - 0.00% -
470.lbm (unexplained diff vs previous) (percentage) -20.97% 1.240 0.980 - 0.00% -
470.lbm (unexplained diff vs previous) -20.51% 39.000 31.000 - 0.00% -
470.lbm (max) (percentage) -19.51% 1.230 0.990 - 0.00% -
464.h264ref (unexplained diff vs previous) (percentage) -18.84% 1.380 1.120 - 0.00% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -18.57% 0.700 0.570 - 0.00% -
470.lbm (max) -18.42% 38.000 31.000 - 0.00% -
436.cactusADM (max) -18.18% 11.000 9.000 - 0.00% -
459.GemsFDTD (unexplained diff vs previous) -18.06% 144.000 118.000 - 0.00% -
464.h264ref (unexplained diff vs previous) -17.86% 56.000 46.000 - 0.00% -
436.cactusADM (max) (percentage) -17.65% 0.170 0.140 - 0.00% -
459.GemsFDTD (max) (percentage) -17.14% 0.700 0.580 - 0.00% -
459.GemsFDTD (max) -16.78% 143.000 119.000 - 0.00% -
471.omnetpp (max) (percentage) -16.63% 4.390 3.660 - 0.00% -
471.omnetpp (max) -15.60% 109.000 92.000 - 0.00% -
429.mcf (max) (percentage) -13.88% 17.940 15.450 - 0.00% -
434.zeusmp (max) (percentage) -12.82% 0.390 0.340 - 0.00% -
410.bwaves (max) -12.50% 32.000 28.000 - 0.00% -
434.zeusmp (max) -12.50% 32.000 28.000 - 0.00% -
410.bwaves (max) (percentage) -12.50% 0.160 0.140 - 0.00% -
436.cactusADM (unexplained diff vs previous) -10.00% 10.000 9.000 - 0.00% -
473.astar (max) (percentage) -9.95% 2.110 1.900 - 0.00% -
433.milc (unexplained diff vs previous) (percentage) -9.05% 2.430 2.210 - 0.00% -
473.astar (max) -8.49% 106.000 97.000 - 0.00% -
434.zeusmp -8.33% 12.000 11.000 - 0.00% -
434.zeusmp (avg) -8.33% 12.000 11.000 - 0.00% -
416.gamess -7.32% 41.000 38.000 - 0.00% -
416.gamess (avg) -7.32% 41.000 38.000 - 0.00% -
433.milc (unexplained diff vs previous) -6.90% 29.000 27.000 - 0.00% -
410.bwaves (avg) (percentage) -6.25% 0.160 0.150 - 0.00% -
410.bwaves -6.25% 32.000 30.000 - 0.00% -
410.bwaves (avg) -6.25% 32.000 30.000 - 0.00% -
464.h264ref (max) (percentage) -5.88% 1.360 1.280 - 0.00% -
464.h264ref (max) -5.45% 55.000 52.000 - 0.00% -
437.leslie3d (max) (percentage) -5.19% 0.770 0.730 - 0.00% -
401.bzip2 -4.76% 21.000 20.000 - 0.00% -
401.bzip2 (avg) -4.76% 21.000 20.000 - 0.00% -
433.milc (max) (percentage) -4.64% 2.370 2.260 - 0.00% -
482.sphinx3 (max) (percentage) -4.55% 2.860 2.730 - 0.00% -
437.leslie3d (max) -4.45% 337.000 322.000 - 0.00% -
416.gamess (max) -4.40% 91.000 87.000 - 0.00% -
433.milc (max) -3.57% 28.000 27.000 - 0.00% -
401.bzip2 (avg) (percentage) -3.53% 0.850 0.820 - 0.00% -
482.sphinx3 (unexplained diff vs previous) (percentage) -2.19% 1.830 1.790 - 0.00% -
450.soplex (unexplained diff vs previous) (percentage) -1.79% 7.260 7.130 - 0.00% -
445.gobmk (max) (percentage) -1.52% 1.320 1.300 - 0.00% -
403.gcc (max) (percentage) -1.17% 6.830 6.750 - 0.00% -

Added Tests - sample variability
445.gobmk
445.gobmk (avg)
445.gobmk (max)
447.dealII (unexplained diff vs previous)
447.dealII (unexplained diff vs previous) (percentage)
453.povray (unexplained diff vs previous)
453.povray (unexplained diff vs previous) (percentage)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
444.namd 1.60% 193170.000 196263.000 - 0.00% -
401.bzip2 1.23% 53812.000 54476.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
464.h264ref 4.35% 3935.000 4106.000 - 1.13% -
400.perlbench 4.20% 1641.000 1710.000 - 5.30% -
453.povray 2.73% 439.000 451.000 - 2.50% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests -8.82% 34.000 31.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d -18.13% 1135066.000 929225.000 - 0.00% -
465.tonto -17.52% 14243435.000 11747473.000 - 0.00% -
410.bwaves -9.38% 670624.000 607752.000 - 0.00% -
434.zeusmp -7.07% 1365588.000 1269021.000 - 0.00% -
459.GemsFDTD -3.60% 2149275.000 2071836.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
445.gobmk -99.96% 5066.000 2.000 - 0.00% -
429.mcf -26.46% 1920.000 1412.000 - -15.45% -
437.leslie3d -22.31% 56799.000 44126.000 - 0.73% -
459.GemsFDTD -13.01% 23686.000 20605.000 - 0.58% -
465.tonto -5.47% 68481.000 64733.000 - 0.15% -
410.bwaves -4.23% 21502.000 20592.000 - 0.08% -
482.sphinx3 -2.13% 798.000 781.000 - 1.83% -
401.bzip2 -2.03% 2563.000 2511.000 - -0.12% -
458.sjeng -1.89% 7191.000 7055.000 - 1.32% -
433.milc -1.69% 1241.000 1220.000 - 2.26% -
473.astar -1.35% 5191.000 5121.000 - 1.49% -
447.dealII -1.25% 1600.000 1580.000 - 1.22% -
462.libquantum -1.12% 89.000 88.000 - 6.02% -
434.zeusmp -1.03% 8532.000 8444.000 - 0.12% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful 12.50% 24.000 27.000 - 0.00% -
nb_execution_successful 4.17% 24.000 25.000 - 0.00% -

Added Tests - Code Size
416.gamess
435.gromacs
436.cactusADM
481.wrf

Added Tests - Execution
416.gamess
435.gromacs
436.cactusADM
481.wrf

Added Tests - sample variability
400.perlbench
400.perlbench (avg)
400.perlbench (avg) (percentage)
400.perlbench (max)
400.perlbench (max) (percentage)
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
403.gcc (avg) (percentage)
403.gcc (max) (percentage)
410.bwaves
410.bwaves (avg)
410.bwaves (avg) (percentage)
410.bwaves (max)
410.bwaves (max) (percentage)
416.gamess
416.gamess (avg)
416.gamess (avg) (percentage)
416.gamess (max)
416.gamess (max) (percentage)
416.gamess (unexplained diff vs previous)
416.gamess (unexplained diff vs previous) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
433.milc
433.milc (avg)
433.milc (avg) (percentage)
433.milc (max)
433.milc (max) (percentage)
434.zeusmp
434.zeusmp (avg)
434.zeusmp (avg) (percentage)
434.zeusmp (max)
434.zeusmp (max) (percentage)
435.gromacs
435.gromacs (avg)
435.gromacs (avg) (percentage)
435.gromacs (max)
435.gromacs (max) (percentage)
435.gromacs (unexplained diff vs previous)
435.gromacs (unexplained diff vs previous) (percentage)
436.cactusADM
436.cactusADM (avg)
436.cactusADM (avg) (percentage)
436.cactusADM (max)
436.cactusADM (max) (percentage)
436.cactusADM (unexplained diff vs previous)
436.cactusADM (unexplained diff vs previous) (percentage)
437.leslie3d
437.leslie3d (avg)
437.leslie3d (avg) (percentage)
437.leslie3d (max)
437.leslie3d (max) (percentage)
444.namd
444.namd (avg)
444.namd (avg) (percentage)
444.namd (max)
444.namd (max) (percentage)
445.gobmk
445.gobmk (avg)
445.gobmk (avg) (percentage)
445.gobmk (max)
445.gobmk (max) (percentage)
447.dealII
447.dealII (avg)
447.dealII (avg) (percentage)
447.dealII (max)
447.dealII (max) (percentage)
450.soplex
450.soplex (avg)
450.soplex (avg) (percentage)
450.soplex (max)
450.soplex (max) (percentage)
453.povray
453.povray (avg)
453.povray (avg) (percentage)
453.povray (max)
453.povray (max) (percentage)
456.hmmer
456.hmmer (avg)
456.hmmer (avg) (percentage)
456.hmmer (max)
456.hmmer (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
459.GemsFDTD
459.GemsFDTD (avg)
459.GemsFDTD (avg) (percentage)
459.GemsFDTD (max)
459.GemsFDTD (max) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)
464.h264ref
464.h264ref (avg)
464.h264ref (avg) (percentage)
464.h264ref (max)
464.h264ref (max) (percentage)
465.tonto
465.tonto (avg)
465.tonto (avg) (percentage)
465.tonto (max)
465.tonto (max) (percentage)
470.lbm
470.lbm (avg)
470.lbm (avg) (percentage)
470.lbm (max)
470.lbm (max) (percentage)
471.omnetpp
471.omnetpp (avg)
471.omnetpp (avg) (percentage)
471.omnetpp (max)
471.omnetpp (max) (percentage)
473.astar
473.astar (avg)
473.astar (avg) (percentage)
473.astar (max)
473.astar (max) (percentage)
481.wrf
481.wrf (avg)
481.wrf (avg) (percentage)
481.wrf (max)
481.wrf (max) (percentage)
481.wrf (unexplained diff vs previous)
481.wrf (unexplained diff vs previous) (percentage)
482.sphinx3
482.sphinx3 (avg)
482.sphinx3 (avg) (percentage)
482.sphinx3 (max)
482.sphinx3 (max) (percentage)
483.xalancbmk (avg) (percentage)
483.xalancbmk (max) (percentage)


Report Time: 0.37s
Name Current %
400.perlbench 1710.000 5.30%
401.bzip2 2511.000 -
410.bwaves 20592.000 -
416.gamess 38071.000 -
429.mcf 1412.000 -15.45%
433.milc 1220.000 2.26%
434.zeusmp 8444.000 -
435.gromacs 17398.000 -
436.cactusADM 6647.000 -
437.leslie3d 44126.000 -
444.namd 675.000 1.66%
445.gobmk 2.000 -
447.dealII 1580.000 1.22%
450.soplex 519.000 7.68%
453.povray 451.000 2.50%
456.hmmer 2834.000 -
458.sjeng 7055.000 1.32%
459.GemsFDTD 20605.000 -
462.libquantum 88.000 6.02%
464.h264ref 4106.000 1.13%
465.tonto 64733.000 -
470.lbm 3171.000 -
471.omnetpp 2537.000 2.13%
473.astar 5121.000 1.49%
481.wrf 23967.000 -
482.sphinx3 781.000 1.83%
Geometric Mean 2885.842 -
Name Current %
400.perlbench 1039126.000 -
401.bzip2 54476.000 -
410.bwaves 607752.000 -
416.gamess 12743527.000 -
429.mcf 11531.000 -
433.milc 103668.000 -
434.zeusmp 1269021.000 -
435.gromacs 978332.000 -
436.cactusADM 1239744.000 -
437.leslie3d 929225.000 -
444.namd 196263.000 -
447.dealII 2628381.000 -
450.soplex 305206.000 -
453.povray 772607.000 -
456.hmmer 250786.000 -
458.sjeng 124327.000 -
459.GemsFDTD 2071836.000 -
462.libquantum 35820.000 -
464.h264ref 460361.000 -
465.tonto 11747473.000 -
470.lbm 11388.000 -
471.omnetpp 633758.000 -
473.astar 34576.000 -
481.wrf 9389255.000 -
482.sphinx3 167121.000 -
Geometric Mean 422672.044 -
Name Current %
400.perlbench 26.000 8.33%
400.perlbench (avg) 26.000 8.33%
400.perlbench (avg) (percentage) 1.530 -
400.perlbench (max) 40.000 5.26%
400.perlbench (max) (percentage) 2.350 -
401.bzip2 20.000 -4.76%
401.bzip2 (avg) 20.000 -4.76%
401.bzip2 (avg) (percentage) 0.820 -3.53%
401.bzip2 (max) 11.000 -47.62%
401.bzip2 (max) (percentage) 0.470 -44.05%
401.bzip2 (unexplained diff vs previous) 3.000 -78.57%
401.bzip2 (unexplained diff vs previous) (percentage) 0.120 -78.57%
403.gcc (avg) (percentage) 3.370 -
403.gcc (max) (percentage) 6.750 -1.17%
410.bwaves 30.000 -6.25%
410.bwaves (avg) 30.000 -6.25%
410.bwaves (avg) (percentage) 0.150 -6.25%
410.bwaves (max) 28.000 -12.50%
410.bwaves (max) (percentage) 0.140 -12.50%
410.bwaves (unexplained diff vs previous) 17.000 -46.88%
410.bwaves (unexplained diff vs previous) (percentage) 0.080 -50.00%
416.gamess 38.000 -7.32%
416.gamess (avg) 38.000 -7.32%
416.gamess (avg) (percentage) 0.100 -
416.gamess (max) 87.000 -4.40%
416.gamess (max) (percentage) 0.230 -
416.gamess (unexplained diff vs previous) 35.000 -23.91%
416.gamess (unexplained diff vs previous) (percentage) 0.090 -25.00%
429.mcf 43.000 2.38%
429.mcf (avg) 43.000 2.38%
429.mcf (avg) (percentage) 3.050 20.55%
429.mcf (max) 218.000 -27.09%
429.mcf (max) (percentage) 15.450 -13.88%
429.mcf (unexplained diff vs previous) 258.000 1.57%
429.mcf (unexplained diff vs previous) (percentage) 18.270 20.12%
433.milc 8.000 14.29%
433.milc (avg) 8.000 14.29%
433.milc (avg) (percentage) 0.680 9.68%
433.milc (max) 27.000 -3.57%
433.milc (max) (percentage) 2.260 -4.64%
433.milc (unexplained diff vs previous) 27.000 -6.90%
433.milc (unexplained diff vs previous) (percentage) 2.210 -9.05%
434.zeusmp 11.000 -8.33%
434.zeusmp (avg) 11.000 -8.33%
434.zeusmp (avg) (percentage) 0.140 -
434.zeusmp (max) 28.000 -12.50%
434.zeusmp (max) (percentage) 0.340 -12.82%
434.zeusmp (unexplained diff vs previous) 10.000 -69.70%
434.zeusmp (unexplained diff vs previous) (percentage) 0.120 -69.23%
435.gromacs 74.000 2.78%
435.gromacs (avg) 74.000 2.78%
435.gromacs (avg) (percentage) 0.430 2.38%
435.gromacs (max) 127.000 27.00%
435.gromacs (max) (percentage) 0.730 25.86%
435.gromacs (unexplained diff vs previous) 126.000 24.75%
435.gromacs (unexplained diff vs previous) (percentage) 0.720 24.14%
436.cactusADM 9.000 -
436.cactusADM (avg) 9.000 -
436.cactusADM (avg) (percentage) 0.150 -
436.cactusADM (max) 9.000 -18.18%
436.cactusADM (max) (percentage) 0.140 -17.65%
436.cactusADM (unexplained diff vs previous) 9.000 -10.00%
436.cactusADM (unexplained diff vs previous) (percentage) 0.140 -
437.leslie3d 132.000 8.20%
437.leslie3d (avg) 132.000 8.20%
437.leslie3d (avg) (percentage) 0.300 7.14%
437.leslie3d (max) 322.000 -4.45%
437.leslie3d (max) (percentage) 0.730 -5.19%
437.leslie3d (unexplained diff vs previous) 319.000 308.97%
437.leslie3d (unexplained diff vs previous) (percentage) 0.720 300.00%
444.namd 5.000 25.00%
444.namd (avg) 5.000 25.00%
444.namd (avg) (percentage) 0.790 6.76%
444.namd (max) 11.000 57.14%
444.namd (max) (percentage) 1.660 48.21%
444.namd (unexplained diff vs previous) 11.000 -
444.namd (unexplained diff vs previous) (percentage) 1.630 -
445.gobmk 0.000 -
445.gobmk (avg) 0.000 -
445.gobmk (avg) (percentage) 0.490 -
445.gobmk (max) 0.000 -
445.gobmk (max) (percentage) 1.300 -1.52%
447.dealII 16.000 6.67%
447.dealII (avg) 16.000 6.67%
447.dealII (avg) (percentage) 1.030 1.98%
447.dealII (max) 19.000 137.50%
447.dealII (max) (percentage) 1.220 117.86%
447.dealII (unexplained diff vs previous) 19.000 -
447.dealII (unexplained diff vs previous) (percentage) 1.200 -
450.soplex 15.000 15.38%
450.soplex (avg) 15.000 15.38%
450.soplex (avg) (percentage) 2.930 7.72%
450.soplex (max) 39.000 21.88%
450.soplex (max) (percentage) 7.680 13.44%
450.soplex (unexplained diff vs previous) 37.000 5.71%
450.soplex (unexplained diff vs previous) (percentage) 7.130 -1.79%
453.povray 6.000 20.00%
453.povray (avg) 6.000 20.00%
453.povray (avg) (percentage) 1.440 7.46%
453.povray (max) 11.000 120.00%
453.povray (max) (percentage) 2.500 85.19%
453.povray (unexplained diff vs previous) 11.000 -
453.povray (unexplained diff vs previous) (percentage) 2.440 -
456.hmmer 10.000 11.11%
456.hmmer (avg) 10.000 11.11%
456.hmmer (avg) (percentage) 0.370 5.71%
456.hmmer (max) 25.000 31.58%
456.hmmer (max) (percentage) 0.890 25.35%
456.hmmer (unexplained diff vs previous) 25.000 31.58%
456.hmmer (unexplained diff vs previous) (percentage) 0.880 29.41%
458.sjeng 37.000 8.82%
458.sjeng (avg) 37.000 8.82%
458.sjeng (avg) (percentage) 0.530 8.16%
458.sjeng (max) 93.000 102.17%
458.sjeng (max) (percentage) 1.320 97.01%
458.sjeng (unexplained diff vs previous) 92.000 95.74%
458.sjeng (unexplained diff vs previous) (percentage) 1.300 94.03%
459.GemsFDTD 78.000 4.00%
459.GemsFDTD (avg) 78.000 4.00%
459.GemsFDTD (avg) (percentage) 0.380 2.70%
459.GemsFDTD (max) 119.000 -16.78%
459.GemsFDTD (max) (percentage) 0.580 -17.14%
459.GemsFDTD (unexplained diff vs previous) 118.000 -18.06%
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.570 -18.57%
462.libquantum 2.000 -
462.libquantum (avg) 2.000 -
462.libquantum (avg) (percentage) 2.700 4.65%
462.libquantum (max) 5.000 150.00%
462.libquantum (max) (percentage) 6.020 68.63%
462.libquantum (unexplained diff vs previous) 5.000 150.00%
462.libquantum (unexplained diff vs previous) (percentage) 5.680 135.68%
464.h264ref 20.000 11.11%
464.h264ref (avg) 20.000 11.11%
464.h264ref (avg) (percentage) 0.500 11.11%
464.h264ref (max) 52.000 -5.45%
464.h264ref (max) (percentage) 1.280 -5.88%
464.h264ref (unexplained diff vs previous) 46.000 -17.86%
464.h264ref (unexplained diff vs previous) (percentage) 1.120 -18.84%
465.tonto 97.000 1.04%
465.tonto (avg) 97.000 1.04%
465.tonto (avg) (percentage) 0.150 -
465.tonto (max) 174.000 -
465.tonto (max) (percentage) 0.270 -
470.lbm 18.000 5.88%
470.lbm (avg) 18.000 5.88%
470.lbm (avg) (percentage) 0.570 -
470.lbm (max) 31.000 -18.42%
470.lbm (max) (percentage) 0.990 -19.51%
470.lbm (unexplained diff vs previous) 31.000 -20.51%
470.lbm (unexplained diff vs previous) (percentage) 0.980 -20.97%
471.omnetpp 38.000 2.70%
471.omnetpp (avg) 38.000 2.70%
471.omnetpp (avg) (percentage) 1.520 1.33%
471.omnetpp (max) 92.000 -15.60%
471.omnetpp (max) (percentage) 3.660 -16.63%
471.omnetpp (unexplained diff vs previous) 53.000 -53.51%
471.omnetpp (unexplained diff vs previous) (percentage) 2.090 -54.47%
473.astar 39.000 5.41%
473.astar (avg) 39.000 5.41%
473.astar (avg) (percentage) 0.780 4.00%
473.astar (max) 97.000 -8.49%
473.astar (max) (percentage) 1.900 -9.95%
473.astar (unexplained diff vs previous) 75.000 -31.19%
473.astar (unexplained diff vs previous) (percentage) 1.460 -32.41%
481.wrf 35.000 6.06%
481.wrf (avg) 35.000 6.06%
481.wrf (avg) (percentage) 0.150 -
481.wrf (max) 50.000 51.52%
481.wrf (max) (percentage) 0.210 50.00%
481.wrf (unexplained diff vs previous) 51.000 50.00%
481.wrf (unexplained diff vs previous) (percentage) 0.210 50.00%
482.sphinx3 14.000 -
482.sphinx3 (avg) 14.000 -
482.sphinx3 (avg) (percentage) 1.870 -
482.sphinx3 (max) 21.000 -
482.sphinx3 (max) (percentage) 2.730 -4.55%
482.sphinx3 (unexplained diff vs previous) 14.000 -
482.sphinx3 (unexplained diff vs previous) (percentage) 1.790 -2.19%
483.xalancbmk (avg) (percentage) 1.100 -
483.xalancbmk (max) (percentage) 1.100 -
Geometric Mean 4.890 -3.81%