Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/ac304d5ffdea7676582e987f75caeba33355a5dd (+ 325 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_vect-spec2k6--llvm-aarch64-master-O3_LTO-build/173/
Filter

llvm-aarch64-master-O3_LTO test results

Run Order Start Time Duration
Current 0173 (llvmorg-19-init-17302-gac304d5ffdea) 2024-07-09T23:17:21 0:00:00
Previous 0170 (llvmorg-19-init-16977-g9e1f1cfa59c4) 2024-07-08T00:06:47 0:00:00
Baseline 0001 (llvmorg-17-init-04177-g4eb1f1fab35d) 2023-03-08T09:39:21 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 59 5
Performance Improvements 74 22
Added Tests 14 167
Unchanged Tests 1005 958
Total Tests 1152

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
429.mcf 31.81% 1396.000 1840.000 - -2.08% -
436.cactusADM 1.30% 1303.000 1320.000 - 0.00% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
429.mcf (unexplained diff vs previous) 14700.00% 3.000 444.000 0.000 0.00% 0.000
429.mcf (unexplained diff vs previous) (percentage) 11390.48% 0.210 24.130 0.000 0.00% 0.000
410.bwaves (unexplained diff vs previous) (percentage) 11300.00% 0.020 2.280 0.000 0.00% 0.000
410.bwaves (unexplained diff vs previous) 9900.00% 1.000 100.000 0.000 0.00% 0.000
401.bzip2 (unexplained diff vs previous) (percentage) 3114.29% 0.070 2.250 0.000 0.00% 0.000
401.bzip2 (unexplained diff vs previous) 2900.00% 2.000 60.000 0.000 0.00% 0.000
473.astar (unexplained diff vs previous) (percentage) 846.03% 0.630 5.960 0.000 0.00% 0.000
473.astar (unexplained diff vs previous) 790.32% 31.000 276.000 0.000 0.00% 0.000
433.milc (unexplained diff vs previous) (percentage) 672.41% 0.290 2.240 0.000 0.00% 0.000
433.milc (unexplained diff vs previous) 666.67% 3.000 23.000 0.000 0.00% 0.000
470.lbm (unexplained diff vs previous) (percentage) 372.22% 0.720 3.400 0.000 0.00% 0.000
470.lbm (unexplained diff vs previous) 354.17% 24.000 109.000 0.000 0.00% 0.000
434.zeusmp (unexplained diff vs previous) (percentage) 251.61% 0.620 2.180 0.000 0.00% 0.000
434.zeusmp (unexplained diff vs previous) 241.67% 12.000 41.000 0.000 0.00% 0.000
462.libquantum (unexplained diff vs previous) (percentage) 104.72% 1.270 2.600 0.000 0.00% 0.000
462.libquantum (unexplained diff vs previous) 100.00% 1.000 2.000 0.000 0.00% 0.000
436.cactusADM (unexplained diff vs previous) 88.89% 9.000 17.000 0.000 0.00% 0.000
436.cactusADM (unexplained diff vs previous) (percentage) 86.96% 0.690 1.290 0.000 0.00% 0.000
429.mcf (max) 62.05% 361.000 585.000 - 0.00% -
429.mcf 52.86% 70.000 107.000 - 0.00% -
429.mcf (avg) 52.86% 70.000 107.000 - 0.00% -
470.lbm (max) (percentage) 50.92% 2.180 3.290 - 0.00% -
444.namd (max) 50.00% 8.000 12.000 - 0.00% -
444.namd (max) (percentage) 48.06% 1.290 1.910 - 0.00% -
410.bwaves (max) (percentage) 46.71% 1.520 2.230 - 0.00% -
470.lbm (max) 45.83% 72.000 105.000 - 0.00% -
410.bwaves (max) 42.65% 68.000 97.000 - 0.00% -
473.astar (max) (percentage) 27.09% 4.430 5.630 - 0.00% -
429.mcf (max) (percentage) 22.72% 25.920 31.810 - 0.00% -
473.astar (max) 19.82% 217.000 260.000 - 0.00% -
429.mcf (avg) (percentage) 15.45% 5.050 5.830 - 0.00% -
450.soplex (max) (percentage) 11.10% 8.740 9.710 - 0.00% -
481.wrf (avg) (percentage) 9.09% 1.760 1.920 - 0.00% -
450.soplex (avg) (percentage) 7.98% 3.260 3.520 - 0.00% -
473.astar (avg) (percentage) 6.88% 1.890 2.020 - 0.00% -
434.zeusmp (avg) (percentage) 6.45% 0.930 0.990 - 0.00% -
470.lbm (avg) (percentage) 6.25% 0.960 1.020 - 0.00% -
434.zeusmp 5.88% 17.000 18.000 - 0.00% -
434.zeusmp (avg) 5.88% 17.000 18.000 - 0.00% -
410.bwaves (avg) (percentage) 5.75% 0.870 0.920 - 0.00% -
459.GemsFDTD (avg) (percentage) 4.55% 1.540 1.610 - 0.00% -
459.GemsFDTD (max) (percentage) 3.96% 2.780 2.890 - 0.00% -
433.milc (avg) (percentage) 3.88% 1.030 1.070 - 0.00% -
481.wrf 3.64% 55.000 57.000 - 0.00% -
481.wrf (avg) 3.64% 55.000 57.000 - 0.00% -
470.lbm 3.23% 31.000 32.000 - 0.00% -
470.lbm (avg) 3.23% 31.000 32.000 - 0.00% -
444.namd (avg) (percentage) 3.19% 0.940 0.970 - 0.00% -
410.bwaves 2.56% 39.000 40.000 - 0.00% -
410.bwaves (avg) 2.56% 39.000 40.000 - 0.00% -
459.GemsFDTD 2.53% 79.000 81.000 - 0.00% -
459.GemsFDTD (avg) 2.53% 79.000 81.000 - 0.00% -
482.sphinx3 (avg) (percentage) 1.81% 2.760 2.810 - 0.00% -
401.bzip2 (avg) (percentage) 1.21% 1.650 1.670 - 0.00% -
473.astar 1.09% 92.000 93.000 - 0.00% -
473.astar (avg) 1.09% 92.000 93.000 - 0.00% -
436.cactusADM (avg) (percentage) 1.05% 0.950 0.960 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
403.gcc -10.00% 60.000 54.000 - -8.47% -
450.soplex -9.71% 546.000 493.000 - -8.70% -
435.gromacs -6.00% 4330.000 4070.000 - 0.00% -
473.astar -5.63% 4903.000 4627.000 - -0.24% -
481.wrf -4.44% 3151.000 3011.000 - 0.00% -
482.sphinx3 -3.75% 693.000 667.000 - 0.45% -
470.lbm -3.29% 3318.000 3209.000 - -0.80% -
471.omnetpp -2.99% 2173.000 2108.000 - -2.09% -
459.GemsFDTD -2.89% 5193.000 5043.000 - 0.00% -
453.povray -2.68% 411.000 400.000 - -4.99% -
462.libquantum -2.53% 79.000 77.000 - -28.70% -
437.leslie3d -2.48% 6409.000 6250.000 - 0.00% -
410.bwaves -2.23% 4493.000 4393.000 - 0.00% -
401.bzip2 -2.20% 2728.000 2668.000 - 6.29% -
433.milc -2.19% 1048.000 1025.000 - -2.75% -
434.zeusmp -2.14% 1920.000 1879.000 - 0.00% -
400.perlbench -2.13% 1504.000 1472.000 - -0.14% -
445.gobmk -2.02% 4593.000 4500.000 - -2.53% -
444.namd -1.91% 679.000 666.000 - -0.89% -
447.dealII -1.91% 995.000 976.000 - -2.50% -
464.h264ref -1.78% 3756.000 3689.000 - -6.96% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
437.leslie3d (unexplained diff vs previous) -73.54% 601.000 159.000 0.000 0.00% 0.000
437.leslie3d (unexplained diff vs previous) (percentage) -72.92% 9.380 2.540 0.000 0.00% 0.000
462.libquantum (max) -33.33% 3.000 2.000 - 0.00% -
456.hmmer (max) -12.50% 8.000 7.000 - 0.00% -
434.zeusmp (max) -12.00% 50.000 44.000 - 0.00% -
471.omnetpp (max) -11.11% 72.000 64.000 - 0.00% -
462.libquantum (max) (percentage) -10.91% 3.940 3.510 - 0.00% -
435.gromacs (max) -10.46% 306.000 274.000 - 0.00% -
481.wrf (max) -10.06% 179.000 161.000 - 0.00% -
436.cactusADM (max) (percentage) -10.05% 1.890 1.700 - 0.00% -
464.h264ref (max) -10.00% 60.000 54.000 - 0.00% -
434.zeusmp (max) (percentage) -8.78% 2.620 2.390 - 0.00% -
437.leslie3d (max) -8.75% 823.000 751.000 - 0.00% -
471.omnetpp (max) (percentage) -8.41% 3.330 3.050 - 0.00% -
436.cactusADM (max) -8.33% 24.000 22.000 - 0.00% -
401.bzip2 (max) -7.79% 77.000 71.000 - 0.00% -
458.sjeng (max) -7.45% 94.000 87.000 - 0.00% -
456.hmmer (max) (percentage) -6.90% 0.290 0.270 - 0.00% -
464.h264ref (max) (percentage) -6.88% 1.600 1.490 - 0.00% -
458.sjeng (max) (percentage) -6.62% 1.510 1.410 - 0.00% -
437.leslie3d (max) (percentage) -6.46% 12.850 12.020 - 0.00% -
445.gobmk (max) -6.38% 94.000 88.000 - 0.00% -
447.dealII -6.25% 16.000 15.000 - 0.00% -
447.dealII (avg) -6.25% 16.000 15.000 - 0.00% -
482.sphinx3 (max) -6.06% 33.000 31.000 - 0.00% -
447.dealII (max) -5.88% 34.000 32.000 - 0.00% -
481.wrf (max) (percentage) -5.79% 5.700 5.370 - 0.00% -
435.gromacs -5.79% 121.000 114.000 - 0.00% -
435.gromacs (avg) -5.79% 121.000 114.000 - 0.00% -
401.bzip2 (max) (percentage) -5.63% 2.840 2.680 - 0.00% -
447.dealII (max) (percentage) -5.48% 3.470 3.280 - 0.00% -
416.gamess (max) -5.41% 111.000 105.000 - 0.00% -
416.gamess (max) (percentage) -5.32% 0.940 0.890 - 0.00% -
482.sphinx3 -5.26% 19.000 18.000 - 0.00% -
482.sphinx3 (avg) -5.26% 19.000 18.000 - 0.00% -
435.gromacs (max) (percentage) -4.67% 7.070 6.740 - 0.00% -
437.leslie3d -4.66% 322.000 307.000 - 0.00% -
437.leslie3d (avg) -4.66% 322.000 307.000 - 0.00% -
445.gobmk (max) (percentage) -4.39% 2.050 1.960 - 0.00% -
433.milc (max) (percentage) -4.37% 2.290 2.190 - 0.00% -
433.milc (max) -4.35% 23.000 22.000 - 0.00% -
482.sphinx3 (max) (percentage) -3.48% 4.890 4.720 - 0.00% -
453.povray (max) (percentage) -3.12% 0.960 0.930 - 0.00% -
401.bzip2 -2.22% 45.000 44.000 - 0.00% -
401.bzip2 (avg) -2.22% 45.000 44.000 - 0.00% -
445.gobmk -2.22% 45.000 44.000 - 0.00% -
445.gobmk (avg) -2.22% 45.000 44.000 - 0.00% -
437.leslie3d (avg) (percentage) -2.19% 5.030 4.920 - 0.00% -
471.omnetpp -1.72% 58.000 57.000 - 0.00% -
471.omnetpp (avg) -1.72% 58.000 57.000 - 0.00% -
465.tonto (max) (percentage) -1.14% 0.880 0.870 - 0.00% -
465.tonto (max) -1.14% 176.000 174.000 - 0.00% -
403.gcc (max) (percentage) -1.11% 8.100 8.010 - 0.00% -

Added Tests - sample variability
444.namd (unexplained diff vs previous)
444.namd (unexplained diff vs previous) (percentage)
450.soplex (unexplained diff vs previous)
450.soplex (unexplained diff vs previous) (percentage)
456.hmmer (unexplained diff vs previous)
456.hmmer (unexplained diff vs previous) (percentage)
459.GemsFDTD (unexplained diff vs previous)
459.GemsFDTD (unexplained diff vs previous) (percentage)
471.omnetpp (unexplained diff vs previous)
471.omnetpp (unexplained diff vs previous) (percentage)
481.wrf (unexplained diff vs previous)
481.wrf (unexplained diff vs previous) (percentage)
482.sphinx3 (unexplained diff vs previous)
482.sphinx3 (unexplained diff vs previous) (percentage)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
401.bzip2 2.12% 66682.000 68094.000 - 0.00% -
433.milc 1.57% 128200.000 130212.000 - 0.00% -
447.dealII 1.31% 548786.000 555974.000 - -0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
401.bzip2 6.29% 2510.000 2668.000 - -2.20% -
456.hmmer 5.54% 2637.000 2783.000 - -0.18% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
462.libquantum -14.82% 45013.000 38343.000 - 0.00% -
444.namd -2.76% 168697.000 164044.000 - 0.00% -
458.sjeng -2.33% 131729.000 128661.000 - -0.03% -
470.lbm -1.65% 10901.000 10721.000 - 0.00% -
471.omnetpp -1.65% 754667.000 742212.000 - 0.00% -
473.astar -1.55% 33048.000 32536.000 - 0.00% -
450.soplex -1.34% 319083.000 314811.000 - 0.00% -
400.perlbench -1.02% 1269683.000 1256780.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
462.libquantum -28.70% 108.000 77.000 - -2.53% -
450.soplex -8.70% 540.000 493.000 - -9.71% -
403.gcc -8.47% 59.000 54.000 - -10.00% -
464.h264ref -6.96% 3965.000 3689.000 - -1.78% -
453.povray -4.99% 421.000 400.000 - -2.68% -
433.milc -2.75% 1054.000 1025.000 - -2.19% -
445.gobmk -2.53% 4617.000 4500.000 - -2.02% -
447.dealII -2.50% 1001.000 976.000 - -1.91% -
458.sjeng -2.39% 6353.000 6201.000 - -0.70% -
471.omnetpp -2.09% 2153.000 2108.000 - -2.99% -
429.mcf -2.08% 1879.000 1840.000 - 31.81% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful 184.21% 19.000 54.000 - 0.00% -
nb_execution_successful 184.21% 19.000 54.000 - 0.00% -
nb_total_tests 113.79% 29.000 62.000 - 0.00% -

Added Tests - Code Size
410.bwaves
416.gamess
434.zeusmp
435.gromacs
436.cactusADM
437.leslie3d
459.GemsFDTD
465.tonto
481.wrf

Added Tests - Execution
410.bwaves
416.gamess
434.zeusmp
435.gromacs
436.cactusADM
437.leslie3d
459.GemsFDTD
465.tonto
481.wrf

Added Tests - sample variability
400.perlbench
400.perlbench (avg)
400.perlbench (avg) (percentage)
400.perlbench (max)
400.perlbench (max) (percentage)
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
403.gcc
403.gcc (avg)
403.gcc (avg) (percentage)
403.gcc (max)
403.gcc (max) (percentage)
410.bwaves
410.bwaves (avg)
410.bwaves (avg) (percentage)
410.bwaves (max)
410.bwaves (max) (percentage)
410.bwaves (unexplained diff vs previous)
410.bwaves (unexplained diff vs previous) (percentage)
416.gamess
416.gamess (avg)
416.gamess (avg) (percentage)
416.gamess (max)
416.gamess (max) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
433.milc
433.milc (avg)
433.milc (avg) (percentage)
433.milc (max)
433.milc (max) (percentage)
434.zeusmp
434.zeusmp (avg)
434.zeusmp (avg) (percentage)
434.zeusmp (max)
434.zeusmp (max) (percentage)
434.zeusmp (unexplained diff vs previous)
434.zeusmp (unexplained diff vs previous) (percentage)
435.gromacs
435.gromacs (avg)
435.gromacs (avg) (percentage)
435.gromacs (max)
435.gromacs (max) (percentage)
436.cactusADM
436.cactusADM (avg)
436.cactusADM (avg) (percentage)
436.cactusADM (max)
436.cactusADM (max) (percentage)
436.cactusADM (unexplained diff vs previous)
436.cactusADM (unexplained diff vs previous) (percentage)
437.leslie3d
437.leslie3d (avg)
437.leslie3d (avg) (percentage)
437.leslie3d (max)
437.leslie3d (max) (percentage)
437.leslie3d (unexplained diff vs previous)
437.leslie3d (unexplained diff vs previous) (percentage)
444.namd
444.namd (avg)
444.namd (avg) (percentage)
444.namd (max)
444.namd (max) (percentage)
445.gobmk
445.gobmk (avg)
445.gobmk (avg) (percentage)
445.gobmk (max)
445.gobmk (max) (percentage)
447.dealII
447.dealII (avg)
447.dealII (avg) (percentage)
447.dealII (max)
447.dealII (max) (percentage)
450.soplex
450.soplex (avg)
450.soplex (avg) (percentage)
450.soplex (max)
450.soplex (max) (percentage)
453.povray
453.povray (avg)
453.povray (avg) (percentage)
453.povray (max)
453.povray (max) (percentage)
456.hmmer
456.hmmer (avg)
456.hmmer (avg) (percentage)
456.hmmer (max)
456.hmmer (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
459.GemsFDTD
459.GemsFDTD (avg)
459.GemsFDTD (avg) (percentage)
459.GemsFDTD (max)
459.GemsFDTD (max) (percentage)
459.GemsFDTD (unexplained diff vs previous)
459.GemsFDTD (unexplained diff vs previous) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)
464.h264ref
464.h264ref (avg)
464.h264ref (avg) (percentage)
464.h264ref (max)
464.h264ref (max) (percentage)
465.tonto
465.tonto (avg)
465.tonto (avg) (percentage)
465.tonto (max)
465.tonto (max) (percentage)
470.lbm
470.lbm (avg)
470.lbm (avg) (percentage)
470.lbm (max)
470.lbm (max) (percentage)
471.omnetpp
471.omnetpp (avg)
471.omnetpp (avg) (percentage)
471.omnetpp (max)
471.omnetpp (max) (percentage)
473.astar
473.astar (avg)
473.astar (avg) (percentage)
473.astar (max)
473.astar (max) (percentage)
481.wrf
481.wrf (avg)
481.wrf (avg) (percentage)
481.wrf (max)
481.wrf (max) (percentage)
481.wrf (unexplained diff vs previous)
481.wrf (unexplained diff vs previous) (percentage)
482.sphinx3
482.sphinx3 (avg)
482.sphinx3 (avg) (percentage)
482.sphinx3 (max)
482.sphinx3 (max) (percentage)
483.xalancbmk (avg) (percentage)
483.xalancbmk (max) (percentage)


Report Time: 0.38s
Name Current %
400.perlbench 1472.000 -2.13%
401.bzip2 2668.000 -2.20%
403.gcc 54.000 -10.00%
410.bwaves 4393.000 -2.23%
416.gamess 11826.000 -
429.mcf 1840.000 31.81%
433.milc 1025.000 -2.19%
434.zeusmp 1879.000 -2.14%
435.gromacs 4070.000 -6.00%
436.cactusADM 1320.000 1.30%
437.leslie3d 6250.000 -2.48%
444.namd 666.000 -1.91%
445.gobmk 4500.000 -2.02%
447.dealII 976.000 -1.91%
450.soplex 493.000 -9.71%
453.povray 400.000 -2.68%
456.hmmer 2783.000 -
458.sjeng 6201.000 -
459.GemsFDTD 5043.000 -2.89%
462.libquantum 77.000 -2.53%
464.h264ref 3689.000 -1.78%
465.tonto 20109.000 -
470.lbm 3209.000 -3.29%
471.omnetpp 2108.000 -2.99%
473.astar 4627.000 -5.63%
481.wrf 3011.000 -4.44%
482.sphinx3 667.000 -3.75%
Geometric Mean 1875.391 -1.81%
Name Current %
400.perlbench 1256780.000 -
401.bzip2 68094.000 -
403.gcc 3786911.000 -
410.bwaves 657024.000 -
416.gamess 8283485.000 -
429.mcf 11448.000 -
433.milc 130212.000 -
434.zeusmp 1036779.000 -
435.gromacs 701960.000 -
436.cactusADM 1166350.000 -
437.leslie3d 953109.000 -
444.namd 164044.000 -
445.gobmk 2236600.000 -
447.dealII 555974.000 -
450.soplex 314811.000 -
453.povray 1125525.000 -
456.hmmer 163855.000 -
458.sjeng 128661.000 -
459.GemsFDTD 1247602.000 -
462.libquantum 38343.000 -
464.h264ref 767761.000 -
465.tonto 9821952.000 -
470.lbm 10721.000 -
471.omnetpp 742212.000 -
473.astar 32536.000 -
481.wrf 5870687.000 -
482.sphinx3 175858.000 -
Geometric Mean 444588.706 -
Name Current %
400.perlbench 19.000 -
400.perlbench (avg) 19.000 -
400.perlbench (avg) (percentage) 1.310 -
400.perlbench (max) 17.000 -
400.perlbench (max) (percentage) 1.190 -
401.bzip2 44.000 -2.22%
401.bzip2 (avg) 44.000 -2.22%
401.bzip2 (avg) (percentage) 1.670 1.21%
401.bzip2 (max) 71.000 -7.79%
401.bzip2 (max) (percentage) 2.680 -5.63%
401.bzip2 (unexplained diff vs previous) 60.000 2900.00%
401.bzip2 (unexplained diff vs previous) (percentage) 2.250 3114.29%
403.gcc 2.000 -
403.gcc (avg) 2.000 -
403.gcc (avg) (percentage) 4.150 -
403.gcc (max) 4.000 -
403.gcc (max) (percentage) 8.010 -1.11%
410.bwaves 40.000 2.56%
410.bwaves (avg) 40.000 2.56%
410.bwaves (avg) (percentage) 0.920 5.75%
410.bwaves (max) 97.000 42.65%
410.bwaves (max) (percentage) 2.230 46.71%
410.bwaves (unexplained diff vs previous) 100.000 9900.00%
410.bwaves (unexplained diff vs previous) (percentage) 2.280 11300.00%
416.gamess 29.000 -
416.gamess (avg) 29.000 -
416.gamess (avg) (percentage) 0.250 -
416.gamess (max) 105.000 -5.41%
416.gamess (max) (percentage) 0.890 -5.32%
429.mcf 107.000 52.86%
429.mcf (avg) 107.000 52.86%
429.mcf (avg) (percentage) 5.830 15.45%
429.mcf (max) 585.000 62.05%
429.mcf (max) (percentage) 31.810 22.72%
429.mcf (unexplained diff vs previous) 444.000 14700.00%
429.mcf (unexplained diff vs previous) (percentage) 24.130 11390.48%
433.milc 10.000 -
433.milc (avg) 10.000 -
433.milc (avg) (percentage) 1.070 3.88%
433.milc (max) 22.000 -4.35%
433.milc (max) (percentage) 2.190 -4.37%
433.milc (unexplained diff vs previous) 23.000 666.67%
433.milc (unexplained diff vs previous) (percentage) 2.240 672.41%
434.zeusmp 18.000 5.88%
434.zeusmp (avg) 18.000 5.88%
434.zeusmp (avg) (percentage) 0.990 6.45%
434.zeusmp (max) 44.000 -12.00%
434.zeusmp (max) (percentage) 2.390 -8.78%
434.zeusmp (unexplained diff vs previous) 41.000 241.67%
434.zeusmp (unexplained diff vs previous) (percentage) 2.180 251.61%
435.gromacs 114.000 -5.79%
435.gromacs (avg) 114.000 -5.79%
435.gromacs (avg) (percentage) 2.810 -
435.gromacs (max) 274.000 -10.46%
435.gromacs (max) (percentage) 6.740 -4.67%
436.cactusADM 12.000 -
436.cactusADM (avg) 12.000 -
436.cactusADM (avg) (percentage) 0.960 1.05%
436.cactusADM (max) 22.000 -8.33%
436.cactusADM (max) (percentage) 1.700 -10.05%
436.cactusADM (unexplained diff vs previous) 17.000 88.89%
436.cactusADM (unexplained diff vs previous) (percentage) 1.290 86.96%
437.leslie3d 307.000 -4.66%
437.leslie3d (avg) 307.000 -4.66%
437.leslie3d (avg) (percentage) 4.920 -2.19%
437.leslie3d (max) 751.000 -8.75%
437.leslie3d (max) (percentage) 12.020 -6.46%
437.leslie3d (unexplained diff vs previous) 159.000 -73.54%
437.leslie3d (unexplained diff vs previous) (percentage) 2.540 -72.92%
444.namd 6.000 -
444.namd (avg) 6.000 -
444.namd (avg) (percentage) 0.970 3.19%
444.namd (max) 12.000 50.00%
444.namd (max) (percentage) 1.910 48.06%
444.namd (unexplained diff vs previous) 13.000 -
444.namd (unexplained diff vs previous) (percentage) 1.950 -
445.gobmk 44.000 -2.22%
445.gobmk (avg) 44.000 -2.22%
445.gobmk (avg) (percentage) 0.980 -
445.gobmk (max) 88.000 -6.38%
445.gobmk (max) (percentage) 1.960 -4.39%
447.dealII 15.000 -6.25%
447.dealII (avg) 15.000 -6.25%
447.dealII (avg) (percentage) 1.620 -
447.dealII (max) 32.000 -5.88%
447.dealII (max) (percentage) 3.280 -5.48%
450.soplex 17.000 -
450.soplex (avg) 17.000 -
450.soplex (avg) (percentage) 3.520 7.98%
450.soplex (max) 47.000 -
450.soplex (max) (percentage) 9.710 11.10%
450.soplex (unexplained diff vs previous) 53.000 -
450.soplex (unexplained diff vs previous) (percentage) 10.750 -
453.povray 4.000 -
453.povray (avg) 4.000 -
453.povray (avg) (percentage) 1.080 -
453.povray (max) 3.000 -
453.povray (max) (percentage) 0.930 -3.12%
456.hmmer 6.000 -
456.hmmer (avg) 6.000 -
456.hmmer (avg) (percentage) 0.240 -
456.hmmer (max) 7.000 -12.50%
456.hmmer (max) (percentage) 0.270 -6.90%
456.hmmer (unexplained diff vs previous) 5.000 -
456.hmmer (unexplained diff vs previous) (percentage) 0.180 -
458.sjeng 34.000 -
458.sjeng (avg) 34.000 -
458.sjeng (avg) (percentage) 0.550 -
458.sjeng (max) 87.000 -7.45%
458.sjeng (max) (percentage) 1.410 -6.62%
459.GemsFDTD 81.000 2.53%
459.GemsFDTD (avg) 81.000 2.53%
459.GemsFDTD (avg) (percentage) 1.610 4.55%
459.GemsFDTD (max) 145.000 -
459.GemsFDTD (max) (percentage) 2.890 3.96%
459.GemsFDTD (unexplained diff vs previous) 150.000 -
459.GemsFDTD (unexplained diff vs previous) (percentage) 2.970 -
462.libquantum 1.000 -
462.libquantum (avg) 1.000 -
462.libquantum (avg) (percentage) 2.150 -
462.libquantum (max) 2.000 -33.33%
462.libquantum (max) (percentage) 3.510 -10.91%
462.libquantum (unexplained diff vs previous) 2.000 100.00%
462.libquantum (unexplained diff vs previous) (percentage) 2.600 104.72%
464.h264ref 34.000 -
464.h264ref (avg) 34.000 -
464.h264ref (avg) (percentage) 0.930 -
464.h264ref (max) 54.000 -10.00%
464.h264ref (max) (percentage) 1.490 -6.88%
465.tonto 195.000 -
465.tonto (avg) 195.000 -
465.tonto (avg) (percentage) 0.970 -
465.tonto (max) 174.000 -1.14%
465.tonto (max) (percentage) 0.870 -1.14%
470.lbm 32.000 3.23%
470.lbm (avg) 32.000 3.23%
470.lbm (avg) (percentage) 1.020 6.25%
470.lbm (max) 105.000 45.83%
470.lbm (max) (percentage) 3.290 50.92%
470.lbm (unexplained diff vs previous) 109.000 354.17%
470.lbm (unexplained diff vs previous) (percentage) 3.400 372.22%
471.omnetpp 57.000 -1.72%
471.omnetpp (avg) 57.000 -1.72%
471.omnetpp (avg) (percentage) 2.730 -
471.omnetpp (max) 64.000 -11.11%
471.omnetpp (max) (percentage) 3.050 -8.41%
471.omnetpp (unexplained diff vs previous) 65.000 -
471.omnetpp (unexplained diff vs previous) (percentage) 3.080 -
473.astar 93.000 1.09%
473.astar (avg) 93.000 1.09%
473.astar (avg) (percentage) 2.020 6.88%
473.astar (max) 260.000 19.82%
473.astar (max) (percentage) 5.630 27.09%
473.astar (unexplained diff vs previous) 276.000 790.32%
473.astar (unexplained diff vs previous) (percentage) 5.960 846.03%
481.wrf 57.000 3.64%
481.wrf (avg) 57.000 3.64%
481.wrf (avg) (percentage) 1.920 9.09%
481.wrf (max) 161.000 -10.06%
481.wrf (max) (percentage) 5.370 -5.79%
481.wrf (unexplained diff vs previous) 140.000 -
481.wrf (unexplained diff vs previous) (percentage) 4.650 -
482.sphinx3 18.000 -5.26%
482.sphinx3 (avg) 18.000 -5.26%
482.sphinx3 (avg) (percentage) 2.810 1.81%
482.sphinx3 (max) 31.000 -6.06%
482.sphinx3 (max) (percentage) 4.720 -3.48%
482.sphinx3 (unexplained diff vs previous) 26.000 -
482.sphinx3 (unexplained diff vs previous) (percentage) 3.900 -
483.xalancbmk (avg) (percentage) 4.050 -
483.xalancbmk (max) (percentage) 6.280 -
Geometric Mean 10.658 29.79%