Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/f061a395ffb78215a23e0f503e8ea121ee3b13ad (+ 187 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_vect-spec2k6--llvm-aarch64-master-O3-build/166/
Filter

llvm-aarch64-master-O3 test results

Run Order Start Time Duration
Current 0166 (llvmorg-19-init-09943-gf061a395ffb7) 2024-04-29T01:26:06 0:00:00
Previous 0163 (llvmorg-19-init-09756-g37ae4ad0eef3) 2024-04-27T08:29:11 0:00:00
Baseline 0001 (llvmorg-17-init-04177-g4eb1f1fab35d) 2023-03-08T09:39:21 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 41 10
Performance Improvements 105 16
Added Tests 4 176
Unchanged Tests 1050 998
Total Tests 1200

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
403.gcc 8.77% 57.000 62.000 - -3.12% -
481.wrf 1.83% 3165.000 3223.000 - 0.00% -
471.omnetpp 1.53% 2552.000 2591.000 - -0.88% -
462.libquantum 1.20% 83.000 84.000 - -20.75% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
450.soplex (unexplained diff vs previous) (percentage) 1200.00% 0.190 2.470 0.000 0.00% 0.000
450.soplex (unexplained diff vs previous) 1200.00% 1.000 13.000 0.000 0.00% 0.000
471.omnetpp (unexplained diff vs previous) 387.50% 8.000 39.000 0.000 0.00% 0.000
471.omnetpp (unexplained diff vs previous) (percentage) 387.10% 0.310 1.510 0.000 0.00% 0.000
483.xalancbmk (unexplained diff vs previous) (percentage) 281.90% 1.050 4.010 0.000 0.00% 0.000
483.xalancbmk (unexplained diff vs previous) 268.42% 38.000 140.000 0.000 0.00% 0.000
483.xalancbmk (max) (percentage) 240.71% 1.130 3.850 - 0.00% -
483.xalancbmk (max) 226.83% 41.000 134.000 - 0.00% -
410.bwaves (unexplained diff vs previous) 220.00% 5.000 16.000 0.000 0.00% 0.000
410.bwaves (unexplained diff vs previous) (percentage) 209.09% 0.110 0.340 0.000 0.00% 0.000
481.wrf (max) 132.00% 25.000 58.000 - 0.00% -
481.wrf (max) (percentage) 125.93% 0.810 1.830 - 0.00% -
481.wrf (unexplained diff vs previous) 123.08% 26.000 58.000 0.000 0.00% 0.000
481.wrf (unexplained diff vs previous) (percentage) 119.51% 0.820 1.800 0.000 0.00% 0.000
473.astar (unexplained diff vs previous) 95.65% 23.000 45.000 0.000 0.00% 0.000
473.astar (unexplained diff vs previous) (percentage) 95.56% 0.450 0.880 0.000 0.00% 0.000
459.GemsFDTD (unexplained diff vs previous) (percentage) 84.21% 0.190 0.350 0.000 0.00% 0.000
459.GemsFDTD (unexplained diff vs previous) 80.00% 10.000 18.000 0.000 0.00% 0.000
481.wrf 65.00% 20.000 33.000 - 0.00% -
481.wrf (avg) 65.00% 20.000 33.000 - 0.00% -
481.wrf (avg) (percentage) 59.09% 0.660 1.050 - 0.00% -
471.omnetpp (max) (percentage) 56.12% 0.980 1.530 - 0.00% -
471.omnetpp (max) 56.00% 25.000 39.000 - 0.00% -
456.hmmer (max) 33.33% 3.000 4.000 - 0.00% -
435.gromacs (avg) (percentage) 32.33% 1.330 1.760 - 0.00% -
435.gromacs 30.30% 66.000 86.000 - 0.00% -
435.gromacs (avg) 30.30% 66.000 86.000 - 0.00% -
435.gromacs (unexplained diff vs previous) (percentage) 30.28% 2.180 2.840 0.000 0.00% 0.000
459.GemsFDTD (max) 28.57% 14.000 18.000 - 0.00% -
435.gromacs (unexplained diff vs previous) 26.36% 110.000 139.000 0.000 0.00% 0.000
435.gromacs (max) (percentage) 23.77% 2.230 2.760 - 0.00% -
459.GemsFDTD (max) (percentage) 20.69% 0.290 0.350 - 0.00% -
435.gromacs (max) 20.54% 112.000 135.000 - 0.00% -
464.h264ref (unexplained diff vs previous) 20.00% 20.000 24.000 0.000 0.00% 0.000
464.h264ref (unexplained diff vs previous) (percentage) 19.23% 0.520 0.620 0.000 0.00% 0.000
456.hmmer (max) (percentage) 15.38% 0.130 0.150 - 0.00% -
483.xalancbmk (avg) (percentage) 4.19% 1.670 1.740 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
483.xalancbmk -3.85% 3634.000 3494.000 - -2.18% -
435.gromacs -2.76% 5036.000 4897.000 - 0.00% -
450.soplex -2.41% 539.000 526.000 - -1.87% -
453.povray -2.26% 442.000 432.000 - -7.10% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
445.gobmk (unexplained diff vs previous) (percentage) -94.48% 1.450 0.080 0.000 0.00% 0.000
445.gobmk (unexplained diff vs previous) -94.37% 71.000 4.000 0.000 0.00% 0.000
465.tonto (unexplained diff vs previous) (percentage) -93.33% 0.300 0.020 0.000 0.00% 0.000
465.tonto (unexplained diff vs previous) -91.67% 60.000 5.000 0.000 0.00% 0.000
429.mcf (unexplained diff vs previous) -80.95% 21.000 4.000 0.000 0.00% 0.000
429.mcf (unexplained diff vs previous) (percentage) -80.67% 1.500 0.290 0.000 0.00% 0.000
470.lbm (unexplained diff vs previous) -70.27% 37.000 11.000 0.000 0.00% 0.000
470.lbm (unexplained diff vs previous) (percentage) -70.27% 1.110 0.330 0.000 0.00% 0.000
458.sjeng (unexplained diff vs previous) (percentage) -67.86% 0.560 0.180 0.000 0.00% 0.000
458.sjeng (unexplained diff vs previous) -67.57% 37.000 12.000 0.000 0.00% 0.000
436.cactusADM (unexplained diff vs previous) -66.67% 12.000 4.000 0.000 0.00% 0.000
436.cactusADM (unexplained diff vs previous) (percentage) -66.30% 0.920 0.310 0.000 0.00% 0.000
437.leslie3d (unexplained diff vs previous) -65.96% 94.000 32.000 0.000 0.00% 0.000
437.leslie3d (unexplained diff vs previous) (percentage) -65.54% 1.480 0.510 0.000 0.00% 0.000
433.milc (unexplained diff vs previous) -55.56% 9.000 4.000 0.000 0.00% 0.000
433.milc (unexplained diff vs previous) (percentage) -55.41% 0.740 0.330 0.000 0.00% 0.000
444.namd (unexplained diff vs previous) -50.00% 6.000 3.000 0.000 0.00% 0.000
444.namd (unexplained diff vs previous) (percentage) -50.00% 0.880 0.440 0.000 0.00% 0.000
447.dealII (unexplained diff vs previous) (percentage) -42.86% 0.560 0.320 0.000 0.00% 0.000
447.dealII (unexplained diff vs previous) -42.86% 7.000 4.000 0.000 0.00% 0.000
416.gamess (unexplained diff vs previous) (percentage) -33.33% 0.090 0.060 0.000 0.00% 0.000
465.tonto -31.71% 82.000 56.000 - 0.00% -
465.tonto (avg) -31.71% 82.000 56.000 - 0.00% -
465.tonto (avg) (percentage) -31.71% 0.410 0.280 - 0.00% -
416.gamess (unexplained diff vs previous) -30.00% 10.000 7.000 0.000 0.00% 0.000
462.libquantum (max) (percentage) -28.14% 1.670 1.200 - 0.00% -
400.perlbench -27.27% 11.000 8.000 - 0.00% -
400.perlbench (avg) -27.27% 11.000 8.000 - 0.00% -
400.perlbench (avg) (percentage) -25.71% 0.700 0.520 - 0.00% -
433.milc (max) -22.22% 9.000 7.000 - 0.00% -
434.zeusmp (max) -18.18% 22.000 18.000 - 0.00% -
433.milc (max) (percentage) -17.33% 0.750 0.620 - 0.00% -
444.namd (max) -16.67% 6.000 5.000 - 0.00% -
434.zeusmp (max) (percentage) -14.78% 1.150 0.980 - 0.00% -
434.zeusmp (unexplained diff vs previous) -13.64% 22.000 19.000 0.000 0.00% 0.000
458.sjeng (max) -13.51% 37.000 32.000 - 0.00% -
470.lbm (max) -13.51% 37.000 32.000 - 0.00% -
436.cactusADM (avg) (percentage) -13.51% 0.740 0.640 - 0.00% -
470.lbm (max) (percentage) -12.50% 1.120 0.980 - 0.00% -
444.namd (max) (percentage) -12.50% 0.880 0.770 - 0.00% -
434.zeusmp (unexplained diff vs previous) (percentage) -12.39% 1.130 0.990 0.000 0.00% 0.000
416.gamess (avg) (percentage) -11.54% 0.260 0.230 - 0.00% -
436.cactusADM -11.11% 9.000 8.000 - 0.00% -
436.cactusADM (avg) -11.11% 9.000 8.000 - 0.00% -
453.povray (max) -11.11% 9.000 8.000 - 0.00% -
458.sjeng (max) (percentage) -10.71% 0.560 0.500 - 0.00% -
416.gamess -10.71% 28.000 25.000 - 0.00% -
416.gamess (avg) -10.71% 28.000 25.000 - 0.00% -
410.bwaves (max) (percentage) -9.09% 0.440 0.400 - 0.00% -
445.gobmk (max) (percentage) -8.39% 1.430 1.310 - 0.00% -
401.bzip2 (max) -8.33% 12.000 11.000 - 0.00% -
445.gobmk (max) -7.25% 69.000 64.000 - 0.00% -
437.leslie3d (max) -7.23% 235.000 218.000 - 0.00% -
450.soplex (max) -7.14% 14.000 13.000 - 0.00% -
437.leslie3d (max) (percentage) -6.74% 3.710 3.460 - 0.00% -
401.bzip2 (max) (percentage) -6.67% 0.450 0.420 - 0.00% -
453.povray (max) (percentage) -6.25% 2.080 1.950 - 0.00% -
482.sphinx3 -6.25% 16.000 15.000 - 0.00% -
482.sphinx3 (avg) -6.25% 16.000 15.000 - 0.00% -
450.soplex (max) (percentage) -6.12% 2.780 2.610 - 0.00% -
429.mcf (max) (percentage) -5.59% 1.610 1.520 - 0.00% -
410.bwaves (max) -5.00% 20.000 19.000 - 0.00% -
429.mcf (max) -4.55% 22.000 21.000 - 0.00% -
437.leslie3d -4.37% 252.000 241.000 - 0.00% -
437.leslie3d (avg) -4.37% 252.000 241.000 - 0.00% -
473.astar (max) -4.08% 49.000 47.000 - 0.00% -
447.dealII -4.00% 25.000 24.000 - 0.00% -
447.dealII (avg) -4.00% 25.000 24.000 - 0.00% -
447.dealII (avg) (percentage) -3.98% 2.010 1.930 - 0.00% -
482.sphinx3 (avg) (percentage) -3.88% 2.320 2.230 - 0.00% -
437.leslie3d (avg) (percentage) -3.77% 3.980 3.830 - 0.00% -
470.lbm -3.70% 27.000 26.000 - 0.00% -
470.lbm (avg) -3.70% 27.000 26.000 - 0.00% -
464.h264ref (max) (percentage) -3.57% 0.840 0.810 - 0.00% -
410.bwaves -3.28% 61.000 59.000 - 0.00% -
410.bwaves (avg) -3.28% 61.000 59.000 - 0.00% -
447.dealII (max) (percentage) -3.19% 2.820 2.730 - 0.00% -
464.h264ref (max) -3.12% 32.000 31.000 - 0.00% -
410.bwaves (avg) (percentage) -3.10% 1.290 1.250 - 0.00% -
473.astar (max) (percentage) -3.09% 0.970 0.940 - 0.00% -
447.dealII (max) -2.86% 35.000 34.000 - 0.00% -
458.sjeng -2.86% 35.000 34.000 - 0.00% -
458.sjeng (avg) -2.86% 35.000 34.000 - 0.00% -
445.gobmk -2.70% 37.000 36.000 - 0.00% -
445.gobmk (avg) -2.70% 37.000 36.000 - 0.00% -
445.gobmk (avg) (percentage) -2.60% 0.770 0.750 - 0.00% -
429.mcf (avg) (percentage) -2.57% 3.500 3.410 - 0.00% -
459.GemsFDTD (avg) (percentage) -2.56% 0.780 0.760 - 0.00% -
459.GemsFDTD -2.50% 40.000 39.000 - 0.00% -
459.GemsFDTD (avg) -2.50% 40.000 39.000 - 0.00% -
470.lbm (avg) (percentage) -2.41% 0.830 0.810 - 0.00% -
429.mcf -2.08% 48.000 47.000 - 0.00% -
429.mcf (avg) -2.08% 48.000 47.000 - 0.00% -
444.namd (avg) (percentage) -2.06% 0.970 0.950 - 0.00% -
403.gcc (max) (percentage) -2.02% 9.390 9.200 - 0.00% -
458.sjeng (avg) (percentage) -1.85% 0.540 0.530 - 0.00% -
473.astar -1.52% 66.000 65.000 - 0.00% -
473.astar (avg) -1.52% 66.000 65.000 - 0.00% -
464.h264ref (avg) (percentage) -1.16% 0.860 0.850 - 0.00% -
436.cactusADM (max) (percentage) -1.09% 0.920 0.910 - 0.00% -
433.milc (avg) (percentage) -1.08% 0.930 0.920 - 0.00% -

Added Tests - sample variability
400.perlbench (unexplained diff vs previous)
400.perlbench (unexplained diff vs previous) (percentage)
482.sphinx3 (unexplained diff vs previous)
482.sphinx3 (unexplained diff vs previous) (percentage)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
447.dealII 1.81% 3240486.000 3299214.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
401.bzip2 6.60% 2501.000 2666.000 - -0.07% -
473.astar 4.95% 4865.000 5106.000 - -0.87% -
482.sphinx3 4.17% 672.000 700.000 - 0.43% -
456.hmmer 3.41% 2639.000 2729.000 - 0.15% -
447.dealII 3.11% 1220.000 1258.000 - 0.32% -
444.namd 2.87% 662.000 681.000 - -0.44% -
470.lbm 2.06% 3249.000 3316.000 - -0.33% -
433.milc 1.59% 1198.000 1217.000 - 0.33% -
400.perlbench 1.56% 1664.000 1690.000 - 0.18% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
462.libquantum -5.00% 42589.000 40458.000 - 0.00% -
464.h264ref -2.69% 749591.000 729443.000 - 0.00% -
458.sjeng -2.44% 146102.000 142538.000 - 0.00% -
444.namd -2.31% 212450.000 207537.000 - 0.00% -
450.soplex -1.94% 370392.000 363198.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
429.mcf -26.50% 1906.000 1401.000 - 0.29% -
462.libquantum -20.75% 106.000 84.000 - 1.20% -
453.povray -7.10% 465.000 432.000 - -2.26% -
464.h264ref -3.54% 4036.000 3893.000 - 0.62% -
403.gcc -3.12% 64.000 62.000 - 8.77% -
458.sjeng -2.31% 6752.000 6596.000 - -0.18% -
483.xalancbmk -2.18% 3572.000 3494.000 - -3.85% -
450.soplex -1.87% 536.000 526.000 - -2.41% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful 194.74% 19.000 56.000 - 0.00% -
nb_execution_successful 194.74% 19.000 56.000 - 0.00% -
nb_total_tests 106.90% 29.000 60.000 - 0.00% -

Added Tests - Code Size
410.bwaves
416.gamess
434.zeusmp
435.gromacs
436.cactusADM
437.leslie3d
459.GemsFDTD
465.tonto
481.wrf

Added Tests - Execution
410.bwaves
416.gamess
434.zeusmp
435.gromacs
436.cactusADM
437.leslie3d
459.GemsFDTD
465.tonto
481.wrf

Added Tests - sample variability
400.perlbench
400.perlbench (avg)
400.perlbench (avg) (percentage)
400.perlbench (max)
400.perlbench (max) (percentage)
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
403.gcc
403.gcc (avg)
403.gcc (avg) (percentage)
403.gcc (max)
403.gcc (max) (percentage)
410.bwaves
410.bwaves (avg)
410.bwaves (avg) (percentage)
410.bwaves (max)
410.bwaves (max) (percentage)
410.bwaves (unexplained diff vs previous)
410.bwaves (unexplained diff vs previous) (percentage)
416.gamess
416.gamess (avg)
416.gamess (avg) (percentage)
416.gamess (max)
416.gamess (max) (percentage)
416.gamess (unexplained diff vs previous)
416.gamess (unexplained diff vs previous) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
433.milc
433.milc (avg)
433.milc (avg) (percentage)
433.milc (max)
433.milc (max) (percentage)
434.zeusmp
434.zeusmp (avg)
434.zeusmp (avg) (percentage)
434.zeusmp (max)
434.zeusmp (max) (percentage)
434.zeusmp (unexplained diff vs previous)
434.zeusmp (unexplained diff vs previous) (percentage)
435.gromacs
435.gromacs (avg)
435.gromacs (avg) (percentage)
435.gromacs (max)
435.gromacs (max) (percentage)
435.gromacs (unexplained diff vs previous)
435.gromacs (unexplained diff vs previous) (percentage)
436.cactusADM
436.cactusADM (avg)
436.cactusADM (avg) (percentage)
436.cactusADM (max)
436.cactusADM (max) (percentage)
436.cactusADM (unexplained diff vs previous)
436.cactusADM (unexplained diff vs previous) (percentage)
437.leslie3d
437.leslie3d (avg)
437.leslie3d (avg) (percentage)
437.leslie3d (max)
437.leslie3d (max) (percentage)
437.leslie3d (unexplained diff vs previous)
437.leslie3d (unexplained diff vs previous) (percentage)
444.namd
444.namd (avg)
444.namd (avg) (percentage)
444.namd (max)
444.namd (max) (percentage)
445.gobmk
445.gobmk (avg)
445.gobmk (avg) (percentage)
445.gobmk (max)
445.gobmk (max) (percentage)
447.dealII
447.dealII (avg)
447.dealII (avg) (percentage)
447.dealII (max)
447.dealII (max) (percentage)
450.soplex
450.soplex (avg)
450.soplex (avg) (percentage)
450.soplex (max)
450.soplex (max) (percentage)
453.povray
453.povray (avg)
453.povray (avg) (percentage)
453.povray (max)
453.povray (max) (percentage)
456.hmmer
456.hmmer (avg)
456.hmmer (avg) (percentage)
456.hmmer (max)
456.hmmer (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
459.GemsFDTD
459.GemsFDTD (avg)
459.GemsFDTD (avg) (percentage)
459.GemsFDTD (max)
459.GemsFDTD (max) (percentage)
459.GemsFDTD (unexplained diff vs previous)
459.GemsFDTD (unexplained diff vs previous) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)
464.h264ref
464.h264ref (avg)
464.h264ref (avg) (percentage)
464.h264ref (max)
464.h264ref (max) (percentage)
465.tonto
465.tonto (avg)
465.tonto (avg) (percentage)
465.tonto (max)
465.tonto (max) (percentage)
465.tonto (unexplained diff vs previous)
465.tonto (unexplained diff vs previous) (percentage)
470.lbm
470.lbm (avg)
470.lbm (avg) (percentage)
470.lbm (max)
470.lbm (max) (percentage)
471.omnetpp
471.omnetpp (avg)
471.omnetpp (avg) (percentage)
471.omnetpp (max)
471.omnetpp (max) (percentage)
473.astar
473.astar (avg)
473.astar (avg) (percentage)
473.astar (max)
473.astar (max) (percentage)
481.wrf
481.wrf (avg)
481.wrf (avg) (percentage)
481.wrf (max)
481.wrf (max) (percentage)
481.wrf (unexplained diff vs previous)
481.wrf (unexplained diff vs previous) (percentage)
482.sphinx3
482.sphinx3 (avg)
482.sphinx3 (avg) (percentage)
482.sphinx3 (max)
482.sphinx3 (max) (percentage)
483.xalancbmk
483.xalancbmk (avg)
483.xalancbmk (avg) (percentage)
483.xalancbmk (max)
483.xalancbmk (max) (percentage)


Report Time: 0.44s
Name Current %
400.perlbench 1690.000 -
401.bzip2 2666.000 -
403.gcc 62.000 8.77%
410.bwaves 4753.000 -
416.gamess 10970.000 -
429.mcf 1401.000 -
433.milc 1217.000 -
434.zeusmp 1923.000 -
435.gromacs 4897.000 -2.76%
436.cactusADM 1295.000 -
437.leslie3d 6306.000 -
444.namd 681.000 -
445.gobmk 4889.000 -
447.dealII 1258.000 -
450.soplex 526.000 -2.41%
453.povray 432.000 -2.26%
456.hmmer 2729.000 -
458.sjeng 6596.000 -
459.GemsFDTD 5171.000 -
462.libquantum 84.000 1.20%
464.h264ref 3893.000 -
465.tonto 20185.000 -
470.lbm 3316.000 -
471.omnetpp 2591.000 1.53%
473.astar 5106.000 -
481.wrf 3223.000 1.83%
482.sphinx3 700.000 -
483.xalancbmk 3494.000 -3.85%
Geometric Mean 2026.147 -
Name Current %
400.perlbench 1184190.000 -
401.bzip2 76410.000 -
403.gcc 3427483.000 -
410.bwaves 632599.000 -
416.gamess 8877838.000 -
429.mcf 13255.000 -
433.milc 137200.000 -
434.zeusmp 1033080.000 -
435.gromacs 904012.000 -
436.cactusADM 1423808.000 -
437.leslie3d 951231.000 -
444.namd 207537.000 -
445.gobmk 2111817.000 -
447.dealII 3299214.000 -
450.soplex 363198.000 -
453.povray 962210.000 -
456.hmmer 299008.000 -
458.sjeng 142538.000 -
459.GemsFDTD 1289483.000 -
462.libquantum 40458.000 -
464.h264ref 729443.000 -
465.tonto 10951148.000 -
470.lbm 12117.000 -
471.omnetpp 680246.000 -
473.astar 41968.000 -
481.wrf 7293096.000 -
482.sphinx3 196413.000 -
483.xalancbmk 4316440.000 -
Geometric Mean 557094.547 -
Name Current %
400.perlbench 8.000 -27.27%
400.perlbench (avg) 8.000 -27.27%
400.perlbench (avg) (percentage) 0.520 -25.71%
400.perlbench (max) 19.000 -
400.perlbench (max) (percentage) 1.130 -
400.perlbench (unexplained diff vs previous) 3.000 -
400.perlbench (unexplained diff vs previous) (percentage) 0.180 -
401.bzip2 36.000 -
401.bzip2 (avg) 36.000 -
401.bzip2 (avg) (percentage) 1.360 -
401.bzip2 (max) 11.000 -8.33%
401.bzip2 (max) (percentage) 0.420 -6.67%
403.gcc 3.000 -
403.gcc (avg) 3.000 -
403.gcc (avg) (percentage) 6.090 -
403.gcc (max) 5.000 -
403.gcc (max) (percentage) 9.200 -2.02%
410.bwaves 59.000 -3.28%
410.bwaves (avg) 59.000 -3.28%
410.bwaves (avg) (percentage) 1.250 -3.10%
410.bwaves (max) 19.000 -5.00%
410.bwaves (max) (percentage) 0.400 -9.09%
410.bwaves (unexplained diff vs previous) 16.000 220.00%
410.bwaves (unexplained diff vs previous) (percentage) 0.340 209.09%
416.gamess 25.000 -10.71%
416.gamess (avg) 25.000 -10.71%
416.gamess (avg) (percentage) 0.230 -11.54%
416.gamess (max) 53.000 -
416.gamess (max) (percentage) 0.490 -
416.gamess (unexplained diff vs previous) 7.000 -30.00%
416.gamess (unexplained diff vs previous) (percentage) 0.060 -33.33%
429.mcf 47.000 -2.08%
429.mcf (avg) 47.000 -2.08%
429.mcf (avg) (percentage) 3.410 -2.57%
429.mcf (max) 21.000 -4.55%
429.mcf (max) (percentage) 1.520 -5.59%
429.mcf (unexplained diff vs previous) 4.000 -80.95%
429.mcf (unexplained diff vs previous) (percentage) 0.290 -80.67%
433.milc 11.000 -
433.milc (avg) 11.000 -
433.milc (avg) (percentage) 0.920 -1.08%
433.milc (max) 7.000 -22.22%
433.milc (max) (percentage) 0.620 -17.33%
433.milc (unexplained diff vs previous) 4.000 -55.56%
433.milc (unexplained diff vs previous) (percentage) 0.330 -55.41%
434.zeusmp 17.000 -
434.zeusmp (avg) 17.000 -
434.zeusmp (avg) (percentage) 0.900 -
434.zeusmp (max) 18.000 -18.18%
434.zeusmp (max) (percentage) 0.980 -14.78%
434.zeusmp (unexplained diff vs previous) 19.000 -13.64%
434.zeusmp (unexplained diff vs previous) (percentage) 0.990 -12.39%
435.gromacs 86.000 30.30%
435.gromacs (avg) 86.000 30.30%
435.gromacs (avg) (percentage) 1.760 32.33%
435.gromacs (max) 135.000 20.54%
435.gromacs (max) (percentage) 2.760 23.77%
435.gromacs (unexplained diff vs previous) 139.000 26.36%
435.gromacs (unexplained diff vs previous) (percentage) 2.840 30.28%
436.cactusADM 8.000 -11.11%
436.cactusADM (avg) 8.000 -11.11%
436.cactusADM (avg) (percentage) 0.640 -13.51%
436.cactusADM (max) 11.000 -
436.cactusADM (max) (percentage) 0.910 -1.09%
436.cactusADM (unexplained diff vs previous) 4.000 -66.67%
436.cactusADM (unexplained diff vs previous) (percentage) 0.310 -66.30%
437.leslie3d 241.000 -4.37%
437.leslie3d (avg) 241.000 -4.37%
437.leslie3d (avg) (percentage) 3.830 -3.77%
437.leslie3d (max) 218.000 -7.23%
437.leslie3d (max) (percentage) 3.460 -6.74%
437.leslie3d (unexplained diff vs previous) 32.000 -65.96%
437.leslie3d (unexplained diff vs previous) (percentage) 0.510 -65.54%
444.namd 6.000 -
444.namd (avg) 6.000 -
444.namd (avg) (percentage) 0.950 -2.06%
444.namd (max) 5.000 -16.67%
444.namd (max) (percentage) 0.770 -12.50%
444.namd (unexplained diff vs previous) 3.000 -50.00%
444.namd (unexplained diff vs previous) (percentage) 0.440 -50.00%
445.gobmk 36.000 -2.70%
445.gobmk (avg) 36.000 -2.70%
445.gobmk (avg) (percentage) 0.750 -2.60%
445.gobmk (max) 64.000 -7.25%
445.gobmk (max) (percentage) 1.310 -8.39%
445.gobmk (unexplained diff vs previous) 4.000 -94.37%
445.gobmk (unexplained diff vs previous) (percentage) 0.080 -94.48%
447.dealII 24.000 -4.00%
447.dealII (avg) 24.000 -4.00%
447.dealII (avg) (percentage) 1.930 -3.98%
447.dealII (max) 34.000 -2.86%
447.dealII (max) (percentage) 2.730 -3.19%
447.dealII (unexplained diff vs previous) 4.000 -42.86%
447.dealII (unexplained diff vs previous) (percentage) 0.320 -42.86%
450.soplex 13.000 -
450.soplex (avg) 13.000 -
450.soplex (avg) (percentage) 2.530 -
450.soplex (max) 13.000 -7.14%
450.soplex (max) (percentage) 2.610 -6.12%
450.soplex (unexplained diff vs previous) 13.000 1200.00%
450.soplex (unexplained diff vs previous) (percentage) 2.470 1200.00%
453.povray 6.000 -
453.povray (avg) 6.000 -
453.povray (avg) (percentage) 1.480 -
453.povray (max) 8.000 -11.11%
453.povray (max) (percentage) 1.950 -6.25%
456.hmmer 8.000 -
456.hmmer (avg) 8.000 -
456.hmmer (avg) (percentage) 0.320 -
456.hmmer (max) 4.000 33.33%
456.hmmer (max) (percentage) 0.150 15.38%
456.hmmer (unexplained diff vs previous) 4.000 -
456.hmmer (unexplained diff vs previous) (percentage) 0.150 -
458.sjeng 34.000 -2.86%
458.sjeng (avg) 34.000 -2.86%
458.sjeng (avg) (percentage) 0.530 -1.85%
458.sjeng (max) 32.000 -13.51%
458.sjeng (max) (percentage) 0.500 -10.71%
458.sjeng (unexplained diff vs previous) 12.000 -67.57%
458.sjeng (unexplained diff vs previous) (percentage) 0.180 -67.86%
459.GemsFDTD 39.000 -2.50%
459.GemsFDTD (avg) 39.000 -2.50%
459.GemsFDTD (avg) (percentage) 0.760 -2.56%
459.GemsFDTD (max) 18.000 28.57%
459.GemsFDTD (max) (percentage) 0.350 20.69%
459.GemsFDTD (unexplained diff vs previous) 18.000 80.00%
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.350 84.21%
462.libquantum 1.000 -
462.libquantum (avg) 1.000 -
462.libquantum (avg) (percentage) 1.700 -
462.libquantum (max) 1.000 -
462.libquantum (max) (percentage) 1.200 -28.14%
462.libquantum (unexplained diff vs previous) 1.000 -
462.libquantum (unexplained diff vs previous) (percentage) 1.190 -
464.h264ref 33.000 -
464.h264ref (avg) 33.000 -
464.h264ref (avg) (percentage) 0.850 -1.16%
464.h264ref (max) 31.000 -3.12%
464.h264ref (max) (percentage) 0.810 -3.57%
464.h264ref (unexplained diff vs previous) 24.000 20.00%
464.h264ref (unexplained diff vs previous) (percentage) 0.620 19.23%
465.tonto 56.000 -31.71%
465.tonto (avg) 56.000 -31.71%
465.tonto (avg) (percentage) 0.280 -31.71%
465.tonto (max) 102.000 -
465.tonto (max) (percentage) 0.510 -
465.tonto (unexplained diff vs previous) 5.000 -91.67%
465.tonto (unexplained diff vs previous) (percentage) 0.020 -93.33%
470.lbm 26.000 -3.70%
470.lbm (avg) 26.000 -3.70%
470.lbm (avg) (percentage) 0.810 -2.41%
470.lbm (max) 32.000 -13.51%
470.lbm (max) (percentage) 0.980 -12.50%
470.lbm (unexplained diff vs previous) 11.000 -70.27%
470.lbm (unexplained diff vs previous) (percentage) 0.330 -70.27%
471.omnetpp 54.000 -
471.omnetpp (avg) 54.000 -
471.omnetpp (avg) (percentage) 2.120 -
471.omnetpp (max) 39.000 56.00%
471.omnetpp (max) (percentage) 1.530 56.12%
471.omnetpp (unexplained diff vs previous) 39.000 387.50%
471.omnetpp (unexplained diff vs previous) (percentage) 1.510 387.10%
473.astar 65.000 -1.52%
473.astar (avg) 65.000 -1.52%
473.astar (avg) (percentage) 1.280 -
473.astar (max) 47.000 -4.08%
473.astar (max) (percentage) 0.940 -3.09%
473.astar (unexplained diff vs previous) 45.000 95.65%
473.astar (unexplained diff vs previous) (percentage) 0.880 95.56%
481.wrf 33.000 65.00%
481.wrf (avg) 33.000 65.00%
481.wrf (avg) (percentage) 1.050 59.09%
481.wrf (max) 58.000 132.00%
481.wrf (max) (percentage) 1.830 125.93%
481.wrf (unexplained diff vs previous) 58.000 123.08%
481.wrf (unexplained diff vs previous) (percentage) 1.800 119.51%
482.sphinx3 15.000 -6.25%
482.sphinx3 (avg) 15.000 -6.25%
482.sphinx3 (avg) (percentage) 2.230 -3.88%
482.sphinx3 (max) 25.000 -
482.sphinx3 (max) (percentage) 3.600 -
482.sphinx3 (unexplained diff vs previous) 3.000 -
482.sphinx3 (unexplained diff vs previous) (percentage) 0.430 -
483.xalancbmk 60.000 -
483.xalancbmk (avg) 60.000 -
483.xalancbmk (avg) (percentage) 1.740 4.19%
483.xalancbmk (max) 134.000 226.83%
483.xalancbmk (max) (percentage) 3.850 240.71%
483.xalancbmk (unexplained diff vs previous) 140.000 268.42%
483.xalancbmk (unexplained diff vs previous) (percentage) 4.010 281.90%
Geometric Mean 5.012 1.26%