Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/40d2f392106f43a60eea79f433b47a5ce44fc4a4 (+ 260 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--llvm-aarch64-master-Oz-build/301/
Filter

llvm-aarch64-master-Oz test results

Run Order Start Time Duration
Current 0301 (llvmorg-21-init-15896-g40d2f392106f) 2025-06-15T23:06:39 0:00:00
Previous 0300 (llvmorg-21-init-15636-g2bf3ccabfa37) 2025-06-13T08:04:47 0:00:00
Baseline 0256 (llvmorg-21-init-02371-g5d4998bc02ce) 2025-02-20T01:29:51 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 99 11
Performance Improvements 54 10
Added Tests 16 135
Unchanged Tests 983 996
Total Tests 1152

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
450.soplex 6.63% 498.000 531.000 - -4.32% -
462.libquantum 6.19% 97.000 103.000 - -1.90% -
473.astar 3.98% 5224.000 5432.000 - 0.15% -
482.sphinx3 3.29% 791.000 817.000 - -2.04% -
403.gcc 3.28% 61.000 63.000 - -3.08% -
433.milc 3.10% 1226.000 1264.000 - 0.40% -
471.omnetpp 2.95% 3258.000 3354.000 - 5.70% -
400.perlbench 2.33% 2013.000 2060.000 - -1.58% -
459.GemsFDTD 1.42% 20343.000 20631.000 - -0.12% -
470.lbm 1.40% 3138.000 3182.000 - -0.56% -
464.h264ref 1.25% 4409.000 4464.000 - -3.06% -
435.gromacs 1.25% 17238.000 17453.000 - -0.19% -
445.gobmk 1.10% 5101.000 5157.000 - -0.65% -
458.sjeng 1.09% 7426.000 7507.000 - 0.40% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
400.perlbench (max) 1466.67% 3.000 47.000 - 0.00% -
400.perlbench (max) (percentage) 1453.33% 0.150 2.330 - 0.00% -
400.perlbench 800.00% 5.000 45.000 - 0.00% -
400.perlbench (avg) 800.00% 5.000 45.000 - 0.00% -
400.perlbench (avg) (percentage) 668.97% 0.290 2.230 - 0.00% -
456.hmmer (unexplained diff vs previous) (percentage) 240.00% 0.100 0.340 - 0.00% -
456.hmmer (unexplained diff vs previous) 233.33% 3.000 10.000 - 0.00% -
459.GemsFDTD (max) 111.59% 138.000 292.000 - 0.00% -
459.GemsFDTD (max) (percentage) 108.82% 0.680 1.420 - 0.00% -
416.gamess (max) 103.33% 30.000 61.000 - 0.00% -
416.gamess (max) (percentage) 100.00% 0.080 0.160 - 0.00% -
459.GemsFDTD 54.84% 93.000 144.000 - 0.00% -
459.GemsFDTD (avg) 54.84% 93.000 144.000 - 0.00% -
416.gamess 54.55% 22.000 34.000 - 0.00% -
416.gamess (avg) 54.55% 22.000 34.000 - 0.00% -
459.GemsFDTD (avg) (percentage) 52.17% 0.460 0.700 - 0.00% -
416.gamess (avg) (percentage) 50.00% 0.060 0.090 - 0.00% -
433.milc (max) 50.00% 26.000 39.000 - 0.00% -
462.libquantum (max) 50.00% 4.000 6.000 - 0.00% -
433.milc (max) (percentage) 44.19% 2.150 3.100 - 0.00% -
456.hmmer (max) 42.86% 7.000 10.000 - 0.00% -
456.hmmer (max) (percentage) 41.67% 0.240 0.340 - 0.00% -
433.milc (unexplained diff vs previous) 40.74% 27.000 38.000 - 0.00% -
473.astar (max) 37.58% 157.000 216.000 - 0.00% -
433.milc (unexplained diff vs previous) (percentage) 36.82% 2.200 3.010 - 0.00% -
473.astar (max) (percentage) 32.23% 3.010 3.980 - 0.00% -
429.mcf (unexplained diff vs previous) (percentage) 30.35% 14.760 19.240 - 0.00% -
482.sphinx3 (unexplained diff vs previous) 30.00% 20.000 26.000 - 0.00% -
473.astar (unexplained diff vs previous) 28.40% 162.000 208.000 - 0.00% -
462.libquantum (max) (percentage) 26.33% 4.900 6.190 - 0.00% -
471.omnetpp (unexplained diff vs previous) 26.32% 76.000 96.000 - 0.00% -
482.sphinx3 (unexplained diff vs previous) (percentage) 25.69% 2.530 3.180 - 0.00% -
433.milc 25.00% 12.000 15.000 - 0.00% -
433.milc (avg) 25.00% 12.000 15.000 - 0.00% -
482.sphinx3 (max) 23.81% 21.000 26.000 - 0.00% -
473.astar (unexplained diff vs previous) (percentage) 23.55% 3.100 3.830 - 0.00% -
471.omnetpp (unexplained diff vs previous) (percentage) 22.75% 2.330 2.860 - 0.00% -
473.astar 20.48% 83.000 100.000 - 0.00% -
473.astar (avg) 20.48% 83.000 100.000 - 0.00% -
462.libquantum (unexplained diff vs previous) 20.00% 5.000 6.000 - 0.00% -
482.sphinx3 (max) (percentage) 19.20% 2.760 3.290 - 0.00% -
462.libquantum (avg) (percentage) 18.66% 2.090 2.480 - 0.00% -
433.milc (avg) (percentage) 18.27% 1.040 1.230 - 0.00% -
473.astar (avg) (percentage) 15.62% 1.600 1.850 - 0.00% -
435.gromacs 14.29% 91.000 104.000 - 0.00% -
435.gromacs (avg) 14.29% 91.000 104.000 - 0.00% -
450.soplex (unexplained diff vs previous) 13.79% 29.000 33.000 - 0.00% -
435.gromacs (avg) (percentage) 13.21% 0.530 0.600 - 0.00% -
462.libquantum (unexplained diff vs previous) (percentage) 13.20% 5.150 5.830 - 0.00% -
450.soplex 13.04% 23.000 26.000 - 0.00% -
450.soplex (avg) 13.04% 23.000 26.000 - 0.00% -
429.mcf (avg) (percentage) 12.89% 7.290 8.230 - 0.00% -
435.gromacs (max) 11.22% 196.000 218.000 - 0.00% -
482.sphinx3 11.11% 18.000 20.000 - 0.00% -
482.sphinx3 (avg) 11.11% 18.000 20.000 - 0.00% -
470.lbm (avg) (percentage) 10.29% 0.680 0.750 - 0.00% -
434.zeusmp 10.00% 10.000 11.000 - 0.00% -
434.zeusmp (avg) 10.00% 10.000 11.000 - 0.00% -
435.gromacs (max) (percentage) 9.65% 1.140 1.250 - 0.00% -
470.lbm 9.52% 21.000 23.000 - 0.00% -
470.lbm (avg) 9.52% 21.000 23.000 - 0.00% -
429.mcf (unexplained diff vs previous) 9.35% 246.000 269.000 - 0.00% -
471.omnetpp 9.09% 55.000 60.000 - 0.00% -
471.omnetpp (avg) 9.09% 55.000 60.000 - 0.00% -
445.gobmk (avg) (percentage) 8.45% 0.710 0.770 - 0.00% -
445.gobmk 8.33% 36.000 39.000 - 0.00% -
445.gobmk (avg) 8.33% 36.000 39.000 - 0.00% -
458.sjeng 8.16% 49.000 53.000 - 0.00% -
458.sjeng (avg) 8.16% 49.000 53.000 - 0.00% -
435.gromacs (unexplained diff vs previous) 8.04% 199.000 215.000 - 0.00% -
434.zeusmp (avg) (percentage) 7.69% 0.130 0.140 - 0.00% -
458.sjeng (avg) (percentage) 7.58% 0.660 0.710 - 0.00% -
471.omnetpp (avg) (percentage) 7.10% 1.690 1.810 - 0.00% -
435.gromacs (unexplained diff vs previous) (percentage) 6.96% 1.150 1.230 - 0.00% -
450.soplex (unexplained diff vs previous) (percentage) 6.70% 5.820 6.210 - 0.00% -
445.gobmk (max) 5.66% 53.000 56.000 - 0.00% -
450.soplex (avg) (percentage) 4.86% 4.730 4.960 - 0.00% -
445.gobmk (max) (percentage) 4.76% 1.050 1.100 - 0.00% -
482.sphinx3 (avg) (percentage) 4.64% 2.370 2.480 - 0.00% -
445.gobmk (unexplained diff vs previous) 3.70% 54.000 56.000 - 0.00% -
456.hmmer (avg) (percentage) 3.45% 0.290 0.300 - 0.00% -
445.gobmk (unexplained diff vs previous) (percentage) 2.83% 1.060 1.090 - 0.00% -
450.soplex (max) 2.63% 38.000 39.000 - 0.00% -
464.h264ref 2.00% 50.000 51.000 - 0.00% -
464.h264ref (avg) 2.00% 50.000 51.000 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
429.mcf -16.14% 1667.000 1398.000 - 0.36% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
481.wrf (max) (percentage) -47.76% 0.670 0.350 - 0.00% -
481.wrf (max) -47.50% 160.000 84.000 - 0.00% -
401.bzip2 (unexplained diff vs previous) -33.33% 12.000 8.000 - 0.00% -
401.bzip2 (unexplained diff vs previous) (percentage) -32.61% 0.460 0.310 - 0.00% -
444.namd (max) -25.00% 4.000 3.000 - 0.00% -
429.mcf (max) -21.88% 288.000 225.000 - 0.00% -
410.bwaves (max) (percentage) -21.74% 0.230 0.180 - 0.00% -
410.bwaves (max) -21.28% 47.000 37.000 - 0.00% -
436.cactusADM (avg) (percentage) -20.00% 0.250 0.200 - 0.00% -
436.cactusADM -18.75% 16.000 13.000 - 0.00% -
436.cactusADM (avg) -18.75% 16.000 13.000 - 0.00% -
447.dealII -15.79% 19.000 16.000 - 0.00% -
447.dealII (avg) -15.79% 19.000 16.000 - 0.00% -
437.leslie3d (max) (percentage) -15.28% 0.720 0.610 - 0.00% -
437.leslie3d (max) -15.14% 317.000 269.000 - 0.00% -
437.leslie3d (avg) (percentage) -14.81% 0.540 0.460 - 0.00% -
437.leslie3d -14.71% 238.000 203.000 - 0.00% -
437.leslie3d (avg) -14.71% 238.000 203.000 - 0.00% -
447.dealII (avg) (percentage) -14.12% 0.850 0.730 - 0.00% -
464.h264ref (unexplained diff vs previous) (percentage) -13.99% 1.430 1.230 - 0.00% -
464.h264ref (unexplained diff vs previous) -12.70% 63.000 55.000 - 0.00% -
401.bzip2 -10.00% 20.000 18.000 - 0.00% -
401.bzip2 (avg) -10.00% 20.000 18.000 - 0.00% -
470.lbm (unexplained diff vs previous) (percentage) -9.80% 1.530 1.380 - 0.00% -
444.namd (max) (percentage) -9.09% 0.660 0.600 - 0.00% -
470.lbm (unexplained diff vs previous) -8.33% 48.000 44.000 - 0.00% -
401.bzip2 (avg) (percentage) -7.79% 0.770 0.710 - 0.00% -
470.lbm (max) (percentage) -7.28% 1.510 1.400 - 0.00% -
458.sjeng (unexplained diff vs previous) (percentage) -6.90% 1.160 1.080 - 0.00% -
429.mcf (max) (percentage) -6.76% 17.310 16.140 - 0.00% -
464.h264ref (max) -6.45% 62.000 58.000 - 0.00% -
470.lbm (max) -6.38% 47.000 44.000 - 0.00% -
464.h264ref (max) (percentage) -6.38% 1.410 1.320 - 0.00% -
458.sjeng (unexplained diff vs previous) -5.81% 86.000 81.000 - 0.00% -
447.dealII (max) (percentage) -5.31% 1.130 1.070 - 0.00% -
453.povray (max) (percentage) -5.00% 1.400 1.330 - 0.00% -
429.mcf -4.96% 121.000 115.000 - 0.00% -
429.mcf (avg) -4.96% 121.000 115.000 - 0.00% -
436.cactusADM (max) -4.76% 21.000 20.000 - 0.00% -
450.soplex (max) (percentage) -4.60% 7.830 7.470 - 0.00% -
434.zeusmp (max) -4.55% 22.000 21.000 - 0.00% -
471.omnetpp (max) (percentage) -4.47% 3.580 3.420 - 0.00% -
458.sjeng (max) (percentage) -4.39% 1.140 1.090 - 0.00% -
447.dealII (max) -4.00% 25.000 24.000 - 0.00% -
434.zeusmp (max) (percentage) -3.70% 0.270 0.260 - 0.00% -
458.sjeng (max) -3.57% 84.000 81.000 - 0.00% -
436.cactusADM (max) (percentage) -3.13% 0.320 0.310 - 0.00% -
481.wrf (avg) (percentage) -2.56% 0.390 0.380 - 0.00% -
444.namd (avg) (percentage) -2.50% 0.800 0.780 - 0.00% -
403.gcc (max) (percentage) -2.21% 5.430 5.310 - 0.00% -
481.wrf -2.15% 93.000 91.000 - 0.00% -
481.wrf (avg) -2.15% 93.000 91.000 - 0.00% -
471.omnetpp (max) -1.72% 116.000 114.000 - 0.00% -

Added Tests - sample variability
400.perlbench (unexplained diff vs previous)
400.perlbench (unexplained diff vs previous) (percentage)
410.bwaves (unexplained diff vs previous)
410.bwaves (unexplained diff vs previous) (percentage)
416.gamess (unexplained diff vs previous)
416.gamess (unexplained diff vs previous) (percentage)
434.zeusmp (unexplained diff vs previous)
434.zeusmp (unexplained diff vs previous) (percentage)
436.cactusADM (unexplained diff vs previous)
436.cactusADM (unexplained diff vs previous) (percentage)
437.leslie3d (unexplained diff vs previous)
437.leslie3d (unexplained diff vs previous) (percentage)
459.GemsFDTD (unexplained diff vs previous)
459.GemsFDTD (unexplained diff vs previous) (percentage)
481.wrf (unexplained diff vs previous)
481.wrf (unexplained diff vs previous) (percentage)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
410.bwaves 38.18% 612748.000 846696.000 - 0.00% -
437.leslie3d 25.62% 934397.000 1173753.000 - 0.00% -
436.cactusADM 19.65% 1203544.000 1439983.000 - 0.00% -
434.zeusmp 18.79% 1273985.000 1513317.000 - 0.00% -
459.GemsFDTD 9.37% 2564792.000 2805126.000 - 0.00% -
481.wrf 2.25% 9996719.000 10221965.000 - 0.00% -
416.gamess 1.88% 12747915.000 12987823.000 - 0.00% -
465.tonto 1.52% 13421693.000 13625075.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
471.omnetpp 5.70% 3173.000 3354.000 - 2.95% -
465.tonto 2.65% 65162.000 66887.000 - 0.55% -
456.hmmer 1.20% 2910.000 2945.000 - 0.34% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
450.soplex -2.56% 282839.000 275593.000 - 0.00% -
444.namd -1.34% 172423.000 170106.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
450.soplex -4.32% 555.000 531.000 - 6.63% -
403.gcc -3.08% 65.000 63.000 - 3.28% -
464.h264ref -3.06% 4605.000 4464.000 - 1.25% -
482.sphinx3 -2.04% 834.000 817.000 - 3.29% -
462.libquantum -1.90% 105.000 103.000 - 6.19% -
453.povray -1.63% 491.000 483.000 - 0.21% -
400.perlbench -1.58% 2093.000 2060.000 - 2.33% -
447.dealII -1.56% 2305.000 2269.000 - -0.13% -

Added Tests - sample variability
400.perlbench
400.perlbench (avg)
400.perlbench (avg) (percentage)
400.perlbench (max)
400.perlbench (max) (percentage)
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
403.gcc
403.gcc (avg)
403.gcc (avg) (percentage)
403.gcc (max)
403.gcc (max) (percentage)
410.bwaves
410.bwaves (avg)
410.bwaves (avg) (percentage)
410.bwaves (max)
410.bwaves (max) (percentage)
416.gamess
416.gamess (avg)
416.gamess (avg) (percentage)
416.gamess (max)
416.gamess (max) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
433.milc
433.milc (avg)
433.milc (avg) (percentage)
433.milc (max)
433.milc (max) (percentage)
434.zeusmp
434.zeusmp (avg)
434.zeusmp (avg) (percentage)
434.zeusmp (max)
434.zeusmp (max) (percentage)
435.gromacs
435.gromacs (avg)
435.gromacs (avg) (percentage)
435.gromacs (max)
435.gromacs (max) (percentage)
436.cactusADM
436.cactusADM (avg)
436.cactusADM (avg) (percentage)
436.cactusADM (max)
436.cactusADM (max) (percentage)
437.leslie3d
437.leslie3d (avg)
437.leslie3d (avg) (percentage)
437.leslie3d (max)
437.leslie3d (max) (percentage)
444.namd
444.namd (avg)
444.namd (avg) (percentage)
444.namd (max)
444.namd (max) (percentage)
445.gobmk
445.gobmk (avg)
445.gobmk (avg) (percentage)
445.gobmk (max)
445.gobmk (max) (percentage)
447.dealII
447.dealII (avg)
447.dealII (avg) (percentage)
447.dealII (max)
447.dealII (max) (percentage)
450.soplex
450.soplex (avg)
450.soplex (avg) (percentage)
450.soplex (max)
450.soplex (max) (percentage)
453.povray
453.povray (avg)
453.povray (avg) (percentage)
453.povray (max)
453.povray (max) (percentage)
456.hmmer
456.hmmer (avg)
456.hmmer (avg) (percentage)
456.hmmer (max)
456.hmmer (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
459.GemsFDTD
459.GemsFDTD (avg)
459.GemsFDTD (avg) (percentage)
459.GemsFDTD (max)
459.GemsFDTD (max) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)
464.h264ref
464.h264ref (avg)
464.h264ref (avg) (percentage)
464.h264ref (max)
464.h264ref (max) (percentage)
465.tonto
465.tonto (avg)
465.tonto (avg) (percentage)
465.tonto (max)
465.tonto (max) (percentage)
470.lbm
470.lbm (avg)
470.lbm (avg) (percentage)
470.lbm (max)
470.lbm (max) (percentage)
471.omnetpp
471.omnetpp (avg)
471.omnetpp (avg) (percentage)
471.omnetpp (max)
471.omnetpp (max) (percentage)
473.astar
473.astar (avg)
473.astar (avg) (percentage)
473.astar (max)
473.astar (max) (percentage)
481.wrf
481.wrf (avg)
481.wrf (avg) (percentage)
481.wrf (max)
481.wrf (max) (percentage)
482.sphinx3
482.sphinx3 (avg)
482.sphinx3 (avg) (percentage)
482.sphinx3 (max)
482.sphinx3 (max) (percentage)


Report Time: 0.37s
Name Current %
400.perlbench 2060.000 2.33%
401.bzip2 2615.000 -
403.gcc 63.000 3.28%
410.bwaves 20670.000 -
416.gamess 38267.000 -
429.mcf 1398.000 -16.14%
433.milc 1264.000 3.10%
434.zeusmp 8452.000 -
435.gromacs 17453.000 1.25%
436.cactusADM 6668.000 -
437.leslie3d 44205.000 -
444.namd 664.000 -
445.gobmk 5157.000 1.10%
447.dealII 2269.000 -
450.soplex 531.000 6.63%
453.povray 483.000 -
456.hmmer 2945.000 -
458.sjeng 7507.000 1.09%
459.GemsFDTD 20631.000 1.42%
462.libquantum 103.000 6.19%
464.h264ref 4464.000 1.25%
465.tonto 66887.000 -
470.lbm 3182.000 1.40%
471.omnetpp 3354.000 2.95%
473.astar 5432.000 3.98%
481.wrf 24069.000 -
482.sphinx3 817.000 3.29%
Geometric Mean 3538.379 -
Name Current %
400.perlbench 1002325.000 -
401.bzip2 49430.000 -
403.gcc 2755885.000 -
410.bwaves 846696.000 -
416.gamess 12987823.000 -
429.mcf 10895.000 -
433.milc 100454.000 -
434.zeusmp 1513317.000 -
435.gromacs 947471.000 -
436.cactusADM 1439983.000 -
437.leslie3d 1173753.000 -
444.namd 170106.000 -
445.gobmk 1894215.000 -
447.dealII 2299394.000 -
450.soplex 275593.000 -
453.povray 731192.000 -
456.hmmer 236706.000 -
458.sjeng 120423.000 -
459.GemsFDTD 2805126.000 -
462.libquantum 32892.000 -
464.h264ref 443539.000 -
465.tonto 13625075.000 -
470.lbm 11296.000 -
471.omnetpp 578183.000 -
473.astar 32800.000 -
481.wrf 10221965.000 -
482.sphinx3 158624.000 -
Geometric Mean 485048.921 -
Name Current %
400.perlbench 45.000 800.00%
400.perlbench (avg) 45.000 800.00%
400.perlbench (avg) (percentage) 2.230 668.97%
400.perlbench (max) 47.000 1466.67%
400.perlbench (max) (percentage) 2.330 1453.33%
400.perlbench (unexplained diff vs previous) 47.000 -
400.perlbench (unexplained diff vs previous) (percentage) 2.280 -
401.bzip2 18.000 -10.00%
401.bzip2 (avg) 18.000 -10.00%
401.bzip2 (avg) (percentage) 0.710 -7.79%
401.bzip2 (max) 25.000 -
401.bzip2 (max) (percentage) 0.960 -
401.bzip2 (unexplained diff vs previous) 8.000 -33.33%
401.bzip2 (unexplained diff vs previous) (percentage) 0.310 -32.61%
403.gcc 3.000 -
403.gcc (avg) 3.000 -
403.gcc (avg) (percentage) 5.770 -
403.gcc (max) 3.000 -
403.gcc (max) (percentage) 5.310 -2.21%
410.bwaves 22.000 -
410.bwaves (avg) 22.000 -
410.bwaves (avg) (percentage) 0.110 -
410.bwaves (max) 37.000 -21.28%
410.bwaves (max) (percentage) 0.180 -21.74%
410.bwaves (unexplained diff vs previous) 15.000 -
410.bwaves (unexplained diff vs previous) (percentage) 0.070 -
416.gamess 34.000 54.55%
416.gamess (avg) 34.000 54.55%
416.gamess (avg) (percentage) 0.090 50.00%
416.gamess (max) 61.000 103.33%
416.gamess (max) (percentage) 0.160 100.00%
416.gamess (unexplained diff vs previous) 60.000 -
416.gamess (unexplained diff vs previous) (percentage) 0.160 -
429.mcf 115.000 -4.96%
429.mcf (avg) 115.000 -4.96%
429.mcf (avg) (percentage) 8.230 12.89%
429.mcf (max) 225.000 -21.88%
429.mcf (max) (percentage) 16.140 -6.76%
429.mcf (unexplained diff vs previous) 269.000 9.35%
429.mcf (unexplained diff vs previous) (percentage) 19.240 30.35%
433.milc 15.000 25.00%
433.milc (avg) 15.000 25.00%
433.milc (avg) (percentage) 1.230 18.27%
433.milc (max) 39.000 50.00%
433.milc (max) (percentage) 3.100 44.19%
433.milc (unexplained diff vs previous) 38.000 40.74%
433.milc (unexplained diff vs previous) (percentage) 3.010 36.82%
434.zeusmp 11.000 10.00%
434.zeusmp (avg) 11.000 10.00%
434.zeusmp (avg) (percentage) 0.140 7.69%
434.zeusmp (max) 21.000 -4.55%
434.zeusmp (max) (percentage) 0.260 -3.70%
434.zeusmp (unexplained diff vs previous) 15.000 -
434.zeusmp (unexplained diff vs previous) (percentage) 0.180 -
435.gromacs 104.000 14.29%
435.gromacs (avg) 104.000 14.29%
435.gromacs (avg) (percentage) 0.600 13.21%
435.gromacs (max) 218.000 11.22%
435.gromacs (max) (percentage) 1.250 9.65%
435.gromacs (unexplained diff vs previous) 215.000 8.04%
435.gromacs (unexplained diff vs previous) (percentage) 1.230 6.96%
436.cactusADM 13.000 -18.75%
436.cactusADM (avg) 13.000 -18.75%
436.cactusADM (avg) (percentage) 0.200 -20.00%
436.cactusADM (max) 20.000 -4.76%
436.cactusADM (max) (percentage) 0.310 -3.13%
436.cactusADM (unexplained diff vs previous) 6.000 -
436.cactusADM (unexplained diff vs previous) (percentage) 0.090 -
437.leslie3d 203.000 -14.71%
437.leslie3d (avg) 203.000 -14.71%
437.leslie3d (avg) (percentage) 0.460 -14.81%
437.leslie3d (max) 269.000 -15.14%
437.leslie3d (max) (percentage) 0.610 -15.28%
437.leslie3d (unexplained diff vs previous) 97.000 -
437.leslie3d (unexplained diff vs previous) (percentage) 0.220 -
444.namd 5.000 -
444.namd (avg) 5.000 -
444.namd (avg) (percentage) 0.780 -2.50%
444.namd (max) 3.000 -25.00%
444.namd (max) (percentage) 0.600 -9.09%
444.namd (unexplained diff vs previous) 4.000 -
444.namd (unexplained diff vs previous) (percentage) 0.600 -
445.gobmk 39.000 8.33%
445.gobmk (avg) 39.000 8.33%
445.gobmk (avg) (percentage) 0.770 8.45%
445.gobmk (max) 56.000 5.66%
445.gobmk (max) (percentage) 1.100 4.76%
445.gobmk (unexplained diff vs previous) 56.000 3.70%
445.gobmk (unexplained diff vs previous) (percentage) 1.090 2.83%
447.dealII 16.000 -15.79%
447.dealII (avg) 16.000 -15.79%
447.dealII (avg) (percentage) 0.730 -14.12%
447.dealII (max) 24.000 -4.00%
447.dealII (max) (percentage) 1.070 -5.31%
447.dealII (unexplained diff vs previous) 3.000 -
447.dealII (unexplained diff vs previous) (percentage) 0.130 -
450.soplex 26.000 13.04%
450.soplex (avg) 26.000 13.04%
450.soplex (avg) (percentage) 4.960 4.86%
450.soplex (max) 39.000 2.63%
450.soplex (max) (percentage) 7.470 -4.60%
450.soplex (unexplained diff vs previous) 33.000 13.79%
450.soplex (unexplained diff vs previous) (percentage) 6.210 6.70%
453.povray 3.000 -
453.povray (avg) 3.000 -
453.povray (avg) (percentage) 0.750 -
453.povray (max) 6.000 -
453.povray (max) (percentage) 1.330 -5.00%
456.hmmer 8.000 -
456.hmmer (avg) 8.000 -
456.hmmer (avg) (percentage) 0.300 3.45%
456.hmmer (max) 10.000 42.86%
456.hmmer (max) (percentage) 0.340 41.67%
456.hmmer (unexplained diff vs previous) 10.000 233.33%
456.hmmer (unexplained diff vs previous) (percentage) 0.340 240.00%
458.sjeng 53.000 8.16%
458.sjeng (avg) 53.000 8.16%
458.sjeng (avg) (percentage) 0.710 7.58%
458.sjeng (max) 81.000 -3.57%
458.sjeng (max) (percentage) 1.090 -4.39%
458.sjeng (unexplained diff vs previous) 81.000 -5.81%
458.sjeng (unexplained diff vs previous) (percentage) 1.080 -6.90%
459.GemsFDTD 144.000 54.84%
459.GemsFDTD (avg) 144.000 54.84%
459.GemsFDTD (avg) (percentage) 0.700 52.17%
459.GemsFDTD (max) 292.000 111.59%
459.GemsFDTD (max) (percentage) 1.420 108.82%
459.GemsFDTD (unexplained diff vs previous) 288.000 -
459.GemsFDTD (unexplained diff vs previous) (percentage) 1.400 -
462.libquantum 2.000 -
462.libquantum (avg) 2.000 -
462.libquantum (avg) (percentage) 2.480 18.66%
462.libquantum (max) 6.000 50.00%
462.libquantum (max) (percentage) 6.190 26.33%
462.libquantum (unexplained diff vs previous) 6.000 20.00%
462.libquantum (unexplained diff vs previous) (percentage) 5.830 13.20%
464.h264ref 51.000 2.00%
464.h264ref (avg) 51.000 2.00%
464.h264ref (avg) (percentage) 1.160 -
464.h264ref (max) 58.000 -6.45%
464.h264ref (max) (percentage) 1.320 -6.38%
464.h264ref (unexplained diff vs previous) 55.000 -12.70%
464.h264ref (unexplained diff vs previous) (percentage) 1.230 -13.99%
465.tonto 153.000 -
465.tonto (avg) 153.000 -
465.tonto (avg) (percentage) 0.230 -
465.tonto (max) 193.000 -
465.tonto (max) (percentage) 0.290 -
470.lbm 23.000 9.52%
470.lbm (avg) 23.000 9.52%
470.lbm (avg) (percentage) 0.750 10.29%
470.lbm (max) 44.000 -6.38%
470.lbm (max) (percentage) 1.400 -7.28%
470.lbm (unexplained diff vs previous) 44.000 -8.33%
470.lbm (unexplained diff vs previous) (percentage) 1.380 -9.80%
471.omnetpp 60.000 9.09%
471.omnetpp (avg) 60.000 9.09%
471.omnetpp (avg) (percentage) 1.810 7.10%
471.omnetpp (max) 114.000 -1.72%
471.omnetpp (max) (percentage) 3.420 -4.47%
471.omnetpp (unexplained diff vs previous) 96.000 26.32%
471.omnetpp (unexplained diff vs previous) (percentage) 2.860 22.75%
473.astar 100.000 20.48%
473.astar (avg) 100.000 20.48%
473.astar (avg) (percentage) 1.850 15.62%
473.astar (max) 216.000 37.58%
473.astar (max) (percentage) 3.980 32.23%
473.astar (unexplained diff vs previous) 208.000 28.40%
473.astar (unexplained diff vs previous) (percentage) 3.830 23.55%
481.wrf 91.000 -2.15%
481.wrf (avg) 91.000 -2.15%
481.wrf (avg) (percentage) 0.380 -2.56%
481.wrf (max) 84.000 -47.50%
481.wrf (max) (percentage) 0.350 -47.76%
481.wrf (unexplained diff vs previous) 82.000 -
481.wrf (unexplained diff vs previous) (percentage) 0.340 -
482.sphinx3 20.000 11.11%
482.sphinx3 (avg) 20.000 11.11%
482.sphinx3 (avg) (percentage) 2.480 4.64%
482.sphinx3 (max) 26.000 23.81%
482.sphinx3 (max) (percentage) 3.290 19.20%
482.sphinx3 (unexplained diff vs previous) 26.000 30.00%
482.sphinx3 (unexplained diff vs previous) (percentage) 3.180 25.69%
Geometric Mean 7.222 6.86%