Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/a707d0883b5ab9de6a0a864df614ef14909a4de1 (+ 116 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_vect-spec2k6--llvm-aarch64-master-O3_LTO-build/164/
Filter

llvm-aarch64-master-O3_LTO test results

Run Order Start Time Duration
Current 0164 (llvmorg-19-init-16362-ga707d0883b5a) 2024-06-29T06:14:30 0:00:00
Previous 0162 (llvmorg-19-init-16246-gb7e157cab173) 2024-06-25T04:55:41 0:00:00
Baseline 0001 (llvmorg-17-init-04177-g4eb1f1fab35d) 2023-03-08T09:39:21 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 59 12
Performance Improvements 73 18
Added Tests 36 175
Unchanged Tests 1008 971
Total Tests 1176

Performance Regressions - Code Size Δ Previous Current σ Δ (B) σ (B)
465.tonto 1.98% 9873660.000 10069044.000 - 0.00% -

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
450.soplex 6.25% 528.000 561.000 - 3.89% -
482.sphinx3 5.14% 701.000 737.000 - 10.99% -
459.GemsFDTD 3.26% 5212.000 5382.000 - 0.00% -
437.leslie3d 3.02% 6483.000 6679.000 - 0.00% -
435.gromacs 2.78% 4279.000 4398.000 - 0.00% -
400.perlbench 2.72% 1506.000 1547.000 - 4.95% -
410.bwaves 1.81% 4523.000 4605.000 - 0.00% -
444.namd 1.79% 672.000 684.000 - 1.79% -
403.gcc 1.75% 57.000 58.000 - -1.69% -
453.povray 1.49% 402.000 408.000 - -3.09% -
481.wrf 1.09% 3219.000 3254.000 - 0.00% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
470.lbm (unexplained diff vs previous) 400.00% 4.000 20.000 0.000 0.00% 0.000
470.lbm (unexplained diff vs previous) (percentage) 400.00% 0.120 0.600 0.000 0.00% 0.000
453.povray (max) 200.00% 2.000 6.000 - 0.00% -
453.povray (max) (percentage) 170.91% 0.550 1.490 - 0.00% -
410.bwaves (unexplained diff vs previous) 115.79% 38.000 82.000 0.000 0.00% 0.000
410.bwaves (unexplained diff vs previous) (percentage) 111.90% 0.840 1.780 0.000 0.00% 0.000
410.bwaves (max) 69.39% 49.000 83.000 - 0.00% -
410.bwaves (max) (percentage) 64.55% 1.100 1.810 - 0.00% -
459.GemsFDTD (max) 60.55% 109.000 175.000 - 0.00% -
459.GemsFDTD (max) (percentage) 54.50% 2.110 3.260 - 0.00% -
482.sphinx3 (max) 54.17% 24.000 37.000 - 0.00% -
450.soplex (max) 52.17% 23.000 35.000 - 0.00% -
444.namd (max) 50.00% 8.000 12.000 - 0.00% -
482.sphinx3 (max) (percentage) 48.55% 3.460 5.140 - 0.00% -
444.namd (max) (percentage) 46.72% 1.220 1.790 - 0.00% -
450.soplex (max) (percentage) 40.13% 4.460 6.250 - 0.00% -
459.GemsFDTD 15.79% 57.000 66.000 - 0.00% -
459.GemsFDTD (avg) 15.79% 57.000 66.000 - 0.00% -
450.soplex 15.38% 13.000 15.000 - 0.00% -
450.soplex (avg) 15.38% 13.000 15.000 - 0.00% -
458.sjeng (unexplained diff vs previous) 12.50% 8.000 9.000 0.000 0.00% 0.000
482.sphinx3 11.76% 17.000 19.000 - 0.00% -
482.sphinx3 (avg) 11.76% 17.000 19.000 - 0.00% -
459.GemsFDTD (avg) (percentage) 11.71% 1.110 1.240 - 0.00% -
458.sjeng (unexplained diff vs previous) (percentage) 7.69% 0.130 0.140 0.000 0.00% 0.000
434.zeusmp 7.14% 14.000 15.000 - 0.00% -
434.zeusmp (avg) 7.14% 14.000 15.000 - 0.00% -
450.soplex (avg) (percentage) 6.59% 2.580 2.750 - 0.00% -
410.bwaves 6.06% 33.000 35.000 - 0.00% -
410.bwaves (avg) 6.06% 33.000 35.000 - 0.00% -
416.gamess (avg) (percentage) 5.56% 0.180 0.190 - 0.00% -
400.perlbench (max) 5.56% 18.000 19.000 - 0.00% -
410.bwaves (avg) (percentage) 5.41% 0.740 0.780 - 0.00% -
434.zeusmp (avg) (percentage) 5.26% 0.760 0.800 - 0.00% -
400.perlbench 5.26% 19.000 20.000 - 0.00% -
400.perlbench (avg) 5.26% 19.000 20.000 - 0.00% -
482.sphinx3 (avg) (percentage) 5.24% 2.480 2.610 - 0.00% -
416.gamess 4.76% 21.000 22.000 - 0.00% -
416.gamess (avg) 4.76% 21.000 22.000 - 0.00% -
435.gromacs 4.00% 100.000 104.000 - 0.00% -
435.gromacs (avg) 4.00% 100.000 104.000 - 0.00% -
444.namd (avg) (percentage) 3.13% 0.960 0.990 - 0.00% -
481.wrf 2.56% 39.000 40.000 - 0.00% -
481.wrf (avg) 2.56% 39.000 40.000 - 0.00% -
437.leslie3d 1.97% 254.000 259.000 - 0.00% -
437.leslie3d (avg) 1.97% 254.000 259.000 - 0.00% -
453.povray (avg) (percentage) 1.75% 1.140 1.160 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
429.mcf -1.50% 1404.000 1383.000 - -26.40% -
434.zeusmp -1.39% 1942.000 1915.000 - 0.00% -
471.omnetpp -1.39% 2236.000 2205.000 - 2.42% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
464.h264ref (max) -72.22% 54.000 15.000 - 0.00% -
464.h264ref (max) (percentage) -71.83% 1.420 0.400 - 0.00% -
445.gobmk (max) -56.79% 81.000 35.000 - 0.00% -
445.gobmk (max) (percentage) -55.93% 1.770 0.780 - 0.00% -
436.cactusADM (unexplained diff vs previous) -55.56% 9.000 4.000 0.000 0.00% 0.000
436.cactusADM (unexplained diff vs previous) (percentage) -55.07% 0.690 0.310 0.000 0.00% 0.000
403.gcc (unexplained diff vs previous) (percentage) -51.00% 3.510 1.720 0.000 0.00% 0.000
403.gcc (unexplained diff vs previous) -50.00% 2.000 1.000 0.000 0.00% 0.000
437.leslie3d (max) (percentage) -47.48% 5.750 3.020 - 0.00% -
437.leslie3d (max) -45.97% 372.000 201.000 - 0.00% -
433.milc (unexplained diff vs previous) (percentage) -43.28% 0.670 0.380 0.000 0.00% 0.000
433.milc (unexplained diff vs previous) -42.86% 7.000 4.000 0.000 0.00% 0.000
429.mcf (max) -31.31% 214.000 147.000 - 0.00% -
429.mcf (max) (percentage) -30.28% 15.290 10.660 - 0.00% -
429.mcf (unexplained diff vs previous) -25.00% 28.000 21.000 0.000 0.00% 0.000
429.mcf (unexplained diff vs previous) (percentage) -23.62% 1.990 1.520 0.000 0.00% 0.000
433.milc (max) (percentage) -22.41% 1.740 1.350 - 0.00% -
433.milc (max) -22.22% 18.000 14.000 - 0.00% -
435.gromacs (max) (percentage) -16.67% 3.600 3.000 - 0.00% -
435.gromacs (max) -14.94% 154.000 131.000 - 0.00% -
436.cactusADM (max) -11.76% 17.000 15.000 - 0.00% -
436.cactusADM (max) (percentage) -11.03% 1.360 1.210 - 0.00% -
447.dealII (max) -10.34% 29.000 26.000 - 0.00% -
447.dealII (max) (percentage) -10.10% 2.970 2.670 - 0.00% -
433.milc -9.09% 11.000 10.000 - 0.00% -
433.milc (avg) -9.09% 11.000 10.000 - 0.00% -
436.cactusADM -8.33% 12.000 11.000 - 0.00% -
436.cactusADM (avg) -8.33% 12.000 11.000 - 0.00% -
471.omnetpp (max) -7.78% 90.000 83.000 - 0.00% -
416.gamess (max) -7.69% 52.000 48.000 - 0.00% -
456.hmmer (max) -7.69% 13.000 12.000 - 0.00% -
401.bzip2 (max) (percentage) -6.96% 1.150 1.070 - 0.00% -
416.gamess (max) (percentage) -6.82% 0.440 0.410 - 0.00% -
401.bzip2 (max) -6.45% 31.000 29.000 - 0.00% -
471.omnetpp (max) (percentage) -6.40% 4.060 3.800 - 0.00% -
456.hmmer (max) (percentage) -6.25% 0.480 0.450 - 0.00% -
464.h264ref -5.88% 34.000 32.000 - 0.00% -
464.h264ref (avg) -5.88% 34.000 32.000 - 0.00% -
434.zeusmp (max) -5.71% 35.000 33.000 - 0.00% -
445.gobmk -4.65% 43.000 41.000 - 0.00% -
445.gobmk (avg) -4.65% 43.000 41.000 - 0.00% -
403.gcc (avg) (percentage) -4.50% 4.670 4.460 - 0.00% -
401.bzip2 (avg) (percentage) -4.47% 1.790 1.710 - 0.00% -
464.h264ref (avg) (percentage) -4.44% 0.900 0.860 - 0.00% -
401.bzip2 -4.17% 48.000 46.000 - 0.00% -
401.bzip2 (avg) -4.17% 48.000 46.000 - 0.00% -
462.libquantum (avg) (percentage) -4.00% 2.000 1.920 - 0.00% -
470.lbm (max) -4.00% 25.000 24.000 - 0.00% -
473.astar (avg) (percentage) -3.80% 1.840 1.770 - 0.00% -
429.mcf -3.57% 56.000 54.000 - 0.00% -
429.mcf (avg) -3.57% 56.000 54.000 - 0.00% -
473.astar -3.37% 89.000 86.000 - 0.00% -
473.astar (avg) -3.37% 89.000 86.000 - 0.00% -
434.zeusmp (max) (percentage) -3.28% 1.830 1.770 - 0.00% -
436.cactusADM (avg) (percentage) -3.19% 0.940 0.910 - 0.00% -
445.gobmk (avg) (percentage) -3.19% 0.940 0.910 - 0.00% -
471.omnetpp -3.08% 65.000 63.000 - 0.00% -
471.omnetpp (avg) -3.08% 65.000 63.000 - 0.00% -
433.milc (avg) (percentage) -2.86% 1.050 1.020 - 0.00% -
481.wrf (max) (percentage) -2.79% 2.510 2.440 - 0.00% -
462.libquantum (max) (percentage) -2.75% 5.450 5.300 - 0.00% -
447.dealII (avg) (percentage) -2.72% 1.470 1.430 - 0.00% -
470.lbm (max) (percentage) -2.60% 0.770 0.750 - 0.00% -
471.omnetpp (avg) (percentage) -2.38% 2.940 2.870 - 0.00% -
403.gcc (max) (percentage) -2.24% 8.940 8.740 - 0.00% -
429.mcf (avg) (percentage) -1.99% 4.020 3.940 - 0.00% -
458.sjeng (avg) (percentage) -1.96% 0.510 0.500 - 0.00% -
437.leslie3d (avg) (percentage) -1.27% 3.930 3.880 - 0.00% -
481.wrf (max) -1.25% 80.000 79.000 - 0.00% -
470.lbm (avg) (percentage) -1.10% 0.910 0.900 - 0.00% -

Added Tests - sample variability
401.bzip2 (unexplained diff vs previous)
401.bzip2 (unexplained diff vs previous) (percentage)
416.gamess (unexplained diff vs previous)
416.gamess (unexplained diff vs previous) (percentage)
434.zeusmp (unexplained diff vs previous)
434.zeusmp (unexplained diff vs previous) (percentage)
435.gromacs (unexplained diff vs previous)
435.gromacs (unexplained diff vs previous) (percentage)
437.leslie3d (unexplained diff vs previous)
437.leslie3d (unexplained diff vs previous) (percentage)
444.namd (unexplained diff vs previous)
444.namd (unexplained diff vs previous) (percentage)
445.gobmk (unexplained diff vs previous)
445.gobmk (unexplained diff vs previous) (percentage)
447.dealII (unexplained diff vs previous)
447.dealII (unexplained diff vs previous) (percentage)
450.soplex (unexplained diff vs previous)
450.soplex (unexplained diff vs previous) (percentage)
453.povray (unexplained diff vs previous)
453.povray (unexplained diff vs previous) (percentage)
456.hmmer (unexplained diff vs previous)
456.hmmer (unexplained diff vs previous) (percentage)
459.GemsFDTD (unexplained diff vs previous)
459.GemsFDTD (unexplained diff vs previous) (percentage)
462.libquantum (unexplained diff vs previous)
462.libquantum (unexplained diff vs previous) (percentage)
464.h264ref (unexplained diff vs previous)
464.h264ref (unexplained diff vs previous) (percentage)
471.omnetpp (unexplained diff vs previous)
471.omnetpp (unexplained diff vs previous) (percentage)
473.astar (unexplained diff vs previous)
473.astar (unexplained diff vs previous) (percentage)
481.wrf (unexplained diff vs previous)
481.wrf (unexplained diff vs previous) (percentage)
482.sphinx3 (unexplained diff vs previous)
482.sphinx3 (unexplained diff vs previous) (percentage)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
401.bzip2 2.12% 66682.000 68094.000 - 0.00% -
433.milc 1.57% 128200.000 130212.000 - 0.00% -
447.dealII 1.34% 548786.000 556114.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
482.sphinx3 10.99% 664.000 737.000 - 5.14% -
401.bzip2 8.09% 2510.000 2713.000 - 0.00% -
456.hmmer 5.50% 2637.000 2782.000 - -0.32% -
473.astar 5.24% 4638.000 4881.000 - -0.02% -
400.perlbench 4.95% 1474.000 1547.000 - 2.72% -
450.soplex 3.89% 540.000 561.000 - 6.25% -
470.lbm 2.50% 3235.000 3316.000 - 0.61% -
471.omnetpp 2.42% 2153.000 2205.000 - -1.39% -
444.namd 1.79% 672.000 684.000 - 1.79% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
462.libquantum -14.82% 45013.000 38343.000 - 0.00% -
458.sjeng -2.27% 131729.000 128741.000 - 0.00% -
444.namd -2.22% 168697.000 164952.000 - 0.00% -
470.lbm -1.65% 10901.000 10721.000 - 0.00% -
471.omnetpp -1.63% 754667.000 742388.000 - 0.00% -
473.astar -1.55% 33048.000 32536.000 - 0.00% -
450.soplex -1.34% 319083.000 314807.000 - 0.00% -
400.perlbench -1.01% 1269683.000 1256832.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
429.mcf -26.40% 1879.000 1383.000 - -1.50% -
462.libquantum -25.93% 108.000 80.000 - 0.00% -
464.h264ref -3.88% 3965.000 3811.000 - 0.16% -
453.povray -3.09% 421.000 408.000 - 1.49% -
403.gcc -1.69% 59.000 58.000 - 1.75% -
447.dealII -1.30% 1001.000 988.000 - 0.71% -
458.sjeng -1.10% 6353.000 6283.000 - 0.14% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful 184.21% 19.000 54.000 - 0.00% -
nb_execution_successful 184.21% 19.000 54.000 - 0.00% -
nb_total_tests 113.79% 29.000 62.000 - 0.00% -

Added Tests - Code Size
410.bwaves
416.gamess
434.zeusmp
435.gromacs
436.cactusADM
437.leslie3d
459.GemsFDTD
465.tonto
481.wrf

Added Tests - Execution
410.bwaves
416.gamess
434.zeusmp
435.gromacs
436.cactusADM
437.leslie3d
459.GemsFDTD
465.tonto
481.wrf

Added Tests - sample variability
400.perlbench
400.perlbench (avg)
400.perlbench (avg) (percentage)
400.perlbench (max)
400.perlbench (max) (percentage)
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
401.bzip2 (unexplained diff vs previous)
401.bzip2 (unexplained diff vs previous) (percentage)
403.gcc
403.gcc (avg)
403.gcc (avg) (percentage)
403.gcc (max)
403.gcc (max) (percentage)
410.bwaves
410.bwaves (avg)
410.bwaves (avg) (percentage)
410.bwaves (max)
410.bwaves (max) (percentage)
410.bwaves (unexplained diff vs previous)
410.bwaves (unexplained diff vs previous) (percentage)
416.gamess
416.gamess (avg)
416.gamess (avg) (percentage)
416.gamess (max)
416.gamess (max) (percentage)
416.gamess (unexplained diff vs previous)
416.gamess (unexplained diff vs previous) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
433.milc
433.milc (avg)
433.milc (avg) (percentage)
433.milc (max)
433.milc (max) (percentage)
434.zeusmp
434.zeusmp (avg)
434.zeusmp (avg) (percentage)
434.zeusmp (max)
434.zeusmp (max) (percentage)
434.zeusmp (unexplained diff vs previous)
434.zeusmp (unexplained diff vs previous) (percentage)
435.gromacs
435.gromacs (avg)
435.gromacs (avg) (percentage)
435.gromacs (max)
435.gromacs (max) (percentage)
435.gromacs (unexplained diff vs previous)
435.gromacs (unexplained diff vs previous) (percentage)
436.cactusADM
436.cactusADM (avg)
436.cactusADM (avg) (percentage)
436.cactusADM (max)
436.cactusADM (max) (percentage)
436.cactusADM (unexplained diff vs previous)
436.cactusADM (unexplained diff vs previous) (percentage)
437.leslie3d
437.leslie3d (avg)
437.leslie3d (avg) (percentage)
437.leslie3d (max)
437.leslie3d (max) (percentage)
437.leslie3d (unexplained diff vs previous)
437.leslie3d (unexplained diff vs previous) (percentage)
444.namd
444.namd (avg)
444.namd (avg) (percentage)
444.namd (max)
444.namd (max) (percentage)
445.gobmk
445.gobmk (avg)
445.gobmk (avg) (percentage)
445.gobmk (max)
445.gobmk (max) (percentage)
447.dealII
447.dealII (avg)
447.dealII (avg) (percentage)
447.dealII (max)
447.dealII (max) (percentage)
450.soplex
450.soplex (avg)
450.soplex (avg) (percentage)
450.soplex (max)
450.soplex (max) (percentage)
453.povray
453.povray (avg)
453.povray (avg) (percentage)
453.povray (max)
453.povray (max) (percentage)
456.hmmer
456.hmmer (avg)
456.hmmer (avg) (percentage)
456.hmmer (max)
456.hmmer (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
459.GemsFDTD
459.GemsFDTD (avg)
459.GemsFDTD (avg) (percentage)
459.GemsFDTD (max)
459.GemsFDTD (max) (percentage)
459.GemsFDTD (unexplained diff vs previous)
459.GemsFDTD (unexplained diff vs previous) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)
462.libquantum (unexplained diff vs previous)
462.libquantum (unexplained diff vs previous) (percentage)
464.h264ref
464.h264ref (avg)
464.h264ref (avg) (percentage)
464.h264ref (max)
464.h264ref (max) (percentage)
465.tonto
465.tonto (avg)
465.tonto (avg) (percentage)
465.tonto (max)
465.tonto (max) (percentage)
470.lbm
470.lbm (avg)
470.lbm (avg) (percentage)
470.lbm (max)
470.lbm (max) (percentage)
471.omnetpp
471.omnetpp (avg)
471.omnetpp (avg) (percentage)
471.omnetpp (max)
471.omnetpp (max) (percentage)
473.astar
473.astar (avg)
473.astar (avg) (percentage)
473.astar (max)
473.astar (max) (percentage)
481.wrf
481.wrf (avg)
481.wrf (avg) (percentage)
481.wrf (max)
481.wrf (max) (percentage)
481.wrf (unexplained diff vs previous)
481.wrf (unexplained diff vs previous) (percentage)
482.sphinx3
482.sphinx3 (avg)
482.sphinx3 (avg) (percentage)
482.sphinx3 (max)
482.sphinx3 (max) (percentage)
483.xalancbmk (avg) (percentage)
483.xalancbmk (max) (percentage)


Report Time: 0.37s
Name Current %
400.perlbench 1547.000 2.72%
401.bzip2 2713.000 -
403.gcc 58.000 1.75%
410.bwaves 4605.000 1.81%
416.gamess 11879.000 -
429.mcf 1383.000 -1.50%
433.milc 1052.000 -
434.zeusmp 1915.000 -1.39%
435.gromacs 4398.000 2.78%
436.cactusADM 1305.000 -
437.leslie3d 6679.000 3.02%
444.namd 684.000 1.79%
445.gobmk 4588.000 -
447.dealII 988.000 -
450.soplex 561.000 6.25%
453.povray 408.000 1.49%
456.hmmer 2782.000 -
458.sjeng 6283.000 -
459.GemsFDTD 5382.000 3.26%
462.libquantum 80.000 -
464.h264ref 3811.000 -
465.tonto 20216.000 -
470.lbm 3316.000 -
471.omnetpp 2205.000 -1.39%
473.astar 4881.000 -
481.wrf 3254.000 1.09%
482.sphinx3 737.000 5.14%
Geometric Mean 1928.303 1.04%
Name Current %
400.perlbench 1256832.000 -
401.bzip2 68094.000 -
403.gcc 3787447.000 -
410.bwaves 657036.000 -
416.gamess 8283505.000 -
429.mcf 11448.000 -
433.milc 130212.000 -
434.zeusmp 1036783.000 -
435.gromacs 701840.000 -
436.cactusADM 1166478.000 -
437.leslie3d 953109.000 -
444.namd 164952.000 -
445.gobmk 2237332.000 -
447.dealII 556114.000 -
450.soplex 314807.000 -
453.povray 1125553.000 -
456.hmmer 163791.000 -
458.sjeng 128741.000 -
459.GemsFDTD 1247606.000 -
462.libquantum 38343.000 -
464.h264ref 768089.000 -
465.tonto 10069044.000 1.98%
470.lbm 10721.000 -
471.omnetpp 742388.000 -
473.astar 32536.000 -
481.wrf 5870767.000 -
482.sphinx3 175830.000 -
Geometric Mean 445113.562 -
Name Current %
400.perlbench 20.000 5.26%
400.perlbench (avg) 20.000 5.26%
400.perlbench (avg) (percentage) 1.310 -
400.perlbench (max) 19.000 5.56%
400.perlbench (max) (percentage) 1.230 -
401.bzip2 46.000 -4.17%
401.bzip2 (avg) 46.000 -4.17%
401.bzip2 (avg) (percentage) 1.710 -4.47%
401.bzip2 (max) 29.000 -6.45%
401.bzip2 (max) (percentage) 1.070 -6.96%
401.bzip2 (unexplained diff vs previous) 0.000 -
401.bzip2 (unexplained diff vs previous) (percentage) 0.000 -
403.gcc 2.000 -
403.gcc (avg) 2.000 -
403.gcc (avg) (percentage) 4.460 -4.50%
403.gcc (max) 5.000 -
403.gcc (max) (percentage) 8.740 -2.24%
403.gcc (unexplained diff vs previous) 1.000 -50.00%
403.gcc (unexplained diff vs previous) (percentage) 1.720 -51.00%
410.bwaves 35.000 6.06%
410.bwaves (avg) 35.000 6.06%
410.bwaves (avg) (percentage) 0.780 5.41%
410.bwaves (max) 83.000 69.39%
410.bwaves (max) (percentage) 1.810 64.55%
410.bwaves (unexplained diff vs previous) 82.000 115.79%
410.bwaves (unexplained diff vs previous) (percentage) 1.780 111.90%
416.gamess 22.000 4.76%
416.gamess (avg) 22.000 4.76%
416.gamess (avg) (percentage) 0.190 5.56%
416.gamess (max) 48.000 -7.69%
416.gamess (max) (percentage) 0.410 -6.82%
416.gamess (unexplained diff vs previous) 35.000 -
416.gamess (unexplained diff vs previous) (percentage) 0.290 -
429.mcf 54.000 -3.57%
429.mcf (avg) 54.000 -3.57%
429.mcf (avg) (percentage) 3.940 -1.99%
429.mcf (max) 147.000 -31.31%
429.mcf (max) (percentage) 10.660 -30.28%
429.mcf (unexplained diff vs previous) 21.000 -25.00%
429.mcf (unexplained diff vs previous) (percentage) 1.520 -23.62%
433.milc 10.000 -9.09%
433.milc (avg) 10.000 -9.09%
433.milc (avg) (percentage) 1.020 -2.86%
433.milc (max) 14.000 -22.22%
433.milc (max) (percentage) 1.350 -22.41%
433.milc (unexplained diff vs previous) 4.000 -42.86%
433.milc (unexplained diff vs previous) (percentage) 0.380 -43.28%
434.zeusmp 15.000 7.14%
434.zeusmp (avg) 15.000 7.14%
434.zeusmp (avg) (percentage) 0.800 5.26%
434.zeusmp (max) 33.000 -5.71%
434.zeusmp (max) (percentage) 1.770 -3.28%
434.zeusmp (unexplained diff vs previous) 27.000 -
434.zeusmp (unexplained diff vs previous) (percentage) 1.410 -
435.gromacs 104.000 4.00%
435.gromacs (avg) 104.000 4.00%
435.gromacs (avg) (percentage) 2.380 -
435.gromacs (max) 131.000 -14.94%
435.gromacs (max) (percentage) 3.000 -16.67%
435.gromacs (unexplained diff vs previous) 119.000 -
435.gromacs (unexplained diff vs previous) (percentage) 2.710 -
436.cactusADM 11.000 -8.33%
436.cactusADM (avg) 11.000 -8.33%
436.cactusADM (avg) (percentage) 0.910 -3.19%
436.cactusADM (max) 15.000 -11.76%
436.cactusADM (max) (percentage) 1.210 -11.03%
436.cactusADM (unexplained diff vs previous) 4.000 -55.56%
436.cactusADM (unexplained diff vs previous) (percentage) 0.310 -55.07%
437.leslie3d 259.000 1.97%
437.leslie3d (avg) 259.000 1.97%
437.leslie3d (avg) (percentage) 3.880 -1.27%
437.leslie3d (max) 201.000 -45.97%
437.leslie3d (max) (percentage) 3.020 -47.48%
437.leslie3d (unexplained diff vs previous) 196.000 -
437.leslie3d (unexplained diff vs previous) (percentage) 2.930 -
444.namd 6.000 -
444.namd (avg) 6.000 -
444.namd (avg) (percentage) 0.990 3.13%
444.namd (max) 12.000 50.00%
444.namd (max) (percentage) 1.790 46.72%
444.namd (unexplained diff vs previous) 12.000 -
444.namd (unexplained diff vs previous) (percentage) 1.750 -
445.gobmk 41.000 -4.65%
445.gobmk (avg) 41.000 -4.65%
445.gobmk (avg) (percentage) 0.910 -3.19%
445.gobmk (max) 35.000 -56.79%
445.gobmk (max) (percentage) 0.780 -55.93%
445.gobmk (unexplained diff vs previous) 15.000 -
445.gobmk (unexplained diff vs previous) (percentage) 0.330 -
447.dealII 14.000 -
447.dealII (avg) 14.000 -
447.dealII (avg) (percentage) 1.430 -2.72%
447.dealII (max) 26.000 -10.34%
447.dealII (max) (percentage) 2.670 -10.10%
447.dealII (unexplained diff vs previous) 7.000 -
447.dealII (unexplained diff vs previous) (percentage) 0.710 -
450.soplex 15.000 15.38%
450.soplex (avg) 15.000 15.38%
450.soplex (avg) (percentage) 2.750 6.59%
450.soplex (max) 35.000 52.17%
450.soplex (max) (percentage) 6.250 40.13%
450.soplex (unexplained diff vs previous) 33.000 -
450.soplex (unexplained diff vs previous) (percentage) 5.880 -
453.povray 4.000 -
453.povray (avg) 4.000 -
453.povray (avg) (percentage) 1.160 1.75%
453.povray (max) 6.000 200.00%
453.povray (max) (percentage) 1.490 170.91%
453.povray (unexplained diff vs previous) 6.000 -
453.povray (unexplained diff vs previous) (percentage) 1.470 -
456.hmmer 6.000 -
456.hmmer (avg) 6.000 -
456.hmmer (avg) (percentage) 0.240 -
456.hmmer (max) 12.000 -7.69%
456.hmmer (max) (percentage) 0.450 -6.25%
456.hmmer (unexplained diff vs previous) 9.000 -
456.hmmer (unexplained diff vs previous) (percentage) 0.320 -
458.sjeng 31.000 -
458.sjeng (avg) 31.000 -
458.sjeng (avg) (percentage) 0.500 -1.96%
458.sjeng (max) 47.000 -
458.sjeng (max) (percentage) 0.760 -
458.sjeng (unexplained diff vs previous) 9.000 12.50%
458.sjeng (unexplained diff vs previous) (percentage) 0.140 7.69%
459.GemsFDTD 66.000 15.79%
459.GemsFDTD (avg) 66.000 15.79%
459.GemsFDTD (avg) (percentage) 1.240 11.71%
459.GemsFDTD (max) 175.000 60.55%
459.GemsFDTD (max) (percentage) 3.260 54.50%
459.GemsFDTD (unexplained diff vs previous) 170.000 -
459.GemsFDTD (unexplained diff vs previous) (percentage) 3.160 -
462.libquantum 1.000 -
462.libquantum (avg) 1.000 -
462.libquantum (avg) (percentage) 1.920 -4.00%
462.libquantum (max) 4.000 -
462.libquantum (max) (percentage) 5.300 -2.75%
462.libquantum (unexplained diff vs previous) 0.000 -
462.libquantum (unexplained diff vs previous) (percentage) 0.000 -
464.h264ref 32.000 -5.88%
464.h264ref (avg) 32.000 -5.88%
464.h264ref (avg) (percentage) 0.860 -4.44%
464.h264ref (max) 15.000 -72.22%
464.h264ref (max) (percentage) 0.400 -71.83%
464.h264ref (unexplained diff vs previous) 6.000 -
464.h264ref (unexplained diff vs previous) (percentage) 0.160 -
465.tonto 196.000 -
465.tonto (avg) 196.000 -
465.tonto (avg) (percentage) 0.970 -
465.tonto (max) 183.000 -
465.tonto (max) (percentage) 0.910 -
470.lbm 29.000 -
470.lbm (avg) 29.000 -
470.lbm (avg) (percentage) 0.900 -1.10%
470.lbm (max) 24.000 -4.00%
470.lbm (max) (percentage) 0.750 -2.60%
470.lbm (unexplained diff vs previous) 20.000 400.00%
470.lbm (unexplained diff vs previous) (percentage) 0.600 400.00%
471.omnetpp 63.000 -3.08%
471.omnetpp (avg) 63.000 -3.08%
471.omnetpp (avg) (percentage) 2.870 -2.38%
471.omnetpp (max) 83.000 -7.78%
471.omnetpp (max) (percentage) 3.800 -6.40%
471.omnetpp (unexplained diff vs previous) 31.000 -
471.omnetpp (unexplained diff vs previous) (percentage) 1.410 -
473.astar 86.000 -3.37%
473.astar (avg) 86.000 -3.37%
473.astar (avg) (percentage) 1.770 -3.80%
473.astar (max) 128.000 -
473.astar (max) (percentage) 2.640 -
473.astar (unexplained diff vs previous) 1.000 -
473.astar (unexplained diff vs previous) (percentage) 0.020 -
481.wrf 40.000 2.56%
481.wrf (avg) 40.000 2.56%
481.wrf (avg) (percentage) 1.230 -
481.wrf (max) 79.000 -1.25%
481.wrf (max) (percentage) 2.440 -2.79%
481.wrf (unexplained diff vs previous) 35.000 -
481.wrf (unexplained diff vs previous) (percentage) 1.080 -
482.sphinx3 19.000 11.76%
482.sphinx3 (avg) 19.000 11.76%
482.sphinx3 (avg) (percentage) 2.610 5.24%
482.sphinx3 (max) 37.000 54.17%
482.sphinx3 (max) (percentage) 5.140 48.55%
482.sphinx3 (unexplained diff vs previous) 36.000 -
482.sphinx3 (unexplained diff vs previous) (percentage) 4.880 -
483.xalancbmk (avg) (percentage) 4.050 -
483.xalancbmk (max) (percentage) 6.490 -
Geometric Mean 5.394 -28.58%