Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/e240e6b8b7cc68a29bc8a5d6a7d0e3b7eaa61dc0 (+ 287 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_vect-spec2k6--llvm-arm-master-O3_LTO-build/7/
Filter

llvm-arm-master-O3_LTO test results

Run Order Start Time Duration
Current 0007 (llvmorg-17-init-05636-ge240e6b8b7cc) 2023-03-20T07:41:12 0:00:00
Previous 0006 (llvmorg-17-init-05349-gd0398d3593ba) 2023-03-18T19:32:43 0:00:00
No Baseline Run


Tests Summary

Status Group #
Performance Regressions 12
Performance Improvements 1
Added Tests 81
Unchanged Tests 650
Total Tests 744

Performance Regressions - Execution Δ Previous Current σ
429.mcf 8.85% 1277.000 1390.000 -
433.milc 8.42% 1117.000 1211.000 -
450.soplex 7.99% 563.000 608.000 -
462.libquantum 6.32% 95.000 101.000 -
482.sphinx3 5.16% 911.000 958.000 -
470.lbm 3.08% 2990.000 3082.000 -
483.xalancbmk 1.87% 2934.000 2989.000 -
473.astar 1.86% 4881.000 4972.000 -
401.bzip2 1.62% 2847.000 2893.000 -
447.dealII 1.59% 1067.000 1084.000 -
444.namd 1.59% 694.000 705.000 -
471.omnetpp 1.07% 2242.000 2266.000 -

Performance Improvements - Execution Δ Previous Current σ
403.gcc -3.28% 61.000 59.000 -

Added Tests - sample variability
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
403.gcc (max)
403.gcc (max) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
433.milc
433.milc (avg)
433.milc (avg) (percentage)
433.milc (max)
433.milc (max) (percentage)
444.namd
444.namd (avg)
444.namd (avg) (percentage)
444.namd (max)
444.namd (max) (percentage)
445.gobmk
445.gobmk (avg)
445.gobmk (avg) (percentage)
445.gobmk (max)
445.gobmk (max) (percentage)
447.dealII
447.dealII (avg)
447.dealII (avg) (percentage)
447.dealII (max)
447.dealII (max) (percentage)
450.soplex
450.soplex (avg)
450.soplex (avg) (percentage)
450.soplex (max)
450.soplex (max) (percentage)
453.povray
453.povray (avg)
453.povray (avg) (percentage)
453.povray (max)
453.povray (max) (percentage)
456.hmmer
456.hmmer (avg)
456.hmmer (avg) (percentage)
456.hmmer (max)
456.hmmer (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)
464.h264ref
464.h264ref (avg)
464.h264ref (avg) (percentage)
464.h264ref (max)
464.h264ref (max) (percentage)
470.lbm
470.lbm (avg)
470.lbm (avg) (percentage)
470.lbm (max)
470.lbm (max) (percentage)
471.omnetpp (max)
471.omnetpp (max) (percentage)
473.astar
473.astar (avg)
473.astar (avg) (percentage)
473.astar (max)
473.astar (max) (percentage)
482.sphinx3
482.sphinx3 (avg)
482.sphinx3 (avg) (percentage)
482.sphinx3 (max)
482.sphinx3 (max) (percentage)
483.xalancbmk (max)
483.xalancbmk (max) (percentage)


Report Time: 0.20s
Name Current %
401.bzip2 2893.000 1.62%
403.gcc 59.000 -3.28%
429.mcf 1390.000 8.85%
433.milc 1211.000 8.42%
444.namd 705.000 1.59%
445.gobmk 4949.000 -
447.dealII 1084.000 1.59%
450.soplex 608.000 7.99%
453.povray 420.000 -
456.hmmer 3501.000 -
458.sjeng 7507.000 -
462.libquantum 101.000 6.32%
464.h264ref 5181.000 -
470.lbm 3082.000 3.08%
471.omnetpp 2266.000 1.07%
473.astar 4972.000 1.86%
482.sphinx3 958.000 5.16%
483.xalancbmk 2989.000 1.87%
Geometric Mean 1390.870 2.64%
Name Current %
401.bzip2 64543.000 -
403.gcc 3828493.000 -
429.mcf 12471.000 -
433.milc 107474.000 -
444.namd 181004.000 -
445.gobmk 1842098.000 -
447.dealII 477780.000 -
450.soplex 286133.000 -
453.povray 1151868.000 -
456.hmmer 167055.000 -
458.sjeng 138799.000 -
462.libquantum 36309.000 -
464.h264ref 816918.000 -
470.lbm 10930.000 -
471.omnetpp 690771.000 -
473.astar 30771.000 -
482.sphinx3 177904.000 -
483.xalancbmk 3265798.000 -
Geometric Mean 221252.595 -
Name Current %
401.bzip2 46.000 -
401.bzip2 (avg) 46.000 -
401.bzip2 (avg) (percentage) 1.620 -
401.bzip2 (max) 46.000 -
401.bzip2 (max) (percentage) 1.620 -
401.bzip2 (unexplained diff vs previous) 46.000 -
401.bzip2 (unexplained diff vs previous) (percentage) 1.590 -
403.gcc (max) 0.000 -
403.gcc (max) (percentage) 0.000 -
429.mcf 123.000 -
429.mcf (avg) 123.000 -
429.mcf (avg) (percentage) 8.850 -
429.mcf (max) 123.000 -
429.mcf (max) (percentage) 8.850 -
429.mcf (unexplained diff vs previous) 113.000 -
429.mcf (unexplained diff vs previous) (percentage) 8.130 -
433.milc 101.000 -
433.milc (avg) 101.000 -
433.milc (avg) (percentage) 8.420 -
433.milc (max) 101.000 -
433.milc (max) (percentage) 8.420 -
433.milc (unexplained diff vs previous) 94.000 -
433.milc (unexplained diff vs previous) (percentage) 7.760 -
444.namd 11.000 -
444.namd (avg) 11.000 -
444.namd (avg) (percentage) 1.590 -
444.namd (max) 11.000 -
444.namd (max) (percentage) 1.590 -
444.namd (unexplained diff vs previous) 11.000 -
444.namd (unexplained diff vs previous) (percentage) 1.560 -
445.gobmk 37.000 -
445.gobmk (avg) 37.000 -
445.gobmk (avg) (percentage) 0.750 -
445.gobmk (max) 37.000 -
445.gobmk (max) (percentage) 0.750 -
445.gobmk (unexplained diff vs previous) 37.000 -
445.gobmk (unexplained diff vs previous) (percentage) 0.750 -
447.dealII 17.000 -
447.dealII (avg) 17.000 -
447.dealII (avg) (percentage) 1.590 -
447.dealII (max) 17.000 -
447.dealII (max) (percentage) 1.590 -
447.dealII (unexplained diff vs previous) 17.000 -
447.dealII (unexplained diff vs previous) (percentage) 1.570 -
450.soplex 48.000 -
450.soplex (avg) 48.000 -
450.soplex (avg) (percentage) 7.990 -
450.soplex (max) 48.000 -
450.soplex (max) (percentage) 7.990 -
450.soplex (unexplained diff vs previous) 45.000 -
450.soplex (unexplained diff vs previous) (percentage) 7.400 -
453.povray 2.000 -
453.povray (avg) 2.000 -
453.povray (avg) (percentage) 0.480 -
453.povray (max) 2.000 -
453.povray (max) (percentage) 0.480 -
453.povray (unexplained diff vs previous) 2.000 -
453.povray (unexplained diff vs previous) (percentage) 0.480 -
456.hmmer 14.000 -
456.hmmer (avg) 14.000 -
456.hmmer (avg) (percentage) 0.400 -
456.hmmer (max) 14.000 -
456.hmmer (max) (percentage) 0.400 -
456.hmmer (unexplained diff vs previous) 14.000 -
456.hmmer (unexplained diff vs previous) (percentage) 0.400 -
458.sjeng 11.000 -
458.sjeng (avg) 11.000 -
458.sjeng (avg) (percentage) 0.150 -
458.sjeng (max) 11.000 -
458.sjeng (max) (percentage) 0.150 -
458.sjeng (unexplained diff vs previous) 11.000 -
458.sjeng (unexplained diff vs previous) (percentage) 0.150 -
462.libquantum 6.000 -
462.libquantum (avg) 6.000 -
462.libquantum (avg) (percentage) 6.320 -
462.libquantum (max) 6.000 -
462.libquantum (max) (percentage) 6.320 -
462.libquantum (unexplained diff vs previous) 6.000 -
462.libquantum (unexplained diff vs previous) (percentage) 5.940 -
464.h264ref 39.000 -
464.h264ref (avg) 39.000 -
464.h264ref (avg) (percentage) 0.760 -
464.h264ref (max) 39.000 -
464.h264ref (max) (percentage) 0.760 -
464.h264ref (unexplained diff vs previous) 39.000 -
464.h264ref (unexplained diff vs previous) (percentage) 0.750 -
470.lbm 94.000 -
470.lbm (avg) 94.000 -
470.lbm (avg) (percentage) 3.080 -
470.lbm (max) 94.000 -
470.lbm (max) (percentage) 3.080 -
470.lbm (unexplained diff vs previous) 92.000 -
470.lbm (unexplained diff vs previous) (percentage) 2.990 -
471.omnetpp (max) 0.000 -
471.omnetpp (max) (percentage) 0.000 -
473.astar 92.000 -
473.astar (avg) 92.000 -
473.astar (avg) (percentage) 1.860 -
473.astar (max) 92.000 -
473.astar (max) (percentage) 1.860 -
473.astar (unexplained diff vs previous) 91.000 -
473.astar (unexplained diff vs previous) (percentage) 1.830 -
482.sphinx3 49.000 -
482.sphinx3 (avg) 49.000 -
482.sphinx3 (avg) (percentage) 5.160 -
482.sphinx3 (max) 49.000 -
482.sphinx3 (max) (percentage) 5.160 -
482.sphinx3 (unexplained diff vs previous) 47.000 -
482.sphinx3 (unexplained diff vs previous) (percentage) 4.910 -
483.xalancbmk (max) 0.000 -
483.xalancbmk (max) (percentage) 0.000 -
Geometric Mean 4.675 2155952284059453882368.00%