Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/64276eec7ed07e762ef90c248a36cbafdcd7bd81 (+ 235 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_vect-spec2k6--llvm-arm-master-O3-build/7/
Filter

llvm-arm-master-O3 test results

Run Order Start Time Duration
Current 0007 (llvmorg-17-init-05577-g64276eec7ed0) 2023-03-19T22:52:48 0:00:00
Previous 0006 (llvmorg-17-init-05342-g7ba9c060d48f) 2023-03-18T09:13:31 0:00:00
No Baseline Run


Tests Summary

Status Group #
Performance Regressions 2
Performance Improvements 1
Added Tests 81
Unchanged Tests 636
Total Tests 720

Performance Regressions - Execution Δ Previous Current σ
447.dealII 2.88% 1352.000 1391.000 -
471.omnetpp 1.13% 2666.000 2696.000 -

Performance Improvements - Execution Δ Previous Current σ
403.gcc -4.84% 62.000 59.000 -

Added Tests - sample variability
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
433.milc
433.milc (avg)
433.milc (avg) (percentage)
433.milc (max)
433.milc (max) (percentage)
444.namd
444.namd (avg)
444.namd (avg) (percentage)
444.namd (max)
444.namd (max) (percentage)
445.gobmk
445.gobmk (avg)
445.gobmk (avg) (percentage)
445.gobmk (max)
445.gobmk (max) (percentage)
447.dealII (max)
447.dealII (max) (percentage)
450.soplex
450.soplex (avg)
450.soplex (avg) (percentage)
450.soplex (max)
450.soplex (max) (percentage)
453.povray (max)
453.povray (max) (percentage)
456.hmmer
456.hmmer (avg)
456.hmmer (avg) (percentage)
456.hmmer (max)
456.hmmer (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)
462.libquantum (unexplained diff vs previous)
462.libquantum (unexplained diff vs previous) (percentage)
464.h264ref
464.h264ref (avg)
464.h264ref (avg) (percentage)
464.h264ref (max)
464.h264ref (max) (percentage)
470.lbm
470.lbm (avg)
470.lbm (avg) (percentage)
470.lbm (max)
470.lbm (max) (percentage)
471.omnetpp
471.omnetpp (avg)
471.omnetpp (avg) (percentage)
471.omnetpp (max)
471.omnetpp (max) (percentage)
473.astar
473.astar (avg)
473.astar (avg) (percentage)
473.astar (max)
473.astar (max) (percentage)
482.sphinx3
482.sphinx3 (avg)
482.sphinx3 (avg) (percentage)
482.sphinx3 (max)
482.sphinx3 (max) (percentage)
483.xalancbmk
483.xalancbmk (avg)
483.xalancbmk (avg) (percentage)
483.xalancbmk (max)
483.xalancbmk (max) (percentage)


Report Time: 0.23s
Name Current %
401.bzip2 2806.000 -
403.gcc 59.000 -4.84%
429.mcf 1279.000 -
433.milc 1187.000 -
444.namd 694.000 -
445.gobmk 5390.000 -
447.dealII 1391.000 2.88%
450.soplex 576.000 -
453.povray 469.000 -
456.hmmer 3249.000 -
458.sjeng 8265.000 -
462.libquantum 104.000 -
464.h264ref 5273.000 -
470.lbm 2977.000 -
471.omnetpp 2696.000 1.13%
473.astar 4942.000 -
482.sphinx3 916.000 -
483.xalancbmk 3649.000 -
Geometric Mean 1437.821 -
Name Current %
401.bzip2 76651.000 -
403.gcc 3277048.000 -
429.mcf 11906.000 -
433.milc 128358.000 -
444.namd 224547.000 -
445.gobmk 1668739.000 -
447.dealII 2754428.000 -
450.soplex 321475.000 -
453.povray 924787.000 -
456.hmmer 269240.000 -
458.sjeng 146364.000 -
462.libquantum 34560.000 -
464.h264ref 767882.000 -
470.lbm 11352.000 -
471.omnetpp 536840.000 -
473.astar 36483.000 -
482.sphinx3 169711.000 -
483.xalancbmk 3449387.000 -
Geometric Mean 251349.590 -
Name Current %
401.bzip2 12.000 -
401.bzip2 (avg) 12.000 -
401.bzip2 (avg) (percentage) 0.430 -
401.bzip2 (max) 12.000 -
401.bzip2 (max) (percentage) 0.430 -
401.bzip2 (unexplained diff vs previous) 12.000 -
401.bzip2 (unexplained diff vs previous) (percentage) 0.430 -
429.mcf 11.000 -
429.mcf (avg) 11.000 -
429.mcf (avg) (percentage) 0.930 -
429.mcf (max) 11.000 -
429.mcf (max) (percentage) 0.930 -
429.mcf (unexplained diff vs previous) 12.000 -
429.mcf (unexplained diff vs previous) (percentage) 0.940 -
433.milc 4.000 -
433.milc (avg) 4.000 -
433.milc (avg) (percentage) 0.340 -
433.milc (max) 4.000 -
433.milc (max) (percentage) 0.340 -
433.milc (unexplained diff vs previous) 4.000 -
433.milc (unexplained diff vs previous) (percentage) 0.340 -
444.namd 3.000 -
444.namd (avg) 3.000 -
444.namd (avg) (percentage) 0.570 -
444.namd (max) 3.000 -
444.namd (max) (percentage) 0.570 -
444.namd (unexplained diff vs previous) 4.000 -
444.namd (unexplained diff vs previous) (percentage) 0.580 -
445.gobmk 5.000 -
445.gobmk (avg) 5.000 -
445.gobmk (avg) (percentage) 0.110 -
445.gobmk (max) 5.000 -
445.gobmk (max) (percentage) 0.110 -
445.gobmk (unexplained diff vs previous) 6.000 -
445.gobmk (unexplained diff vs previous) (percentage) 0.110 -
447.dealII (max) 0.000 -
447.dealII (max) (percentage) 0.000 -
450.soplex 2.000 -
450.soplex (avg) 2.000 -
450.soplex (avg) (percentage) 0.350 -
450.soplex (max) 2.000 -
450.soplex (max) (percentage) 0.350 -
450.soplex (unexplained diff vs previous) 2.000 -
450.soplex (unexplained diff vs previous) (percentage) 0.350 -
453.povray (max) 0.000 -
453.povray (max) (percentage) 0.000 -
456.hmmer 23.000 -
456.hmmer (avg) 23.000 -
456.hmmer (avg) (percentage) 0.710 -
456.hmmer (max) 23.000 -
456.hmmer (max) (percentage) 0.710 -
456.hmmer (unexplained diff vs previous) 23.000 -
456.hmmer (unexplained diff vs previous) (percentage) 0.710 -
458.sjeng 22.000 -
458.sjeng (avg) 22.000 -
458.sjeng (avg) (percentage) 0.270 -
458.sjeng (max) 22.000 -
458.sjeng (max) (percentage) 0.270 -
458.sjeng (unexplained diff vs previous) 22.000 -
458.sjeng (unexplained diff vs previous) (percentage) 0.270 -
462.libquantum 0.000 -
462.libquantum (avg) 0.000 -
462.libquantum (avg) (percentage) 0.000 -
462.libquantum (max) 0.000 -
462.libquantum (max) (percentage) 0.000 -
462.libquantum (unexplained diff vs previous) 0.000 -
462.libquantum (unexplained diff vs previous) (percentage) 0.000 -
464.h264ref 3.000 -
464.h264ref (avg) 3.000 -
464.h264ref (avg) (percentage) 0.060 -
464.h264ref (max) 3.000 -
464.h264ref (max) (percentage) 0.060 -
464.h264ref (unexplained diff vs previous) 3.000 -
464.h264ref (unexplained diff vs previous) (percentage) 0.060 -
470.lbm 0.000 -
470.lbm (avg) 0.000 -
470.lbm (avg) (percentage) 0.030 -
470.lbm (max) 0.000 -
470.lbm (max) (percentage) 0.030 -
470.lbm (unexplained diff vs previous) 1.000 -
470.lbm (unexplained diff vs previous) (percentage) 0.030 -
471.omnetpp 30.000 -
471.omnetpp (avg) 30.000 -
471.omnetpp (avg) (percentage) 1.130 -
471.omnetpp (max) 30.000 -
471.omnetpp (max) (percentage) 1.130 -
471.omnetpp (unexplained diff vs previous) 30.000 -
471.omnetpp (unexplained diff vs previous) (percentage) 1.110 -
473.astar 42.000 -
473.astar (avg) 42.000 -
473.astar (avg) (percentage) 0.860 -
473.astar (max) 42.000 -
473.astar (max) (percentage) 0.860 -
473.astar (unexplained diff vs previous) 42.000 -
473.astar (unexplained diff vs previous) (percentage) 0.850 -
482.sphinx3 2.000 -
482.sphinx3 (avg) 2.000 -
482.sphinx3 (avg) (percentage) 0.220 -
482.sphinx3 (max) 2.000 -
482.sphinx3 (max) (percentage) 0.220 -
482.sphinx3 (unexplained diff vs previous) 2.000 -
482.sphinx3 (unexplained diff vs previous) (percentage) 0.220 -
483.xalancbmk 29.000 -
483.xalancbmk (avg) 29.000 -
483.xalancbmk (avg) (percentage) 0.820 -
483.xalancbmk (max) 29.000 -
483.xalancbmk (max) (percentage) 0.820 -
483.xalancbmk (unexplained diff vs previous) 30.000 -
483.xalancbmk (unexplained diff vs previous) (percentage) 0.820 -
Geometric Mean 0.565 595998412474053689344.00%