Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/31dda3913f9d99049845b02202ee9fc9a4971de9 (+ 4795 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_vect-spec2k6--llvm-arm-master-O3-build/46/
Filter

llvm-arm-master-O3 test results

Run Order Start Time Duration
Current 0046 (llvmorg-17-init-17667-g31dda3913f9d) 2023-06-20T18:36:51 0:00:00
Previous 0038 (llvmorg-17-init-12872-gc8319cf95859) 2023-05-30T02:29:06 0:00:00
Baseline 0006 (llvmorg-17-init-05342-g7ba9c060d48f) 2023-03-18T09:13:31 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 9 7
Performance Improvements 0 8
Added Tests 3 90
Unchanged Tests 756 663
Total Tests 768

Performance Regressions - Code Size Δ Previous Current σ Δ (B) σ (B)
433.milc 2.25% 129286.000 132194.000 - 2.99% -

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
403.gcc 5.00% 60.000 63.000 - 1.61% -
483.xalancbmk 1.78% 3654.000 3719.000 - 1.09% -
464.h264ref 1.60% 5235.000 5319.000 - 0.82% -
401.bzip2 1.58% 2717.000 2760.000 - -1.22% -
444.namd 1.43% 698.000 708.000 - 1.43% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
444.namd (max) 33.33% 3.000 4.000 - 0.00% -
470.lbm 6.67% 15.000 16.000 - 0.00% -
470.lbm (avg) 6.67% 15.000 16.000 - 0.00% -

Added Tests - sample variability
462.libquantum
462.libquantum (avg)
482.sphinx3 (max)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
433.milc 2.99% 128358.000 132194.000 - 2.25% -
471.omnetpp 1.10% 536824.000 542748.000 - 0.50% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
456.hmmer 3.38% 3226.000 3335.000 - -0.06% -
447.dealII 1.78% 1352.000 1376.000 - 0.15% -
403.gcc 1.61% 62.000 63.000 - 5.00% -
444.namd 1.43% 698.000 708.000 - 1.43% -
483.xalancbmk 1.09% 3679.000 3719.000 - 1.78% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
450.soplex -9.86% 578.000 521.000 - 0.39% -
429.mcf -7.59% 1291.000 1193.000 - -0.17% -
433.milc -6.97% 1191.000 1108.000 - 0.27% -
470.lbm -5.64% 2978.000 2810.000 - 0.50% -
482.sphinx3 -3.72% 914.000 880.000 - 0.00% -
473.astar -2.45% 4900.000 4780.000 - -0.67% -
453.povray -1.92% 469.000 460.000 - -0.43% -
401.bzip2 -1.22% 2794.000 2760.000 - 1.58% -

Added Tests - sample variability
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
403.gcc
403.gcc (avg)
403.gcc (avg) (percentage)
403.gcc (max)
403.gcc (max) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
433.milc
433.milc (avg)
433.milc (avg) (percentage)
433.milc (max)
433.milc (max) (percentage)
444.namd
444.namd (avg)
444.namd (avg) (percentage)
444.namd (max)
444.namd (max) (percentage)
445.gobmk
445.gobmk (avg)
445.gobmk (avg) (percentage)
445.gobmk (max)
445.gobmk (max) (percentage)
447.dealII
447.dealII (avg)
447.dealII (avg) (percentage)
447.dealII (max)
447.dealII (max) (percentage)
450.soplex
450.soplex (avg)
450.soplex (avg) (percentage)
450.soplex (max)
450.soplex (max) (percentage)
453.povray
453.povray (avg)
453.povray (avg) (percentage)
453.povray (max)
453.povray (max) (percentage)
456.hmmer
456.hmmer (avg)
456.hmmer (avg) (percentage)
456.hmmer (max)
456.hmmer (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)
464.h264ref
464.h264ref (avg)
464.h264ref (avg) (percentage)
464.h264ref (max)
464.h264ref (max) (percentage)
470.lbm
470.lbm (avg)
470.lbm (avg) (percentage)
470.lbm (max)
470.lbm (max) (percentage)
471.omnetpp
471.omnetpp (avg)
471.omnetpp (avg) (percentage)
471.omnetpp (max)
471.omnetpp (max) (percentage)
473.astar
473.astar (avg)
473.astar (avg) (percentage)
473.astar (max)
473.astar (max) (percentage)
482.sphinx3
482.sphinx3 (avg)
482.sphinx3 (avg) (percentage)
482.sphinx3 (max)
482.sphinx3 (max) (percentage)
483.xalancbmk
483.xalancbmk (avg)
483.xalancbmk (avg) (percentage)
483.xalancbmk (max)
483.xalancbmk (max) (percentage)


Report Time: 0.33s
Name Current %
401.bzip2 2760.000 1.58%
403.gcc 63.000 5.00%
429.mcf 1193.000 -
433.milc 1108.000 -
444.namd 708.000 1.43%
445.gobmk 5341.000 -
447.dealII 1376.000 -
450.soplex 521.000 -
453.povray 460.000 -
456.hmmer 3335.000 -
458.sjeng 8180.000 -
462.libquantum 103.000 -
464.h264ref 5319.000 1.60%
470.lbm 2810.000 -
471.omnetpp 2657.000 -
473.astar 4780.000 -
482.sphinx3 880.000 -
483.xalancbmk 3719.000 1.78%
Geometric Mean 1412.402 -
Name Current %
401.bzip2 76527.000 -
403.gcc 3279768.000 -
429.mcf 11938.000 -
433.milc 132194.000 2.25%
444.namd 223739.000 -
445.gobmk 1664403.000 -
447.dealII 2764724.000 -
450.soplex 321451.000 -
453.povray 923999.000 -
456.hmmer 269352.000 -
458.sjeng 146404.000 -
462.libquantum 34632.000 -
464.h264ref 767962.000 -
470.lbm 11368.000 -
471.omnetpp 542748.000 -
473.astar 36439.000 -
482.sphinx3 169683.000 -
483.xalancbmk 3459055.000 -
Geometric Mean 251973.073 -
Name Current %
401.bzip2 11.000 -
401.bzip2 (avg) 11.000 -
401.bzip2 (avg) (percentage) 0.430 -
401.bzip2 (max) 17.000 -
401.bzip2 (max) (percentage) 0.640 -
403.gcc 1.000 -
403.gcc (avg) 1.000 -
403.gcc (avg) (percentage) 2.970 -
403.gcc (max) 2.000 -
403.gcc (max) (percentage) 3.870 -
429.mcf 8.000 -
429.mcf (avg) 8.000 -
429.mcf (avg) (percentage) 0.720 -
429.mcf (max) 9.000 -
429.mcf (max) (percentage) 0.820 -
433.milc 7.000 -
433.milc (avg) 7.000 -
433.milc (avg) (percentage) 0.650 -
433.milc (max) 8.000 -
433.milc (max) (percentage) 0.790 -
444.namd 3.000 -
444.namd (avg) 3.000 -
444.namd (avg) (percentage) 0.490 -
444.namd (max) 4.000 33.33%
444.namd (max) (percentage) 0.570 -
445.gobmk 19.000 -
445.gobmk (avg) 19.000 -
445.gobmk (avg) (percentage) 0.370 -
445.gobmk (max) 41.000 -
445.gobmk (max) (percentage) 0.780 -
447.dealII 12.000 -
447.dealII (avg) 12.000 -
447.dealII (avg) (percentage) 0.900 -
447.dealII (max) 14.000 -
447.dealII (max) (percentage) 1.050 -
450.soplex 10.000 -
450.soplex (avg) 10.000 -
450.soplex (avg) (percentage) 1.950 -
450.soplex (max) 11.000 -
450.soplex (max) (percentage) 2.120 -
453.povray 4.000 -
453.povray (avg) 4.000 -
453.povray (avg) (percentage) 0.890 -
453.povray (max) 8.000 -
453.povray (max) (percentage) 1.760 -
456.hmmer 7.000 -
456.hmmer (avg) 7.000 -
456.hmmer (avg) (percentage) 0.220 -
456.hmmer (max) 10.000 -
456.hmmer (max) (percentage) 0.320 -
458.sjeng 24.000 -
458.sjeng (avg) 24.000 -
458.sjeng (avg) (percentage) 0.300 -
458.sjeng (max) 31.000 -
458.sjeng (max) (percentage) 0.380 -
462.libquantum 0.000 -
462.libquantum (avg) 0.000 -
462.libquantum (avg) (percentage) 0.800 -
462.libquantum (max) 1.000 -
462.libquantum (max) (percentage) 1.920 -
464.h264ref 6.000 -
464.h264ref (avg) 6.000 -
464.h264ref (avg) (percentage) 0.130 -
464.h264ref (max) 7.000 -
464.h264ref (max) (percentage) 0.150 -
470.lbm 16.000 6.67%
470.lbm (avg) 16.000 6.67%
470.lbm (avg) (percentage) 0.570 -
470.lbm (max) 10.000 -
470.lbm (max) (percentage) 0.360 -
471.omnetpp 18.000 -
471.omnetpp (avg) 18.000 -
471.omnetpp (avg) (percentage) 0.710 -
471.omnetpp (max) 8.000 -
471.omnetpp (max) (percentage) 0.320 -
473.astar 15.000 -
473.astar (avg) 15.000 -
473.astar (avg) (percentage) 0.330 -
473.astar (max) 17.000 -
473.astar (max) (percentage) 0.370 -
482.sphinx3 2.000 -
482.sphinx3 (avg) 2.000 -
482.sphinx3 (avg) (percentage) 0.300 -
482.sphinx3 (max) 0.000 -
482.sphinx3 (max) (percentage) 0.080 -
483.xalancbmk 27.000 -
483.xalancbmk (avg) 27.000 -
483.xalancbmk (avg) (percentage) 0.740 -
483.xalancbmk (max) 42.000 -
483.xalancbmk (max) (percentage) 1.150 -
Geometric Mean 2.053 -28.65%