Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/1f21e49870feebe6971be4db8d32eee646368cc4 (+ 412 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-spec2k6--llvm-arm-master-O3-build/86/
Filter

llvm-arm-master-O3 test results

Run Order Start Time Duration
Current 0086 (llvmorg-18-init-11182-g1f21e49870fe) 2023-11-05T15:21:37 0:00:00
Previous 0085 (llvmorg-18-init-10770-g19bfe08c7f5f) 2023-11-02T02:03:53 0:00:00
Baseline 0079 (llvmorg-18-init-07933-ge13bed4c5f35) 2023-10-06T11:29:06 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 8 1
Performance Improvements 13 1
Added Tests 2 20
Unchanged Tests 253 254
Total Tests 276

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
401.bzip2 (unexplained diff vs previous) 63.16% 19.000 31.000 - 0.00% -
401.bzip2 (max) (percentage) 58.82% 0.170 0.270 - 0.00% -
401.bzip2 (unexplained diff vs previous) (percentage) 58.82% 0.170 0.270 - 0.00% -
401.bzip2 58.33% 12.000 19.000 - 0.00% -
401.bzip2 (avg) 58.33% 12.000 19.000 - 0.00% -
401.bzip2 (max) 57.89% 19.000 30.000 - 0.00% -
401.bzip2 (avg) (percentage) 54.55% 0.110 0.170 - 0.00% -
429.mcf (unexplained diff vs previous) 50.00% 2.000 3.000 - 0.00% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
462.libquantum (unexplained diff vs previous) -83.33% 6.000 1.000 - 0.00% -
462.libquantum (unexplained diff vs previous) (percentage) -75.00% 0.040 0.010 - 0.00% -
458.sjeng -43.48% 138.000 78.000 - 0.00% -
458.sjeng (avg) -43.48% 138.000 78.000 - 0.00% -
458.sjeng (avg) (percentage) -42.86% 0.980 0.560 - 0.00% -
462.libquantum -27.27% 11.000 8.000 - 0.00% -
462.libquantum (avg) -27.27% 11.000 8.000 - 0.00% -
462.libquantum (avg) (percentage) -25.00% 0.080 0.060 - 0.00% -
429.mcf (max) -25.00% 4.000 3.000 - 0.00% -
429.mcf (max) (percentage) -20.00% 0.050 0.040 - 0.00% -
462.libquantum (max) -9.09% 22.000 20.000 - 0.00% -
458.sjeng (max) -4.39% 114.000 109.000 - 0.00% -
458.sjeng (max) (percentage) -3.70% 0.810 0.780 - 0.00% -

Added Tests - sample variability
458.sjeng (unexplained diff vs previous)
458.sjeng (unexplained diff vs previous) (percentage)

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
458.sjeng 1.38% 13872.000 14063.000 - -0.20% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
429.mcf -1.07% 11954.000 11826.000 - 0.00% -

Added Tests - sample variability
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)


Report Time: 0.20s
Name Current %
401.bzip2 11349.000 -
429.mcf 9669.000 -
458.sjeng 14063.000 -
462.libquantum 14690.000 -
Geometric Mean 12270.429 -
Name Current %
401.bzip2 79227.000 -
429.mcf 11826.000 -
458.sjeng 145504.000 -
462.libquantum 33792.000 -
Geometric Mean 46328.686 -