Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/42b5b720caf62e0710b9c1e32e894d8606106a19 (+ 257 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-spec2k6--llvm-arm-master-O3-build/159/
Filter

llvm-arm-master-O3 test results

Run Order Start Time Duration
Current 0159 (llvmorg-19-init-01423-g42b5b720caf6) 2024-01-31T15:40:07 0:00:00
Previous 0158 (llvmorg-19-init-01166-g78b4e7c5e349) 2024-01-25T21:54:26 0:00:00
Baseline 0079 (llvmorg-18-init-07933-ge13bed4c5f35) 2023-10-06T11:29:06 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 10 2
Performance Improvements 12 1
Added Tests 9 26
Unchanged Tests 245 247
Total Tests 276

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
450.soplex 20.00% 15.000 18.000 - 0.00% -
403.gcc 1.52% 132.000 134.000 - 0.00% -
401.bzip2 1.03% 11213.000 11328.000 - 0.21% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
401.bzip2 (max) 8.41% 107.000 116.000 - 0.00% -
401.bzip2 (max) (percentage) 7.29% 0.960 1.030 - 0.00% -
458.sjeng 3.33% 60.000 62.000 - 0.00% -
458.sjeng (avg) 3.33% 60.000 62.000 - 0.00% -
458.sjeng (avg) (percentage) 2.33% 0.430 0.440 - 0.00% -
401.bzip2 1.02% 98.000 99.000 - 0.00% -
401.bzip2 (avg) 1.02% 98.000 99.000 - 0.00% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
462.libquantum (max) -71.43% 49.000 14.000 - 0.00% -
462.libquantum (max) (percentage) -70.59% 0.340 0.100 - 0.00% -
458.sjeng (max) (percentage) -31.63% 0.980 0.670 - 0.00% -
429.mcf (max) -31.25% 16.000 11.000 - 0.00% -
458.sjeng (max) -31.16% 138.000 95.000 - 0.00% -
429.mcf (max) (percentage) -29.41% 0.170 0.120 - 0.00% -
462.libquantum -6.25% 32.000 30.000 - 0.00% -
462.libquantum (avg) -6.25% 32.000 30.000 - 0.00% -
429.mcf -5.56% 18.000 17.000 - 0.00% -
429.mcf (avg) -5.56% 18.000 17.000 - 0.00% -
429.mcf (avg) (percentage) -5.26% 0.190 0.180 - 0.00% -
462.libquantum (avg) (percentage) -4.55% 0.220 0.210 - 0.00% -

Added Tests - Execution
482.sphinx3

Added Tests - sample variability
401.bzip2 (unexplained diff vs previous)
401.bzip2 (unexplained diff vs previous) (percentage)
429.mcf (unexplained diff vs previous)
429.mcf (unexplained diff vs previous) (percentage)
458.sjeng (unexplained diff vs previous)
458.sjeng (unexplained diff vs previous) (percentage)
462.libquantum (unexplained diff vs previous)
462.libquantum (unexplained diff vs previous) (percentage)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
401.bzip2 1.36% 79295.000 80375.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
458.sjeng 2.85% 13872.000 14268.000 - 0.67% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
429.mcf -1.20% 11954.000 11810.000 - 0.00% -

Added Tests - Execution
403.gcc
433.milc
450.soplex
470.lbm
482.sphinx3
483.xalancbmk

Added Tests - sample variability
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)


Report Time: 0.19s
Name Current %
401.bzip2 11328.000 1.03%
403.gcc 134.000 1.52%
429.mcf 9672.000 -
433.milc 5.000 -
450.soplex 18.000 20.00%
458.sjeng 14268.000 -
462.libquantum 14684.000 -
470.lbm 1.000 -
482.sphinx3 1.000 -
483.xalancbmk 2674.000 -
Geometric Mean 243.752 -44.43%
Name Current %
401.bzip2 80375.000 -
429.mcf 11810.000 -
458.sjeng 146148.000 -
462.libquantum 33760.000 -
Geometric Mean 46520.198 -