Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/03e8637a9162204d24439f503950bf8c53ce18eb (+ 2486 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-cpu2017rate--llvm-arm-master-O3_LTO-build/43/
Filter

llvm-arm-master-O3_LTO test results

Run Order Start Time Duration
Current 0043 (llvmorg-17-init-14955-g03e8637a9162) 2023-06-04T14:32:11 0:00:00
Previous 0036 (llvmorg-17-init-12469-g0f619ce18c78) 2023-05-23T12:16:52 0:00:00
Baseline 0017 (llvmorg-17-init-07925-g40276f78fd4d) 2023-04-13T10:09:36 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 2 1
Performance Improvements 14 4
Added Tests 4 19
Unchanged Tests 202 198
Total Tests 222

Performance Regressions - Code Size Δ Previous Current σ Δ (B) σ (B)
505.mcf_r 19.87% 22804.000 27336.000 - -1.20% -
557.xz_r 1.30% 139407.000 141219.000 - 2.07% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
505.mcf_r -9.82% 13131.000 11842.000 - -1.32% -
557.xz_r -3.50% 10066.000 9714.000 - -3.12% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
557.xz_r -25.00% 4.000 3.000 - 0.00% -
557.xz_r (avg) -25.00% 4.000 3.000 - 0.00% -
557.xz_r (max) -20.00% 5.000 4.000 - 0.00% -
505.mcf_r (max) -18.18% 22.000 18.000 - 0.00% -
505.mcf_r -10.00% 10.000 9.000 - 0.00% -
505.mcf_r (avg) -10.00% 10.000 9.000 - 0.00% -
505.mcf_r (max) (percentage) -5.88% 0.170 0.160 - 0.00% -
531.deepsjeng_r (max) -5.43% 129.000 122.000 - 0.00% -
531.deepsjeng_r (max) (percentage) -4.50% 1.110 1.060 - 0.00% -
531.deepsjeng_r -1.18% 85.000 84.000 - 0.00% -
531.deepsjeng_r (avg) -1.18% 85.000 84.000 - 0.00% -

Performance Improvements - Score Δ Previous Current σ Δ (B) σ (B)
nb_execution_successful 200.00% 3.000 9.000 - 200.00% -

Added Tests - Code Size
519.lbm_r
523.xalancbmk_r

Added Tests - Execution
519.lbm_r
523.xalancbmk_r

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
557.xz_r 2.07% 138351.000 141219.000 - 1.30% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
505.mcf_r -1.20% 27668.000 27336.000 - 19.87% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
557.xz_r -3.12% 10027.000 9714.000 - -3.50% -
505.mcf_r -1.32% 12001.000 11842.000 - -9.82% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_execution_successful 200.00% 3.000 9.000 - 200.00% -

Added Tests - Code Size
519.lbm_r
523.xalancbmk_r

Added Tests - Execution
519.lbm_r
523.xalancbmk_r

Added Tests - sample variability
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)


Report Time: 0.20s
Name Current %
505.mcf_r 11842.000 -9.82%
519.lbm_r 1.000 -
523.xalancbmk_r 2517.000 -
531.deepsjeng_r 11598.000 -
557.xz_r 9714.000 -3.50%
Geometric Mean 1274.168 -88.99%
Name Current %
505.mcf_r 27336.000 19.87%
519.lbm_r 11062.000 -
523.xalancbmk_r 3643634.000 -
531.deepsjeng_r 111904.000 -
557.xz_r 141219.000 1.30%
Geometric Mean 111729.646 58.06%
Name Current %
nb_compile_successful 16.000 -
nb_execution_successful 9.000 200.00%
nb_total_tests 16.000 -
Geometric Mean 13.208 44.22%