Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/eb7698254ab668e53133062fbc53b9635de95c4d (+ 600 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-cpu2017rate--llvm-arm-master-O3-build/91/
Filter

llvm-arm-master-O3 test results

Run Order Start Time Duration
Current 0091 (llvmorg-18-init-12169-geb7698254ab6) 2023-11-15T06:32:28 0:00:00
Previous 0088 (llvmorg-18-init-11036-g6a451ea5b443) 2023-11-03T17:32:42 0:00:00
Baseline 0015 (llvmorg-17-init-07405-g0f9842c21c76) 2023-04-07T17:38:29 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 12 3
Performance Improvements 4 2
Added Tests 5 20
Unchanged Tests 201 197
Total Tests 222

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
531.deepsjeng_r (max) 138.71% 93.000 222.000 - 0.00% -
531.deepsjeng_r (max) (percentage) 137.50% 0.880 2.090 - 0.00% -
531.deepsjeng_r (avg) (percentage) 31.82% 0.660 0.870 - 0.00% -
531.deepsjeng_r 31.43% 70.000 92.000 - 0.00% -
531.deepsjeng_r (avg) 31.43% 70.000 92.000 - 0.00% -
505.mcf_r (max) 23.81% 42.000 52.000 - 0.00% -
505.mcf_r (max) (percentage) 23.33% 0.300 0.370 - 0.00% -
505.mcf_r 9.09% 22.000 24.000 - 0.00% -
505.mcf_r (avg) 9.09% 22.000 24.000 - 0.00% -
505.mcf_r (avg) (percentage) 6.25% 0.160 0.170 - 0.00% -

Performance Regressions - Score Δ Previous Current σ Δ (B) σ (B)
nb_compile_successful -18.75% 16.000 13.000 - -18.75% -
nb_total_tests -18.75% 16.000 13.000 - -18.75% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
557.xz_r (max) -46.15% 13.000 7.000 - 0.00% -
557.xz_r (max) (percentage) -46.15% 0.130 0.070 - 0.00% -
557.xz_r -12.50% 8.000 7.000 - 0.00% -
557.xz_r (avg) -12.50% 8.000 7.000 - 0.00% -

Added Tests - Execution
519.lbm_r
523.xalancbmk_r
538.imagick_r
541.leela_r

Added Tests - Score
nb_execution_successful

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
505.mcf_r 1.45% 13925.000 14127.000 - -0.04% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -18.75% 16.000 13.000 - -18.75% -
nb_total_tests -18.75% 16.000 13.000 - -18.75% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
557.xz_r -1.64% 10353.000 10183.000 - 0.10% -
531.deepsjeng_r -1.03% 10775.000 10664.000 - -0.13% -

Added Tests - Execution
519.lbm_r
523.xalancbmk_r
538.imagick_r
541.leela_r

Added Tests - sample variability
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)

Added Tests - Score
nb_execution_successful


Report Time: 0.30s
Name Current %
505.mcf_r 14127.000 -
519.lbm_r 1.000 -
523.xalancbmk_r 2659.000 -
531.deepsjeng_r 10664.000 -
538.imagick_r 3.000 -
541.leela_r 3.000 -
557.xz_r 10183.000 -
Geometric Mean 232.494 -97.98%
Name Current %
nb_compile_successful 13.000 -18.75%
nb_execution_successful 0.000 -
nb_total_tests 13.000 -18.75%
Geometric Mean 0.257 -98.40%