Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/67268da61aa2f8b24172907ee6f8d9250ee18b65 (+ 172 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-cpu2017rate--llvm-arm-master-O2-build/102/
Filter

llvm-arm-master-O2 test results

Run Order Start Time Duration
Current 0102 (llvmorg-18-init-12867-g67268da61aa2) 2023-11-24T19:46:25 0:00:00
Previous 0095 (no-change) 2023-11-07T05:16:26 0:00:00
Baseline 0013 (llvmorg-17-init-07454-g7a1044c6affe) 2023-04-08T11:09:44 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 0 1
Performance Improvements 17 1
Added Tests 16 24
Unchanged Tests 213 220
Total Tests 246

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
531.deepsjeng_r -1.52% 10248.000 10092.000 - -4.31% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
531.deepsjeng_r (max) -13.69% 314.000 271.000 - 0.00% -
531.deepsjeng_r (max) (percentage) -12.38% 3.070 2.690 - 0.00% -
557.xz_r -8.33% 12.000 11.000 - 0.00% -
557.xz_r (avg) -8.33% 12.000 11.000 - 0.00% -
557.xz_r (max) (percentage) -7.69% 0.260 0.240 - 0.00% -
557.xz_r (max) -7.41% 27.000 25.000 - 0.00% -
505.mcf_r -5.71% 35.000 33.000 - 0.00% -
505.mcf_r (avg) -5.71% 35.000 33.000 - 0.00% -
531.deepsjeng_r -4.35% 92.000 88.000 - 0.00% -
531.deepsjeng_r (avg) -4.35% 92.000 88.000 - 0.00% -
505.mcf_r (avg) (percentage) -4.00% 0.250 0.240 - 0.00% -
505.mcf_r (max) (percentage) -2.78% 0.360 0.350 - 0.00% -
531.deepsjeng_r (avg) (percentage) -2.22% 0.900 0.880 - 0.00% -
505.mcf_r (max) -2.00% 50.000 49.000 - 0.00% -

Performance Improvements - Score Δ Previous Current σ Δ (B) σ (B)
nb_compile_successful 23.08% 13.000 16.000 - 0.00% -
nb_total_tests 23.08% 13.000 16.000 - 0.00% -

Added Tests - Code Size
505.mcf_r
531.deepsjeng_r
557.xz_r

Added Tests - Execution
519.lbm_r
538.imagick_r

Added Tests - sample variability
505.mcf_r (unexplained diff vs previous)
505.mcf_r (unexplained diff vs previous) (percentage)
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)
531.deepsjeng_r (unexplained diff vs previous)
531.deepsjeng_r (unexplained diff vs previous) (percentage)
557.xz_r (unexplained diff vs previous)
557.xz_r (unexplained diff vs previous) (percentage)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
505.mcf_r 1.78% 29232.000 29752.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
531.deepsjeng_r -4.31% 10547.000 10092.000 - -1.52% -

Added Tests - Execution
519.lbm_r
523.xalancbmk_r
538.imagick_r
541.leela_r

Added Tests - sample variability
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)


Report Time: 0.20s
Name Current %
505.mcf_r 14064.000 -
519.lbm_r 1.000 -
523.xalancbmk_r 2562.000 -
531.deepsjeng_r 10092.000 -1.52%
538.imagick_r 1.000 -
541.leela_r 3.000 -
557.xz_r 10422.000 -
Geometric Mean 196.649 -87.97%
Name Current %
505.mcf_r 29752.000 -
531.deepsjeng_r 92052.000 -
557.xz_r 176539.000 -
Geometric Mean 78486.811 -
Name Current %
nb_compile_successful 16.000 23.08%
nb_execution_successful 3.000 -
nb_total_tests 16.000 23.08%
Geometric Mean 9.158 3469.94%