Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/7cbf9598cc6f207a268599cea636533a5c7b2dbd (+ 1 commits)
regression LLVM-1040
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-cpu2017rate--llvm-arm-master-O2-build/103/
Filter

llvm-arm-master-O2 test results

Run Order Start Time Duration
Current 0103 (llvmorg-18-init-12868-g7cbf9598cc6f) 2023-11-26T10:32:59 0:00:00
Previous 0095 (no-change) 2023-11-07T05:16:26 0:00:00
Baseline 0013 (llvmorg-17-init-07454-g7a1044c6affe) 2023-04-08T11:09:44 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 3 1
Performance Improvements 13 1
Added Tests 16 24
Unchanged Tests 214 220
Total Tests 246

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
531.deepsjeng_r (avg) (percentage) 8.89% 0.900 0.980 - 0.00% -
531.deepsjeng_r 8.70% 92.000 100.000 - 0.00% -
531.deepsjeng_r (avg) 8.70% 92.000 100.000 - 0.00% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
531.deepsjeng_r (max) (percentage) -19.87% 3.070 2.460 - 0.00% -
531.deepsjeng_r (max) -19.43% 314.000 253.000 - 0.00% -
557.xz_r (max) -18.52% 27.000 22.000 - 0.00% -
557.xz_r (max) (percentage) -15.38% 0.260 0.220 - 0.00% -
557.xz_r -8.33% 12.000 11.000 - 0.00% -
557.xz_r (avg) -8.33% 12.000 11.000 - 0.00% -
505.mcf_r (max) -6.00% 50.000 47.000 - 0.00% -
505.mcf_r -5.71% 35.000 33.000 - 0.00% -
505.mcf_r (avg) -5.71% 35.000 33.000 - 0.00% -
505.mcf_r (max) (percentage) -5.56% 0.360 0.340 - 0.00% -
505.mcf_r (avg) (percentage) -4.00% 0.250 0.240 - 0.00% -

Performance Improvements - Score Δ Previous Current σ Δ (B) σ (B)
nb_compile_successful 23.08% 13.000 16.000 - 0.00% -
nb_total_tests 23.08% 13.000 16.000 - 0.00% -

Added Tests - Code Size
505.mcf_r
531.deepsjeng_r
557.xz_r

Added Tests - Execution
519.lbm_r
538.imagick_r

Added Tests - sample variability
505.mcf_r (unexplained diff vs previous)
505.mcf_r (unexplained diff vs previous) (percentage)
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)
531.deepsjeng_r (unexplained diff vs previous)
531.deepsjeng_r (unexplained diff vs previous) (percentage)
557.xz_r (unexplained diff vs previous)
557.xz_r (unexplained diff vs previous) (percentage)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
505.mcf_r 1.78% 29232.000 29752.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
531.deepsjeng_r -2.41% 10547.000 10293.000 - 0.44% -

Added Tests - Execution
519.lbm_r
523.xalancbmk_r
538.imagick_r
541.leela_r

Added Tests - sample variability
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)


Report Time: 0.20s
Name Current %
505.mcf_r 14100.000 -
519.lbm_r 1.000 -
523.xalancbmk_r 2563.000 -
531.deepsjeng_r 10293.000 -
538.imagick_r 3.000 -
541.leela_r 3.000 -
557.xz_r 10407.000 -
Geometric Mean 230.762 -85.88%
Name Current %
505.mcf_r 29752.000 -
531.deepsjeng_r 92052.000 -
557.xz_r 176539.000 -
Geometric Mean 78486.811 -
Name Current %
nb_compile_successful 16.000 23.08%
nb_execution_successful 3.000 -
nb_total_tests 16.000 23.08%
Geometric Mean 9.158 3469.94%