Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/a3cab1fa17ebf29b01fcb566648e2f3fb2955993 (+ 31 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-cpu2017rate--llvm-arm-master-O3-build/103/
Filter

llvm-arm-master-O3 test results

Run Order Start Time Duration
Current 0103 (llvmorg-18-init-12504-ga3cab1fa17eb) 2023-11-22T23:48:10 0:00:00
Previous 0101 (no-change) 2023-11-22T15:19:03 0:00:00
Baseline 0015 (llvmorg-17-init-07405-g0f9842c21c76) 2023-04-07T17:38:29 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 8 6
Performance Improvements 5 1
Added Tests 1 19
Unchanged Tests 208 196
Total Tests 222

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
531.deepsjeng_r 3.53% 10630.000 11005.000 - 2.13% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
557.xz_r (unexplained diff vs previous) 500.00% 1.000 6.000 - 0.00% -
557.xz_r (unexplained diff vs previous) (percentage) 500.00% 0.010 0.060 - 0.00% -
531.deepsjeng_r 3.33% 90.000 93.000 - 0.00% -
531.deepsjeng_r (avg) 3.33% 90.000 93.000 - 0.00% -

Performance Regressions - Score Δ Previous Current σ Δ (B) σ (B)
nb_compile_successful -50.00% 16.000 8.000 - -50.00% -
nb_total_tests -50.00% 16.000 8.000 - -50.00% -
nb_execution_successful -33.33% 3.000 2.000 - -33.33% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
557.xz_r (max) -11.11% 9.000 8.000 - 0.00% -
531.deepsjeng_r (max) (percentage) -4.92% 1.830 1.740 - 0.00% -
505.mcf_r (max) -4.17% 48.000 46.000 - 0.00% -
505.mcf_r (max) (percentage) -2.94% 0.340 0.330 - 0.00% -
531.deepsjeng_r (max) -1.55% 194.000 191.000 - 0.00% -

Added Tests - Execution
508.namd_r

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
531.deepsjeng_r 1.09% 100020.000 101112.000 - 0.16% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
531.deepsjeng_r 2.13% 10775.000 11005.000 - 3.53% -
505.mcf_r 1.37% 13925.000 14116.000 - -0.07% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -50.00% 16.000 8.000 - -50.00% -
nb_total_tests -50.00% 16.000 8.000 - -50.00% -
nb_execution_successful -33.33% 3.000 2.000 - -33.33% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
557.xz_r -1.85% 10353.000 10161.000 - -0.06% -

Added Tests - Execution
508.namd_r
519.lbm_r
523.xalancbmk_r
541.leela_r

Added Tests - sample variability
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)


Report Time: 0.20s
Name Current %
505.mcf_r 14116.000 -
508.namd_r 1.000 -
519.lbm_r 1.000 -
523.xalancbmk_r 2602.000 -
531.deepsjeng_r 11005.000 3.53%
541.leela_r 3.000 -
557.xz_r 10161.000 -
Geometric Mean 198.921 -58.33%
Name Current %
531.deepsjeng_r 101112.000 -
557.xz_r 185083.000 -
Geometric Mean 136799.533 -
Name Current %
nb_compile_successful 8.000 -50.00%
nb_execution_successful 2.000 -33.33%
nb_total_tests 8.000 -50.00%
Geometric Mean 5.040 -44.97%