Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/f49e2b05bf3ececa2fe20c5d658ab92ab974dc36 (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-cpu2017rate--llvm-arm-master-O3-build/115/
Filter

llvm-arm-master-O3 test results

Run Order Start Time Duration
Current 0115 (no-change) 2023-12-15T09:59:17 0:00:00
Previous 0113 (llvmorg-18-init-15062-gf49e2b05bf3e) 2023-12-14T03:10:58 0:00:00
Baseline 0015 (llvmorg-17-init-07405-g0f9842c21c76) 2023-04-07T17:38:29 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 5 6
Performance Improvements 5 0
Added Tests 4 18
Unchanged Tests 208 198
Total Tests 222

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
557.xz_r (max) (percentage) 44.44% 0.090 0.130 - 0.00% -
557.xz_r (max) 44.44% 9.000 13.000 - 0.00% -

Performance Regressions - Score Δ Previous Current σ Δ (B) σ (B)
nb_execution_successful -33.33% 3.000 2.000 - -33.33% -
nb_compile_successful -14.29% 14.000 12.000 - -25.00% -
nb_total_tests -14.29% 14.000 12.000 - -25.00% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
531.deepsjeng_r (avg) (percentage) -5.63% 0.710 0.670 - 0.00% -
531.deepsjeng_r -5.13% 78.000 74.000 - 0.00% -
531.deepsjeng_r (avg) -5.13% 78.000 74.000 - 0.00% -
531.deepsjeng_r (max) (percentage) -3.85% 0.260 0.250 - 0.00% -
531.deepsjeng_r (max) -3.57% 28.000 27.000 - 0.00% -

Added Tests - sample variability
531.deepsjeng_r (unexplained diff vs previous)
531.deepsjeng_r (unexplained diff vs previous) (percentage)
557.xz_r (unexplained diff vs previous)
557.xz_r (unexplained diff vs previous) (percentage)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
531.deepsjeng_r 1.24% 100020.000 101264.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
505.mcf_r 5.22% 13925.000 14652.000 - -0.29% -
531.deepsjeng_r 2.71% 10775.000 11067.000 - 0.01% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_execution_successful -33.33% 3.000 2.000 - -33.33% -
nb_compile_successful -25.00% 16.000 12.000 - -14.29% -
nb_total_tests -25.00% 16.000 12.000 - -14.29% -

Added Tests - Execution
519.lbm_r
523.xalancbmk_r
541.leela_r

Added Tests - sample variability
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)


Report Time: 0.20s
Name Current %
505.mcf_r 14652.000 -
519.lbm_r 1.000 -
523.xalancbmk_r 2594.000 -
531.deepsjeng_r 11067.000 -
541.leela_r 3.000 -
557.xz_r 10417.000 -
Geometric Mean 485.814 -
Name Current %
531.deepsjeng_r 101264.000 -
557.xz_r 185595.000 -
Geometric Mean 137091.546 -
Name Current %
nb_compile_successful 12.000 -14.29%
nb_execution_successful 2.000 -33.33%
nb_total_tests 12.000 -14.29%
Geometric Mean 6.604 -21.17%