Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/a09e32e5fe13e3b64bef1defddf71a9e83022e76 (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-cpu2017rate--llvm-arm-master-O2-build/73/
Filter

llvm-arm-master-O2 test results

Run Order Start Time Duration
Current 0073 (no-change) 2023-09-18T07:06:58 0:00:00
Previous 0077 (llvmorg-18-init-07933-ge13bed4c5f35) 2023-10-04T01:49:35 0:00:00
Baseline 0013 (llvmorg-17-init-07454-g7a1044c6affe) 2023-04-08T11:09:44 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 8 0
Performance Improvements 9 1
Added Tests 6 17
Unchanged Tests 211 216
Total Tests 234

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
531.deepsjeng_r 8.11% 74.000 80.000 - 0.00% -
531.deepsjeng_r (avg) 8.11% 74.000 80.000 - 0.00% -
557.xz_r (max) (percentage) 7.69% 0.130 0.140 - 0.00% -
557.xz_r (max) 7.69% 13.000 14.000 - 0.00% -
531.deepsjeng_r (avg) (percentage) 6.94% 0.720 0.770 - 0.00% -
531.deepsjeng_r (max) 6.52% 138.000 147.000 - 0.00% -
531.deepsjeng_r (max) (percentage) 6.02% 1.330 1.410 - 0.00% -

Performance Regressions - Score Δ Previous Current σ Δ (B) σ (B)
nb_execution_successful -75.00% 12.000 3.000 - 0.00% -

Performance Improvements - Code Size Δ Previous Current σ Δ (B) σ (B)
505.mcf_r -2.94% 29912.000 29032.000 - -0.68% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
557.xz_r -1.12% 10474.000 10357.000 - -0.95% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
531.deepsjeng_r (unexplained diff vs previous) (percentage) -55.77% 1.040 0.460 - 0.00% -
531.deepsjeng_r (unexplained diff vs previous) -55.56% 108.000 48.000 - 0.00% -
505.mcf_r (max) -32.00% 75.000 51.000 - 0.00% -
505.mcf_r (max) (percentage) -31.48% 0.540 0.370 - 0.00% -
505.mcf_r -18.18% 33.000 27.000 - 0.00% -
505.mcf_r (avg) -18.18% 33.000 27.000 - 0.00% -
505.mcf_r (avg) (percentage) -16.67% 0.240 0.200 - 0.00% -

Added Tests - sample variability
505.mcf_r (unexplained diff vs previous)
505.mcf_r (unexplained diff vs previous) (percentage)
519.lbm_r (avg) (percentage)
519.lbm_r (max) (percentage)
557.xz_r (unexplained diff vs previous)
557.xz_r (unexplained diff vs previous) (percentage)

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
531.deepsjeng_r -1.11% 10547.000 10430.000 - 0.43% -

Added Tests - sample variability
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
519.lbm_r (avg) (percentage)
519.lbm_r (max) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)


Report Time: 0.27s
Name Current %
505.mcf_r 13994.000 -
531.deepsjeng_r 10430.000 -
557.xz_r 10357.000 -1.12%
Geometric Mean 11476.780 -
Name Current %
505.mcf_r 29032.000 -2.94%
531.deepsjeng_r 92052.000 -
557.xz_r 177595.000 -
Geometric Mean 78003.419 -
Name Current %
nb_compile_successful 16.000 -
nb_execution_successful 3.000 -75.00%
nb_total_tests 16.000 -
Geometric Mean 9.158 -37.00%