Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/a16f6462d756804276d4b39267b3c19bcd6949fe (+ 112 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-cpu2017rate--llvm-arm-master-O2-build/76/
Filter

llvm-arm-master-O2 test results

Run Order Start Time Duration
Current 0076 (llvmorg-18-init-07932-ga16f6462d756) 2023-10-01T16:10:05 0:00:00
Previous 0073 (no-change) 2023-09-18T07:06:58 0:00:00
Baseline 0013 (llvmorg-17-init-07454-g7a1044c6affe) 2023-04-08T11:09:44 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 11 0
Performance Improvements 8 1
Added Tests 7 22
Unchanged Tests 220 223
Total Tests 246

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
505.mcf_r (unexplained diff vs previous) (percentage) 366.67% 0.120 0.560 - 0.00% -
505.mcf_r (unexplained diff vs previous) 358.82% 17.000 78.000 - 0.00% -
531.deepsjeng_r (unexplained diff vs previous) 58.33% 48.000 76.000 - 0.00% -
531.deepsjeng_r (unexplained diff vs previous) (percentage) 56.52% 0.460 0.720 - 0.00% -
505.mcf_r (max) 52.94% 51.000 78.000 - 0.00% -
505.mcf_r (max) (percentage) 51.35% 0.370 0.560 - 0.00% -
557.xz_r (unexplained diff vs previous) 42.86% 7.000 10.000 - 0.00% -
557.xz_r (unexplained diff vs previous) (percentage) 42.86% 0.070 0.100 - 0.00% -
505.mcf_r 22.22% 27.000 33.000 - 0.00% -
505.mcf_r (avg) 22.22% 27.000 33.000 - 0.00% -
505.mcf_r (avg) (percentage) 20.00% 0.200 0.240 - 0.00% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
531.deepsjeng_r (avg) (percentage) -12.99% 0.770 0.670 - 0.00% -
531.deepsjeng_r -12.50% 80.000 70.000 - 0.00% -
531.deepsjeng_r (avg) -12.50% 80.000 70.000 - 0.00% -
557.xz_r (max) (percentage) -7.14% 0.140 0.130 - 0.00% -
557.xz_r (max) -7.14% 14.000 13.000 - 0.00% -
531.deepsjeng_r (max) (percentage) -4.26% 1.410 1.350 - 0.00% -
531.deepsjeng_r (max) -4.08% 147.000 141.000 - 0.00% -

Performance Improvements - Score Δ Previous Current σ Δ (B) σ (B)
nb_execution_successful 66.67% 3.000 5.000 - 66.67% -

Added Tests - Code Size
519.lbm_r

Added Tests - Execution
519.lbm_r

Added Tests - sample variability
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_execution_successful 66.67% 3.000 5.000 - 66.67% -

Added Tests - Code Size
519.lbm_r

Added Tests - Execution
519.lbm_r

Added Tests - sample variability
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)


Report Time: 0.20s
Name Current %
505.mcf_r 14045.000 -
519.lbm_r 1.000 -
531.deepsjeng_r 10493.000 -
557.xz_r 10447.000 -
Geometric Mean 1113.946 -90.29%
Name Current %
505.mcf_r 29032.000 -
519.lbm_r 13072.000 -
531.deepsjeng_r 92052.000 -
557.xz_r 177867.000 -
Geometric Mean 49927.164 -35.99%
Name Current %
nb_compile_successful 16.000 -
nb_execution_successful 5.000 66.67%
nb_total_tests 16.000 -
Geometric Mean 10.858 18.56%