Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/78b4e7c5e349d8c101b50affbd260eb109748f8f (+ 1584 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-spec2k6--llvm-arm-master-O3-build/158/
Filter

llvm-arm-master-O3 test results

Run Order Start Time Duration
Current 0158 (llvmorg-19-init-01166-g78b4e7c5e349) 2024-01-25T21:54:26 0:00:00
Previous 0155 (llvmorg-18-init-17942-g3a4615c0fe98) 2024-01-17T13:36:19 0:00:00
Baseline 0079 (llvmorg-18-init-07933-ge13bed4c5f35) 2023-10-06T11:29:06 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 1 2
Performance Improvements 13 1
Added Tests 0 25
Unchanged Tests 262 248
Total Tests 276

Performance Regressions - Code Size Δ Previous Current σ Δ (B) σ (B)
401.bzip2 1.53% 79167.000 80375.000 - 1.36% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
450.soplex -6.25% 16.000 15.000 - 0.00% -
403.gcc -3.65% 137.000 132.000 - 0.00% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
401.bzip2 (max) -13.71% 124.000 107.000 - 0.00% -
401.bzip2 (max) (percentage) -12.73% 1.100 0.960 - 0.00% -
429.mcf (max) -5.88% 17.000 16.000 - 0.00% -
462.libquantum (max) -5.77% 52.000 49.000 - 0.00% -
462.libquantum (max) (percentage) -5.56% 0.360 0.340 - 0.00% -
458.sjeng (max) (percentage) -4.85% 1.030 0.980 - 0.00% -
458.sjeng (max) -4.83% 145.000 138.000 - 0.00% -
401.bzip2 -1.01% 99.000 98.000 - 0.00% -
401.bzip2 (avg) -1.01% 99.000 98.000 - 0.00% -

Performance Improvements - Score Δ Previous Current σ Δ (B) σ (B)
nb_compile_successful 11.76% 17.000 19.000 - 0.00% -
nb_total_tests 11.76% 17.000 19.000 - 0.00% -

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
401.bzip2 1.36% 79295.000 80375.000 - 1.53% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
458.sjeng 2.17% 13872.000 14173.000 - 0.59% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
429.mcf -1.20% 11954.000 11810.000 - 0.00% -

Added Tests - Execution
403.gcc
433.milc
450.soplex
470.lbm
483.xalancbmk

Added Tests - sample variability
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)


Report Time: 0.20s
Name Current %
401.bzip2 11213.000 -
403.gcc 132.000 -3.65%
429.mcf 9667.000 -
433.milc 5.000 -
450.soplex 15.000 -6.25%
458.sjeng 14173.000 -
462.libquantum 14692.000 -
470.lbm 1.000 -
483.xalancbmk 2688.000 -
Geometric Mean 438.606 -1.15%
Name Current %
401.bzip2 80375.000 1.53%
429.mcf 11810.000 -
458.sjeng 146148.000 -
462.libquantum 33760.000 -
Geometric Mean 46520.198 -
Name Current %
nb_compile_successful 19.000 11.76%
nb_execution_successful 4.000 -
nb_total_tests 19.000 11.76%
Geometric Mean 11.303 7.70%