Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/e5c523e8610492b3256dde6856811b527b4dcb35 (+ 2 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-spec2k6--llvm-arm-master-O3-build/126/
Filter

llvm-arm-master-O3 test results

Run Order Start Time Duration
Current 0126 (llvmorg-18-init-15183-ge5c523e86104) 2023-12-18T12:49:01 0:00:00
Previous 0129 (no-change) 2023-12-18T17:28:25 0:00:00
Baseline 0079 (llvmorg-18-init-07933-ge13bed4c5f35) 2023-10-06T11:29:06 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 16 1
Performance Improvements 11 1
Added Tests 0 26
Unchanged Tests 249 248
Total Tests 276

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
450.soplex 7.14% 14.000 15.000 - 0.00% -
403.gcc 1.49% 134.000 136.000 - 0.00% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
401.bzip2 (max) (percentage) 18.95% 1.900 2.260 - 0.00% -
401.bzip2 (max) 18.52% 216.000 256.000 - 0.00% -
429.mcf (max) 12.12% 33.000 37.000 - 0.00% -
429.mcf (unexplained diff vs previous) 11.76% 34.000 38.000 - 0.00% -
429.mcf (max) (percentage) 11.43% 0.350 0.390 - 0.00% -
429.mcf (unexplained diff vs previous) (percentage) 11.43% 0.350 0.390 - 0.00% -
458.sjeng (avg) (percentage) 11.11% 0.540 0.600 - 0.00% -
458.sjeng 10.39% 77.000 85.000 - 0.00% -
458.sjeng (avg) 10.39% 77.000 85.000 - 0.00% -
458.sjeng (max) 8.89% 135.000 147.000 - 0.00% -
458.sjeng (max) (percentage) 8.42% 0.950 1.030 - 0.00% -
401.bzip2 4.72% 106.000 111.000 - 0.00% -
401.bzip2 (avg) 4.72% 106.000 111.000 - 0.00% -
401.bzip2 (avg) (percentage) 4.26% 0.940 0.980 - 0.00% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
462.libquantum (unexplained diff vs previous) -50.00% 46.000 23.000 - 0.00% -
462.libquantum (unexplained diff vs previous) (percentage) -48.39% 0.310 0.160 - 0.00% -
401.bzip2 (unexplained diff vs previous) -17.28% 81.000 67.000 - 0.00% -
401.bzip2 (unexplained diff vs previous) (percentage) -16.90% 0.710 0.590 - 0.00% -
462.libquantum (max) (percentage) -16.13% 0.310 0.260 - 0.00% -
462.libquantum (max) -15.56% 45.000 38.000 - 0.00% -
429.mcf -4.00% 25.000 24.000 - 0.00% -
429.mcf (avg) -4.00% 25.000 24.000 - 0.00% -
429.mcf (avg) (percentage) -3.85% 0.260 0.250 - 0.00% -

Performance Improvements - Score Δ Previous Current σ Δ (B) σ (B)
nb_compile_successful 11.76% 17.000 19.000 - 0.00% -
nb_total_tests 11.76% 17.000 19.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
458.sjeng 3.22% 13872.000 14318.000 - 0.36% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
429.mcf -1.07% 11954.000 11826.000 - 0.00% -

Added Tests - Execution
403.gcc
433.milc
450.soplex
470.lbm
482.sphinx3
483.xalancbmk

Added Tests - sample variability
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)


Report Time: 0.20s
Name Current %
401.bzip2 11369.000 -
403.gcc 136.000 1.49%
429.mcf 9667.000 -
433.milc 5.000 -
450.soplex 15.000 7.14%
458.sjeng 14318.000 -
462.libquantum 14706.000 -
470.lbm 1.000 -
482.sphinx3 1.000 -
483.xalancbmk 2723.000 -
Geometric Mean 240.333 -
Name Current %
401.bzip2 79151.000 -
429.mcf 11826.000 -
458.sjeng 145844.000 -
462.libquantum 33808.000 -
Geometric Mean 46350.090 -
Name Current %
nb_compile_successful 19.000 11.76%
nb_execution_successful 4.000 -
nb_total_tests 19.000 11.76%
Geometric Mean 11.303 7.70%