Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/833fea40d22ff7265a8331c88a7dc3b32a84c6a8 (+ 1243 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-spec2k6--llvm-arm-master-O3-build/166/
Filter

llvm-arm-master-O3 test results

Run Order Start Time Duration
Current 0166 (llvmorg-19-init-02666-g833fea40d22f) 2024-02-12T00:07:20 0:00:00
Previous 0165 (no-change) 2024-02-05T16:12:35 0:00:00
Baseline 0079 (llvmorg-18-init-07933-ge13bed4c5f35) 2023-10-06T11:29:06 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 2 1
Performance Improvements 22 2
Added Tests 0 25
Unchanged Tests 252 248
Total Tests 276

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
450.soplex 16.67% 12.000 14.000 - 0.00% -
403.gcc 2.26% 133.000 136.000 - 0.00% -

Performance Improvements - Code Size Δ Previous Current σ Δ (B) σ (B)
458.sjeng -1.31% 146148.000 144228.000 - -1.14% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
458.sjeng -2.12% 14230.000 13928.000 - 0.40% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
429.mcf (unexplained diff vs previous) (percentage) -96.67% 0.300 0.010 - 0.00% -
429.mcf (unexplained diff vs previous) -96.55% 29.000 1.000 - 0.00% -
401.bzip2 (unexplained diff vs previous) -75.90% 195.000 47.000 - 0.00% -
401.bzip2 (unexplained diff vs previous) (percentage) -75.86% 1.740 0.420 - 0.00% -
401.bzip2 (max) (percentage) -9.94% 1.710 1.540 - 0.00% -
401.bzip2 (max) -9.42% 191.000 173.000 - 0.00% -
429.mcf (max) (percentage) -9.38% 0.320 0.290 - 0.00% -
458.sjeng (max) -8.00% 75.000 69.000 - 0.00% -
462.libquantum (max) -7.69% 39.000 36.000 - 0.00% -
462.libquantum (max) (percentage) -7.41% 0.270 0.250 - 0.00% -
429.mcf (max) -6.67% 30.000 28.000 - 0.00% -
458.sjeng (max) (percentage) -5.66% 0.530 0.500 - 0.00% -
429.mcf -5.56% 18.000 17.000 - 0.00% -
429.mcf (avg) -5.56% 18.000 17.000 - 0.00% -
429.mcf (avg) (percentage) -5.26% 0.190 0.180 - 0.00% -
401.bzip2 (avg) (percentage) -2.25% 0.890 0.870 - 0.00% -
401.bzip2 -2.02% 99.000 97.000 - 0.00% -
401.bzip2 (avg) -2.02% 99.000 97.000 - 0.00% -
458.sjeng -1.69% 59.000 58.000 - 0.00% -
458.sjeng (avg) -1.69% 59.000 58.000 - 0.00% -

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
401.bzip2 1.36% 79295.000 80375.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
429.mcf -1.20% 11954.000 11810.000 - 0.00% -
458.sjeng -1.14% 145884.000 144228.000 - -1.31% -

Added Tests - Execution
403.gcc
433.milc
450.soplex
470.lbm
483.xalancbmk

Added Tests - sample variability
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)


Report Time: 0.22s
Name Current %
401.bzip2 11257.000 -
403.gcc 136.000 2.26%
429.mcf 9680.000 -
433.milc 5.000 -
450.soplex 14.000 16.67%
458.sjeng 13928.000 -2.12%
462.libquantum 14687.000 -
470.lbm 1.000 -
483.xalancbmk 2663.000 -
Geometric Mean 435.644 1.75%
Name Current %
401.bzip2 80375.000 -
429.mcf 11810.000 -
458.sjeng 144228.000 -1.31%
462.libquantum 33792.000 -
Geometric Mean 46377.634 -