Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/42b5b720caf62e0710b9c1e32e894d8606106a19 (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-spec2k6--llvm-arm-master-O3-build/165/
Filter

llvm-arm-master-O3 test results

Run Order Start Time Duration
Current 0165 (no-change) 2024-02-05T16:12:35 0:00:00
Previous 0163 (no-change) 2024-02-04T22:59:22 0:00:00
Baseline 0079 (llvmorg-18-init-07933-ge13bed4c5f35) 2023-10-06T11:29:06 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 8 2
Performance Improvements 19 1
Added Tests 0 26
Unchanged Tests 249 247
Total Tests 276

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
403.gcc 1.53% 131.000 133.000 - 0.00% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
401.bzip2 (unexplained diff vs previous) (percentage) 91.21% 0.910 1.740 - 0.00% -
401.bzip2 (unexplained diff vs previous) 87.50% 104.000 195.000 - 0.00% -
401.bzip2 (max) (percentage) 85.87% 0.920 1.710 - 0.00% -
401.bzip2 (max) 83.65% 104.000 191.000 - 0.00% -
401.bzip2 (avg) (percentage) 3.49% 0.860 0.890 - 0.00% -
401.bzip2 1.02% 98.000 99.000 - 0.00% -
401.bzip2 (avg) 1.02% 98.000 99.000 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
450.soplex -25.00% 16.000 12.000 - 0.00% -
401.bzip2 -1.71% 11405.000 11210.000 - -0.83% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
462.libquantum (unexplained diff vs previous) (percentage) -80.65% 0.310 0.060 - 0.00% -
462.libquantum (unexplained diff vs previous) -80.43% 46.000 9.000 - 0.00% -
458.sjeng (unexplained diff vs previous) (percentage) -42.86% 0.280 0.160 - 0.00% -
458.sjeng (unexplained diff vs previous) -42.50% 40.000 23.000 - 0.00% -
429.mcf (unexplained diff vs previous) -17.14% 35.000 29.000 - 0.00% -
429.mcf (unexplained diff vs previous) (percentage) -16.67% 0.360 0.300 - 0.00% -
462.libquantum (max) -13.33% 45.000 39.000 - 0.00% -
462.libquantum (max) (percentage) -12.90% 0.310 0.270 - 0.00% -
429.mcf (max) -11.76% 34.000 30.000 - 0.00% -
429.mcf (max) (percentage) -11.11% 0.360 0.320 - 0.00% -
458.sjeng (max) (percentage) -5.36% 0.560 0.530 - 0.00% -
458.sjeng (max) -5.06% 79.000 75.000 - 0.00% -
462.libquantum -3.33% 30.000 29.000 - 0.00% -
462.libquantum (avg) -3.33% 30.000 29.000 - 0.00% -
458.sjeng -3.28% 61.000 59.000 - 0.00% -
458.sjeng (avg) -3.28% 61.000 59.000 - 0.00% -
458.sjeng (avg) (percentage) -2.33% 0.430 0.420 - 0.00% -

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
401.bzip2 1.36% 79295.000 80375.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
458.sjeng 2.58% 13872.000 14230.000 - -0.16% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
429.mcf -1.20% 11954.000 11810.000 - 0.00% -

Added Tests - Execution
403.gcc
433.milc
450.soplex
470.lbm
482.sphinx3
483.xalancbmk

Added Tests - sample variability
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)


Report Time: 0.20s
Name Current %
401.bzip2 11210.000 -1.71%
403.gcc 133.000 1.53%
429.mcf 9679.000 -
433.milc 5.000 -
450.soplex 12.000 -25.00%
458.sjeng 14230.000 -
462.libquantum 14742.000 -
470.lbm 1.000 -
482.sphinx3 1.000 -
483.xalancbmk 2662.000 -
Geometric Mean 233.588 -2.95%
Name Current %
401.bzip2 80375.000 -
429.mcf 11810.000 -
458.sjeng 146148.000 -
462.libquantum 33760.000 -
Geometric Mean 46520.198 -