Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/42b5b720caf62e0710b9c1e32e894d8606106a19 (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-spec2k6--llvm-arm-master-O3-build/163/
Filter

llvm-arm-master-O3 test results

Run Order Start Time Duration
Current 0163 (no-change) 2024-02-04T22:59:22 0:00:00
Previous 0161 (no-change) 2024-02-03T12:32:57 0:00:00
Baseline 0079 (llvmorg-18-init-07933-ge13bed4c5f35) 2023-10-06T11:29:06 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 21 2
Performance Improvements 9 1
Added Tests 0 26
Unchanged Tests 246 247
Total Tests 276

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
450.soplex 33.33% 12.000 16.000 - 0.00% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
429.mcf (unexplained diff vs previous) (percentage) 3500.00% 0.010 0.360 - 0.00% -
429.mcf (unexplained diff vs previous) 3400.00% 1.000 35.000 - 0.00% -
462.libquantum (unexplained diff vs previous) (percentage) 1450.00% 0.020 0.310 - 0.00% -
462.libquantum (unexplained diff vs previous) 1433.33% 3.000 46.000 - 0.00% -
401.bzip2 (unexplained diff vs previous) 285.19% 27.000 104.000 - 0.00% -
401.bzip2 (unexplained diff vs previous) (percentage) 279.17% 0.240 0.910 - 0.00% -
462.libquantum (max) 246.15% 13.000 45.000 - 0.00% -
462.libquantum (max) (percentage) 244.44% 0.090 0.310 - 0.00% -
429.mcf (max) 240.00% 10.000 34.000 - 0.00% -
429.mcf (max) (percentage) 227.27% 0.110 0.360 - 0.00% -
429.mcf 5.88% 17.000 18.000 - 0.00% -
429.mcf (avg) 5.88% 17.000 18.000 - 0.00% -
429.mcf (avg) (percentage) 5.56% 0.180 0.190 - 0.00% -
462.libquantum 3.45% 29.000 30.000 - 0.00% -
462.libquantum (avg) 3.45% 29.000 30.000 - 0.00% -
401.bzip2 (max) 2.97% 101.000 104.000 - 0.00% -
401.bzip2 (max) (percentage) 2.22% 0.900 0.920 - 0.00% -
401.bzip2 2.08% 96.000 98.000 - 0.00% -
401.bzip2 (avg) 2.08% 96.000 98.000 - 0.00% -
401.bzip2 (avg) (percentage) 1.18% 0.850 0.860 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
482.sphinx3 -50.00% 2.000 1.000 - 0.00% -
403.gcc -2.24% 134.000 131.000 - 0.00% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
458.sjeng (unexplained diff vs previous) (percentage) -28.21% 0.390 0.280 - 0.00% -
458.sjeng (unexplained diff vs previous) -27.27% 55.000 40.000 - 0.00% -
458.sjeng (max) -7.06% 85.000 79.000 - 0.00% -
458.sjeng (max) (percentage) -6.67% 0.600 0.560 - 0.00% -
458.sjeng (avg) (percentage) -2.27% 0.440 0.430 - 0.00% -
458.sjeng -1.61% 62.000 61.000 - 0.00% -
458.sjeng (avg) -1.61% 62.000 61.000 - 0.00% -

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
401.bzip2 1.36% 79295.000 80375.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
458.sjeng 2.75% 13872.000 14253.000 - 0.28% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
429.mcf -1.20% 11954.000 11810.000 - 0.00% -

Added Tests - Execution
403.gcc
433.milc
450.soplex
470.lbm
482.sphinx3
483.xalancbmk

Added Tests - sample variability
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)


Report Time: 0.19s
Name Current %
401.bzip2 11405.000 -
403.gcc 131.000 -2.24%
429.mcf 9708.000 -
433.milc 5.000 -
450.soplex 16.000 33.33%
458.sjeng 14253.000 -
462.libquantum 14733.000 -
470.lbm 1.000 -
482.sphinx3 1.000 -50.00%
483.xalancbmk 2676.000 -
Geometric Mean 240.678 -3.99%
Name Current %
401.bzip2 80375.000 -
429.mcf 11810.000 -
458.sjeng 146148.000 -
462.libquantum 33760.000 -
Geometric Mean 46520.198 -