Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/9cf3e31172b7b9966ce95d6a84ca09f8d0f6ebc1 (+ 214 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-spec2k6--llvm-arm-master-O3-build/116/
Filter

llvm-arm-master-O3 test results

Run Order Start Time Duration
Current 0116 (llvmorg-18-init-14845-g9cf3e31172b7) 2023-12-13T21:46:04 0:00:00
Previous 0114 (no-change) 2023-12-13T04:25:31 0:00:00
Baseline 0079 (llvmorg-18-init-07933-ge13bed4c5f35) 2023-10-06T11:29:06 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 1 1
Performance Improvements 23 1
Added Tests 0 25
Unchanged Tests 252 249
Total Tests 276

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
403.gcc 3.82% 131.000 136.000 - 0.00% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
458.sjeng (unexplained diff vs previous) -99.21% 126.000 1.000 - 0.00% -
458.sjeng (unexplained diff vs previous) (percentage) -98.88% 0.890 0.010 - 0.00% -
462.libquantum (unexplained diff vs previous) (percentage) -88.64% 0.440 0.050 - 0.00% -
462.libquantum (unexplained diff vs previous) -87.69% 65.000 8.000 - 0.00% -
429.mcf (unexplained diff vs previous) (percentage) -84.21% 0.380 0.060 - 0.00% -
429.mcf (unexplained diff vs previous) -83.78% 37.000 6.000 - 0.00% -
458.sjeng (max) -25.00% 124.000 93.000 - 0.00% -
462.libquantum (max) -25.00% 64.000 48.000 - 0.00% -
458.sjeng (max) (percentage) -25.00% 0.880 0.660 - 0.00% -
462.libquantum (max) (percentage) -25.00% 0.440 0.330 - 0.00% -
429.mcf (max) -10.00% 40.000 36.000 - 0.00% -
429.mcf (max) (percentage) -9.52% 0.420 0.380 - 0.00% -
458.sjeng (avg) (percentage) -8.77% 0.570 0.520 - 0.00% -
458.sjeng -8.75% 80.000 73.000 - 0.00% -
458.sjeng (avg) -8.75% 80.000 73.000 - 0.00% -
462.libquantum -7.32% 41.000 38.000 - 0.00% -
462.libquantum (avg) -7.32% 41.000 38.000 - 0.00% -
401.bzip2 (max) -7.23% 83.000 77.000 - 0.00% -
462.libquantum (avg) (percentage) -7.14% 0.280 0.260 - 0.00% -
429.mcf -7.14% 28.000 26.000 - 0.00% -
429.mcf (avg) -7.14% 28.000 26.000 - 0.00% -
429.mcf (avg) (percentage) -6.90% 0.290 0.270 - 0.00% -
401.bzip2 (max) (percentage) -6.76% 0.740 0.690 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
458.sjeng 2.31% 13872.000 14193.000 - 0.01% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
429.mcf -1.07% 11954.000 11826.000 - 0.00% -

Added Tests - Execution
403.gcc
433.milc
450.soplex
482.sphinx3
483.xalancbmk

Added Tests - sample variability
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)


Report Time: 0.20s
Name Current %
401.bzip2 11291.000 -
403.gcc 136.000 3.82%
429.mcf 9667.000 -
433.milc 5.000 -
450.soplex 15.000 -
458.sjeng 14193.000 -
462.libquantum 14680.000 -
482.sphinx3 1.000 -
483.xalancbmk 2713.000 -
Geometric Mean 440.885 -
Name Current %
401.bzip2 79151.000 -
429.mcf 11826.000 -
458.sjeng 145844.000 -
462.libquantum 33808.000 -
Geometric Mean 46350.090 -