Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/85071a3c74f531ade3709351638c1380c4503d2c (+ 451 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-spec2k6--llvm-arm-master-O3-build/152/
Filter

llvm-arm-master-O3 test results

Run Order Start Time Duration
Current 0152 (llvmorg-18-init-17115-g85071a3c74f5) 2024-01-11T01:40:33 0:00:00
Previous 0150 (llvmorg-18-init-16664-g5f71aa9270c3) 2024-01-07T00:01:50 0:00:00
Baseline 0079 (llvmorg-18-init-07933-ge13bed4c5f35) 2023-10-06T11:29:06 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 15 2
Performance Improvements 13 1
Added Tests 0 25
Unchanged Tests 248 248
Total Tests 276

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
401.bzip2 1.29% 11308.000 11454.000 - 1.33% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
401.bzip2 (unexplained diff vs previous) 247.62% 42.000 146.000 - 0.00% -
401.bzip2 (unexplained diff vs previous) (percentage) 243.24% 0.370 1.270 - 0.00% -
429.mcf (unexplained diff vs previous) 166.67% 3.000 8.000 - 0.00% -
429.mcf (unexplained diff vs previous) (percentage) 166.67% 0.030 0.080 - 0.00% -
462.libquantum (unexplained diff vs previous) (percentage) 126.32% 0.190 0.430 - 0.00% -
462.libquantum (unexplained diff vs previous) 125.00% 28.000 63.000 - 0.00% -
462.libquantum (avg) (percentage) 4.55% 0.220 0.230 - 0.00% -
401.bzip2 4.04% 99.000 103.000 - 0.00% -
401.bzip2 (avg) 4.04% 99.000 103.000 - 0.00% -
462.libquantum (max) 3.28% 61.000 63.000 - 0.00% -
462.libquantum 3.12% 32.000 33.000 - 0.00% -
462.libquantum (avg) 3.12% 32.000 33.000 - 0.00% -
462.libquantum (max) (percentage) 2.38% 0.420 0.430 - 0.00% -
401.bzip2 (avg) (percentage) 2.27% 0.880 0.900 - 0.00% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
458.sjeng (unexplained diff vs previous) (percentage) -81.29% 1.390 0.260 - 0.00% -
458.sjeng (unexplained diff vs previous) -81.12% 196.000 37.000 - 0.00% -
458.sjeng (max) -12.44% 193.000 169.000 - 0.00% -
458.sjeng (max) (percentage) -12.41% 1.370 1.200 - 0.00% -
401.bzip2 (max) (percentage) -6.49% 1.540 1.440 - 0.00% -
401.bzip2 (max) -5.75% 174.000 164.000 - 0.00% -
429.mcf -5.00% 20.000 19.000 - 0.00% -
429.mcf (avg) -5.00% 20.000 19.000 - 0.00% -
429.mcf (max) -4.76% 21.000 20.000 - 0.00% -
429.mcf (max) (percentage) -4.55% 0.220 0.210 - 0.00% -
458.sjeng (avg) (percentage) -2.33% 0.430 0.420 - 0.00% -
458.sjeng -1.67% 60.000 59.000 - 0.00% -
458.sjeng (avg) -1.67% 60.000 59.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
458.sjeng 2.08% 13872.000 14160.000 - 0.26% -
401.bzip2 1.33% 11304.000 11454.000 - 1.29% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
429.mcf -1.20% 11954.000 11810.000 - 0.00% -

Added Tests - Execution
403.gcc
433.milc
450.soplex
470.lbm
483.xalancbmk

Added Tests - sample variability
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)


Report Time: 0.20s
Name Current %
401.bzip2 11454.000 1.29%
403.gcc 138.000 -
429.mcf 9664.000 -
433.milc 5.000 -
450.soplex 15.000 -
458.sjeng 14160.000 -
462.libquantum 14734.000 -
470.lbm 1.000 -
483.xalancbmk 2689.000 -
Geometric Mean 441.919 -
Name Current %
401.bzip2 79167.000 -
429.mcf 11810.000 -
458.sjeng 145908.000 -
462.libquantum 33792.000 -
Geometric Mean 46336.345 -