Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/85071a3c74f531ade3709351638c1380c4503d2c (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-spec2k6--llvm-arm-master-O3-build/154/
Filter

llvm-arm-master-O3 test results

Run Order Start Time Duration
Current 0154 (no-change) 2024-01-13T02:29:54 0:00:00
Previous 0152 (llvmorg-18-init-17115-g85071a3c74f5) 2024-01-11T01:40:33 0:00:00
Baseline 0079 (llvmorg-18-init-07933-ge13bed4c5f35) 2023-10-06T11:29:06 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 3 2
Performance Improvements 27 1
Added Tests 0 25
Unchanged Tests 246 248
Total Tests 276

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
403.gcc 1.45% 138.000 140.000 - 0.00% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
458.sjeng (unexplained diff vs previous) 8.11% 37.000 40.000 - 0.00% -
458.sjeng (unexplained diff vs previous) (percentage) 7.69% 0.260 0.280 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
450.soplex -13.33% 15.000 13.000 - 0.00% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
401.bzip2 (unexplained diff vs previous) (percentage) -80.31% 1.270 0.250 - 0.00% -
401.bzip2 (unexplained diff vs previous) -80.14% 146.000 29.000 - 0.00% -
429.mcf (unexplained diff vs previous) -75.00% 8.000 2.000 - 0.00% -
429.mcf (unexplained diff vs previous) (percentage) -75.00% 0.080 0.020 - 0.00% -
429.mcf (max) -70.00% 20.000 6.000 - 0.00% -
462.libquantum (unexplained diff vs previous) -69.84% 63.000 19.000 - 0.00% -
462.libquantum (unexplained diff vs previous) (percentage) -69.77% 0.430 0.130 - 0.00% -
429.mcf (max) (percentage) -66.67% 0.210 0.070 - 0.00% -
401.bzip2 (max) -32.93% 164.000 110.000 - 0.00% -
401.bzip2 (max) (percentage) -32.64% 1.440 0.970 - 0.00% -
462.libquantum (max) -9.52% 63.000 57.000 - 0.00% -
462.libquantum (max) (percentage) -9.30% 0.430 0.390 - 0.00% -
458.sjeng (max) (percentage) -8.33% 1.200 1.100 - 0.00% -
458.sjeng (max) -7.69% 169.000 156.000 - 0.00% -
429.mcf -5.26% 19.000 18.000 - 0.00% -
429.mcf (avg) -5.26% 19.000 18.000 - 0.00% -
429.mcf (avg) (percentage) -5.00% 0.200 0.190 - 0.00% -
462.libquantum (avg) (percentage) -4.35% 0.230 0.220 - 0.00% -
401.bzip2 -3.88% 103.000 99.000 - 0.00% -
401.bzip2 (avg) -3.88% 103.000 99.000 - 0.00% -
401.bzip2 (avg) (percentage) -3.33% 0.900 0.870 - 0.00% -
462.libquantum -3.03% 33.000 32.000 - 0.00% -
462.libquantum (avg) -3.03% 33.000 32.000 - 0.00% -
458.sjeng (avg) (percentage) -2.38% 0.420 0.410 - 0.00% -
458.sjeng -1.69% 59.000 58.000 - 0.00% -
458.sjeng (avg) -1.69% 59.000 58.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
458.sjeng 2.36% 13872.000 14200.000 - 0.28% -
401.bzip2 1.07% 11304.000 11425.000 - -0.25% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
429.mcf -1.20% 11954.000 11810.000 - 0.00% -

Added Tests - Execution
403.gcc
433.milc
450.soplex
470.lbm
483.xalancbmk

Added Tests - sample variability
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)


Report Time: 0.20s
Name Current %
401.bzip2 11425.000 -
403.gcc 140.000 1.45%
429.mcf 9666.000 -
433.milc 5.000 -
450.soplex 13.000 -13.33%
458.sjeng 14200.000 -
462.libquantum 14715.000 -
470.lbm 1.000 -
483.xalancbmk 2691.000 -
Geometric Mean 435.641 -1.42%
Name Current %
401.bzip2 79167.000 -
429.mcf 11810.000 -
458.sjeng 145908.000 -
462.libquantum 33792.000 -
Geometric Mean 46336.345 -