Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/5f71aa9270c3d680babfbc6e766773d113c2a79a (+ 348 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-spec2k6--llvm-arm-master-O3-build/150/
Filter

llvm-arm-master-O3 test results

Run Order Start Time Duration
Current 0150 (llvmorg-18-init-16664-g5f71aa9270c3) 2024-01-07T00:01:50 0:00:00
Previous 0149 (llvmorg-18-init-16316-gf1d75d08adb9) 2024-01-04T00:43:35 0:00:00
Baseline 0079 (llvmorg-18-init-07933-ge13bed4c5f35) 2023-10-06T11:29:06 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 10 1
Performance Improvements 16 1
Added Tests 1 25
Unchanged Tests 249 249
Total Tests 276

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
403.gcc 2.24% 134.000 137.000 - 0.00% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
458.sjeng (unexplained diff vs previous) 988.89% 18.000 196.000 - 0.00% -
458.sjeng (unexplained diff vs previous) (percentage) 969.23% 0.130 1.390 - 0.00% -
458.sjeng (max) (percentage) 522.73% 0.220 1.370 - 0.00% -
458.sjeng (max) 522.58% 31.000 193.000 - 0.00% -
462.libquantum (unexplained diff vs previous) 75.00% 16.000 28.000 - 0.00% -
462.libquantum (unexplained diff vs previous) (percentage) 72.73% 0.110 0.190 - 0.00% -
458.sjeng (avg) (percentage) 13.16% 0.380 0.430 - 0.00% -
458.sjeng 11.11% 54.000 60.000 - 0.00% -
458.sjeng (avg) 11.11% 54.000 60.000 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
450.soplex -21.05% 19.000 15.000 - 0.00% -
458.sjeng -1.37% 14319.000 14123.000 - 1.81% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
401.bzip2 (unexplained diff vs previous) (percentage) -78.36% 1.710 0.370 - 0.00% -
401.bzip2 (unexplained diff vs previous) -78.24% 193.000 42.000 - 0.00% -
429.mcf (max) -8.70% 23.000 21.000 - 0.00% -
429.mcf (max) (percentage) -8.33% 0.240 0.220 - 0.00% -
401.bzip2 (max) (percentage) -8.33% 1.680 1.540 - 0.00% -
401.bzip2 (max) -7.94% 189.000 174.000 - 0.00% -
429.mcf -4.76% 21.000 20.000 - 0.00% -
429.mcf (avg) -4.76% 21.000 20.000 - 0.00% -
462.libquantum (max) -4.69% 64.000 61.000 - 0.00% -
429.mcf (avg) (percentage) -4.55% 0.220 0.210 - 0.00% -
462.libquantum (max) (percentage) -4.55% 0.440 0.420 - 0.00% -
401.bzip2 (avg) (percentage) -2.22% 0.900 0.880 - 0.00% -
401.bzip2 -1.98% 101.000 99.000 - 0.00% -
401.bzip2 (avg) -1.98% 101.000 99.000 - 0.00% -

Added Tests - Execution
470.lbm

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
458.sjeng 1.81% 13872.000 14123.000 - -1.37% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
429.mcf -1.20% 11954.000 11810.000 - 0.00% -

Added Tests - Execution
403.gcc
433.milc
450.soplex
470.lbm
483.xalancbmk

Added Tests - sample variability
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)


Report Time: 0.20s
Name Current %
401.bzip2 11308.000 -
403.gcc 137.000 2.24%
429.mcf 9672.000 -
433.milc 5.000 -
450.soplex 15.000 -21.05%
458.sjeng 14123.000 -1.37%
462.libquantum 14671.000 -
470.lbm 1.000 -
483.xalancbmk 2684.000 -
Geometric Mean 440.544 -54.60%
Name Current %
401.bzip2 79167.000 -
429.mcf 11810.000 -
458.sjeng 145908.000 -
462.libquantum 33808.000 -
Geometric Mean 46341.829 -