Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/4d7112435e31dafb5854f69c516373e4548bd0a3 (+ 101 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-spec2k6--llvm-arm-master-O3-build/136/
Filter

llvm-arm-master-O3 test results

Run Order Start Time Duration
Current 0136 (llvmorg-18-init-15518-g4d7112435e31) 2023-12-20T22:46:46 0:00:00
Previous 0134 (llvmorg-18-init-15417-gb03f0c596a18) 2023-12-20T05:55:24 0:00:00
Baseline 0079 (llvmorg-18-init-07933-ge13bed4c5f35) 2023-10-06T11:29:06 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 2 1
Performance Improvements 15 1
Added Tests 0 26
Unchanged Tests 259 248
Total Tests 276

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
458.sjeng (unexplained diff vs previous) 100.00% 7.000 14.000 - 0.00% -
458.sjeng (unexplained diff vs previous) (percentage) 100.00% 0.050 0.100 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
482.sphinx3 -50.00% 2.000 1.000 - 0.00% -
450.soplex -10.53% 19.000 17.000 - 0.00% -
403.gcc -2.14% 140.000 137.000 - 0.00% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
401.bzip2 (unexplained diff vs previous) -87.76% 98.000 12.000 - 0.00% -
401.bzip2 (unexplained diff vs previous) (percentage) -87.36% 0.870 0.110 - 0.00% -
458.sjeng -7.81% 64.000 59.000 - 0.00% -
458.sjeng (avg) -7.81% 64.000 59.000 - 0.00% -
458.sjeng (avg) (percentage) -6.67% 0.450 0.420 - 0.00% -
401.bzip2 -5.66% 106.000 100.000 - 0.00% -
401.bzip2 (avg) -5.66% 106.000 100.000 - 0.00% -
401.bzip2 (avg) (percentage) -5.32% 0.940 0.890 - 0.00% -
462.libquantum (max) (percentage) -4.35% 0.230 0.220 - 0.00% -
429.mcf (max) -4.00% 25.000 24.000 - 0.00% -
429.mcf (max) (percentage) -3.85% 0.260 0.250 - 0.00% -
462.libquantum (max) -3.03% 33.000 32.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
458.sjeng 2.71% 13872.000 14248.000 - -0.10% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
429.mcf -1.20% 11954.000 11810.000 - -0.14% -

Added Tests - Execution
403.gcc
433.milc
450.soplex
470.lbm
482.sphinx3
483.xalancbmk

Added Tests - sample variability
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)


Report Time: 0.20s
Name Current %
401.bzip2 11273.000 -
403.gcc 137.000 -2.14%
429.mcf 9676.000 -
433.milc 5.000 -
450.soplex 17.000 -10.53%
458.sjeng 14248.000 -
462.libquantum 14681.000 -
470.lbm 1.000 -
482.sphinx3 1.000 -50.00%
483.xalancbmk 2634.000 -
Geometric Mean 242.387 -7.96%
Name Current %
401.bzip2 79151.000 -
429.mcf 11810.000 -
458.sjeng 145844.000 -
462.libquantum 33808.000 -
Geometric Mean 46334.405 -