Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/853b13342a131e06d61293ec6e840642054c6c85 (+ 453 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-spec2k6--llvm-arm-master-O3-build/148/
Filter

llvm-arm-master-O3 test results

Run Order Start Time Duration
Current 0148 (llvmorg-18-init-16315-g853b13342a13) 2024-01-02T03:31:20 0:00:00
Previous 0144 (llvmorg-18-init-15862-g3ddf3685248a) 2023-12-29T09:20:49 0:00:00
Baseline 0079 (llvmorg-18-init-07933-ge13bed4c5f35) 2023-10-06T11:29:06 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 3 4
Performance Improvements 15 1
Added Tests 0 26
Unchanged Tests 258 245
Total Tests 276

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
482.sphinx3 100.00% 1.000 2.000 - 0.00% -
450.soplex 77.78% 9.000 16.000 - 0.00% -
483.xalancbmk 2.63% 2624.000 2693.000 - 0.00% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
462.libquantum (unexplained diff vs previous) -68.29% 41.000 13.000 - 0.00% -
462.libquantum (unexplained diff vs previous) (percentage) -67.86% 0.280 0.090 - 0.00% -
458.sjeng (max) -13.51% 37.000 32.000 - 0.00% -
458.sjeng (max) (percentage) -11.54% 0.260 0.230 - 0.00% -
462.libquantum (max) (percentage) -9.62% 0.520 0.470 - 0.00% -
462.libquantum (max) -9.21% 76.000 69.000 - 0.00% -
401.bzip2 (max) (percentage) -7.14% 1.120 1.040 - 0.00% -
401.bzip2 (max) -7.03% 128.000 119.000 - 0.00% -
462.libquantum (avg) (percentage) -4.35% 0.230 0.220 - 0.00% -
429.mcf (max) -3.45% 29.000 28.000 - 0.00% -
429.mcf (max) (percentage) -3.33% 0.300 0.290 - 0.00% -
462.libquantum -3.03% 33.000 32.000 - 0.00% -
462.libquantum (avg) -3.03% 33.000 32.000 - 0.00% -

Performance Improvements - Score Δ Previous Current σ Δ (B) σ (B)
nb_compile_successful 14.29% 14.000 16.000 - -15.79% -
nb_total_tests 14.29% 14.000 16.000 - -15.79% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
458.sjeng 3.09% 13872.000 14301.000 - -0.30% -
401.bzip2 1.37% 11304.000 11459.000 - -0.33% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -15.79% 19.000 16.000 - 14.29% -
nb_total_tests -15.79% 19.000 16.000 - 14.29% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
429.mcf -1.20% 11954.000 11810.000 - -0.14% -

Added Tests - Execution
403.gcc
433.milc
450.soplex
470.lbm
482.sphinx3
483.xalancbmk

Added Tests - sample variability
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)


Report Time: 0.19s
Name Current %
401.bzip2 11459.000 -
403.gcc 133.000 -
429.mcf 9675.000 -
433.milc 5.000 -
450.soplex 16.000 77.78%
458.sjeng 14301.000 -
462.libquantum 14715.000 -
470.lbm 1.000 -
482.sphinx3 2.000 100.00%
483.xalancbmk 2693.000 2.63%
Geometric Mean 258.595 13.60%
Name Current %
401.bzip2 79167.000 -
429.mcf 11810.000 -
458.sjeng 145908.000 -
462.libquantum 33808.000 -
Geometric Mean 46341.829 -
Name Current %
nb_compile_successful 16.000 14.29%
nb_execution_successful 4.000 -
nb_total_tests 16.000 14.29%
Geometric Mean 10.079 9.31%