Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/31d7ad4d994b1f6b60da304ec2d06bd2d7f16aaa (+ 1 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-spec2k6--llvm-arm-master-O3-build/142/
Filter

llvm-arm-master-O3 test results

Run Order Start Time Duration
Current 0142 (llvmorg-18-init-15854-g31d7ad4d994b) 2023-12-28T16:42:45 0:00:00
Previous 0141 (llvmorg-18-init-15853-gbae46d14eb66) 2023-12-27T13:01:31 0:00:00
Baseline 0079 (llvmorg-18-init-07933-ge13bed4c5f35) 2023-10-06T11:29:06 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 15 1
Performance Improvements 8 1
Added Tests 1 26
Unchanged Tests 252 248
Total Tests 276

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
401.bzip2 (unexplained diff vs previous) 4250.00% 2.000 87.000 - 0.00% -
401.bzip2 (unexplained diff vs previous) (percentage) 3750.00% 0.020 0.770 - 0.00% -
458.sjeng (unexplained diff vs previous) (percentage) 1450.00% 0.020 0.310 - 0.00% -
458.sjeng (unexplained diff vs previous) 1366.67% 3.000 44.000 - 0.00% -
429.mcf (unexplained diff vs previous) (percentage) 316.67% 0.060 0.250 - 0.00% -
429.mcf (unexplained diff vs previous) 300.00% 6.000 24.000 - 0.00% -
462.libquantum (unexplained diff vs previous) (percentage) 84.37% 0.320 0.590 - 0.00% -
462.libquantum (unexplained diff vs previous) 81.25% 48.000 87.000 - 0.00% -
462.libquantum (max) 79.17% 48.000 86.000 - 0.00% -
462.libquantum (max) (percentage) 78.79% 0.330 0.590 - 0.00% -
462.libquantum (avg) (percentage) 9.52% 0.210 0.230 - 0.00% -
462.libquantum 6.45% 31.000 33.000 - 0.00% -
462.libquantum (avg) 6.45% 31.000 33.000 - 0.00% -
401.bzip2 1.05% 95.000 96.000 - 0.00% -
401.bzip2 (avg) 1.05% 95.000 96.000 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
450.soplex -10.53% 19.000 17.000 - 0.00% -
403.gcc -1.50% 133.000 131.000 - 0.00% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
458.sjeng (max) (percentage) -4.76% 0.420 0.400 - 0.00% -
458.sjeng (max) -3.39% 59.000 57.000 - 0.00% -
401.bzip2 (max) (percentage) -2.53% 0.790 0.770 - 0.00% -
401.bzip2 (max) -2.25% 89.000 87.000 - 0.00% -

Performance Improvements - Score Δ Previous Current σ Δ (B) σ (B)
nb_compile_successful 46.15% 13.000 19.000 - 0.00% -
nb_total_tests 46.15% 13.000 19.000 - 0.00% -

Added Tests - Execution
482.sphinx3

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
458.sjeng 3.18% 13872.000 14313.000 - 0.31% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
429.mcf -1.07% 11954.000 11826.000 - 0.00% -

Added Tests - Execution
403.gcc
433.milc
450.soplex
470.lbm
482.sphinx3
483.xalancbmk

Added Tests - sample variability
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)


Report Time: 0.21s
Name Current %
401.bzip2 11370.000 -
403.gcc 131.000 -1.50%
429.mcf 9688.000 -
433.milc 5.000 -
450.soplex 17.000 -10.53%
458.sjeng 14313.000 -
462.libquantum 14687.000 -
470.lbm 1.000 -
482.sphinx3 1.000 -
483.xalancbmk 2630.000 -
Geometric Mean 241.624 -46.41%
Name Current %
401.bzip2 79151.000 -
429.mcf 11826.000 -
458.sjeng 145844.000 -
462.libquantum 33808.000 -
Geometric Mean 46350.090 -
Name Current %
nb_compile_successful 19.000 46.15%
nb_execution_successful 4.000 -
nb_total_tests 19.000 46.15%
Geometric Mean 11.303 28.79%