Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/b8df88b41c8a1b4e879b4fd34be3522c9b45e86f (+ 1 commits)
regression LLVM-1068
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-spec2k6--llvm-arm-master-O3-build/137/
Filter

llvm-arm-master-O3 test results

Run Order Start Time Duration
Current 0137 (llvmorg-18-init-15519-gb8df88b41c8a) 2023-12-21T07:12:27 0:00:00
Previous 0136 (llvmorg-18-init-15518-g4d7112435e31) 2023-12-20T22:46:46 0:00:00
Baseline 0079 (llvmorg-18-init-07933-ge13bed4c5f35) 2023-10-06T11:29:06 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 13 1
Performance Improvements 8 1
Added Tests 2 26
Unchanged Tests 253 248
Total Tests 276

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
401.bzip2 1.01% 11273.000 11387.000 - 0.73% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
401.bzip2 (unexplained diff vs previous) 850.00% 12.000 114.000 - 0.00% -
401.bzip2 (unexplained diff vs previous) (percentage) 809.09% 0.110 1.000 - 0.00% -
458.sjeng (unexplained diff vs previous) 421.43% 14.000 73.000 - 0.00% -
458.sjeng (unexplained diff vs previous) (percentage) 410.00% 0.100 0.510 - 0.00% -
429.mcf (max) 16.67% 24.000 28.000 - 0.00% -
429.mcf (max) (percentage) 16.00% 0.250 0.290 - 0.00% -
458.sjeng 3.39% 59.000 61.000 - 0.00% -
458.sjeng (avg) 3.39% 59.000 61.000 - 0.00% -
458.sjeng (avg) (percentage) 2.38% 0.420 0.430 - 0.00% -
401.bzip2 2.00% 100.000 102.000 - 0.00% -
401.bzip2 (avg) 2.00% 100.000 102.000 - 0.00% -
401.bzip2 (avg) (percentage) 1.12% 0.890 0.900 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
450.soplex -17.65% 17.000 14.000 - 0.00% -
403.gcc -1.46% 137.000 135.000 - 0.00% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
462.libquantum (unexplained diff vs previous) (percentage) -56.25% 0.160 0.070 - 0.00% -
462.libquantum (unexplained diff vs previous) -54.17% 24.000 11.000 - 0.00% -
462.libquantum (max) -37.50% 32.000 20.000 - 0.00% -
462.libquantum (max) (percentage) -36.36% 0.220 0.140 - 0.00% -
462.libquantum -3.33% 30.000 29.000 - 0.00% -
462.libquantum (avg) -3.33% 30.000 29.000 - 0.00% -

Added Tests - sample variability
429.mcf (unexplained diff vs previous)
429.mcf (unexplained diff vs previous) (percentage)

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
458.sjeng 3.24% 13872.000 14321.000 - 0.51% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
429.mcf -1.20% 11954.000 11810.000 - 0.00% -

Added Tests - Execution
403.gcc
433.milc
450.soplex
470.lbm
482.sphinx3
483.xalancbmk

Added Tests - sample variability
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)


Report Time: 0.22s
Name Current %
401.bzip2 11387.000 1.01%
403.gcc 135.000 -1.46%
429.mcf 9704.000 -
433.milc 5.000 -
450.soplex 14.000 -17.65%
458.sjeng 14321.000 -
462.libquantum 14692.000 -
470.lbm 1.000 -
482.sphinx3 1.000 -
483.xalancbmk 2626.000 -
Geometric Mean 237.752 -1.91%
Name Current %
401.bzip2 79151.000 -
429.mcf 11810.000 -
458.sjeng 145844.000 -
462.libquantum 33808.000 -
Geometric Mean 46334.405 -