Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/771676878a1df2610cdc2ece6a55b4aa81a3da6a (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-spec2k6--llvm-arm-master-O3-build/101/
Filter

llvm-arm-master-O3 test results

Run Order Start Time Duration
Current 0101 (no-change) 2023-11-25T06:58:40 0:00:00
Previous 0087 (llvmorg-18-init-11473-g190b9179a5de) 2023-11-08T21:57:56 0:00:00
Baseline 0079 (llvmorg-18-init-07933-ge13bed4c5f35) 2023-10-06T11:29:06 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 27 1
Performance Improvements 0 1
Added Tests 5 25
Unchanged Tests 244 249
Total Tests 276

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
458.sjeng 1.04% 14085.000 14232.000 - 2.60% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
429.mcf (max) 343.75% 16.000 71.000 - 0.00% -
429.mcf (unexplained diff vs previous) 343.75% 16.000 71.000 - 0.00% -
429.mcf (max) (percentage) 329.41% 0.170 0.730 - 0.00% -
429.mcf (unexplained diff vs previous) (percentage) 329.41% 0.170 0.730 - 0.00% -
429.mcf 316.67% 6.000 25.000 - 0.00% -
429.mcf (avg) 316.67% 6.000 25.000 - 0.00% -
462.libquantum (max) 309.09% 22.000 90.000 - 0.00% -
462.libquantum (max) (percentage) 306.67% 0.150 0.610 - 0.00% -
462.libquantum (unexplained diff vs previous) 304.55% 22.000 89.000 - 0.00% -
462.libquantum 300.00% 11.000 44.000 - 0.00% -
462.libquantum (avg) 300.00% 11.000 44.000 - 0.00% -
462.libquantum (unexplained diff vs previous) (percentage) 300.00% 0.150 0.600 - 0.00% -
462.libquantum (avg) (percentage) 275.00% 0.080 0.300 - 0.00% -
429.mcf (avg) (percentage) 271.43% 0.070 0.260 - 0.00% -
401.bzip2 252.38% 21.000 74.000 - 0.00% -
401.bzip2 (avg) 252.38% 21.000 74.000 - 0.00% -
401.bzip2 (avg) (percentage) 247.37% 0.190 0.660 - 0.00% -
401.bzip2 (max) 241.38% 29.000 99.000 - 0.00% -
401.bzip2 (max) (percentage) 238.46% 0.260 0.880 - 0.00% -
458.sjeng (max) 196.26% 107.000 317.000 - 0.00% -
458.sjeng (max) (percentage) 193.42% 0.760 2.230 - 0.00% -
458.sjeng 115.79% 57.000 123.000 - 0.00% -
458.sjeng (avg) 115.79% 57.000 123.000 - 0.00% -
458.sjeng (avg) (percentage) 112.20% 0.410 0.870 - 0.00% -
458.sjeng (unexplained diff vs previous) 81.82% 22.000 40.000 - 0.00% -
458.sjeng (unexplained diff vs previous) (percentage) 75.00% 0.160 0.280 - 0.00% -

Added Tests - Execution
403.gcc
433.milc
450.soplex
482.sphinx3
483.xalancbmk

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
458.sjeng 2.60% 13872.000 14232.000 - 1.04% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
429.mcf -1.07% 11954.000 11826.000 - 0.00% -

Added Tests - Execution
403.gcc
433.milc
450.soplex
482.sphinx3
483.xalancbmk

Added Tests - sample variability
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)


Report Time: 0.20s
Name Current %
401.bzip2 11284.000 -
403.gcc 138.000 -
429.mcf 9740.000 -
433.milc 5.000 -
450.soplex 18.000 -
458.sjeng 14232.000 1.04%
462.libquantum 14777.000 -
482.sphinx3 1.000 -
483.xalancbmk 2710.000 -
Geometric Mean 451.396 -96.33%
Name Current %
401.bzip2 79227.000 -
429.mcf 11826.000 -
458.sjeng 145844.000 -
462.libquantum 33808.000 -
Geometric Mean 46361.212 -