Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/d715e2c65b4449f00b39493b1e0a19c04b75bc7c (+ 30 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-spec2k6--llvm-arm-master-O3-build/91/
Filter

llvm-arm-master-O3 test results

Run Order Start Time Duration
Current 0091 (llvmorg-18-init-12182-gd715e2c65b44) 2023-11-17T07:59:47 0:00:00
Previous 0089 (llvmorg-18-init-12152-gdfe1d35c629f) 2023-11-14T07:00:09 0:00:00
Baseline 0079 (llvmorg-18-init-07933-ge13bed4c5f35) 2023-10-06T11:29:06 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 12 2
Performance Improvements 13 1
Added Tests 0 26
Unchanged Tests 251 247
Total Tests 276

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
403.gcc 2.26% 133.000 136.000 - 0.00% -
401.bzip2 1.15% 11325.000 11455.000 - 1.34% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
401.bzip2 (max) 147.17% 53.000 131.000 - 0.00% -
401.bzip2 (max) (percentage) 144.68% 0.470 1.150 - 0.00% -
401.bzip2 (unexplained diff vs previous) 140.74% 54.000 130.000 - 0.00% -
401.bzip2 (unexplained diff vs previous) (percentage) 135.42% 0.480 1.130 - 0.00% -
401.bzip2 75.86% 29.000 51.000 - 0.00% -
401.bzip2 (avg) 75.86% 29.000 51.000 - 0.00% -
401.bzip2 (avg) (percentage) 73.08% 0.260 0.450 - 0.00% -
458.sjeng (avg) (percentage) 27.83% 1.150 1.470 - 0.00% -
458.sjeng 24.70% 166.000 207.000 - 0.00% -
458.sjeng (avg) 24.70% 166.000 207.000 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
458.sjeng -2.43% 14491.000 14139.000 - 1.92% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
462.libquantum (unexplained diff vs previous) -63.49% 63.000 23.000 - 0.00% -
462.libquantum (unexplained diff vs previous) (percentage) -62.79% 0.430 0.160 - 0.00% -
429.mcf (unexplained diff vs previous) -25.00% 12.000 9.000 - 0.00% -
429.mcf (unexplained diff vs previous) (percentage) -25.00% 0.120 0.090 - 0.00% -
458.sjeng (unexplained diff vs previous) -13.30% 406.000 352.000 - 0.00% -
462.libquantum (max) -12.70% 63.000 55.000 - 0.00% -
462.libquantum (max) (percentage) -11.63% 0.430 0.380 - 0.00% -
458.sjeng (unexplained diff vs previous) (percentage) -11.07% 2.800 2.490 - 0.00% -
458.sjeng (max) -9.59% 417.000 377.000 - 0.00% -
429.mcf (max) -7.69% 13.000 12.000 - 0.00% -
458.sjeng (max) (percentage) -7.29% 2.880 2.670 - 0.00% -
429.mcf (max) (percentage) -7.14% 0.140 0.130 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
458.sjeng 1.92% 13872.000 14139.000 - -2.43% -
401.bzip2 1.34% 11304.000 11455.000 - 1.15% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
429.mcf -1.07% 11954.000 11826.000 - 0.00% -

Added Tests - Execution
403.gcc
433.milc
450.soplex
470.lbm
482.sphinx3
483.xalancbmk

Added Tests - sample variability
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)


Report Time: 0.20s
Name Current %
401.bzip2 11455.000 1.15%
403.gcc 136.000 2.26%
429.mcf 9664.000 -
433.milc 5.000 -
450.soplex 18.000 -
458.sjeng 14139.000 -2.43%
462.libquantum 14708.000 -
470.lbm 1.000 -
482.sphinx3 1.000 -
483.xalancbmk 2707.000 -
Geometric Mean 244.483 -
Name Current %
401.bzip2 79227.000 -
429.mcf 11826.000 -
458.sjeng 145504.000 -
462.libquantum 33808.000 -
Geometric Mean 46334.169 -