Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/7a87ff64e1fe970adcc41b7fc664fb5fd8410a68 (+ 232 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-spec2k6--llvm-arm-master-O3-build/133/
Filter

llvm-arm-master-O3 test results

Run Order Start Time Duration
Current 0133 (llvmorg-18-init-15416-g7a87ff64e1fe) 2023-12-19T17:58:47 0:00:00
Previous 0131 (no-change) 2023-12-18T18:14:59 0:00:00
Baseline 0079 (llvmorg-18-init-07933-ge13bed4c5f35) 2023-10-06T11:29:06 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 7 1
Performance Improvements 21 1
Added Tests 2 28
Unchanged Tests 246 246
Total Tests 276

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
450.soplex 5.88% 17.000 18.000 - 0.00% -
401.bzip2 1.04% 11266.000 11383.000 - 0.70% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
401.bzip2 (unexplained diff vs previous) 12.50% 104.000 117.000 - 0.00% -
401.bzip2 (unexplained diff vs previous) (percentage) 11.96% 0.920 1.030 - 0.00% -
401.bzip2 2.86% 105.000 108.000 - 0.00% -
401.bzip2 (avg) 2.86% 105.000 108.000 - 0.00% -
401.bzip2 (avg) (percentage) 1.06% 0.940 0.950 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
483.xalancbmk -3.20% 2720.000 2633.000 - 0.00% -
403.gcc -2.21% 136.000 133.000 - 0.00% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
458.sjeng (unexplained diff vs previous) -66.67% 3.000 1.000 - 0.00% -
429.mcf (unexplained diff vs previous) -54.55% 11.000 5.000 - 0.00% -
429.mcf (unexplained diff vs previous) (percentage) -54.55% 0.110 0.050 - 0.00% -
458.sjeng (unexplained diff vs previous) (percentage) -50.00% 0.020 0.010 - 0.00% -
429.mcf (max) -10.00% 30.000 27.000 - 0.00% -
429.mcf (max) (percentage) -9.68% 0.310 0.280 - 0.00% -
462.libquantum -9.09% 33.000 30.000 - 0.00% -
462.libquantum (avg) -9.09% 33.000 30.000 - 0.00% -
462.libquantum (avg) (percentage) -8.70% 0.230 0.210 - 0.00% -
458.sjeng (avg) (percentage) -7.84% 0.510 0.470 - 0.00% -
462.libquantum (max) -7.69% 39.000 36.000 - 0.00% -
462.libquantum (max) (percentage) -7.41% 0.270 0.250 - 0.00% -
458.sjeng -6.94% 72.000 67.000 - 0.00% -
458.sjeng (avg) -6.94% 72.000 67.000 - 0.00% -
429.mcf -4.17% 24.000 23.000 - 0.00% -
429.mcf (avg) -4.17% 24.000 23.000 - 0.00% -
429.mcf (avg) (percentage) -4.00% 0.250 0.240 - 0.00% -
401.bzip2 (max) (percentage) -3.87% 1.810 1.740 - 0.00% -
401.bzip2 (max) -2.46% 203.000 198.000 - 0.00% -

Added Tests - sample variability
462.libquantum (unexplained diff vs previous)
462.libquantum (unexplained diff vs previous) (percentage)

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
458.sjeng 2.86% 13872.000 14269.000 - -0.01% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
429.mcf -1.07% 11954.000 11826.000 - 0.00% -

Added Tests - Execution
403.gcc
433.milc
450.soplex
470.lbm
482.sphinx3
483.xalancbmk

Added Tests - sample variability
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)
462.libquantum (unexplained diff vs previous)
462.libquantum (unexplained diff vs previous) (percentage)


Report Time: 0.20s
Name Current %
401.bzip2 11383.000 1.04%
403.gcc 133.000 -2.21%
429.mcf 9673.000 -
433.milc 5.000 -
450.soplex 18.000 5.88%
458.sjeng 14269.000 -
462.libquantum 14681.000 -
470.lbm 1.000 -
482.sphinx3 1.000 -
483.xalancbmk 2633.000 -3.20%
Geometric Mean 243.311 -
Name Current %
401.bzip2 79151.000 -
429.mcf 11826.000 -
458.sjeng 145844.000 -
462.libquantum 33808.000 -
Geometric Mean 46350.090 -