Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/b88b480640f173582ffbfd2faae690f2bc895d14 (+ 1528 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-spec2k6--llvm-arm-master-O3-build/103/
Filter

llvm-arm-master-O3 test results

Run Order Start Time Duration
Current 0103 (llvmorg-18-init-14253-gb88b480640f1) 2023-12-02T04:51:33 0:00:00
Previous 0101 (no-change) 2023-11-25T06:58:40 0:00:00
Baseline 0079 (llvmorg-18-init-07933-ge13bed4c5f35) 2023-10-06T11:29:06 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 10 1
Performance Improvements 14 1
Added Tests 1 25
Unchanged Tests 251 249
Total Tests 276

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
429.mcf (avg) (percentage) 26.92% 0.260 0.330 - 0.00% -
429.mcf 24.00% 25.000 31.000 - 0.00% -
429.mcf (avg) 24.00% 25.000 31.000 - 0.00% -
429.mcf (unexplained diff vs previous) (percentage) 9.59% 0.730 0.800 - 0.00% -
429.mcf (unexplained diff vs previous) 8.45% 71.000 77.000 - 0.00% -
429.mcf (max) (percentage) 8.22% 0.730 0.790 - 0.00% -
429.mcf (max) 7.04% 71.000 76.000 - 0.00% -
462.libquantum 6.82% 44.000 47.000 - 0.00% -
462.libquantum (avg) 6.82% 44.000 47.000 - 0.00% -
462.libquantum (avg) (percentage) 6.67% 0.300 0.320 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
450.soplex -11.11% 18.000 16.000 - 0.00% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
458.sjeng (unexplained diff vs previous) (percentage) -96.43% 0.280 0.010 - 0.00% -
458.sjeng (unexplained diff vs previous) -95.00% 40.000 2.000 - 0.00% -
458.sjeng (max) -45.43% 317.000 173.000 - 0.00% -
458.sjeng (max) (percentage) -45.29% 2.230 1.220 - 0.00% -
462.libquantum (unexplained diff vs previous) (percentage) -28.33% 0.600 0.430 - 0.00% -
462.libquantum (unexplained diff vs previous) -28.09% 89.000 64.000 - 0.00% -
458.sjeng -16.26% 123.000 103.000 - 0.00% -
458.sjeng (avg) -16.26% 123.000 103.000 - 0.00% -
458.sjeng (avg) (percentage) -16.09% 0.870 0.730 - 0.00% -
462.libquantum (max) -11.11% 90.000 80.000 - 0.00% -
462.libquantum (max) (percentage) -9.84% 0.610 0.550 - 0.00% -
401.bzip2 (max) (percentage) -4.55% 0.880 0.840 - 0.00% -
401.bzip2 (max) -4.04% 99.000 95.000 - 0.00% -

Added Tests - Execution
470.lbm

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
458.sjeng 2.61% 13872.000 14234.000 - 0.01% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
429.mcf -1.07% 11954.000 11826.000 - 0.00% -

Added Tests - Execution
403.gcc
433.milc
450.soplex
470.lbm
483.xalancbmk

Added Tests - sample variability
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)


Report Time: 0.20s
Name Current %
401.bzip2 11313.000 -
403.gcc 137.000 -
429.mcf 9663.000 -
433.milc 5.000 -
450.soplex 16.000 -11.11%
458.sjeng 14234.000 -
462.libquantum 14713.000 -
470.lbm 1.000 -
483.xalancbmk 2720.000 -
Geometric Mean 444.876 -54.09%
Name Current %
401.bzip2 79183.000 -
429.mcf 11826.000 -
458.sjeng 145844.000 -
462.libquantum 33808.000 -
Geometric Mean 46354.774 -