Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/d5fb4c0f118b47db74233af2d99ae075e1dbe148 (+ 208 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-spec2k6--llvm-arm-master-O3-build/104/
Filter

llvm-arm-master-O3 test results

Run Order Start Time Duration
Current 0104 (llvmorg-18-init-14461-gd5fb4c0f118b) 2023-12-07T04:41:44 0:00:00
Previous 0103 (llvmorg-18-init-14253-gb88b480640f1) 2023-12-02T04:51:33 0:00:00
Baseline 0079 (llvmorg-18-init-07933-ge13bed4c5f35) 2023-10-06T11:29:06 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 3 1
Performance Improvements 23 1
Added Tests 2 25
Unchanged Tests 248 249
Total Tests 276

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
450.soplex 6.25% 16.000 17.000 - 0.00% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
458.sjeng (unexplained diff vs previous) (percentage) 4800.00% 0.010 0.490 - 0.00% -
458.sjeng (unexplained diff vs previous) 3400.00% 2.000 70.000 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
403.gcc -4.38% 137.000 131.000 - 0.00% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
429.mcf (unexplained diff vs previous) (percentage) -92.50% 0.800 0.060 - 0.00% -
429.mcf (unexplained diff vs previous) -92.21% 77.000 6.000 - 0.00% -
462.libquantum (unexplained diff vs previous) -35.94% 64.000 41.000 - 0.00% -
462.libquantum (unexplained diff vs previous) (percentage) -34.88% 0.430 0.280 - 0.00% -
401.bzip2 (avg) (percentage) -18.18% 0.660 0.540 - 0.00% -
401.bzip2 -17.57% 74.000 61.000 - 0.00% -
401.bzip2 (avg) -17.57% 74.000 61.000 - 0.00% -
429.mcf (max) -17.11% 76.000 63.000 - 0.00% -
429.mcf (max) (percentage) -16.46% 0.790 0.660 - 0.00% -
429.mcf (avg) (percentage) -12.12% 0.330 0.290 - 0.00% -
429.mcf -9.68% 31.000 28.000 - 0.00% -
429.mcf (avg) -9.68% 31.000 28.000 - 0.00% -
462.libquantum (max) -7.50% 80.000 74.000 - 0.00% -
462.libquantum (max) (percentage) -7.27% 0.550 0.510 - 0.00% -
458.sjeng (avg) (percentage) -5.48% 0.730 0.690 - 0.00% -
401.bzip2 (max) -5.26% 95.000 90.000 - 0.00% -
458.sjeng -4.85% 103.000 98.000 - 0.00% -
458.sjeng (avg) -4.85% 103.000 98.000 - 0.00% -
401.bzip2 (max) (percentage) -4.76% 0.840 0.800 - 0.00% -
462.libquantum -4.26% 47.000 45.000 - 0.00% -
462.libquantum (avg) -4.26% 47.000 45.000 - 0.00% -
462.libquantum (avg) (percentage) -3.13% 0.320 0.310 - 0.00% -

Added Tests - sample variability
401.bzip2 (unexplained diff vs previous)
401.bzip2 (unexplained diff vs previous) (percentage)

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
458.sjeng 3.11% 13872.000 14304.000 - 0.49% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
429.mcf -1.07% 11954.000 11826.000 - 0.00% -

Added Tests - Execution
403.gcc
433.milc
450.soplex
470.lbm
483.xalancbmk

Added Tests - sample variability
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)


Report Time: 0.20s
Name Current %
401.bzip2 11316.000 -
403.gcc 131.000 -4.38%
429.mcf 9669.000 -
433.milc 5.000 -
450.soplex 17.000 6.25%
458.sjeng 14304.000 -
462.libquantum 14672.000 -
470.lbm 1.000 -
483.xalancbmk 2724.000 -
Geometric Mean 445.881 -
Name Current %
401.bzip2 79183.000 -
429.mcf 11826.000 -
458.sjeng 145844.000 -
462.libquantum 33808.000 -
Geometric Mean 46354.774 -