Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/190b9179a5def1db3483617286d5a8f4a8dde1f3 (+ 291 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-spec2k6--llvm-arm-master-O3-build/87/
Filter

llvm-arm-master-O3 test results

Run Order Start Time Duration
Current 0087 (llvmorg-18-init-11473-g190b9179a5de) 2023-11-08T21:57:56 0:00:00
Previous 0086 (llvmorg-18-init-11182-g1f21e49870fe) 2023-11-05T15:21:37 0:00:00
Baseline 0079 (llvmorg-18-init-07933-ge13bed4c5f35) 2023-10-06T11:29:06 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 16 1
Performance Improvements 11 1
Added Tests 0 20
Unchanged Tests 249 254
Total Tests 276

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
462.libquantum (unexplained diff vs previous) 2100.00% 1.000 22.000 - 0.00% -
462.libquantum (unexplained diff vs previous) (percentage) 1400.00% 0.010 0.150 - 0.00% -
429.mcf (unexplained diff vs previous) (percentage) 466.67% 0.030 0.170 - 0.00% -
429.mcf (max) 433.33% 3.000 16.000 - 0.00% -
429.mcf (unexplained diff vs previous) 433.33% 3.000 16.000 - 0.00% -
429.mcf (max) (percentage) 325.00% 0.040 0.170 - 0.00% -
429.mcf 200.00% 2.000 6.000 - 0.00% -
429.mcf (avg) 200.00% 2.000 6.000 - 0.00% -
429.mcf (avg) (percentage) 133.33% 0.030 0.070 - 0.00% -
462.libquantum 37.50% 8.000 11.000 - 0.00% -
462.libquantum (avg) 37.50% 8.000 11.000 - 0.00% -
462.libquantum (avg) (percentage) 33.33% 0.060 0.080 - 0.00% -
401.bzip2 (avg) (percentage) 11.76% 0.170 0.190 - 0.00% -
401.bzip2 10.53% 19.000 21.000 - 0.00% -
401.bzip2 (avg) 10.53% 19.000 21.000 - 0.00% -
462.libquantum (max) 10.00% 20.000 22.000 - 0.00% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
458.sjeng -26.92% 78.000 57.000 - 0.00% -
458.sjeng (avg) -26.92% 78.000 57.000 - 0.00% -
458.sjeng (avg) (percentage) -26.79% 0.560 0.410 - 0.00% -
458.sjeng (unexplained diff vs previous) -21.43% 28.000 22.000 - 0.00% -
458.sjeng (unexplained diff vs previous) (percentage) -20.00% 0.200 0.160 - 0.00% -
401.bzip2 (max) (percentage) -3.70% 0.270 0.260 - 0.00% -
401.bzip2 (unexplained diff vs previous) (percentage) -3.70% 0.270 0.260 - 0.00% -
401.bzip2 (max) -3.33% 30.000 29.000 - 0.00% -
401.bzip2 (unexplained diff vs previous) -3.23% 31.000 30.000 - 0.00% -
458.sjeng (max) (percentage) -2.56% 0.780 0.760 - 0.00% -
458.sjeng (max) -1.83% 109.000 107.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
458.sjeng 1.54% 13872.000 14085.000 - 0.16% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
429.mcf -1.07% 11954.000 11826.000 - 0.00% -

Added Tests - sample variability
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)


Report Time: 0.20s
Name Current %
401.bzip2 11379.000 -
429.mcf 9685.000 -
458.sjeng 14085.000 -
462.libquantum 14668.000 -
Geometric Mean 12283.804 -
Name Current %
401.bzip2 79227.000 -
429.mcf 11826.000 -
458.sjeng 145504.000 -
462.libquantum 33808.000 -
Geometric Mean 46334.169 -