Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/b9975cec0ea0a2f10d65b7bd1197d9e1706cbd3d (+ 1 commits)
regression LLVM-1024
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-spec2k6--llvm-arm-master-O3-build/92/
Filter

llvm-arm-master-O3 test results

Run Order Start Time Duration
Current 0092 (llvmorg-18-init-12183-gb9975cec0ea0) 2023-11-18T20:29:44 0:00:00
Previous 0091 (llvmorg-18-init-12182-gd715e2c65b44) 2023-11-17T07:59:47 0:00:00
Baseline 0079 (llvmorg-18-init-07933-ge13bed4c5f35) 2023-10-06T11:29:06 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 7 1
Performance Improvements 22 1
Added Tests 0 26
Unchanged Tests 247 248
Total Tests 276

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
482.sphinx3 200.00% 1.000 3.000 - 0.00% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
401.bzip2 (avg) (percentage) 31.11% 0.450 0.590 - 0.00% -
401.bzip2 29.41% 51.000 66.000 - 0.00% -
401.bzip2 (avg) 29.41% 51.000 66.000 - 0.00% -
401.bzip2 (unexplained diff vs previous) (percentage) 4.42% 1.130 1.180 - 0.00% -
401.bzip2 (unexplained diff vs previous) 3.08% 130.000 134.000 - 0.00% -
401.bzip2 (max) (percentage) 1.74% 1.150 1.170 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
450.soplex -44.44% 18.000 10.000 - 0.00% -
401.bzip2 -1.17% 11455.000 11321.000 - 0.15% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
458.sjeng (unexplained diff vs previous) -93.75% 352.000 22.000 - 0.00% -
458.sjeng (unexplained diff vs previous) (percentage) -93.57% 2.490 0.160 - 0.00% -
429.mcf (unexplained diff vs previous) -77.78% 9.000 2.000 - 0.00% -
429.mcf (unexplained diff vs previous) (percentage) -77.78% 0.090 0.020 - 0.00% -
462.libquantum (unexplained diff vs previous) (percentage) -43.75% 0.160 0.090 - 0.00% -
462.libquantum (unexplained diff vs previous) -43.48% 23.000 13.000 - 0.00% -
458.sjeng (avg) (percentage) -19.05% 1.470 1.190 - 0.00% -
458.sjeng -18.84% 207.000 168.000 - 0.00% -
458.sjeng (avg) -18.84% 207.000 168.000 - 0.00% -
429.mcf -14.29% 7.000 6.000 - 0.00% -
429.mcf (avg) -14.29% 7.000 6.000 - 0.00% -
462.libquantum (max) -10.91% 55.000 49.000 - 0.00% -
462.libquantum (max) (percentage) -10.53% 0.380 0.340 - 0.00% -
429.mcf (max) -8.33% 12.000 11.000 - 0.00% -
429.mcf (max) (percentage) -7.69% 0.130 0.120 - 0.00% -
462.libquantum (avg) (percentage) -6.25% 0.160 0.150 - 0.00% -
458.sjeng (max) (percentage) -5.62% 2.670 2.520 - 0.00% -
458.sjeng (max) -5.57% 377.000 356.000 - 0.00% -
462.libquantum -4.35% 23.000 22.000 - 0.00% -
462.libquantum (avg) -4.35% 23.000 22.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
458.sjeng 2.08% 13872.000 14161.000 - 0.16% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
429.mcf -1.07% 11954.000 11826.000 - 0.00% -

Added Tests - Execution
403.gcc
433.milc
450.soplex
470.lbm
482.sphinx3
483.xalancbmk

Added Tests - sample variability
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)


Report Time: 0.20s
Name Current %
401.bzip2 11321.000 -1.17%
403.gcc 136.000 -
429.mcf 9662.000 -
433.milc 5.000 -
450.soplex 10.000 -44.44%
458.sjeng 14161.000 -
462.libquantum 14695.000 -
470.lbm 1.000 -
482.sphinx3 3.000 200.00%
483.xalancbmk 2711.000 -
Geometric Mean 257.042 5.14%
Name Current %
401.bzip2 79227.000 -
429.mcf 11826.000 -
458.sjeng 145504.000 -
462.libquantum 33808.000 -
Geometric Mean 46334.169 -