Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/9e759f3523e9e7fa955e4af58a6b4f63634dcb24 (+ 1418 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-spec2k6--llvm-arm-master-O3-build/171/
Filter

llvm-arm-master-O3 test results

Run Order Start Time Duration
Current 0171 (llvmorg-19-init-04324-g9e759f3523e9) 2024-02-25T22:11:40 0:00:00
Previous 0167 (llvmorg-19-init-02906-g03203b79c624) 2024-02-16T14:05:42 0:00:00
Baseline 0079 (llvmorg-18-init-07933-ge13bed4c5f35) 2023-10-06T11:29:06 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 23 3
Performance Improvements 3 2
Added Tests 0 25
Unchanged Tests 250 246
Total Tests 276

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
450.soplex 7.14% 14.000 15.000 - 0.00% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
462.libquantum (unexplained diff vs previous) (percentage) 1033.33% 0.030 0.340 - 0.00% -
462.libquantum (unexplained diff vs previous) 900.00% 5.000 50.000 - 0.00% -
429.mcf (unexplained diff vs previous) 164.71% 17.000 45.000 - 0.00% -
429.mcf (unexplained diff vs previous) (percentage) 155.56% 0.180 0.460 - 0.00% -
429.mcf (max) (percentage) 74.07% 0.270 0.470 - 0.00% -
429.mcf (max) 73.08% 26.000 45.000 - 0.00% -
462.libquantum (max) 51.52% 33.000 50.000 - 0.00% -
462.libquantum (max) (percentage) 47.83% 0.230 0.340 - 0.00% -
458.sjeng (unexplained diff vs previous) (percentage) 6.67% 0.900 0.960 - 0.00% -
429.mcf 5.88% 17.000 18.000 - 0.00% -
429.mcf (avg) 5.88% 17.000 18.000 - 0.00% -
429.mcf (avg) (percentage) 5.56% 0.180 0.190 - 0.00% -
458.sjeng (unexplained diff vs previous) 5.51% 127.000 134.000 - 0.00% -
458.sjeng 4.92% 61.000 64.000 - 0.00% -
458.sjeng (avg) 4.92% 61.000 64.000 - 0.00% -
458.sjeng (avg) (percentage) 4.55% 0.440 0.460 - 0.00% -
458.sjeng (max) (percentage) 4.40% 0.910 0.950 - 0.00% -
458.sjeng (max) 3.94% 127.000 132.000 - 0.00% -
401.bzip2 1.05% 95.000 96.000 - 0.00% -
401.bzip2 (avg) 1.05% 95.000 96.000 - 0.00% -

Performance Regressions - Score Δ Previous Current σ Δ (B) σ (B)
nb_compile_successful -31.58% 19.000 13.000 - -31.58% -
nb_total_tests -31.58% 19.000 13.000 - -31.58% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
403.gcc -1.47% 136.000 134.000 - 0.00% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
401.bzip2 (max) (percentage) -5.63% 1.420 1.340 - 0.00% -
401.bzip2 (max) -5.03% 159.000 151.000 - 0.00% -

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
401.bzip2 1.38% 79295.000 80391.000 - 0.02% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -31.58% 19.000 13.000 - -31.58% -
nb_total_tests -31.58% 19.000 13.000 - -31.58% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
429.mcf -1.20% 11954.000 11810.000 - 0.00% -
458.sjeng -1.14% 145884.000 144228.000 - 0.00% -

Added Tests - Execution
403.gcc
433.milc
450.soplex
470.lbm
483.xalancbmk

Added Tests - sample variability
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)


Report Time: 0.19s
Name Current %
401.bzip2 11297.000 -
403.gcc 134.000 -1.47%
429.mcf 9708.000 -
433.milc 5.000 -
450.soplex 15.000 7.14%
458.sjeng 13921.000 -
462.libquantum 14742.000 -
470.lbm 1.000 -
483.xalancbmk 2686.000 -
Geometric Mean 439.165 -
Name Current %
401.bzip2 80391.000 -
429.mcf 11810.000 -
458.sjeng 144228.000 -
462.libquantum 33792.000 -
Geometric Mean 46379.942 -
Name Current %
nb_compile_successful 13.000 -31.58%
nb_execution_successful 4.000 -
nb_total_tests 13.000 -31.58%
Geometric Mean 8.776 -22.35%