Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/63d8058ef50a3186b6b6a5db254f44673fea3d19 (+ 3743 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-spec2k6--llvm-arm-master-O3-build/191/
Filter

llvm-arm-master-O3 test results

Run Order Start Time Duration
Current 0191 (llvmorg-19-init-08704-g63d8058ef50a) 2024-03-30T17:49:25 0:00:00
Previous 0190 (no-change) 2024-03-12T02:35:43 0:00:00
Baseline 0079 (llvmorg-18-init-07933-ge13bed4c5f35) 2023-10-06T11:29:06 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 1 3
Performance Improvements 9 2
Added Tests 11 89
Unchanged Tests 459 386
Total Tests 480

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
456.hmmer 1.99% 7536.000 7686.000 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
483.xalancbmk -2.08% 5584.000 5468.000 - 0.00% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
458.sjeng (max) -12.40% 121.000 106.000 - 0.00% -
429.mcf (max) (percentage) -11.76% 0.340 0.300 - 0.00% -
458.sjeng (max) (percentage) -11.49% 0.870 0.770 - 0.00% -
429.mcf (max) -9.38% 32.000 29.000 - 0.00% -
462.libquantum (max) (percentage) -8.33% 0.480 0.440 - 0.00% -
462.libquantum (max) -7.14% 56.000 52.000 - 0.00% -
401.bzip2 (max) -3.31% 121.000 117.000 - 0.00% -
401.bzip2 (max) (percentage) -2.80% 1.070 1.040 - 0.00% -

Added Tests - sample variability
433.milc (unexplained diff vs previous)
433.milc (unexplained diff vs previous) (percentage)
456.hmmer
456.hmmer (avg)
456.hmmer (avg) (percentage)
456.hmmer (max)
456.hmmer (max) (percentage)
456.hmmer (unexplained diff vs previous)
456.hmmer (unexplained diff vs previous) (percentage)
470.lbm (unexplained diff vs previous)
470.lbm (unexplained diff vs previous) (percentage)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
429.mcf 5.89% 11954.000 12658.000 - 0.00% -
401.bzip2 3.02% 79295.000 81691.000 - -0.01% -
462.libquantum 1.54% 33856.000 34376.000 - 0.21% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
462.libquantum -19.48% 14706.000 11841.000 - 0.77% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_execution_successful 350.00% 4.000 18.000 - 0.00% -

Added Tests - Code Size
403.gcc
433.milc
444.namd
445.gobmk
447.dealII
450.soplex
453.povray
456.hmmer
464.h264ref
470.lbm
471.omnetpp
473.astar
482.sphinx3
483.xalancbmk

Added Tests - Execution
403.gcc
433.milc
444.namd
445.gobmk
447.dealII
450.soplex
453.povray
456.hmmer
464.h264ref
470.lbm
471.omnetpp
473.astar
482.sphinx3
483.xalancbmk

Added Tests - sample variability
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
403.gcc
403.gcc (avg)
403.gcc (avg) (percentage)
403.gcc (max)
403.gcc (max) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
433.milc
433.milc (avg)
433.milc (avg) (percentage)
433.milc (max)
433.milc (max) (percentage)
433.milc (unexplained diff vs previous)
433.milc (unexplained diff vs previous) (percentage)
450.soplex
450.soplex (avg)
450.soplex (avg) (percentage)
450.soplex (max)
450.soplex (max) (percentage)
456.hmmer
456.hmmer (avg)
456.hmmer (avg) (percentage)
456.hmmer (max)
456.hmmer (max) (percentage)
456.hmmer (unexplained diff vs previous)
456.hmmer (unexplained diff vs previous) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)
470.lbm
470.lbm (avg)
470.lbm (avg) (percentage)
470.lbm (max)
470.lbm (max) (percentage)
470.lbm (unexplained diff vs previous)
470.lbm (unexplained diff vs previous) (percentage)
482.sphinx3
482.sphinx3 (avg)
482.sphinx3 (avg) (percentage)
482.sphinx3 (max)
482.sphinx3 (max) (percentage)
483.xalancbmk
483.xalancbmk (avg)
483.xalancbmk (avg) (percentage)
483.xalancbmk (max)
483.xalancbmk (max) (percentage)


Report Time: 0.20s
Name Current %
401.bzip2 11330.000 -
403.gcc 6402.000 -
429.mcf 9702.000 -
433.milc 11750.000 -
444.namd 9931.000 -
445.gobmk 10427.000 -
447.dealII 5123.000 -
450.soplex 8342.000 -
453.povray 4396.000 -
456.hmmer 7686.000 1.99%
458.sjeng 13889.000 -
462.libquantum 11841.000 -
464.h264ref 9852.000 -
470.lbm 16038.000 -
471.omnetpp 7412.000 -
473.astar 9407.000 -
482.sphinx3 18474.000 -
483.xalancbmk 5468.000 -2.08%
Geometric Mean 9207.628 -
Name Current %
401.bzip2 81691.000 -
403.gcc 3313928.000 -
429.mcf 12658.000 -
433.milc 132566.000 -
444.namd 220146.000 -
445.gobmk 1660226.000 -
447.dealII 2823479.000 -
450.soplex 326299.000 -
453.povray 934524.000 -
456.hmmer 271065.000 -
458.sjeng 144620.000 -
462.libquantum 34376.000 -
464.h264ref 763665.000 -
470.lbm 11460.000 -
471.omnetpp 547336.000 -
473.astar 38263.000 -
482.sphinx3 171307.000 -
483.xalancbmk 3501254.000 -
Geometric Mean 255265.549 -
Name Current %
401.bzip2 100.000 -
401.bzip2 (avg) 100.000 -
401.bzip2 (avg) (percentage) 0.890 -
401.bzip2 (max) 117.000 -3.31%
401.bzip2 (max) (percentage) 1.040 -2.80%
403.gcc 39.000 -
403.gcc (avg) 39.000 -
403.gcc (avg) (percentage) 0.620 -
403.gcc (max) 12.000 -
403.gcc (max) (percentage) 0.200 -
429.mcf 20.000 -
429.mcf (avg) 20.000 -
429.mcf (avg) (percentage) 0.210 -
429.mcf (max) 29.000 -9.38%
429.mcf (max) (percentage) 0.300 -11.76%
433.milc 5.000 -
433.milc (avg) 5.000 -
433.milc (avg) (percentage) 0.050 -
433.milc (max) 38.000 -
433.milc (max) (percentage) 0.330 -
433.milc (unexplained diff vs previous) 39.000 -
433.milc (unexplained diff vs previous) (percentage) 0.330 -
450.soplex 919.000 -
450.soplex (avg) 919.000 -
450.soplex (avg) (percentage) 11.020 -
450.soplex (max) 1620.000 -
450.soplex (max) (percentage) 19.420 -
456.hmmer 152.000 -
456.hmmer (avg) 152.000 -
456.hmmer (avg) (percentage) 1.990 -
456.hmmer (max) 152.000 -
456.hmmer (max) (percentage) 1.990 -
456.hmmer (unexplained diff vs previous) 150.000 -
456.hmmer (unexplained diff vs previous) (percentage) 1.950 -
458.sjeng 68.000 -
458.sjeng (avg) 68.000 -
458.sjeng (avg) (percentage) 0.490 -
458.sjeng (max) 106.000 -12.40%
458.sjeng (max) (percentage) 0.770 -11.49%
462.libquantum 30.000 -
462.libquantum (avg) 30.000 -
462.libquantum (avg) (percentage) 0.260 -
462.libquantum (max) 52.000 -7.14%
462.libquantum (max) (percentage) 0.440 -8.33%
470.lbm 1.000 -
470.lbm (avg) 1.000 -
470.lbm (avg) (percentage) 0.010 -
470.lbm (max) 17.000 -
470.lbm (max) (percentage) 0.110 -
470.lbm (unexplained diff vs previous) 17.000 -
470.lbm (unexplained diff vs previous) (percentage) 0.110 -
482.sphinx3 2309.000 -
482.sphinx3 (avg) 2309.000 -
482.sphinx3 (avg) (percentage) 12.500 -
482.sphinx3 (max) 3885.000 -
482.sphinx3 (max) (percentage) 21.030 -
483.xalancbmk 3.000 -
483.xalancbmk (avg) 3.000 -
483.xalancbmk (avg) (percentage) 0.060 -
483.xalancbmk (max) 3.000 -
483.xalancbmk (max) (percentage) 0.060 -
Geometric Mean 7.945 538.20%