Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/251377c47d296000158347d6a1cba2e6b30132a3 (+ 840 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_vect-spec2k6--llvm-arm-master-O3_LTO-build/235/
Filter

llvm-arm-master-O3_LTO test results

Run Order Start Time Duration
Current 0235 (llvmorg-21-init-02103-g251377c47d29) 2025-02-09T00:57:01 0:00:00
Previous 0235 (llvmorg-21-init-02103-g251377c47d29) 2025-02-09T00:57:01 0:00:00
Baseline 0006 (llvmorg-17-init-05349-gd0398d3593ba) 2023-03-18T19:32:43 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 0 7
Performance Improvements 0 21
Added Tests 3 84
Unchanged Tests 753 644
Total Tests 756

Added Tests - sample variability
482.sphinx3
482.sphinx3 (avg)
482.sphinx3 (max)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
470.lbm 3.26% 10930.000 11286.000 - 0.00% -
433.milc 2.34% 107474.000 109986.000 - 0.00% -
473.astar 2.13% 30771.000 31427.000 - 0.00% -
401.bzip2 2.00% 64543.000 65835.000 - 0.00% -
456.hmmer 1.32% 167055.000 169259.000 - 0.00% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_execution_successful -16.67% 18.000 15.000 - 0.00% -
nb_compile_successful -10.53% 19.000 17.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
444.namd -4.00% 181004.000 173760.000 - 0.00% -
462.libquantum -3.80% 36309.000 34928.000 - 0.00% -
471.omnetpp -2.50% 690755.000 673468.000 - 0.00% -
447.dealII -2.09% 477780.000 467792.000 - 0.00% -
429.mcf -1.25% 12471.000 12315.000 - 0.00% -
464.h264ref -1.01% 816918.000 808648.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
482.sphinx3 -99.67% 911.000 3.000 - 0.00% -
450.soplex -11.01% 563.000 501.000 - 0.00% -
433.milc -10.03% 1117.000 1005.000 - 0.00% -
403.gcc -9.84% 61.000 55.000 - 0.00% -
429.mcf -8.69% 1277.000 1166.000 - 0.00% -
401.bzip2 -6.88% 2847.000 2651.000 - 0.00% -
470.lbm -6.86% 2990.000 2785.000 - 0.00% -
473.astar -3.30% 4881.000 4720.000 - 0.00% -
456.hmmer -3.07% 3487.000 3380.000 - 0.00% -
471.omnetpp -2.63% 2242.000 2183.000 - 0.00% -
458.sjeng -2.04% 7518.000 7365.000 - 0.00% -
447.dealII -1.59% 1067.000 1050.000 - 0.00% -
462.libquantum -1.05% 95.000 94.000 - 0.00% -
464.h264ref -1.05% 5142.000 5088.000 - 0.00% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 10.53% 19.000 21.000 - 0.00% -

Added Tests - sample variability
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
403.gcc
403.gcc (avg)
403.gcc (avg) (percentage)
403.gcc (max)
403.gcc (max) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
433.milc
433.milc (avg)
433.milc (avg) (percentage)
433.milc (max)
433.milc (max) (percentage)
444.namd
444.namd (avg)
444.namd (avg) (percentage)
444.namd (max)
444.namd (max) (percentage)
445.gobmk (avg) (percentage)
445.gobmk (max) (percentage)
447.dealII
447.dealII (avg)
447.dealII (avg) (percentage)
447.dealII (max)
447.dealII (max) (percentage)
450.soplex
450.soplex (avg)
450.soplex (avg) (percentage)
450.soplex (max)
450.soplex (max) (percentage)
453.povray
453.povray (avg)
453.povray (avg) (percentage)
453.povray (max)
453.povray (max) (percentage)
456.hmmer
456.hmmer (avg)
456.hmmer (avg) (percentage)
456.hmmer (max)
456.hmmer (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)
464.h264ref
464.h264ref (avg)
464.h264ref (avg) (percentage)
464.h264ref (max)
464.h264ref (max) (percentage)
470.lbm
470.lbm (avg)
470.lbm (avg) (percentage)
470.lbm (max)
470.lbm (max) (percentage)
471.omnetpp
471.omnetpp (avg)
471.omnetpp (avg) (percentage)
471.omnetpp (max)
471.omnetpp (max) (percentage)
473.astar
473.astar (avg)
473.astar (avg) (percentage)
473.astar (max)
473.astar (max) (percentage)
482.sphinx3
482.sphinx3 (avg)
482.sphinx3 (avg) (percentage)
482.sphinx3 (max)
482.sphinx3 (max) (percentage)
483.xalancbmk (avg) (percentage)
483.xalancbmk (max) (percentage)


Report Time: 0.21s
Name Current %
401.bzip2 2651.000 -
403.gcc 55.000 -
429.mcf 1166.000 -
433.milc 1005.000 -
444.namd 691.000 -
447.dealII 1050.000 -
450.soplex 501.000 -
453.povray 421.000 -
456.hmmer 3380.000 -
458.sjeng 7365.000 -
462.libquantum 94.000 -
464.h264ref 5088.000 -
470.lbm 2785.000 -
471.omnetpp 2183.000 -
473.astar 4720.000 -
482.sphinx3 3.000 -
Geometric Mean 797.552 -
Name Current %
401.bzip2 65835.000 -
403.gcc 3818505.000 -
429.mcf 12315.000 -
433.milc 109986.000 -
444.namd 173760.000 -
447.dealII 467792.000 -
450.soplex 286989.000 -
453.povray 1144529.000 -
456.hmmer 169259.000 -
458.sjeng 139523.000 -
462.libquantum 34928.000 -
464.h264ref 808648.000 -
470.lbm 11286.000 -
471.omnetpp 673468.000 -
473.astar 31427.000 -
Geometric Mean 162452.785 -
Name Current %
401.bzip2 11.000 -
401.bzip2 (avg) 11.000 -
401.bzip2 (avg) (percentage) 0.420 -
401.bzip2 (max) 28.000 -
401.bzip2 (max) (percentage) 1.080 -
401.bzip2 (unexplained diff vs previous) 29.000 -
401.bzip2 (unexplained diff vs previous) (percentage) 1.090 -
403.gcc 2.000 -
403.gcc (avg) 2.000 -
403.gcc (avg) (percentage) 5.310 -
403.gcc (max) 5.000 -
403.gcc (max) (percentage) 10.640 -
429.mcf 12.000 -
429.mcf (avg) 12.000 -
429.mcf (avg) (percentage) 1.060 -
429.mcf (max) 58.000 -
429.mcf (max) (percentage) 5.010 -
429.mcf (unexplained diff vs previous) 32.000 -
429.mcf (unexplained diff vs previous) (percentage) 2.740 -
433.milc 8.000 -
433.milc (avg) 8.000 -
433.milc (avg) (percentage) 0.840 -
433.milc (max) 46.000 -
433.milc (max) (percentage) 4.650 -
433.milc (unexplained diff vs previous) 49.000 -
433.milc (unexplained diff vs previous) (percentage) 4.880 -
444.namd 3.000 -
444.namd (avg) 3.000 -
444.namd (avg) (percentage) 0.530 -
444.namd (max) 4.000 -
444.namd (max) (percentage) 0.580 -
444.namd (unexplained diff vs previous) 4.000 -
444.namd (unexplained diff vs previous) (percentage) 0.580 -
445.gobmk (avg) (percentage) 0.290 -
445.gobmk (max) (percentage) 0.350 -
447.dealII 12.000 -
447.dealII (avg) 12.000 -
447.dealII (avg) (percentage) 1.210 -
447.dealII (max) 9.000 -
447.dealII (max) (percentage) 0.880 -
450.soplex 6.000 -
450.soplex (avg) 6.000 -
450.soplex (avg) (percentage) 1.310 -
450.soplex (max) 19.000 -
450.soplex (max) (percentage) 3.980 -
453.povray 3.000 -
453.povray (avg) 3.000 -
453.povray (avg) (percentage) 0.930 -
453.povray (max) 7.000 -
453.povray (max) (percentage) 1.880 -
456.hmmer 8.000 -
456.hmmer (avg) 8.000 -
456.hmmer (avg) (percentage) 0.260 -
456.hmmer (max) 19.000 -
456.hmmer (max) (percentage) 0.570 -
456.hmmer (unexplained diff vs previous) 19.000 -
456.hmmer (unexplained diff vs previous) (percentage) 0.560 -
458.sjeng 14.000 -
458.sjeng (avg) 14.000 -
458.sjeng (avg) (percentage) 0.200 -
458.sjeng (max) 13.000 -
458.sjeng (max) (percentage) 0.180 -
458.sjeng (unexplained diff vs previous) 3.000 -
458.sjeng (unexplained diff vs previous) (percentage) 0.040 -
462.libquantum 1.000 -
462.libquantum (avg) 1.000 -
462.libquantum (avg) (percentage) 1.360 -
462.libquantum (max) 3.000 -
462.libquantum (max) (percentage) 3.300 -
462.libquantum (unexplained diff vs previous) 3.000 -
462.libquantum (unexplained diff vs previous) (percentage) 3.190 -
464.h264ref 12.000 -
464.h264ref (avg) 12.000 -
464.h264ref (avg) (percentage) 0.240 -
464.h264ref (max) 20.000 -
464.h264ref (max) (percentage) 0.410 -
464.h264ref (unexplained diff vs previous) 15.000 -
464.h264ref (unexplained diff vs previous) (percentage) 0.290 -
470.lbm 15.000 -
470.lbm (avg) 15.000 -
470.lbm (avg) (percentage) 0.540 -
470.lbm (max) 91.000 -
470.lbm (max) (percentage) 3.270 -
470.lbm (unexplained diff vs previous) 94.000 -
470.lbm (unexplained diff vs previous) (percentage) 3.380 -
471.omnetpp 29.000 -
471.omnetpp (avg) 29.000 -
471.omnetpp (avg) (percentage) 1.330 -
471.omnetpp (max) 37.000 -
471.omnetpp (max) (percentage) 1.710 -
471.omnetpp (unexplained diff vs previous) 38.000 -
471.omnetpp (unexplained diff vs previous) (percentage) 1.740 -
473.astar 19.000 -
473.astar (avg) 19.000 -
473.astar (avg) (percentage) 0.410 -
473.astar (max) 45.000 -
473.astar (max) (percentage) 0.970 -
473.astar (unexplained diff vs previous) 36.000 -
473.astar (unexplained diff vs previous) (percentage) 0.760 -
482.sphinx3 0.000 -
482.sphinx3 (avg) 0.000 -
482.sphinx3 (avg) (percentage) 0.500 -
482.sphinx3 (max) 0.000 -
482.sphinx3 (max) (percentage) 0.720 -
483.xalancbmk (avg) (percentage) 0.610 -
483.xalancbmk (max) (percentage) 0.860 -
Geometric Mean 2.699 -25.71%