Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/9e6a342fdac8978ef6d3e373cbbc7425e3dfe0f8 (+ 361 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_vect-spec2k6--llvm-arm-master-O3_LTO-build/44/
Filter

llvm-arm-master-O3_LTO test results

Run Order Start Time Duration
Current 0044 (llvmorg-17-init-18113-g9e6a342fdac8) 2023-07-04T21:58:20 0:00:00
Previous 0043 (llvmorg-17-init-17752-g0e543747ab42) 2023-06-23T20:37:39 0:00:00
Baseline 0006 (llvmorg-17-init-05349-gd0398d3593ba) 2023-03-18T19:32:43 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 4 3
Performance Improvements 7 14
Added Tests 0 90
Unchanged Tests 769 673
Total Tests 780

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
453.povray 3.82% 419.000 435.000 - 4.07% -
447.dealII 1.06% 1039.000 1050.000 - -1.59% -
483.xalancbmk 1.05% 2944.000 2975.000 - 1.40% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
471.omnetpp (max) 2.50% 40.000 41.000 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
458.sjeng -2.71% 7519.000 7315.000 - -2.70% -
403.gcc -1.72% 58.000 57.000 - -6.56% -
429.mcf -1.43% 1189.000 1172.000 - -8.22% -
450.soplex -1.14% 527.000 521.000 - -7.46% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
458.sjeng -5.88% 17.000 16.000 - 0.00% -
458.sjeng (avg) -5.88% 17.000 16.000 - 0.00% -
458.sjeng (max) -4.76% 21.000 20.000 - 0.00% -

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
433.milc 3.30% 107474.000 111026.000 - -0.04% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
453.povray 4.07% 418.000 435.000 - 3.82% -
483.xalancbmk 1.40% 2934.000 2975.000 - 1.05% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
458.sjeng -1.29% 138799.000 137011.000 - -0.55% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
429.mcf -8.22% 1277.000 1172.000 - -1.43% -
433.milc -7.97% 1117.000 1028.000 - 0.10% -
450.soplex -7.46% 563.000 521.000 - -1.14% -
403.gcc -6.56% 61.000 57.000 - -1.72% -
470.lbm -6.05% 2990.000 2809.000 - -0.60% -
401.bzip2 -3.86% 2847.000 2737.000 - 0.44% -
482.sphinx3 -3.51% 911.000 879.000 - 0.80% -
456.hmmer -3.38% 3487.000 3369.000 - 0.09% -
458.sjeng -2.70% 7518.000 7315.000 - -2.71% -
445.gobmk -2.69% 4912.000 4780.000 - -0.89% -
473.astar -1.74% 4881.000 4796.000 - -0.44% -
447.dealII -1.59% 1067.000 1050.000 - 1.06% -
462.libquantum -1.05% 95.000 94.000 - 0.00% -

Added Tests - sample variability
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
403.gcc
403.gcc (avg)
403.gcc (avg) (percentage)
403.gcc (max)
403.gcc (max) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
433.milc
433.milc (avg)
433.milc (avg) (percentage)
433.milc (max)
433.milc (max) (percentage)
444.namd
444.namd (avg)
444.namd (avg) (percentage)
444.namd (max)
444.namd (max) (percentage)
445.gobmk
445.gobmk (avg)
445.gobmk (avg) (percentage)
445.gobmk (max)
445.gobmk (max) (percentage)
447.dealII
447.dealII (avg)
447.dealII (avg) (percentage)
447.dealII (max)
447.dealII (max) (percentage)
450.soplex
450.soplex (avg)
450.soplex (avg) (percentage)
450.soplex (max)
450.soplex (max) (percentage)
453.povray
453.povray (avg)
453.povray (avg) (percentage)
453.povray (max)
453.povray (max) (percentage)
456.hmmer
456.hmmer (avg)
456.hmmer (avg) (percentage)
456.hmmer (max)
456.hmmer (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)
464.h264ref
464.h264ref (avg)
464.h264ref (avg) (percentage)
464.h264ref (max)
464.h264ref (max) (percentage)
470.lbm
470.lbm (avg)
470.lbm (avg) (percentage)
470.lbm (max)
470.lbm (max) (percentage)
471.omnetpp
471.omnetpp (avg)
471.omnetpp (avg) (percentage)
471.omnetpp (max)
471.omnetpp (max) (percentage)
473.astar
473.astar (avg)
473.astar (avg) (percentage)
473.astar (max)
473.astar (max) (percentage)
482.sphinx3
482.sphinx3 (avg)
482.sphinx3 (avg) (percentage)
482.sphinx3 (max)
482.sphinx3 (max) (percentage)
483.xalancbmk
483.xalancbmk (avg)
483.xalancbmk (avg) (percentage)
483.xalancbmk (max)
483.xalancbmk (max) (percentage)


Report Time: 0.23s
Name Current %
401.bzip2 2737.000 -
403.gcc 57.000 -1.72%
429.mcf 1172.000 -1.43%
433.milc 1028.000 -
444.namd 694.000 -
445.gobmk 4780.000 -
447.dealII 1050.000 1.06%
450.soplex 521.000 -1.14%
453.povray 435.000 3.82%
456.hmmer 3369.000 -
458.sjeng 7315.000 -2.71%
462.libquantum 94.000 -
464.h264ref 5094.000 -
470.lbm 2809.000 -
471.omnetpp 2254.000 -
473.astar 4796.000 -
482.sphinx3 879.000 -
483.xalancbmk 2975.000 1.05%
Geometric Mean 1315.416 -
Name Current %
401.bzip2 64543.000 -
403.gcc 3837205.000 -
429.mcf 12483.000 -
433.milc 111026.000 -
444.namd 180312.000 -
445.gobmk 1827354.000 -
447.dealII 476480.000 -
450.soplex 286849.000 -
453.povray 1144896.000 -
456.hmmer 166087.000 -
458.sjeng 137011.000 -
462.libquantum 36461.000 -
464.h264ref 813326.000 -
470.lbm 10958.000 -
471.omnetpp 690139.000 -
473.astar 30691.000 -
482.sphinx3 177816.000 -
483.xalancbmk 3261218.000 -
Geometric Mean 221200.025 -
Name Current %
401.bzip2 12.000 -
401.bzip2 (avg) 12.000 -
401.bzip2 (avg) (percentage) 0.450 -
401.bzip2 (max) 12.000 -
401.bzip2 (max) (percentage) 0.470 -
403.gcc 2.000 -
403.gcc (avg) 2.000 -
403.gcc (avg) (percentage) 4.080 -
403.gcc (max) 3.000 -
403.gcc (max) (percentage) 6.400 -
429.mcf 10.000 -
429.mcf (avg) 10.000 -
429.mcf (avg) (percentage) 0.880 -
429.mcf (max) 11.000 -
429.mcf (max) (percentage) 0.950 -
433.milc 9.000 -
433.milc (avg) 9.000 -
433.milc (avg) (percentage) 0.940 -
433.milc (max) 10.000 -
433.milc (max) (percentage) 0.990 -
444.namd 5.000 -
444.namd (avg) 5.000 -
444.namd (avg) (percentage) 0.740 -
444.namd (max) 9.000 -
444.namd (max) (percentage) 1.350 -
445.gobmk 11.000 -
445.gobmk (avg) 11.000 -
445.gobmk (avg) (percentage) 0.240 -
445.gobmk (max) 14.000 -
445.gobmk (max) (percentage) 0.310 -
447.dealII 9.000 -
447.dealII (avg) 9.000 -
447.dealII (avg) (percentage) 0.920 -
447.dealII (max) 19.000 -
447.dealII (max) (percentage) 1.830 -
450.soplex 7.000 -
450.soplex (avg) 7.000 -
450.soplex (avg) (percentage) 1.430 -
450.soplex (max) 9.000 -
450.soplex (max) (percentage) 1.810 -
453.povray 4.000 -
453.povray (avg) 4.000 -
453.povray (avg) (percentage) 1.040 -
453.povray (max) 6.000 -
453.povray (max) (percentage) 1.460 -
456.hmmer 4.000 -
456.hmmer (avg) 4.000 -
456.hmmer (avg) (percentage) 0.140 -
456.hmmer (max) 4.000 -
456.hmmer (max) (percentage) 0.140 -
458.sjeng 16.000 -5.88%
458.sjeng (avg) 16.000 -5.88%
458.sjeng (avg) (percentage) 0.230 -
458.sjeng (max) 20.000 -4.76%
458.sjeng (max) (percentage) 0.280 -
462.libquantum 1.000 -
462.libquantum (avg) 1.000 -
462.libquantum (avg) (percentage) 1.180 -
462.libquantum (max) 1.000 -
462.libquantum (max) (percentage) 2.020 -
464.h264ref 14.000 -
464.h264ref (avg) 14.000 -
464.h264ref (avg) (percentage) 0.280 -
464.h264ref (max) 13.000 -
464.h264ref (max) (percentage) 0.260 -
470.lbm 13.000 -
470.lbm (avg) 13.000 -
470.lbm (avg) (percentage) 0.470 -
470.lbm (max) 16.000 -
470.lbm (max) (percentage) 0.570 -
471.omnetpp 29.000 -
471.omnetpp (avg) 29.000 -
471.omnetpp (avg) (percentage) 1.310 -
471.omnetpp (max) 41.000 2.50%
471.omnetpp (max) (percentage) 1.830 -
473.astar 16.000 -
473.astar (avg) 16.000 -
473.astar (avg) (percentage) 0.340 -
473.astar (max) 20.000 -
473.astar (max) (percentage) 0.430 -
482.sphinx3 6.000 -
482.sphinx3 (avg) 6.000 -
482.sphinx3 (avg) (percentage) 0.740 -
482.sphinx3 (max) 10.000 -
482.sphinx3 (max) (percentage) 1.150 -
483.xalancbmk 22.000 -
483.xalancbmk (avg) 22.000 -
483.xalancbmk (avg) (percentage) 0.750 -
483.xalancbmk (max) 27.000 -
483.xalancbmk (max) (percentage) 0.930 -
Geometric Mean 3.273 -