Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/f0332d12aeecf08420f2595e4b07a71849c931e3 (+ 1256 commits)
test_url https://ci.linaro.org/job/tcwg_bmk_ci_llvm-build-tcwg_bmk_apm-llvm-master-aarch64-spec2k6-Oz_LTO/276/
Filter

llvm-aarch64-master-Oz_LTO test results

Run Order Start Time Duration
Current 0276 (llvmorg-16-init-03904-gf0332d12aeec) 2022-08-29T06:27:43 0:00:00
Previous 0275 (llvmorg-20-init-16238-g8daba2c13dc3) 2024-12-20T07:15:44 0:00:00
Baseline 0001 (llvmorg-16-init-17110-gb1256f2345f6) 2022-12-17T20:51:03 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 33 8
Performance Improvements 0 8
Added Tests 2 0
Unchanged Tests 1009 1028
Total Tests 1044

Performance Regressions - Code Size Δ Previous Current σ Δ (B) σ (B)
444.namd 6.25% 135372.000 143833.000 - 0.29% -
464.h264ref 3.96% 385247.000 400510.000 - 0.13% -
462.libquantum 3.26% 16468.000 17005.000 - 0.09% -
453.povray 3.13% 671103.000 692114.000 - 0.09% -
447.dealII 3.05% 320047.000 329805.000 - 1.41% -
403.gcc 3.03% 2416924.000 2490041.000 - 0.12% -
482.sphinx3 2.39% 117637.000 120454.000 - 0.17% -
473.astar 1.96% 23664.000 24128.000 - 1.43% -
400.perlbench 1.95% 883687.000 900899.000 - 0.07% -
471.omnetpp 1.71% 487258.000 495590.000 - 1.11% -
433.milc 1.68% 62150.000 63195.000 - 0.53% -
445.gobmk 1.61% 1821926.000 1851247.000 - 0.05% -
450.soplex 1.50% 228474.000 231907.000 - 3.34% -
458.sjeng 1.38% 105411.000 106864.000 - -0.01% -

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
403.gcc 12334.62% 78.000 9699.000 - -4.44% -
462.libquantum 8931.43% 105.000 9483.000 - -1.82% -
482.sphinx3 2843.98% 839.000 24700.000 - 3.87% -
450.soplex 2373.65% 554.000 13704.000 - -2.03% -
453.povray 1300.19% 523.000 7323.000 - 0.30% -
444.namd 1199.40% 670.000 8706.000 - -7.16% -
429.mcf 1123.26% 1492.000 18251.000 - -3.46% -
433.milc 1007.28% 1250.000 13841.000 - -5.13% -
400.perlbench 453.64% 2008.000 11117.000 - 0.29% -
447.dealII 385.15% 1946.000 9441.000 - 3.72% -
471.omnetpp 271.20% 3194.000 11856.000 - -0.51% -
470.lbm 241.16% 3236.000 11040.000 - -0.05% -
464.h264ref 165.28% 4545.000 12057.000 - -0.70% -
473.astar 155.61% 5202.000 13297.000 - -0.03% -
445.gobmk 113.03% 5487.000 11689.000 - 0.18% -
458.sjeng 97.10% 7539.000 14859.000 - -2.77% -

Performance Regressions - Score Δ Previous Current σ Δ (B) σ (B)
nb_total_tests -38.71% 31.000 19.000 - 0.00% -
nb_compile_successful -37.04% 27.000 17.000 - -10.53% -
nb_execution_successful -37.04% 27.000 17.000 - -10.53% -

Added Tests - Code Size
483.xalancbmk

Added Tests - Execution
483.xalancbmk

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
450.soplex 3.34% 224407.000 231907.000 - 1.50% -
473.astar 1.43% 23789.000 24128.000 - 1.96% -
447.dealII 1.41% 325219.000 329805.000 - 3.05% -
471.omnetpp 1.11% 490147.000 495590.000 - 1.71% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
482.sphinx3 3.87% 23779.000 24700.000 - 2843.98% -
447.dealII 3.72% 9102.000 9441.000 - 385.15% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -10.53% 19.000 17.000 - -37.04% -
nb_execution_successful -10.53% 19.000 17.000 - -37.04% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
444.namd -7.16% 9377.000 8706.000 - 1199.40% -
433.milc -5.13% 14590.000 13841.000 - 1007.28% -
403.gcc -4.44% 10150.000 9699.000 - 12334.62% -
429.mcf -3.46% 18905.000 18251.000 - 1123.26% -
458.sjeng -2.77% 15282.000 14859.000 - 97.10% -
450.soplex -2.03% 13988.000 13704.000 - 2373.65% -
462.libquantum -1.82% 9659.000 9483.000 - 8931.43% -
483.xalancbmk -1.58% 9633.000 9481.000 - 0.00% -


Report Time: 0.35s
Name Current %
400.perlbench 11117.000 453.64%
403.gcc 9699.000 12334.62%
429.mcf 18251.000 1123.26%
433.milc 13841.000 1007.28%
444.namd 8706.000 1199.40%
445.gobmk 11689.000 113.03%
447.dealII 9441.000 385.15%
450.soplex 13704.000 2373.65%
453.povray 7323.000 1300.19%
458.sjeng 14859.000 97.10%
462.libquantum 9483.000 8931.43%
464.h264ref 12057.000 165.28%
470.lbm 11040.000 241.16%
471.omnetpp 11856.000 271.20%
473.astar 13297.000 155.61%
482.sphinx3 24700.000 2843.98%
483.xalancbmk 9481.000 -
Geometric Mean 11860.427 790.38%
Name Current %
400.perlbench 900899.000 1.95%
403.gcc 2490041.000 3.03%
429.mcf 9249.000 -
433.milc 63195.000 1.68%
444.namd 143833.000 6.25%
445.gobmk 1851247.000 1.61%
447.dealII 329805.000 3.05%
450.soplex 231907.000 1.50%
453.povray 692114.000 3.13%
458.sjeng 106864.000 1.38%
462.libquantum 17005.000 3.26%
464.h264ref 400510.000 3.96%
470.lbm 10273.000 -
471.omnetpp 495590.000 1.71%
473.astar 24128.000 1.96%
482.sphinx3 120454.000 2.39%
483.xalancbmk 2530403.000 -
Geometric Mean 189057.724 20.42%
Name Current %
nb_compile_successful 17.000 -37.04%
nb_execution_successful 17.000 -37.04%
nb_total_tests 19.000 -38.71%
Geometric Mean 17.642 -37.60%