Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/b7e157cab173e56c68872cc84522c24b8d6ee635 (+ 1288 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_vect-spec2k6--llvm-aarch64-master-O3_LTO-build/162/
View Options
Report
Filter

llvm-aarch64-master-O3_LTO test results

Run Order Start Time Duration
Current 0162 (llvmorg-19-init-16246-gb7e157cab173) 2024-06-25T04:55:41 0:00:00
Previous 0162 (llvmorg-19-init-16246-gb7e157cab173) 2024-06-25T04:55:41 0:00:00
Baseline 0001 (llvmorg-17-init-04177-g4eb1f1fab35d) 2023-03-08T09:39:21 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 0 10
Performance Improvements 0 19
Added Tests 0 159
Unchanged Tests 1104 916
Total Tests 1104

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
401.bzip2 2.12% 66682.000 68094.000 - 0.00% -
433.milc 1.57% 128200.000 130212.000 - 0.00% -
447.dealII 1.34% 548786.000 556114.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
401.bzip2 8.09% 2510.000 2713.000 - 0.00% -
456.hmmer 5.84% 2637.000 2791.000 - 0.00% -
482.sphinx3 5.57% 664.000 701.000 - 0.00% -
473.astar 5.26% 4638.000 4882.000 - 0.00% -
471.omnetpp 3.86% 2153.000 2236.000 - 0.00% -
400.perlbench 2.17% 1474.000 1506.000 - 0.00% -
470.lbm 1.89% 3235.000 3296.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
462.libquantum -14.82% 45013.000 38343.000 - 0.00% -
458.sjeng -2.27% 131729.000 128741.000 - 0.00% -
444.namd -2.22% 168697.000 164952.000 - 0.00% -
470.lbm -1.65% 10901.000 10721.000 - 0.00% -
471.omnetpp -1.63% 754667.000 742388.000 - 0.00% -
473.astar -1.55% 33048.000 32536.000 - 0.00% -
450.soplex -1.34% 319083.000 314807.000 - 0.00% -
400.perlbench -1.01% 1269683.000 1256832.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
462.libquantum -25.93% 108.000 80.000 - 0.00% -
429.mcf -25.28% 1879.000 1404.000 - 0.00% -
453.povray -4.51% 421.000 402.000 - 0.00% -
464.h264ref -4.04% 3965.000 3805.000 - 0.00% -
403.gcc -3.39% 59.000 57.000 - 0.00% -
450.soplex -2.22% 540.000 528.000 - 0.00% -
447.dealII -2.00% 1001.000 981.000 - 0.00% -
458.sjeng -1.24% 6353.000 6274.000 - 0.00% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful 184.21% 19.000 54.000 - 0.00% -
nb_execution_successful 184.21% 19.000 54.000 - 0.00% -
nb_total_tests 113.79% 29.000 62.000 - 0.00% -

Added Tests - Code Size
410.bwaves
416.gamess
434.zeusmp
435.gromacs
436.cactusADM
437.leslie3d
459.GemsFDTD
465.tonto
481.wrf

Added Tests - Execution
410.bwaves
416.gamess
434.zeusmp
435.gromacs
436.cactusADM
437.leslie3d
459.GemsFDTD
465.tonto
481.wrf

Added Tests - sample variability
400.perlbench
400.perlbench (avg)
400.perlbench (avg) (percentage)
400.perlbench (max)
400.perlbench (max) (percentage)
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
403.gcc
403.gcc (avg)
403.gcc (avg) (percentage)
403.gcc (max)
403.gcc (max) (percentage)
410.bwaves
410.bwaves (avg)
410.bwaves (avg) (percentage)
410.bwaves (max)
410.bwaves (max) (percentage)
410.bwaves (unexplained diff vs previous)
410.bwaves (unexplained diff vs previous) (percentage)
416.gamess
416.gamess (avg)
416.gamess (avg) (percentage)
416.gamess (max)
416.gamess (max) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
433.milc
433.milc (avg)
433.milc (avg) (percentage)
433.milc (max)
433.milc (max) (percentage)
434.zeusmp
434.zeusmp (avg)
434.zeusmp (avg) (percentage)
434.zeusmp (max)
434.zeusmp (max) (percentage)
435.gromacs
435.gromacs (avg)
435.gromacs (avg) (percentage)
435.gromacs (max)
435.gromacs (max) (percentage)
436.cactusADM
436.cactusADM (avg)
436.cactusADM (avg) (percentage)
436.cactusADM (max)
436.cactusADM (max) (percentage)
436.cactusADM (unexplained diff vs previous)
436.cactusADM (unexplained diff vs previous) (percentage)
437.leslie3d
437.leslie3d (avg)
437.leslie3d (avg) (percentage)
437.leslie3d (max)
437.leslie3d (max) (percentage)
444.namd
444.namd (avg)
444.namd (avg) (percentage)
444.namd (max)
444.namd (max) (percentage)
445.gobmk
445.gobmk (avg)
445.gobmk (avg) (percentage)
445.gobmk (max)
445.gobmk (max) (percentage)
447.dealII
447.dealII (avg)
447.dealII (avg) (percentage)
447.dealII (max)
447.dealII (max) (percentage)
450.soplex
450.soplex (avg)
450.soplex (avg) (percentage)
450.soplex (max)
450.soplex (max) (percentage)
453.povray
453.povray (avg)
453.povray (avg) (percentage)
453.povray (max)
453.povray (max) (percentage)
456.hmmer
456.hmmer (avg)
456.hmmer (avg) (percentage)
456.hmmer (max)
456.hmmer (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
459.GemsFDTD
459.GemsFDTD (avg)
459.GemsFDTD (avg) (percentage)
459.GemsFDTD (max)
459.GemsFDTD (max) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)
464.h264ref
464.h264ref (avg)
464.h264ref (avg) (percentage)
464.h264ref (max)
464.h264ref (max) (percentage)
465.tonto
465.tonto (avg)
465.tonto (avg) (percentage)
465.tonto (max)
465.tonto (max) (percentage)
470.lbm
470.lbm (avg)
470.lbm (avg) (percentage)
470.lbm (max)
470.lbm (max) (percentage)
471.omnetpp
471.omnetpp (avg)
471.omnetpp (avg) (percentage)
471.omnetpp (max)
471.omnetpp (max) (percentage)
473.astar
473.astar (avg)
473.astar (avg) (percentage)
473.astar (max)
473.astar (max) (percentage)
481.wrf
481.wrf (avg)
481.wrf (avg) (percentage)
481.wrf (max)
481.wrf (max) (percentage)
482.sphinx3
482.sphinx3 (avg)
482.sphinx3 (avg) (percentage)
482.sphinx3 (max)
482.sphinx3 (max) (percentage)
483.xalancbmk (avg) (percentage)
483.xalancbmk (max) (percentage)

Report Time: 0.36s
Execution (seconds)
Name Current %
400.perlbench 1506.000 -
401.bzip2 2713.000 -
403.gcc 57.000 -
410.bwaves 4523.000 -
416.gamess 11844.000 -
429.mcf 1404.000 -
433.milc 1048.000 -
434.zeusmp 1942.000 -
435.gromacs 4279.000 -
436.cactusADM 1301.000 -
437.leslie3d 6483.000 -
444.namd 672.000 -
445.gobmk 4603.000 -
447.dealII 981.000 -
450.soplex 528.000 -
453.povray 402.000 -
456.hmmer 2791.000 -
458.sjeng 6274.000 -
459.GemsFDTD 5212.000 -
462.libquantum 80.000 -
464.h264ref 3805.000 -
465.tonto 20257.000 -
470.lbm 3296.000 -
471.omnetpp 2236.000 -
473.astar 4882.000 -
481.wrf 3219.000 -
482.sphinx3 701.000 -
Geometric Mean 1908.423 -
Code Size (bytes)
Name Current %
400.perlbench 1256832.000 -
401.bzip2 68094.000 -
403.gcc 3787447.000 -
410.bwaves 657036.000 -
416.gamess 8283505.000 -
429.mcf 11448.000 -
433.milc 130212.000 -
434.zeusmp 1036783.000 -
435.gromacs 701840.000 -
436.cactusADM 1166478.000 -
437.leslie3d 953109.000 -
444.namd 164952.000 -
445.gobmk 2237332.000 -
447.dealII 556114.000 -
450.soplex 314807.000 -
453.povray 1125553.000 -
456.hmmer 163791.000 -
458.sjeng 128741.000 -
459.GemsFDTD 1247606.000 -
462.libquantum 38343.000 -
464.h264ref 768089.000 -
465.tonto 9873660.000 -
470.lbm 10721.000 -
471.omnetpp 742388.000 -
473.astar 32536.000 -
481.wrf 5870767.000 -
482.sphinx3 175830.000 -
Geometric Mean 444790.640 -
sample variability
Name Current %
400.perlbench 19.000 -
400.perlbench (avg) 19.000 -
400.perlbench (avg) (percentage) 1.310 -
400.perlbench (max) 18.000 -
400.perlbench (max) (percentage) 1.240 -
401.bzip2 48.000 -
401.bzip2 (avg) 48.000 -
401.bzip2 (avg) (percentage) 1.790 -
401.bzip2 (max) 31.000 -
401.bzip2 (max) (percentage) 1.150 -
403.gcc 2.000 -
403.gcc (avg) 2.000 -
403.gcc (avg) (percentage) 4.670 -
403.gcc (max) 5.000 -
403.gcc (max) (percentage) 8.940 -
403.gcc (unexplained diff vs previous) 2.000 -
403.gcc (unexplained diff vs previous) (percentage) 3.510 -
410.bwaves 33.000 -
410.bwaves (avg) 33.000 -
410.bwaves (avg) (percentage) 0.740 -
410.bwaves (max) 49.000 -
410.bwaves (max) (percentage) 1.100 -
410.bwaves (unexplained diff vs previous) 38.000 -
410.bwaves (unexplained diff vs previous) (percentage) 0.840 -
416.gamess 21.000 -
416.gamess (avg) 21.000 -
416.gamess (avg) (percentage) 0.180 -
416.gamess (max) 52.000 -
416.gamess (max) (percentage) 0.440 -
429.mcf 56.000 -
429.mcf (avg) 56.000 -
429.mcf (avg) (percentage) 4.020 -
429.mcf (max) 214.000 -
429.mcf (max) (percentage) 15.290 -
429.mcf (unexplained diff vs previous) 28.000 -
429.mcf (unexplained diff vs previous) (percentage) 1.990 -
433.milc 11.000 -
433.milc (avg) 11.000 -
433.milc (avg) (percentage) 1.050 -
433.milc (max) 18.000 -
433.milc (max) (percentage) 1.740 -
433.milc (unexplained diff vs previous) 7.000 -
433.milc (unexplained diff vs previous) (percentage) 0.670 -
434.zeusmp 14.000 -
434.zeusmp (avg) 14.000 -
434.zeusmp (avg) (percentage) 0.760 -
434.zeusmp (max) 35.000 -
434.zeusmp (max) (percentage) 1.830 -
435.gromacs 100.000 -
435.gromacs (avg) 100.000 -
435.gromacs (avg) (percentage) 2.360 -
435.gromacs (max) 154.000 -
435.gromacs (max) (percentage) 3.600 -
436.cactusADM 12.000 -
436.cactusADM (avg) 12.000 -
436.cactusADM (avg) (percentage) 0.940 -
436.cactusADM (max) 17.000 -
436.cactusADM (max) (percentage) 1.360 -
436.cactusADM (unexplained diff vs previous) 9.000 -
436.cactusADM (unexplained diff vs previous) (percentage) 0.690 -
437.leslie3d 254.000 -
437.leslie3d (avg) 254.000 -
437.leslie3d (avg) (percentage) 3.930 -
437.leslie3d (max) 372.000 -
437.leslie3d (max) (percentage) 5.750 -
444.namd 6.000 -
444.namd (avg) 6.000 -
444.namd (avg) (percentage) 0.960 -
444.namd (max) 8.000 -
444.namd (max) (percentage) 1.220 -
445.gobmk 43.000 -
445.gobmk (avg) 43.000 -
445.gobmk (avg) (percentage) 0.940 -
445.gobmk (max) 81.000 -
445.gobmk (max) (percentage) 1.770 -
447.dealII 14.000 -
447.dealII (avg) 14.000 -
447.dealII (avg) (percentage) 1.470 -
447.dealII (max) 29.000 -
447.dealII (max) (percentage) 2.970 -
450.soplex 13.000 -
450.soplex (avg) 13.000 -
450.soplex (avg) (percentage) 2.580 -
450.soplex (max) 23.000 -
450.soplex (max) (percentage) 4.460 -
453.povray 4.000 -
453.povray (avg) 4.000 -
453.povray (avg) (percentage) 1.140 -
453.povray (max) 2.000 -
453.povray (max) (percentage) 0.550 -
456.hmmer 6.000 -
456.hmmer (avg) 6.000 -
456.hmmer (avg) (percentage) 0.230 -
456.hmmer (max) 13.000 -
456.hmmer (max) (percentage) 0.480 -
458.sjeng 31.000 -
458.sjeng (avg) 31.000 -
458.sjeng (avg) (percentage) 0.510 -
458.sjeng (max) 47.000 -
458.sjeng (max) (percentage) 0.760 -
458.sjeng (unexplained diff vs previous) 8.000 -
458.sjeng (unexplained diff vs previous) (percentage) 0.130 -
459.GemsFDTD 57.000 -
459.GemsFDTD (avg) 57.000 -
459.GemsFDTD (avg) (percentage) 1.110 -
459.GemsFDTD (max) 109.000 -
459.GemsFDTD (max) (percentage) 2.110 -
462.libquantum 1.000 -
462.libquantum (avg) 1.000 -
462.libquantum (avg) (percentage) 2.000 -
462.libquantum (max) 4.000 -
462.libquantum (max) (percentage) 5.450 -
464.h264ref 34.000 -
464.h264ref (avg) 34.000 -
464.h264ref (avg) (percentage) 0.900 -
464.h264ref (max) 54.000 -
464.h264ref (max) (percentage) 1.420 -
465.tonto 196.000 -
465.tonto (avg) 196.000 -
465.tonto (avg) (percentage) 0.970 -
465.tonto (max) 184.000 -
465.tonto (max) (percentage) 0.910 -
470.lbm 29.000 -
470.lbm (avg) 29.000 -
470.lbm (avg) (percentage) 0.910 -
470.lbm (max) 25.000 -
470.lbm (max) (percentage) 0.770 -
470.lbm (unexplained diff vs previous) 4.000 -
470.lbm (unexplained diff vs previous) (percentage) 0.120 -
471.omnetpp 65.000 -
471.omnetpp (avg) 65.000 -
471.omnetpp (avg) (percentage) 2.940 -
471.omnetpp (max) 90.000 -
471.omnetpp (max) (percentage) 4.060 -
473.astar 89.000 -
473.astar (avg) 89.000 -
473.astar (avg) (percentage) 1.840 -
473.astar (max) 128.000 -
473.astar (max) (percentage) 2.640 -
481.wrf 39.000 -
481.wrf (avg) 39.000 -
481.wrf (avg) (percentage) 1.240 -
481.wrf (max) 80.000 -
481.wrf (max) (percentage) 2.510 -
482.sphinx3 17.000 -
482.sphinx3 (avg) 17.000 -
482.sphinx3 (avg) (percentage) 2.480 -
482.sphinx3 (max) 24.000 -
482.sphinx3 (max) (percentage) 3.460 -
483.xalancbmk (avg) (percentage) 4.050 -
483.xalancbmk (max) (percentage) 6.530 -
Geometric Mean 7.552 -