Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/abe7ef60957f9d7e1b0fca4f59b4d256a798ba90 (+ 142 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_vect-spec2k6--llvm-aarch64-master-O3_LTO-build/29/
Filter

llvm-aarch64-master-O3_LTO test results

Run Order Start Time Duration
Current 0029 (llvmorg-17-init-14255-gabe7ef60957f) 2023-06-08T23:54:10 0:00:00
Previous 0029 (llvmorg-17-init-14255-gabe7ef60957f) 2023-06-08T23:54:10 0:00:00
Baseline 0001 (llvmorg-17-init-04177-g4eb1f1fab35d) 2023-03-08T09:39:21 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 0 1
Performance Improvements 0 19
Added Tests 2 137
Unchanged Tests 1042 887
Total Tests 1044

Added Tests - sample variability
400.perlbench (max)
400.perlbench (max) (percentage)

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
401.bzip2 6.57% 2510.000 2675.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
462.libquantum -15.16% 45013.000 38189.000 - 0.00% -
482.sphinx3 -1.20% 176978.000 174846.000 - 0.00% -
456.hmmer -1.14% 165371.000 163491.000 - 0.00% -
458.sjeng -1.04% 131729.000 130357.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
462.libquantum -28.70% 108.000 77.000 - 0.00% -
403.gcc -8.47% 59.000 54.000 - 0.00% -
450.soplex -6.85% 540.000 503.000 - 0.00% -
447.dealII -5.79% 1001.000 943.000 - 0.00% -
482.sphinx3 -5.42% 664.000 628.000 - 0.00% -
400.perlbench -4.41% 1474.000 1409.000 - 0.00% -
483.xalancbmk -4.01% 2715.000 2606.000 - 0.00% -
464.h264ref -3.93% 3965.000 3809.000 - 0.00% -
473.astar -2.95% 4638.000 4501.000 - 0.00% -
471.omnetpp -2.65% 2153.000 2096.000 - 0.00% -
444.namd -2.08% 672.000 658.000 - 0.00% -
433.milc -1.14% 1054.000 1042.000 - 0.00% -
470.lbm -1.05% 3235.000 3201.000 - 0.00% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful 26.32% 19.000 24.000 - 0.00% -
nb_execution_successful 26.32% 19.000 24.000 - 0.00% -

Added Tests - Code Size
410.bwaves
434.zeusmp
435.gromacs
436.cactusADM
437.leslie3d

Added Tests - Execution
410.bwaves
434.zeusmp
435.gromacs
436.cactusADM
437.leslie3d

Added Tests - sample variability
400.perlbench (max)
400.perlbench (max) (percentage)
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
403.gcc
403.gcc (avg)
403.gcc (avg) (percentage)
403.gcc (max)
403.gcc (max) (percentage)
410.bwaves
410.bwaves (avg)
410.bwaves (avg) (percentage)
410.bwaves (max)
410.bwaves (max) (percentage)
410.bwaves (unexplained diff vs previous)
410.bwaves (unexplained diff vs previous) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
433.milc
433.milc (avg)
433.milc (avg) (percentage)
433.milc (max)
433.milc (max) (percentage)
434.zeusmp
434.zeusmp (avg)
434.zeusmp (avg) (percentage)
434.zeusmp (max)
434.zeusmp (max) (percentage)
434.zeusmp (unexplained diff vs previous)
434.zeusmp (unexplained diff vs previous) (percentage)
435.gromacs
435.gromacs (avg)
435.gromacs (avg) (percentage)
435.gromacs (max)
435.gromacs (max) (percentage)
435.gromacs (unexplained diff vs previous)
435.gromacs (unexplained diff vs previous) (percentage)
436.cactusADM
436.cactusADM (avg)
436.cactusADM (avg) (percentage)
436.cactusADM (max)
436.cactusADM (max) (percentage)
436.cactusADM (unexplained diff vs previous)
436.cactusADM (unexplained diff vs previous) (percentage)
437.leslie3d
437.leslie3d (avg)
437.leslie3d (avg) (percentage)
437.leslie3d (max)
437.leslie3d (max) (percentage)
437.leslie3d (unexplained diff vs previous)
437.leslie3d (unexplained diff vs previous) (percentage)
444.namd
444.namd (avg)
444.namd (avg) (percentage)
444.namd (max)
444.namd (max) (percentage)
445.gobmk
445.gobmk (avg)
445.gobmk (avg) (percentage)
445.gobmk (max)
445.gobmk (max) (percentage)
447.dealII
447.dealII (avg)
447.dealII (avg) (percentage)
447.dealII (max)
447.dealII (max) (percentage)
450.soplex
450.soplex (avg)
450.soplex (avg) (percentage)
450.soplex (max)
450.soplex (max) (percentage)
453.povray
453.povray (avg)
453.povray (avg) (percentage)
453.povray (max)
453.povray (max) (percentage)
456.hmmer
456.hmmer (avg)
456.hmmer (avg) (percentage)
456.hmmer (max)
456.hmmer (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)
464.h264ref
464.h264ref (avg)
464.h264ref (avg) (percentage)
464.h264ref (max)
464.h264ref (max) (percentage)
470.lbm
470.lbm (avg)
470.lbm (avg) (percentage)
470.lbm (max)
470.lbm (max) (percentage)
471.omnetpp
471.omnetpp (avg)
471.omnetpp (avg) (percentage)
471.omnetpp (max)
471.omnetpp (max) (percentage)
473.astar
473.astar (avg)
473.astar (avg) (percentage)
473.astar (max)
473.astar (max) (percentage)
482.sphinx3
482.sphinx3 (avg)
482.sphinx3 (avg) (percentage)
482.sphinx3 (max)
482.sphinx3 (max) (percentage)
483.xalancbmk
483.xalancbmk (avg)
483.xalancbmk (avg) (percentage)
483.xalancbmk (max)
483.xalancbmk (max) (percentage)


Report Time: 0.35s
Name Current %
400.perlbench 1409.000 -
401.bzip2 2675.000 -
403.gcc 54.000 -
410.bwaves 4249.000 -
429.mcf 1880.000 -
433.milc 1042.000 -
434.zeusmp 1940.000 -
435.gromacs 4849.000 -
436.cactusADM 1339.000 -
437.leslie3d 6791.000 -
444.namd 658.000 -
445.gobmk 4633.000 -
447.dealII 943.000 -
450.soplex 503.000 -
453.povray 418.000 -
456.hmmer 2616.000 -
458.sjeng 6305.000 -
462.libquantum 77.000 -
464.h264ref 3809.000 -
470.lbm 3201.000 -
471.omnetpp 2096.000 -
473.astar 4501.000 -
482.sphinx3 628.000 -
483.xalancbmk 2606.000 -
Geometric Mean 1513.706 -
Name Current %
400.perlbench 1263035.000 -
401.bzip2 66506.000 -
403.gcc 3792471.000 -
410.bwaves 579830.000 -
429.mcf 11512.000 -
433.milc 128468.000 -
434.zeusmp 1014805.000 -
435.gromacs 725448.000 -
436.cactusADM 1102538.000 -
437.leslie3d 915623.000 -
444.namd 168297.000 -
445.gobmk 2225808.000 -
447.dealII 549358.000 -
450.soplex 317643.000 -
453.povray 1134163.000 -
456.hmmer 163491.000 -
458.sjeng 130357.000 -
462.libquantum 38189.000 -
464.h264ref 766803.000 -
470.lbm 10805.000 -
471.omnetpp 752219.000 -
473.astar 33112.000 -
482.sphinx3 174846.000 -
483.xalancbmk 3701785.000 -
Geometric Mean 322782.825 -
Name Current %
400.perlbench (max) 0.000 -
400.perlbench (max) (percentage) 0.000 -
401.bzip2 22.000 -
401.bzip2 (avg) 22.000 -
401.bzip2 (avg) (percentage) 0.850 -
401.bzip2 (max) 37.000 -
401.bzip2 (max) (percentage) 1.400 -
401.bzip2 (unexplained diff vs previous) 38.000 -
401.bzip2 (unexplained diff vs previous) (percentage) 1.420 -
403.gcc 1.000 -
403.gcc (avg) 1.000 -
403.gcc (avg) (percentage) 2.450 -
403.gcc (max) 1.000 -
403.gcc (max) (percentage) 3.400 -
410.bwaves 29.000 -
410.bwaves (avg) 29.000 -
410.bwaves (avg) (percentage) 0.690 -
410.bwaves (max) 68.000 -
410.bwaves (max) (percentage) 1.620 -
410.bwaves (unexplained diff vs previous) 70.000 -
410.bwaves (unexplained diff vs previous) (percentage) 1.650 -
429.mcf 83.000 -
429.mcf (avg) 83.000 -
429.mcf (avg) (percentage) 4.450 -
429.mcf (max) 307.000 -
429.mcf (max) (percentage) 16.330 -
429.mcf (unexplained diff vs previous) 180.000 -
429.mcf (unexplained diff vs previous) (percentage) 9.570 -
433.milc 16.000 -
433.milc (avg) 16.000 -
433.milc (avg) (percentage) 1.550 -
433.milc (max) 41.000 -
433.milc (max) (percentage) 4.030 -
433.milc (unexplained diff vs previous) 18.000 -
433.milc (unexplained diff vs previous) (percentage) 1.730 -
434.zeusmp 30.000 -
434.zeusmp (avg) 30.000 -
434.zeusmp (avg) (percentage) 1.570 -
434.zeusmp (max) 30.000 -
434.zeusmp (max) (percentage) 1.570 -
434.zeusmp (unexplained diff vs previous) 31.000 -
434.zeusmp (unexplained diff vs previous) (percentage) 1.600 -
435.gromacs 117.000 -
435.gromacs (avg) 117.000 -
435.gromacs (avg) (percentage) 2.420 -
435.gromacs (max) 187.000 -
435.gromacs (max) (percentage) 3.870 -
435.gromacs (unexplained diff vs previous) 195.000 -
435.gromacs (unexplained diff vs previous) (percentage) 4.020 -
436.cactusADM 11.000 -
436.cactusADM (avg) 11.000 -
436.cactusADM (avg) (percentage) 0.860 -
436.cactusADM (max) 35.000 -
436.cactusADM (max) (percentage) 2.680 -
436.cactusADM (unexplained diff vs previous) 35.000 -
436.cactusADM (unexplained diff vs previous) (percentage) 2.610 -
437.leslie3d 270.000 -
437.leslie3d (avg) 270.000 -
437.leslie3d (avg) (percentage) 3.980 -
437.leslie3d (max) 270.000 -
437.leslie3d (max) (percentage) 3.980 -
437.leslie3d (unexplained diff vs previous) 260.000 -
437.leslie3d (unexplained diff vs previous) (percentage) 3.830 -
444.namd 7.000 -
444.namd (avg) 7.000 -
444.namd (avg) (percentage) 1.090 -
444.namd (max) 16.000 -
444.namd (max) (percentage) 2.520 -
444.namd (unexplained diff vs previous) 17.000 -
444.namd (unexplained diff vs previous) (percentage) 2.580 -
445.gobmk 9.000 -
445.gobmk (avg) 9.000 -
445.gobmk (avg) (percentage) 0.200 -
445.gobmk (max) 24.000 -
445.gobmk (max) (percentage) 0.530 -
447.dealII 14.000 -
447.dealII (avg) 14.000 -
447.dealII (avg) (percentage) 1.560 -
447.dealII (max) 18.000 -
447.dealII (max) (percentage) 1.950 -
450.soplex 20.000 -
450.soplex (avg) 20.000 -
450.soplex (avg) (percentage) 4.110 -
450.soplex (max) 54.000 -
450.soplex (max) (percentage) 10.800 -
450.soplex (unexplained diff vs previous) 30.000 -
450.soplex (unexplained diff vs previous) (percentage) 5.960 -
453.povray 5.000 -
453.povray (avg) 5.000 -
453.povray (avg) (percentage) 1.280 -
453.povray (max) 9.000 -
453.povray (max) (percentage) 2.310 -
453.povray (unexplained diff vs previous) 3.000 -
453.povray (unexplained diff vs previous) (percentage) 0.720 -
456.hmmer 8.000 -
456.hmmer (avg) 8.000 -
456.hmmer (avg) (percentage) 0.310 -
456.hmmer (max) 12.000 -
456.hmmer (max) (percentage) 0.460 -
456.hmmer (unexplained diff vs previous) 12.000 -
456.hmmer (unexplained diff vs previous) (percentage) 0.460 -
458.sjeng 42.000 -
458.sjeng (avg) 42.000 -
458.sjeng (avg) (percentage) 0.670 -
458.sjeng (max) 122.000 -
458.sjeng (max) (percentage) 1.940 -
458.sjeng (unexplained diff vs previous) 125.000 -
458.sjeng (unexplained diff vs previous) (percentage) 1.980 -
462.libquantum 1.000 -
462.libquantum (avg) 1.000 -
462.libquantum (avg) (percentage) 1.570 -
462.libquantum (max) 3.000 -
462.libquantum (max) (percentage) 4.940 -
462.libquantum (unexplained diff vs previous) 4.000 -
462.libquantum (unexplained diff vs previous) (percentage) 5.190 -
464.h264ref 38.000 -
464.h264ref (avg) 38.000 -
464.h264ref (avg) (percentage) 1.010 -
464.h264ref (max) 84.000 -
464.h264ref (max) (percentage) 2.210 -
464.h264ref (unexplained diff vs previous) 86.000 -
464.h264ref (unexplained diff vs previous) (percentage) 2.260 -
470.lbm 34.000 -
470.lbm (avg) 34.000 -
470.lbm (avg) (percentage) 1.090 -
470.lbm (max) 106.000 -
470.lbm (max) (percentage) 3.320 -
470.lbm (unexplained diff vs previous) 110.000 -
470.lbm (unexplained diff vs previous) (percentage) 3.440 -
471.omnetpp 29.000 -
471.omnetpp (avg) 29.000 -
471.omnetpp (avg) (percentage) 1.400 -
471.omnetpp (max) 48.000 -
471.omnetpp (max) (percentage) 2.330 -
471.omnetpp (unexplained diff vs previous) 50.000 -
471.omnetpp (unexplained diff vs previous) (percentage) 2.390 -
473.astar 88.000 -
473.astar (avg) 88.000 -
473.astar (avg) (percentage) 1.960 -
473.astar (max) 290.000 -
473.astar (max) (percentage) 6.460 -
473.astar (unexplained diff vs previous) 311.000 -
473.astar (unexplained diff vs previous) (percentage) 6.910 -
482.sphinx3 16.000 -
482.sphinx3 (avg) 16.000 -
482.sphinx3 (avg) (percentage) 2.550 -
482.sphinx3 (max) 40.000 -
482.sphinx3 (max) (percentage) 6.410 -
482.sphinx3 (unexplained diff vs previous) 43.000 -
482.sphinx3 (unexplained diff vs previous) (percentage) 6.850 -
483.xalancbmk 58.000 -
483.xalancbmk (avg) 58.000 -
483.xalancbmk (avg) (percentage) 2.250 -
483.xalancbmk (max) 74.000 -
483.xalancbmk (max) (percentage) 2.850 -
Geometric Mean 8.202 -13.75%