Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/3fc30ae29762ce354ed17b63d27251f4dd8fdb0c (+ 205 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_vect-spec2k6--llvm-aarch64-master-O3-build/24/
Filter

llvm-aarch64-master-O3 test results

Run Order Start Time Duration
Current 0024 (llvmorg-17-init-12136-g3fc30ae29762) 2023-05-20T10:36:14 0:00:00
Previous 0024 (llvmorg-17-init-12136-g3fc30ae29762) 2023-05-20T10:36:14 0:00:00
Baseline 0001 (llvmorg-17-init-04177-g4eb1f1fab35d) 2023-03-08T09:39:21 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 0 8
Performance Improvements 0 7
Added Tests 4 99
Unchanged Tests 848 738
Total Tests 852

Added Tests - sample variability
400.perlbench (max)
400.perlbench (max) (percentage)
403.gcc (max)
403.gcc (max) (percentage)

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
401.bzip2 6.36% 2501.000 2660.000 - 0.00% -
429.mcf 5.46% 1906.000 2010.000 - 0.00% -
473.astar 5.32% 4865.000 5124.000 - 0.00% -
447.dealII 2.46% 1220.000 1250.000 - 0.00% -
453.povray 2.37% 465.000 476.000 - 0.00% -
483.xalancbmk 1.20% 3572.000 3615.000 - 0.00% -
470.lbm 1.17% 3249.000 3287.000 - 0.00% -
482.sphinx3 1.04% 672.000 679.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
470.lbm -1.34% 12229.000 12065.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
403.gcc -9.38% 64.000 58.000 - 0.00% -
464.h264ref -4.71% 4036.000 3846.000 - 0.00% -
450.soplex -1.87% 536.000 526.000 - 0.00% -
471.omnetpp -1.19% 2614.000 2583.000 - 0.00% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful 26.32% 19.000 24.000 - 0.00% -
nb_execution_successful 26.32% 19.000 24.000 - 0.00% -

Added Tests - Code Size
410.bwaves
434.zeusmp
435.gromacs
436.cactusADM
437.leslie3d

Added Tests - Execution
410.bwaves
434.zeusmp
435.gromacs
436.cactusADM
437.leslie3d

Added Tests - sample variability
400.perlbench (max)
400.perlbench (max) (percentage)
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
403.gcc (max)
403.gcc (max) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
433.milc
433.milc (avg)
433.milc (avg) (percentage)
433.milc (max)
433.milc (max) (percentage)
444.namd
444.namd (avg)
444.namd (avg) (percentage)
444.namd (max)
444.namd (max) (percentage)
445.gobmk
445.gobmk (avg)
445.gobmk (avg) (percentage)
445.gobmk (max)
445.gobmk (max) (percentage)
447.dealII
447.dealII (avg)
447.dealII (avg) (percentage)
447.dealII (max)
447.dealII (max) (percentage)
450.soplex
450.soplex (avg)
450.soplex (avg) (percentage)
450.soplex (max)
450.soplex (max) (percentage)
453.povray
453.povray (avg)
453.povray (avg) (percentage)
453.povray (max)
453.povray (max) (percentage)
456.hmmer
456.hmmer (avg)
456.hmmer (avg) (percentage)
456.hmmer (max)
456.hmmer (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)
464.h264ref
464.h264ref (avg)
464.h264ref (avg) (percentage)
464.h264ref (max)
464.h264ref (max) (percentage)
470.lbm
470.lbm (avg)
470.lbm (avg) (percentage)
470.lbm (max)
470.lbm (max) (percentage)
471.omnetpp
471.omnetpp (avg)
471.omnetpp (avg) (percentage)
471.omnetpp (max)
471.omnetpp (max) (percentage)
473.astar
473.astar (avg)
473.astar (avg) (percentage)
473.astar (max)
473.astar (max) (percentage)
482.sphinx3
482.sphinx3 (avg)
482.sphinx3 (avg) (percentage)
482.sphinx3 (max)
482.sphinx3 (max) (percentage)
483.xalancbmk
483.xalancbmk (avg)
483.xalancbmk (avg) (percentage)
483.xalancbmk (max)
483.xalancbmk (max) (percentage)


Report Time: 0.34s
Name Current %
400.perlbench 1669.000 -
401.bzip2 2660.000 -
403.gcc 58.000 -
410.bwaves 4413.000 -
429.mcf 2010.000 -
433.milc 1207.000 -
434.zeusmp 1996.000 -
435.gromacs 4995.000 -
436.cactusADM 1280.000 -
437.leslie3d 6614.000 -
444.namd 667.000 -
445.gobmk 4910.000 -
447.dealII 1250.000 -
450.soplex 526.000 -
453.povray 476.000 -
456.hmmer 2650.000 -
458.sjeng 6804.000 -
462.libquantum 106.000 -
464.h264ref 3846.000 -
470.lbm 3287.000 -
471.omnetpp 2583.000 -
473.astar 5124.000 -
482.sphinx3 679.000 -
483.xalancbmk 3615.000 -
Geometric Mean 1658.365 -
Name Current %
400.perlbench 1192226.000 -
401.bzip2 76734.000 -
403.gcc 3432691.000 -
410.bwaves 578657.000 -
429.mcf 13347.000 -
433.milc 139504.000 -
434.zeusmp 1034282.000 -
435.gromacs 920408.000 -
436.cactusADM 1397064.000 -
437.leslie3d 916249.000 -
444.namd 210913.000 -
445.gobmk 2130561.000 -
447.dealII 3261494.000 -
450.soplex 370504.000 -
453.povray 963914.000 -
456.hmmer 298651.000 -
458.sjeng 146106.000 -
462.libquantum 42477.000 -
464.h264ref 746535.000 -
470.lbm 12065.000 -
471.omnetpp 678394.000 -
473.astar 42376.000 -
482.sphinx3 197127.000 -
483.xalancbmk 4318486.000 -
Geometric Mean 381113.716 -
Name Current %
400.perlbench (max) 0.000 -
400.perlbench (max) (percentage) 0.000 -
401.bzip2 56.000 -
401.bzip2 (avg) 56.000 -
401.bzip2 (avg) (percentage) 2.110 -
401.bzip2 (max) 206.000 -
401.bzip2 (max) (percentage) 7.780 -
401.bzip2 (unexplained diff vs previous) 192.000 -
401.bzip2 (unexplained diff vs previous) (percentage) 7.220 -
403.gcc (max) 0.000 -
403.gcc (max) (percentage) 0.000 -
429.mcf 137.000 -
429.mcf (avg) 137.000 -
429.mcf (avg) (percentage) 6.840 -
429.mcf (max) 428.000 -
429.mcf (max) (percentage) 21.300 -
429.mcf (unexplained diff vs previous) 353.000 -
429.mcf (unexplained diff vs previous) (percentage) 17.560 -
433.milc 21.000 -
433.milc (avg) 21.000 -
433.milc (avg) (percentage) 1.800 -
433.milc (max) 60.000 -
433.milc (max) (percentage) 5.050 -
433.milc (unexplained diff vs previous) 58.000 -
433.milc (unexplained diff vs previous) (percentage) 4.810 -
444.namd 6.000 -
444.namd (avg) 6.000 -
444.namd (avg) (percentage) 0.970 -
444.namd (max) 12.000 -
444.namd (max) (percentage) 1.830 -
444.namd (unexplained diff vs previous) 12.000 -
444.namd (unexplained diff vs previous) (percentage) 1.800 -
445.gobmk 12.000 -
445.gobmk (avg) 12.000 -
445.gobmk (avg) (percentage) 0.250 -
445.gobmk (max) 18.000 -
445.gobmk (max) (percentage) 0.380 -
447.dealII 38.000 -
447.dealII (avg) 38.000 -
447.dealII (avg) (percentage) 3.040 -
447.dealII (max) 48.000 -
447.dealII (max) (percentage) 3.910 -
447.dealII (unexplained diff vs previous) 47.000 -
447.dealII (unexplained diff vs previous) (percentage) 3.760 -
450.soplex 32.000 -
450.soplex (avg) 32.000 -
450.soplex (avg) (percentage) 6.270 -
450.soplex (max) 65.000 -
450.soplex (max) (percentage) 12.390 -
450.soplex (unexplained diff vs previous) 58.000 -
450.soplex (unexplained diff vs previous) (percentage) 11.030 -
453.povray 8.000 -
453.povray (avg) 8.000 -
453.povray (avg) (percentage) 1.830 -
453.povray (max) 15.000 -
453.povray (max) (percentage) 3.250 -
453.povray (unexplained diff vs previous) 15.000 -
453.povray (unexplained diff vs previous) (percentage) 3.150 -
456.hmmer 11.000 -
456.hmmer (avg) 11.000 -
456.hmmer (avg) (percentage) 0.430 -
456.hmmer (max) 13.000 -
456.hmmer (max) (percentage) 0.520 -
456.hmmer (unexplained diff vs previous) 9.000 -
456.hmmer (unexplained diff vs previous) (percentage) 0.340 -
458.sjeng 36.000 -
458.sjeng (avg) 36.000 -
458.sjeng (avg) (percentage) 0.530 -
458.sjeng (max) 123.000 -
458.sjeng (max) (percentage) 1.810 -
458.sjeng (unexplained diff vs previous) 121.000 -
458.sjeng (unexplained diff vs previous) (percentage) 1.780 -
462.libquantum 2.000 -
462.libquantum (avg) 2.000 -
462.libquantum (avg) (percentage) 2.470 -
462.libquantum (max) 4.000 -
462.libquantum (max) (percentage) 3.920 -
462.libquantum (unexplained diff vs previous) 4.000 -
462.libquantum (unexplained diff vs previous) (percentage) 3.770 -
464.h264ref 32.000 -
464.h264ref (avg) 32.000 -
464.h264ref (avg) (percentage) 0.840 -
464.h264ref (max) 32.000 -
464.h264ref (max) (percentage) 0.850 -
470.lbm 40.000 -
470.lbm (avg) 40.000 -
470.lbm (avg) (percentage) 1.240 -
470.lbm (max) 111.000 -
470.lbm (max) (percentage) 3.400 -
470.lbm (unexplained diff vs previous) 108.000 -
470.lbm (unexplained diff vs previous) (percentage) 3.290 -
471.omnetpp 39.000 -
471.omnetpp (avg) 39.000 -
471.omnetpp (avg) (percentage) 1.540 -
471.omnetpp (max) 69.000 -
471.omnetpp (max) (percentage) 2.690 -
471.omnetpp (unexplained diff vs previous) 50.000 -
471.omnetpp (unexplained diff vs previous) (percentage) 1.940 -
473.astar 93.000 -
473.astar (avg) 93.000 -
473.astar (avg) (percentage) 1.820 -
473.astar (max) 316.000 -
473.astar (max) (percentage) 6.170 -
473.astar (unexplained diff vs previous) 298.000 -
473.astar (unexplained diff vs previous) (percentage) 5.820 -
482.sphinx3 15.000 -
482.sphinx3 (avg) 15.000 -
482.sphinx3 (avg) (percentage) 2.270 -
482.sphinx3 (max) 33.000 -
482.sphinx3 (max) (percentage) 4.950 -
482.sphinx3 (unexplained diff vs previous) 32.000 -
482.sphinx3 (unexplained diff vs previous) (percentage) 4.710 -
483.xalancbmk 49.000 -
483.xalancbmk (avg) 49.000 -
483.xalancbmk (avg) (percentage) 1.380 -
483.xalancbmk (max) 126.000 -
483.xalancbmk (max) (percentage) 3.490 -
483.xalancbmk (unexplained diff vs previous) 122.000 -
483.xalancbmk (unexplained diff vs previous) (percentage) 3.370 -
Geometric Mean 7.704 -32.39%