Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/dcbe0d43b56fbc44a42914ad335f036fdb58dfe8 (+ 57 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_vect-spec2k6--llvm-aarch64-master-O3-build/204/
View Options
Report
Filter

llvm-aarch64-master-O3 test results

Run Order Start Time Duration
Current 0204 (llvmorg-19-init-14563-gdcbe0d43b56f) 2024-06-13T01:17:29 0:00:00
Previous 0204 (llvmorg-19-init-14563-gdcbe0d43b56f) 2024-06-13T01:17:29 0:00:00
Baseline 0001 (llvmorg-17-init-04177-g4eb1f1fab35d) 2023-03-08T09:39:21 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 0 10
Performance Improvements 0 16
Added Tests 0 171
Unchanged Tests 1176 979
Total Tests 1176

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
447.dealII 2.10% 3240486.000 3308530.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
473.astar 6.02% 4865.000 5158.000 - 0.00% -
401.bzip2 5.16% 2501.000 2630.000 - 0.00% -
447.dealII 4.84% 1220.000 1279.000 - 0.00% -
482.sphinx3 4.76% 672.000 704.000 - 0.00% -
456.hmmer 3.33% 2639.000 2727.000 - 0.00% -
445.gobmk 1.96% 4887.000 4983.000 - 0.00% -
444.namd 1.81% 662.000 674.000 - 0.00% -
470.lbm 1.72% 3249.000 3305.000 - 0.00% -
433.milc 1.25% 1198.000 1213.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
462.libquantum -5.16% 42589.000 40390.000 - 0.00% -
464.h264ref -2.62% 749591.000 729973.000 - 0.00% -
444.namd -2.22% 212450.000 207733.000 - 0.00% -
458.sjeng -1.54% 146102.000 143846.000 - 0.00% -
450.soplex -1.31% 370392.000 365554.000 - 0.00% -
470.lbm -1.28% 12229.000 12073.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
429.mcf -28.33% 1906.000 1366.000 - 0.00% -
462.libquantum -23.58% 106.000 81.000 - 0.00% -
453.povray -7.53% 465.000 430.000 - 0.00% -
471.omnetpp -6.04% 2614.000 2456.000 - 0.00% -
458.sjeng -4.28% 6752.000 6463.000 - 0.00% -
464.h264ref -3.27% 4036.000 3904.000 - 0.00% -
403.gcc -1.56% 64.000 63.000 - 0.00% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful 184.21% 19.000 54.000 - 0.00% -
nb_execution_successful 184.21% 19.000 54.000 - 0.00% -
nb_total_tests 113.79% 29.000 62.000 - 0.00% -

Added Tests - Code Size
410.bwaves
416.gamess
434.zeusmp
435.gromacs
436.cactusADM
437.leslie3d
459.GemsFDTD
465.tonto
481.wrf

Added Tests - Execution
410.bwaves
416.gamess
434.zeusmp
435.gromacs
436.cactusADM
437.leslie3d
459.GemsFDTD
465.tonto
481.wrf

Added Tests - sample variability
400.perlbench
400.perlbench (avg)
400.perlbench (avg) (percentage)
400.perlbench (max)
400.perlbench (max) (percentage)
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
403.gcc
403.gcc (avg)
403.gcc (avg) (percentage)
403.gcc (max)
403.gcc (max) (percentage)
410.bwaves
410.bwaves (avg)
410.bwaves (avg) (percentage)
410.bwaves (max)
410.bwaves (max) (percentage)
410.bwaves (unexplained diff vs previous)
410.bwaves (unexplained diff vs previous) (percentage)
416.gamess
416.gamess (avg)
416.gamess (avg) (percentage)
416.gamess (max)
416.gamess (max) (percentage)
416.gamess (unexplained diff vs previous)
416.gamess (unexplained diff vs previous) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
433.milc
433.milc (avg)
433.milc (avg) (percentage)
433.milc (max)
433.milc (max) (percentage)
434.zeusmp
434.zeusmp (avg)
434.zeusmp (avg) (percentage)
434.zeusmp (max)
434.zeusmp (max) (percentage)
434.zeusmp (unexplained diff vs previous)
434.zeusmp (unexplained diff vs previous) (percentage)
435.gromacs
435.gromacs (avg)
435.gromacs (avg) (percentage)
435.gromacs (max)
435.gromacs (max) (percentage)
435.gromacs (unexplained diff vs previous)
435.gromacs (unexplained diff vs previous) (percentage)
436.cactusADM
436.cactusADM (avg)
436.cactusADM (avg) (percentage)
436.cactusADM (max)
436.cactusADM (max) (percentage)
436.cactusADM (unexplained diff vs previous)
436.cactusADM (unexplained diff vs previous) (percentage)
437.leslie3d
437.leslie3d (avg)
437.leslie3d (avg) (percentage)
437.leslie3d (max)
437.leslie3d (max) (percentage)
437.leslie3d (unexplained diff vs previous)
437.leslie3d (unexplained diff vs previous) (percentage)
444.namd
444.namd (avg)
444.namd (avg) (percentage)
444.namd (max)
444.namd (max) (percentage)
445.gobmk
445.gobmk (avg)
445.gobmk (avg) (percentage)
445.gobmk (max)
445.gobmk (max) (percentage)
447.dealII
447.dealII (avg)
447.dealII (avg) (percentage)
447.dealII (max)
447.dealII (max) (percentage)
450.soplex
450.soplex (avg)
450.soplex (avg) (percentage)
450.soplex (max)
450.soplex (max) (percentage)
453.povray
453.povray (avg)
453.povray (avg) (percentage)
453.povray (max)
453.povray (max) (percentage)
456.hmmer
456.hmmer (avg)
456.hmmer (avg) (percentage)
456.hmmer (max)
456.hmmer (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
459.GemsFDTD
459.GemsFDTD (avg)
459.GemsFDTD (avg) (percentage)
459.GemsFDTD (max)
459.GemsFDTD (max) (percentage)
459.GemsFDTD (unexplained diff vs previous)
459.GemsFDTD (unexplained diff vs previous) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)
464.h264ref
464.h264ref (avg)
464.h264ref (avg) (percentage)
464.h264ref (max)
464.h264ref (max) (percentage)
465.tonto
465.tonto (avg)
465.tonto (avg) (percentage)
465.tonto (max)
465.tonto (max) (percentage)
470.lbm
470.lbm (avg)
470.lbm (avg) (percentage)
470.lbm (max)
470.lbm (max) (percentage)
471.omnetpp
471.omnetpp (avg)
471.omnetpp (avg) (percentage)
471.omnetpp (max)
471.omnetpp (max) (percentage)
473.astar
473.astar (avg)
473.astar (avg) (percentage)
473.astar (max)
473.astar (max) (percentage)
481.wrf
481.wrf (avg)
481.wrf (avg) (percentage)
481.wrf (max)
481.wrf (max) (percentage)
481.wrf (unexplained diff vs previous)
481.wrf (unexplained diff vs previous) (percentage)
482.sphinx3
482.sphinx3 (avg)
482.sphinx3 (avg) (percentage)
482.sphinx3 (max)
482.sphinx3 (max) (percentage)
483.xalancbmk (avg) (percentage)
483.xalancbmk (max) (percentage)

Report Time: 0.33s
Execution (seconds)
Name Current %
400.perlbench 1655.000 -
401.bzip2 2630.000 -
403.gcc 63.000 -
410.bwaves 4747.000 -
416.gamess 10955.000 -
429.mcf 1366.000 -
433.milc 1213.000 -
434.zeusmp 1919.000 -
435.gromacs 4791.000 -
436.cactusADM 1314.000 -
437.leslie3d 6491.000 -
444.namd 674.000 -
445.gobmk 4983.000 -
447.dealII 1279.000 -
450.soplex 536.000 -
453.povray 430.000 -
456.hmmer 2727.000 -
458.sjeng 6463.000 -
459.GemsFDTD 5131.000 -
462.libquantum 81.000 -
464.h264ref 3904.000 -
465.tonto 20054.000 -
470.lbm 3305.000 -
471.omnetpp 2456.000 -
473.astar 5158.000 -
481.wrf 3218.000 -
482.sphinx3 704.000 -
Geometric Mean 1978.160 -
Code Size (bytes)
Name Current %
400.perlbench 1184453.000 -
401.bzip2 76494.000 -
403.gcc 3428767.000 -
410.bwaves 634491.000 -
416.gamess 8882418.000 -
429.mcf 13243.000 -
433.milc 137560.000 -
434.zeusmp 1032180.000 -
435.gromacs 905528.000 -
436.cactusADM 1425332.000 -
437.leslie3d 954461.000 -
444.namd 207733.000 -
445.gobmk 2112105.000 -
447.dealII 3308530.000 -
450.soplex 365554.000 -
453.povray 962684.000 -
456.hmmer 299772.000 -
458.sjeng 143846.000 -
459.GemsFDTD 1289767.000 -
462.libquantum 40390.000 -
464.h264ref 729973.000 -
465.tonto 10991216.000 -
470.lbm 12073.000 -
471.omnetpp 682759.000 -
473.astar 41996.000 -
481.wrf 7420693.000 -
482.sphinx3 196273.000 -
Geometric Mean 517463.982 -
sample variability
Name Current %
400.perlbench 29.000 -
400.perlbench (avg) 29.000 -
400.perlbench (avg) (percentage) 1.780 -
400.perlbench (max) 53.000 -
400.perlbench (max) (percentage) 3.240 -
401.bzip2 33.000 -
401.bzip2 (avg) 33.000 -
401.bzip2 (avg) (percentage) 1.270 -
401.bzip2 (max) 32.000 -
401.bzip2 (max) (percentage) 1.230 -
401.bzip2 (unexplained diff vs previous) 10.000 -
401.bzip2 (unexplained diff vs previous) (percentage) 0.380 -
403.gcc 3.000 -
403.gcc (avg) 3.000 -
403.gcc (avg) (percentage) 5.150 -
403.gcc (max) 6.000 -
403.gcc (max) (percentage) 10.340 -
410.bwaves 52.000 -
410.bwaves (avg) 52.000 -
410.bwaves (avg) (percentage) 1.110 -
410.bwaves (max) 153.000 -
410.bwaves (max) (percentage) 3.240 -
410.bwaves (unexplained diff vs previous) 149.000 -
410.bwaves (unexplained diff vs previous) (percentage) 3.140 -
416.gamess 23.000 -
416.gamess (avg) 23.000 -
416.gamess (avg) (percentage) 0.210 -
416.gamess (max) 54.000 -
416.gamess (max) (percentage) 0.500 -
416.gamess (unexplained diff vs previous) 54.000 -
416.gamess (unexplained diff vs previous) (percentage) 0.490 -
429.mcf 54.000 -
429.mcf (avg) 54.000 -
429.mcf (avg) (percentage) 4.010 -
429.mcf (max) 360.000 -
429.mcf (max) (percentage) 26.360 -
429.mcf (unexplained diff vs previous) 489.000 -
429.mcf (unexplained diff vs previous) (percentage) 35.800 -
433.milc 10.000 -
433.milc (avg) 10.000 -
433.milc (avg) (percentage) 0.870 -
433.milc (max) 43.000 -
433.milc (max) (percentage) 3.590 -
433.milc (unexplained diff vs previous) 42.000 -
433.milc (unexplained diff vs previous) (percentage) 3.460 -
434.zeusmp 17.000 -
434.zeusmp (avg) 17.000 -
434.zeusmp (avg) (percentage) 0.930 -
434.zeusmp (max) 39.000 -
434.zeusmp (max) (percentage) 2.070 -
434.zeusmp (unexplained diff vs previous) 39.000 -
434.zeusmp (unexplained diff vs previous) (percentage) 2.030 -
435.gromacs 101.000 -
435.gromacs (avg) 101.000 -
435.gromacs (avg) (percentage) 2.110 -
435.gromacs (max) 172.000 -
435.gromacs (max) (percentage) 3.610 -
435.gromacs (unexplained diff vs previous) 167.000 -
435.gromacs (unexplained diff vs previous) (percentage) 3.490 -
436.cactusADM 10.000 -
436.cactusADM (avg) 10.000 -
436.cactusADM (avg) (percentage) 0.790 -
436.cactusADM (max) 24.000 -
436.cactusADM (max) (percentage) 1.870 -
436.cactusADM (unexplained diff vs previous) 25.000 -
436.cactusADM (unexplained diff vs previous) (percentage) 1.900 -
437.leslie3d 225.000 -
437.leslie3d (avg) 225.000 -
437.leslie3d (avg) (percentage) 3.470 -
437.leslie3d (max) 402.000 -
437.leslie3d (max) (percentage) 6.200 -
437.leslie3d (unexplained diff vs previous) 379.000 -
437.leslie3d (unexplained diff vs previous) (percentage) 5.840 -
444.namd 5.000 -
444.namd (avg) 5.000 -
444.namd (avg) (percentage) 0.840 -
444.namd (max) 9.000 -
444.namd (max) (percentage) 1.360 -
444.namd (unexplained diff vs previous) 2.000 -
444.namd (unexplained diff vs previous) (percentage) 0.300 -
445.gobmk 43.000 -
445.gobmk (avg) 43.000 -
445.gobmk (avg) (percentage) 0.880 -
445.gobmk (max) 180.000 -
445.gobmk (max) (percentage) 3.620 -
445.gobmk (unexplained diff vs previous) 174.000 -
445.gobmk (unexplained diff vs previous) (percentage) 3.490 -
447.dealII 20.000 -
447.dealII (avg) 20.000 -
447.dealII (avg) (percentage) 1.610 -
447.dealII (max) 20.000 -
447.dealII (max) (percentage) 1.640 -
447.dealII (unexplained diff vs previous) 20.000 -
447.dealII (unexplained diff vs previous) (percentage) 1.560 -
450.soplex 14.000 -
450.soplex (avg) 14.000 -
450.soplex (avg) (percentage) 2.780 -
450.soplex (max) 39.000 -
450.soplex (max) (percentage) 7.410 -
450.soplex (unexplained diff vs previous) 37.000 -
450.soplex (unexplained diff vs previous) (percentage) 6.900 -
453.povray 6.000 -
453.povray (avg) 6.000 -
453.povray (avg) (percentage) 1.440 -
453.povray (max) 11.000 -
453.povray (max) (percentage) 2.640 -
453.povray (unexplained diff vs previous) 1.000 -
453.povray (unexplained diff vs previous) (percentage) 0.230 -
456.hmmer 8.000 -
456.hmmer (avg) 8.000 -
456.hmmer (avg) (percentage) 0.320 -
456.hmmer (max) 11.000 -
456.hmmer (max) (percentage) 0.440 -
456.hmmer (unexplained diff vs previous) 9.000 -
456.hmmer (unexplained diff vs previous) (percentage) 0.330 -
458.sjeng 37.000 -
458.sjeng (avg) 37.000 -
458.sjeng (avg) (percentage) 0.580 -
458.sjeng (max) 116.000 -
458.sjeng (max) (percentage) 1.800 -
458.sjeng (unexplained diff vs previous) 114.000 -
458.sjeng (unexplained diff vs previous) (percentage) 1.760 -
459.GemsFDTD 41.000 -
459.GemsFDTD (avg) 41.000 -
459.GemsFDTD (avg) (percentage) 0.810 -
459.GemsFDTD (max) 152.000 -
459.GemsFDTD (max) (percentage) 2.980 -
459.GemsFDTD (unexplained diff vs previous) 141.000 -
459.GemsFDTD (unexplained diff vs previous) (percentage) 2.750 -
462.libquantum 1.000 -
462.libquantum (avg) 1.000 -
462.libquantum (avg) (percentage) 1.880 -
462.libquantum (max) 4.000 -
462.libquantum (max) (percentage) 4.940 -
462.libquantum (unexplained diff vs previous) 3.000 -
462.libquantum (unexplained diff vs previous) (percentage) 3.700 -
464.h264ref 37.000 -
464.h264ref (avg) 37.000 -
464.h264ref (avg) (percentage) 0.950 -
464.h264ref (max) 114.000 -
464.h264ref (max) (percentage) 2.930 -
464.h264ref (unexplained diff vs previous) 68.000 -
464.h264ref (unexplained diff vs previous) (percentage) 1.740 -
465.tonto 56.000 -
465.tonto (avg) 56.000 -
465.tonto (avg) (percentage) 0.280 -
465.tonto (max) 92.000 -
465.tonto (max) (percentage) 0.460 -
470.lbm 26.000 -
470.lbm (avg) 26.000 -
470.lbm (avg) (percentage) 0.810 -
470.lbm (max) 88.000 -
470.lbm (max) (percentage) 2.670 -
470.lbm (unexplained diff vs previous) 86.000 -
470.lbm (unexplained diff vs previous) (percentage) 2.600 -
471.omnetpp 52.000 -
471.omnetpp (avg) 52.000 -
471.omnetpp (avg) (percentage) 2.130 -
471.omnetpp (max) 88.000 -
471.omnetpp (max) (percentage) 3.620 -
471.omnetpp (unexplained diff vs previous) 71.000 -
471.omnetpp (unexplained diff vs previous) (percentage) 2.890 -
473.astar 65.000 -
473.astar (avg) 65.000 -
473.astar (avg) (percentage) 1.270 -
473.astar (max) 241.000 -
473.astar (max) (percentage) 4.690 -
473.astar (unexplained diff vs previous) 231.000 -
473.astar (unexplained diff vs previous) (percentage) 4.480 -
481.wrf 57.000 -
481.wrf (avg) 57.000 -
481.wrf (avg) (percentage) 1.800 -
481.wrf (max) 213.000 -
481.wrf (max) (percentage) 6.630 -
481.wrf (unexplained diff vs previous) 200.000 -
481.wrf (unexplained diff vs previous) (percentage) 6.220 -
482.sphinx3 14.000 -
482.sphinx3 (avg) 14.000 -
482.sphinx3 (avg) (percentage) 2.120 -
482.sphinx3 (max) 33.000 -
482.sphinx3 (max) (percentage) 4.760 -
482.sphinx3 (unexplained diff vs previous) 32.000 -
482.sphinx3 (unexplained diff vs previous) (percentage) 4.550 -
483.xalancbmk (avg) (percentage) 1.740 -
483.xalancbmk (max) (percentage) 2.210 -
Geometric Mean 9.813 -