Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=1afdbb1e986157a73a7bf1cf4fa03b9426e824e8 (+ 43 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/c62df15d283f035d5b1644f74493db2933f2a8cb (+ 68 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=e78c4c49831d0ca6253ff5ce5b956cdc4189c8a9 (+ 15 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=74e67f340972acd164a325ac11553d5ad50eb8d5 (+ 999 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_vect-spec2k6--gnu-aarch64-master-O3_LTO-build/2/
Filter

gnu-aarch64-master-O3_LTO test results

Run Order Start Time Duration
Current 0002 (4-changed-components) 2023-03-09T14:13:34 0:00:00
Previous 0001 (4-changed-components) 2023-03-08T03:13:34 0:00:00
No Baseline Run


Tests Summary

Status Group #
Performance Regressions 15
Performance Improvements 8
Added Tests 83
Unchanged Tests 866
Total Tests 972

Performance Regressions - Code Size Δ Previous Current σ
482.sphinx3 2.64% 153776.000 157840.000 -
444.namd 1.66% 235533.000 239453.000 -

Performance Regressions - Execution Δ Previous Current σ
450.soplex 10.34% 493.000 544.000 -
433.milc 7.83% 932.000 1005.000 -
403.gcc 6.25% 48.000 51.000 -
429.mcf 5.75% 1790.000 1893.000 -
410.bwaves 4.41% 4016.000 4193.000 -
434.zeusmp 3.80% 1709.000 1774.000 -
436.cactusADM 2.53% 1621.000 1662.000 -
401.bzip2 2.41% 2612.000 2675.000 -
437.leslie3d 2.23% 6730.000 6880.000 -
453.povray 1.87% 375.000 382.000 -
447.dealII 1.51% 996.000 1011.000 -
444.namd 1.46% 618.000 627.000 -
400.perlbench 1.11% 1354.000 1369.000 -

Performance Improvements - Execution Δ Previous Current σ
470.lbm -6.81% 3644.000 3396.000 -
459.GemsFDTD -5.77% 4574.000 4310.000 -
482.sphinx3 -3.89% 771.000 741.000 -
481.wrf -3.63% 2999.000 2890.000 -
473.astar -2.64% 4586.000 4465.000 -
454.calculix -2.04% 49.000 48.000 -
462.libquantum -1.25% 80.000 79.000 -
435.gromacs -1.02% 4991.000 4940.000 -

Added Tests - sample variability
400.perlbench (max)
400.perlbench (max) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
410.bwaves
410.bwaves (avg)
410.bwaves (avg) (percentage)
410.bwaves (max)
410.bwaves (max) (percentage)
416.gamess (max)
416.gamess (max) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
433.milc (max)
433.milc (max) (percentage)
434.zeusmp (max)
434.zeusmp (max) (percentage)
435.gromacs (max)
435.gromacs (max) (percentage)
436.cactusADM
436.cactusADM (avg)
436.cactusADM (avg) (percentage)
436.cactusADM (max)
436.cactusADM (max) (percentage)
437.leslie3d
437.leslie3d (avg)
437.leslie3d (avg) (percentage)
437.leslie3d (max)
437.leslie3d (max) (percentage)
444.namd (max)
444.namd (max) (percentage)
445.gobmk (max)
445.gobmk (max) (percentage)
447.dealII (max)
447.dealII (max) (percentage)
450.soplex
450.soplex (avg)
450.soplex (avg) (percentage)
450.soplex (max)
450.soplex (max) (percentage)
453.povray (max)
453.povray (max) (percentage)
454.calculix (max)
454.calculix (max) (percentage)
456.hmmer (max)
456.hmmer (max) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
459.GemsFDTD (max)
459.GemsFDTD (max) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)
464.h264ref (max)
464.h264ref (max) (percentage)
465.tonto (max)
465.tonto (max) (percentage)
470.lbm
470.lbm (avg)
470.lbm (avg) (percentage)
470.lbm (max)
470.lbm (max) (percentage)
471.omnetpp
471.omnetpp (avg)
471.omnetpp (avg) (percentage)
471.omnetpp (max)
471.omnetpp (max) (percentage)
473.astar
473.astar (avg)
473.astar (avg) (percentage)
473.astar (max)
473.astar (max) (percentage)
481.wrf (max)
481.wrf (max) (percentage)
482.sphinx3 (max)
482.sphinx3 (max) (percentage)
483.xalancbmk
483.xalancbmk (avg)
483.xalancbmk (avg) (percentage)
483.xalancbmk (max)
483.xalancbmk (max) (percentage)


Report Time: 0.21s
Name Current %
400.perlbench 1369.000 1.11%
401.bzip2 2675.000 2.41%
403.gcc 51.000 6.25%
410.bwaves 4193.000 4.41%
416.gamess 10455.000 -
429.mcf 1893.000 5.75%
433.milc 1005.000 7.83%
434.zeusmp 1774.000 3.80%
435.gromacs 4940.000 -1.02%
436.cactusADM 1662.000 2.53%
437.leslie3d 6880.000 2.23%
444.namd 627.000 1.46%
445.gobmk 4382.000 -
447.dealII 1011.000 1.51%
450.soplex 544.000 10.34%
453.povray 382.000 1.87%
454.calculix 48.000 -2.04%
456.hmmer 1935.000 -
458.sjeng 6083.000 -
459.GemsFDTD 4310.000 -5.77%
462.libquantum 79.000 -1.25%
464.h264ref 3891.000 -
465.tonto 8563.000 -
470.lbm 3396.000 -6.81%
471.omnetpp 2045.000 -
473.astar 4465.000 -2.64%
481.wrf 2890.000 -3.63%
482.sphinx3 741.000 -3.89%
483.xalancbmk 2734.000 -
Geometric Mean 1612.891 -
Name Current %
400.perlbench 1324165.000 -
401.bzip2 72953.000 -
403.gcc 3929992.000 -
410.bwaves 26143.000 -
416.gamess 8078657.000 -
429.mcf 10100.000 -
433.milc 93945.000 -
434.zeusmp 296597.000 -
435.gromacs 736559.000 -
436.cactusADM 528481.000 -
437.leslie3d 100088.000 -
444.namd 239453.000 1.66%
445.gobmk 1882255.000 -
447.dealII 480882.000 -
450.soplex 326173.000 -
453.povray 1083450.000 -
454.calculix 1148449.000 -
456.hmmer 165317.000 -
458.sjeng 156466.000 -
459.GemsFDTD 376572.000 -
462.libquantum 22168.000 -
464.h264ref 698904.000 -
465.tonto 2786777.000 -
470.lbm 11256.000 -
471.omnetpp 652766.000 -
473.astar 31105.000 -
481.wrf 3968443.000 -
482.sphinx3 157840.000 2.64%
483.xalancbmk 3494090.000 -
Geometric Mean 334602.148 -
Name Current %
400.perlbench (max) 0.000 -
400.perlbench (max) (percentage) 0.000 -
401.bzip2 (max) 0.000 -
401.bzip2 (max) (percentage) 0.000 -
410.bwaves 184.000 -
410.bwaves (avg) 184.000 -
410.bwaves (avg) (percentage) 4.410 -
410.bwaves (max) 184.000 -
410.bwaves (max) (percentage) 4.410 -
410.bwaves (unexplained diff vs previous) 177.000 -
410.bwaves (unexplained diff vs previous) (percentage) 4.220 -
416.gamess (max) 0.000 -
416.gamess (max) (percentage) 0.000 -
429.mcf (max) 0.000 -
429.mcf (max) (percentage) 0.000 -
433.milc (max) 0.000 -
433.milc (max) (percentage) 0.000 -
434.zeusmp (max) 0.000 -
434.zeusmp (max) (percentage) 0.000 -
435.gromacs (max) 0.000 -
435.gromacs (max) (percentage) 0.000 -
436.cactusADM 42.000 -
436.cactusADM (avg) 42.000 -
436.cactusADM (avg) (percentage) 2.530 -
436.cactusADM (max) 42.000 -
436.cactusADM (max) (percentage) 2.530 -
436.cactusADM (unexplained diff vs previous) 41.000 -
436.cactusADM (unexplained diff vs previous) (percentage) 2.470 -
437.leslie3d 153.000 -
437.leslie3d (avg) 153.000 -
437.leslie3d (avg) (percentage) 2.230 -
437.leslie3d (max) 153.000 -
437.leslie3d (max) (percentage) 2.230 -
437.leslie3d (unexplained diff vs previous) 150.000 -
437.leslie3d (unexplained diff vs previous) (percentage) 2.180 -
444.namd (max) 0.000 -
444.namd (max) (percentage) 0.000 -
445.gobmk (max) 0.000 -
445.gobmk (max) (percentage) 0.000 -
447.dealII (max) 0.000 -
447.dealII (max) (percentage) 0.000 -
450.soplex 56.000 -
450.soplex (avg) 56.000 -
450.soplex (avg) (percentage) 10.340 -
450.soplex (max) 56.000 -
450.soplex (max) (percentage) 10.340 -
450.soplex (unexplained diff vs previous) 51.000 -
450.soplex (unexplained diff vs previous) (percentage) 9.380 -
453.povray (max) 0.000 -
453.povray (max) (percentage) 0.000 -
454.calculix (max) 0.000 -
454.calculix (max) (percentage) 0.000 -
456.hmmer (max) 0.000 -
456.hmmer (max) (percentage) 0.000 -
458.sjeng (max) 0.000 -
458.sjeng (max) (percentage) 0.000 -
459.GemsFDTD (max) 0.000 -
459.GemsFDTD (max) (percentage) 0.000 -
462.libquantum 0.000 -
462.libquantum (avg) 0.000 -
462.libquantum (avg) (percentage) 1.250 -
462.libquantum (max) 0.000 -
462.libquantum (max) (percentage) 1.250 -
462.libquantum (unexplained diff vs previous) 1.000 -
462.libquantum (unexplained diff vs previous) (percentage) 1.270 -
464.h264ref (max) 0.000 -
464.h264ref (max) (percentage) 0.000 -
465.tonto (max) 0.000 -
465.tonto (max) (percentage) 0.000 -
470.lbm 231.000 -
470.lbm (avg) 231.000 -
470.lbm (avg) (percentage) 6.810 -
470.lbm (max) 231.000 -
470.lbm (max) (percentage) 6.810 -
470.lbm (unexplained diff vs previous) 248.000 -
470.lbm (unexplained diff vs previous) (percentage) 7.300 -
471.omnetpp 11.000 -
471.omnetpp (avg) 11.000 -
471.omnetpp (avg) (percentage) 0.580 -
471.omnetpp (max) 11.000 -
471.omnetpp (max) (percentage) 0.580 -
471.omnetpp (unexplained diff vs previous) 12.000 -
471.omnetpp (unexplained diff vs previous) (percentage) 0.590 -
473.astar 117.000 -
473.astar (avg) 117.000 -
473.astar (avg) (percentage) 2.640 -
473.astar (max) 117.000 -
473.astar (max) (percentage) 2.640 -
473.astar (unexplained diff vs previous) 121.000 -
473.astar (unexplained diff vs previous) (percentage) 2.710 -
481.wrf (max) 0.000 -
481.wrf (max) (percentage) 0.000 -
482.sphinx3 (max) 0.000 -
482.sphinx3 (max) (percentage) 0.000 -
483.xalancbmk 15.000 -
483.xalancbmk (avg) 15.000 -
483.xalancbmk (avg) (percentage) 0.580 -
483.xalancbmk (max) 15.000 -
483.xalancbmk (max) (percentage) 0.580 -
483.xalancbmk (unexplained diff vs previous) 16.000 -
483.xalancbmk (unexplained diff vs previous) (percentage) 0.590 -
Geometric Mean 0.111 273933160634939965440.00%