Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=9213a6d79a64446de3c176773f123d1f8b9311b4 (+ 27 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/fdc5abbdcfb65d415af6c40230f8f07872e51e49 (+ 36 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=5476f8cd2e68800a705e80f568599e1a38facd93 (+ 33 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=773e23b4ee1ad9cd0502d3969e2f2598b1ccc6fe (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_vect-spec2k6--gnu-aarch64-master-O3_LTO-build/9/
Filter

gnu-aarch64-master-O3_LTO test results

Run Order Start Time Duration
Current 0009 (3-changed-components) 2023-04-01T02:47:06 0:00:00
Previous 0009 (3-changed-components) 2023-04-01T02:47:06 0:00:00
Baseline 0001 (4-changed-components) 2023-03-08T03:13:34 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 0 20
Performance Improvements 0 4
Added Tests 0 147
Unchanged Tests 1236 1065
Total Tests 1236

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
403.gcc 10.42% 48.000 53.000 - 0.00% -
450.soplex 10.34% 493.000 544.000 - 0.00% -
437.leslie3d 8.63% 6730.000 7311.000 - 0.00% -
401.bzip2 5.67% 2612.000 2760.000 - 0.00% -
410.bwaves 4.43% 4016.000 4194.000 - 0.00% -
454.calculix 4.08% 49.000 51.000 - 0.00% -
445.gobmk 3.83% 4363.000 4530.000 - 0.00% -
462.libquantum 3.75% 80.000 83.000 - 0.00% -
434.zeusmp 3.34% 1709.000 1766.000 - 0.00% -
435.gromacs 2.87% 4991.000 5134.000 - 0.00% -
433.milc 2.79% 932.000 958.000 - 0.00% -
483.xalancbmk 2.73% 2750.000 2825.000 - 0.00% -
465.tonto 2.54% 8627.000 8846.000 - 0.00% -
400.perlbench 2.51% 1354.000 1388.000 - 0.00% -
453.povray 2.40% 375.000 384.000 - 0.00% -
473.astar 2.38% 4586.000 4695.000 - 0.00% -
444.namd 2.27% 618.000 632.000 - 0.00% -
481.wrf 2.17% 2999.000 3064.000 - 0.00% -
471.omnetpp 1.85% 2057.000 2095.000 - 0.00% -
458.sjeng 1.39% 6134.000 6219.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
429.mcf -20.28% 1790.000 1427.000 - 0.00% -
470.lbm -3.81% 3644.000 3505.000 - 0.00% -
436.cactusADM -2.71% 1621.000 1577.000 - 0.00% -
459.GemsFDTD -2.67% 4574.000 4452.000 - 0.00% -

Added Tests - sample variability
400.perlbench
400.perlbench (avg)
400.perlbench (avg) (percentage)
400.perlbench (max)
400.perlbench (max) (percentage)
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
403.gcc
403.gcc (avg)
403.gcc (avg) (percentage)
403.gcc (max)
403.gcc (max) (percentage)
403.gcc (unexplained diff vs previous)
403.gcc (unexplained diff vs previous) (percentage)
410.bwaves
410.bwaves (avg)
410.bwaves (avg) (percentage)
410.bwaves (max)
410.bwaves (max) (percentage)
416.gamess
416.gamess (avg)
416.gamess (avg) (percentage)
416.gamess (max)
416.gamess (max) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
433.milc
433.milc (avg)
433.milc (avg) (percentage)
433.milc (max)
433.milc (max) (percentage)
434.zeusmp
434.zeusmp (avg)
434.zeusmp (avg) (percentage)
434.zeusmp (max)
434.zeusmp (max) (percentage)
435.gromacs
435.gromacs (avg)
435.gromacs (avg) (percentage)
435.gromacs (max)
435.gromacs (max) (percentage)
436.cactusADM
436.cactusADM (avg)
436.cactusADM (avg) (percentage)
436.cactusADM (max)
436.cactusADM (max) (percentage)
437.leslie3d
437.leslie3d (avg)
437.leslie3d (avg) (percentage)
437.leslie3d (max)
437.leslie3d (max) (percentage)
444.namd
444.namd (avg)
444.namd (avg) (percentage)
444.namd (max)
444.namd (max) (percentage)
445.gobmk
445.gobmk (avg)
445.gobmk (avg) (percentage)
445.gobmk (max)
445.gobmk (max) (percentage)
447.dealII
447.dealII (avg)
447.dealII (avg) (percentage)
447.dealII (max)
447.dealII (max) (percentage)
450.soplex
450.soplex (avg)
450.soplex (avg) (percentage)
450.soplex (max)
450.soplex (max) (percentage)
453.povray
453.povray (avg)
453.povray (avg) (percentage)
453.povray (max)
453.povray (max) (percentage)
454.calculix
454.calculix (avg)
454.calculix (avg) (percentage)
454.calculix (max)
454.calculix (max) (percentage)
456.hmmer
456.hmmer (avg)
456.hmmer (avg) (percentage)
456.hmmer (max)
456.hmmer (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
459.GemsFDTD
459.GemsFDTD (avg)
459.GemsFDTD (avg) (percentage)
459.GemsFDTD (max)
459.GemsFDTD (max) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)
464.h264ref
464.h264ref (avg)
464.h264ref (avg) (percentage)
464.h264ref (max)
464.h264ref (max) (percentage)
465.tonto
465.tonto (avg)
465.tonto (avg) (percentage)
465.tonto (max)
465.tonto (max) (percentage)
470.lbm
470.lbm (avg)
470.lbm (avg) (percentage)
470.lbm (max)
470.lbm (max) (percentage)
471.omnetpp
471.omnetpp (avg)
471.omnetpp (avg) (percentage)
471.omnetpp (max)
471.omnetpp (max) (percentage)
473.astar
473.astar (avg)
473.astar (avg) (percentage)
473.astar (max)
473.astar (max) (percentage)
481.wrf
481.wrf (avg)
481.wrf (avg) (percentage)
481.wrf (max)
481.wrf (max) (percentage)
482.sphinx3
482.sphinx3 (avg)
482.sphinx3 (avg) (percentage)
482.sphinx3 (max)
482.sphinx3 (max) (percentage)
483.xalancbmk
483.xalancbmk (avg)
483.xalancbmk (avg) (percentage)
483.xalancbmk (max)
483.xalancbmk (max) (percentage)


Report Time: 0.34s
Name Current %
400.perlbench 1388.000 -
401.bzip2 2760.000 -
403.gcc 53.000 -
410.bwaves 4194.000 -
416.gamess 10447.000 -
429.mcf 1427.000 -
433.milc 958.000 -
434.zeusmp 1766.000 -
435.gromacs 5134.000 -
436.cactusADM 1577.000 -
437.leslie3d 7311.000 -
444.namd 632.000 -
445.gobmk 4530.000 -
447.dealII 998.000 -
450.soplex 544.000 -
453.povray 384.000 -
454.calculix 51.000 -
456.hmmer 1959.000 -
458.sjeng 6219.000 -
459.GemsFDTD 4452.000 -
462.libquantum 83.000 -
464.h264ref 3950.000 -
465.tonto 8846.000 -
470.lbm 3505.000 -
471.omnetpp 2095.000 -
473.astar 4695.000 -
481.wrf 3064.000 -
482.sphinx3 773.000 -
483.xalancbmk 2825.000 -
Geometric Mean 1629.220 -
Name Current %
400.perlbench 1333768.000 -
401.bzip2 72953.000 -
403.gcc 3922572.000 -
410.bwaves 26135.000 -
416.gamess 8051637.000 -
429.mcf 10088.000 -
433.milc 93737.000 -
434.zeusmp 296797.000 -
435.gromacs 737187.000 -
436.cactusADM 528353.000 -
437.leslie3d 100088.000 -
444.namd 235229.000 -
445.gobmk 1873295.000 -
447.dealII 476112.000 -
450.soplex 326312.000 -
453.povray 1077314.000 -
454.calculix 1143852.000 -
456.hmmer 165277.000 -
458.sjeng 156466.000 -
459.GemsFDTD 377384.000 -
462.libquantum 22168.000 -
464.h264ref 701096.000 -
465.tonto 2782344.000 -
470.lbm 11256.000 -
471.omnetpp 652744.000 -
473.astar 31105.000 -
481.wrf 3964998.000 -
482.sphinx3 153656.000 -
483.xalancbmk 3493890.000 -
Geometric Mean 333834.400 -
Name Current %
400.perlbench 32.000 -
400.perlbench (avg) 32.000 -
400.perlbench (avg) (percentage) 2.310 -
400.perlbench (max) 40.000 -
400.perlbench (max) (percentage) 2.920 -
401.bzip2 32.000 -
401.bzip2 (avg) 32.000 -
401.bzip2 (avg) (percentage) 1.180 -
401.bzip2 (max) 57.000 -
401.bzip2 (max) (percentage) 2.070 -
401.bzip2 (unexplained diff vs previous) 56.000 -
401.bzip2 (unexplained diff vs previous) (percentage) 2.030 -
403.gcc 1.000 -
403.gcc (avg) 1.000 -
403.gcc (avg) (percentage) 2.970 -
403.gcc (max) 4.000 -
403.gcc (max) (percentage) 7.820 -
403.gcc (unexplained diff vs previous) 1.000 -
403.gcc (unexplained diff vs previous) (percentage) 1.890 -
410.bwaves 59.000 -
410.bwaves (avg) 59.000 -
410.bwaves (avg) (percentage) 1.410 -
410.bwaves (max) 99.000 -
410.bwaves (max) (percentage) 2.380 -
410.bwaves (unexplained diff vs previous) 33.000 -
410.bwaves (unexplained diff vs previous) (percentage) 0.790 -
416.gamess 12.000 -
416.gamess (avg) 12.000 -
416.gamess (avg) (percentage) 0.120 -
416.gamess (max) 14.000 -
416.gamess (max) (percentage) 0.140 -
429.mcf 15.000 -
429.mcf (avg) 15.000 -
429.mcf (avg) (percentage) 1.090 -
429.mcf (max) 56.000 -
429.mcf (max) (percentage) 3.960 -
429.mcf (unexplained diff vs previous) 13.000 -
429.mcf (unexplained diff vs previous) (percentage) 0.910 -
433.milc 13.000 -
433.milc (avg) 13.000 -
433.milc (avg) (percentage) 1.390 -
433.milc (max) 43.000 -
433.milc (max) (percentage) 4.540 -
433.milc (unexplained diff vs previous) 6.000 -
433.milc (unexplained diff vs previous) (percentage) 0.630 -
434.zeusmp 11.000 -
434.zeusmp (avg) 11.000 -
434.zeusmp (avg) (percentage) 0.650 -
434.zeusmp (max) 37.000 -
434.zeusmp (max) (percentage) 2.150 -
434.zeusmp (unexplained diff vs previous) 5.000 -
434.zeusmp (unexplained diff vs previous) (percentage) 0.280 -
435.gromacs 79.000 -
435.gromacs (avg) 79.000 -
435.gromacs (avg) (percentage) 1.540 -
435.gromacs (max) 121.000 -
435.gromacs (max) (percentage) 2.360 -
435.gromacs (unexplained diff vs previous) 124.000 -
435.gromacs (unexplained diff vs previous) (percentage) 2.420 -
436.cactusADM 11.000 -
436.cactusADM (avg) 11.000 -
436.cactusADM (avg) (percentage) 0.740 -
436.cactusADM (max) 32.000 -
436.cactusADM (max) (percentage) 2.030 -
436.cactusADM (unexplained diff vs previous) 13.000 -
436.cactusADM (unexplained diff vs previous) (percentage) 0.820 -
437.leslie3d 302.000 -
437.leslie3d (avg) 302.000 -
437.leslie3d (avg) (percentage) 4.140 -
437.leslie3d (max) 462.000 -
437.leslie3d (max) (percentage) 6.330 -
437.leslie3d (unexplained diff vs previous) 435.000 -
437.leslie3d (unexplained diff vs previous) (percentage) 5.950 -
444.namd 4.000 -
444.namd (avg) 4.000 -
444.namd (avg) (percentage) 0.660 -
444.namd (max) 4.000 -
444.namd (max) (percentage) 0.730 -
444.namd (unexplained diff vs previous) 4.000 -
444.namd (unexplained diff vs previous) (percentage) 0.630 -
445.gobmk 9.000 -
445.gobmk (avg) 9.000 -
445.gobmk (avg) (percentage) 0.220 -
445.gobmk (max) 9.000 -
445.gobmk (max) (percentage) 0.200 -
447.dealII 10.000 -
447.dealII (avg) 10.000 -
447.dealII (avg) (percentage) 1.010 -
447.dealII (max) 9.000 -
447.dealII (max) (percentage) 0.990 -
447.dealII (unexplained diff vs previous) 5.000 -
447.dealII (unexplained diff vs previous) (percentage) 0.500 -
450.soplex 13.000 -
450.soplex (avg) 13.000 -
450.soplex (avg) (percentage) 2.400 -
450.soplex (max) 31.000 -
450.soplex (max) (percentage) 5.820 -
450.soplex (unexplained diff vs previous) 12.000 -
450.soplex (unexplained diff vs previous) (percentage) 2.210 -
453.povray 4.000 -
453.povray (avg) 4.000 -
453.povray (avg) (percentage) 1.220 -
453.povray (max) 7.000 -
453.povray (max) (percentage) 1.880 -
454.calculix 1.000 -
454.calculix (avg) 1.000 -
454.calculix (avg) (percentage) 2.880 -
454.calculix (max) 1.000 -
454.calculix (max) (percentage) 2.990 -
456.hmmer 13.000 -
456.hmmer (avg) 13.000 -
456.hmmer (avg) (percentage) 0.670 -
456.hmmer (max) 23.000 -
456.hmmer (max) (percentage) 1.220 -
456.hmmer (unexplained diff vs previous) 9.000 -
456.hmmer (unexplained diff vs previous) (percentage) 0.460 -
458.sjeng 57.000 -
458.sjeng (avg) 57.000 -
458.sjeng (avg) (percentage) 0.930 -
458.sjeng (max) 128.000 -
458.sjeng (max) (percentage) 2.060 -
458.sjeng (unexplained diff vs previous) 24.000 -
458.sjeng (unexplained diff vs previous) (percentage) 0.390 -
459.GemsFDTD 141.000 -
459.GemsFDTD (avg) 141.000 -
459.GemsFDTD (avg) (percentage) 3.180 -
459.GemsFDTD (max) 185.000 -
459.GemsFDTD (max) (percentage) 4.160 -
459.GemsFDTD (unexplained diff vs previous) 90.000 -
459.GemsFDTD (unexplained diff vs previous) (percentage) 2.020 -
462.libquantum 2.000 -
462.libquantum (avg) 2.000 -
462.libquantum (avg) (percentage) 2.620 -
462.libquantum (max) 5.000 -
462.libquantum (max) (percentage) 6.150 -
462.libquantum (unexplained diff vs previous) 1.000 -
462.libquantum (unexplained diff vs previous) (percentage) 1.200 -
464.h264ref 20.000 -
464.h264ref (avg) 20.000 -
464.h264ref (avg) (percentage) 0.520 -
464.h264ref (max) 26.000 -
464.h264ref (max) (percentage) 0.680 -
464.h264ref (unexplained diff vs previous) 25.000 -
464.h264ref (unexplained diff vs previous) (percentage) 0.630 -
465.tonto 55.000 -
465.tonto (avg) 55.000 -
465.tonto (avg) (percentage) 0.630 -
465.tonto (max) 104.000 -
465.tonto (max) (percentage) 1.180 -
470.lbm 66.000 -
470.lbm (avg) 66.000 -
470.lbm (avg) (percentage) 1.900 -
470.lbm (max) 134.000 -
470.lbm (max) (percentage) 3.830 -
470.lbm (unexplained diff vs previous) 3.000 -
470.lbm (unexplained diff vs previous) (percentage) 0.090 -
471.omnetpp 38.000 -
471.omnetpp (avg) 38.000 -
471.omnetpp (avg) (percentage) 1.860 -
471.omnetpp (max) 58.000 -
471.omnetpp (max) (percentage) 2.770 -
471.omnetpp (unexplained diff vs previous) 35.000 -
471.omnetpp (unexplained diff vs previous) (percentage) 1.670 -
473.astar 90.000 -
473.astar (avg) 90.000 -
473.astar (avg) (percentage) 1.920 -
473.astar (max) 160.000 -
473.astar (max) (percentage) 3.420 -
473.astar (unexplained diff vs previous) 46.000 -
473.astar (unexplained diff vs previous) (percentage) 0.980 -
481.wrf 70.000 -
481.wrf (avg) 70.000 -
481.wrf (avg) (percentage) 2.310 -
481.wrf (max) 80.000 -
481.wrf (max) (percentage) 2.620 -
482.sphinx3 10.000 -
482.sphinx3 (avg) 10.000 -
482.sphinx3 (avg) (percentage) 1.410 -
482.sphinx3 (max) 20.000 -
482.sphinx3 (max) (percentage) 2.630 -
482.sphinx3 (unexplained diff vs previous) 2.000 -
482.sphinx3 (unexplained diff vs previous) (percentage) 0.260 -
483.xalancbmk 16.000 -
483.xalancbmk (avg) 16.000 -
483.xalancbmk (avg) (percentage) 0.580 -
483.xalancbmk (max) 21.000 -
483.xalancbmk (max) (percentage) 0.750 -
483.xalancbmk (unexplained diff vs previous) 21.000 -
483.xalancbmk (unexplained diff vs previous) (percentage) 0.740 -
Geometric Mean 6.346 -