Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=c2f55040d34784a5c40d25f6a58615da1b4a52be (unchanged)
git_gcc https://gcc.gnu.org/git/gcc.git (3b1cf36eb47e217b6f093abd9f76ea358d456e2e) (+ 1275 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=70b648855185e967e54668b101d24704c3fb869d (unchanged)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/dfc5f6de47b62aa45150d0b9ef1ffda99bb5112a (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_vect-spec2k6--gnu-aarch64-master-O3_LTO-build/376/
Filter

gnu-aarch64-master-O3_LTO test results

Run Order Start Time Duration
Current 0376 (basepoints/gcc-15-09260-g3b1cf36eb47) 2025-04-05T09:02:54 0:00:00
Previous 0375 (basepoints/gcc-15-07985-g855b61b61e6) 2025-04-03T02:57:24 0:00:00
Baseline 0001 (4-changed-components) 2023-03-08T03:13:34 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 19 18
Performance Improvements 44 16
Added Tests 0 118
Unchanged Tests 1053 964
Total Tests 1116

Performance Regressions - Code Size Δ Previous Current σ Δ (B) σ (B)
458.sjeng 2.75% 154550.000 158794.000 - 1.44% -
434.zeusmp 1.89% 298815.000 304467.000 - 2.65% -
459.GemsFDTD 1.31% 356362.000 361034.000 - -4.13% -

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
437.leslie3d 6.60% 6125.000 6529.000 - -2.99% -
462.libquantum 2.82% 71.000 73.000 - -8.75% -
453.povray 2.23% 358.000 366.000 - -2.40% -
458.sjeng 1.55% 5929.000 6021.000 - -1.84% -
447.dealII 1.22% 981.000 993.000 - -0.30% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
447.dealII 7.69% 13.000 14.000 - 0.00% -
447.dealII (avg) 7.69% 13.000 14.000 - 0.00% -
482.sphinx3 7.69% 13.000 14.000 - 0.00% -
482.sphinx3 (avg) 7.69% 13.000 14.000 - 0.00% -
437.leslie3d 6.82% 264.000 282.000 - 0.00% -
437.leslie3d (avg) 6.82% 264.000 282.000 - 0.00% -
437.leslie3d (max) 3.25% 154.000 159.000 - 0.00% -
458.sjeng 2.86% 35.000 36.000 - 0.00% -
458.sjeng (avg) 2.86% 35.000 36.000 - 0.00% -
459.GemsFDTD 1.47% 68.000 69.000 - 0.00% -
459.GemsFDTD (avg) 1.47% 68.000 69.000 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
471.omnetpp -1.20% 2077.000 2052.000 - -0.24% -
445.gobmk -1.02% 4395.000 4350.000 - -0.30% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
470.lbm (unexplained diff vs previous) -96.15% 26.000 1.000 - 0.00% -
470.lbm (unexplained diff vs previous) (percentage) -96.10% 0.770 0.030 - 0.00% -
470.lbm (max) -66.67% 63.000 21.000 - 0.00% -
470.lbm (max) (percentage) -65.79% 1.900 0.650 - 0.00% -
453.povray (max) -12.50% 8.000 7.000 - 0.00% -
445.gobmk (max) -6.25% 64.000 60.000 - 0.00% -
453.povray (max) (percentage) -6.19% 2.260 2.120 - 0.00% -
410.bwaves (max) -5.88% 102.000 96.000 - 0.00% -
450.soplex (max) -5.88% 17.000 16.000 - 0.00% -
471.omnetpp (max) -5.45% 55.000 52.000 - 0.00% -
473.astar (max) -5.06% 178.000 169.000 - 0.00% -
410.bwaves (max) (percentage) -4.87% 2.670 2.540 - 0.00% -
429.mcf (max) (percentage) -4.86% 7.200 6.850 - 0.00% -
473.astar (max) (percentage) -4.84% 4.130 3.930 - 0.00% -
471.omnetpp (max) (percentage) -4.83% 2.690 2.560 - 0.00% -
445.gobmk (max) (percentage) -4.79% 1.460 1.390 - 0.00% -
433.milc (max) (percentage) -4.71% 2.760 2.630 - 0.00% -
458.sjeng (max) (percentage) -4.71% 0.850 0.810 - 0.00% -
462.libquantum (max) (percentage) -4.62% 5.200 4.960 - 0.00% -
429.mcf (max) -4.58% 131.000 125.000 - 0.00% -
459.GemsFDTD (max) (percentage) -4.58% 3.060 2.920 - 0.00% -
482.sphinx3 (max) (percentage) -4.43% 3.840 3.670 - 0.00% -
482.sphinx3 (max) -4.17% 24.000 23.000 - 0.00% -
450.soplex (max) (percentage) -4.05% 3.460 3.320 - 0.00% -
458.sjeng (max) -4.00% 50.000 48.000 - 0.00% -
401.bzip2 (max) (percentage) -3.89% 3.340 3.210 - 0.00% -
444.namd (max) (percentage) -3.85% 1.560 1.500 - 0.00% -
433.milc (max) -3.85% 26.000 25.000 - 0.00% -
459.GemsFDTD (max) -3.76% 133.000 128.000 - 0.00% -
465.tonto (max) (percentage) -3.21% 2.180 2.110 - 0.00% -
437.leslie3d (max) (percentage) -3.16% 2.530 2.450 - 0.00% -
435.gromacs (max) (percentage) -3.08% 2.920 2.830 - 0.00% -
447.dealII (max) (percentage) -2.99% 3.680 3.570 - 0.00% -
447.dealII (max) -2.78% 36.000 35.000 - 0.00% -
434.zeusmp (max) (percentage) -2.72% 2.570 2.500 - 0.00% -
465.tonto (max) -2.69% 186.000 181.000 - 0.00% -
401.bzip2 (max) -2.33% 86.000 84.000 - 0.00% -
434.zeusmp (max) -2.27% 44.000 43.000 - 0.00% -
435.gromacs (max) -2.14% 140.000 137.000 - 0.00% -
410.bwaves -1.79% 56.000 55.000 - 0.00% -
410.bwaves (avg) -1.79% 56.000 55.000 - 0.00% -
470.lbm (avg) (percentage) -1.69% 1.180 1.160 - 0.00% -

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
470.lbm 34.04% 11256.000 15088.000 - 0.00% -
444.namd 20.26% 235533.000 283254.000 - -0.14% -
429.mcf 8.43% 10100.000 10951.000 - 0.00% -
437.leslie3d 4.93% 100088.000 105021.000 - 0.01% -
410.bwaves 4.56% 26143.000 27335.000 - 0.46% -
445.gobmk 3.80% 1878607.000 1949931.000 - -0.21% -
482.sphinx3 3.38% 153776.000 158967.000 - -0.01% -
450.soplex 3.36% 326173.000 337146.000 - -0.16% -
465.tonto 2.67% 2795025.000 2869736.000 - 0.34% -
434.zeusmp 2.65% 296597.000 304467.000 - 1.89% -
453.povray 2.59% 1083050.000 1111105.000 - 0.03% -
471.omnetpp 1.78% 652766.000 664375.000 - 0.05% -
458.sjeng 1.44% 156546.000 158794.000 - 2.75% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
433.milc 3.22% 932.000 962.000 - -0.52% -
429.mcf 1.96% 1790.000 1825.000 - -0.05% -
434.zeusmp 1.35% 1709.000 1732.000 - -0.69% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -31.03% 29.000 20.000 - 0.00% -
nb_execution_successful -31.03% 29.000 20.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
459.GemsFDTD -4.13% 376580.000 361034.000 - 1.31% -
462.libquantum -2.54% 22168.000 21604.000 - 0.00% -
473.astar -2.51% 31105.000 30325.000 - -0.11% -
435.gromacs -1.55% 736591.000 725161.000 - -0.01% -
447.dealII -1.41% 480818.000 474042.000 - 0.04% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
482.sphinx3 -16.08% 771.000 647.000 - 0.78% -
462.libquantum -8.75% 80.000 73.000 - 2.82% -
470.lbm -7.60% 3644.000 3367.000 - 0.03% -
473.astar -5.91% 4586.000 4315.000 - -0.35% -
410.bwaves -4.93% 4016.000 3818.000 - -0.47% -
459.GemsFDTD -3.83% 4574.000 4399.000 - 0.87% -
437.leslie3d -2.99% 6730.000 6529.000 - 6.60% -
435.gromacs -2.87% 4991.000 4848.000 - 0.66% -
453.povray -2.40% 375.000 366.000 - 2.23% -
458.sjeng -1.84% 6134.000 6021.000 - 1.55% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 31.03% 29.000 38.000 - 0.00% -

Added Tests - sample variability
400.perlbench (avg) (percentage)
400.perlbench (max) (percentage)
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
403.gcc (avg) (percentage)
403.gcc (max) (percentage)
410.bwaves
410.bwaves (avg)
410.bwaves (avg) (percentage)
410.bwaves (max)
410.bwaves (max) (percentage)
416.gamess (avg) (percentage)
416.gamess (max) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
433.milc
433.milc (avg)
433.milc (avg) (percentage)
433.milc (max)
433.milc (max) (percentage)
434.zeusmp
434.zeusmp (avg)
434.zeusmp (avg) (percentage)
434.zeusmp (max)
434.zeusmp (max) (percentage)
435.gromacs
435.gromacs (avg)
435.gromacs (avg) (percentage)
435.gromacs (max)
435.gromacs (max) (percentage)
436.cactusADM (avg) (percentage)
436.cactusADM (max) (percentage)
437.leslie3d
437.leslie3d (avg)
437.leslie3d (avg) (percentage)
437.leslie3d (max)
437.leslie3d (max) (percentage)
444.namd
444.namd (avg)
444.namd (avg) (percentage)
444.namd (max)
444.namd (max) (percentage)
445.gobmk
445.gobmk (avg)
445.gobmk (avg) (percentage)
445.gobmk (max)
445.gobmk (max) (percentage)
447.dealII
447.dealII (avg)
447.dealII (avg) (percentage)
447.dealII (max)
447.dealII (max) (percentage)
450.soplex
450.soplex (avg)
450.soplex (avg) (percentage)
450.soplex (max)
450.soplex (max) (percentage)
453.povray
453.povray (avg)
453.povray (avg) (percentage)
453.povray (max)
453.povray (max) (percentage)
454.calculix (avg) (percentage)
454.calculix (max) (percentage)
456.hmmer (avg) (percentage)
456.hmmer (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
459.GemsFDTD
459.GemsFDTD (avg)
459.GemsFDTD (avg) (percentage)
459.GemsFDTD (max)
459.GemsFDTD (max) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)
464.h264ref (avg) (percentage)
464.h264ref (max) (percentage)
465.tonto
465.tonto (avg)
465.tonto (avg) (percentage)
465.tonto (max)
465.tonto (max) (percentage)
470.lbm
470.lbm (avg)
470.lbm (avg) (percentage)
470.lbm (max)
470.lbm (max) (percentage)
471.omnetpp
471.omnetpp (avg)
471.omnetpp (avg) (percentage)
471.omnetpp (max)
471.omnetpp (max) (percentage)
473.astar
473.astar (avg)
473.astar (avg) (percentage)
473.astar (max)
473.astar (max) (percentage)
481.wrf (avg) (percentage)
481.wrf (max) (percentage)
482.sphinx3
482.sphinx3 (avg)
482.sphinx3 (avg) (percentage)
482.sphinx3 (max)
482.sphinx3 (max) (percentage)
483.xalancbmk (avg) (percentage)
483.xalancbmk (max) (percentage)


Report Time: 0.35s
Name Current %
401.bzip2 2618.000 -
410.bwaves 3818.000 -
429.mcf 1825.000 -
433.milc 962.000 -
434.zeusmp 1732.000 -
435.gromacs 4848.000 -
437.leslie3d 6529.000 6.60%
444.namd 620.000 -
445.gobmk 4350.000 -1.02%
447.dealII 993.000 1.22%
450.soplex 496.000 -
453.povray 366.000 2.23%
458.sjeng 6021.000 1.55%
459.GemsFDTD 4399.000 -
462.libquantum 73.000 2.82%
465.tonto 8617.000 -
470.lbm 3367.000 -
471.omnetpp 2052.000 -1.20%
473.astar 4315.000 -
482.sphinx3 647.000 -
Geometric Mean 1814.889 -
Name Current %
401.bzip2 72389.000 -
410.bwaves 27335.000 -
429.mcf 10951.000 -
433.milc 93884.000 -
434.zeusmp 304467.000 1.89%
435.gromacs 725161.000 -
437.leslie3d 105021.000 -
444.namd 283254.000 -
445.gobmk 1949931.000 -
447.dealII 474042.000 -
450.soplex 337146.000 -
453.povray 1111105.000 -
458.sjeng 158794.000 2.75%
459.GemsFDTD 361034.000 1.31%
462.libquantum 21604.000 -
465.tonto 2869736.000 -
470.lbm 15088.000 -
471.omnetpp 664375.000 -
473.astar 30325.000 -
482.sphinx3 158967.000 -
Geometric Mean 175796.088 -
Name Current %
400.perlbench (avg) (percentage) 2.510 -
400.perlbench (max) (percentage) 2.190 -
401.bzip2 36.000 -
401.bzip2 (avg) 36.000 -
401.bzip2 (avg) (percentage) 1.390 -
401.bzip2 (max) 84.000 -2.33%
401.bzip2 (max) (percentage) 3.210 -3.89%
403.gcc (avg) (percentage) 5.640 -
403.gcc (max) (percentage) 7.220 -
410.bwaves 55.000 -1.79%
410.bwaves (avg) 55.000 -1.79%
410.bwaves (avg) (percentage) 1.460 -
410.bwaves (max) 96.000 -5.88%
410.bwaves (max) (percentage) 2.540 -4.87%
416.gamess (avg) (percentage) 0.250 -
416.gamess (max) (percentage) 0.160 -
429.mcf 73.000 -
429.mcf (avg) 73.000 -
429.mcf (avg) (percentage) 4.010 -
429.mcf (max) 125.000 -4.58%
429.mcf (max) (percentage) 6.850 -4.86%
433.milc 13.000 -
433.milc (avg) 13.000 -
433.milc (avg) (percentage) 1.440 -
433.milc (max) 25.000 -3.85%
433.milc (max) (percentage) 2.630 -4.71%
434.zeusmp 17.000 -
434.zeusmp (avg) 17.000 -
434.zeusmp (avg) (percentage) 1.020 -
434.zeusmp (max) 43.000 -2.27%
434.zeusmp (max) (percentage) 2.500 -2.72%
435.gromacs 117.000 -
435.gromacs (avg) 117.000 -
435.gromacs (avg) (percentage) 2.420 -
435.gromacs (max) 137.000 -2.14%
435.gromacs (max) (percentage) 2.830 -3.08%
436.cactusADM (avg) (percentage) 0.990 -
436.cactusADM (max) (percentage) 1.590 -
437.leslie3d 282.000 6.82%
437.leslie3d (avg) 282.000 6.82%
437.leslie3d (avg) (percentage) 4.320 -
437.leslie3d (max) 159.000 3.25%
437.leslie3d (max) (percentage) 2.450 -3.16%
444.namd 6.000 -
444.namd (avg) 6.000 -
444.namd (avg) (percentage) 1.040 -
444.namd (max) 9.000 -
444.namd (max) (percentage) 1.500 -3.85%
445.gobmk 48.000 -
445.gobmk (avg) 48.000 -
445.gobmk (avg) (percentage) 1.110 -
445.gobmk (max) 60.000 -6.25%
445.gobmk (max) (percentage) 1.390 -4.79%
447.dealII 14.000 7.69%
447.dealII (avg) 14.000 7.69%
447.dealII (avg) (percentage) 1.410 -
447.dealII (max) 35.000 -2.78%
447.dealII (max) (percentage) 3.570 -2.99%
450.soplex 14.000 -
450.soplex (avg) 14.000 -
450.soplex (avg) (percentage) 2.950 -
450.soplex (max) 16.000 -5.88%
450.soplex (max) (percentage) 3.320 -4.05%
453.povray 5.000 -
453.povray (avg) 5.000 -
453.povray (avg) (percentage) 1.510 -
453.povray (max) 7.000 -12.50%
453.povray (max) (percentage) 2.120 -6.19%
454.calculix (avg) (percentage) 3.100 -
454.calculix (max) (percentage) 2.940 -
456.hmmer (avg) (percentage) 0.780 -
456.hmmer (max) (percentage) 1.180 -
458.sjeng 36.000 2.86%
458.sjeng (avg) 36.000 2.86%
458.sjeng (avg) (percentage) 0.600 -
458.sjeng (max) 48.000 -4.00%
458.sjeng (max) (percentage) 0.810 -4.71%
459.GemsFDTD 69.000 1.47%
459.GemsFDTD (avg) 69.000 1.47%
459.GemsFDTD (avg) (percentage) 1.580 -
459.GemsFDTD (max) 128.000 -3.76%
459.GemsFDTD (max) (percentage) 2.920 -4.58%
462.libquantum 2.000 -
462.libquantum (avg) 2.000 -
462.libquantum (avg) (percentage) 3.160 -
462.libquantum (max) 3.000 -
462.libquantum (max) (percentage) 4.960 -4.62%
464.h264ref (avg) (percentage) 0.730 -
464.h264ref (max) (percentage) 1.660 -
465.tonto 104.000 -
465.tonto (avg) 104.000 -
465.tonto (avg) (percentage) 1.210 -
465.tonto (max) 181.000 -2.69%
465.tonto (max) (percentage) 2.110 -3.21%
470.lbm 39.000 -
470.lbm (avg) 39.000 -
470.lbm (avg) (percentage) 1.160 -1.69%
470.lbm (max) 21.000 -66.67%
470.lbm (max) (percentage) 0.650 -65.79%
470.lbm (unexplained diff vs previous) 1.000 -96.15%
470.lbm (unexplained diff vs previous) (percentage) 0.030 -96.10%
471.omnetpp 39.000 -
471.omnetpp (avg) 39.000 -
471.omnetpp (avg) (percentage) 1.920 -
471.omnetpp (max) 52.000 -5.45%
471.omnetpp (max) (percentage) 2.560 -4.83%
473.astar 90.000 -
473.astar (avg) 90.000 -
473.astar (avg) (percentage) 2.090 -
473.astar (max) 169.000 -5.06%
473.astar (max) (percentage) 3.930 -4.84%
481.wrf (avg) (percentage) 1.890 -
481.wrf (max) (percentage) 0.680 -
482.sphinx3 14.000 7.69%
482.sphinx3 (avg) 14.000 7.69%
482.sphinx3 (avg) (percentage) 2.180 -
482.sphinx3 (max) 23.000 -4.17%
482.sphinx3 (max) (percentage) 3.670 -4.43%
483.xalancbmk (avg) (percentage) 2.740 -
483.xalancbmk (max) (percentage) 1.850 -
Geometric Mean 7.594 -7.79%