Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=51251096bc7e935d579cb2220734d2af0ab9024b (unchanged)
git_gcc https://gcc.gnu.org/git/gcc.git (201cd2d3bef8e935eb9af04a516b9d224b5b8470) (+ 1 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=62fba6d9807fc12334d7c5513407715d59539611 (unchanged)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/854a85bbaa94372aab63fed6a37a8e1768cf1a84 (unchanged)
regression GNU-1602
test_url https://ci.linaro.org/job/tcwg_bmk-code_vect-spec2k6--gnu-aarch64-master-O3_LTO-build/412/
Filter

gnu-aarch64-master-O3_LTO test results

Run Order Start Time Duration
Current 0412 (basepoints/gcc-16-01285-g201cd2d3bef) 2025-06-07T22:37:25 0:00:00
Previous 0411 (basepoints/gcc-16-01284-g4f88f1593fa) 2025-06-07T01:40:17 0:00:00
Baseline 0001 (4-changed-components) 2023-03-08T03:13:34 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 23 23
Performance Improvements 55 12
Added Tests 0 118
Unchanged Tests 1038 963
Total Tests 1116

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
435.gromacs 1.30% 4993.000 5058.000 - 1.34% -
462.libquantum 1.30% 77.000 78.000 - -2.50% -
444.namd 1.27% 629.000 637.000 - 3.07% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
444.namd (unexplained diff vs previous) 300.00% 2.000 8.000 - 0.00% -
444.namd (unexplained diff vs previous) (percentage) 293.75% 0.320 1.260 - 0.00% -
470.lbm (unexplained diff vs previous) 200.00% 2.000 6.000 - 0.00% -
470.lbm (unexplained diff vs previous) (percentage) 183.33% 0.060 0.170 - 0.00% -
410.bwaves (unexplained diff vs previous) (percentage) 113.85% 0.650 1.390 - 0.00% -
410.bwaves (unexplained diff vs previous) 111.54% 26.000 55.000 - 0.00% -
444.namd (max) 60.00% 5.000 8.000 - 0.00% -
444.namd (max) (percentage) 35.11% 0.940 1.270 - 0.00% -
437.leslie3d (unexplained diff vs previous) (percentage) 28.55% 8.370 10.760 - 0.00% -
410.bwaves (max) (percentage) 24.55% 1.100 1.370 - 0.00% -
410.bwaves (max) 22.73% 44.000 54.000 - 0.00% -
437.leslie3d (unexplained diff vs previous) 16.04% 586.000 680.000 - 0.00% -
450.soplex 6.67% 15.000 16.000 - 0.00% -
450.soplex (avg) 6.67% 15.000 16.000 - 0.00% -
437.leslie3d (max) (percentage) 6.35% 9.140 9.720 - 0.00% -
401.bzip2 2.17% 46.000 47.000 - 0.00% -
401.bzip2 (avg) 2.17% 46.000 47.000 - 0.00% -
437.leslie3d (avg) (percentage) 2.05% 4.380 4.470 - 0.00% -
435.gromacs 1.67% 120.000 122.000 - 0.00% -
435.gromacs (avg) 1.67% 120.000 122.000 - 0.00% -

Performance Improvements - Code Size Δ Previous Current σ Δ (B) σ (B)
482.sphinx3 -2.35% 168919.000 164951.000 - 7.27% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
437.leslie3d -9.72% 6998.000 6318.000 - -6.12% -
471.omnetpp -3.17% 2205.000 2135.000 - 3.79% -
410.bwaves -1.37% 4009.000 3954.000 - -1.54% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
459.GemsFDTD (max) -81.60% 125.000 23.000 - 0.00% -
459.GemsFDTD (max) (percentage) -81.59% 2.770 0.510 - 0.00% -
473.astar (max) -77.19% 171.000 39.000 - 0.00% -
473.astar (max) (percentage) -76.60% 3.760 0.880 - 0.00% -
434.zeusmp (max) -71.43% 42.000 12.000 - 0.00% -
434.zeusmp (unexplained diff vs previous) -71.43% 14.000 4.000 - 0.00% -
434.zeusmp (unexplained diff vs previous) (percentage) -70.89% 0.790 0.230 - 0.00% -
434.zeusmp (max) (percentage) -70.78% 2.430 0.710 - 0.00% -
473.astar (unexplained diff vs previous) (percentage) -53.54% 0.990 0.460 - 0.00% -
473.astar (unexplained diff vs previous) -53.33% 45.000 21.000 - 0.00% -
459.GemsFDTD (unexplained diff vs previous) -42.31% 26.000 15.000 - 0.00% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -42.11% 0.570 0.330 - 0.00% -
470.lbm (max) (percentage) -8.54% 0.820 0.750 - 0.00% -
437.leslie3d -7.84% 306.000 282.000 - 0.00% -
437.leslie3d (avg) -7.84% 306.000 282.000 - 0.00% -
470.lbm (max) -7.14% 28.000 26.000 - 0.00% -
429.mcf (max) (percentage) -6.50% 3.230 3.020 - 0.00% -
429.mcf (max) -6.25% 64.000 60.000 - 0.00% -
471.omnetpp (max) -6.21% 145.000 136.000 - 0.00% -
433.milc (max) (percentage) -5.56% 2.340 2.210 - 0.00% -
458.sjeng (max) (percentage) -5.00% 0.400 0.380 - 0.00% -
453.povray (max) (percentage) -4.86% 1.440 1.370 - 0.00% -
450.soplex (max) (percentage) -4.81% 4.570 4.350 - 0.00% -
433.milc (max) -4.35% 23.000 22.000 - 0.00% -
450.soplex (max) -4.17% 24.000 23.000 - 0.00% -
458.sjeng (max) -4.17% 24.000 23.000 - 0.00% -
465.tonto (max) -4.17% 96.000 92.000 - 0.00% -
437.leslie3d (max) -3.91% 639.000 614.000 - 0.00% -
447.dealII (max) -3.70% 27.000 26.000 - 0.00% -
462.libquantum (max) (percentage) -3.67% 6.000 5.780 - 0.00% -
465.tonto (max) (percentage) -3.39% 1.180 1.140 - 0.00% -
482.sphinx3 (max) (percentage) -3.13% 6.380 6.180 - 0.00% -
435.gromacs (max) (percentage) -2.99% 4.010 3.890 - 0.00% -
471.omnetpp (max) (percentage) -2.89% 6.580 6.390 - 0.00% -
447.dealII (max) (percentage) -2.87% 2.790 2.710 - 0.00% -
445.gobmk (max) -2.75% 109.000 106.000 - 0.00% -
445.gobmk (max) (percentage) -2.46% 2.440 2.380 - 0.00% -
482.sphinx3 (max) -2.33% 43.000 42.000 - 0.00% -
471.omnetpp -2.22% 45.000 44.000 - 0.00% -
471.omnetpp (avg) -2.22% 45.000 44.000 - 0.00% -
435.gromacs (max) -2.00% 200.000 196.000 - 0.00% -
401.bzip2 (max) (percentage) -1.90% 4.220 4.140 - 0.00% -
410.bwaves -1.64% 61.000 60.000 - 0.00% -
410.bwaves (avg) -1.64% 61.000 60.000 - 0.00% -
459.GemsFDTD -1.37% 73.000 72.000 - 0.00% -
459.GemsFDTD (avg) -1.37% 73.000 72.000 - 0.00% -
459.GemsFDTD (avg) (percentage) -1.24% 1.610 1.590 - 0.00% -
465.tonto -1.05% 95.000 94.000 - 0.00% -
465.tonto (avg) -1.05% 95.000 94.000 - 0.00% -
473.astar -1.05% 95.000 94.000 - 0.00% -
473.astar (avg) -1.05% 95.000 94.000 - 0.00% -

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
470.lbm 34.12% 11256.000 15096.000 - 0.00% -
444.namd 22.80% 235533.000 289223.000 - 0.00% -
429.mcf 8.50% 10100.000 10959.000 - 0.00% -
482.sphinx3 7.27% 153776.000 164951.000 - -2.35% -
410.bwaves 6.55% 26143.000 27855.000 - 0.00% -
437.leslie3d 5.02% 100088.000 105109.000 - 0.00% -
445.gobmk 4.57% 1878607.000 1964547.000 - 0.62% -
450.soplex 3.42% 326173.000 337329.000 - -0.05% -
453.povray 2.43% 1083050.000 1109336.000 - 0.06% -
434.zeusmp 2.34% 296597.000 303535.000 - 0.00% -
471.omnetpp 1.74% 652766.000 664117.000 - -0.00% -
458.sjeng 1.42% 156546.000 158766.000 - -0.02% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
429.mcf 11.90% 1790.000 2003.000 - -0.05% -
450.soplex 11.36% 493.000 549.000 - 0.92% -
433.milc 7.19% 932.000 999.000 - 0.50% -
401.bzip2 6.78% 2612.000 2789.000 - 0.61% -
471.omnetpp 3.79% 2057.000 2135.000 - -3.17% -
434.zeusmp 3.69% 1709.000 1772.000 - 0.23% -
444.namd 3.07% 618.000 637.000 - 1.27% -
445.gobmk 2.70% 4363.000 4481.000 - 0.00% -
435.gromacs 1.34% 4991.000 5058.000 - 1.30% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -31.03% 29.000 20.000 - 0.00% -
nb_execution_successful -31.03% 29.000 20.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
459.GemsFDTD -3.21% 376580.000 364500.000 - 0.00% -
462.libquantum -2.29% 22168.000 21660.000 - -0.07% -
435.gromacs -1.24% 736591.000 727477.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
482.sphinx3 -10.89% 771.000 687.000 - 0.29% -
437.leslie3d -6.12% 6730.000 6318.000 - -9.72% -
465.tonto -5.45% 8627.000 8157.000 - -0.71% -
470.lbm -4.75% 3644.000 3471.000 - 0.17% -
462.libquantum -2.50% 80.000 78.000 - 1.30% -
447.dealII -1.91% 996.000 977.000 - 0.10% -
410.bwaves -1.54% 4016.000 3954.000 - -1.37% -
453.povray -1.33% 375.000 370.000 - 0.54% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 31.03% 29.000 38.000 - 0.00% -

Added Tests - sample variability
400.perlbench (avg) (percentage)
400.perlbench (max) (percentage)
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
403.gcc (avg) (percentage)
403.gcc (max) (percentage)
410.bwaves
410.bwaves (avg)
410.bwaves (avg) (percentage)
410.bwaves (max)
410.bwaves (max) (percentage)
416.gamess (avg) (percentage)
416.gamess (max) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
433.milc
433.milc (avg)
433.milc (avg) (percentage)
433.milc (max)
433.milc (max) (percentage)
434.zeusmp
434.zeusmp (avg)
434.zeusmp (avg) (percentage)
434.zeusmp (max)
434.zeusmp (max) (percentage)
435.gromacs
435.gromacs (avg)
435.gromacs (avg) (percentage)
435.gromacs (max)
435.gromacs (max) (percentage)
436.cactusADM (avg) (percentage)
436.cactusADM (max) (percentage)
437.leslie3d
437.leslie3d (avg)
437.leslie3d (avg) (percentage)
437.leslie3d (max)
437.leslie3d (max) (percentage)
444.namd
444.namd (avg)
444.namd (avg) (percentage)
444.namd (max)
444.namd (max) (percentage)
445.gobmk
445.gobmk (avg)
445.gobmk (avg) (percentage)
445.gobmk (max)
445.gobmk (max) (percentage)
447.dealII
447.dealII (avg)
447.dealII (avg) (percentage)
447.dealII (max)
447.dealII (max) (percentage)
450.soplex
450.soplex (avg)
450.soplex (avg) (percentage)
450.soplex (max)
450.soplex (max) (percentage)
453.povray
453.povray (avg)
453.povray (avg) (percentage)
453.povray (max)
453.povray (max) (percentage)
454.calculix (avg) (percentage)
454.calculix (max) (percentage)
456.hmmer (avg) (percentage)
456.hmmer (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
459.GemsFDTD
459.GemsFDTD (avg)
459.GemsFDTD (avg) (percentage)
459.GemsFDTD (max)
459.GemsFDTD (max) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)
464.h264ref (avg) (percentage)
464.h264ref (max) (percentage)
465.tonto
465.tonto (avg)
465.tonto (avg) (percentage)
465.tonto (max)
465.tonto (max) (percentage)
470.lbm
470.lbm (avg)
470.lbm (avg) (percentage)
470.lbm (max)
470.lbm (max) (percentage)
471.omnetpp
471.omnetpp (avg)
471.omnetpp (avg) (percentage)
471.omnetpp (max)
471.omnetpp (max) (percentage)
473.astar
473.astar (avg)
473.astar (avg) (percentage)
473.astar (max)
473.astar (max) (percentage)
481.wrf (avg) (percentage)
481.wrf (max) (percentage)
482.sphinx3
482.sphinx3 (avg)
482.sphinx3 (avg) (percentage)
482.sphinx3 (max)
482.sphinx3 (max) (percentage)
483.xalancbmk (avg) (percentage)
483.xalancbmk (max) (percentage)


Report Time: 0.36s
Name Current %
401.bzip2 2789.000 -
410.bwaves 3954.000 -1.37%
429.mcf 2003.000 -
433.milc 999.000 -
434.zeusmp 1772.000 -
435.gromacs 5058.000 1.30%
437.leslie3d 6318.000 -9.72%
444.namd 637.000 1.27%
445.gobmk 4481.000 -
447.dealII 977.000 -
450.soplex 549.000 -
453.povray 370.000 -
458.sjeng 6128.000 -
459.GemsFDTD 4556.000 -
462.libquantum 78.000 1.30%
465.tonto 8157.000 -
470.lbm 3471.000 -
471.omnetpp 2135.000 -3.17%
473.astar 4541.000 -
482.sphinx3 687.000 -
Geometric Mean 1875.734 -
Name Current %
401.bzip2 72353.000 -
410.bwaves 27855.000 -
429.mcf 10959.000 -
433.milc 94368.000 -
434.zeusmp 303535.000 -
435.gromacs 727477.000 -
437.leslie3d 105109.000 -
444.namd 289223.000 -
445.gobmk 1964547.000 -
447.dealII 477463.000 -
450.soplex 337329.000 -
453.povray 1109336.000 -
458.sjeng 158766.000 -
459.GemsFDTD 364500.000 -
462.libquantum 21660.000 -
465.tonto 2821590.000 -
470.lbm 15096.000 -
471.omnetpp 664117.000 -
473.astar 30901.000 -
482.sphinx3 164951.000 -2.35%
Geometric Mean 176770.920 -
Name Current %
400.perlbench (avg) (percentage) 2.510 -
400.perlbench (max) (percentage) 2.110 -
401.bzip2 47.000 2.17%
401.bzip2 (avg) 47.000 2.17%
401.bzip2 (avg) (percentage) 1.690 -
401.bzip2 (max) 115.000 -
401.bzip2 (max) (percentage) 4.140 -1.90%
403.gcc (avg) (percentage) 5.640 -
403.gcc (max) (percentage) 7.210 -
410.bwaves 60.000 -1.64%
410.bwaves (avg) 60.000 -1.64%
410.bwaves (avg) (percentage) 1.520 -
410.bwaves (max) 54.000 22.73%
410.bwaves (max) (percentage) 1.370 24.55%
410.bwaves (unexplained diff vs previous) 55.000 111.54%
410.bwaves (unexplained diff vs previous) (percentage) 1.390 113.85%
416.gamess (avg) (percentage) 0.250 -
416.gamess (max) (percentage) 0.160 -
429.mcf 80.000 -
429.mcf (avg) 80.000 -
429.mcf (avg) (percentage) 4.020 -
429.mcf (max) 60.000 -6.25%
429.mcf (max) (percentage) 3.020 -6.50%
433.milc 14.000 -
433.milc (avg) 14.000 -
433.milc (avg) (percentage) 1.500 -
433.milc (max) 22.000 -4.35%
433.milc (max) (percentage) 2.210 -5.56%
434.zeusmp 18.000 -
434.zeusmp (avg) 18.000 -
434.zeusmp (avg) (percentage) 1.020 -
434.zeusmp (max) 12.000 -71.43%
434.zeusmp (max) (percentage) 0.710 -70.78%
434.zeusmp (unexplained diff vs previous) 4.000 -71.43%
434.zeusmp (unexplained diff vs previous) (percentage) 0.230 -70.89%
435.gromacs 122.000 1.67%
435.gromacs (avg) 122.000 1.67%
435.gromacs (avg) (percentage) 2.420 -
435.gromacs (max) 196.000 -2.00%
435.gromacs (max) (percentage) 3.890 -2.99%
436.cactusADM (avg) (percentage) 0.990 -
436.cactusADM (max) (percentage) 1.520 -
437.leslie3d 282.000 -7.84%
437.leslie3d (avg) 282.000 -7.84%
437.leslie3d (avg) (percentage) 4.470 2.05%
437.leslie3d (max) 614.000 -3.91%
437.leslie3d (max) (percentage) 9.720 6.35%
437.leslie3d (unexplained diff vs previous) 680.000 16.04%
437.leslie3d (unexplained diff vs previous) (percentage) 10.760 28.55%
444.namd 6.000 -
444.namd (avg) 6.000 -
444.namd (avg) (percentage) 1.080 -
444.namd (max) 8.000 60.00%
444.namd (max) (percentage) 1.270 35.11%
444.namd (unexplained diff vs previous) 8.000 300.00%
444.namd (unexplained diff vs previous) (percentage) 1.260 293.75%
445.gobmk 50.000 -
445.gobmk (avg) 50.000 -
445.gobmk (avg) (percentage) 1.120 -
445.gobmk (max) 106.000 -2.75%
445.gobmk (max) (percentage) 2.380 -2.46%
447.dealII 13.000 -
447.dealII (avg) 13.000 -
447.dealII (avg) (percentage) 1.400 -
447.dealII (max) 26.000 -3.70%
447.dealII (max) (percentage) 2.710 -2.87%
450.soplex 16.000 6.67%
450.soplex (avg) 16.000 6.67%
450.soplex (avg) (percentage) 2.920 -
450.soplex (max) 23.000 -4.17%
450.soplex (max) (percentage) 4.350 -4.81%
453.povray 5.000 -
453.povray (avg) 5.000 -
453.povray (avg) (percentage) 1.490 -
453.povray (max) 5.000 -
453.povray (max) (percentage) 1.370 -4.86%
454.calculix (avg) (percentage) 3.100 -
454.calculix (max) (percentage) 2.940 -
456.hmmer (avg) (percentage) 0.780 -
456.hmmer (max) (percentage) 1.130 -
458.sjeng 38.000 -
458.sjeng (avg) 38.000 -
458.sjeng (avg) (percentage) 0.630 -
458.sjeng (max) 23.000 -4.17%
458.sjeng (max) (percentage) 0.380 -5.00%
459.GemsFDTD 72.000 -1.37%
459.GemsFDTD (avg) 72.000 -1.37%
459.GemsFDTD (avg) (percentage) 1.590 -1.24%
459.GemsFDTD (max) 23.000 -81.60%
459.GemsFDTD (max) (percentage) 0.510 -81.59%
459.GemsFDTD (unexplained diff vs previous) 15.000 -42.31%
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.330 -42.11%
462.libquantum 2.000 -
462.libquantum (avg) 2.000 -
462.libquantum (avg) (percentage) 3.340 -
462.libquantum (max) 4.000 -
462.libquantum (max) (percentage) 5.780 -3.67%
464.h264ref (avg) (percentage) 0.730 -
464.h264ref (max) (percentage) 1.580 -
465.tonto 94.000 -1.05%
465.tonto (avg) 94.000 -1.05%
465.tonto (avg) (percentage) 1.160 -
465.tonto (max) 92.000 -4.17%
465.tonto (max) (percentage) 1.140 -3.39%
470.lbm 40.000 -
470.lbm (avg) 40.000 -
470.lbm (avg) (percentage) 1.170 -
470.lbm (max) 26.000 -7.14%
470.lbm (max) (percentage) 0.750 -8.54%
470.lbm (unexplained diff vs previous) 6.000 200.00%
470.lbm (unexplained diff vs previous) (percentage) 0.170 183.33%
471.omnetpp 44.000 -2.22%
471.omnetpp (avg) 44.000 -2.22%
471.omnetpp (avg) (percentage) 2.070 -
471.omnetpp (max) 136.000 -6.21%
471.omnetpp (max) (percentage) 6.390 -2.89%
473.astar 94.000 -1.05%
473.astar (avg) 94.000 -1.05%
473.astar (avg) (percentage) 2.080 -
473.astar (max) 39.000 -77.19%
473.astar (max) (percentage) 0.880 -76.60%
473.astar (unexplained diff vs previous) 21.000 -53.33%
473.astar (unexplained diff vs previous) (percentage) 0.460 -53.54%
481.wrf (avg) (percentage) 1.890 -
481.wrf (max) (percentage) 0.680 -
482.sphinx3 16.000 -
482.sphinx3 (avg) 16.000 -
482.sphinx3 (avg) (percentage) 2.450 -
482.sphinx3 (max) 42.000 -2.33%
482.sphinx3 (max) (percentage) 6.180 -3.13%
483.xalancbmk (avg) (percentage) 2.740 -
483.xalancbmk (max) (percentage) 1.840 -
Geometric Mean 7.262 -5.26%