Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=9197e8eebe3491914653f49908ed54cc4573eaae (unchanged)
git_gcc https://gcc.gnu.org/git/gcc.git (8335fd561fa823d32556512c09dfce44463e8eaa) (+ 1 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=af90dc572ad232d05b667c4ce218d499f066b7bc (unchanged)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/5ba594f2049bc9eb2781500c137e3e9fcc87ef69 (unchanged)
regression GNU-1582
test_url https://ci.linaro.org/job/tcwg_bmk-code_vect-spec2k6--gnu-aarch64-master-O3_LTO-build/401/
Filter

gnu-aarch64-master-O3_LTO test results

Run Order Start Time Duration
Current 0401 (basepoints/gcc-16-00448-g8335fd561fa) 2025-05-31T12:30:09 0:00:00
Previous 0400 (basepoints/gcc-16-00447-g2c8d632d9ed) 2025-05-29T20:15:19 0:00:00
Baseline 0001 (4-changed-components) 2023-03-08T03:13:34 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 7 25
Performance Improvements 72 12
Added Tests 0 118
Unchanged Tests 1037 961
Total Tests 1116

Performance Regressions - Code Size Δ Previous Current σ Δ (B) σ (B)
459.GemsFDTD 1.10% 364484.000 368500.000 - -2.15% -

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
462.libquantum 8.00% 75.000 81.000 - 1.25% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
434.zeusmp 5.56% 18.000 19.000 - 0.00% -
434.zeusmp (avg) 5.56% 18.000 19.000 - 0.00% -
462.libquantum (avg) (percentage) 1.80% 3.330 3.390 - 0.00% -
459.GemsFDTD 1.35% 74.000 75.000 - 0.00% -
459.GemsFDTD (avg) 1.35% 74.000 75.000 - 0.00% -

Performance Improvements - Code Size Δ Previous Current σ Δ (B) σ (B)
434.zeusmp -1.31% 304371.000 300387.000 - 1.28% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
437.leslie3d -5.60% 6736.000 6359.000 - -5.51% -
447.dealII -2.92% 1029.000 999.000 - 0.30% -
453.povray -2.12% 377.000 369.000 - -1.60% -
450.soplex -1.84% 544.000 534.000 - 8.32% -
401.bzip2 -1.72% 2843.000 2794.000 - 6.97% -
482.sphinx3 -1.45% 689.000 679.000 - -11.93% -
444.namd -1.10% 637.000 630.000 - 1.94% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
429.mcf (unexplained diff vs previous) -91.58% 202.000 17.000 - 0.00% -
429.mcf (unexplained diff vs previous) (percentage) -91.56% 9.950 0.840 - 0.00% -
410.bwaves (unexplained diff vs previous) -83.64% 214.000 35.000 - 0.00% -
410.bwaves (unexplained diff vs previous) (percentage) -83.43% 5.370 0.890 - 0.00% -
470.lbm (unexplained diff vs previous) -76.83% 82.000 19.000 - 0.00% -
470.lbm (unexplained diff vs previous) (percentage) -76.69% 2.360 0.550 - 0.00% -
458.sjeng (unexplained diff vs previous) (percentage) -74.42% 1.720 0.440 - 0.00% -
458.sjeng (unexplained diff vs previous) -74.29% 105.000 27.000 - 0.00% -
444.namd (unexplained diff vs previous) -41.67% 12.000 7.000 - 0.00% -
444.namd (max) -41.18% 17.000 10.000 - 0.00% -
444.namd (unexplained diff vs previous) (percentage) -40.96% 1.880 1.110 - 0.00% -
444.namd (max) (percentage) -39.29% 2.800 1.700 - 0.00% -
470.lbm (max) -26.25% 80.000 59.000 - 0.00% -
429.mcf (max) -25.89% 224.000 166.000 - 0.00% -
410.bwaves (max) -25.25% 202.000 151.000 - 0.00% -
470.lbm (max) (percentage) -25.11% 2.310 1.730 - 0.00% -
429.mcf (max) (percentage) -25.00% 11.040 8.280 - 0.00% -
410.bwaves (max) (percentage) -24.95% 5.090 3.820 - 0.00% -
462.libquantum (unexplained diff vs previous) (percentage) -20.58% 9.330 7.410 - 0.00% -
462.libquantum (unexplained diff vs previous) -14.29% 7.000 6.000 - 0.00% -
458.sjeng (max) -13.59% 103.000 89.000 - 0.00% -
458.sjeng (max) (percentage) -12.43% 1.690 1.480 - 0.00% -
437.leslie3d (max) -10.97% 383.000 341.000 - 0.00% -
435.gromacs (max) -8.86% 316.000 288.000 - 0.00% -
435.gromacs (max) (percentage) -8.35% 6.230 5.710 - 0.00% -
447.dealII (max) -8.33% 24.000 22.000 - 0.00% -
401.bzip2 (max) -7.59% 224.000 207.000 - 0.00% -
447.dealII -7.14% 14.000 13.000 - 0.00% -
447.dealII (avg) -7.14% 14.000 13.000 - 0.00% -
450.soplex (max) -6.67% 30.000 28.000 - 0.00% -
462.libquantum (max) (percentage) -6.32% 8.540 8.000 - 0.00% -
401.bzip2 (max) (percentage) -6.20% 7.900 7.410 - 0.00% -
437.leslie3d (max) (percentage) -5.62% 5.690 5.370 - 0.00% -
437.leslie3d -5.52% 290.000 274.000 - 0.00% -
437.leslie3d (avg) -5.52% 290.000 274.000 - 0.00% -
459.GemsFDTD (max) (percentage) -3.97% 4.030 3.870 - 0.00% -
445.gobmk (max) (percentage) -3.95% 3.800 3.650 - 0.00% -
471.omnetpp (max) (percentage) -3.85% 8.310 7.990 - 0.00% -
447.dealII (max) (percentage) -3.80% 2.370 2.280 - 0.00% -
473.astar (max) (percentage) -3.78% 5.020 4.830 - 0.00% -
450.soplex (max) (percentage) -3.78% 5.560 5.350 - 0.00% -
434.zeusmp (max) (percentage) -3.70% 3.240 3.120 - 0.00% -
445.gobmk (max) -3.55% 169.000 163.000 - 0.00% -
434.zeusmp (max) -3.51% 57.000 55.000 - 0.00% -
471.omnetpp (max) -3.41% 176.000 170.000 - 0.00% -
459.GemsFDTD (max) -3.30% 182.000 176.000 - 0.00% -
453.povray (max) (percentage) -3.28% 1.830 1.770 - 0.00% -
482.sphinx3 (max) -3.28% 61.000 59.000 - 0.00% -
473.astar (max) -3.07% 228.000 221.000 - 0.00% -
465.tonto (max) -3.03% 132.000 128.000 - 0.00% -
482.sphinx3 (max) (percentage) -2.58% 8.930 8.700 - 0.00% -
458.sjeng -2.56% 39.000 38.000 - 0.00% -
458.sjeng (avg) -2.56% 39.000 38.000 - 0.00% -
433.milc (max) (percentage) -2.52% 2.380 2.320 - 0.00% -
465.tonto (max) (percentage) -2.45% 1.630 1.590 - 0.00% -
429.mcf -2.38% 84.000 82.000 - 0.00% -
429.mcf (avg) -2.38% 84.000 82.000 - 0.00% -
470.lbm -2.38% 42.000 41.000 - 0.00% -
470.lbm (avg) -2.38% 42.000 41.000 - 0.00% -
401.bzip2 -2.04% 49.000 48.000 - 0.00% -
401.bzip2 (avg) -2.04% 49.000 48.000 - 0.00% -
410.bwaves -1.61% 62.000 61.000 - 0.00% -
410.bwaves (avg) -1.61% 62.000 61.000 - 0.00% -
429.mcf (avg) (percentage) -1.20% 4.150 4.100 - 0.00% -

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
470.lbm 34.12% 11256.000 15096.000 - 0.00% -
444.namd 20.91% 235533.000 284789.000 - 0.00% -
429.mcf 8.50% 10100.000 10959.000 - 0.00% -
482.sphinx3 7.29% 153776.000 164983.000 - -0.04% -
410.bwaves 6.55% 26143.000 27855.000 - 0.00% -
437.leslie3d 4.92% 100088.000 105013.000 - -0.29% -
445.gobmk 4.01% 1878607.000 1954027.000 - 0.00% -
450.soplex 3.46% 326173.000 337457.000 - 0.00% -
453.povray 3.08% 1083050.000 1116419.000 - 0.37% -
471.omnetpp 1.74% 652766.000 664093.000 - -0.01% -
458.sjeng 1.38% 156546.000 158714.000 - 0.00% -
465.tonto 1.28% 2795025.000 2830774.000 - 0.57% -
434.zeusmp 1.28% 296597.000 300387.000 - -1.31% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
429.mcf 12.51% 1790.000 2014.000 - -0.84% -
450.soplex 8.32% 493.000 534.000 - -1.84% -
433.milc 7.62% 932.000 1003.000 - -0.20% -
401.bzip2 6.97% 2612.000 2794.000 - -1.72% -
434.zeusmp 4.92% 1709.000 1793.000 - 0.17% -
471.omnetpp 3.69% 2057.000 2133.000 - 0.66% -
445.gobmk 2.54% 4363.000 4474.000 - 0.38% -
444.namd 1.94% 618.000 630.000 - -1.10% -
435.gromacs 1.34% 4991.000 5058.000 - -0.45% -
462.libquantum 1.25% 80.000 81.000 - 8.00% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -31.03% 29.000 20.000 - 0.00% -
nb_execution_successful -31.03% 29.000 20.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
462.libquantum -2.51% 22168.000 21612.000 - 0.00% -
459.GemsFDTD -2.15% 376580.000 368500.000 - 1.10% -
447.dealII -1.50% 480818.000 473615.000 - -0.07% -
435.gromacs -1.00% 736591.000 729221.000 - -0.03% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
482.sphinx3 -11.93% 771.000 679.000 - -1.45% -
465.tonto -6.63% 8627.000 8055.000 - -0.96% -
437.leslie3d -5.51% 6730.000 6359.000 - -5.60% -
470.lbm -5.27% 3644.000 3452.000 - -0.55% -
453.povray -1.60% 375.000 369.000 - -2.12% -
410.bwaves -1.57% 4016.000 3953.000 - -0.88% -
458.sjeng -1.04% 6134.000 6070.000 - -0.44% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 31.03% 29.000 38.000 - 0.00% -

Added Tests - sample variability
400.perlbench (avg) (percentage)
400.perlbench (max) (percentage)
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
403.gcc (avg) (percentage)
403.gcc (max) (percentage)
410.bwaves
410.bwaves (avg)
410.bwaves (avg) (percentage)
410.bwaves (max)
410.bwaves (max) (percentage)
416.gamess (avg) (percentage)
416.gamess (max) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
433.milc
433.milc (avg)
433.milc (avg) (percentage)
433.milc (max)
433.milc (max) (percentage)
434.zeusmp
434.zeusmp (avg)
434.zeusmp (avg) (percentage)
434.zeusmp (max)
434.zeusmp (max) (percentage)
435.gromacs
435.gromacs (avg)
435.gromacs (avg) (percentage)
435.gromacs (max)
435.gromacs (max) (percentage)
436.cactusADM (avg) (percentage)
436.cactusADM (max) (percentage)
437.leslie3d
437.leslie3d (avg)
437.leslie3d (avg) (percentage)
437.leslie3d (max)
437.leslie3d (max) (percentage)
444.namd
444.namd (avg)
444.namd (avg) (percentage)
444.namd (max)
444.namd (max) (percentage)
445.gobmk
445.gobmk (avg)
445.gobmk (avg) (percentage)
445.gobmk (max)
445.gobmk (max) (percentage)
447.dealII
447.dealII (avg)
447.dealII (avg) (percentage)
447.dealII (max)
447.dealII (max) (percentage)
450.soplex
450.soplex (avg)
450.soplex (avg) (percentage)
450.soplex (max)
450.soplex (max) (percentage)
453.povray
453.povray (avg)
453.povray (avg) (percentage)
453.povray (max)
453.povray (max) (percentage)
454.calculix (avg) (percentage)
454.calculix (max) (percentage)
456.hmmer (avg) (percentage)
456.hmmer (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
459.GemsFDTD
459.GemsFDTD (avg)
459.GemsFDTD (avg) (percentage)
459.GemsFDTD (max)
459.GemsFDTD (max) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)
464.h264ref (avg) (percentage)
464.h264ref (max) (percentage)
465.tonto
465.tonto (avg)
465.tonto (avg) (percentage)
465.tonto (max)
465.tonto (max) (percentage)
470.lbm
470.lbm (avg)
470.lbm (avg) (percentage)
470.lbm (max)
470.lbm (max) (percentage)
471.omnetpp
471.omnetpp (avg)
471.omnetpp (avg) (percentage)
471.omnetpp (max)
471.omnetpp (max) (percentage)
473.astar
473.astar (avg)
473.astar (avg) (percentage)
473.astar (max)
473.astar (max) (percentage)
481.wrf (avg) (percentage)
481.wrf (max) (percentage)
482.sphinx3
482.sphinx3 (avg)
482.sphinx3 (avg) (percentage)
482.sphinx3 (max)
482.sphinx3 (max) (percentage)
483.xalancbmk (avg) (percentage)
483.xalancbmk (max) (percentage)


Report Time: 0.35s
Name Current %
401.bzip2 2794.000 -1.72%
410.bwaves 3953.000 -
429.mcf 2014.000 -
433.milc 1003.000 -
434.zeusmp 1793.000 -
435.gromacs 5058.000 -
437.leslie3d 6359.000 -5.60%
444.namd 630.000 -1.10%
445.gobmk 4474.000 -
447.dealII 999.000 -2.92%
450.soplex 534.000 -1.84%
453.povray 369.000 -2.12%
458.sjeng 6070.000 -
459.GemsFDTD 4562.000 -
462.libquantum 81.000 8.00%
465.tonto 8055.000 -
470.lbm 3452.000 -
471.omnetpp 2133.000 -
473.astar 4579.000 -
482.sphinx3 679.000 -1.45%
Geometric Mean 1877.204 -
Name Current %
401.bzip2 72357.000 -
410.bwaves 27855.000 -
429.mcf 10959.000 -
433.milc 94264.000 -
434.zeusmp 300387.000 -1.31%
435.gromacs 729221.000 -
437.leslie3d 105013.000 -
444.namd 284789.000 -
445.gobmk 1954027.000 -
447.dealII 473615.000 -
450.soplex 337457.000 -
453.povray 1116419.000 -
458.sjeng 158714.000 -
459.GemsFDTD 368500.000 1.10%
462.libquantum 21612.000 -
465.tonto 2830774.000 -
470.lbm 15096.000 -
471.omnetpp 664093.000 -
473.astar 30869.000 -
482.sphinx3 164983.000 -
Geometric Mean 176581.707 -
Name Current %
400.perlbench (avg) (percentage) 2.510 -
400.perlbench (max) (percentage) 2.130 -
401.bzip2 48.000 -2.04%
401.bzip2 (avg) 48.000 -2.04%
401.bzip2 (avg) (percentage) 1.730 -
401.bzip2 (max) 207.000 -7.59%
401.bzip2 (max) (percentage) 7.410 -6.20%
403.gcc (avg) (percentage) 5.640 -
403.gcc (max) (percentage) 7.210 -
410.bwaves 61.000 -1.61%
410.bwaves (avg) 61.000 -1.61%
410.bwaves (avg) (percentage) 1.560 -
410.bwaves (max) 151.000 -25.25%
410.bwaves (max) (percentage) 3.820 -24.95%
410.bwaves (unexplained diff vs previous) 35.000 -83.64%
410.bwaves (unexplained diff vs previous) (percentage) 0.890 -83.43%
416.gamess (avg) (percentage) 0.250 -
416.gamess (max) (percentage) 0.160 -
429.mcf 82.000 -2.38%
429.mcf (avg) 82.000 -2.38%
429.mcf (avg) (percentage) 4.100 -1.20%
429.mcf (max) 166.000 -25.89%
429.mcf (max) (percentage) 8.280 -25.00%
429.mcf (unexplained diff vs previous) 17.000 -91.58%
429.mcf (unexplained diff vs previous) (percentage) 0.840 -91.56%
433.milc 14.000 -
433.milc (avg) 14.000 -
433.milc (avg) (percentage) 1.490 -
433.milc (max) 23.000 -
433.milc (max) (percentage) 2.320 -2.52%
434.zeusmp 19.000 5.56%
434.zeusmp (avg) 19.000 5.56%
434.zeusmp (avg) (percentage) 1.060 -
434.zeusmp (max) 55.000 -3.51%
434.zeusmp (max) (percentage) 3.120 -3.70%
435.gromacs 122.000 -
435.gromacs (avg) 122.000 -
435.gromacs (avg) (percentage) 2.430 -
435.gromacs (max) 288.000 -8.86%
435.gromacs (max) (percentage) 5.710 -8.35%
436.cactusADM (avg) (percentage) 0.990 -
436.cactusADM (max) (percentage) 1.540 -
437.leslie3d 274.000 -5.52%
437.leslie3d (avg) 274.000 -5.52%
437.leslie3d (avg) (percentage) 4.320 -
437.leslie3d (max) 341.000 -10.97%
437.leslie3d (max) (percentage) 5.370 -5.62%
444.namd 6.000 -
444.namd (avg) 6.000 -
444.namd (avg) (percentage) 1.090 -
444.namd (max) 10.000 -41.18%
444.namd (max) (percentage) 1.700 -39.29%
444.namd (unexplained diff vs previous) 7.000 -41.67%
444.namd (unexplained diff vs previous) (percentage) 1.110 -40.96%
445.gobmk 51.000 -
445.gobmk (avg) 51.000 -
445.gobmk (avg) (percentage) 1.160 -
445.gobmk (max) 163.000 -3.55%
445.gobmk (max) (percentage) 3.650 -3.95%
447.dealII 13.000 -7.14%
447.dealII (avg) 13.000 -7.14%
447.dealII (avg) (percentage) 1.370 -
447.dealII (max) 22.000 -8.33%
447.dealII (max) (percentage) 2.280 -3.80%
450.soplex 15.000 -
450.soplex (avg) 15.000 -
450.soplex (avg) (percentage) 2.910 -
450.soplex (max) 28.000 -6.67%
450.soplex (max) (percentage) 5.350 -3.78%
453.povray 5.000 -
453.povray (avg) 5.000 -
453.povray (avg) (percentage) 1.500 -
453.povray (max) 6.000 -
453.povray (max) (percentage) 1.770 -3.28%
454.calculix (avg) (percentage) 3.100 -
454.calculix (max) (percentage) 2.940 -
456.hmmer (avg) (percentage) 0.780 -
456.hmmer (max) (percentage) 1.150 -
458.sjeng 38.000 -2.56%
458.sjeng (avg) 38.000 -2.56%
458.sjeng (avg) (percentage) 0.640 -
458.sjeng (max) 89.000 -13.59%
458.sjeng (max) (percentage) 1.480 -12.43%
458.sjeng (unexplained diff vs previous) 27.000 -74.29%
458.sjeng (unexplained diff vs previous) (percentage) 0.440 -74.42%
459.GemsFDTD 75.000 1.35%
459.GemsFDTD (avg) 75.000 1.35%
459.GemsFDTD (avg) (percentage) 1.650 -
459.GemsFDTD (max) 176.000 -3.30%
459.GemsFDTD (max) (percentage) 3.870 -3.97%
462.libquantum 2.000 -
462.libquantum (avg) 2.000 -
462.libquantum (avg) (percentage) 3.390 1.80%
462.libquantum (max) 6.000 -
462.libquantum (max) (percentage) 8.000 -6.32%
462.libquantum (unexplained diff vs previous) 6.000 -14.29%
462.libquantum (unexplained diff vs previous) (percentage) 7.410 -20.58%
464.h264ref (avg) (percentage) 0.730 -
464.h264ref (max) (percentage) 1.600 -
465.tonto 95.000 -
465.tonto (avg) 95.000 -
465.tonto (avg) (percentage) 1.180 -
465.tonto (max) 128.000 -3.03%
465.tonto (max) (percentage) 1.590 -2.45%
470.lbm 41.000 -2.38%
470.lbm (avg) 41.000 -2.38%
470.lbm (avg) (percentage) 1.210 -
470.lbm (max) 59.000 -26.25%
470.lbm (max) (percentage) 1.730 -25.11%
470.lbm (unexplained diff vs previous) 19.000 -76.83%
470.lbm (unexplained diff vs previous) (percentage) 0.550 -76.69%
471.omnetpp 42.000 -
471.omnetpp (avg) 42.000 -
471.omnetpp (avg) (percentage) 1.990 -
471.omnetpp (max) 170.000 -3.41%
471.omnetpp (max) (percentage) 7.990 -3.85%
473.astar 98.000 -
473.astar (avg) 98.000 -
473.astar (avg) (percentage) 2.160 -
473.astar (max) 221.000 -3.07%
473.astar (max) (percentage) 4.830 -3.78%
481.wrf (avg) (percentage) 1.890 -
481.wrf (max) (percentage) 0.680 -
482.sphinx3 16.000 -
482.sphinx3 (avg) 16.000 -
482.sphinx3 (avg) (percentage) 2.410 -
482.sphinx3 (max) 59.000 -3.28%
482.sphinx3 (max) (percentage) 8.700 -2.58%
483.xalancbmk (avg) (percentage) 2.740 -
483.xalancbmk (max) (percentage) 1.840 -
Geometric Mean 8.874 -14.54%