Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=9197e8eebe3491914653f49908ed54cc4573eaae (unchanged)
git_gcc https://gcc.gnu.org/git/gcc.git (f12151e527d8d1b39a26b196f3de768c7edce5d0) (+ 626 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=af90dc572ad232d05b667c4ce218d499f066b7bc (unchanged)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/5ba594f2049bc9eb2781500c137e3e9fcc87ef69 (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_vect-spec2k6--gnu-aarch64-master-O3_LTO-build/403/
Filter

gnu-aarch64-master-O3_LTO test results

Run Order Start Time Duration
Current 0403 (basepoints/gcc-16-01074-gf12151e527d) 2025-06-01T23:11:34 0:00:00
Previous 0401 (basepoints/gcc-16-00448-g8335fd561fa) 2025-05-31T12:30:09 0:00:00
Baseline 0001 (4-changed-components) 2023-03-08T03:13:34 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 11 24
Performance Improvements 50 11
Added Tests 0 118
Unchanged Tests 1055 963
Total Tests 1116

Performance Regressions - Code Size Δ Previous Current σ Δ (B) σ (B)
434.zeusmp 1.05% 300387.000 303535.000 - 2.34% -

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
482.sphinx3 1.33% 679.000 688.000 - -10.77% -
462.libquantum 1.23% 81.000 82.000 - 2.50% -
437.leslie3d 1.18% 6359.000 6434.000 - -4.40% -
465.tonto 1.18% 8055.000 8150.000 - -5.53% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
429.mcf (unexplained diff vs previous) (percentage) 19.05% 0.840 1.000 - 0.00% -
429.mcf (unexplained diff vs previous) 17.65% 17.000 20.000 - 0.00% -
437.leslie3d 1.09% 274.000 277.000 - 0.00% -
437.leslie3d (avg) 1.09% 274.000 277.000 - 0.00% -
465.tonto 1.05% 95.000 96.000 - 0.00% -
465.tonto (avg) 1.05% 95.000 96.000 - 0.00% -

Performance Improvements - Code Size Δ Previous Current σ Δ (B) σ (B)
459.GemsFDTD -1.08% 368500.000 364532.000 - -3.20% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
435.gromacs -2.25% 5058.000 4944.000 - -0.94% -
453.povray -1.63% 369.000 363.000 - -3.20% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
470.lbm (unexplained diff vs previous) -36.84% 19.000 12.000 - 0.00% -
470.lbm (unexplained diff vs previous) (percentage) -36.36% 0.550 0.350 - 0.00% -
462.libquantum (max) -16.67% 6.000 5.000 - 0.00% -
429.mcf (max) -12.05% 166.000 146.000 - 0.00% -
410.bwaves (max) -11.26% 151.000 134.000 - 0.00% -
410.bwaves (max) (percentage) -11.26% 3.820 3.390 - 0.00% -
429.mcf (max) (percentage) -11.11% 8.280 7.360 - 0.00% -
470.lbm (max) (percentage) -10.98% 1.730 1.540 - 0.00% -
470.lbm (max) -10.17% 59.000 53.000 - 0.00% -
462.libquantum (max) (percentage) -10.00% 8.000 7.200 - 0.00% -
458.sjeng (max) (percentage) -8.78% 1.480 1.350 - 0.00% -
435.gromacs (max) -8.33% 288.000 264.000 - 0.00% -
458.sjeng (max) -7.87% 89.000 82.000 - 0.00% -
435.gromacs (max) (percentage) -6.48% 5.710 5.340 - 0.00% -
444.namd (max) (percentage) -6.47% 1.700 1.590 - 0.00% -
434.zeusmp -5.26% 19.000 18.000 - 0.00% -
434.zeusmp (avg) -5.26% 19.000 18.000 - 0.00% -
401.bzip2 (max) (percentage) -4.72% 7.410 7.060 - 0.00% -
437.leslie3d (max) (percentage) -4.66% 5.370 5.120 - 0.00% -
401.bzip2 (max) -4.35% 207.000 198.000 - 0.00% -
433.milc (max) -4.35% 23.000 22.000 - 0.00% -
471.omnetpp (max) -4.12% 170.000 163.000 - 0.00% -
473.astar (max) -4.07% 221.000 212.000 - 0.00% -
459.GemsFDTD (max) -3.98% 176.000 169.000 - 0.00% -
434.zeusmp (max) -3.64% 55.000 53.000 - 0.00% -
450.soplex (max) -3.57% 28.000 27.000 - 0.00% -
450.soplex (max) (percentage) -3.55% 5.350 5.160 - 0.00% -
434.zeusmp (max) (percentage) -3.53% 3.120 3.010 - 0.00% -
473.astar (max) (percentage) -3.52% 4.830 4.660 - 0.00% -
437.leslie3d (max) -3.52% 341.000 329.000 - 0.00% -
447.dealII (max) (percentage) -3.51% 2.280 2.200 - 0.00% -
471.omnetpp (max) (percentage) -3.38% 7.990 7.720 - 0.00% -
459.GemsFDTD (max) (percentage) -3.36% 3.870 3.740 - 0.00% -
445.gobmk (max) (percentage) -3.29% 3.650 3.530 - 0.00% -
445.gobmk (max) -3.07% 163.000 158.000 - 0.00% -
453.povray (max) (percentage) -2.82% 1.770 1.720 - 0.00% -
465.tonto (max) (percentage) -2.52% 1.590 1.550 - 0.00% -
429.mcf -2.44% 82.000 80.000 - 0.00% -
429.mcf (avg) -2.44% 82.000 80.000 - 0.00% -
482.sphinx3 (max) (percentage) -2.30% 8.700 8.500 - 0.00% -
433.milc (max) (percentage) -2.16% 2.320 2.270 - 0.00% -
482.sphinx3 (max) -1.69% 59.000 58.000 - 0.00% -
435.gromacs -1.64% 122.000 120.000 - 0.00% -
435.gromacs (avg) -1.64% 122.000 120.000 - 0.00% -
465.tonto (max) -1.56% 128.000 126.000 - 0.00% -
459.GemsFDTD -1.33% 75.000 74.000 - 0.00% -
459.GemsFDTD (avg) -1.33% 75.000 74.000 - 0.00% -

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
470.lbm 34.12% 11256.000 15096.000 - 0.00% -
444.namd 20.87% 235533.000 284677.000 - -0.04% -
429.mcf 8.50% 10100.000 10959.000 - 0.00% -
482.sphinx3 7.23% 153776.000 164887.000 - -0.06% -
410.bwaves 6.55% 26143.000 27855.000 - 0.00% -
437.leslie3d 5.02% 100088.000 105109.000 - 0.09% -
445.gobmk 4.01% 1878607.000 1954027.000 - 0.00% -
450.soplex 3.48% 326173.000 337521.000 - 0.02% -
453.povray 2.63% 1083050.000 1111514.000 - -0.44% -
434.zeusmp 2.34% 296597.000 303535.000 - 1.05% -
471.omnetpp 1.74% 652766.000 664125.000 - 0.00% -
458.sjeng 1.18% 156546.000 158394.000 - -0.20% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
429.mcf 11.40% 1790.000 1994.000 - -0.99% -
450.soplex 8.72% 493.000 536.000 - 0.37% -
401.bzip2 7.66% 2612.000 2812.000 - 0.64% -
433.milc 6.97% 932.000 997.000 - -0.60% -
434.zeusmp 4.68% 1709.000 1789.000 - -0.22% -
471.omnetpp 3.21% 2057.000 2123.000 - -0.47% -
444.namd 2.75% 618.000 635.000 - 0.79% -
445.gobmk 2.64% 4363.000 4478.000 - 0.09% -
462.libquantum 2.50% 80.000 82.000 - 1.23% -
447.dealII 1.20% 996.000 1008.000 - 0.90% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -31.03% 29.000 20.000 - 0.00% -
nb_execution_successful -31.03% 29.000 20.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
459.GemsFDTD -3.20% 376580.000 364532.000 - -1.08% -
462.libquantum -2.36% 22168.000 21644.000 - 0.15% -
447.dealII -1.50% 480818.000 473583.000 - -0.01% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
482.sphinx3 -10.77% 771.000 688.000 - 1.33% -
465.tonto -5.53% 8627.000 8150.000 - 1.18% -
470.lbm -4.94% 3644.000 3464.000 - 0.35% -
437.leslie3d -4.40% 6730.000 6434.000 - 1.18% -
453.povray -3.20% 375.000 363.000 - -1.63% -
410.bwaves -1.54% 4016.000 3954.000 - 0.03% -
459.GemsFDTD -1.01% 4574.000 4528.000 - -0.75% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 31.03% 29.000 38.000 - 0.00% -

Added Tests - sample variability
400.perlbench (avg) (percentage)
400.perlbench (max) (percentage)
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
403.gcc (avg) (percentage)
403.gcc (max) (percentage)
410.bwaves
410.bwaves (avg)
410.bwaves (avg) (percentage)
410.bwaves (max)
410.bwaves (max) (percentage)
416.gamess (avg) (percentage)
416.gamess (max) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
433.milc
433.milc (avg)
433.milc (avg) (percentage)
433.milc (max)
433.milc (max) (percentage)
434.zeusmp
434.zeusmp (avg)
434.zeusmp (avg) (percentage)
434.zeusmp (max)
434.zeusmp (max) (percentage)
435.gromacs
435.gromacs (avg)
435.gromacs (avg) (percentage)
435.gromacs (max)
435.gromacs (max) (percentage)
436.cactusADM (avg) (percentage)
436.cactusADM (max) (percentage)
437.leslie3d
437.leslie3d (avg)
437.leslie3d (avg) (percentage)
437.leslie3d (max)
437.leslie3d (max) (percentage)
444.namd
444.namd (avg)
444.namd (avg) (percentage)
444.namd (max)
444.namd (max) (percentage)
445.gobmk
445.gobmk (avg)
445.gobmk (avg) (percentage)
445.gobmk (max)
445.gobmk (max) (percentage)
447.dealII
447.dealII (avg)
447.dealII (avg) (percentage)
447.dealII (max)
447.dealII (max) (percentage)
450.soplex
450.soplex (avg)
450.soplex (avg) (percentage)
450.soplex (max)
450.soplex (max) (percentage)
453.povray
453.povray (avg)
453.povray (avg) (percentage)
453.povray (max)
453.povray (max) (percentage)
454.calculix (avg) (percentage)
454.calculix (max) (percentage)
456.hmmer (avg) (percentage)
456.hmmer (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
459.GemsFDTD
459.GemsFDTD (avg)
459.GemsFDTD (avg) (percentage)
459.GemsFDTD (max)
459.GemsFDTD (max) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)
464.h264ref (avg) (percentage)
464.h264ref (max) (percentage)
465.tonto
465.tonto (avg)
465.tonto (avg) (percentage)
465.tonto (max)
465.tonto (max) (percentage)
470.lbm
470.lbm (avg)
470.lbm (avg) (percentage)
470.lbm (max)
470.lbm (max) (percentage)
471.omnetpp
471.omnetpp (avg)
471.omnetpp (avg) (percentage)
471.omnetpp (max)
471.omnetpp (max) (percentage)
473.astar
473.astar (avg)
473.astar (avg) (percentage)
473.astar (max)
473.astar (max) (percentage)
481.wrf (avg) (percentage)
481.wrf (max) (percentage)
482.sphinx3
482.sphinx3 (avg)
482.sphinx3 (avg) (percentage)
482.sphinx3 (max)
482.sphinx3 (max) (percentage)
483.xalancbmk (avg) (percentage)
483.xalancbmk (max) (percentage)


Report Time: 0.34s
Name Current %
401.bzip2 2812.000 -
410.bwaves 3954.000 -
429.mcf 1994.000 -
433.milc 997.000 -
434.zeusmp 1789.000 -
435.gromacs 4944.000 -2.25%
437.leslie3d 6434.000 1.18%
444.namd 635.000 -
445.gobmk 4478.000 -
447.dealII 1008.000 -
450.soplex 536.000 -
453.povray 363.000 -1.63%
458.sjeng 6075.000 -
459.GemsFDTD 4528.000 -
462.libquantum 82.000 1.23%
465.tonto 8150.000 1.18%
470.lbm 3464.000 -
471.omnetpp 2123.000 -
473.astar 4565.000 -
482.sphinx3 688.000 1.33%
Geometric Mean 1878.022 -
Name Current %
401.bzip2 72353.000 -
410.bwaves 27855.000 -
429.mcf 10959.000 -
433.milc 94008.000 -
434.zeusmp 303535.000 1.05%
435.gromacs 729429.000 -
437.leslie3d 105109.000 -
444.namd 284677.000 -
445.gobmk 1954027.000 -
447.dealII 473583.000 -
450.soplex 337521.000 -
453.povray 1111514.000 -
458.sjeng 158394.000 -
459.GemsFDTD 364532.000 -1.08%
462.libquantum 21644.000 -
465.tonto 2822102.000 -
470.lbm 15096.000 -
471.omnetpp 664125.000 -
473.astar 30901.000 -
482.sphinx3 164887.000 -
Geometric Mean 176495.591 -
Name Current %
400.perlbench (avg) (percentage) 2.510 -
400.perlbench (max) (percentage) 2.130 -
401.bzip2 48.000 -
401.bzip2 (avg) 48.000 -
401.bzip2 (avg) (percentage) 1.730 -
401.bzip2 (max) 198.000 -4.35%
401.bzip2 (max) (percentage) 7.060 -4.72%
403.gcc (avg) (percentage) 5.640 -
403.gcc (max) (percentage) 7.210 -
410.bwaves 61.000 -
410.bwaves (avg) 61.000 -
410.bwaves (avg) (percentage) 1.560 -
410.bwaves (max) 134.000 -11.26%
410.bwaves (max) (percentage) 3.390 -11.26%
416.gamess (avg) (percentage) 0.250 -
416.gamess (max) (percentage) 0.160 -
429.mcf 80.000 -2.44%
429.mcf (avg) 80.000 -2.44%
429.mcf (avg) (percentage) 4.060 -
429.mcf (max) 146.000 -12.05%
429.mcf (max) (percentage) 7.360 -11.11%
429.mcf (unexplained diff vs previous) 20.000 17.65%
429.mcf (unexplained diff vs previous) (percentage) 1.000 19.05%
433.milc 14.000 -
433.milc (avg) 14.000 -
433.milc (avg) (percentage) 1.490 -
433.milc (max) 22.000 -4.35%
433.milc (max) (percentage) 2.270 -2.16%
434.zeusmp 18.000 -5.26%
434.zeusmp (avg) 18.000 -5.26%
434.zeusmp (avg) (percentage) 1.060 -
434.zeusmp (max) 53.000 -3.64%
434.zeusmp (max) (percentage) 3.010 -3.53%
435.gromacs 120.000 -1.64%
435.gromacs (avg) 120.000 -1.64%
435.gromacs (avg) (percentage) 2.430 -
435.gromacs (max) 264.000 -8.33%
435.gromacs (max) (percentage) 5.340 -6.48%
436.cactusADM (avg) (percentage) 0.990 -
436.cactusADM (max) (percentage) 1.530 -
437.leslie3d 277.000 1.09%
437.leslie3d (avg) 277.000 1.09%
437.leslie3d (avg) (percentage) 4.320 -
437.leslie3d (max) 329.000 -3.52%
437.leslie3d (max) (percentage) 5.120 -4.66%
444.namd 6.000 -
444.namd (avg) 6.000 -
444.namd (avg) (percentage) 1.090 -
444.namd (max) 10.000 -
444.namd (max) (percentage) 1.590 -6.47%
445.gobmk 51.000 -
445.gobmk (avg) 51.000 -
445.gobmk (avg) (percentage) 1.160 -
445.gobmk (max) 158.000 -3.07%
445.gobmk (max) (percentage) 3.530 -3.29%
447.dealII 13.000 -
447.dealII (avg) 13.000 -
447.dealII (avg) (percentage) 1.370 -
447.dealII (max) 22.000 -
447.dealII (max) (percentage) 2.200 -3.51%
450.soplex 15.000 -
450.soplex (avg) 15.000 -
450.soplex (avg) (percentage) 2.910 -
450.soplex (max) 27.000 -3.57%
450.soplex (max) (percentage) 5.160 -3.55%
453.povray 5.000 -
453.povray (avg) 5.000 -
453.povray (avg) (percentage) 1.500 -
453.povray (max) 6.000 -
453.povray (max) (percentage) 1.720 -2.82%
454.calculix (avg) (percentage) 3.100 -
454.calculix (max) (percentage) 2.940 -
456.hmmer (avg) (percentage) 0.780 -
456.hmmer (max) (percentage) 1.140 -
458.sjeng 38.000 -
458.sjeng (avg) 38.000 -
458.sjeng (avg) (percentage) 0.640 -
458.sjeng (max) 82.000 -7.87%
458.sjeng (max) (percentage) 1.350 -8.78%
459.GemsFDTD 74.000 -1.33%
459.GemsFDTD (avg) 74.000 -1.33%
459.GemsFDTD (avg) (percentage) 1.650 -
459.GemsFDTD (max) 169.000 -3.98%
459.GemsFDTD (max) (percentage) 3.740 -3.36%
462.libquantum 2.000 -
462.libquantum (avg) 2.000 -
462.libquantum (avg) (percentage) 3.390 -
462.libquantum (max) 5.000 -16.67%
462.libquantum (max) (percentage) 7.200 -10.00%
464.h264ref (avg) (percentage) 0.730 -
464.h264ref (max) (percentage) 1.590 -
465.tonto 96.000 1.05%
465.tonto (avg) 96.000 1.05%
465.tonto (avg) (percentage) 1.180 -
465.tonto (max) 126.000 -1.56%
465.tonto (max) (percentage) 1.550 -2.52%
470.lbm 41.000 -
470.lbm (avg) 41.000 -
470.lbm (avg) (percentage) 1.200 -
470.lbm (max) 53.000 -10.17%
470.lbm (max) (percentage) 1.540 -10.98%
470.lbm (unexplained diff vs previous) 12.000 -36.84%
470.lbm (unexplained diff vs previous) (percentage) 0.350 -36.36%
471.omnetpp 42.000 -
471.omnetpp (avg) 42.000 -
471.omnetpp (avg) (percentage) 1.990 -
471.omnetpp (max) 163.000 -4.12%
471.omnetpp (max) (percentage) 7.720 -3.38%
473.astar 98.000 -
473.astar (avg) 98.000 -
473.astar (avg) (percentage) 2.160 -
473.astar (max) 212.000 -4.07%
473.astar (max) (percentage) 4.660 -3.52%
481.wrf (avg) (percentage) 1.890 -
481.wrf (max) (percentage) 0.680 -
482.sphinx3 16.000 -
482.sphinx3 (avg) 16.000 -
482.sphinx3 (avg) (percentage) 2.410 -
482.sphinx3 (max) 58.000 -1.69%
482.sphinx3 (max) (percentage) 8.500 -2.30%
483.xalancbmk (avg) (percentage) 2.740 -
483.xalancbmk (max) (percentage) 1.840 -
Geometric Mean 9.073 -2.43%