Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=c67b2ee18a9e064243902c265cb9b24aa736bdab (unchanged)
git_gcc https://gcc.gnu.org/git/gcc.git (8335fd561fa823d32556512c09dfce44463e8eaa) (+ 1 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=2c421fc4302ecb729823ca442f9dfab95afba752 (unchanged)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/f1f8a95d093efd12e3e7a66cb387389471fa25a6 (unchanged)
regression GNU-1582
test_url https://ci.linaro.org/job/tcwg_bmk-code_vect-spec2k6--gnu-aarch64-master-O3-build/384/
Filter

gnu-aarch64-master-O3 test results

Run Order Start Time Duration
Current 0384 (basepoints/gcc-16-00448-g8335fd561fa) 2025-05-16T18:54:24 0:00:00
Previous 0383 (basepoints/gcc-16-00447-g2c8d632d9ed) 2025-05-13T19:35:58 0:00:00
Baseline 0001 (4-changed-components) 2023-03-07T16:12:14 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 11 26
Performance Improvements 83 5
Added Tests 6 120
Unchanged Tests 1016 965
Total Tests 1116

Performance Regressions - Code Size Δ Previous Current σ Δ (B) σ (B)
459.GemsFDTD 1.16% 362944.000 367168.000 - -0.72% -

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
429.mcf 14.57% 1723.000 1974.000 - -1.30% -
435.gromacs 5.10% 4749.000 4991.000 - 0.85% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
429.mcf 17.65% 85.000 100.000 - 0.00% -
429.mcf (avg) 17.65% 85.000 100.000 - 0.00% -
429.mcf (max) 9.54% 262.000 287.000 - 0.00% -
435.gromacs 4.92% 122.000 128.000 - 0.00% -
435.gromacs (avg) 4.92% 122.000 128.000 - 0.00% -
471.omnetpp (avg) (percentage) 3.13% 2.560 2.640 - 0.00% -
429.mcf (avg) (percentage) 2.63% 4.940 5.070 - 0.00% -
410.bwaves (avg) (percentage) 2.60% 1.540 1.580 - 0.00% -

Performance Improvements - Code Size Δ Previous Current σ Δ (B) σ (B)
437.leslie3d -3.86% 119831.000 115207.000 - 5.17% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
471.omnetpp -7.80% 2564.000 2364.000 - 0.98% -
401.bzip2 -7.45% 3113.000 2881.000 - 7.42% -
434.zeusmp -6.03% 1891.000 1777.000 - 1.02% -
447.dealII -5.02% 1395.000 1325.000 - 0.00% -
473.astar -4.72% 5130.000 4888.000 - 5.10% -
410.bwaves -4.37% 4553.000 4354.000 - 1.63% -
482.sphinx3 -3.67% 736.000 709.000 - -5.72% -
445.gobmk -3.28% 4972.000 4809.000 - 3.64% -
450.soplex -2.39% 587.000 573.000 - 5.91% -
459.GemsFDTD -2.26% 4647.000 4542.000 - 5.29% -
470.lbm -2.20% 3498.000 3421.000 - 4.49% -
437.leslie3d -1.76% 6472.000 6358.000 - -8.12% -
458.sjeng -1.48% 6561.000 6464.000 - 0.26% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
433.milc (unexplained diff vs previous) -52.63% 19.000 9.000 - 0.00% -
433.milc (unexplained diff vs previous) (percentage) -51.96% 1.790 0.860 - 0.00% -
429.mcf (unexplained diff vs previous) (percentage) -29.06% 17.930 12.720 - 0.00% -
458.sjeng (unexplained diff vs previous) -25.95% 131.000 97.000 - 0.00% -
458.sjeng (unexplained diff vs previous) (percentage) -25.00% 2.000 1.500 - 0.00% -
410.bwaves (unexplained diff vs previous) -24.91% 265.000 199.000 - 0.00% -
410.bwaves (unexplained diff vs previous) (percentage) -21.48% 5.820 4.570 - 0.00% -
471.omnetpp (unexplained diff vs previous) -19.68% 249.000 200.000 - 0.00% -
429.mcf (unexplained diff vs previous) -18.77% 309.000 251.000 - 0.00% -
471.omnetpp (max) -17.09% 275.000 228.000 - 0.00% -
410.bwaves (max) -13.88% 281.000 242.000 - 0.00% -
471.omnetpp (unexplained diff vs previous) (percentage) -12.87% 9.710 8.460 - 0.00% -
462.libquantum (max) -12.50% 8.000 7.000 - 0.00% -
401.bzip2 (max) -12.21% 344.000 302.000 - 0.00% -
458.sjeng (max) -11.28% 133.000 118.000 - 0.00% -
434.zeusmp (max) -10.71% 112.000 100.000 - 0.00% -
471.omnetpp (max) (percentage) -10.04% 10.760 9.680 - 0.00% -
410.bwaves (max) (percentage) -10.03% 6.180 5.560 - 0.00% -
458.sjeng (max) (percentage) -9.80% 2.040 1.840 - 0.00% -
401.bzip2 -8.00% 75.000 69.000 - 0.00% -
401.bzip2 (avg) -8.00% 75.000 69.000 - 0.00% -
473.astar (max) -7.56% 291.000 269.000 - 0.00% -
447.dealII (max) -7.37% 95.000 88.000 - 0.00% -
435.gromacs (max) (percentage) -7.23% 3.460 3.210 - 0.00% -
450.soplex (max) -6.67% 75.000 70.000 - 0.00% -
482.sphinx3 (max) -6.15% 65.000 61.000 - 0.00% -
445.gobmk (max) -5.84% 154.000 145.000 - 0.00% -
459.GemsFDTD (max) -5.43% 184.000 174.000 - 0.00% -
437.leslie3d (max) -5.41% 462.000 437.000 - 0.00% -
447.dealII -5.26% 19.000 18.000 - 0.00% -
447.dealII (avg) -5.26% 19.000 18.000 - 0.00% -
462.libquantum (max) (percentage) -5.20% 10.000 9.480 - 0.00% -
434.zeusmp (max) (percentage) -5.05% 5.940 5.640 - 0.00% -
401.bzip2 (max) (percentage) -4.97% 11.060 10.510 - 0.00% -
470.lbm (max) -4.84% 124.000 118.000 - 0.00% -
473.astar -4.65% 129.000 123.000 - 0.00% -
473.astar (avg) -4.65% 129.000 123.000 - 0.00% -
471.omnetpp -4.62% 65.000 62.000 - 0.00% -
471.omnetpp (avg) -4.62% 65.000 62.000 - 0.00% -
444.namd (max) -4.55% 22.000 21.000 - 0.00% -
450.soplex -4.35% 23.000 22.000 - 0.00% -
450.soplex (avg) -4.35% 23.000 22.000 - 0.00% -
429.mcf (max) (percentage) -4.21% 15.210 14.570 - 0.00% -
434.zeusmp -4.00% 25.000 24.000 - 0.00% -
434.zeusmp (avg) -4.00% 25.000 24.000 - 0.00% -
445.gobmk -3.77% 53.000 51.000 - 0.00% -
445.gobmk (avg) -3.77% 53.000 51.000 - 0.00% -
437.leslie3d (max) (percentage) -3.64% 7.140 6.880 - 0.00% -
482.sphinx3 (max) (percentage) -3.58% 8.940 8.620 - 0.00% -
450.soplex (max) (percentage) -3.51% 12.830 12.380 - 0.00% -
465.tonto (max) -3.37% 208.000 201.000 - 0.00% -
465.tonto (max) (percentage) -3.20% 2.500 2.420 - 0.00% -
453.povray (max) (percentage) -3.14% 5.410 5.240 - 0.00% -
470.lbm (max) (percentage) -3.09% 3.560 3.450 - 0.00% -
459.GemsFDTD (max) (percentage) -3.03% 3.960 3.840 - 0.00% -
473.astar (max) (percentage) -2.99% 5.680 5.510 - 0.00% -
444.namd (max) (percentage) -2.90% 3.450 3.350 - 0.00% -
445.gobmk (max) (percentage) -2.89% 3.110 3.020 - 0.00% -
410.bwaves -2.86% 70.000 68.000 - 0.00% -
410.bwaves (avg) -2.86% 70.000 68.000 - 0.00% -
459.GemsFDTD -2.78% 72.000 70.000 - 0.00% -
459.GemsFDTD (avg) -2.78% 72.000 70.000 - 0.00% -
435.gromacs (max) -2.44% 164.000 160.000 - 0.00% -
470.lbm -2.22% 45.000 44.000 - 0.00% -
470.lbm (avg) -2.22% 45.000 44.000 - 0.00% -
447.dealII (max) (percentage) -1.91% 6.820 6.690 - 0.00% -
437.leslie3d -1.69% 237.000 233.000 - 0.00% -
437.leslie3d (avg) -1.69% 237.000 233.000 - 0.00% -
462.libquantum (avg) (percentage) -1.47% 2.720 2.680 - 0.00% -

Added Tests - sample variability
444.namd (unexplained diff vs previous)
444.namd (unexplained diff vs previous) (percentage)
462.libquantum (unexplained diff vs previous)
462.libquantum (unexplained diff vs previous) (percentage)
470.lbm (unexplained diff vs previous)
470.lbm (unexplained diff vs previous) (percentage)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
444.namd 22.08% 236982.000 289297.000 - 0.00% -
410.bwaves 13.93% 24460.000 27868.000 - 0.00% -
429.mcf 5.33% 12224.000 12875.000 - 0.00% -
450.soplex 5.28% 425268.000 447734.000 - 0.14% -
437.leslie3d 5.17% 109542.000 115207.000 - -3.86% -
433.milc 4.95% 135823.000 142542.000 - 0.32% -
453.povray 4.70% 1000090.000 1047045.000 - -0.09% -
445.gobmk 4.35% 1662239.000 1734531.000 - -0.25% -
482.sphinx3 3.76% 203848.000 211515.000 - -0.03% -
471.omnetpp 1.98% 682768.000 696303.000 - 0.01% -
447.dealII 1.74% 3212233.000 3267989.000 - 0.02% -
434.zeusmp 1.54% 308615.000 313365.000 - -0.03% -
465.tonto 1.35% 3968188.000 4021806.000 - -0.03% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
401.bzip2 7.42% 2682.000 2881.000 - -7.45% -
462.libquantum 6.41% 78.000 83.000 - 0.00% -
450.soplex 5.91% 541.000 573.000 - -2.39% -
459.GemsFDTD 5.29% 4314.000 4542.000 - -2.26% -
465.tonto 5.26% 7891.000 8306.000 - -0.50% -
473.astar 5.10% 4651.000 4888.000 - -4.72% -
470.lbm 4.49% 3274.000 3421.000 - -2.20% -
445.gobmk 3.64% 4640.000 4809.000 - -3.28% -
410.bwaves 1.63% 4284.000 4354.000 - -4.37% -
444.namd 1.42% 635.000 644.000 - -0.77% -
434.zeusmp 1.02% 1759.000 1777.000 - -6.03% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -31.03% 29.000 20.000 - 0.00% -
nb_execution_successful -31.03% 29.000 20.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d -8.12% 6920.000 6358.000 - -1.76% -
482.sphinx3 -5.72% 752.000 709.000 - -3.67% -
453.povray -3.59% 418.000 403.000 - 0.75% -
429.mcf -1.30% 2000.000 1974.000 - 14.57% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 31.03% 29.000 38.000 - 0.00% -

Added Tests - sample variability
400.perlbench (avg) (percentage)
400.perlbench (max) (percentage)
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
403.gcc (avg) (percentage)
403.gcc (max) (percentage)
410.bwaves
410.bwaves (avg)
410.bwaves (avg) (percentage)
410.bwaves (max)
410.bwaves (max) (percentage)
416.gamess (avg) (percentage)
416.gamess (max) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
433.milc
433.milc (avg)
433.milc (avg) (percentage)
433.milc (max)
433.milc (max) (percentage)
434.zeusmp
434.zeusmp (avg)
434.zeusmp (avg) (percentage)
434.zeusmp (max)
434.zeusmp (max) (percentage)
435.gromacs
435.gromacs (avg)
435.gromacs (avg) (percentage)
435.gromacs (max)
435.gromacs (max) (percentage)
436.cactusADM (avg) (percentage)
436.cactusADM (max) (percentage)
437.leslie3d
437.leslie3d (avg)
437.leslie3d (avg) (percentage)
437.leslie3d (max)
437.leslie3d (max) (percentage)
444.namd
444.namd (avg)
444.namd (avg) (percentage)
444.namd (max)
444.namd (max) (percentage)
445.gobmk
445.gobmk (avg)
445.gobmk (avg) (percentage)
445.gobmk (max)
445.gobmk (max) (percentage)
447.dealII
447.dealII (avg)
447.dealII (avg) (percentage)
447.dealII (max)
447.dealII (max) (percentage)
450.soplex
450.soplex (avg)
450.soplex (avg) (percentage)
450.soplex (max)
450.soplex (max) (percentage)
453.povray
453.povray (avg)
453.povray (avg) (percentage)
453.povray (max)
453.povray (max) (percentage)
454.calculix (avg) (percentage)
454.calculix (max) (percentage)
456.hmmer (avg) (percentage)
456.hmmer (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
459.GemsFDTD
459.GemsFDTD (avg)
459.GemsFDTD (avg) (percentage)
459.GemsFDTD (max)
459.GemsFDTD (max) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)
462.libquantum (unexplained diff vs previous)
462.libquantum (unexplained diff vs previous) (percentage)
464.h264ref (avg) (percentage)
464.h264ref (max) (percentage)
465.tonto
465.tonto (avg)
465.tonto (avg) (percentage)
465.tonto (max)
465.tonto (max) (percentage)
470.lbm
470.lbm (avg)
470.lbm (avg) (percentage)
470.lbm (max)
470.lbm (max) (percentage)
471.omnetpp
471.omnetpp (avg)
471.omnetpp (avg) (percentage)
471.omnetpp (max)
471.omnetpp (max) (percentage)
473.astar
473.astar (avg)
473.astar (avg) (percentage)
473.astar (max)
473.astar (max) (percentage)
481.wrf (avg) (percentage)
481.wrf (max) (percentage)
482.sphinx3
482.sphinx3 (avg)
482.sphinx3 (avg) (percentage)
482.sphinx3 (max)
482.sphinx3 (max) (percentage)
483.xalancbmk (avg) (percentage)
483.xalancbmk (max) (percentage)


Report Time: 0.36s
Name Current %
401.bzip2 2881.000 -7.45%
410.bwaves 4354.000 -4.37%
429.mcf 1974.000 14.57%
433.milc 1051.000 -
434.zeusmp 1777.000 -6.03%
435.gromacs 4991.000 5.10%
437.leslie3d 6358.000 -1.76%
444.namd 644.000 -
445.gobmk 4809.000 -3.28%
447.dealII 1325.000 -5.02%
450.soplex 573.000 -2.39%
453.povray 403.000 -
458.sjeng 6464.000 -1.48%
459.GemsFDTD 4542.000 -2.26%
462.libquantum 83.000 -
465.tonto 8306.000 -
470.lbm 3421.000 -2.20%
471.omnetpp 2364.000 -7.80%
473.astar 4888.000 -4.72%
482.sphinx3 709.000 -3.67%
Geometric Mean 1971.739 -1.81%
Name Current %
401.bzip2 83101.000 -
410.bwaves 27868.000 -
429.mcf 12875.000 -
433.milc 142542.000 -
434.zeusmp 313365.000 -
435.gromacs 954366.000 -
437.leslie3d 115207.000 -3.86%
444.namd 289297.000 -
445.gobmk 1734531.000 -
447.dealII 3267989.000 -
450.soplex 447734.000 -
453.povray 1047045.000 -
458.sjeng 162907.000 -
459.GemsFDTD 367168.000 1.16%
462.libquantum 40484.000 -
465.tonto 4021806.000 -
470.lbm 12817.000 -
471.omnetpp 696303.000 -
473.astar 42133.000 -
482.sphinx3 211515.000 -
Geometric Mean 222343.680 -
Name Current %
400.perlbench (avg) (percentage) 1.890 -
400.perlbench (max) (percentage) 0.750 -
401.bzip2 69.000 -8.00%
401.bzip2 (avg) 69.000 -8.00%
401.bzip2 (avg) (percentage) 2.420 -
401.bzip2 (max) 302.000 -12.21%
401.bzip2 (max) (percentage) 10.510 -4.97%
403.gcc (avg) (percentage) 4.820 -
403.gcc (max) (percentage) 10.550 -
410.bwaves 68.000 -2.86%
410.bwaves (avg) 68.000 -2.86%
410.bwaves (avg) (percentage) 1.580 2.60%
410.bwaves (max) 242.000 -13.88%
410.bwaves (max) (percentage) 5.560 -10.03%
410.bwaves (unexplained diff vs previous) 199.000 -24.91%
410.bwaves (unexplained diff vs previous) (percentage) 4.570 -21.48%
416.gamess (avg) (percentage) 0.250 -
416.gamess (max) (percentage) 0.470 -
429.mcf 100.000 17.65%
429.mcf (avg) 100.000 17.65%
429.mcf (avg) (percentage) 5.070 2.63%
429.mcf (max) 287.000 9.54%
429.mcf (max) (percentage) 14.570 -4.21%
429.mcf (unexplained diff vs previous) 251.000 -18.77%
429.mcf (unexplained diff vs previous) (percentage) 12.720 -29.06%
433.milc 15.000 -
433.milc (avg) 15.000 -
433.milc (avg) (percentage) 1.490 -
433.milc (max) 25.000 -
433.milc (max) (percentage) 2.440 -
433.milc (unexplained diff vs previous) 9.000 -52.63%
433.milc (unexplained diff vs previous) (percentage) 0.860 -51.96%
434.zeusmp 24.000 -4.00%
434.zeusmp (avg) 24.000 -4.00%
434.zeusmp (avg) (percentage) 1.360 -
434.zeusmp (max) 100.000 -10.71%
434.zeusmp (max) (percentage) 5.640 -5.05%
435.gromacs 128.000 4.92%
435.gromacs (avg) 128.000 4.92%
435.gromacs (avg) (percentage) 2.570 -
435.gromacs (max) 160.000 -2.44%
435.gromacs (max) (percentage) 3.210 -7.23%
436.cactusADM (avg) (percentage) 1.020 -
436.cactusADM (max) (percentage) 1.610 -
437.leslie3d 233.000 -1.69%
437.leslie3d (avg) 233.000 -1.69%
437.leslie3d (avg) (percentage) 3.670 -
437.leslie3d (max) 437.000 -5.41%
437.leslie3d (max) (percentage) 6.880 -3.64%
444.namd 6.000 -
444.namd (avg) 6.000 -
444.namd (avg) (percentage) 1.040 -
444.namd (max) 21.000 -4.55%
444.namd (max) (percentage) 3.350 -2.90%
444.namd (unexplained diff vs previous) 5.000 -
444.namd (unexplained diff vs previous) (percentage) 0.780 -
445.gobmk 51.000 -3.77%
445.gobmk (avg) 51.000 -3.77%
445.gobmk (avg) (percentage) 1.080 -
445.gobmk (max) 145.000 -5.84%
445.gobmk (max) (percentage) 3.020 -2.89%
447.dealII 18.000 -5.26%
447.dealII (avg) 18.000 -5.26%
447.dealII (avg) (percentage) 1.420 -
447.dealII (max) 88.000 -7.37%
447.dealII (max) (percentage) 6.690 -1.91%
450.soplex 22.000 -4.35%
450.soplex (avg) 22.000 -4.35%
450.soplex (avg) (percentage) 3.980 -
450.soplex (max) 70.000 -6.67%
450.soplex (max) (percentage) 12.380 -3.51%
453.povray 6.000 -
453.povray (avg) 6.000 -
453.povray (avg) (percentage) 1.560 -
453.povray (max) 21.000 -
453.povray (max) (percentage) 5.240 -3.14%
454.calculix (avg) (percentage) 2.830 -
454.calculix (max) (percentage) 1.010 -
456.hmmer (avg) (percentage) 0.820 -
456.hmmer (max) (percentage) 1.120 -
458.sjeng 53.000 -
458.sjeng (avg) 53.000 -
458.sjeng (avg) (percentage) 0.820 -
458.sjeng (max) 118.000 -11.28%
458.sjeng (max) (percentage) 1.840 -9.80%
458.sjeng (unexplained diff vs previous) 97.000 -25.95%
458.sjeng (unexplained diff vs previous) (percentage) 1.500 -25.00%
459.GemsFDTD 70.000 -2.78%
459.GemsFDTD (avg) 70.000 -2.78%
459.GemsFDTD (avg) (percentage) 1.560 -
459.GemsFDTD (max) 174.000 -5.43%
459.GemsFDTD (max) (percentage) 3.840 -3.03%
462.libquantum 2.000 -
462.libquantum (avg) 2.000 -
462.libquantum (avg) (percentage) 2.680 -1.47%
462.libquantum (max) 7.000 -12.50%
462.libquantum (max) (percentage) 9.480 -5.20%
462.libquantum (unexplained diff vs previous) 0.000 -
462.libquantum (unexplained diff vs previous) (percentage) 0.000 -
464.h264ref (avg) (percentage) 0.930 -
464.h264ref (max) (percentage) 1.370 -
465.tonto 98.000 -
465.tonto (avg) 98.000 -
465.tonto (avg) (percentage) 1.180 -
465.tonto (max) 201.000 -3.37%
465.tonto (max) (percentage) 2.420 -3.20%
470.lbm 44.000 -2.22%
470.lbm (avg) 44.000 -2.22%
470.lbm (avg) (percentage) 1.310 -
470.lbm (max) 118.000 -4.84%
470.lbm (max) (percentage) 3.450 -3.09%
470.lbm (unexplained diff vs previous) 77.000 -
470.lbm (unexplained diff vs previous) (percentage) 2.250 -
471.omnetpp 62.000 -4.62%
471.omnetpp (avg) 62.000 -4.62%
471.omnetpp (avg) (percentage) 2.640 3.13%
471.omnetpp (max) 228.000 -17.09%
471.omnetpp (max) (percentage) 9.680 -10.04%
471.omnetpp (unexplained diff vs previous) 200.000 -19.68%
471.omnetpp (unexplained diff vs previous) (percentage) 8.460 -12.87%
473.astar 123.000 -4.65%
473.astar (avg) 123.000 -4.65%
473.astar (avg) (percentage) 2.530 -
473.astar (max) 269.000 -7.56%
473.astar (max) (percentage) 5.510 -2.99%
481.wrf (avg) (percentage) 1.850 -
481.wrf (max) (percentage) 1.040 -
482.sphinx3 18.000 -
482.sphinx3 (avg) 18.000 -
482.sphinx3 (avg) (percentage) 2.550 -
482.sphinx3 (max) 61.000 -6.15%
482.sphinx3 (max) (percentage) 8.620 -3.58%
483.xalancbmk (avg) (percentage) 1.550 -
483.xalancbmk (max) (percentage) 2.380 -
Geometric Mean 9.789 -21.99%