Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=f3d834df28734ebc82931808960fe63401127c06 (unchanged)
git_gcc https://gcc.gnu.org/git/gcc.git (1a13684dfc7286139064f7d7341462c9995cbd1c) (+ 433 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=4f6dae219578d6df475864e273da40bde9d30806 (unchanged)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/d2cb798d2d8ceb0d194721a2cb0e577b4b927573 (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-aarch64-master-O2-build/401/
Filter

gnu-aarch64-master-O2 test results

Run Order Start Time Duration
Current 0401 (basepoints/gcc-16-00303-g1a13684dfc7) 2025-05-02T02:28:10 0:00:00
Previous 0398 (2-changed-components) 2025-04-28T15:19:02 0:00:00
Baseline 0002 (4-changed-components) 2023-03-27T00:00:07 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 9 19
Performance Improvements 59 12
Added Tests 0 118
Unchanged Tests 1060 979
Total Tests 1128

Performance Regressions - Code Size Δ Previous Current σ Δ (B) σ (B)
410.bwaves 3.59% 25752.000 26676.000 - 23.89% -
459.GemsFDTD 2.72% 308684.000 317076.000 - 7.33% -

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
435.gromacs 1.07% 5977.000 6041.000 - 15.15% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
429.mcf (unexplained diff vs previous) (percentage) 515.79% 0.190 1.170 - 0.00% -
429.mcf (unexplained diff vs previous) 500.00% 4.000 24.000 - 0.00% -
470.lbm (unexplained diff vs previous) 266.67% 3.000 11.000 - 0.00% -
470.lbm (unexplained diff vs previous) (percentage) 255.56% 0.090 0.320 - 0.00% -
445.gobmk 2.50% 40.000 41.000 - 0.00% -
445.gobmk (avg) 2.50% 40.000 41.000 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
465.tonto -2.90% 9268.000 8999.000 - -0.99% -
410.bwaves -1.60% 4368.000 4298.000 - -0.99% -
453.povray -1.59% 440.000 433.000 - 1.17% -
462.libquantum -1.30% 77.000 76.000 - -6.17% -
471.omnetpp -1.22% 2456.000 2426.000 - -9.14% -
429.mcf -1.16% 2069.000 2045.000 - 39.40% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
433.milc (max) (percentage) -79.26% 2.170 0.450 - 0.00% -
433.milc (max) -79.17% 24.000 5.000 - 0.00% -
473.astar (max) (percentage) -73.44% 1.920 0.510 - 0.00% -
473.astar (max) -73.20% 97.000 26.000 - 0.00% -
433.milc (unexplained diff vs previous) (percentage) -33.33% 0.540 0.360 - 0.00% -
433.milc (unexplained diff vs previous) -33.33% 6.000 4.000 - 0.00% -
462.libquantum (max) -25.00% 4.000 3.000 - 0.00% -
453.povray (max) -20.00% 5.000 4.000 - 0.00% -
447.dealII (max) -18.18% 11.000 9.000 - 0.00% -
473.astar (unexplained diff vs previous) (percentage) -16.39% 0.610 0.510 - 0.00% -
473.astar (unexplained diff vs previous) -16.13% 31.000 26.000 - 0.00% -
429.mcf (max) -12.50% 48.000 42.000 - 0.00% -
482.sphinx3 (max) (percentage) -11.27% 1.420 1.260 - 0.00% -
465.tonto (max) -11.11% 45.000 40.000 - 0.00% -
429.mcf (max) (percentage) -11.06% 2.350 2.090 - 0.00% -
447.dealII (max) (percentage) -10.98% 0.820 0.730 - 0.00% -
434.zeusmp (max) -9.09% 11.000 10.000 - 0.00% -
437.leslie3d (max) -9.09% 154.000 140.000 - 0.00% -
482.sphinx3 (max) -9.09% 11.000 10.000 - 0.00% -
437.leslie3d (max) (percentage) -8.70% 1.840 1.680 - 0.00% -
410.bwaves (max) -8.33% 96.000 88.000 - 0.00% -
444.namd (max) -8.33% 12.000 11.000 - 0.00% -
465.tonto (max) (percentage) -8.16% 0.490 0.450 - 0.00% -
470.lbm (max) -7.41% 27.000 25.000 - 0.00% -
434.zeusmp (max) (percentage) -6.90% 0.580 0.540 - 0.00% -
410.bwaves (max) (percentage) -6.76% 2.220 2.070 - 0.00% -
453.povray (max) (percentage) -5.93% 1.180 1.110 - 0.00% -
450.soplex (max) -4.76% 21.000 20.000 - 0.00% -
471.omnetpp (max) -4.48% 67.000 64.000 - 0.00% -
462.libquantum (max) (percentage) -4.38% 5.480 5.240 - 0.00% -
444.namd (max) (percentage) -4.09% 1.710 1.640 - 0.00% -
471.omnetpp (max) (percentage) -4.00% 2.750 2.640 - 0.00% -
450.soplex (max) (percentage) -3.93% 4.070 3.910 - 0.00% -
458.sjeng (max) -3.90% 77.000 74.000 - 0.00% -
470.lbm (max) (percentage) -3.85% 0.780 0.750 - 0.00% -
445.gobmk (max) (percentage) -3.60% 1.390 1.340 - 0.00% -
458.sjeng (max) (percentage) -3.39% 1.180 1.140 - 0.00% -
459.GemsFDTD (max) -3.26% 92.000 89.000 - 0.00% -
465.tonto -3.12% 96.000 93.000 - 0.00% -
465.tonto (avg) -3.12% 96.000 93.000 - 0.00% -
435.gromacs (max) (percentage) -3.03% 2.310 2.240 - 0.00% -
401.bzip2 (max) (percentage) -2.95% 6.770 6.570 - 0.00% -
459.GemsFDTD (max) (percentage) -2.93% 2.050 1.990 - 0.00% -
401.bzip2 (max) -2.54% 197.000 192.000 - 0.00% -
429.mcf -2.44% 82.000 80.000 - 0.00% -
429.mcf (avg) -2.44% 82.000 80.000 - 0.00% -
435.gromacs (max) -2.17% 138.000 135.000 - 0.00% -
471.omnetpp -1.96% 51.000 50.000 - 0.00% -
471.omnetpp (avg) -1.96% 51.000 50.000 - 0.00% -
410.bwaves -1.59% 63.000 62.000 - 0.00% -
410.bwaves (avg) -1.59% 63.000 62.000 - 0.00% -
445.gobmk (max) -1.52% 66.000 65.000 - 0.00% -
470.lbm (avg) (percentage) -1.02% 0.980 0.970 - 0.00% -

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
410.bwaves 23.89% 21532.000 26676.000 - 3.59% -
434.zeusmp 21.83% 203703.000 248173.000 - 0.71% -
459.GemsFDTD 7.33% 295414.000 317076.000 - 2.72% -
429.mcf 2.38% 12072.000 12359.000 - 0.00% -
465.tonto 1.90% 3263584.000 3325624.000 - 0.35% -
447.dealII 1.36% 2802286.000 2840389.000 - 0.22% -
482.sphinx3 1.23% 175488.000 177651.000 - -0.01% -
401.bzip2 1.06% 58669.000 59293.000 - 0.18% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
429.mcf 39.40% 1467.000 2045.000 - -1.16% -
435.gromacs 15.15% 5246.000 6041.000 - 1.07% -
444.namd 11.48% 636.000 709.000 - 0.57% -
459.GemsFDTD 6.73% 4220.000 4504.000 - 0.02% -
482.sphinx3 5.62% 783.000 827.000 - 0.98% -
401.bzip2 5.52% 2774.000 2927.000 - 0.10% -
473.astar 3.76% 4941.000 5127.000 - 0.51% -
470.lbm 3.04% 3354.000 3456.000 - -0.32% -
453.povray 1.17% 428.000 433.000 - -1.59% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -31.03% 29.000 20.000 - 0.00% -
nb_execution_successful -31.03% 29.000 20.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
473.astar -3.23% 37101.000 35901.000 - -0.02% -
437.leslie3d -1.73% 79330.000 77958.000 - 0.09% -
453.povray -1.66% 842399.000 828406.000 - 0.11% -
435.gromacs -1.12% 796334.000 787398.000 - 0.33% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
471.omnetpp -9.14% 2670.000 2426.000 - -1.22% -
462.libquantum -6.17% 81.000 76.000 - -1.30% -
437.leslie3d -6.16% 8929.000 8379.000 - -0.29% -
447.dealII -4.07% 1426.000 1368.000 - 0.88% -
434.zeusmp -3.01% 1991.000 1931.000 - -0.36% -
433.milc -1.24% 1129.000 1115.000 - 0.36% -
445.gobmk -1.10% 4909.000 4855.000 - 0.85% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 31.03% 29.000 38.000 - 0.00% -

Added Tests - sample variability
400.perlbench (avg) (percentage)
400.perlbench (max) (percentage)
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
403.gcc (avg) (percentage)
403.gcc (max) (percentage)
410.bwaves
410.bwaves (avg)
410.bwaves (avg) (percentage)
410.bwaves (max)
410.bwaves (max) (percentage)
416.gamess (avg) (percentage)
416.gamess (max) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
433.milc
433.milc (avg)
433.milc (avg) (percentage)
433.milc (max)
433.milc (max) (percentage)
434.zeusmp
434.zeusmp (avg)
434.zeusmp (avg) (percentage)
434.zeusmp (max)
434.zeusmp (max) (percentage)
435.gromacs
435.gromacs (avg)
435.gromacs (avg) (percentage)
435.gromacs (max)
435.gromacs (max) (percentage)
436.cactusADM (avg) (percentage)
436.cactusADM (max) (percentage)
437.leslie3d
437.leslie3d (avg)
437.leslie3d (avg) (percentage)
437.leslie3d (max)
437.leslie3d (max) (percentage)
444.namd
444.namd (avg)
444.namd (avg) (percentage)
444.namd (max)
444.namd (max) (percentage)
445.gobmk
445.gobmk (avg)
445.gobmk (avg) (percentage)
445.gobmk (max)
445.gobmk (max) (percentage)
447.dealII
447.dealII (avg)
447.dealII (avg) (percentage)
447.dealII (max)
447.dealII (max) (percentage)
450.soplex
450.soplex (avg)
450.soplex (avg) (percentage)
450.soplex (max)
450.soplex (max) (percentage)
453.povray
453.povray (avg)
453.povray (avg) (percentage)
453.povray (max)
453.povray (max) (percentage)
454.calculix (avg) (percentage)
454.calculix (max) (percentage)
456.hmmer (avg) (percentage)
456.hmmer (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
459.GemsFDTD
459.GemsFDTD (avg)
459.GemsFDTD (avg) (percentage)
459.GemsFDTD (max)
459.GemsFDTD (max) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)
464.h264ref (avg) (percentage)
464.h264ref (max) (percentage)
465.tonto
465.tonto (avg)
465.tonto (avg) (percentage)
465.tonto (max)
465.tonto (max) (percentage)
470.lbm
470.lbm (avg)
470.lbm (avg) (percentage)
470.lbm (max)
470.lbm (max) (percentage)
471.omnetpp
471.omnetpp (avg)
471.omnetpp (avg) (percentage)
471.omnetpp (max)
471.omnetpp (max) (percentage)
473.astar
473.astar (avg)
473.astar (avg) (percentage)
473.astar (max)
473.astar (max) (percentage)
481.wrf (avg) (percentage)
481.wrf (max) (percentage)
482.sphinx3
482.sphinx3 (avg)
482.sphinx3 (avg) (percentage)
482.sphinx3 (max)
482.sphinx3 (max) (percentage)
483.xalancbmk (avg) (percentage)
483.xalancbmk (max) (percentage)


Report Time: 0.38s
Name Current %
401.bzip2 2927.000 -
410.bwaves 4298.000 -1.60%
429.mcf 2045.000 -1.16%
433.milc 1115.000 -
434.zeusmp 1931.000 -
435.gromacs 6041.000 1.07%
437.leslie3d 8379.000 -
444.namd 709.000 -
445.gobmk 4855.000 -
447.dealII 1368.000 -
450.soplex 532.000 -
453.povray 433.000 -1.59%
458.sjeng 6563.000 -
459.GemsFDTD 4504.000 -
462.libquantum 76.000 -1.30%
465.tonto 8999.000 -2.90%
470.lbm 3456.000 -
471.omnetpp 2426.000 -1.22%
473.astar 5127.000 -
482.sphinx3 827.000 -
Geometric Mean 2074.819 -
Name Current %
401.bzip2 59293.000 -
410.bwaves 26676.000 3.59%
429.mcf 12359.000 -
433.milc 111038.000 -
434.zeusmp 248173.000 -
435.gromacs 787398.000 -
437.leslie3d 77958.000 -
444.namd 225843.000 -
445.gobmk 1554083.000 -
447.dealII 2840389.000 -
450.soplex 347545.000 -
453.povray 828406.000 -
458.sjeng 131131.000 -
459.GemsFDTD 317076.000 2.72%
462.libquantum 37884.000 -
465.tonto 3325624.000 -
470.lbm 11517.000 -
471.omnetpp 633382.000 -
473.astar 35901.000 -
482.sphinx3 177651.000 -
Geometric Mean 185442.353 -
Name Current %
400.perlbench (avg) (percentage) 1.910 -
400.perlbench (max) (percentage) 2.470 -
401.bzip2 60.000 -
401.bzip2 (avg) 60.000 -
401.bzip2 (avg) (percentage) 2.080 -
401.bzip2 (max) 192.000 -2.54%
401.bzip2 (max) (percentage) 6.570 -2.95%
403.gcc (avg) (percentage) 4.780 -
403.gcc (max) (percentage) 3.840 -
410.bwaves 62.000 -1.59%
410.bwaves (avg) 62.000 -1.59%
410.bwaves (avg) (percentage) 1.450 -
410.bwaves (max) 88.000 -8.33%
410.bwaves (max) (percentage) 2.070 -6.76%
416.gamess (avg) (percentage) 0.310 -
416.gamess (max) (percentage) 0.340 -
429.mcf 80.000 -2.44%
429.mcf (avg) 80.000 -2.44%
429.mcf (avg) (percentage) 3.960 -
429.mcf (max) 42.000 -12.50%
429.mcf (max) (percentage) 2.090 -11.06%
429.mcf (unexplained diff vs previous) 24.000 500.00%
429.mcf (unexplained diff vs previous) (percentage) 1.170 515.79%
433.milc 13.000 -
433.milc (avg) 13.000 -
433.milc (avg) (percentage) 1.180 -
433.milc (max) 5.000 -79.17%
433.milc (max) (percentage) 0.450 -79.26%
433.milc (unexplained diff vs previous) 4.000 -33.33%
433.milc (unexplained diff vs previous) (percentage) 0.360 -33.33%
434.zeusmp 18.000 -
434.zeusmp (avg) 18.000 -
434.zeusmp (avg) (percentage) 0.970 -
434.zeusmp (max) 10.000 -9.09%
434.zeusmp (max) (percentage) 0.540 -6.90%
435.gromacs 115.000 -
435.gromacs (avg) 115.000 -
435.gromacs (avg) (percentage) 1.920 -
435.gromacs (max) 135.000 -2.17%
435.gromacs (max) (percentage) 2.240 -3.03%
436.cactusADM (avg) (percentage) 0.880 -
436.cactusADM (max) (percentage) 1.460 -
437.leslie3d 373.000 -
437.leslie3d (avg) 373.000 -
437.leslie3d (avg) (percentage) 4.460 -
437.leslie3d (max) 140.000 -9.09%
437.leslie3d (max) (percentage) 1.680 -8.70%
444.namd 7.000 -
444.namd (avg) 7.000 -
444.namd (avg) (percentage) 1.000 -
444.namd (max) 11.000 -8.33%
444.namd (max) (percentage) 1.640 -4.09%
445.gobmk 41.000 2.50%
445.gobmk (avg) 41.000 2.50%
445.gobmk (avg) (percentage) 0.850 -
445.gobmk (max) 65.000 -1.52%
445.gobmk (max) (percentage) 1.340 -3.60%
447.dealII 16.000 -
447.dealII (avg) 16.000 -
447.dealII (avg) (percentage) 1.230 -
447.dealII (max) 9.000 -18.18%
447.dealII (max) (percentage) 0.730 -10.98%
450.soplex 14.000 -
450.soplex (avg) 14.000 -
450.soplex (avg) (percentage) 2.660 -
450.soplex (max) 20.000 -4.76%
450.soplex (max) (percentage) 3.910 -3.93%
453.povray 6.000 -
453.povray (avg) 6.000 -
453.povray (avg) (percentage) 1.440 -
453.povray (max) 4.000 -20.00%
453.povray (max) (percentage) 1.110 -5.93%
454.calculix (avg) (percentage) 3.100 -
454.calculix (max) (percentage) 2.620 -
456.hmmer (avg) (percentage) 0.340 -
456.hmmer (max) (percentage) 0.280 -
458.sjeng 43.000 -
458.sjeng (avg) 43.000 -
458.sjeng (avg) (percentage) 0.660 -
458.sjeng (max) 74.000 -3.90%
458.sjeng (max) (percentage) 1.140 -3.39%
459.GemsFDTD 56.000 -
459.GemsFDTD (avg) 56.000 -
459.GemsFDTD (avg) (percentage) 1.250 -
459.GemsFDTD (max) 89.000 -3.26%
459.GemsFDTD (max) (percentage) 1.990 -2.93%
462.libquantum 2.000 -
462.libquantum (avg) 2.000 -
462.libquantum (avg) (percentage) 2.790 -
462.libquantum (max) 3.000 -25.00%
462.libquantum (max) (percentage) 5.240 -4.38%
464.h264ref (avg) (percentage) 0.640 -
464.h264ref (max) (percentage) 1.990 -
465.tonto 93.000 -3.12%
465.tonto (avg) 93.000 -3.12%
465.tonto (avg) (percentage) 1.040 -
465.tonto (max) 40.000 -11.11%
465.tonto (max) (percentage) 0.450 -8.16%
470.lbm 33.000 -
470.lbm (avg) 33.000 -
470.lbm (avg) (percentage) 0.970 -1.02%
470.lbm (max) 25.000 -7.41%
470.lbm (max) (percentage) 0.750 -3.85%
470.lbm (unexplained diff vs previous) 11.000 266.67%
470.lbm (unexplained diff vs previous) (percentage) 0.320 255.56%
471.omnetpp 50.000 -1.96%
471.omnetpp (avg) 50.000 -1.96%
471.omnetpp (avg) (percentage) 2.100 -
471.omnetpp (max) 64.000 -4.48%
471.omnetpp (max) (percentage) 2.640 -4.00%
473.astar 80.000 -
473.astar (avg) 80.000 -
473.astar (avg) (percentage) 1.570 -
473.astar (max) 26.000 -73.20%
473.astar (max) (percentage) 0.510 -73.44%
473.astar (unexplained diff vs previous) 26.000 -16.13%
473.astar (unexplained diff vs previous) (percentage) 0.510 -16.39%
481.wrf (avg) (percentage) 1.320 -
481.wrf (max) (percentage) 0.660 -
482.sphinx3 17.000 -
482.sphinx3 (avg) 17.000 -
482.sphinx3 (avg) (percentage) 2.120 -
482.sphinx3 (max) 10.000 -9.09%
482.sphinx3 (max) (percentage) 1.260 -11.27%
483.xalancbmk (avg) (percentage) 2.290 -
483.xalancbmk (max) (percentage) 2.390 -
Geometric Mean 6.353 -2.94%