Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=2711e4754fc4d9ed594491d3e87a37d0ffa165ed (+ 24 commits)
git_gcc https://gcc.gnu.org/git/gcc.git (a4f45de95eed90e3d166bb706bb883e3a6cda0bd) (+ 454 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=7b9881c2c8841ef135ce897d459123dfe9dd3a06 (+ 18 commits)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/6f871ce2482ed3a48ea0e1080bfeb7e4d6e99f78 (+ 146 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-aarch64-master-O2_LTO-build/420/
Filter

gnu-aarch64-master-O2_LTO test results

Run Order Start Time Duration
Current 0420 (4-changed-components) 2025-05-19T23:19:09 0:00:00
Previous 0418 (basepoints/gcc-16-00372-g064cac730f8) 2025-05-17T04:31:55 0:00:00
Baseline 0001 (4-changed-components) 2023-03-25T19:03:58 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 2 13
Performance Improvements 89 20
Added Tests 0 118
Unchanged Tests 1025 965
Total Tests 1116

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
429.mcf (unexplained diff vs previous) (percentage) 16.65% 8.050 9.390 - 0.00% -
429.mcf (unexplained diff vs previous) 6.67% 165.000 176.000 - 0.00% -

Performance Improvements - Code Size Δ Previous Current σ Δ (B) σ (B)
434.zeusmp -1.23% 233975.000 231095.000 - 20.50% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
429.mcf -8.59% 2050.000 1874.000 - 31.05% -
401.bzip2 -6.15% 2909.000 2730.000 - -0.40% -
450.soplex -6.12% 539.000 506.000 - -8.99% -
471.omnetpp -5.63% 2237.000 2111.000 - -3.43% -
473.astar -5.43% 4658.000 4405.000 - -6.46% -
482.sphinx3 -4.93% 750.000 713.000 - -8.59% -
459.GemsFDTD -4.67% 4560.000 4347.000 - 3.16% -
462.libquantum -3.90% 77.000 74.000 - -9.76% -
453.povray -3.10% 420.000 407.000 - -2.40% -
410.bwaves -2.81% 4341.000 4219.000 - -4.00% -
433.milc -2.67% 1087.000 1058.000 - -2.40% -
465.tonto -2.64% 8923.000 8687.000 - -5.84% -
435.gromacs -2.11% 5921.000 5796.000 - 7.89% -
434.zeusmp -2.10% 1955.000 1914.000 - -3.87% -
470.lbm -1.76% 3694.000 3629.000 - 3.80% -
444.namd -1.69% 708.000 696.000 - 11.54% -
458.sjeng -1.68% 6445.000 6337.000 - -0.02% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
473.astar (max) -12.20% 205.000 180.000 - 0.00% -
401.bzip2 (max) -12.12% 165.000 145.000 - 0.00% -
429.mcf (max) -10.61% 179.000 160.000 - 0.00% -
450.soplex -9.09% 22.000 20.000 - 0.00% -
450.soplex (avg) -9.09% 22.000 20.000 - 0.00% -
435.gromacs (max) -8.82% 170.000 155.000 - 0.00% -
433.milc (max) -8.33% 36.000 33.000 - 0.00% -
444.namd (max) -8.33% 12.000 11.000 - 0.00% -
429.mcf -8.18% 110.000 101.000 - 0.00% -
429.mcf (avg) -8.18% 110.000 101.000 - 0.00% -
450.soplex (max) -8.11% 74.000 68.000 - 0.00% -
471.omnetpp (max) -7.50% 40.000 37.000 - 0.00% -
473.astar (max) (percentage) -7.47% 4.420 4.090 - 0.00% -
459.GemsFDTD (max) -7.39% 230.000 213.000 - 0.00% -
470.lbm (max) -7.35% 68.000 63.000 - 0.00% -
410.bwaves (max) -7.04% 142.000 132.000 - 0.00% -
453.povray (max) -6.67% 15.000 14.000 - 0.00% -
435.gromacs (max) (percentage) -6.60% 2.880 2.690 - 0.00% -
482.sphinx3 (max) -6.52% 46.000 43.000 - 0.00% -
401.bzip2 (max) (percentage) -6.32% 5.700 5.340 - 0.00% -
471.omnetpp -5.77% 52.000 49.000 - 0.00% -
471.omnetpp (avg) -5.77% 52.000 49.000 - 0.00% -
465.tonto (max) -5.52% 326.000 308.000 - 0.00% -
458.sjeng (max) -5.32% 94.000 89.000 - 0.00% -
433.milc -5.26% 19.000 18.000 - 0.00% -
433.milc (avg) -5.26% 19.000 18.000 - 0.00% -
401.bzip2 -5.19% 77.000 73.000 - 0.00% -
401.bzip2 (avg) -5.19% 77.000 73.000 - 0.00% -
473.astar -5.08% 118.000 112.000 - 0.00% -
473.astar (avg) -5.08% 118.000 112.000 - 0.00% -
470.lbm (max) (percentage) -4.86% 1.850 1.760 - 0.00% -
444.namd (max) (percentage) -4.62% 1.730 1.650 - 0.00% -
410.bwaves (max) (percentage) -4.57% 3.280 3.130 - 0.00% -
459.GemsFDTD -4.40% 91.000 87.000 - 0.00% -
459.GemsFDTD (avg) -4.40% 91.000 87.000 - 0.00% -
433.milc (max) (percentage) -4.20% 3.330 3.190 - 0.00% -
434.zeusmp -4.17% 24.000 23.000 - 0.00% -
434.zeusmp (avg) -4.17% 24.000 23.000 - 0.00% -
482.sphinx3 -4.17% 24.000 23.000 - 0.00% -
482.sphinx3 (avg) -4.17% 24.000 23.000 - 0.00% -
458.sjeng (max) (percentage) -4.08% 1.470 1.410 - 0.00% -
465.tonto -3.08% 130.000 126.000 - 0.00% -
465.tonto (avg) -3.08% 130.000 126.000 - 0.00% -
434.zeusmp (max) -3.03% 33.000 32.000 - 0.00% -
465.tonto (max) (percentage) -3.01% 3.660 3.550 - 0.00% -
470.lbm (unexplained diff vs previous) -2.99% 67.000 65.000 - 0.00% -
437.leslie3d (max) -2.92% 343.000 333.000 - 0.00% -
471.omnetpp (max) (percentage) -2.73% 1.830 1.780 - 0.00% -
453.povray (max) (percentage) -2.72% 3.670 3.570 - 0.00% -
410.bwaves -2.70% 74.000 72.000 - 0.00% -
410.bwaves (avg) -2.70% 74.000 72.000 - 0.00% -
459.GemsFDTD (max) (percentage) -2.57% 5.050 4.920 - 0.00% -
447.dealII (max) -2.56% 39.000 38.000 - 0.00% -
450.soplex (max) (percentage) -2.52% 13.880 13.530 - 0.00% -
447.dealII (max) (percentage) -2.47% 3.650 3.560 - 0.00% -
434.zeusmp (max) (percentage) -2.31% 1.730 1.690 - 0.00% -
437.leslie3d (max) (percentage) -2.14% 4.210 4.120 - 0.00% -
435.gromacs -2.11% 142.000 139.000 - 0.00% -
435.gromacs (avg) -2.11% 142.000 139.000 - 0.00% -
445.gobmk -2.08% 48.000 47.000 - 0.00% -
445.gobmk (avg) -2.08% 48.000 47.000 - 0.00% -
445.gobmk (max) (percentage) -2.03% 1.480 1.450 - 0.00% -
458.sjeng -1.92% 52.000 51.000 - 0.00% -
458.sjeng (avg) -1.92% 52.000 51.000 - 0.00% -
429.mcf (max) (percentage) -1.83% 8.750 8.590 - 0.00% -
470.lbm -1.72% 58.000 57.000 - 0.00% -
470.lbm (avg) -1.72% 58.000 57.000 - 0.00% -
482.sphinx3 (max) (percentage) -1.62% 6.190 6.090 - 0.00% -
445.gobmk (max) -1.54% 65.000 64.000 - 0.00% -
462.libquantum (max) (percentage) -1.51% 4.630 4.560 - 0.00% -
470.lbm (unexplained diff vs previous) (percentage) -1.10% 1.810 1.790 - 0.00% -

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
410.bwaves 22.73% 20380.000 25012.000 - 0.00% -
434.zeusmp 20.50% 191785.000 231095.000 - -1.23% -
482.sphinx3 3.36% 136204.000 140783.000 - -0.02% -
450.soplex 2.71% 275117.000 282586.000 - -0.02% -
459.GemsFDTD 2.64% 305748.000 313808.000 - 0.03% -
429.mcf 2.59% 9840.000 10095.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
429.mcf 31.05% 1430.000 1874.000 - -8.59% -
444.namd 11.54% 624.000 696.000 - -1.69% -
435.gromacs 7.89% 5372.000 5796.000 - -2.11% -
470.lbm 3.80% 3496.000 3629.000 - -1.76% -
459.GemsFDTD 3.16% 4214.000 4347.000 - -4.67% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -31.03% 29.000 20.000 - 0.00% -
nb_execution_successful -31.03% 29.000 20.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
462.libquantum -4.39% 20328.000 19436.000 - 0.00% -
470.lbm -4.01% 10968.000 10528.000 - 0.00% -
473.astar -3.52% 27173.000 26217.000 - -0.35% -
447.dealII -3.08% 413208.000 400477.000 - -0.11% -
433.milc -1.76% 72058.000 70793.000 - -0.37% -
437.leslie3d -1.74% 72512.000 71248.000 - -0.27% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
462.libquantum -9.76% 82.000 74.000 - -3.90% -
450.soplex -8.99% 556.000 506.000 - -6.12% -
482.sphinx3 -8.59% 780.000 713.000 - -4.93% -
473.astar -6.46% 4709.000 4405.000 - -5.43% -
465.tonto -5.84% 9226.000 8687.000 - -2.64% -
410.bwaves -4.00% 4395.000 4219.000 - -2.81% -
445.gobmk -3.98% 4627.000 4443.000 - -0.07% -
434.zeusmp -3.87% 1991.000 1914.000 - -2.10% -
437.leslie3d -3.81% 8424.000 8103.000 - -0.83% -
471.omnetpp -3.43% 2186.000 2111.000 - -5.63% -
433.milc -2.40% 1084.000 1058.000 - -2.67% -
453.povray -2.40% 417.000 407.000 - -3.10% -
447.dealII -1.90% 1104.000 1083.000 - -0.18% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 31.03% 29.000 38.000 - 0.00% -

Added Tests - sample variability
400.perlbench (avg) (percentage)
400.perlbench (max) (percentage)
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
403.gcc (avg) (percentage)
403.gcc (max) (percentage)
410.bwaves
410.bwaves (avg)
410.bwaves (avg) (percentage)
410.bwaves (max)
410.bwaves (max) (percentage)
416.gamess (avg) (percentage)
416.gamess (max) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
433.milc
433.milc (avg)
433.milc (avg) (percentage)
433.milc (max)
433.milc (max) (percentage)
434.zeusmp
434.zeusmp (avg)
434.zeusmp (avg) (percentage)
434.zeusmp (max)
434.zeusmp (max) (percentage)
435.gromacs
435.gromacs (avg)
435.gromacs (avg) (percentage)
435.gromacs (max)
435.gromacs (max) (percentage)
436.cactusADM (avg) (percentage)
436.cactusADM (max) (percentage)
437.leslie3d
437.leslie3d (avg)
437.leslie3d (avg) (percentage)
437.leslie3d (max)
437.leslie3d (max) (percentage)
444.namd
444.namd (avg)
444.namd (avg) (percentage)
444.namd (max)
444.namd (max) (percentage)
445.gobmk
445.gobmk (avg)
445.gobmk (avg) (percentage)
445.gobmk (max)
445.gobmk (max) (percentage)
447.dealII
447.dealII (avg)
447.dealII (avg) (percentage)
447.dealII (max)
447.dealII (max) (percentage)
450.soplex
450.soplex (avg)
450.soplex (avg) (percentage)
450.soplex (max)
450.soplex (max) (percentage)
453.povray
453.povray (avg)
453.povray (avg) (percentage)
453.povray (max)
453.povray (max) (percentage)
454.calculix (avg) (percentage)
454.calculix (max) (percentage)
456.hmmer (avg) (percentage)
456.hmmer (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
459.GemsFDTD
459.GemsFDTD (avg)
459.GemsFDTD (avg) (percentage)
459.GemsFDTD (max)
459.GemsFDTD (max) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)
464.h264ref (avg) (percentage)
464.h264ref (max) (percentage)
465.tonto
465.tonto (avg)
465.tonto (avg) (percentage)
465.tonto (max)
465.tonto (max) (percentage)
470.lbm
470.lbm (avg)
470.lbm (avg) (percentage)
470.lbm (max)
470.lbm (max) (percentage)
471.omnetpp
471.omnetpp (avg)
471.omnetpp (avg) (percentage)
471.omnetpp (max)
471.omnetpp (max) (percentage)
473.astar
473.astar (avg)
473.astar (avg) (percentage)
473.astar (max)
473.astar (max) (percentage)
481.wrf (avg) (percentage)
481.wrf (max) (percentage)
482.sphinx3
482.sphinx3 (avg)
482.sphinx3 (avg) (percentage)
482.sphinx3 (max)
482.sphinx3 (max) (percentage)
483.xalancbmk (avg) (percentage)
483.xalancbmk (max) (percentage)


Report Time: 0.36s
Name Current %
401.bzip2 2730.000 -6.15%
410.bwaves 4219.000 -2.81%
429.mcf 1874.000 -8.59%
433.milc 1058.000 -2.67%
434.zeusmp 1914.000 -2.10%
435.gromacs 5796.000 -2.11%
437.leslie3d 8103.000 -
444.namd 696.000 -1.69%
445.gobmk 4443.000 -
447.dealII 1083.000 -
450.soplex 506.000 -6.12%
453.povray 407.000 -3.10%
458.sjeng 6337.000 -1.68%
459.GemsFDTD 4347.000 -4.67%
462.libquantum 74.000 -3.90%
465.tonto 8687.000 -2.64%
470.lbm 3629.000 -1.76%
471.omnetpp 2111.000 -5.63%
473.astar 4405.000 -5.43%
482.sphinx3 713.000 -4.93%
Geometric Mean 1945.470 -3.38%
Name Current %
401.bzip2 50741.000 -
410.bwaves 25012.000 -
429.mcf 10095.000 -
433.milc 70793.000 -
434.zeusmp 231095.000 -1.23%
435.gromacs 592929.000 -
437.leslie3d 71248.000 -
444.namd 224865.000 -
445.gobmk 1576587.000 -
447.dealII 400477.000 -
450.soplex 282586.000 -
453.povray 836271.000 -
458.sjeng 119450.000 -
459.GemsFDTD 313808.000 -
462.libquantum 19436.000 -
465.tonto 2302543.000 -
470.lbm 10528.000 -
471.omnetpp 595533.000 -
473.astar 26217.000 -
482.sphinx3 140783.000 -
Geometric Mean 142264.565 -
Name Current %
400.perlbench (avg) (percentage) 2.220 -
400.perlbench (max) (percentage) 1.730 -
401.bzip2 73.000 -5.19%
401.bzip2 (avg) 73.000 -5.19%
401.bzip2 (avg) (percentage) 2.680 -
401.bzip2 (max) 145.000 -12.12%
401.bzip2 (max) (percentage) 5.340 -6.32%
403.gcc (avg) (percentage) 4.710 -
403.gcc (max) (percentage) 4.330 -
410.bwaves 72.000 -2.70%
410.bwaves (avg) 72.000 -2.70%
410.bwaves (avg) (percentage) 1.720 -
410.bwaves (max) 132.000 -7.04%
410.bwaves (max) (percentage) 3.130 -4.57%
416.gamess (avg) (percentage) 0.220 -
416.gamess (max) (percentage) 0.230 -
429.mcf 101.000 -8.18%
429.mcf (avg) 101.000 -8.18%
429.mcf (avg) (percentage) 5.410 -
429.mcf (max) 160.000 -10.61%
429.mcf (max) (percentage) 8.590 -1.83%
429.mcf (unexplained diff vs previous) 176.000 6.67%
429.mcf (unexplained diff vs previous) (percentage) 9.390 16.65%
433.milc 18.000 -5.26%
433.milc (avg) 18.000 -5.26%
433.milc (avg) (percentage) 1.790 -
433.milc (max) 33.000 -8.33%
433.milc (max) (percentage) 3.190 -4.20%
434.zeusmp 23.000 -4.17%
434.zeusmp (avg) 23.000 -4.17%
434.zeusmp (avg) (percentage) 1.250 -
434.zeusmp (max) 32.000 -3.03%
434.zeusmp (max) (percentage) 1.690 -2.31%
435.gromacs 139.000 -2.11%
435.gromacs (avg) 139.000 -2.11%
435.gromacs (avg) (percentage) 2.410 -
435.gromacs (max) 155.000 -8.82%
435.gromacs (max) (percentage) 2.690 -6.60%
436.cactusADM (avg) (percentage) 0.940 -
436.cactusADM (max) (percentage) 1.350 -
437.leslie3d 426.000 -
437.leslie3d (avg) 426.000 -
437.leslie3d (avg) (percentage) 5.260 -
437.leslie3d (max) 333.000 -2.92%
437.leslie3d (max) (percentage) 4.120 -2.14%
444.namd 8.000 -
444.namd (avg) 8.000 -
444.namd (avg) (percentage) 1.150 -
444.namd (max) 11.000 -8.33%
444.namd (max) (percentage) 1.650 -4.62%
445.gobmk 47.000 -2.08%
445.gobmk (avg) 47.000 -2.08%
445.gobmk (avg) (percentage) 1.080 -
445.gobmk (max) 64.000 -1.54%
445.gobmk (max) (percentage) 1.450 -2.03%
447.dealII 16.000 -
447.dealII (avg) 16.000 -
447.dealII (avg) (percentage) 1.560 -
447.dealII (max) 38.000 -2.56%
447.dealII (max) (percentage) 3.560 -2.47%
450.soplex 20.000 -9.09%
450.soplex (avg) 20.000 -9.09%
450.soplex (avg) (percentage) 4.090 -
450.soplex (max) 68.000 -8.11%
450.soplex (max) (percentage) 13.530 -2.52%
453.povray 6.000 -
453.povray (avg) 6.000 -
453.povray (avg) (percentage) 1.540 -
453.povray (max) 14.000 -6.67%
453.povray (max) (percentage) 3.570 -2.72%
454.calculix (avg) (percentage) 2.260 -
454.calculix (max) (percentage) 2.750 -
456.hmmer (avg) (percentage) 0.290 -
456.hmmer (max) (percentage) 0.320 -
458.sjeng 51.000 -1.92%
458.sjeng (avg) 51.000 -1.92%
458.sjeng (avg) (percentage) 0.810 -
458.sjeng (max) 89.000 -5.32%
458.sjeng (max) (percentage) 1.410 -4.08%
459.GemsFDTD 87.000 -4.40%
459.GemsFDTD (avg) 87.000 -4.40%
459.GemsFDTD (avg) (percentage) 2.010 -
459.GemsFDTD (max) 213.000 -7.39%
459.GemsFDTD (max) (percentage) 4.920 -2.57%
462.libquantum 2.000 -
462.libquantum (avg) 2.000 -
462.libquantum (avg) (percentage) 3.050 -
462.libquantum (max) 3.000 -
462.libquantum (max) (percentage) 4.560 -1.51%
462.libquantum (unexplained diff vs previous) 3.000 -
462.libquantum (unexplained diff vs previous) (percentage) 4.050 -
464.h264ref (avg) (percentage) 0.780 -
464.h264ref (max) (percentage) 0.980 -
465.tonto 126.000 -3.08%
465.tonto (avg) 126.000 -3.08%
465.tonto (avg) (percentage) 1.460 -
465.tonto (max) 308.000 -5.52%
465.tonto (max) (percentage) 3.550 -3.01%
470.lbm 57.000 -1.72%
470.lbm (avg) 57.000 -1.72%
470.lbm (avg) (percentage) 1.580 -
470.lbm (max) 63.000 -7.35%
470.lbm (max) (percentage) 1.760 -4.86%
470.lbm (unexplained diff vs previous) 65.000 -2.99%
470.lbm (unexplained diff vs previous) (percentage) 1.790 -1.10%
471.omnetpp 49.000 -5.77%
471.omnetpp (avg) 49.000 -5.77%
471.omnetpp (avg) (percentage) 2.340 -
471.omnetpp (max) 37.000 -7.50%
471.omnetpp (max) (percentage) 1.780 -2.73%
473.astar 112.000 -5.08%
473.astar (avg) 112.000 -5.08%
473.astar (avg) (percentage) 2.550 -
473.astar (max) 180.000 -12.20%
473.astar (max) (percentage) 4.090 -7.47%
481.wrf (avg) (percentage) 1.480 -
481.wrf (max) (percentage) 0.720 -
482.sphinx3 23.000 -4.17%
482.sphinx3 (avg) 23.000 -4.17%
482.sphinx3 (avg) (percentage) 3.250 -
482.sphinx3 (max) 43.000 -6.52%
482.sphinx3 (max) (percentage) 6.090 -1.62%
483.xalancbmk (avg) (percentage) 1.490 -
483.xalancbmk (max) (percentage) 0.940 -
Geometric Mean 9.916 15.31%