Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=5cfabe75dbaef32f1506f02c172219536baff4c4 (+ 76 commits)
git_gcc https://gcc.gnu.org/git/gcc.git (84ec58b6943b66de74b26d2537ef2687ddf2c044) (+ 329 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=6d6a6e2dd2133908e3f5cb8a2ed817ccb2a0bb06 (+ 29 commits)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/b56d937da32fe959bffba6750805ade1d5fe76d3 (+ 503 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_vect-spec2k6--gnu-aarch64-master-O3_LTO-build/378/
Filter

gnu-aarch64-master-O3_LTO test results

Run Order Start Time Duration
Current 0378 (4-changed-components) 2025-04-13T09:02:02 0:00:00
Previous 0377 (4-changed-components) 2025-04-06T17:46:24 0:00:00
Baseline 0001 (4-changed-components) 2023-03-08T03:13:34 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 26 18
Performance Improvements 46 18
Added Tests 0 118
Unchanged Tests 1044 962
Total Tests 1116

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
462.libquantum 4.11% 73.000 76.000 - -5.00% -
453.povray 2.22% 361.000 369.000 - -1.60% -
435.gromacs 1.55% 4832.000 4907.000 - -1.68% -
459.GemsFDTD 1.20% 4343.000 4395.000 - -3.91% -
433.milc 1.04% 958.000 968.000 - 3.86% -
471.omnetpp 1.04% 2016.000 2037.000 - -0.97% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
470.lbm (unexplained diff vs previous) (percentage) 900.00% 0.060 0.600 - 0.00% -
470.lbm (unexplained diff vs previous) 900.00% 2.000 20.000 - 0.00% -
410.bwaves (unexplained diff vs previous) (percentage) 760.00% 0.100 0.860 - 0.00% -
410.bwaves (unexplained diff vs previous) 725.00% 4.000 33.000 - 0.00% -
434.zeusmp (unexplained diff vs previous) 400.00% 1.000 5.000 - 0.00% -
434.zeusmp (unexplained diff vs previous) (percentage) 383.33% 0.060 0.290 - 0.00% -
433.milc (unexplained diff vs previous) 150.00% 4.000 10.000 - 0.00% -
433.milc (unexplained diff vs previous) (percentage) 145.24% 0.420 1.030 - 0.00% -
429.mcf (unexplained diff vs previous) 100.00% 2.000 4.000 - 0.00% -
429.mcf (unexplained diff vs previous) (percentage) 100.00% 0.110 0.220 - 0.00% -
437.leslie3d (unexplained diff vs previous) (percentage) 93.17% 5.270 10.180 - 0.00% -
437.leslie3d (unexplained diff vs previous) 75.48% 363.000 637.000 - 0.00% -
437.leslie3d (max) (percentage) 66.19% 5.560 9.240 - 0.00% -
437.leslie3d (max) 50.65% 383.000 577.000 - 0.00% -
437.leslie3d (avg) (percentage) 2.07% 4.340 4.430 - 0.00% -
435.gromacs 1.75% 114.000 116.000 - 0.00% -
435.gromacs (avg) 1.75% 114.000 116.000 - 0.00% -
470.lbm (max) (percentage) 1.72% 0.580 0.590 - 0.00% -
459.GemsFDTD 1.47% 68.000 69.000 - 0.00% -
459.GemsFDTD (avg) 1.47% 68.000 69.000 - 0.00% -

Performance Improvements - Code Size Δ Previous Current σ Δ (B) σ (B)
458.sjeng -2.76% 158794.000 154406.000 - -1.37% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
437.leslie3d -9.24% 6892.000 6255.000 - -7.06% -
447.dealII -1.81% 995.000 977.000 - -1.91% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
401.bzip2 (unexplained diff vs previous) (percentage) -34.78% 0.230 0.150 - 0.00% -
401.bzip2 (unexplained diff vs previous) -33.33% 6.000 4.000 - 0.00% -
437.leslie3d -7.36% 299.000 277.000 - 0.00% -
437.leslie3d (avg) -7.36% 299.000 277.000 - 0.00% -
444.namd (max) (percentage) -6.48% 1.080 1.010 - 0.00% -
450.soplex (max) -6.25% 16.000 15.000 - 0.00% -
458.sjeng (max) (percentage) -5.00% 0.800 0.760 - 0.00% -
458.sjeng (max) -4.26% 47.000 45.000 - 0.00% -
433.milc (max) -4.17% 24.000 23.000 - 0.00% -
445.gobmk (max) -3.45% 58.000 56.000 - 0.00% -
435.gromacs (max) (percentage) -3.35% 2.090 2.020 - 0.00% -
410.bwaves (max) (percentage) -3.27% 2.450 2.370 - 0.00% -
471.omnetpp (max) (percentage) -3.24% 2.470 2.390 - 0.00% -
459.GemsFDTD (max) (percentage) -3.19% 2.820 2.730 - 0.00% -
433.milc (max) (percentage) -3.16% 2.530 2.450 - 0.00% -
482.sphinx3 (max) (percentage) -3.12% 3.530 3.420 - 0.00% -
445.gobmk (max) (percentage) -3.01% 1.330 1.290 - 0.00% -
447.dealII (max) -2.94% 34.000 33.000 - 0.00% -
462.libquantum (max) (percentage) -2.94% 4.770 4.630 - 0.00% -
429.mcf (max) (percentage) -2.87% 6.610 6.420 - 0.00% -
401.bzip2 -2.86% 35.000 34.000 - 0.00% -
401.bzip2 (avg) -2.86% 35.000 34.000 - 0.00% -
473.astar (max) (percentage) -2.64% 3.790 3.690 - 0.00% -
447.dealII (max) (percentage) -2.59% 3.480 3.390 - 0.00% -
429.mcf (max) -2.50% 120.000 117.000 - 0.00% -
434.zeusmp (max) (percentage) -2.47% 2.430 2.370 - 0.00% -
401.bzip2 (max) -2.47% 81.000 79.000 - 0.00% -
453.povray (max) (percentage) -2.46% 2.030 1.980 - 0.00% -
459.GemsFDTD (max) -2.46% 122.000 119.000 - 0.00% -
473.astar (max) -2.45% 163.000 159.000 - 0.00% -
465.tonto (max) (percentage) -2.43% 2.060 2.010 - 0.00% -
434.zeusmp (max) -2.38% 42.000 41.000 - 0.00% -
465.tonto (max) -2.27% 176.000 172.000 - 0.00% -
410.bwaves (max) -2.15% 93.000 91.000 - 0.00% -
471.omnetpp (max) -2.04% 49.000 48.000 - 0.00% -
401.bzip2 (max) (percentage) -1.92% 3.120 3.060 - 0.00% -
450.soplex (max) (percentage) -1.86% 3.230 3.170 - 0.00% -
429.mcf (avg) (percentage) -1.52% 3.950 3.890 - 0.00% -
401.bzip2 (avg) (percentage) -1.47% 1.360 1.340 - 0.00% -
429.mcf -1.39% 72.000 71.000 - 0.00% -
429.mcf (avg) -1.39% 72.000 71.000 - 0.00% -
434.zeusmp (avg) (percentage) -1.00% 1.000 0.990 - 0.00% -
435.gromacs (max) -1.00% 100.000 99.000 - 0.00% -

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
470.lbm 34.04% 11256.000 15088.000 - 0.00% -
444.namd 20.08% 235533.000 282838.000 - -0.15% -
429.mcf 8.43% 10100.000 10951.000 - 0.00% -
437.leslie3d 4.93% 100088.000 105021.000 - 0.00% -
410.bwaves 4.56% 26143.000 27335.000 - 0.00% -
445.gobmk 4.49% 1878607.000 1962863.000 - 0.66% -
482.sphinx3 3.29% 153776.000 158831.000 - -0.09% -
450.soplex 3.29% 326173.000 336894.000 - -0.07% -
434.zeusmp 2.65% 296597.000 304467.000 - 0.00% -
465.tonto 2.34% 2795025.000 2860544.000 - -0.32% -
453.povray 1.95% 1083050.000 1104193.000 - -0.62% -
471.omnetpp 1.58% 652766.000 663107.000 - -0.19% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
433.milc 3.86% 932.000 968.000 - 1.04% -
429.mcf 2.29% 1790.000 1831.000 - 0.22% -
450.soplex 1.83% 493.000 502.000 - 0.60% -
434.zeusmp 1.70% 1709.000 1738.000 - 0.29% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -31.03% 29.000 20.000 - 0.00% -
nb_execution_successful -31.03% 29.000 20.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
459.GemsFDTD -4.14% 376580.000 361002.000 - -0.01% -
473.astar -2.65% 31105.000 30281.000 - -0.15% -
462.libquantum -2.54% 22168.000 21604.000 - 0.00% -
447.dealII -1.42% 480818.000 474014.000 - -0.01% -
458.sjeng -1.37% 156546.000 154406.000 - -2.76% -
435.gromacs -1.00% 736591.000 729209.000 - 0.56% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
482.sphinx3 -16.08% 771.000 647.000 - 0.00% -
470.lbm -8.10% 3644.000 3349.000 - -0.59% -
437.leslie3d -7.06% 6730.000 6255.000 - -9.24% -
473.astar -5.89% 4586.000 4316.000 - -0.07% -
462.libquantum -5.00% 80.000 76.000 - 4.11% -
410.bwaves -4.21% 4016.000 3847.000 - 0.87% -
459.GemsFDTD -3.91% 4574.000 4395.000 - 1.20% -
458.sjeng -2.46% 6134.000 5983.000 - 0.17% -
447.dealII -1.91% 996.000 977.000 - -1.81% -
435.gromacs -1.68% 4991.000 4907.000 - 1.55% -
453.povray -1.60% 375.000 369.000 - 2.22% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 31.03% 29.000 38.000 - 0.00% -

Added Tests - sample variability
400.perlbench (avg) (percentage)
400.perlbench (max) (percentage)
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
403.gcc (avg) (percentage)
403.gcc (max) (percentage)
410.bwaves
410.bwaves (avg)
410.bwaves (avg) (percentage)
410.bwaves (max)
410.bwaves (max) (percentage)
416.gamess (avg) (percentage)
416.gamess (max) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
433.milc
433.milc (avg)
433.milc (avg) (percentage)
433.milc (max)
433.milc (max) (percentage)
434.zeusmp
434.zeusmp (avg)
434.zeusmp (avg) (percentage)
434.zeusmp (max)
434.zeusmp (max) (percentage)
435.gromacs
435.gromacs (avg)
435.gromacs (avg) (percentage)
435.gromacs (max)
435.gromacs (max) (percentage)
436.cactusADM (avg) (percentage)
436.cactusADM (max) (percentage)
437.leslie3d
437.leslie3d (avg)
437.leslie3d (avg) (percentage)
437.leslie3d (max)
437.leslie3d (max) (percentage)
444.namd
444.namd (avg)
444.namd (avg) (percentage)
444.namd (max)
444.namd (max) (percentage)
445.gobmk
445.gobmk (avg)
445.gobmk (avg) (percentage)
445.gobmk (max)
445.gobmk (max) (percentage)
447.dealII
447.dealII (avg)
447.dealII (avg) (percentage)
447.dealII (max)
447.dealII (max) (percentage)
450.soplex
450.soplex (avg)
450.soplex (avg) (percentage)
450.soplex (max)
450.soplex (max) (percentage)
453.povray
453.povray (avg)
453.povray (avg) (percentage)
453.povray (max)
453.povray (max) (percentage)
454.calculix (avg) (percentage)
454.calculix (max) (percentage)
456.hmmer (avg) (percentage)
456.hmmer (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
459.GemsFDTD
459.GemsFDTD (avg)
459.GemsFDTD (avg) (percentage)
459.GemsFDTD (max)
459.GemsFDTD (max) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)
464.h264ref (avg) (percentage)
464.h264ref (max) (percentage)
465.tonto
465.tonto (avg)
465.tonto (avg) (percentage)
465.tonto (max)
465.tonto (max) (percentage)
470.lbm
470.lbm (avg)
470.lbm (avg) (percentage)
470.lbm (max)
470.lbm (max) (percentage)
471.omnetpp
471.omnetpp (avg)
471.omnetpp (avg) (percentage)
471.omnetpp (max)
471.omnetpp (max) (percentage)
473.astar
473.astar (avg)
473.astar (avg) (percentage)
473.astar (max)
473.astar (max) (percentage)
481.wrf (avg) (percentage)
481.wrf (max) (percentage)
482.sphinx3
482.sphinx3 (avg)
482.sphinx3 (avg) (percentage)
482.sphinx3 (max)
482.sphinx3 (max) (percentage)
483.xalancbmk (avg) (percentage)
483.xalancbmk (max) (percentage)


Report Time: 0.36s
Name Current %
401.bzip2 2608.000 -
410.bwaves 3847.000 -
429.mcf 1831.000 -
433.milc 968.000 1.04%
434.zeusmp 1738.000 -
435.gromacs 4907.000 1.55%
437.leslie3d 6255.000 -9.24%
444.namd 619.000 -
445.gobmk 4372.000 -
447.dealII 977.000 -1.81%
450.soplex 502.000 -
453.povray 369.000 2.22%
458.sjeng 5983.000 -
459.GemsFDTD 4395.000 1.20%
462.libquantum 76.000 4.11%
465.tonto 8572.000 -
470.lbm 3349.000 -
471.omnetpp 2037.000 1.04%
473.astar 4316.000 -
482.sphinx3 647.000 -
Geometric Mean 1815.672 -
Name Current %
401.bzip2 72389.000 -
410.bwaves 27335.000 -
429.mcf 10951.000 -
433.milc 93884.000 -
434.zeusmp 304467.000 -
435.gromacs 729209.000 -
437.leslie3d 105021.000 -
444.namd 282838.000 -
445.gobmk 1962863.000 -
447.dealII 474014.000 -
450.soplex 336894.000 -
453.povray 1104193.000 -
458.sjeng 154406.000 -2.76%
459.GemsFDTD 361002.000 -
462.libquantum 21604.000 -
465.tonto 2860544.000 -
470.lbm 15088.000 -
471.omnetpp 663107.000 -
473.astar 30281.000 -
482.sphinx3 158831.000 -
Geometric Mean 175516.115 -
Name Current %
400.perlbench (avg) (percentage) 2.510 -
400.perlbench (max) (percentage) 2.180 -
401.bzip2 34.000 -2.86%
401.bzip2 (avg) 34.000 -2.86%
401.bzip2 (avg) (percentage) 1.340 -1.47%
401.bzip2 (max) 79.000 -2.47%
401.bzip2 (max) (percentage) 3.060 -1.92%
401.bzip2 (unexplained diff vs previous) 4.000 -33.33%
401.bzip2 (unexplained diff vs previous) (percentage) 0.150 -34.78%
403.gcc (avg) (percentage) 5.640 -
403.gcc (max) (percentage) 7.220 -
410.bwaves 54.000 -
410.bwaves (avg) 54.000 -
410.bwaves (avg) (percentage) 1.420 -
410.bwaves (max) 91.000 -2.15%
410.bwaves (max) (percentage) 2.370 -3.27%
410.bwaves (unexplained diff vs previous) 33.000 725.00%
410.bwaves (unexplained diff vs previous) (percentage) 0.860 760.00%
416.gamess (avg) (percentage) 0.250 -
416.gamess (max) (percentage) 0.160 -
429.mcf 71.000 -1.39%
429.mcf (avg) 71.000 -1.39%
429.mcf (avg) (percentage) 3.890 -1.52%
429.mcf (max) 117.000 -2.50%
429.mcf (max) (percentage) 6.420 -2.87%
429.mcf (unexplained diff vs previous) 4.000 100.00%
429.mcf (unexplained diff vs previous) (percentage) 0.220 100.00%
433.milc 13.000 -
433.milc (avg) 13.000 -
433.milc (avg) (percentage) 1.420 -
433.milc (max) 23.000 -4.17%
433.milc (max) (percentage) 2.450 -3.16%
433.milc (unexplained diff vs previous) 10.000 150.00%
433.milc (unexplained diff vs previous) (percentage) 1.030 145.24%
434.zeusmp 17.000 -
434.zeusmp (avg) 17.000 -
434.zeusmp (avg) (percentage) 0.990 -1.00%
434.zeusmp (max) 41.000 -2.38%
434.zeusmp (max) (percentage) 2.370 -2.47%
434.zeusmp (unexplained diff vs previous) 5.000 400.00%
434.zeusmp (unexplained diff vs previous) (percentage) 0.290 383.33%
435.gromacs 116.000 1.75%
435.gromacs (avg) 116.000 1.75%
435.gromacs (avg) (percentage) 2.370 -
435.gromacs (max) 99.000 -1.00%
435.gromacs (max) (percentage) 2.020 -3.35%
436.cactusADM (avg) (percentage) 0.990 -
436.cactusADM (max) (percentage) 1.570 -
437.leslie3d 277.000 -7.36%
437.leslie3d (avg) 277.000 -7.36%
437.leslie3d (avg) (percentage) 4.430 2.07%
437.leslie3d (max) 577.000 50.65%
437.leslie3d (max) (percentage) 9.240 66.19%
437.leslie3d (unexplained diff vs previous) 637.000 75.48%
437.leslie3d (unexplained diff vs previous) (percentage) 10.180 93.17%
444.namd 6.000 -
444.namd (avg) 6.000 -
444.namd (avg) (percentage) 1.020 -
444.namd (max) 6.000 -
444.namd (max) (percentage) 1.010 -6.48%
445.gobmk 48.000 -
445.gobmk (avg) 48.000 -
445.gobmk (avg) (percentage) 1.100 -
445.gobmk (max) 56.000 -3.45%
445.gobmk (max) (percentage) 1.290 -3.01%
447.dealII 13.000 -
447.dealII (avg) 13.000 -
447.dealII (avg) (percentage) 1.380 -
447.dealII (max) 33.000 -2.94%
447.dealII (max) (percentage) 3.390 -2.59%
450.soplex 14.000 -
450.soplex (avg) 14.000 -
450.soplex (avg) (percentage) 2.910 -
450.soplex (max) 15.000 -6.25%
450.soplex (max) (percentage) 3.170 -1.86%
453.povray 5.000 -
453.povray (avg) 5.000 -
453.povray (avg) (percentage) 1.500 -
453.povray (max) 7.000 -
453.povray (max) (percentage) 1.980 -2.46%
454.calculix (avg) (percentage) 3.100 -
454.calculix (max) (percentage) 2.940 -
456.hmmer (avg) (percentage) 0.780 -
456.hmmer (max) (percentage) 1.170 -
458.sjeng 35.000 -
458.sjeng (avg) 35.000 -
458.sjeng (avg) (percentage) 0.600 -
458.sjeng (max) 45.000 -4.26%
458.sjeng (max) (percentage) 0.760 -5.00%
459.GemsFDTD 69.000 1.47%
459.GemsFDTD (avg) 69.000 1.47%
459.GemsFDTD (avg) (percentage) 1.570 -
459.GemsFDTD (max) 119.000 -2.46%
459.GemsFDTD (max) (percentage) 2.730 -3.19%
462.libquantum 2.000 -
462.libquantum (avg) 2.000 -
462.libquantum (avg) (percentage) 3.130 -
462.libquantum (max) 3.000 -
462.libquantum (max) (percentage) 4.630 -2.94%
462.libquantum (unexplained diff vs previous) 3.000 -
462.libquantum (unexplained diff vs previous) (percentage) 3.950 -
464.h264ref (avg) (percentage) 0.730 -
464.h264ref (max) (percentage) 1.640 -
465.tonto 102.000 -
465.tonto (avg) 102.000 -
465.tonto (avg) (percentage) 1.190 -
465.tonto (max) 172.000 -2.27%
465.tonto (max) (percentage) 2.010 -2.43%
470.lbm 38.000 -
470.lbm (avg) 38.000 -
470.lbm (avg) (percentage) 1.140 -
470.lbm (max) 19.000 -
470.lbm (max) (percentage) 0.590 1.72%
470.lbm (unexplained diff vs previous) 20.000 900.00%
470.lbm (unexplained diff vs previous) (percentage) 0.600 900.00%
471.omnetpp 38.000 -
471.omnetpp (avg) 38.000 -
471.omnetpp (avg) (percentage) 1.910 -
471.omnetpp (max) 48.000 -2.04%
471.omnetpp (max) (percentage) 2.390 -3.24%
473.astar 88.000 -
473.astar (avg) 88.000 -
473.astar (avg) (percentage) 2.060 -
473.astar (max) 159.000 -2.45%
473.astar (max) (percentage) 3.690 -2.64%
481.wrf (avg) (percentage) 1.890 -
481.wrf (max) (percentage) 0.680 -
482.sphinx3 13.000 -
482.sphinx3 (avg) 13.000 -
482.sphinx3 (avg) (percentage) 2.130 -
482.sphinx3 (max) 22.000 -
482.sphinx3 (max) (percentage) 3.420 -3.12%
483.xalancbmk (avg) (percentage) 2.740 -
483.xalancbmk (max) (percentage) 1.850 -
Geometric Mean 7.166 31.07%