Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=e564115c8a0e8f9b993cf0add01fa34548005d20 (unchanged)
git_gcc https://gcc.gnu.org/git/gcc.git (405c99c17210a58df1adddd237219e773e689f17) (+ 1 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=53a71b9f66dbc7f0ce44ec95bff7caa31fa0374b (unchanged)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/73eab0e90b4becff0564c5964867c8eef41388bf (unchanged)
regression GNU-1486
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-aarch64-master-Os_LTO-build/357/
View Options
Report
Filter

gnu-aarch64-master-Os_LTO test results

Run Order Start Time Duration
Current 0357 (basepoints/gcc-15-06657-g405c99c1721) 2025-01-10T07:57:51 0:00:00
Previous 0357 (basepoints/gcc-15-06657-g405c99c1721) 2025-01-10T07:57:51 0:00:00
Baseline 0001 (4-changed-components) 2023-02-20T22:48:24 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 0 12
Performance Improvements 0 143
Added Tests 2 2
Unchanged Tests 1234 1079
Total Tests 1236

Run-Over-Run Changes Detail

Added Tests - sample variability
462.libquantum (unexplained diff vs previous)
462.libquantum (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
410.bwaves 6.49% 16760.000 17848.000 - 0.00% -
465.tonto 1.01% 1946163.000 1965787.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
429.mcf 43.26% 1424.000 2040.000 - 0.00% -
450.soplex 5.11% 567.000 596.000 - 0.00% -
401.bzip2 3.23% 2941.000 3036.000 - 0.00% -
410.bwaves 1.84% 5652.000 5756.000 - 0.00% -
470.lbm 1.48% 3788.000 3844.000 - 0.00% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d (avg) (percentage) 43.93% 3.050 4.390 - 0.00% -
437.leslie3d 35.77% 355.000 482.000 - 0.00% -
437.leslie3d (avg) 35.77% 355.000 482.000 - 0.00% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -31.03% 29.000 20.000 - 0.00% -
nb_execution_successful -31.03% 29.000 20.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d -8.65% 59479.000 54334.000 - 0.00% -
459.GemsFDTD -4.65% 244728.000 233360.000 - 0.00% -
447.dealII -2.18% 311591.000 304794.000 - 0.00% -
434.zeusmp -1.81% 152037.000 149279.000 - 0.00% -
462.libquantum -1.79% 16085.000 15797.000 - 0.00% -
435.gromacs -1.72% 499261.000 490666.000 - 0.00% -
433.milc -1.55% 61382.000 60432.000 - 0.00% -
470.lbm -1.49% 9691.000 9547.000 - 0.00% -
453.povray -1.22% 661389.000 653332.000 - 0.00% -
444.namd -1.10% 188385.000 186304.000 - 0.00% -
401.bzip2 -1.10% 44233.000 43747.000 - 0.00% -
473.astar -1.01% 22968.000 22736.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
459.GemsFDTD -21.63% 6173.000 4838.000 - 0.00% -
482.sphinx3 -10.48% 945.000 846.000 - 0.00% -
434.zeusmp -6.21% 2514.000 2358.000 - 0.00% -
437.leslie3d -5.64% 11640.000 10983.000 - 0.00% -
447.dealII -4.93% 1724.000 1639.000 - 0.00% -
445.gobmk -2.41% 5023.000 4902.000 - 0.00% -
435.gromacs -1.50% 7269.000 7160.000 - 0.00% -
462.libquantum -1.43% 140.000 138.000 - 0.00% -
465.tonto -1.41% 10941.000 10787.000 - 0.00% -
453.povray -1.28% 547.000 540.000 - 0.00% -
458.sjeng -1.19% 7567.000 7477.000 - 0.00% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
429.mcf (unexplained diff vs previous) (percentage) -100.00% 1305.690 0.050 - 0.00% -
429.mcf (unexplained diff vs previous) -99.99% 18593.000 1.000 - 0.00% -
429.mcf (max) -99.92% 1322.000 1.000 - 0.00% -
429.mcf (max) (percentage) -99.91% 92.890 0.080 - 0.00% -
471.omnetpp (unexplained diff vs previous) (percentage) -99.86% 391.300 0.550 - 0.00% -
471.omnetpp (unexplained diff vs previous) -99.86% 10659.000 15.000 - 0.00% -
456.hmmer (max) (percentage) -99.52% 73.590 0.350 - 0.00% -
464.h264ref (max) (percentage) -99.30% 54.290 0.380 - 0.00% -
444.namd (max) -99.27% 685.000 5.000 - 0.00% -
444.namd (max) (percentage) -99.18% 91.790 0.750 - 0.00% -
454.calculix (max) (percentage) -99.18% 99.730 0.820 - 0.00% -
416.gamess (max) (percentage) -99.07% 38.550 0.360 - 0.00% -
436.cactusADM (max) (percentage) -99.02% 88.730 0.870 - 0.00% -
447.dealII (max) -98.92% 1384.000 15.000 - 0.00% -
481.wrf (max) (percentage) -98.85% 68.700 0.790 - 0.00% -
447.dealII (max) (percentage) -98.83% 80.280 0.940 - 0.00% -
458.sjeng (max) -98.81% 3602.000 43.000 - 0.00% -
458.sjeng (max) (percentage) -98.78% 47.610 0.580 - 0.00% -
470.lbm (max) (percentage) -98.59% 72.510 1.020 - 0.00% -
470.lbm (max) -98.58% 2746.000 39.000 - 0.00% -
410.bwaves (max) (percentage) -98.46% 57.970 0.890 - 0.00% -
410.bwaves (max) -98.44% 3276.000 51.000 - 0.00% -
434.zeusmp (max) -98.30% 2055.000 35.000 - 0.00% -
435.gromacs (max) -98.29% 3573.000 61.000 - 0.00% -
435.gromacs (max) (percentage) -98.25% 49.160 0.860 - 0.00% -
434.zeusmp (max) (percentage) -98.17% 81.770 1.500 - 0.00% -
445.gobmk (max) -98.15% 2643.000 49.000 - 0.00% -
471.omnetpp (max) -98.11% 2169.000 41.000 - 0.00% -
471.omnetpp (max) (percentage) -98.10% 79.650 1.510 - 0.00% -
445.gobmk (max) (percentage) -98.08% 52.630 1.010 - 0.00% -
482.sphinx3 (max) -97.69% 911.000 21.000 - 0.00% -
483.xalancbmk (max) (percentage) -97.42% 68.670 1.770 - 0.00% -
400.perlbench (max) (percentage) -97.41% 84.060 2.180 - 0.00% -
482.sphinx3 (max) (percentage) -97.39% 96.500 2.520 - 0.00% -
433.milc (max) -97.22% 1044.000 29.000 - 0.00% -
433.milc (max) (percentage) -97.20% 90.750 2.540 - 0.00% -
453.povray (max) -96.99% 499.000 15.000 - 0.00% -
453.povray (max) (percentage) -96.81% 91.250 2.910 - 0.00% -
459.GemsFDTD (max) -96.76% 4411.000 143.000 - 0.00% -
403.gcc (max) (percentage) -96.27% 99.360 3.710 - 0.00% -
473.astar (max) (percentage) -96.12% 66.430 2.580 - 0.00% -
473.astar (max) -96.10% 3406.000 133.000 - 0.00% -
459.GemsFDTD (max) (percentage) -95.86% 71.460 2.960 - 0.00% -
462.libquantum (max) -95.65% 138.000 6.000 - 0.00% -
462.libquantum (max) (percentage) -94.95% 98.970 5.000 - 0.00% -
450.soplex (max) (percentage) -93.96% 96.240 5.810 - 0.00% -
450.soplex (max) -93.76% 545.000 34.000 - 0.00% -
401.bzip2 (max) (percentage) -93.25% 78.650 5.310 - 0.00% -
401.bzip2 (max) -93.04% 2313.000 161.000 - 0.00% -
444.namd -88.24% 68.000 8.000 - 0.00% -
444.namd (avg) -88.24% 68.000 8.000 - 0.00% -
456.hmmer (avg) (percentage) -88.21% 4.410 0.520 - 0.00% -
444.namd (avg) (percentage) -87.96% 9.220 1.110 - 0.00% -
470.lbm (avg) (percentage) -87.52% 6.330 0.790 - 0.00% -
470.lbm -87.45% 239.000 30.000 - 0.00% -
470.lbm (avg) -87.45% 239.000 30.000 - 0.00% -
434.zeusmp -86.39% 147.000 20.000 - 0.00% -
434.zeusmp (avg) -86.39% 147.000 20.000 - 0.00% -
464.h264ref (avg) (percentage) -86.05% 5.090 0.710 - 0.00% -
434.zeusmp (avg) (percentage) -84.96% 5.850 0.880 - 0.00% -
465.tonto (max) -84.75% 2112.000 322.000 - 0.00% -
465.tonto (max) (percentage) -84.52% 19.310 2.990 - 0.00% -
459.GemsFDTD -83.06% 360.000 61.000 - 0.00% -
459.GemsFDTD (avg) -83.06% 360.000 61.000 - 0.00% -
458.sjeng -82.99% 241.000 41.000 - 0.00% -
458.sjeng (avg) -82.99% 241.000 41.000 - 0.00% -
416.gamess (avg) (percentage) -82.81% 4.420 0.760 - 0.00% -
458.sjeng (avg) (percentage) -82.45% 3.190 0.560 - 0.00% -
436.cactusADM (avg) (percentage) -82.44% 5.980 1.050 - 0.00% -
447.dealII -81.82% 99.000 18.000 - 0.00% -
447.dealII (avg) -81.82% 99.000 18.000 - 0.00% -
410.bwaves (avg) (percentage) -81.41% 4.410 0.820 - 0.00% -
410.bwaves -81.12% 249.000 47.000 - 0.00% -
410.bwaves (avg) -81.12% 249.000 47.000 - 0.00% -
482.sphinx3 -81.08% 74.000 14.000 - 0.00% -
482.sphinx3 (avg) -81.08% 74.000 14.000 - 0.00% -
453.povray -80.95% 42.000 8.000 - 0.00% -
453.povray (avg) -80.95% 42.000 8.000 - 0.00% -
447.dealII (avg) (percentage) -80.59% 5.770 1.120 - 0.00% -
462.libquantum -80.00% 10.000 2.000 - 0.00% -
462.libquantum (avg) -80.00% 10.000 2.000 - 0.00% -
433.milc (avg) (percentage) -79.83% 6.050 1.220 - 0.00% -
433.milc -79.71% 69.000 14.000 - 0.00% -
433.milc (avg) -79.71% 69.000 14.000 - 0.00% -
453.povray (avg) (percentage) -79.64% 7.810 1.590 - 0.00% -
445.gobmk -79.59% 196.000 40.000 - 0.00% -
445.gobmk (avg) -79.59% 196.000 40.000 - 0.00% -
445.gobmk (avg) (percentage) -78.77% 3.910 0.830 - 0.00% -
482.sphinx3 (avg) (percentage) -78.69% 7.930 1.690 - 0.00% -
459.GemsFDTD (avg) (percentage) -78.25% 5.840 1.270 - 0.00% -
471.omnetpp (avg) (percentage) -75.85% 8.200 1.980 - 0.00% -
462.libquantum (avg) (percentage) -75.85% 7.660 1.850 - 0.00% -
471.omnetpp -75.78% 223.000 54.000 - 0.00% -
471.omnetpp (avg) -75.78% 223.000 54.000 - 0.00% -
401.bzip2 (avg) (percentage) -72.81% 5.480 1.490 - 0.00% -
401.bzip2 -72.05% 161.000 45.000 - 0.00% -
401.bzip2 (avg) -72.05% 161.000 45.000 - 0.00% -
481.wrf (avg) (percentage) -71.15% 6.240 1.800 - 0.00% -
437.leslie3d (max) -69.73% 1929.000 584.000 - 0.00% -
400.perlbench (avg) (percentage) -69.45% 6.350 1.940 - 0.00% -
437.leslie3d (max) (percentage) -67.91% 16.580 5.320 - 0.00% -
435.gromacs -67.85% 367.000 118.000 - 0.00% -
435.gromacs (avg) -67.85% 367.000 118.000 - 0.00% -
435.gromacs (avg) (percentage) -67.19% 5.060 1.660 - 0.00% -
473.astar (avg) (percentage) -62.98% 4.160 1.540 - 0.00% -
473.astar -62.91% 213.000 79.000 - 0.00% -
473.astar (avg) -62.91% 213.000 79.000 - 0.00% -
450.soplex (avg) (percentage) -62.52% 6.430 2.410 - 0.00% -
465.tonto -61.92% 365.000 139.000 - 0.00% -
465.tonto (avg) -61.92% 365.000 139.000 - 0.00% -
465.tonto (avg) (percentage) -61.38% 3.340 1.290 - 0.00% -
450.soplex -61.11% 36.000 14.000 - 0.00% -
450.soplex (avg) -61.11% 36.000 14.000 - 0.00% -
454.calculix (avg) (percentage) -55.11% 8.020 3.600 - 0.00% -
483.xalancbmk (avg) (percentage) -54.46% 6.500 2.960 - 0.00% -
429.mcf (avg) (percentage) -41.07% 7.670 4.520 - 0.00% -
403.gcc (avg) (percentage) -30.46% 7.320 5.090 - 0.00% -
429.mcf -15.60% 109.000 92.000 - 0.00% -
429.mcf (avg) -15.60% 109.000 92.000 - 0.00% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 31.03% 29.000 38.000 - 0.00% -

Added Tests - sample variability
462.libquantum (unexplained diff vs previous)
462.libquantum (unexplained diff vs previous) (percentage)

Report Time: 0.37s
Execution (seconds)
Name Current %
401.bzip2 3036.000 -
410.bwaves 5756.000 -
429.mcf 2040.000 -
433.milc 1151.000 -
434.zeusmp 2358.000 -
435.gromacs 7160.000 -
437.leslie3d 10983.000 -
444.namd 743.000 -
445.gobmk 4902.000 -
447.dealII 1639.000 -
450.soplex 596.000 -
453.povray 540.000 -
458.sjeng 7477.000 -
459.GemsFDTD 4838.000 -
462.libquantum 138.000 -
465.tonto 10787.000 -
470.lbm 3844.000 -
471.omnetpp 2738.000 -
473.astar 5168.000 -
482.sphinx3 846.000 -
Geometric Mean 2387.528 -
Code Size (bytes)
Name Current %
401.bzip2 43747.000 -
410.bwaves 17848.000 -
429.mcf 9086.000 -
433.milc 60432.000 -
434.zeusmp 149279.000 -
435.gromacs 490666.000 -
437.leslie3d 54334.000 -
444.namd 186304.000 -
445.gobmk 1375162.000 -
447.dealII 304794.000 -
450.soplex 203242.000 -
453.povray 653332.000 -
458.sjeng 103295.000 -
459.GemsFDTD 233360.000 -
462.libquantum 15797.000 -
465.tonto 1965787.000 -
470.lbm 9547.000 -
471.omnetpp 475181.000 -
473.astar 22736.000 -
482.sphinx3 111774.000 -
Geometric Mean 114600.911 -
sample variability
Name Current %
400.perlbench (avg) (percentage) 1.940 -
400.perlbench (max) (percentage) 2.180 -
401.bzip2 45.000 -
401.bzip2 (avg) 45.000 -
401.bzip2 (avg) (percentage) 1.490 -
401.bzip2 (max) 161.000 -
401.bzip2 (max) (percentage) 5.310 -
403.gcc (avg) (percentage) 5.090 -
403.gcc (max) (percentage) 3.710 -
410.bwaves 47.000 -
410.bwaves (avg) 47.000 -
410.bwaves (avg) (percentage) 0.820 -
410.bwaves (max) 51.000 -
410.bwaves (max) (percentage) 0.890 -
416.gamess (avg) (percentage) 0.760 -
416.gamess (max) (percentage) 0.360 -
429.mcf 92.000 -
429.mcf (avg) 92.000 -
429.mcf (avg) (percentage) 4.520 -
429.mcf (max) 1.000 -
429.mcf (max) (percentage) 0.080 -
429.mcf (unexplained diff vs previous) 1.000 -
429.mcf (unexplained diff vs previous) (percentage) 0.050 -
433.milc 14.000 -
433.milc (avg) 14.000 -
433.milc (avg) (percentage) 1.220 -
433.milc (max) 29.000 -
433.milc (max) (percentage) 2.540 -
434.zeusmp 20.000 -
434.zeusmp (avg) 20.000 -
434.zeusmp (avg) (percentage) 0.880 -
434.zeusmp (max) 35.000 -
434.zeusmp (max) (percentage) 1.500 -
435.gromacs 118.000 -
435.gromacs (avg) 118.000 -
435.gromacs (avg) (percentage) 1.660 -
435.gromacs (max) 61.000 -
435.gromacs (max) (percentage) 0.860 -
436.cactusADM (avg) (percentage) 1.050 -
436.cactusADM (max) (percentage) 0.870 -
437.leslie3d 482.000 -
437.leslie3d (avg) 482.000 -
437.leslie3d (avg) (percentage) 4.390 -
437.leslie3d (max) 584.000 -
437.leslie3d (max) (percentage) 5.320 -
444.namd 8.000 -
444.namd (avg) 8.000 -
444.namd (avg) (percentage) 1.110 -
444.namd (max) 5.000 -
444.namd (max) (percentage) 0.750 -
445.gobmk 40.000 -
445.gobmk (avg) 40.000 -
445.gobmk (avg) (percentage) 0.830 -
445.gobmk (max) 49.000 -
445.gobmk (max) (percentage) 1.010 -
447.dealII 18.000 -
447.dealII (avg) 18.000 -
447.dealII (avg) (percentage) 1.120 -
447.dealII (max) 15.000 -
447.dealII (max) (percentage) 0.940 -
450.soplex 14.000 -
450.soplex (avg) 14.000 -
450.soplex (avg) (percentage) 2.410 -
450.soplex (max) 34.000 -
450.soplex (max) (percentage) 5.810 -
453.povray 8.000 -
453.povray (avg) 8.000 -
453.povray (avg) (percentage) 1.590 -
453.povray (max) 15.000 -
453.povray (max) (percentage) 2.910 -
454.calculix (avg) (percentage) 3.600 -
454.calculix (max) (percentage) 0.820 -
456.hmmer (avg) (percentage) 0.520 -
456.hmmer (max) (percentage) 0.350 -
458.sjeng 41.000 -
458.sjeng (avg) 41.000 -
458.sjeng (avg) (percentage) 0.560 -
458.sjeng (max) 43.000 -
458.sjeng (max) (percentage) 0.580 -
459.GemsFDTD 61.000 -
459.GemsFDTD (avg) 61.000 -
459.GemsFDTD (avg) (percentage) 1.270 -
459.GemsFDTD (max) 143.000 -
459.GemsFDTD (max) (percentage) 2.960 -
462.libquantum 2.000 -
462.libquantum (avg) 2.000 -
462.libquantum (avg) (percentage) 1.850 -
462.libquantum (max) 6.000 -
462.libquantum (max) (percentage) 5.000 -
462.libquantum (unexplained diff vs previous) 0.000 -
462.libquantum (unexplained diff vs previous) (percentage) 0.000 -
464.h264ref (avg) (percentage) 0.710 -
464.h264ref (max) (percentage) 0.380 -
465.tonto 139.000 -
465.tonto (avg) 139.000 -
465.tonto (avg) (percentage) 1.290 -
465.tonto (max) 322.000 -
465.tonto (max) (percentage) 2.990 -
470.lbm 30.000 -
470.lbm (avg) 30.000 -
470.lbm (avg) (percentage) 0.790 -
470.lbm (max) 39.000 -
470.lbm (max) (percentage) 1.020 -
471.omnetpp 54.000 -
471.omnetpp (avg) 54.000 -
471.omnetpp (avg) (percentage) 1.980 -
471.omnetpp (max) 41.000 -
471.omnetpp (max) (percentage) 1.510 -
471.omnetpp (unexplained diff vs previous) 15.000 -
471.omnetpp (unexplained diff vs previous) (percentage) 0.550 -
473.astar 79.000 -
473.astar (avg) 79.000 -
473.astar (avg) (percentage) 1.540 -
473.astar (max) 133.000 -
473.astar (max) (percentage) 2.580 -
481.wrf (avg) (percentage) 1.800 -
481.wrf (max) (percentage) 0.790 -
482.sphinx3 14.000 -
482.sphinx3 (avg) 14.000 -
482.sphinx3 (avg) (percentage) 1.690 -
482.sphinx3 (max) 21.000 -
482.sphinx3 (max) (percentage) 2.520 -
483.xalancbmk (avg) (percentage) 2.960 -
483.xalancbmk (max) (percentage) 1.770 -
Geometric Mean 5.581 -16.40%