Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=eb6c9310ee4d6cbde509d251fafb54ae45f5a5bf (+ 46 commits)
git_gcc https://gcc.gnu.org/git/gcc.git (76cbd678d123ed93f99c4c52456bc14290f19b7f) (+ 140 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=daab2a6d19f8360248289840408e7d2e5c203c2e (+ 6 commits)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/b0d369dbad20a8c9702607e7294d63c4a0c8e0fe (+ 16054 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-aarch64-master-O2-build/420/
Filter

gnu-aarch64-master-O2 test results

Run Order Start Time Duration
Current 0420 (4-changed-components) 2025-06-06T21:21:59 0:00:00
Previous 0419 (4-changed-components) 2025-06-02T04:24:02 0:00:00
Baseline 0002 (4-changed-components) 2023-03-27T00:00:07 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 10 19
Performance Improvements 77 12
Added Tests 0 118
Unchanged Tests 1041 979
Total Tests 1128

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
462.libquantum 2.60% 77.000 79.000 - -2.47% -
465.tonto 1.11% 9043.000 9143.000 - 0.59% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
433.milc (unexplained diff vs previous) (percentage) 93.88% 0.980 1.900 - 0.00% -
433.milc (unexplained diff vs previous) 90.91% 11.000 21.000 - 0.00% -
471.omnetpp (unexplained diff vs previous) (percentage) 53.38% 1.480 2.270 - 0.00% -
471.omnetpp (unexplained diff vs previous) 50.00% 36.000 54.000 - 0.00% -
429.mcf (unexplained diff vs previous) (percentage) 48.78% 0.820 1.220 - 0.00% -
429.mcf (unexplained diff vs previous) 47.06% 17.000 25.000 - 0.00% -
465.tonto 1.00% 100.000 101.000 - 0.00% -
465.tonto (avg) 1.00% 100.000 101.000 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
450.soplex -7.58% 567.000 524.000 - -1.50% -
482.sphinx3 -4.92% 853.000 811.000 - 3.58% -
447.dealII -3.21% 1400.000 1355.000 - -4.98% -
410.bwaves -3.17% 4441.000 4300.000 - -0.94% -
444.namd -2.24% 714.000 698.000 - 9.75% -
471.omnetpp -2.22% 2432.000 2378.000 - -10.94% -
453.povray -2.06% 437.000 428.000 - 0.00% -
434.zeusmp -1.95% 1951.000 1913.000 - -3.92% -
433.milc -1.87% 1125.000 1104.000 - -2.21% -
401.bzip2 -1.64% 2935.000 2887.000 - 4.07% -
429.mcf -1.21% 2066.000 2041.000 - 39.13% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
437.leslie3d (unexplained diff vs previous) -78.57% 14.000 3.000 - 0.00% -
437.leslie3d (unexplained diff vs previous) (percentage) -76.47% 0.170 0.040 - 0.00% -
470.lbm (unexplained diff vs previous) -63.64% 11.000 4.000 - 0.00% -
470.lbm (unexplained diff vs previous) (percentage) -62.50% 0.320 0.120 - 0.00% -
473.astar (unexplained diff vs previous) -30.95% 42.000 29.000 - 0.00% -
473.astar (unexplained diff vs previous) (percentage) -30.86% 0.810 0.560 - 0.00% -
482.sphinx3 (max) -15.38% 39.000 33.000 - 0.00% -
462.libquantum (max) -14.29% 7.000 6.000 - 0.00% -
482.sphinx3 (max) (percentage) -12.45% 4.660 4.080 - 0.00% -
471.omnetpp (max) -11.76% 68.000 60.000 - 0.00% -
401.bzip2 (max) -11.19% 143.000 127.000 - 0.00% -
437.leslie3d (max) -11.15% 314.000 279.000 - 0.00% -
437.leslie3d (max) (percentage) -11.08% 3.790 3.370 - 0.00% -
401.bzip2 (max) (percentage) -10.00% 4.900 4.410 - 0.00% -
471.omnetpp (max) (percentage) -9.93% 2.820 2.540 - 0.00% -
450.soplex (max) -9.76% 41.000 37.000 - 0.00% -
410.bwaves (max) -9.01% 222.000 202.000 - 0.00% -
447.dealII (max) -7.32% 41.000 38.000 - 0.00% -
433.milc -7.14% 14.000 13.000 - 0.00% -
433.milc (avg) -7.14% 14.000 13.000 - 0.00% -
444.namd (max) -7.14% 14.000 13.000 - 0.00% -
433.milc (max) -6.45% 31.000 29.000 - 0.00% -
473.astar (max) -6.35% 252.000 236.000 - 0.00% -
450.soplex -6.25% 16.000 15.000 - 0.00% -
450.soplex (avg) -6.25% 16.000 15.000 - 0.00% -
459.GemsFDTD (max) -6.25% 176.000 165.000 - 0.00% -
429.mcf (max) -6.17% 227.000 213.000 - 0.00% -
473.astar (max) (percentage) -5.94% 4.880 4.590 - 0.00% -
447.dealII -5.88% 17.000 16.000 - 0.00% -
447.dealII (avg) -5.88% 17.000 16.000 - 0.00% -
470.lbm (max) -5.88% 119.000 112.000 - 0.00% -
459.GemsFDTD (max) (percentage) -5.88% 3.910 3.680 - 0.00% -
410.bwaves (max) (percentage) -5.80% 5.000 4.710 - 0.00% -
470.lbm (max) (percentage) -5.76% 3.470 3.270 - 0.00% -
462.libquantum (max) (percentage) -5.72% 9.260 8.730 - 0.00% -
429.mcf (max) (percentage) -5.26% 11.020 10.440 - 0.00% -
482.sphinx3 -5.26% 19.000 18.000 - 0.00% -
482.sphinx3 (avg) -5.26% 19.000 18.000 - 0.00% -
445.gobmk (max) -4.84% 62.000 59.000 - 0.00% -
433.milc (max) (percentage) -4.58% 2.840 2.710 - 0.00% -
444.namd (max) (percentage) -4.50% 2.000 1.910 - 0.00% -
465.tonto (max) (percentage) -4.47% 2.910 2.780 - 0.00% -
445.gobmk (max) (percentage) -3.85% 1.300 1.250 - 0.00% -
447.dealII (max) (percentage) -3.75% 2.930 2.820 - 0.00% -
453.povray (max) (percentage) -3.51% 2.280 2.200 - 0.00% -
465.tonto (max) -3.42% 263.000 254.000 - 0.00% -
450.soplex (max) (percentage) -3.40% 7.350 7.100 - 0.00% -
435.gromacs (max) (percentage) -3.32% 2.710 2.620 - 0.00% -
410.bwaves -3.03% 66.000 64.000 - 0.00% -
410.bwaves (avg) -3.03% 66.000 64.000 - 0.00% -
470.lbm -2.86% 35.000 34.000 - 0.00% -
470.lbm (avg) -2.86% 35.000 34.000 - 0.00% -
435.gromacs (max) -2.52% 159.000 155.000 - 0.00% -
458.sjeng (max) -2.50% 80.000 78.000 - 0.00% -
458.sjeng (max) (percentage) -2.46% 1.220 1.190 - 0.00% -
471.omnetpp -1.96% 51.000 50.000 - 0.00% -
471.omnetpp (avg) -1.96% 51.000 50.000 - 0.00% -
401.bzip2 -1.59% 63.000 62.000 - 0.00% -
401.bzip2 (avg) -1.59% 63.000 62.000 - 0.00% -
437.leslie3d -1.40% 357.000 352.000 - 0.00% -
437.leslie3d (avg) -1.40% 357.000 352.000 - 0.00% -
437.leslie3d (avg) (percentage) -1.40% 4.300 4.240 - 0.00% -
429.mcf -1.19% 84.000 83.000 - 0.00% -
429.mcf (avg) -1.19% 84.000 83.000 - 0.00% -
473.astar -1.14% 88.000 87.000 - 0.00% -
473.astar (avg) -1.14% 88.000 87.000 - 0.00% -

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
410.bwaves 23.76% 21532.000 26648.000 - 0.00% -
434.zeusmp 20.89% 203703.000 246249.000 - -0.00% -
459.GemsFDTD 7.45% 295414.000 317420.000 - 0.00% -
433.milc 2.85% 112111.000 115310.000 - 0.00% -
429.mcf 2.44% 12072.000 12367.000 - 0.00% -
465.tonto 1.88% 3263584.000 3325088.000 - 0.37% -
482.sphinx3 1.54% 175488.000 178195.000 - 0.27% -
447.dealII 1.53% 2802286.000 2845113.000 - -0.00% -
401.bzip2 1.15% 58669.000 59341.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
429.mcf 39.13% 1467.000 2041.000 - -1.21% -
435.gromacs 13.00% 5246.000 5928.000 - 0.70% -
444.namd 9.75% 636.000 698.000 - -2.24% -
459.GemsFDTD 6.66% 4220.000 4501.000 - -0.51% -
473.astar 4.19% 4941.000 5148.000 - -0.56% -
401.bzip2 4.07% 2774.000 2887.000 - -1.64% -
482.sphinx3 3.58% 783.000 811.000 - -4.92% -
470.lbm 2.95% 3354.000 3453.000 - -0.12% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -31.03% 29.000 20.000 - 0.00% -
nb_execution_successful -31.03% 29.000 20.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
473.astar -3.45% 37101.000 35821.000 - 0.00% -
437.leslie3d -1.44% 79330.000 78190.000 - 0.00% -
435.gromacs -1.09% 796334.000 787654.000 - 0.01% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
471.omnetpp -10.94% 2670.000 2378.000 - -2.22% -
437.leslie3d -7.02% 8929.000 8302.000 - -0.04% -
447.dealII -4.98% 1426.000 1355.000 - -3.21% -
434.zeusmp -3.92% 1991.000 1913.000 - -1.95% -
462.libquantum -2.47% 81.000 79.000 - 2.60% -
445.gobmk -2.40% 4909.000 4791.000 - -0.27% -
433.milc -2.21% 1129.000 1104.000 - -1.87% -
450.soplex -1.50% 532.000 524.000 - -7.58% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 31.03% 29.000 38.000 - 0.00% -

Added Tests - sample variability
400.perlbench (avg) (percentage)
400.perlbench (max) (percentage)
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
403.gcc (avg) (percentage)
403.gcc (max) (percentage)
410.bwaves
410.bwaves (avg)
410.bwaves (avg) (percentage)
410.bwaves (max)
410.bwaves (max) (percentage)
416.gamess (avg) (percentage)
416.gamess (max) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
433.milc
433.milc (avg)
433.milc (avg) (percentage)
433.milc (max)
433.milc (max) (percentage)
434.zeusmp
434.zeusmp (avg)
434.zeusmp (avg) (percentage)
434.zeusmp (max)
434.zeusmp (max) (percentage)
435.gromacs
435.gromacs (avg)
435.gromacs (avg) (percentage)
435.gromacs (max)
435.gromacs (max) (percentage)
436.cactusADM (avg) (percentage)
436.cactusADM (max) (percentage)
437.leslie3d
437.leslie3d (avg)
437.leslie3d (avg) (percentage)
437.leslie3d (max)
437.leslie3d (max) (percentage)
444.namd
444.namd (avg)
444.namd (avg) (percentage)
444.namd (max)
444.namd (max) (percentage)
445.gobmk
445.gobmk (avg)
445.gobmk (avg) (percentage)
445.gobmk (max)
445.gobmk (max) (percentage)
447.dealII
447.dealII (avg)
447.dealII (avg) (percentage)
447.dealII (max)
447.dealII (max) (percentage)
450.soplex
450.soplex (avg)
450.soplex (avg) (percentage)
450.soplex (max)
450.soplex (max) (percentage)
453.povray
453.povray (avg)
453.povray (avg) (percentage)
453.povray (max)
453.povray (max) (percentage)
454.calculix (avg) (percentage)
454.calculix (max) (percentage)
456.hmmer (avg) (percentage)
456.hmmer (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
459.GemsFDTD
459.GemsFDTD (avg)
459.GemsFDTD (avg) (percentage)
459.GemsFDTD (max)
459.GemsFDTD (max) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)
464.h264ref (avg) (percentage)
464.h264ref (max) (percentage)
465.tonto
465.tonto (avg)
465.tonto (avg) (percentage)
465.tonto (max)
465.tonto (max) (percentage)
470.lbm
470.lbm (avg)
470.lbm (avg) (percentage)
470.lbm (max)
470.lbm (max) (percentage)
471.omnetpp
471.omnetpp (avg)
471.omnetpp (avg) (percentage)
471.omnetpp (max)
471.omnetpp (max) (percentage)
473.astar
473.astar (avg)
473.astar (avg) (percentage)
473.astar (max)
473.astar (max) (percentage)
481.wrf (avg) (percentage)
481.wrf (max) (percentage)
482.sphinx3
482.sphinx3 (avg)
482.sphinx3 (avg) (percentage)
482.sphinx3 (max)
482.sphinx3 (max) (percentage)
483.xalancbmk (avg) (percentage)
483.xalancbmk (max) (percentage)


Report Time: 0.37s
Name Current %
401.bzip2 2887.000 -1.64%
410.bwaves 4300.000 -3.17%
429.mcf 2041.000 -1.21%
433.milc 1104.000 -1.87%
434.zeusmp 1913.000 -1.95%
435.gromacs 5928.000 -
437.leslie3d 8302.000 -
444.namd 698.000 -2.24%
445.gobmk 4791.000 -
447.dealII 1355.000 -3.21%
450.soplex 524.000 -7.58%
453.povray 428.000 -2.06%
458.sjeng 6558.000 -
459.GemsFDTD 4501.000 -
462.libquantum 79.000 2.60%
465.tonto 9143.000 1.11%
470.lbm 3453.000 -
471.omnetpp 2378.000 -2.22%
473.astar 5148.000 -
482.sphinx3 811.000 -4.92%
Geometric Mean 2063.335 -1.49%
Name Current %
401.bzip2 59341.000 -
410.bwaves 26648.000 -
429.mcf 12367.000 -
433.milc 115310.000 -
434.zeusmp 246249.000 -
435.gromacs 787654.000 -
437.leslie3d 78190.000 -
444.namd 227706.000 -
445.gobmk 1548923.000 -
447.dealII 2845113.000 -
450.soplex 348324.000 -
453.povray 840122.000 -
458.sjeng 131427.000 -
459.GemsFDTD 317420.000 -
462.libquantum 38084.000 -
465.tonto 3325088.000 -
470.lbm 11525.000 -
471.omnetpp 633350.000 -
473.astar 35821.000 -
482.sphinx3 178195.000 -
Geometric Mean 186059.224 -
Name Current %
400.perlbench (avg) (percentage) 1.910 -
400.perlbench (max) (percentage) 2.440 -
401.bzip2 62.000 -1.59%
401.bzip2 (avg) 62.000 -1.59%
401.bzip2 (avg) (percentage) 2.180 -
401.bzip2 (max) 127.000 -11.19%
401.bzip2 (max) (percentage) 4.410 -10.00%
403.gcc (avg) (percentage) 4.780 -
403.gcc (max) (percentage) 3.840 -
410.bwaves 64.000 -3.03%
410.bwaves (avg) 64.000 -3.03%
410.bwaves (avg) (percentage) 1.500 -
410.bwaves (max) 202.000 -9.01%
410.bwaves (max) (percentage) 4.710 -5.80%
416.gamess (avg) (percentage) 0.310 -
416.gamess (max) (percentage) 0.340 -
429.mcf 83.000 -1.19%
429.mcf (avg) 83.000 -1.19%
429.mcf (avg) (percentage) 4.070 -
429.mcf (max) 213.000 -6.17%
429.mcf (max) (percentage) 10.440 -5.26%
429.mcf (unexplained diff vs previous) 25.000 47.06%
429.mcf (unexplained diff vs previous) (percentage) 1.220 48.78%
433.milc 13.000 -7.14%
433.milc (avg) 13.000 -7.14%
433.milc (avg) (percentage) 1.260 -
433.milc (max) 29.000 -6.45%
433.milc (max) (percentage) 2.710 -4.58%
433.milc (unexplained diff vs previous) 21.000 90.91%
433.milc (unexplained diff vs previous) (percentage) 1.900 93.88%
434.zeusmp 18.000 -
434.zeusmp (avg) 18.000 -
434.zeusmp (avg) (percentage) 0.950 -
434.zeusmp (max) 8.000 -
434.zeusmp (max) (percentage) 0.460 -
435.gromacs 113.000 -
435.gromacs (avg) 113.000 -
435.gromacs (avg) (percentage) 1.920 -
435.gromacs (max) 155.000 -2.52%
435.gromacs (max) (percentage) 2.620 -3.32%
436.cactusADM (avg) (percentage) 0.880 -
436.cactusADM (max) (percentage) 1.440 -
437.leslie3d 352.000 -1.40%
437.leslie3d (avg) 352.000 -1.40%
437.leslie3d (avg) (percentage) 4.240 -1.40%
437.leslie3d (max) 279.000 -11.15%
437.leslie3d (max) (percentage) 3.370 -11.08%
437.leslie3d (unexplained diff vs previous) 3.000 -78.57%
437.leslie3d (unexplained diff vs previous) (percentage) 0.040 -76.47%
444.namd 7.000 -
444.namd (avg) 7.000 -
444.namd (avg) (percentage) 1.010 -
444.namd (max) 13.000 -7.14%
444.namd (max) (percentage) 1.910 -4.50%
445.gobmk 40.000 -
445.gobmk (avg) 40.000 -
445.gobmk (avg) (percentage) 0.840 -
445.gobmk (max) 59.000 -4.84%
445.gobmk (max) (percentage) 1.250 -3.85%
447.dealII 16.000 -5.88%
447.dealII (avg) 16.000 -5.88%
447.dealII (avg) (percentage) 1.250 -
447.dealII (max) 38.000 -7.32%
447.dealII (max) (percentage) 2.820 -3.75%
450.soplex 15.000 -6.25%
450.soplex (avg) 15.000 -6.25%
450.soplex (avg) (percentage) 2.880 -
450.soplex (max) 37.000 -9.76%
450.soplex (max) (percentage) 7.100 -3.40%
453.povray 6.000 -
453.povray (avg) 6.000 -
453.povray (avg) (percentage) 1.460 -
453.povray (max) 9.000 -
453.povray (max) (percentage) 2.200 -3.51%
454.calculix (avg) (percentage) 3.100 -
454.calculix (max) (percentage) 2.620 -
456.hmmer (avg) (percentage) 0.340 -
456.hmmer (max) (percentage) 0.280 -
458.sjeng 43.000 -
458.sjeng (avg) 43.000 -
458.sjeng (avg) (percentage) 0.660 -
458.sjeng (max) 78.000 -2.50%
458.sjeng (max) (percentage) 1.190 -2.46%
459.GemsFDTD 57.000 -
459.GemsFDTD (avg) 57.000 -
459.GemsFDTD (avg) (percentage) 1.280 -
459.GemsFDTD (max) 165.000 -6.25%
459.GemsFDTD (max) (percentage) 3.680 -5.88%
462.libquantum 2.000 -
462.libquantum (avg) 2.000 -
462.libquantum (avg) (percentage) 2.950 -
462.libquantum (max) 6.000 -14.29%
462.libquantum (max) (percentage) 8.730 -5.72%
464.h264ref (avg) (percentage) 0.640 -
464.h264ref (max) (percentage) 1.930 -
465.tonto 101.000 1.00%
465.tonto (avg) 101.000 1.00%
465.tonto (avg) (percentage) 1.110 -
465.tonto (max) 254.000 -3.42%
465.tonto (max) (percentage) 2.780 -4.47%
470.lbm 34.000 -2.86%
470.lbm (avg) 34.000 -2.86%
470.lbm (avg) (percentage) 1.010 -
470.lbm (max) 112.000 -5.88%
470.lbm (max) (percentage) 3.270 -5.76%
470.lbm (unexplained diff vs previous) 4.000 -63.64%
470.lbm (unexplained diff vs previous) (percentage) 0.120 -62.50%
471.omnetpp 50.000 -1.96%
471.omnetpp (avg) 50.000 -1.96%
471.omnetpp (avg) (percentage) 2.120 -
471.omnetpp (max) 60.000 -11.76%
471.omnetpp (max) (percentage) 2.540 -9.93%
471.omnetpp (unexplained diff vs previous) 54.000 50.00%
471.omnetpp (unexplained diff vs previous) (percentage) 2.270 53.38%
473.astar 87.000 -1.14%
473.astar (avg) 87.000 -1.14%
473.astar (avg) (percentage) 1.700 -
473.astar (max) 236.000 -6.35%
473.astar (max) (percentage) 4.590 -5.94%
473.astar (unexplained diff vs previous) 29.000 -30.95%
473.astar (unexplained diff vs previous) (percentage) 0.560 -30.86%
481.wrf (avg) (percentage) 1.320 -
481.wrf (max) (percentage) 0.660 -
482.sphinx3 18.000 -5.26%
482.sphinx3 (avg) 18.000 -5.26%
482.sphinx3 (avg) (percentage) 2.330 -
482.sphinx3 (max) 33.000 -15.38%
482.sphinx3 (max) (percentage) 4.080 -12.45%
483.xalancbmk (avg) (percentage) 2.290 -
483.xalancbmk (max) (percentage) 2.390 -
Geometric Mean 7.912 -4.68%