Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=a388feed3d4662623749a2e991ea802000cf74b7 (+ 47 commits)
git_gcc https://gcc.gnu.org/git/gcc.git (b6d37ec1dd2a228d94e7b5b438f3aa53684316bc) (+ 184 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=84977600dace5a7cfcb0918e6757939fd4969839 (+ 11 commits)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/7f0020417b7bceaa10cf9e1efe2b3f5c554d972e (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_vect-spec2k6--gnu-aarch64-master-O3-build/371/
Filter

gnu-aarch64-master-O3 test results

Run Order Start Time Duration
Current 0371 (3-changed-components) 2025-04-25T23:45:22 0:00:00
Previous 0370 (4-changed-components) 2025-04-20T06:24:00 0:00:00
Baseline 0001 (4-changed-components) 2023-03-07T16:12:14 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 8 21
Performance Improvements 70 12
Added Tests 0 118
Unchanged Tests 1038 965
Total Tests 1116

Performance Regressions - Code Size Δ Previous Current σ Δ (B) σ (B)
437.leslie3d 4.04% 115167.000 119823.000 - 9.39% -
410.bwaves 1.04% 27572.000 27860.000 - 13.90% -

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
465.tonto 2.08% 8183.000 8353.000 - 5.85% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
470.lbm (unexplained diff vs previous) (percentage) 362.07% 0.290 1.340 - 0.00% -
470.lbm (unexplained diff vs previous) 350.00% 10.000 45.000 - 0.00% -
429.mcf (unexplained diff vs previous) (percentage) 2.54% 2.360 2.420 - 0.00% -
465.tonto 2.08% 96.000 98.000 - 0.00% -
465.tonto (avg) 2.08% 96.000 98.000 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
462.libquantum -2.60% 77.000 75.000 - -3.85% -
429.mcf -2.36% 1988.000 1941.000 - -2.95% -
471.omnetpp -1.75% 2343.000 2302.000 - -1.67% -
401.bzip2 -1.50% 2794.000 2752.000 - 2.61% -
470.lbm -1.32% 3404.000 3359.000 - 2.60% -
459.GemsFDTD -1.27% 4497.000 4440.000 - 2.92% -
445.gobmk -1.20% 4825.000 4767.000 - 2.74% -
482.sphinx3 -1.17% 682.000 674.000 - -10.37% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
433.milc (unexplained diff vs previous) -82.76% 29.000 5.000 - 0.00% -
433.milc (unexplained diff vs previous) (percentage) -82.69% 2.830 0.490 - 0.00% -
410.bwaves (unexplained diff vs previous) -79.78% 89.000 18.000 - 0.00% -
410.bwaves (unexplained diff vs previous) (percentage) -79.62% 2.110 0.430 - 0.00% -
462.libquantum -50.00% 2.000 1.000 - 0.00% -
462.libquantum (avg) -50.00% 2.000 1.000 - 0.00% -
471.omnetpp (unexplained diff vs previous) -26.79% 56.000 41.000 - 0.00% -
471.omnetpp (unexplained diff vs previous) (percentage) -25.52% 2.390 1.780 - 0.00% -
429.mcf (max) -13.21% 106.000 92.000 - 0.00% -
429.mcf (max) (percentage) -11.05% 5.340 4.750 - 0.00% -
453.povray (max) -8.33% 24.000 22.000 - 0.00% -
471.omnetpp (max) -7.28% 151.000 140.000 - 0.00% -
470.lbm (max) -7.19% 139.000 129.000 - 0.00% -
401.bzip2 (max) -7.09% 282.000 262.000 - 0.00% -
482.sphinx3 (max) -7.04% 71.000 66.000 - 0.00% -
459.GemsFDTD (max) -6.83% 205.000 191.000 - 0.00% -
437.leslie3d (max) (percentage) -6.53% 8.420 7.870 - 0.00% -
482.sphinx3 (max) (percentage) -6.45% 10.540 9.860 - 0.00% -
473.astar (max) -6.27% 319.000 299.000 - 0.00% -
435.gromacs (max) (percentage) -6.26% 4.310 4.040 - 0.00% -
433.milc (max) -6.12% 49.000 46.000 - 0.00% -
410.bwaves (max) -6.06% 264.000 248.000 - 0.00% -
450.soplex (max) -6.02% 83.000 78.000 - 0.00% -
470.lbm (max) (percentage) -5.84% 4.110 3.870 - 0.00% -
434.zeusmp (max) (percentage) -5.79% 3.970 3.740 - 0.00% -
473.astar (max) (percentage) -5.79% 6.560 6.180 - 0.00% -
433.milc (max) (percentage) -5.79% 4.840 4.560 - 0.00% -
437.leslie3d (max) -5.75% 539.000 508.000 - 0.00% -
410.bwaves (max) (percentage) -5.73% 6.280 5.920 - 0.00% -
471.omnetpp (max) (percentage) -5.72% 6.470 6.100 - 0.00% -
434.zeusmp (max) -5.71% 70.000 66.000 - 0.00% -
459.GemsFDTD (max) (percentage) -5.69% 4.570 4.310 - 0.00% -
435.gromacs (max) -5.66% 212.000 200.000 - 0.00% -
401.bzip2 (max) (percentage) -5.63% 10.120 9.550 - 0.00% -
465.tonto (max) (percentage) -5.56% 2.880 2.720 - 0.00% -
444.namd (max) (percentage) -5.53% 3.980 3.760 - 0.00% -
445.gobmk (max) -5.43% 184.000 174.000 - 0.00% -
458.sjeng (max) (percentage) -5.42% 2.030 1.920 - 0.00% -
458.sjeng (max) -5.38% 130.000 123.000 - 0.00% -
462.libquantum (max) (percentage) -4.98% 7.230 6.870 - 0.00% -
453.povray (max) (percentage) -4.73% 6.130 5.840 - 0.00% -
450.soplex (max) (percentage) -4.69% 15.580 14.850 - 0.00% -
445.gobmk (max) (percentage) -4.44% 3.830 3.660 - 0.00% -
444.namd (max) -4.17% 24.000 23.000 - 0.00% -
471.omnetpp -3.45% 58.000 56.000 - 0.00% -
471.omnetpp (avg) -3.45% 58.000 56.000 - 0.00% -
465.tonto (max) -3.40% 235.000 227.000 - 0.00% -
429.mcf -3.12% 96.000 93.000 - 0.00% -
429.mcf (avg) -3.12% 96.000 93.000 - 0.00% -
447.dealII (max) -3.12% 96.000 93.000 - 0.00% -
447.dealII (max) (percentage) -2.47% 7.290 7.110 - 0.00% -
470.lbm -2.27% 44.000 43.000 - 0.00% -
470.lbm (avg) -2.27% 44.000 43.000 - 0.00% -
445.gobmk -1.92% 52.000 51.000 - 0.00% -
445.gobmk (avg) -1.92% 52.000 51.000 - 0.00% -
410.bwaves -1.61% 62.000 61.000 - 0.00% -
410.bwaves (avg) -1.61% 62.000 61.000 - 0.00% -
401.bzip2 -1.59% 63.000 62.000 - 0.00% -
401.bzip2 (avg) -1.59% 63.000 62.000 - 0.00% -
459.GemsFDTD -1.47% 68.000 67.000 - 0.00% -
459.GemsFDTD (avg) -1.47% 68.000 67.000 - 0.00% -
410.bwaves (avg) (percentage) -1.35% 1.480 1.460 - 0.00% -

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
444.namd 20.74% 236982.000 286139.000 - -0.06% -
410.bwaves 13.90% 24460.000 27860.000 - 1.04% -
437.leslie3d 9.39% 109542.000 119823.000 - 4.04% -
453.povray 5.57% 1000090.000 1055821.000 - 0.52% -
429.mcf 5.26% 12224.000 12867.000 - 0.00% -
433.milc 4.58% 135823.000 142046.000 - -0.10% -
445.gobmk 4.36% 1662239.000 1734635.000 - -0.22% -
482.sphinx3 3.79% 203848.000 211571.000 - 0.07% -
450.soplex 2.05% 425268.000 433971.000 - -0.19% -
471.omnetpp 1.90% 682768.000 695713.000 - -0.01% -
447.dealII 1.63% 3212233.000 3264677.000 - -0.16% -
434.zeusmp 1.57% 308615.000 313461.000 - 0.11% -
465.tonto 1.38% 3968188.000 4022886.000 - -0.01% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
465.tonto 5.85% 7891.000 8353.000 - 2.08% -
473.astar 4.28% 4651.000 4850.000 - -0.47% -
459.GemsFDTD 2.92% 4314.000 4440.000 - -1.27% -
445.gobmk 2.74% 4640.000 4767.000 - -1.20% -
401.bzip2 2.61% 2682.000 2752.000 - -1.50% -
470.lbm 2.60% 3274.000 3359.000 - -1.32% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -31.03% 29.000 20.000 - 0.00% -
nb_execution_successful -31.03% 29.000 20.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
459.GemsFDTD -1.86% 369814.000 362936.000 - 0.12% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
482.sphinx3 -10.37% 752.000 674.000 - -1.17% -
437.leslie3d -6.66% 6920.000 6459.000 - 0.73% -
453.povray -6.22% 418.000 392.000 - -0.25% -
462.libquantum -3.85% 78.000 75.000 - -2.60% -
433.milc -3.59% 1059.000 1021.000 - -0.49% -
429.mcf -2.95% 2000.000 1941.000 - -2.36% -
410.bwaves -2.17% 4284.000 4191.000 - -0.43% -
450.soplex -1.85% 541.000 531.000 - -0.56% -
471.omnetpp -1.67% 2341.000 2302.000 - -1.75% -
444.namd -1.42% 635.000 626.000 - -0.32% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 31.03% 29.000 38.000 - 0.00% -

Added Tests - sample variability
400.perlbench (avg) (percentage)
400.perlbench (max) (percentage)
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
403.gcc (avg) (percentage)
403.gcc (max) (percentage)
410.bwaves
410.bwaves (avg)
410.bwaves (avg) (percentage)
410.bwaves (max)
410.bwaves (max) (percentage)
416.gamess (avg) (percentage)
416.gamess (max) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
433.milc
433.milc (avg)
433.milc (avg) (percentage)
433.milc (max)
433.milc (max) (percentage)
434.zeusmp
434.zeusmp (avg)
434.zeusmp (avg) (percentage)
434.zeusmp (max)
434.zeusmp (max) (percentage)
435.gromacs
435.gromacs (avg)
435.gromacs (avg) (percentage)
435.gromacs (max)
435.gromacs (max) (percentage)
436.cactusADM (avg) (percentage)
436.cactusADM (max) (percentage)
437.leslie3d
437.leslie3d (avg)
437.leslie3d (avg) (percentage)
437.leslie3d (max)
437.leslie3d (max) (percentage)
444.namd
444.namd (avg)
444.namd (avg) (percentage)
444.namd (max)
444.namd (max) (percentage)
445.gobmk
445.gobmk (avg)
445.gobmk (avg) (percentage)
445.gobmk (max)
445.gobmk (max) (percentage)
447.dealII
447.dealII (avg)
447.dealII (avg) (percentage)
447.dealII (max)
447.dealII (max) (percentage)
450.soplex
450.soplex (avg)
450.soplex (avg) (percentage)
450.soplex (max)
450.soplex (max) (percentage)
453.povray
453.povray (avg)
453.povray (avg) (percentage)
453.povray (max)
453.povray (max) (percentage)
454.calculix (avg) (percentage)
454.calculix (max) (percentage)
456.hmmer (avg) (percentage)
456.hmmer (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
459.GemsFDTD
459.GemsFDTD (avg)
459.GemsFDTD (avg) (percentage)
459.GemsFDTD (max)
459.GemsFDTD (max) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)
464.h264ref (avg) (percentage)
464.h264ref (max) (percentage)
465.tonto
465.tonto (avg)
465.tonto (avg) (percentage)
465.tonto (max)
465.tonto (max) (percentage)
470.lbm
470.lbm (avg)
470.lbm (avg) (percentage)
470.lbm (max)
470.lbm (max) (percentage)
471.omnetpp
471.omnetpp (avg)
471.omnetpp (avg) (percentage)
471.omnetpp (max)
471.omnetpp (max) (percentage)
473.astar
473.astar (avg)
473.astar (avg) (percentage)
473.astar (max)
473.astar (max) (percentage)
481.wrf (avg) (percentage)
481.wrf (max) (percentage)
482.sphinx3
482.sphinx3 (avg)
482.sphinx3 (avg) (percentage)
482.sphinx3 (max)
482.sphinx3 (max) (percentage)
483.xalancbmk (avg) (percentage)
483.xalancbmk (max) (percentage)


Report Time: 0.36s
Name Current %
401.bzip2 2752.000 -1.50%
410.bwaves 4191.000 -
429.mcf 1941.000 -2.36%
433.milc 1021.000 -
434.zeusmp 1774.000 -
435.gromacs 4963.000 -
437.leslie3d 6459.000 -
444.namd 626.000 -
445.gobmk 4767.000 -1.20%
447.dealII 1315.000 -
450.soplex 531.000 -
453.povray 392.000 -
458.sjeng 6420.000 -
459.GemsFDTD 4440.000 -1.27%
462.libquantum 75.000 -2.60%
465.tonto 8353.000 2.08%
470.lbm 3359.000 -1.32%
471.omnetpp 2302.000 -1.75%
473.astar 4850.000 -
482.sphinx3 674.000 -1.17%
Geometric Mean 1923.213 -
Name Current %
401.bzip2 83493.000 -
410.bwaves 27860.000 1.04%
429.mcf 12867.000 -
433.milc 142046.000 -
434.zeusmp 313461.000 -
435.gromacs 954966.000 -
437.leslie3d 119823.000 4.04%
444.namd 286139.000 -
445.gobmk 1734635.000 -
447.dealII 3264677.000 -
450.soplex 433971.000 -
453.povray 1055821.000 -
458.sjeng 162859.000 -
459.GemsFDTD 362936.000 -
462.libquantum 40476.000 -
465.tonto 4022886.000 -
470.lbm 12625.000 -
471.omnetpp 695713.000 -
473.astar 42141.000 -
482.sphinx3 211571.000 -
Geometric Mean 222103.936 -
Name Current %
400.perlbench (avg) (percentage) 1.890 -
400.perlbench (max) (percentage) 0.750 -
401.bzip2 62.000 -1.59%
401.bzip2 (avg) 62.000 -1.59%
401.bzip2 (avg) (percentage) 2.260 -
401.bzip2 (max) 262.000 -7.09%
401.bzip2 (max) (percentage) 9.550 -5.63%
403.gcc (avg) (percentage) 4.820 -
403.gcc (max) (percentage) 10.560 -
410.bwaves 61.000 -1.61%
410.bwaves (avg) 61.000 -1.61%
410.bwaves (avg) (percentage) 1.460 -1.35%
410.bwaves (max) 248.000 -6.06%
410.bwaves (max) (percentage) 5.920 -5.73%
410.bwaves (unexplained diff vs previous) 18.000 -79.78%
410.bwaves (unexplained diff vs previous) (percentage) 0.430 -79.62%
416.gamess (avg) (percentage) 0.250 -
416.gamess (max) (percentage) 0.470 -
429.mcf 93.000 -3.12%
429.mcf (avg) 93.000 -3.12%
429.mcf (avg) (percentage) 4.800 -
429.mcf (max) 92.000 -13.21%
429.mcf (max) (percentage) 4.750 -11.05%
429.mcf (unexplained diff vs previous) 47.000 -
429.mcf (unexplained diff vs previous) (percentage) 2.420 2.54%
433.milc 15.000 -
433.milc (avg) 15.000 -
433.milc (avg) (percentage) 1.490 -
433.milc (max) 46.000 -6.12%
433.milc (max) (percentage) 4.560 -5.79%
433.milc (unexplained diff vs previous) 5.000 -82.76%
433.milc (unexplained diff vs previous) (percentage) 0.490 -82.69%
434.zeusmp 22.000 -
434.zeusmp (avg) 22.000 -
434.zeusmp (avg) (percentage) 1.280 -
434.zeusmp (max) 66.000 -5.71%
434.zeusmp (max) (percentage) 3.740 -5.79%
435.gromacs 126.000 -
435.gromacs (avg) 126.000 -
435.gromacs (avg) (percentage) 2.550 -
435.gromacs (max) 200.000 -5.66%
435.gromacs (max) (percentage) 4.040 -6.26%
436.cactusADM (avg) (percentage) 1.020 -
436.cactusADM (max) (percentage) 1.610 -
437.leslie3d 241.000 -
437.leslie3d (avg) 241.000 -
437.leslie3d (avg) (percentage) 3.740 -
437.leslie3d (max) 508.000 -5.75%
437.leslie3d (max) (percentage) 7.870 -6.53%
444.namd 6.000 -
444.namd (avg) 6.000 -
444.namd (avg) (percentage) 1.040 -
444.namd (max) 23.000 -4.17%
444.namd (max) (percentage) 3.760 -5.53%
445.gobmk 51.000 -1.92%
445.gobmk (avg) 51.000 -1.92%
445.gobmk (avg) (percentage) 1.090 -
445.gobmk (max) 174.000 -5.43%
445.gobmk (max) (percentage) 3.660 -4.44%
447.dealII 18.000 -
447.dealII (avg) 18.000 -
447.dealII (avg) (percentage) 1.420 -
447.dealII (max) 93.000 -3.12%
447.dealII (max) (percentage) 7.110 -2.47%
450.soplex 20.000 -
450.soplex (avg) 20.000 -
450.soplex (avg) (percentage) 3.910 -
450.soplex (max) 78.000 -6.02%
450.soplex (max) (percentage) 14.850 -4.69%
453.povray 6.000 -
453.povray (avg) 6.000 -
453.povray (avg) (percentage) 1.560 -
453.povray (max) 22.000 -8.33%
453.povray (max) (percentage) 5.840 -4.73%
454.calculix (avg) (percentage) 2.830 -
454.calculix (max) (percentage) 1.010 -
456.hmmer (avg) (percentage) 0.820 -
456.hmmer (max) (percentage) 1.120 -
458.sjeng 50.000 -
458.sjeng (avg) 50.000 -
458.sjeng (avg) (percentage) 0.790 -
458.sjeng (max) 123.000 -5.38%
458.sjeng (max) (percentage) 1.920 -5.42%
459.GemsFDTD 67.000 -1.47%
459.GemsFDTD (avg) 67.000 -1.47%
459.GemsFDTD (avg) (percentage) 1.530 -
459.GemsFDTD (max) 191.000 -6.83%
459.GemsFDTD (max) (percentage) 4.310 -5.69%
462.libquantum 1.000 -50.00%
462.libquantum (avg) 1.000 -50.00%
462.libquantum (avg) (percentage) 2.640 -
462.libquantum (max) 5.000 -
462.libquantum (max) (percentage) 6.870 -4.98%
464.h264ref (avg) (percentage) 0.930 -
464.h264ref (max) (percentage) 1.380 -
465.tonto 98.000 2.08%
465.tonto (avg) 98.000 2.08%
465.tonto (avg) (percentage) 1.180 -
465.tonto (max) 227.000 -3.40%
465.tonto (max) (percentage) 2.720 -5.56%
470.lbm 43.000 -2.27%
470.lbm (avg) 43.000 -2.27%
470.lbm (avg) (percentage) 1.300 -
470.lbm (max) 129.000 -7.19%
470.lbm (max) (percentage) 3.870 -5.84%
470.lbm (unexplained diff vs previous) 45.000 350.00%
470.lbm (unexplained diff vs previous) (percentage) 1.340 362.07%
471.omnetpp 56.000 -3.45%
471.omnetpp (avg) 56.000 -3.45%
471.omnetpp (avg) (percentage) 2.470 -
471.omnetpp (max) 140.000 -7.28%
471.omnetpp (max) (percentage) 6.100 -5.72%
471.omnetpp (unexplained diff vs previous) 41.000 -26.79%
471.omnetpp (unexplained diff vs previous) (percentage) 1.780 -25.52%
473.astar 122.000 -
473.astar (avg) 122.000 -
473.astar (avg) (percentage) 2.520 -
473.astar (max) 299.000 -6.27%
473.astar (max) (percentage) 6.180 -5.79%
481.wrf (avg) (percentage) 1.850 -
481.wrf (max) (percentage) 1.040 -
482.sphinx3 16.000 -
482.sphinx3 (avg) 16.000 -
482.sphinx3 (avg) (percentage) 2.480 -
482.sphinx3 (max) 66.000 -7.04%
482.sphinx3 (max) (percentage) 9.860 -6.45%
483.xalancbmk (avg) (percentage) 1.550 -
483.xalancbmk (max) (percentage) 2.380 -
Geometric Mean 10.447 -6.31%