Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=b381c2381c5b069c3f2e969334368c4d4fdf25be (+ 190 commits)
git_gcc https://gcc.gnu.org/git/gcc.git (1789c57dc97ea2f9819ef89e28bf17208b6208e7) (+ 490 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=59f64a1f4f3bbe2bcaf8fc1951b94e1d0e7d307e (+ 41 commits)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/d2cb798d2d8ceb0d194721a2cb0e577b4b927573 (+ 14280 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-arm-master-Os-build/328/
Filter

gnu-arm-master-Os test results

Run Order Start Time Duration
Current 0328 (4-changed-components) 2025-04-20T07:15:33 0:00:00
Previous 0325 (4-changed-components) 2025-04-07T22:49:24 0:00:00
Baseline 0309 (4-changed-components) 2025-02-21T00:17:36 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 22 1
Performance Improvements 78 3
Added Tests 0 100
Unchanged Tests 812 808
Total Tests 912

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
429.mcf 2.35% 1194.000 1222.000 - -1.37% -
435.gromacs 1.22% 7235.000 7323.000 - 0.11% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
410.bwaves (avg) (percentage) 66.07% 0.560 0.930 - 0.00% -
410.bwaves 62.16% 37.000 60.000 - 0.00% -
410.bwaves (avg) 62.16% 37.000 60.000 - 0.00% -
410.bwaves (unexplained diff vs previous) (percentage) 50.86% 1.160 1.750 - 0.00% -
410.bwaves (unexplained diff vs previous) 48.05% 77.000 114.000 - 0.00% -
410.bwaves (max) (percentage) 47.01% 1.170 1.720 - 0.00% -
410.bwaves (max) 45.45% 77.000 112.000 - 0.00% -
458.sjeng (avg) (percentage) 27.12% 0.590 0.750 - 0.00% -
458.sjeng 25.53% 47.000 59.000 - 0.00% -
458.sjeng (avg) 25.53% 47.000 59.000 - 0.00% -
444.namd (avg) (percentage) 20.00% 2.000 2.400 - 0.00% -
471.omnetpp (avg) (percentage) 17.47% 2.920 3.430 - 0.00% -
444.namd 16.67% 18.000 21.000 - 0.00% -
444.namd (avg) 16.67% 18.000 21.000 - 0.00% -
471.omnetpp 11.36% 88.000 98.000 - 0.00% -
471.omnetpp (avg) 11.36% 88.000 98.000 - 0.00% -
470.lbm (avg) (percentage) 1.95% 1.540 1.570 - 0.00% -
435.gromacs 1.82% 110.000 112.000 - 0.00% -
435.gromacs (avg) 1.82% 110.000 112.000 - 0.00% -
458.sjeng (unexplained diff vs previous) (percentage) 1.01% 0.990 1.000 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
482.sphinx3 -7.95% 981.000 903.000 - -0.33% -
450.soplex -6.87% 626.000 583.000 - -3.16% -
401.bzip2 -6.34% 3219.000 3015.000 - -0.66% -
447.dealII -5.25% 2325.000 2203.000 - -0.45% -
471.omnetpp -4.69% 3025.000 2883.000 - 0.66% -
453.povray -4.14% 531.000 509.000 - -0.59% -
433.milc -3.75% 1172.000 1128.000 - -0.44% -
437.leslie3d -3.70% 11903.000 11462.000 - 0.17% -
462.libquantum -3.64% 220.000 212.000 - -2.30% -
444.namd -3.14% 923.000 894.000 - -0.33% -
473.astar -2.44% 5540.000 5405.000 - 0.32% -
410.bwaves -1.72% 6639.000 6525.000 - -0.18% -
470.lbm -1.64% 3659.000 3599.000 - -0.50% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
473.astar (unexplained diff vs previous) -55.74% 305.000 135.000 - 0.00% -
473.astar (unexplained diff vs previous) (percentage) -54.63% 5.510 2.500 - 0.00% -
470.lbm (unexplained diff vs previous) -47.83% 115.000 60.000 - 0.00% -
470.lbm (unexplained diff vs previous) (percentage) -46.82% 3.140 1.670 - 0.00% -
470.lbm (max) -17.80% 118.000 97.000 - 0.00% -
453.povray (max) -16.67% 12.000 10.000 - 0.00% -
470.lbm (max) (percentage) -16.67% 3.240 2.700 - 0.00% -
471.omnetpp (max) -16.56% 163.000 136.000 - 0.00% -
482.sphinx3 (max) -16.07% 112.000 94.000 - 0.00% -
450.soplex (max) -15.28% 72.000 61.000 - 0.00% -
473.astar (max) -14.60% 322.000 275.000 - 0.00% -
401.bzip2 (max) -14.11% 397.000 341.000 - 0.00% -
447.dealII (max) -13.51% 111.000 96.000 - 0.00% -
473.astar (max) (percentage) -12.52% 5.830 5.100 - 0.00% -
462.libquantum (max) -12.50% 8.000 7.000 - 0.00% -
471.omnetpp (max) (percentage) -12.41% 5.400 4.730 - 0.00% -
429.mcf (unexplained diff vs previous) (percentage) -11.92% 2.600 2.290 - 0.00% -
437.leslie3d (max) -11.86% 683.000 602.000 - 0.00% -
433.milc (max) -11.76% 68.000 60.000 - 0.00% -
429.mcf (unexplained diff vs previous) -9.68% 31.000 28.000 - 0.00% -
444.namd (max) -9.68% 31.000 28.000 - 0.00% -
459.GemsFDTD (max) -9.21% 239.000 217.000 - 0.00% -
434.zeusmp (max) -8.77% 57.000 52.000 - 0.00% -
445.gobmk (max) -8.63% 139.000 127.000 - 0.00% -
465.tonto (max) -8.40% 238.000 218.000 - 0.00% -
471.omnetpp (unexplained diff vs previous) -8.39% 155.000 142.000 - 0.00% -
450.soplex (max) (percentage) -8.37% 11.590 10.620 - 0.00% -
447.dealII (max) (percentage) -8.37% 4.780 4.380 - 0.00% -
437.leslie3d (max) (percentage) -8.36% 5.740 5.260 - 0.00% -
482.sphinx3 (max) (percentage) -8.36% 11.480 10.520 - 0.00% -
459.GemsFDTD (max) (percentage) -8.36% 3.350 3.070 - 0.00% -
433.milc (max) (percentage) -8.35% 5.870 5.380 - 0.00% -
465.tonto (max) (percentage) -8.33% 1.800 1.650 - 0.00% -
434.zeusmp (max) (percentage) -8.33% 2.040 1.870 - 0.00% -
401.bzip2 (max) (percentage) -8.33% 12.360 11.330 - 0.00% -
445.gobmk (max) (percentage) -8.30% 2.650 2.430 - 0.00% -
453.povray (max) (percentage) -8.23% 2.310 2.120 - 0.00% -
462.libquantum (max) (percentage) -8.22% 3.770 3.460 - 0.00% -
482.sphinx3 -7.69% 52.000 48.000 - 0.00% -
482.sphinx3 (avg) -7.69% 52.000 48.000 - 0.00% -
450.soplex -6.82% 44.000 41.000 - 0.00% -
450.soplex (avg) -6.82% 44.000 41.000 - 0.00% -
429.mcf (avg) (percentage) -6.60% 2.880 2.690 - 0.00% -
473.astar -6.58% 152.000 142.000 - 0.00% -
473.astar (avg) -6.58% 152.000 142.000 - 0.00% -
444.namd (max) (percentage) -6.55% 3.360 3.140 - 0.00% -
401.bzip2 -6.49% 231.000 216.000 - 0.00% -
401.bzip2 (avg) -6.49% 231.000 216.000 - 0.00% -
435.gromacs (max) (percentage) -6.40% 2.500 2.340 - 0.00% -
429.mcf -5.88% 34.000 32.000 - 0.00% -
429.mcf (avg) -5.88% 34.000 32.000 - 0.00% -
435.gromacs (max) -5.00% 180.000 171.000 - 0.00% -
429.mcf (max) (percentage) -4.70% 3.190 3.040 - 0.00% -
447.dealII -4.48% 67.000 64.000 - 0.00% -
447.dealII (avg) -4.48% 67.000 64.000 - 0.00% -
473.astar (avg) (percentage) -4.35% 2.760 2.640 - 0.00% -
471.omnetpp (unexplained diff vs previous) (percentage) -3.71% 5.120 4.930 - 0.00% -
437.leslie3d -3.60% 555.000 535.000 - 0.00% -
437.leslie3d (avg) -3.60% 555.000 535.000 - 0.00% -
444.namd (unexplained diff vs previous) -3.33% 30.000 29.000 - 0.00% -
433.milc -3.03% 33.000 32.000 - 0.00% -
433.milc (avg) -3.03% 33.000 32.000 - 0.00% -
429.mcf (max) -2.63% 38.000 37.000 - 0.00% -
458.sjeng (max) -1.25% 80.000 79.000 - 0.00% -
458.sjeng (max) (percentage) -1.00% 1.000 0.990 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
445.gobmk 1.02% 5190.000 5243.000 - -0.59% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
450.soplex -3.16% 602.000 583.000 - -6.87% -
462.libquantum -2.30% 217.000 212.000 - -3.64% -
429.mcf -1.37% 1239.000 1222.000 - 2.35% -

Added Tests - sample variability
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
410.bwaves
410.bwaves (avg)
410.bwaves (avg) (percentage)
410.bwaves (max)
410.bwaves (max) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
433.milc
433.milc (avg)
433.milc (avg) (percentage)
433.milc (max)
433.milc (max) (percentage)
434.zeusmp
434.zeusmp (avg)
434.zeusmp (avg) (percentage)
434.zeusmp (max)
434.zeusmp (max) (percentage)
435.gromacs
435.gromacs (avg)
435.gromacs (avg) (percentage)
435.gromacs (max)
435.gromacs (max) (percentage)
437.leslie3d
437.leslie3d (avg)
437.leslie3d (avg) (percentage)
437.leslie3d (max)
437.leslie3d (max) (percentage)
444.namd
444.namd (avg)
444.namd (avg) (percentage)
444.namd (max)
444.namd (max) (percentage)
445.gobmk
445.gobmk (avg)
445.gobmk (avg) (percentage)
445.gobmk (max)
445.gobmk (max) (percentage)
447.dealII
447.dealII (avg)
447.dealII (avg) (percentage)
447.dealII (max)
447.dealII (max) (percentage)
450.soplex
450.soplex (avg)
450.soplex (avg) (percentage)
450.soplex (max)
450.soplex (max) (percentage)
453.povray
453.povray (avg)
453.povray (avg) (percentage)
453.povray (max)
453.povray (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
459.GemsFDTD
459.GemsFDTD (avg)
459.GemsFDTD (avg) (percentage)
459.GemsFDTD (max)
459.GemsFDTD (max) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)
465.tonto
465.tonto (avg)
465.tonto (avg) (percentage)
465.tonto (max)
465.tonto (max) (percentage)
470.lbm
470.lbm (avg)
470.lbm (avg) (percentage)
470.lbm (max)
470.lbm (max) (percentage)
471.omnetpp
471.omnetpp (avg)
471.omnetpp (avg) (percentage)
471.omnetpp (max)
471.omnetpp (max) (percentage)
473.astar
473.astar (avg)
473.astar (avg) (percentage)
473.astar (max)
473.astar (max) (percentage)
482.sphinx3
482.sphinx3 (avg)
482.sphinx3 (avg) (percentage)
482.sphinx3 (max)
482.sphinx3 (max) (percentage)


Report Time: 0.27s
Name Current %
401.bzip2 3015.000 -6.34%
410.bwaves 6525.000 -1.72%
429.mcf 1222.000 2.35%
433.milc 1128.000 -3.75%
434.zeusmp 2795.000 -
435.gromacs 7323.000 1.22%
437.leslie3d 11462.000 -3.70%
444.namd 894.000 -3.14%
445.gobmk 5243.000 -
447.dealII 2203.000 -5.25%
450.soplex 583.000 -6.87%
453.povray 509.000 -4.14%
458.sjeng 7997.000 -
459.GemsFDTD 7087.000 -
462.libquantum 212.000 -3.64%
465.tonto 13226.000 -
470.lbm 3599.000 -1.64%
471.omnetpp 2883.000 -4.69%
473.astar 5405.000 -2.44%
482.sphinx3 903.000 -7.95%
Geometric Mean 2569.083 -2.78%
Name Current %
401.bzip2 34391.000 -
410.bwaves 16079.000 -
429.mcf 8050.000 -
433.milc 65802.000 -
434.zeusmp 147832.000 -
435.gromacs 500345.000 -
437.leslie3d 50318.000 -
444.namd 160913.000 -
445.gobmk 1089121.000 -
447.dealII 1353936.000 -
450.soplex 167648.000 -
453.povray 520511.000 -
458.sjeng 83171.000 -
459.GemsFDTD 207628.000 -
462.libquantum 21287.000 -
465.tonto 2047414.000 -
470.lbm 10593.000 -
471.omnetpp 331804.000 -
473.astar 20157.000 -
482.sphinx3 98132.000 -
Geometric Mean 113139.811 -
Name Current %
401.bzip2 216.000 -6.49%
401.bzip2 (avg) 216.000 -6.49%
401.bzip2 (avg) (percentage) 7.190 -
401.bzip2 (max) 341.000 -14.11%
401.bzip2 (max) (percentage) 11.330 -8.33%
410.bwaves 60.000 62.16%
410.bwaves (avg) 60.000 62.16%
410.bwaves (avg) (percentage) 0.930 66.07%
410.bwaves (max) 112.000 45.45%
410.bwaves (max) (percentage) 1.720 47.01%
410.bwaves (unexplained diff vs previous) 114.000 48.05%
410.bwaves (unexplained diff vs previous) (percentage) 1.750 50.86%
429.mcf 32.000 -5.88%
429.mcf (avg) 32.000 -5.88%
429.mcf (avg) (percentage) 2.690 -6.60%
429.mcf (max) 37.000 -2.63%
429.mcf (max) (percentage) 3.040 -4.70%
429.mcf (unexplained diff vs previous) 28.000 -9.68%
429.mcf (unexplained diff vs previous) (percentage) 2.290 -11.92%
433.milc 32.000 -3.03%
433.milc (avg) 32.000 -3.03%
433.milc (avg) (percentage) 2.880 -
433.milc (max) 60.000 -11.76%
433.milc (max) (percentage) 5.380 -8.35%
434.zeusmp 32.000 -
434.zeusmp (avg) 32.000 -
434.zeusmp (avg) (percentage) 1.150 -
434.zeusmp (max) 52.000 -8.77%
434.zeusmp (max) (percentage) 1.870 -8.33%
435.gromacs 112.000 1.82%
435.gromacs (avg) 112.000 1.82%
435.gromacs (avg) (percentage) 1.530 -
435.gromacs (max) 171.000 -5.00%
435.gromacs (max) (percentage) 2.340 -6.40%
437.leslie3d 535.000 -3.60%
437.leslie3d (avg) 535.000 -3.60%
437.leslie3d (avg) (percentage) 4.670 -
437.leslie3d (max) 602.000 -11.86%
437.leslie3d (max) (percentage) 5.260 -8.36%
444.namd 21.000 16.67%
444.namd (avg) 21.000 16.67%
444.namd (avg) (percentage) 2.400 20.00%
444.namd (max) 28.000 -9.68%
444.namd (max) (percentage) 3.140 -6.55%
444.namd (unexplained diff vs previous) 29.000 -3.33%
444.namd (unexplained diff vs previous) (percentage) 3.240 -
445.gobmk 84.000 -
445.gobmk (avg) 84.000 -
445.gobmk (avg) (percentage) 1.610 -
445.gobmk (max) 127.000 -8.63%
445.gobmk (max) (percentage) 2.430 -8.30%
447.dealII 64.000 -4.48%
447.dealII (avg) 64.000 -4.48%
447.dealII (avg) (percentage) 2.910 -
447.dealII (max) 96.000 -13.51%
447.dealII (max) (percentage) 4.380 -8.37%
450.soplex 41.000 -6.82%
450.soplex (avg) 41.000 -6.82%
450.soplex (avg) (percentage) 7.070 -
450.soplex (max) 61.000 -15.28%
450.soplex (max) (percentage) 10.620 -8.37%
453.povray 9.000 -
453.povray (avg) 9.000 -
453.povray (avg) (percentage) 1.810 -
453.povray (max) 10.000 -16.67%
453.povray (max) (percentage) 2.120 -8.23%
458.sjeng 59.000 25.53%
458.sjeng (avg) 59.000 25.53%
458.sjeng (avg) (percentage) 0.750 27.12%
458.sjeng (max) 79.000 -1.25%
458.sjeng (max) (percentage) 0.990 -1.00%
458.sjeng (unexplained diff vs previous) 80.000 -
458.sjeng (unexplained diff vs previous) (percentage) 1.000 1.01%
459.GemsFDTD 122.000 -
459.GemsFDTD (avg) 122.000 -
459.GemsFDTD (avg) (percentage) 1.730 -
459.GemsFDTD (max) 217.000 -9.21%
459.GemsFDTD (max) (percentage) 3.070 -8.36%
462.libquantum 4.000 -
462.libquantum (avg) 4.000 -
462.libquantum (avg) (percentage) 2.260 -
462.libquantum (max) 7.000 -12.50%
462.libquantum (max) (percentage) 3.460 -8.22%
465.tonto 170.000 -
465.tonto (avg) 170.000 -
465.tonto (avg) (percentage) 1.290 -
465.tonto (max) 218.000 -8.40%
465.tonto (max) (percentage) 1.650 -8.33%
470.lbm 56.000 -
470.lbm (avg) 56.000 -
470.lbm (avg) (percentage) 1.570 1.95%
470.lbm (max) 97.000 -17.80%
470.lbm (max) (percentage) 2.700 -16.67%
470.lbm (unexplained diff vs previous) 60.000 -47.83%
470.lbm (unexplained diff vs previous) (percentage) 1.670 -46.82%
471.omnetpp 98.000 11.36%
471.omnetpp (avg) 98.000 11.36%
471.omnetpp (avg) (percentage) 3.430 17.47%
471.omnetpp (max) 136.000 -16.56%
471.omnetpp (max) (percentage) 4.730 -12.41%
471.omnetpp (unexplained diff vs previous) 142.000 -8.39%
471.omnetpp (unexplained diff vs previous) (percentage) 4.930 -3.71%
473.astar 142.000 -6.58%
473.astar (avg) 142.000 -6.58%
473.astar (avg) (percentage) 2.640 -4.35%
473.astar (max) 275.000 -14.60%
473.astar (max) (percentage) 5.100 -12.52%
473.astar (unexplained diff vs previous) 135.000 -55.74%
473.astar (unexplained diff vs previous) (percentage) 2.500 -54.63%
482.sphinx3 48.000 -7.69%
482.sphinx3 (avg) 48.000 -7.69%
482.sphinx3 (avg) (percentage) 5.350 -
482.sphinx3 (max) 94.000 -16.07%
482.sphinx3 (max) (percentage) 10.520 -8.36%
Geometric Mean 17.935 -3.16%