Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=6a83ffd4e93607684c2036681f0de1641870ef52 (unchanged)
git_gcc https://gcc.gnu.org/git/gcc.git (f242f79b8afeec58477e99c44530bd503878c6d5) (unchanged)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=2fe5e2af0995a6e6ee2c761e55e7596a3220d07c (+ 251 commits)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/bfa40f51f6440f26bf7686eca23a2c2e126e3084 (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-arm-master-O2-build/316/
Filter

gnu-arm-master-O2 test results

Run Order Start Time Duration
Current 0316 (glibc-2.41.9000-00119-g2fe5e2af099) 2025-01-30T11:16:03 0:00:00
Previous 0316 (glibc-2.41.9000-00119-g2fe5e2af099) 2025-01-30T11:16:03 0:00:00
Baseline 0001 (4-changed-components) 2023-03-23T16:47:15 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 0 17
Performance Improvements 0 15
Added Tests 0 130
Unchanged Tests 1176 1014
Total Tests 1176

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
410.bwaves 3.99% 23410.000 24343.000 - 0.00% -
465.tonto 3.27% 3107830.000 3209448.000 - 0.00% -
444.namd 3.21% 223054.000 230214.000 - 0.00% -
462.libquantum 3.21% 32503.000 33546.000 - 0.00% -
445.gobmk 3.01% 1358581.000 1399517.000 - 0.00% -
436.cactusADM 2.68% 582059.000 597651.000 - 0.00% -
400.perlbench 2.02% 981846.000 1001687.000 - 0.00% -
447.dealII 1.19% 2447503.000 2476621.000 - 0.00% -
450.soplex 1.10% 298431.000 301726.000 - 0.00% -
429.mcf 1.09% 10303.000 10415.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
400.perlbench 9.13% 1369.000 1494.000 - 0.00% -
458.sjeng 5.52% 7048.000 7437.000 - 0.00% -
471.omnetpp 3.49% 2351.000 2433.000 - 0.00% -
473.astar 2.89% 4714.000 4850.000 - 0.00% -
465.tonto 1.89% 9514.000 9694.000 - 0.00% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -17.24% 29.000 24.000 - 0.00% -
nb_execution_successful -17.24% 29.000 24.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d -5.38% 82727.000 78280.000 - 0.00% -
473.astar -1.56% 31376.000 30888.000 - 0.00% -
482.sphinx3 -1.41% 153015.000 150851.000 - 0.00% -
459.GemsFDTD -1.30% 332309.000 327997.000 - 0.00% -
453.povray -1.28% 768026.000 758167.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
462.libquantum -9.91% 111.000 100.000 - 0.00% -
453.povray -4.92% 447.000 425.000 - 0.00% -
437.leslie3d -3.59% 9861.000 9507.000 - 0.00% -
445.gobmk -3.19% 4950.000 4792.000 - 0.00% -
447.dealII -2.56% 1757.000 1712.000 - 0.00% -
470.lbm -1.33% 3842.000 3791.000 - 0.00% -
410.bwaves -1.14% 5252.000 5192.000 - 0.00% -
434.zeusmp -1.13% 2384.000 2357.000 - 0.00% -
459.GemsFDTD -1.02% 5078.000 5026.000 - 0.00% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 17.24% 29.000 34.000 - 0.00% -

Added Tests - sample variability
400.perlbench
400.perlbench (avg)
400.perlbench (avg) (percentage)
400.perlbench (max)
400.perlbench (max) (percentage)
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
403.gcc (avg) (percentage)
403.gcc (max) (percentage)
410.bwaves
410.bwaves (avg)
410.bwaves (avg) (percentage)
410.bwaves (max)
410.bwaves (max) (percentage)
416.gamess (avg) (percentage)
416.gamess (max) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
433.milc
433.milc (avg)
433.milc (avg) (percentage)
433.milc (max)
433.milc (max) (percentage)
434.zeusmp
434.zeusmp (avg)
434.zeusmp (avg) (percentage)
434.zeusmp (max)
434.zeusmp (max) (percentage)
435.gromacs
435.gromacs (avg)
435.gromacs (avg) (percentage)
435.gromacs (max)
435.gromacs (max) (percentage)
436.cactusADM
436.cactusADM (avg)
436.cactusADM (avg) (percentage)
436.cactusADM (max)
436.cactusADM (max) (percentage)
437.leslie3d
437.leslie3d (avg)
437.leslie3d (avg) (percentage)
437.leslie3d (max)
437.leslie3d (max) (percentage)
444.namd
444.namd (avg)
444.namd (avg) (percentage)
444.namd (max)
444.namd (max) (percentage)
445.gobmk
445.gobmk (avg)
445.gobmk (avg) (percentage)
445.gobmk (max)
445.gobmk (max) (percentage)
447.dealII
447.dealII (avg)
447.dealII (avg) (percentage)
447.dealII (max)
447.dealII (max) (percentage)
450.soplex
450.soplex (avg)
450.soplex (avg) (percentage)
450.soplex (max)
450.soplex (max) (percentage)
453.povray
453.povray (avg)
453.povray (avg) (percentage)
453.povray (max)
453.povray (max) (percentage)
454.calculix (avg) (percentage)
454.calculix (max) (percentage)
456.hmmer
456.hmmer (avg)
456.hmmer (avg) (percentage)
456.hmmer (max)
456.hmmer (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
459.GemsFDTD
459.GemsFDTD (avg)
459.GemsFDTD (avg) (percentage)
459.GemsFDTD (max)
459.GemsFDTD (max) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)
464.h264ref
464.h264ref (avg)
464.h264ref (avg) (percentage)
464.h264ref (max)
464.h264ref (max) (percentage)
465.tonto
465.tonto (avg)
465.tonto (avg) (percentage)
465.tonto (max)
465.tonto (max) (percentage)
470.lbm
470.lbm (avg)
470.lbm (avg) (percentage)
470.lbm (max)
470.lbm (max) (percentage)
471.omnetpp
471.omnetpp (avg)
471.omnetpp (avg) (percentage)
471.omnetpp (max)
471.omnetpp (max) (percentage)
473.astar
473.astar (avg)
473.astar (avg) (percentage)
473.astar (max)
473.astar (max) (percentage)
481.wrf (avg) (percentage)
481.wrf (max) (percentage)
482.sphinx3
482.sphinx3 (avg)
482.sphinx3 (avg) (percentage)
482.sphinx3 (max)
482.sphinx3 (max) (percentage)
483.xalancbmk (avg) (percentage)
483.xalancbmk (max) (percentage)


Report Time: 0.35s
Name Current %
400.perlbench 1494.000 -
401.bzip2 2640.000 -
410.bwaves 5192.000 -
429.mcf 1123.000 -
433.milc 1101.000 -
434.zeusmp 2357.000 -
435.gromacs 5452.000 -
436.cactusADM 2369.000 -
437.leslie3d 9507.000 -
444.namd 760.000 -
445.gobmk 4792.000 -
447.dealII 1712.000 -
450.soplex 511.000 -
453.povray 425.000 -
456.hmmer 3479.000 -
458.sjeng 7437.000 -
459.GemsFDTD 5026.000 -
462.libquantum 100.000 -
464.h264ref 5777.000 -
465.tonto 9694.000 -
470.lbm 3791.000 -
471.omnetpp 2433.000 -
473.astar 4850.000 -
482.sphinx3 740.000 -
Geometric Mean 2234.167 -
Name Current %
400.perlbench 1001687.000 -
401.bzip2 52872.000 -
410.bwaves 24343.000 -
429.mcf 10415.000 -
433.milc 98550.000 -
434.zeusmp 233240.000 -
435.gromacs 735545.000 -
436.cactusADM 597651.000 -
437.leslie3d 78280.000 -
444.namd 230214.000 -
445.gobmk 1399517.000 -
447.dealII 2476621.000 -
450.soplex 301726.000 -
453.povray 758167.000 -
456.hmmer 233973.000 -
458.sjeng 126220.000 -
459.GemsFDTD 327997.000 -
462.libquantum 33546.000 -
464.h264ref 472148.000 -
465.tonto 3209448.000 -
470.lbm 11146.000 -
471.omnetpp 505030.000 -
473.astar 30888.000 -
482.sphinx3 150851.000 -
Geometric Mean 203364.293 -
Name Current %
400.perlbench 27.000 -
400.perlbench (avg) 27.000 -
400.perlbench (avg) (percentage) 1.840 -
400.perlbench (max) 57.000 -
400.perlbench (max) (percentage) 3.880 -
400.perlbench (unexplained diff vs previous) 8.000 -
400.perlbench (unexplained diff vs previous) (percentage) 0.540 -
401.bzip2 44.000 -
401.bzip2 (avg) 44.000 -
401.bzip2 (avg) (percentage) 1.680 -
401.bzip2 (max) 76.000 -
401.bzip2 (max) (percentage) 2.910 -
401.bzip2 (unexplained diff vs previous) 74.000 -
401.bzip2 (unexplained diff vs previous) (percentage) 2.800 -
403.gcc (avg) (percentage) 7.670 -
403.gcc (max) (percentage) 12.200 -
410.bwaves 38.000 -
410.bwaves (avg) 38.000 -
410.bwaves (avg) (percentage) 0.740 -
410.bwaves (max) 65.000 -
410.bwaves (max) (percentage) 1.260 -
410.bwaves (unexplained diff vs previous) 19.000 -
410.bwaves (unexplained diff vs previous) (percentage) 0.370 -
416.gamess (avg) (percentage) 0.200 -
416.gamess (max) (percentage) 0.210 -
429.mcf 40.000 -
429.mcf (avg) 40.000 -
429.mcf (avg) (percentage) 3.610 -
429.mcf (max) 66.000 -
429.mcf (max) (percentage) 5.950 -
429.mcf (unexplained diff vs previous) 70.000 -
429.mcf (unexplained diff vs previous) (percentage) 6.230 -
433.milc 9.000 -
433.milc (avg) 9.000 -
433.milc (avg) (percentage) 0.850 -
433.milc (max) 21.000 -
433.milc (max) (percentage) 1.960 -
433.milc (unexplained diff vs previous) 22.000 -
433.milc (unexplained diff vs previous) (percentage) 2.000 -
434.zeusmp 20.000 -
434.zeusmp (avg) 20.000 -
434.zeusmp (avg) (percentage) 0.870 -
434.zeusmp (max) 66.000 -
434.zeusmp (max) (percentage) 2.840 -
434.zeusmp (unexplained diff vs previous) 69.000 -
434.zeusmp (unexplained diff vs previous) (percentage) 2.930 -
435.gromacs 109.000 -
435.gromacs (avg) 109.000 -
435.gromacs (avg) (percentage) 2.010 -
435.gromacs (max) 279.000 -
435.gromacs (max) (percentage) 5.130 -
435.gromacs (unexplained diff vs previous) 295.000 -
435.gromacs (unexplained diff vs previous) (percentage) 5.410 -
436.cactusADM 12.000 -
436.cactusADM (avg) 12.000 -
436.cactusADM (avg) (percentage) 0.520 -
436.cactusADM (max) 24.000 -
436.cactusADM (max) (percentage) 1.020 -
436.cactusADM (unexplained diff vs previous) 24.000 -
436.cactusADM (unexplained diff vs previous) (percentage) 1.010 -
437.leslie3d 520.000 -
437.leslie3d (avg) 520.000 -
437.leslie3d (avg) (percentage) 5.470 -
437.leslie3d (max) 931.000 -
437.leslie3d (max) (percentage) 9.800 -
437.leslie3d (unexplained diff vs previous) 1033.000 -
437.leslie3d (unexplained diff vs previous) (percentage) 10.870 -
444.namd 4.000 -
444.namd (avg) 4.000 -
444.namd (avg) (percentage) 0.610 -
444.namd (max) 4.000 -
444.namd (max) (percentage) 0.570 -
444.namd (unexplained diff vs previous) 2.000 -
444.namd (unexplained diff vs previous) (percentage) 0.260 -
445.gobmk 38.000 -
445.gobmk (avg) 38.000 -
445.gobmk (avg) (percentage) 0.800 -
445.gobmk (max) 108.000 -
445.gobmk (max) (percentage) 2.260 -
445.gobmk (unexplained diff vs previous) 111.000 -
445.gobmk (unexplained diff vs previous) (percentage) 2.320 -
447.dealII 18.000 -
447.dealII (avg) 18.000 -
447.dealII (avg) (percentage) 1.070 -
447.dealII (max) 42.000 -
447.dealII (max) (percentage) 2.510 -
447.dealII (unexplained diff vs previous) 44.000 -
447.dealII (unexplained diff vs previous) (percentage) 2.570 -
450.soplex 11.000 -
450.soplex (avg) 11.000 -
450.soplex (avg) (percentage) 2.280 -
450.soplex (max) 30.000 -
450.soplex (max) (percentage) 6.000 -
450.soplex (unexplained diff vs previous) 32.000 -
450.soplex (unexplained diff vs previous) (percentage) 6.260 -
453.povray 4.000 -
453.povray (avg) 4.000 -
453.povray (avg) (percentage) 0.990 -
453.povray (max) 2.000 -
453.povray (max) (percentage) 0.700 -
453.povray (unexplained diff vs previous) 2.000 -
453.povray (unexplained diff vs previous) (percentage) 0.470 -
454.calculix (avg) (percentage) 3.250 -
454.calculix (max) (percentage) 3.040 -
456.hmmer 8.000 -
456.hmmer (avg) 8.000 -
456.hmmer (avg) (percentage) 0.240 -
456.hmmer (max) 11.000 -
456.hmmer (max) (percentage) 0.320 -
456.hmmer (unexplained diff vs previous) 8.000 -
456.hmmer (unexplained diff vs previous) (percentage) 0.230 -
458.sjeng 39.000 -
458.sjeng (avg) 39.000 -
458.sjeng (avg) (percentage) 0.530 -
458.sjeng (max) 100.000 -
458.sjeng (max) (percentage) 1.350 -
458.sjeng (unexplained diff vs previous) 69.000 -
458.sjeng (unexplained diff vs previous) (percentage) 0.930 -
459.GemsFDTD 51.000 -
459.GemsFDTD (avg) 51.000 -
459.GemsFDTD (avg) (percentage) 1.030 -
459.GemsFDTD (max) 140.000 -
459.GemsFDTD (max) (percentage) 2.790 -
459.GemsFDTD (unexplained diff vs previous) 144.000 -
459.GemsFDTD (unexplained diff vs previous) (percentage) 2.870 -
462.libquantum 1.000 -
462.libquantum (avg) 1.000 -
462.libquantum (avg) (percentage) 1.870 -
462.libquantum (max) 3.000 -
462.libquantum (max) (percentage) 3.000 -
462.libquantum (unexplained diff vs previous) 1.000 -
462.libquantum (unexplained diff vs previous) (percentage) 1.000 -
464.h264ref 23.000 -
464.h264ref (avg) 23.000 -
464.h264ref (avg) (percentage) 0.410 -
464.h264ref (max) 56.000 -
464.h264ref (max) (percentage) 0.970 -
464.h264ref (unexplained diff vs previous) 46.000 -
464.h264ref (unexplained diff vs previous) (percentage) 0.800 -
465.tonto 104.000 -
465.tonto (avg) 104.000 -
465.tonto (avg) (percentage) 1.080 -
465.tonto (max) 206.000 -
465.tonto (max) (percentage) 2.130 -
465.tonto (unexplained diff vs previous) 209.000 -
465.tonto (unexplained diff vs previous) (percentage) 2.160 -
470.lbm 30.000 -
470.lbm (avg) 30.000 -
470.lbm (avg) (percentage) 0.810 -
470.lbm (max) 90.000 -
470.lbm (max) (percentage) 2.390 -
470.lbm (unexplained diff vs previous) 93.000 -
470.lbm (unexplained diff vs previous) (percentage) 2.450 -
471.omnetpp 34.000 -
471.omnetpp (avg) 34.000 -
471.omnetpp (avg) (percentage) 1.430 -
471.omnetpp (max) 34.000 -
471.omnetpp (max) (percentage) 1.420 -
471.omnetpp (unexplained diff vs previous) 21.000 -
471.omnetpp (unexplained diff vs previous) (percentage) 0.860 -
473.astar 67.000 -
473.astar (avg) 67.000 -
473.astar (avg) (percentage) 1.400 -
473.astar (max) 159.000 -
473.astar (max) (percentage) 3.290 -
473.astar (unexplained diff vs previous) 165.000 -
473.astar (unexplained diff vs previous) (percentage) 3.400 -
481.wrf (avg) (percentage) 1.430 -
481.wrf (max) (percentage) 0.670 -
482.sphinx3 9.000 -
482.sphinx3 (avg) 9.000 -
482.sphinx3 (avg) (percentage) 1.290 -
482.sphinx3 (max) 20.000 -
482.sphinx3 (max) (percentage) 2.760 -
482.sphinx3 (unexplained diff vs previous) 21.000 -
482.sphinx3 (unexplained diff vs previous) (percentage) 2.840 -
483.xalancbmk (avg) (percentage) 1.390 -
483.xalancbmk (max) (percentage) 1.010 -
Geometric Mean 7.785 -