Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=b664df49f3d07941874dce0bd991c48a37cbf409 (+ 346 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/18dac101678b8c0aed4bd995351e47f26cd54dec (+ 819 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=721f30116ce653fffb0156e1298c8063833396e3 (+ 96 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=3a9c734cf38026353ce3ea9ca342f4ee2cee4ddd (+ 16668 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-arm-master-O2-build/43/
Filter

gnu-arm-master-O2 test results

Run Order Start Time Duration
Current 0043 (4-changed-components) 2023-06-27T04:51:08 0:00:00
Previous 0024 (4-changed-components) 2023-06-09T01:32:36 0:00:00
Baseline 0001 (4-changed-components) 2023-03-23T16:47:15 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 22 19
Performance Improvements 14 6
Added Tests 0 145
Unchanged Tests 1200 1066
Total Tests 1236

Performance Regressions - Code Size Δ Previous Current σ Δ (B) σ (B)
410.bwaves 1.09% 23426.000 23682.000 - 1.16% -

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
403.gcc 7.41% 54.000 58.000 - 9.43% -
473.astar 3.39% 4956.000 5124.000 - 8.70% -
437.leslie3d 2.91% 9960.000 10250.000 - 3.94% -
481.wrf 1.39% 4893.000 4961.000 - 2.65% -
435.gromacs 1.28% 5794.000 5868.000 - 8.13% -
471.omnetpp 1.26% 2390.000 2420.000 - 2.93% -
465.tonto 1.10% 9704.000 9811.000 - 3.12% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
403.gcc (max) 25.00% 4.000 5.000 - 0.00% -
471.omnetpp 4.35% 23.000 24.000 - 0.00% -
471.omnetpp (avg) 4.35% 23.000 24.000 - 0.00% -
473.astar 3.73% 134.000 139.000 - 0.00% -
473.astar (avg) 3.73% 134.000 139.000 - 0.00% -
473.astar (max) 3.30% 212.000 219.000 - 0.00% -
437.leslie3d (max) 3.03% 264.000 272.000 - 0.00% -
437.leslie3d 2.93% 443.000 456.000 - 0.00% -
437.leslie3d (avg) 2.93% 443.000 456.000 - 0.00% -
481.wrf 1.59% 126.000 128.000 - 0.00% -
481.wrf (avg) 1.59% 126.000 128.000 - 0.00% -
481.wrf (max) 1.44% 139.000 141.000 - 0.00% -
435.gromacs (max) 1.34% 298.000 302.000 - 0.00% -
465.tonto (max) 1.20% 167.000 169.000 - 0.00% -

Performance Improvements - Code Size Δ Previous Current σ Δ (B) σ (B)
473.astar -1.34% 31124.000 30708.000 - -2.13% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
454.calculix -3.45% 58.000 56.000 - -1.75% -
447.dealII -2.46% 1789.000 1745.000 - -0.68% -
445.gobmk -1.49% 5116.000 5040.000 - 1.82% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
447.dealII (max) -3.12% 32.000 31.000 - 0.00% -
416.gamess -2.56% 39.000 38.000 - 0.00% -
416.gamess (avg) -2.56% 39.000 38.000 - 0.00% -
445.gobmk (max) -2.11% 95.000 93.000 - 0.00% -
445.gobmk -1.85% 54.000 53.000 - 0.00% -
445.gobmk (avg) -1.85% 54.000 53.000 - 0.00% -
483.xalancbmk -1.52% 66.000 65.000 - 0.00% -
483.xalancbmk (avg) -1.52% 66.000 65.000 - 0.00% -
416.gamess (max) -1.43% 70.000 69.000 - 0.00% -
483.xalancbmk (max) -1.43% 70.000 69.000 - 0.00% -

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
410.bwaves 1.16% 23410.000 23682.000 - 1.09% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
403.gcc 9.43% 53.000 58.000 - 7.41% -
473.astar 8.70% 4714.000 5124.000 - 3.39% -
435.gromacs 8.13% 5427.000 5868.000 - 1.28% -
401.bzip2 6.65% 2617.000 2791.000 - 0.47% -
482.sphinx3 5.02% 737.000 774.000 - 0.65% -
450.soplex 4.66% 515.000 539.000 - 0.56% -
483.xalancbmk 4.07% 3313.000 3448.000 - -0.89% -
437.leslie3d 3.94% 9861.000 10250.000 - 2.91% -
465.tonto 3.12% 9514.000 9811.000 - 1.10% -
471.omnetpp 2.93% 2351.000 2420.000 - 1.26% -
400.perlbench 2.70% 1369.000 1406.000 - 0.07% -
481.wrf 2.65% 4833.000 4961.000 - 1.39% -
433.milc 2.46% 1096.000 1123.000 - 0.27% -
445.gobmk 1.82% 4950.000 5040.000 - -1.49% -
459.GemsFDTD 1.81% 5078.000 5170.000 - 0.14% -
462.libquantum 1.80% 111.000 113.000 - 0.00% -
470.lbm 1.72% 3842.000 3908.000 - 0.41% -
464.h264ref 1.36% 5817.000 5896.000 - 0.14% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
473.astar -2.13% 31376.000 30708.000 - -1.34% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
429.mcf -21.77% 1116.000 873.000 - -0.11% -
454.calculix -1.75% 57.000 56.000 - -3.45% -
410.bwaves -1.43% 5252.000 5177.000 - -0.06% -
453.povray -1.34% 447.000 441.000 - 0.92% -
436.cactusADM -1.01% 2384.000 2360.000 - 0.25% -

Added Tests - sample variability
400.perlbench
400.perlbench (avg)
400.perlbench (avg) (percentage)
400.perlbench (max)
400.perlbench (max) (percentage)
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
403.gcc
403.gcc (avg)
403.gcc (avg) (percentage)
403.gcc (max)
403.gcc (max) (percentage)
410.bwaves
410.bwaves (avg)
410.bwaves (avg) (percentage)
410.bwaves (max)
410.bwaves (max) (percentage)
416.gamess
416.gamess (avg)
416.gamess (avg) (percentage)
416.gamess (max)
416.gamess (max) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
433.milc
433.milc (avg)
433.milc (avg) (percentage)
433.milc (max)
433.milc (max) (percentage)
434.zeusmp
434.zeusmp (avg)
434.zeusmp (avg) (percentage)
434.zeusmp (max)
434.zeusmp (max) (percentage)
435.gromacs
435.gromacs (avg)
435.gromacs (avg) (percentage)
435.gromacs (max)
435.gromacs (max) (percentage)
436.cactusADM
436.cactusADM (avg)
436.cactusADM (avg) (percentage)
436.cactusADM (max)
436.cactusADM (max) (percentage)
437.leslie3d
437.leslie3d (avg)
437.leslie3d (avg) (percentage)
437.leslie3d (max)
437.leslie3d (max) (percentage)
444.namd
444.namd (avg)
444.namd (avg) (percentage)
444.namd (max)
444.namd (max) (percentage)
445.gobmk
445.gobmk (avg)
445.gobmk (avg) (percentage)
445.gobmk (max)
445.gobmk (max) (percentage)
447.dealII
447.dealII (avg)
447.dealII (avg) (percentage)
447.dealII (max)
447.dealII (max) (percentage)
450.soplex
450.soplex (avg)
450.soplex (avg) (percentage)
450.soplex (max)
450.soplex (max) (percentage)
453.povray
453.povray (avg)
453.povray (avg) (percentage)
453.povray (max)
453.povray (max) (percentage)
454.calculix
454.calculix (avg)
454.calculix (avg) (percentage)
454.calculix (max)
454.calculix (max) (percentage)
456.hmmer
456.hmmer (avg)
456.hmmer (avg) (percentage)
456.hmmer (max)
456.hmmer (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
459.GemsFDTD
459.GemsFDTD (avg)
459.GemsFDTD (avg) (percentage)
459.GemsFDTD (max)
459.GemsFDTD (max) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)
464.h264ref
464.h264ref (avg)
464.h264ref (avg) (percentage)
464.h264ref (max)
464.h264ref (max) (percentage)
465.tonto
465.tonto (avg)
465.tonto (avg) (percentage)
465.tonto (max)
465.tonto (max) (percentage)
470.lbm
470.lbm (avg)
470.lbm (avg) (percentage)
470.lbm (max)
470.lbm (max) (percentage)
471.omnetpp
471.omnetpp (avg)
471.omnetpp (avg) (percentage)
471.omnetpp (max)
471.omnetpp (max) (percentage)
473.astar
473.astar (avg)
473.astar (avg) (percentage)
473.astar (max)
473.astar (max) (percentage)
481.wrf
481.wrf (avg)
481.wrf (avg) (percentage)
481.wrf (max)
481.wrf (max) (percentage)
482.sphinx3
482.sphinx3 (avg)
482.sphinx3 (avg) (percentage)
482.sphinx3 (max)
482.sphinx3 (max) (percentage)
483.xalancbmk
483.xalancbmk (avg)
483.xalancbmk (avg) (percentage)
483.xalancbmk (max)
483.xalancbmk (max) (percentage)


Report Time: 0.34s
Name Current %
400.perlbench 1406.000 -
401.bzip2 2791.000 -
403.gcc 58.000 7.41%
410.bwaves 5177.000 -
416.gamess 13915.000 -
429.mcf 873.000 -
433.milc 1123.000 -
434.zeusmp 2394.000 -
435.gromacs 5868.000 1.28%
436.cactusADM 2360.000 -
437.leslie3d 10250.000 2.91%
444.namd 767.000 -
445.gobmk 5040.000 -1.49%
447.dealII 1745.000 -2.46%
450.soplex 539.000 -
453.povray 441.000 -
454.calculix 56.000 -3.45%
456.hmmer 3474.000 -
458.sjeng 7057.000 -
459.GemsFDTD 5170.000 -
462.libquantum 113.000 -
464.h264ref 5896.000 -
465.tonto 9811.000 1.10%
470.lbm 3908.000 -
471.omnetpp 2420.000 1.26%
473.astar 5124.000 3.39%
481.wrf 4961.000 1.39%
482.sphinx3 774.000 -
483.xalancbmk 3448.000 -
Geometric Mean 1950.799 -
Name Current %
400.perlbench 981569.000 -
401.bzip2 52728.000 -
403.gcc 2862057.000 -
410.bwaves 23682.000 1.09%
416.gamess 7183262.000 -
429.mcf 10323.000 -
433.milc 98678.000 -
434.zeusmp 235070.000 -
435.gromacs 739101.000 -
436.cactusADM 580075.000 -
437.leslie3d 82571.000 -
444.namd 222374.000 -
445.gobmk 1359173.000 -
447.dealII 2465104.000 -
450.soplex 298472.000 -
453.povray 761102.000 -
454.calculix 1419006.000 -
456.hmmer 234369.000 -
458.sjeng 125896.000 -
459.GemsFDTD 332465.000 -
462.libquantum 32471.000 -
464.h264ref 469072.000 -
465.tonto 3108041.000 -
470.lbm 11182.000 -
471.omnetpp 502822.000 -
473.astar 30708.000 -1.34%
481.wrf 4486202.000 -
482.sphinx3 152827.000 -
483.xalancbmk 3183036.000 -
Geometric Mean 327812.241 -
Name Current %
400.perlbench 25.000 -
400.perlbench (avg) 25.000 -
400.perlbench (avg) (percentage) 1.830 -
400.perlbench (max) 33.000 -
400.perlbench (max) (percentage) 2.410 -
401.bzip2 103.000 -
401.bzip2 (avg) 103.000 -
401.bzip2 (avg) (percentage) 3.700 -
401.bzip2 (max) 168.000 -
401.bzip2 (max) (percentage) 6.030 -
403.gcc 3.000 -
403.gcc (avg) 3.000 -
403.gcc (avg) (percentage) 6.210 -
403.gcc (max) 5.000 25.00%
403.gcc (max) (percentage) 8.920 -
410.bwaves 56.000 -
410.bwaves (avg) 56.000 -
410.bwaves (avg) (percentage) 1.090 -
410.bwaves (max) 89.000 -
410.bwaves (max) (percentage) 1.730 -
416.gamess 38.000 -2.56%
416.gamess (avg) 38.000 -2.56%
416.gamess (avg) (percentage) 0.280 -
416.gamess (max) 69.000 -1.43%
416.gamess (max) (percentage) 0.500 -
429.mcf 113.000 -
429.mcf (avg) 113.000 -
429.mcf (avg) (percentage) 12.980 -
429.mcf (max) 200.000 -
429.mcf (max) (percentage) 22.930 -
433.milc 16.000 -
433.milc (avg) 16.000 -
433.milc (avg) (percentage) 1.450 -
433.milc (max) 27.000 -
433.milc (max) (percentage) 2.460 -
434.zeusmp 21.000 -
434.zeusmp (avg) 21.000 -
434.zeusmp (avg) (percentage) 0.910 -
434.zeusmp (max) 34.000 -
434.zeusmp (max) (percentage) 1.440 -
435.gromacs 211.000 -
435.gromacs (avg) 211.000 -
435.gromacs (avg) (percentage) 3.610 -
435.gromacs (max) 302.000 1.34%
435.gromacs (max) (percentage) 5.160 -
436.cactusADM 15.000 -
436.cactusADM (avg) 15.000 -
436.cactusADM (avg) (percentage) 0.640 -
436.cactusADM (max) 21.000 -
436.cactusADM (max) (percentage) 0.930 -
437.leslie3d 456.000 2.93%
437.leslie3d (avg) 456.000 2.93%
437.leslie3d (avg) (percentage) 4.450 -
437.leslie3d (max) 272.000 3.03%
437.leslie3d (max) (percentage) 2.660 -
444.namd 6.000 -
444.namd (avg) 6.000 -
444.namd (avg) (percentage) 0.790 -
444.namd (max) 9.000 -
444.namd (max) (percentage) 1.180 -
445.gobmk 53.000 -1.85%
445.gobmk (avg) 53.000 -1.85%
445.gobmk (avg) (percentage) 1.070 -
445.gobmk (max) 93.000 -2.11%
445.gobmk (max) (percentage) 1.860 -
447.dealII 18.000 -
447.dealII (avg) 18.000 -
447.dealII (avg) (percentage) 1.040 -
447.dealII (max) 31.000 -3.12%
447.dealII (max) (percentage) 1.800 -
450.soplex 22.000 -
450.soplex (avg) 22.000 -
450.soplex (avg) (percentage) 4.220 -
450.soplex (max) 35.000 -
450.soplex (max) (percentage) 6.600 -
453.povray 3.000 -
453.povray (avg) 3.000 -
453.povray (avg) (percentage) 0.710 -
453.povray (max) 3.000 -
453.povray (max) (percentage) 0.820 -
454.calculix 2.000 -
454.calculix (avg) 2.000 -
454.calculix (avg) (percentage) 3.710 -
454.calculix (max) 2.000 -
454.calculix (max) (percentage) 4.290 -
456.hmmer 5.000 -
456.hmmer (avg) 5.000 -
456.hmmer (avg) (percentage) 0.160 -
456.hmmer (max) 9.000 -
456.hmmer (max) (percentage) 0.260 -
458.sjeng 75.000 -
458.sjeng (avg) 75.000 -
458.sjeng (avg) (percentage) 1.070 -
458.sjeng (max) 129.000 -
458.sjeng (max) (percentage) 1.830 -
459.GemsFDTD 88.000 -
459.GemsFDTD (avg) 88.000 -
459.GemsFDTD (avg) (percentage) 1.720 -
459.GemsFDTD (max) 146.000 -
459.GemsFDTD (max) (percentage) 2.830 -
462.libquantum 1.000 -
462.libquantum (avg) 1.000 -
462.libquantum (avg) (percentage) 1.460 -
462.libquantum (max) 2.000 -
462.libquantum (max) (percentage) 2.220 -
464.h264ref 30.000 -
464.h264ref (avg) 30.000 -
464.h264ref (avg) (percentage) 0.520 -
464.h264ref (max) 55.000 -
464.h264ref (max) (percentage) 0.940 -
465.tonto 121.000 -
465.tonto (avg) 121.000 -
465.tonto (avg) (percentage) 1.240 -
465.tonto (max) 169.000 1.20%
465.tonto (max) (percentage) 1.730 -
470.lbm 43.000 -
470.lbm (avg) 43.000 -
470.lbm (avg) (percentage) 1.120 -
470.lbm (max) 65.000 -
470.lbm (max) (percentage) 1.680 -
471.omnetpp 24.000 4.35%
471.omnetpp (avg) 24.000 4.35%
471.omnetpp (avg) (percentage) 1.000 -
471.omnetpp (max) 25.000 -
471.omnetpp (max) (percentage) 1.060 -
473.astar 139.000 3.73%
473.astar (avg) 139.000 3.73%
473.astar (avg) (percentage) 2.720 -
473.astar (max) 219.000 3.30%
473.astar (max) (percentage) 4.280 -
481.wrf 128.000 1.59%
481.wrf (avg) 128.000 1.59%
481.wrf (avg) (percentage) 2.590 -
481.wrf (max) 141.000 1.44%
481.wrf (max) (percentage) 2.850 -
482.sphinx3 14.000 -
482.sphinx3 (avg) 14.000 -
482.sphinx3 (avg) (percentage) 1.910 -
482.sphinx3 (max) 29.000 -
482.sphinx3 (max) (percentage) 3.840 -
483.xalancbmk 65.000 -1.52%
483.xalancbmk (avg) 65.000 -1.52%
483.xalancbmk (avg) (percentage) 1.900 -
483.xalancbmk (max) 69.000 -1.43%
483.xalancbmk (max) (percentage) 2.020 -
Geometric Mean 10.229 -