Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=0d8de8f255d3333c7a122c419f7f75f3c6c45df5 (+ 288 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/f10a4ce044a62c92ff3787895f5bae11f5375a59 (unchanged)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=721f30116ce653fffb0156e1298c8063833396e3 (+ 80 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=3a9c734cf38026353ce3ea9ca342f4ee2cee4ddd (+ 16507 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_vect-spec2k6--gnu-arm-master-O3-build/82/
Filter

gnu-arm-master-O3 test results

Run Order Start Time Duration
Current 0082 (3-changed-components) 2023-06-30T00:52:23 0:00:00
Previous 0069 (basepoints/gcc-14-01900-gf10a4ce044a) 2023-06-16T01:44:28 0:00:00
Baseline 0001 (4-changed-components) 2023-03-04T10:24:04 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 11 14
Performance Improvements 24 7
Added Tests 3 145
Unchanged Tests 1186 1058
Total Tests 1224

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
403.gcc 9.62% 52.000 57.000 - 9.62% -
450.soplex 2.05% 536.000 547.000 - 12.32% -
473.astar 1.74% 4883.000 4968.000 - 3.44% -
436.cactusADM 1.25% 2315.000 2344.000 - 0.60% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
436.cactusADM 8.33% 12.000 13.000 - 0.00% -
436.cactusADM (avg) 8.33% 12.000 13.000 - 0.00% -
473.astar (max) 1.49% 201.000 204.000 - 0.00% -
481.wrf 1.39% 72.000 73.000 - 0.00% -
481.wrf (avg) 1.39% 72.000 73.000 - 0.00% -
473.astar 1.22% 82.000 83.000 - 0.00% -
473.astar (avg) 1.22% 82.000 83.000 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
437.leslie3d -3.33% 9425.000 9111.000 - 1.73% -
401.bzip2 -2.87% 2853.000 2771.000 - 4.13% -
435.gromacs -1.75% 5787.000 5686.000 - 4.06% -
454.calculix -1.72% 58.000 57.000 - -3.39% -
483.xalancbmk -1.65% 3569.000 3510.000 - 0.63% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
400.perlbench (max) -4.55% 22.000 21.000 - 0.00% -
401.bzip2 -3.39% 59.000 57.000 - 0.00% -
401.bzip2 (avg) -3.39% 59.000 57.000 - 0.00% -
437.leslie3d (max) -3.28% 518.000 501.000 - 0.00% -
437.leslie3d -3.26% 337.000 326.000 - 0.00% -
437.leslie3d (avg) -3.26% 337.000 326.000 - 0.00% -
401.bzip2 (max) -3.15% 127.000 123.000 - 0.00% -
483.xalancbmk -3.03% 66.000 64.000 - 0.00% -
483.xalancbmk (avg) -3.03% 66.000 64.000 - 0.00% -
410.bwaves -2.70% 37.000 36.000 - 0.00% -
410.bwaves (avg) -2.70% 37.000 36.000 - 0.00% -
410.bwaves (max) -2.70% 37.000 36.000 - 0.00% -
483.xalancbmk (max) -2.15% 93.000 91.000 - 0.00% -
459.GemsFDTD (max) -1.75% 57.000 56.000 - 0.00% -
435.gromacs -1.74% 115.000 113.000 - 0.00% -
435.gromacs (avg) -1.74% 115.000 113.000 - 0.00% -
435.gromacs (max) -1.65% 182.000 179.000 - 0.00% -
459.GemsFDTD -1.61% 62.000 61.000 - 0.00% -
459.GemsFDTD (avg) -1.61% 62.000 61.000 - 0.00% -

Added Tests - sample variability
454.calculix
454.calculix (avg)
454.calculix (max)

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
450.soplex 12.32% 487.000 547.000 - 2.05% -
403.gcc 9.62% 52.000 57.000 - 9.62% -
401.bzip2 4.13% 2661.000 2771.000 - -2.87% -
435.gromacs 4.06% 5464.000 5686.000 - -1.75% -
473.astar 3.44% 4803.000 4968.000 - 1.74% -
434.zeusmp 3.22% 2177.000 2247.000 - 0.36% -
433.milc 2.56% 976.000 1001.000 - 0.10% -
447.dealII 2.41% 1450.000 1485.000 - 0.41% -
400.perlbench 1.94% 1342.000 1368.000 - -0.58% -
462.libquantum 1.79% 112.000 114.000 - -0.87% -
437.leslie3d 1.73% 8956.000 9111.000 - -3.33% -
445.gobmk 1.71% 4847.000 4930.000 - -0.70% -
453.povray 1.56% 448.000 455.000 - 0.66% -
410.bwaves 1.49% 5038.000 5113.000 - -0.72% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
458.sjeng -1.22% 159956.000 158000.000 - 0.00% -
473.astar -1.18% 38180.000 37728.000 - 0.00% -
459.GemsFDTD -1.01% 407317.000 403185.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
429.mcf -22.14% 1120.000 872.000 - 0.23% -
470.lbm -3.45% 3507.000 3386.000 - -0.09% -
454.calculix -3.39% 59.000 57.000 - -1.72% -
471.omnetpp -2.57% 2454.000 2391.000 - 0.00% -

Added Tests - sample variability
400.perlbench
400.perlbench (avg)
400.perlbench (avg) (percentage)
400.perlbench (max)
400.perlbench (max) (percentage)
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
403.gcc
403.gcc (avg)
403.gcc (avg) (percentage)
403.gcc (max)
403.gcc (max) (percentage)
410.bwaves
410.bwaves (avg)
410.bwaves (avg) (percentage)
410.bwaves (max)
410.bwaves (max) (percentage)
416.gamess
416.gamess (avg)
416.gamess (avg) (percentage)
416.gamess (max)
416.gamess (max) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
433.milc
433.milc (avg)
433.milc (avg) (percentage)
433.milc (max)
433.milc (max) (percentage)
434.zeusmp
434.zeusmp (avg)
434.zeusmp (avg) (percentage)
434.zeusmp (max)
434.zeusmp (max) (percentage)
435.gromacs
435.gromacs (avg)
435.gromacs (avg) (percentage)
435.gromacs (max)
435.gromacs (max) (percentage)
436.cactusADM
436.cactusADM (avg)
436.cactusADM (avg) (percentage)
436.cactusADM (max)
436.cactusADM (max) (percentage)
437.leslie3d
437.leslie3d (avg)
437.leslie3d (avg) (percentage)
437.leslie3d (max)
437.leslie3d (max) (percentage)
444.namd
444.namd (avg)
444.namd (avg) (percentage)
444.namd (max)
444.namd (max) (percentage)
445.gobmk
445.gobmk (avg)
445.gobmk (avg) (percentage)
445.gobmk (max)
445.gobmk (max) (percentage)
447.dealII
447.dealII (avg)
447.dealII (avg) (percentage)
447.dealII (max)
447.dealII (max) (percentage)
450.soplex
450.soplex (avg)
450.soplex (avg) (percentage)
450.soplex (max)
450.soplex (max) (percentage)
453.povray
453.povray (avg)
453.povray (avg) (percentage)
453.povray (max)
453.povray (max) (percentage)
454.calculix
454.calculix (avg)
454.calculix (avg) (percentage)
454.calculix (max)
454.calculix (max) (percentage)
456.hmmer
456.hmmer (avg)
456.hmmer (avg) (percentage)
456.hmmer (max)
456.hmmer (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
459.GemsFDTD
459.GemsFDTD (avg)
459.GemsFDTD (avg) (percentage)
459.GemsFDTD (max)
459.GemsFDTD (max) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)
464.h264ref
464.h264ref (avg)
464.h264ref (avg) (percentage)
464.h264ref (max)
464.h264ref (max) (percentage)
465.tonto
465.tonto (avg)
465.tonto (avg) (percentage)
465.tonto (max)
465.tonto (max) (percentage)
470.lbm
470.lbm (avg)
470.lbm (avg) (percentage)
470.lbm (max)
470.lbm (max) (percentage)
471.omnetpp
471.omnetpp (avg)
471.omnetpp (avg) (percentage)
471.omnetpp (max)
471.omnetpp (max) (percentage)
473.astar
473.astar (avg)
473.astar (avg) (percentage)
473.astar (max)
473.astar (max) (percentage)
481.wrf
481.wrf (avg)
481.wrf (avg) (percentage)
481.wrf (max)
481.wrf (max) (percentage)
482.sphinx3
482.sphinx3 (avg)
482.sphinx3 (avg) (percentage)
482.sphinx3 (max)
482.sphinx3 (max) (percentage)
483.xalancbmk
483.xalancbmk (avg)
483.xalancbmk (avg) (percentage)
483.xalancbmk (max)
483.xalancbmk (max) (percentage)


Report Time: 0.50s
Name Current %
400.perlbench 1368.000 -
401.bzip2 2771.000 -2.87%
403.gcc 57.000 9.62%
410.bwaves 5113.000 -
416.gamess 14172.000 -
429.mcf 872.000 -
433.milc 1001.000 -
434.zeusmp 2247.000 -
435.gromacs 5686.000 -1.75%
436.cactusADM 2344.000 1.25%
437.leslie3d 9111.000 -3.33%
444.namd 771.000 -
445.gobmk 4930.000 -
447.dealII 1485.000 -
450.soplex 547.000 2.05%
453.povray 455.000 -
454.calculix 57.000 -1.72%
456.hmmer 3373.000 -
458.sjeng 6994.000 -
459.GemsFDTD 5153.000 -
462.libquantum 114.000 -
464.h264ref 5701.000 -
465.tonto 9064.000 -
470.lbm 3386.000 -
471.omnetpp 2391.000 -
473.astar 4968.000 1.74%
481.wrf 4431.000 -
482.sphinx3 687.000 -
483.xalancbmk 3510.000 -1.65%
Geometric Mean 1881.898 -
Name Current %
400.perlbench 1177425.000 -
401.bzip2 76380.000 -
403.gcc 3207669.000 -
410.bwaves 24222.000 -
416.gamess 9256166.000 -
429.mcf 10599.000 -
433.milc 122538.000 -
434.zeusmp 340898.000 -
435.gromacs 926405.000 -
436.cactusADM 740987.000 -
437.leslie3d 102827.000 -
444.namd 230266.000 -
445.gobmk 1481661.000 -
447.dealII 3044439.000 -
450.soplex 409357.000 -
453.povray 924122.000 -
454.calculix 1744738.000 -
456.hmmer 298317.000 -
458.sjeng 158000.000 -
459.GemsFDTD 403185.000 -
462.libquantum 34759.000 -
464.h264ref 793176.000 -
465.tonto 4320729.000 -
470.lbm 12326.000 -
471.omnetpp 554630.000 -
473.astar 37728.000 -
481.wrf 6963826.000 -
482.sphinx3 196771.000 -
483.xalancbmk 3773218.000 -
Geometric Mean 405171.044 -
Name Current %
400.perlbench 20.000 -
400.perlbench (avg) 20.000 -
400.perlbench (avg) (percentage) 1.520 -
400.perlbench (max) 21.000 -4.55%
400.perlbench (max) (percentage) 1.600 -
401.bzip2 57.000 -3.39%
401.bzip2 (avg) 57.000 -3.39%
401.bzip2 (avg) (percentage) 2.090 -
401.bzip2 (max) 123.000 -3.15%
401.bzip2 (max) (percentage) 4.460 -
403.gcc 2.000 -
403.gcc (avg) 2.000 -
403.gcc (avg) (percentage) 4.610 -
403.gcc (max) 2.000 -
403.gcc (max) (percentage) 4.850 -
410.bwaves 36.000 -2.70%
410.bwaves (avg) 36.000 -2.70%
410.bwaves (avg) (percentage) 0.720 -
410.bwaves (max) 36.000 -2.70%
410.bwaves (max) (percentage) 0.720 -
416.gamess 28.000 -
416.gamess (avg) 28.000 -
416.gamess (avg) (percentage) 0.200 -
416.gamess (max) 36.000 -
416.gamess (max) (percentage) 0.260 -
429.mcf 57.000 -
429.mcf (avg) 57.000 -
429.mcf (avg) (percentage) 6.630 -
429.mcf (max) 184.000 -
429.mcf (max) (percentage) 21.110 -
433.milc 10.000 -
433.milc (avg) 10.000 -
433.milc (avg) (percentage) 1.050 -
433.milc (max) 2.000 -
433.milc (max) (percentage) 0.220 -
434.zeusmp 21.000 -
434.zeusmp (avg) 21.000 -
434.zeusmp (avg) (percentage) 0.960 -
434.zeusmp (max) 28.000 -
434.zeusmp (max) (percentage) 1.280 -
435.gromacs 113.000 -1.74%
435.gromacs (avg) 113.000 -1.74%
435.gromacs (avg) (percentage) 2.000 -
435.gromacs (max) 179.000 -1.65%
435.gromacs (max) (percentage) 3.160 -
436.cactusADM 13.000 8.33%
436.cactusADM (avg) 13.000 8.33%
436.cactusADM (avg) (percentage) 0.560 -
436.cactusADM (max) 15.000 -
436.cactusADM (max) (percentage) 0.660 -
437.leslie3d 326.000 -3.26%
437.leslie3d (avg) 326.000 -3.26%
437.leslie3d (avg) (percentage) 3.580 -
437.leslie3d (max) 501.000 -3.28%
437.leslie3d (max) (percentage) 5.500 -
444.namd 5.000 -
444.namd (avg) 5.000 -
444.namd (avg) (percentage) 0.770 -
444.namd (max) 8.000 -
444.namd (max) (percentage) 1.160 -
445.gobmk 71.000 -
445.gobmk (avg) 71.000 -
445.gobmk (avg) (percentage) 1.450 -
445.gobmk (max) 128.000 -
445.gobmk (max) (percentage) 2.600 -
447.dealII 14.000 -
447.dealII (avg) 14.000 -
447.dealII (avg) (percentage) 0.960 -
447.dealII (max) 15.000 -
447.dealII (max) (percentage) 1.030 -
450.soplex 15.000 -
450.soplex (avg) 15.000 -
450.soplex (avg) (percentage) 2.820 -
450.soplex (max) 26.000 -
450.soplex (max) (percentage) 4.930 -
453.povray 4.000 -
453.povray (avg) 4.000 -
453.povray (avg) (percentage) 1.080 -
453.povray (max) 6.000 -
453.povray (max) (percentage) 1.530 -
454.calculix 0.000 -
454.calculix (avg) 0.000 -
454.calculix (avg) (percentage) 1.540 -
454.calculix (max) 0.000 -
454.calculix (max) (percentage) 1.530 -
456.hmmer 12.000 -
456.hmmer (avg) 12.000 -
456.hmmer (avg) (percentage) 0.360 -
456.hmmer (max) 15.000 -
456.hmmer (max) (percentage) 0.450 -
458.sjeng 44.000 -
458.sjeng (avg) 44.000 -
458.sjeng (avg) (percentage) 0.640 -
458.sjeng (max) 125.000 -
458.sjeng (max) (percentage) 1.790 -
459.GemsFDTD 61.000 -1.61%
459.GemsFDTD (avg) 61.000 -1.61%
459.GemsFDTD (avg) (percentage) 1.200 -
459.GemsFDTD (max) 56.000 -1.75%
459.GemsFDTD (max) (percentage) 1.100 -
462.libquantum 1.000 -
462.libquantum (avg) 1.000 -
462.libquantum (avg) (percentage) 1.410 -
462.libquantum (max) 1.000 -
462.libquantum (max) (percentage) 1.290 -
464.h264ref 35.000 -
464.h264ref (avg) 35.000 -
464.h264ref (avg) (percentage) 0.620 -
464.h264ref (max) 78.000 -
464.h264ref (max) (percentage) 1.380 -
465.tonto 80.000 -
465.tonto (avg) 80.000 -
465.tonto (avg) (percentage) 0.890 -
465.tonto (max) 211.000 -
465.tonto (max) (percentage) 2.330 -
470.lbm 24.000 -
470.lbm (avg) 24.000 -
470.lbm (avg) (percentage) 0.720 -
470.lbm (max) 52.000 -
470.lbm (max) (percentage) 1.560 -
471.omnetpp 34.000 -
471.omnetpp (avg) 34.000 -
471.omnetpp (avg) (percentage) 1.430 -
471.omnetpp (max) 58.000 -
471.omnetpp (max) (percentage) 2.440 -
473.astar 83.000 1.22%
473.astar (avg) 83.000 1.22%
473.astar (avg) (percentage) 1.690 -
473.astar (max) 204.000 1.49%
473.astar (max) (percentage) 4.120 -
481.wrf 73.000 1.39%
481.wrf (avg) 73.000 1.39%
481.wrf (avg) (percentage) 1.660 -
481.wrf (max) 70.000 -
481.wrf (max) (percentage) 1.600 -
482.sphinx3 14.000 -
482.sphinx3 (avg) 14.000 -
482.sphinx3 (avg) (percentage) 2.110 -
482.sphinx3 (max) 36.000 -
482.sphinx3 (max) (percentage) 5.270 -
483.xalancbmk 64.000 -3.03%
483.xalancbmk (avg) 64.000 -3.03%
483.xalancbmk (avg) (percentage) 1.850 -
483.xalancbmk (max) 91.000 -2.15%
483.xalancbmk (max) (percentage) 2.620 -
Geometric Mean 6.752 -21.10%