Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=324998b47364528f407666512015370c12ab83a1 (+ 19 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/1e20bb6737e1173a0c3ef3e9e48c0eda40985ded (+ 36 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=ab991a3d1b401ded6bd4f027352da8262b021a11 (+ 2 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=f130cb3a5bbed9c62474d814fc2bfec5ac66b81b (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-arm-master-O2-build/2/
Filter

gnu-arm-master-O2 test results

Run Order Start Time Duration
Current 0002 (3-changed-components) 2023-03-25T09:45:27 0:00:00
Previous 0001 (4-changed-components) 2023-03-23T16:47:15 0:00:00
No Baseline Run


Tests Summary

Status Group #
Performance Regressions 21
Performance Improvements 3
Added Tests 139
Unchanged Tests 1049
Total Tests 1212

Performance Regressions - Execution Δ Previous Current σ
435.gromacs 8.44% 5427.000 5885.000 -
454.calculix 5.26% 57.000 60.000 -
437.leslie3d 5.11% 9861.000 10365.000 -
473.astar 4.35% 4714.000 4919.000 -
401.bzip2 4.01% 2617.000 2722.000 -
403.gcc 3.77% 53.000 55.000 -
450.soplex 3.50% 515.000 533.000 -
482.sphinx3 2.99% 737.000 759.000 -
465.tonto 2.60% 9514.000 9761.000 -
433.milc 2.37% 1096.000 1122.000 -
471.omnetpp 2.25% 2351.000 2404.000 -
453.povray 2.24% 447.000 457.000 -
445.gobmk 2.18% 4950.000 5058.000 -
459.GemsFDTD 2.17% 5078.000 5188.000 -
434.zeusmp 2.01% 2384.000 2432.000 -
481.wrf 1.84% 4833.000 4922.000 -
462.libquantum 1.80% 111.000 113.000 -
470.lbm 1.54% 3842.000 3901.000 -
483.xalancbmk 1.36% 3313.000 3358.000 -
444.namd 1.31% 765.000 775.000 -
447.dealII 1.02% 1757.000 1775.000 -

Performance Improvements - Execution Δ Previous Current σ
429.mcf -19.00% 1116.000 904.000 -
436.cactusADM -1.38% 2384.000 2351.000 -
410.bwaves -1.09% 5252.000 5195.000 -

Added Tests - sample variability
400.perlbench
400.perlbench (avg)
400.perlbench (avg) (percentage)
400.perlbench (max)
400.perlbench (max) (percentage)
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
403.gcc (max)
403.gcc (max) (percentage)
410.bwaves
410.bwaves (avg)
410.bwaves (avg) (percentage)
410.bwaves (max)
410.bwaves (max) (percentage)
416.gamess
416.gamess (avg)
416.gamess (avg) (percentage)
416.gamess (max)
416.gamess (max) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
433.milc
433.milc (avg)
433.milc (avg) (percentage)
433.milc (max)
433.milc (max) (percentage)
434.zeusmp
434.zeusmp (avg)
434.zeusmp (avg) (percentage)
434.zeusmp (max)
434.zeusmp (max) (percentage)
435.gromacs
435.gromacs (avg)
435.gromacs (avg) (percentage)
435.gromacs (max)
435.gromacs (max) (percentage)
436.cactusADM
436.cactusADM (avg)
436.cactusADM (avg) (percentage)
436.cactusADM (max)
436.cactusADM (max) (percentage)
437.leslie3d
437.leslie3d (avg)
437.leslie3d (avg) (percentage)
437.leslie3d (max)
437.leslie3d (max) (percentage)
444.namd
444.namd (avg)
444.namd (avg) (percentage)
444.namd (max)
444.namd (max) (percentage)
445.gobmk
445.gobmk (avg)
445.gobmk (avg) (percentage)
445.gobmk (max)
445.gobmk (max) (percentage)
447.dealII
447.dealII (avg)
447.dealII (avg) (percentage)
447.dealII (max)
447.dealII (max) (percentage)
450.soplex
450.soplex (avg)
450.soplex (avg) (percentage)
450.soplex (max)
450.soplex (max) (percentage)
453.povray
453.povray (avg)
453.povray (avg) (percentage)
453.povray (max)
453.povray (max) (percentage)
454.calculix
454.calculix (avg)
454.calculix (avg) (percentage)
454.calculix (max)
454.calculix (max) (percentage)
456.hmmer
456.hmmer (avg)
456.hmmer (avg) (percentage)
456.hmmer (max)
456.hmmer (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
459.GemsFDTD
459.GemsFDTD (avg)
459.GemsFDTD (avg) (percentage)
459.GemsFDTD (max)
459.GemsFDTD (max) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)
464.h264ref
464.h264ref (avg)
464.h264ref (avg) (percentage)
464.h264ref (max)
464.h264ref (max) (percentage)
465.tonto
465.tonto (avg)
465.tonto (avg) (percentage)
465.tonto (max)
465.tonto (max) (percentage)
470.lbm
470.lbm (avg)
470.lbm (avg) (percentage)
470.lbm (max)
470.lbm (max) (percentage)
471.omnetpp
471.omnetpp (avg)
471.omnetpp (avg) (percentage)
471.omnetpp (max)
471.omnetpp (max) (percentage)
473.astar
473.astar (avg)
473.astar (avg) (percentage)
473.astar (max)
473.astar (max) (percentage)
481.wrf
481.wrf (avg)
481.wrf (avg) (percentage)
481.wrf (max)
481.wrf (max) (percentage)
482.sphinx3
482.sphinx3 (avg)
482.sphinx3 (avg) (percentage)
482.sphinx3 (max)
482.sphinx3 (max) (percentage)
483.xalancbmk (max)
483.xalancbmk (max) (percentage)


Report Time: 0.22s
Name Current %
400.perlbench 1377.000 -
401.bzip2 2722.000 4.01%
403.gcc 55.000 3.77%
410.bwaves 5195.000 -1.09%
416.gamess 14074.000 -
429.mcf 904.000 -19.00%
433.milc 1122.000 2.37%
434.zeusmp 2432.000 2.01%
435.gromacs 5885.000 8.44%
436.cactusADM 2351.000 -1.38%
437.leslie3d 10365.000 5.11%
444.namd 775.000 1.31%
445.gobmk 5058.000 2.18%
447.dealII 1775.000 1.02%
450.soplex 533.000 3.50%
453.povray 457.000 2.24%
454.calculix 60.000 5.26%
456.hmmer 3465.000 -
458.sjeng 7110.000 -
459.GemsFDTD 5188.000 2.17%
462.libquantum 113.000 1.80%
464.h264ref 5858.000 -
465.tonto 9761.000 2.60%
470.lbm 3901.000 1.54%
471.omnetpp 2404.000 2.25%
473.astar 4919.000 4.35%
481.wrf 4922.000 1.84%
482.sphinx3 759.000 2.99%
483.xalancbmk 3358.000 1.36%
Geometric Mean 1950.387 1.38%
Name Current %
400.perlbench 981846.000 -
401.bzip2 52592.000 -
403.gcc 2862353.000 -
410.bwaves 23410.000 -
416.gamess 7145862.000 -
429.mcf 10303.000 -
433.milc 98838.000 -
434.zeusmp 235118.000 -
435.gromacs 741041.000 -
436.cactusADM 582059.000 -
437.leslie3d 82727.000 -
444.namd 223054.000 -
445.gobmk 1358581.000 -
447.dealII 2447503.000 -
450.soplex 298431.000 -
453.povray 768026.000 -
454.calculix 1421275.000 -
456.hmmer 234965.000 -
458.sjeng 125940.000 -
459.GemsFDTD 332309.000 -
462.libquantum 32503.000 -
464.h264ref 468664.000 -
465.tonto 3107830.000 -
470.lbm 11078.000 -
471.omnetpp 502628.000 -
473.astar 31376.000 -
481.wrf 4488871.000 -
482.sphinx3 153015.000 -
483.xalancbmk 3182943.000 -
Geometric Mean 327935.017 -
Name Current %
400.perlbench 7.000 -
400.perlbench (avg) 7.000 -
400.perlbench (avg) (percentage) 0.580 -
400.perlbench (max) 7.000 -
400.perlbench (max) (percentage) 0.580 -
400.perlbench (unexplained diff vs previous) 8.000 -
400.perlbench (unexplained diff vs previous) (percentage) 0.580 -
401.bzip2 109.000 -
401.bzip2 (avg) 109.000 -
401.bzip2 (avg) (percentage) 4.010 -
401.bzip2 (max) 109.000 -
401.bzip2 (max) (percentage) 4.010 -
401.bzip2 (unexplained diff vs previous) 105.000 -
401.bzip2 (unexplained diff vs previous) (percentage) 3.860 -
403.gcc (max) 0.000 -
403.gcc (max) (percentage) 0.000 -
410.bwaves 56.000 -
410.bwaves (avg) 56.000 -
410.bwaves (avg) (percentage) 1.090 -
410.bwaves (max) 56.000 -
410.bwaves (max) (percentage) 1.090 -
410.bwaves (unexplained diff vs previous) 57.000 -
410.bwaves (unexplained diff vs previous) (percentage) 1.100 -
416.gamess 49.000 -
416.gamess (avg) 49.000 -
416.gamess (avg) (percentage) 0.350 -
416.gamess (max) 49.000 -
416.gamess (max) (percentage) 0.350 -
416.gamess (unexplained diff vs previous) 49.000 -
416.gamess (unexplained diff vs previous) (percentage) 0.350 -
429.mcf 171.000 -
429.mcf (avg) 171.000 -
429.mcf (avg) (percentage) 19.000 -
429.mcf (max) 171.000 -
429.mcf (max) (percentage) 19.000 -
429.mcf (unexplained diff vs previous) 212.000 -
429.mcf (unexplained diff vs previous) (percentage) 23.450 -
433.milc 26.000 -
433.milc (avg) 26.000 -
433.milc (avg) (percentage) 2.370 -
433.milc (max) 26.000 -
433.milc (max) (percentage) 2.370 -
433.milc (unexplained diff vs previous) 26.000 -
433.milc (unexplained diff vs previous) (percentage) 2.320 -
434.zeusmp 48.000 -
434.zeusmp (avg) 48.000 -
434.zeusmp (avg) (percentage) 2.010 -
434.zeusmp (max) 48.000 -
434.zeusmp (max) (percentage) 2.010 -
434.zeusmp (unexplained diff vs previous) 48.000 -
434.zeusmp (unexplained diff vs previous) (percentage) 1.970 -
435.gromacs 496.000 -
435.gromacs (avg) 496.000 -
435.gromacs (avg) (percentage) 8.440 -
435.gromacs (max) 496.000 -
435.gromacs (max) (percentage) 8.440 -
435.gromacs (unexplained diff vs previous) 458.000 -
435.gromacs (unexplained diff vs previous) (percentage) 7.780 -
436.cactusADM 32.000 -
436.cactusADM (avg) 32.000 -
436.cactusADM (avg) (percentage) 1.380 -
436.cactusADM (max) 32.000 -
436.cactusADM (max) (percentage) 1.380 -
436.cactusADM (unexplained diff vs previous) 33.000 -
436.cactusADM (unexplained diff vs previous) (percentage) 1.400 -
437.leslie3d 529.000 -
437.leslie3d (avg) 529.000 -
437.leslie3d (avg) (percentage) 5.110 -
437.leslie3d (max) 529.000 -
437.leslie3d (max) (percentage) 5.110 -
437.leslie3d (unexplained diff vs previous) 504.000 -
437.leslie3d (unexplained diff vs previous) (percentage) 4.860 -
444.namd 10.000 -
444.namd (avg) 10.000 -
444.namd (avg) (percentage) 1.310 -
444.namd (max) 10.000 -
444.namd (max) (percentage) 1.310 -
444.namd (unexplained diff vs previous) 10.000 -
444.namd (unexplained diff vs previous) (percentage) 1.290 -
445.gobmk 110.000 -
445.gobmk (avg) 110.000 -
445.gobmk (avg) (percentage) 2.180 -
445.gobmk (max) 110.000 -
445.gobmk (max) (percentage) 2.180 -
445.gobmk (unexplained diff vs previous) 108.000 -
445.gobmk (unexplained diff vs previous) (percentage) 2.140 -
447.dealII 18.000 -
447.dealII (avg) 18.000 -
447.dealII (avg) (percentage) 1.020 -
447.dealII (max) 18.000 -
447.dealII (max) (percentage) 1.020 -
447.dealII (unexplained diff vs previous) 18.000 -
447.dealII (unexplained diff vs previous) (percentage) 1.010 -
450.soplex 18.000 -
450.soplex (avg) 18.000 -
450.soplex (avg) (percentage) 3.500 -
450.soplex (max) 18.000 -
450.soplex (max) (percentage) 3.500 -
450.soplex (unexplained diff vs previous) 18.000 -
450.soplex (unexplained diff vs previous) (percentage) 3.380 -
453.povray 10.000 -
453.povray (avg) 10.000 -
453.povray (avg) (percentage) 2.240 -
453.povray (max) 10.000 -
453.povray (max) (percentage) 2.240 -
453.povray (unexplained diff vs previous) 10.000 -
453.povray (unexplained diff vs previous) (percentage) 2.190 -
454.calculix 3.000 -
454.calculix (avg) 3.000 -
454.calculix (avg) (percentage) 5.260 -
454.calculix (max) 3.000 -
454.calculix (max) (percentage) 5.260 -
454.calculix (unexplained diff vs previous) 3.000 -
454.calculix (unexplained diff vs previous) (percentage) 5.000 -
456.hmmer 4.000 -
456.hmmer (avg) 4.000 -
456.hmmer (avg) (percentage) 0.120 -
456.hmmer (max) 4.000 -
456.hmmer (max) (percentage) 0.120 -
456.hmmer (unexplained diff vs previous) 4.000 -
456.hmmer (unexplained diff vs previous) (percentage) 0.120 -
458.sjeng 62.000 -
458.sjeng (avg) 62.000 -
458.sjeng (avg) (percentage) 0.880 -
458.sjeng (max) 62.000 -
458.sjeng (max) (percentage) 0.880 -
458.sjeng (unexplained diff vs previous) 62.000 -
458.sjeng (unexplained diff vs previous) (percentage) 0.870 -
459.GemsFDTD 112.000 -
459.GemsFDTD (avg) 112.000 -
459.GemsFDTD (avg) (percentage) 2.170 -
459.GemsFDTD (max) 112.000 -
459.GemsFDTD (max) (percentage) 2.170 -
459.GemsFDTD (unexplained diff vs previous) 110.000 -
459.GemsFDTD (unexplained diff vs previous) (percentage) 2.120 -
462.libquantum 2.000 -
462.libquantum (avg) 2.000 -
462.libquantum (avg) (percentage) 1.800 -
462.libquantum (max) 2.000 -
462.libquantum (max) (percentage) 1.800 -
462.libquantum (unexplained diff vs previous) 2.000 -
462.libquantum (unexplained diff vs previous) (percentage) 1.770 -
464.h264ref 41.000 -
464.h264ref (avg) 41.000 -
464.h264ref (avg) (percentage) 0.700 -
464.h264ref (max) 41.000 -
464.h264ref (max) (percentage) 0.700 -
464.h264ref (unexplained diff vs previous) 41.000 -
464.h264ref (unexplained diff vs previous) (percentage) 0.700 -
465.tonto 253.000 -
465.tonto (avg) 253.000 -
465.tonto (avg) (percentage) 2.600 -
465.tonto (max) 253.000 -
465.tonto (max) (percentage) 2.600 -
465.tonto (unexplained diff vs previous) 247.000 -
465.tonto (unexplained diff vs previous) (percentage) 2.530 -
470.lbm 60.000 -
470.lbm (avg) 60.000 -
470.lbm (avg) (percentage) 1.540 -
470.lbm (max) 60.000 -
470.lbm (max) (percentage) 1.540 -
470.lbm (unexplained diff vs previous) 59.000 -
470.lbm (unexplained diff vs previous) (percentage) 1.510 -
471.omnetpp 54.000 -
471.omnetpp (avg) 54.000 -
471.omnetpp (avg) (percentage) 2.250 -
471.omnetpp (max) 54.000 -
471.omnetpp (max) (percentage) 2.250 -
471.omnetpp (unexplained diff vs previous) 53.000 -
471.omnetpp (unexplained diff vs previous) (percentage) 2.200 -
473.astar 213.000 -
473.astar (avg) 213.000 -
473.astar (avg) (percentage) 4.350 -
473.astar (max) 213.000 -
473.astar (max) (percentage) 4.350 -
473.astar (unexplained diff vs previous) 205.000 -
473.astar (unexplained diff vs previous) (percentage) 4.170 -
481.wrf 90.000 -
481.wrf (avg) 90.000 -
481.wrf (avg) (percentage) 1.840 -
481.wrf (max) 90.000 -
481.wrf (max) (percentage) 1.840 -
481.wrf (unexplained diff vs previous) 89.000 -
481.wrf (unexplained diff vs previous) (percentage) 1.810 -
482.sphinx3 22.000 -
482.sphinx3 (avg) 22.000 -
482.sphinx3 (avg) (percentage) 2.990 -
482.sphinx3 (max) 22.000 -
482.sphinx3 (max) (percentage) 2.990 -
482.sphinx3 (unexplained diff vs previous) 22.000 -
482.sphinx3 (unexplained diff vs previous) (percentage) 2.900 -
483.xalancbmk (max) 0.000 -
483.xalancbmk (max) (percentage) 0.000 -
Geometric Mean 8.620 6360222870733551828992.00%