Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=89bd22ef5b7fec9ac9e760de276781b181f58ee0 (+ 45 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/f9810728cf42ea7c3d84198aa582e53cfb2302d1 (unchanged)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=46b5e98ef6f1b9f4b53851f152ecb8209064b26c (+ 9 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=b84a9523bab4a2483d7b7566b81a7859c2fd9a78 (+ 16139 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-aarch64-master-O2-build/231/
Filter

gnu-aarch64-master-O2 test results

Run Order Start Time Duration
Current 0231 (3-changed-components) 2024-05-28T03:30:06 0:00:00
Previous 0231 (3-changed-components) 2024-05-28T03:30:06 0:00:00
Baseline 0002 (4-changed-components) 2023-03-27T00:00:07 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 0 19
Performance Improvements 0 10
Added Tests 0 130
Unchanged Tests 1176 1017
Total Tests 1176

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
410.bwaves 5.35% 21532.000 22684.000 - 0.00% -
447.dealII 3.13% 2802286.000 2889929.000 - 0.00% -
459.GemsFDTD 2.79% 295414.000 303656.000 - 0.00% -
436.cactusADM 1.94% 652261.000 664917.000 - 0.00% -
400.perlbench 1.80% 1087835.000 1107460.000 - 0.00% -
450.soplex 1.46% 347581.000 352651.000 - 0.00% -
444.namd 1.45% 226710.000 230006.000 - 0.00% -
465.tonto 1.37% 3263584.000 3308351.000 - 0.00% -
482.sphinx3 1.29% 175488.000 177744.000 - 0.00% -
429.mcf 1.23% 12072.000 12220.000 - 0.00% -
464.h264ref 1.11% 472362.000 477626.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
429.mcf 37.49% 1467.000 2017.000 - 0.00% -
473.astar 8.84% 4941.000 5378.000 - 0.00% -
459.GemsFDTD 6.04% 4220.000 4475.000 - 0.00% -
450.soplex 3.57% 532.000 551.000 - 0.00% -
453.povray 3.27% 428.000 442.000 - 0.00% -
434.zeusmp 3.11% 1991.000 2053.000 - 0.00% -
482.sphinx3 2.30% 783.000 801.000 - 0.00% -
400.perlbench 1.61% 1425.000 1448.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
473.astar -2.26% 37101.000 36261.000 - 0.00% -
437.leslie3d -1.41% 79330.000 78210.000 - 0.00% -
434.zeusmp -1.07% 203703.000 201529.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
471.omnetpp -7.19% 2670.000 2478.000 - 0.00% -
447.dealII -1.75% 1426.000 1401.000 - 0.00% -
458.sjeng -1.18% 6549.000 6472.000 - 0.00% -
445.gobmk -1.04% 4909.000 4858.000 - 0.00% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 134.48% 29.000 68.000 - 0.00% -
nb_compile_successful 65.52% 29.000 48.000 - 0.00% -
nb_execution_successful 65.52% 29.000 48.000 - 0.00% -

Added Tests - sample variability
400.perlbench
400.perlbench (avg)
400.perlbench (avg) (percentage)
400.perlbench (max)
400.perlbench (max) (percentage)
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
403.gcc (avg) (percentage)
403.gcc (max) (percentage)
410.bwaves
410.bwaves (avg)
410.bwaves (avg) (percentage)
410.bwaves (max)
410.bwaves (max) (percentage)
416.gamess (avg) (percentage)
416.gamess (max) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
433.milc
433.milc (avg)
433.milc (avg) (percentage)
433.milc (max)
433.milc (max) (percentage)
434.zeusmp
434.zeusmp (avg)
434.zeusmp (avg) (percentage)
434.zeusmp (max)
434.zeusmp (max) (percentage)
435.gromacs
435.gromacs (avg)
435.gromacs (avg) (percentage)
435.gromacs (max)
435.gromacs (max) (percentage)
436.cactusADM
436.cactusADM (avg)
436.cactusADM (avg) (percentage)
436.cactusADM (max)
436.cactusADM (max) (percentage)
437.leslie3d
437.leslie3d (avg)
437.leslie3d (avg) (percentage)
437.leslie3d (max)
437.leslie3d (max) (percentage)
444.namd
444.namd (avg)
444.namd (avg) (percentage)
444.namd (max)
444.namd (max) (percentage)
445.gobmk
445.gobmk (avg)
445.gobmk (avg) (percentage)
445.gobmk (max)
445.gobmk (max) (percentage)
447.dealII
447.dealII (avg)
447.dealII (avg) (percentage)
447.dealII (max)
447.dealII (max) (percentage)
450.soplex
450.soplex (avg)
450.soplex (avg) (percentage)
450.soplex (max)
450.soplex (max) (percentage)
453.povray
453.povray (avg)
453.povray (avg) (percentage)
453.povray (max)
453.povray (max) (percentage)
454.calculix (avg) (percentage)
454.calculix (max) (percentage)
456.hmmer
456.hmmer (avg)
456.hmmer (avg) (percentage)
456.hmmer (max)
456.hmmer (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
459.GemsFDTD
459.GemsFDTD (avg)
459.GemsFDTD (avg) (percentage)
459.GemsFDTD (max)
459.GemsFDTD (max) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)
464.h264ref
464.h264ref (avg)
464.h264ref (avg) (percentage)
464.h264ref (max)
464.h264ref (max) (percentage)
465.tonto
465.tonto (avg)
465.tonto (avg) (percentage)
465.tonto (max)
465.tonto (max) (percentage)
470.lbm
470.lbm (avg)
470.lbm (avg) (percentage)
470.lbm (max)
470.lbm (max) (percentage)
471.omnetpp
471.omnetpp (avg)
471.omnetpp (avg) (percentage)
471.omnetpp (max)
471.omnetpp (max) (percentage)
473.astar
473.astar (avg)
473.astar (avg) (percentage)
473.astar (max)
473.astar (max) (percentage)
481.wrf (avg) (percentage)
481.wrf (max) (percentage)
482.sphinx3
482.sphinx3 (avg)
482.sphinx3 (avg) (percentage)
482.sphinx3 (max)
482.sphinx3 (max) (percentage)
483.xalancbmk (avg) (percentage)
483.xalancbmk (max) (percentage)


Report Time: 0.35s
Name Current %
400.perlbench 1448.000 -
401.bzip2 2801.000 -
410.bwaves 4347.000 -
429.mcf 2017.000 -
433.milc 1129.000 -
434.zeusmp 2053.000 -
435.gromacs 5236.000 -
436.cactusADM 1809.000 -
437.leslie3d 8897.000 -
444.namd 632.000 -
445.gobmk 4858.000 -
447.dealII 1401.000 -
450.soplex 551.000 -
453.povray 442.000 -
456.hmmer 2683.000 -
458.sjeng 6472.000 -
459.GemsFDTD 4475.000 -
462.libquantum 81.000 -
464.h264ref 4286.000 -
465.tonto 9085.000 -
470.lbm 3341.000 -
471.omnetpp 2478.000 -
473.astar 5378.000 -
482.sphinx3 801.000 -
Geometric Mean 2114.194 -
Name Current %
400.perlbench 1107460.000 -
401.bzip2 58857.000 -
410.bwaves 22684.000 -
429.mcf 12220.000 -
433.milc 112639.000 -
434.zeusmp 201529.000 -
435.gromacs 794106.000 -
436.cactusADM 664917.000 -
437.leslie3d 78210.000 -
444.namd 230006.000 -
445.gobmk 1556143.000 -
447.dealII 2889929.000 -
450.soplex 352651.000 -
453.povray 840255.000 -
456.hmmer 272383.000 -
458.sjeng 131171.000 -
459.GemsFDTD 303656.000 -
462.libquantum 38440.000 -
464.h264ref 477626.000 -
465.tonto 3308351.000 -
470.lbm 11629.000 -
471.omnetpp 635299.000 -
473.astar 36261.000 -
482.sphinx3 177744.000 -
Geometric Mean 219868.694 -
Name Current %
400.perlbench 26.000 -
400.perlbench (avg) 26.000 -
400.perlbench (avg) (percentage) 1.810 -
400.perlbench (max) 16.000 -
400.perlbench (max) (percentage) 1.120 -
400.perlbench (unexplained diff vs previous) 16.000 -
400.perlbench (unexplained diff vs previous) (percentage) 1.100 -
401.bzip2 40.000 -
401.bzip2 (avg) 40.000 -
401.bzip2 (avg) (percentage) 1.430 -
401.bzip2 (max) 33.000 -
401.bzip2 (max) (percentage) 1.190 -
401.bzip2 (unexplained diff vs previous) 33.000 -
401.bzip2 (unexplained diff vs previous) (percentage) 1.180 -
403.gcc (avg) (percentage) 4.780 -
403.gcc (max) (percentage) 4.180 -
410.bwaves 29.000 -
410.bwaves (avg) 29.000 -
410.bwaves (avg) (percentage) 0.680 -
410.bwaves (max) 33.000 -
410.bwaves (max) (percentage) 0.760 -
410.bwaves (unexplained diff vs previous) 33.000 -
410.bwaves (unexplained diff vs previous) (percentage) 0.760 -
416.gamess (avg) (percentage) 0.310 -
416.gamess (max) (percentage) 0.430 -
429.mcf 123.000 -
429.mcf (avg) 123.000 -
429.mcf (avg) (percentage) 6.110 -
429.mcf (max) 28.000 -
429.mcf (max) (percentage) 1.420 -
429.mcf (unexplained diff vs previous) 15.000 -
429.mcf (unexplained diff vs previous) (percentage) 0.740 -
433.milc 8.000 -
433.milc (avg) 8.000 -
433.milc (avg) (percentage) 0.710 -
433.milc (max) 6.000 -
433.milc (max) (percentage) 0.610 -
433.milc (unexplained diff vs previous) 6.000 -
433.milc (unexplained diff vs previous) (percentage) 0.530 -
434.zeusmp 15.000 -
434.zeusmp (avg) 15.000 -
434.zeusmp (avg) (percentage) 0.740 -
434.zeusmp (max) 14.000 -
434.zeusmp (max) (percentage) 0.720 -
434.zeusmp (unexplained diff vs previous) 7.000 -
434.zeusmp (unexplained diff vs previous) (percentage) 0.340 -
435.gromacs 100.000 -
435.gromacs (avg) 100.000 -
435.gromacs (avg) (percentage) 1.910 -
435.gromacs (max) 111.000 -
435.gromacs (max) (percentage) 2.130 -
435.gromacs (unexplained diff vs previous) 109.000 -
435.gromacs (unexplained diff vs previous) (percentage) 2.080 -
436.cactusADM 15.000 -
436.cactusADM (avg) 15.000 -
436.cactusADM (avg) (percentage) 0.840 -
436.cactusADM (max) 10.000 -
436.cactusADM (max) (percentage) 0.580 -
436.cactusADM (unexplained diff vs previous) 8.000 -
436.cactusADM (unexplained diff vs previous) (percentage) 0.440 -
437.leslie3d 566.000 -
437.leslie3d (avg) 566.000 -
437.leslie3d (avg) (percentage) 6.370 -
437.leslie3d (max) 732.000 -
437.leslie3d (max) (percentage) 8.230 -
437.leslie3d (unexplained diff vs previous) 548.000 -
437.leslie3d (unexplained diff vs previous) (percentage) 6.160 -
444.namd 4.000 -
444.namd (avg) 4.000 -
444.namd (avg) (percentage) 0.770 -
444.namd (max) 3.000 -
444.namd (max) (percentage) 0.560 -
444.namd (unexplained diff vs previous) 1.000 -
444.namd (unexplained diff vs previous) (percentage) 0.160 -
445.gobmk 36.000 -
445.gobmk (avg) 36.000 -
445.gobmk (avg) (percentage) 0.760 -
445.gobmk (max) 42.000 -
445.gobmk (max) (percentage) 0.870 -
445.gobmk (unexplained diff vs previous) 16.000 -
445.gobmk (unexplained diff vs previous) (percentage) 0.330 -
447.dealII 12.000 -
447.dealII (avg) 12.000 -
447.dealII (avg) (percentage) 0.920 -
447.dealII (max) 26.000 -
447.dealII (max) (percentage) 1.860 -
447.dealII (unexplained diff vs previous) 3.000 -
447.dealII (unexplained diff vs previous) (percentage) 0.210 -
450.soplex 11.000 -
450.soplex (avg) 11.000 -
450.soplex (avg) (percentage) 2.140 -
450.soplex (max) 11.000 -
450.soplex (max) (percentage) 2.060 -
450.soplex (unexplained diff vs previous) 9.000 -
450.soplex (unexplained diff vs previous) (percentage) 1.630 -
453.povray 6.000 -
453.povray (avg) 6.000 -
453.povray (avg) (percentage) 1.420 -
453.povray (max) 6.000 -
453.povray (max) (percentage) 1.400 -
453.povray (unexplained diff vs previous) 1.000 -
453.povray (unexplained diff vs previous) (percentage) 0.230 -
454.calculix (avg) (percentage) 3.100 -
454.calculix (max) (percentage) 2.720 -
456.hmmer 8.000 -
456.hmmer (avg) 8.000 -
456.hmmer (avg) (percentage) 0.330 -
456.hmmer (max) 17.000 -
456.hmmer (max) (percentage) 0.640 -
456.hmmer (unexplained diff vs previous) 17.000 -
456.hmmer (unexplained diff vs previous) (percentage) 0.630 -
458.sjeng 31.000 -
458.sjeng (avg) 31.000 -
458.sjeng (avg) (percentage) 0.490 -
458.sjeng (max) 22.000 -
458.sjeng (max) (percentage) 0.340 -
458.sjeng (unexplained diff vs previous) 22.000 -
458.sjeng (unexplained diff vs previous) (percentage) 0.340 -
459.GemsFDTD 37.000 -
459.GemsFDTD (avg) 37.000 -
459.GemsFDTD (avg) (percentage) 0.830 -
459.GemsFDTD (max) 20.000 -
459.GemsFDTD (max) (percentage) 0.450 -
459.GemsFDTD (unexplained diff vs previous) 20.000 -
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.450 -
462.libquantum 1.000 -
462.libquantum (avg) 1.000 -
462.libquantum (avg) (percentage) 1.810 -
462.libquantum (max) 1.000 -
462.libquantum (max) (percentage) 1.250 -
462.libquantum (unexplained diff vs previous) 1.000 -
462.libquantum (unexplained diff vs previous) (percentage) 1.230 -
464.h264ref 24.000 -
464.h264ref (avg) 24.000 -
464.h264ref (avg) (percentage) 0.560 -
464.h264ref (max) 29.000 -
464.h264ref (max) (percentage) 0.690 -
464.h264ref (unexplained diff vs previous) 17.000 -
464.h264ref (unexplained diff vs previous) (percentage) 0.400 -
465.tonto 89.000 -
465.tonto (avg) 89.000 -
465.tonto (avg) (percentage) 0.980 -
465.tonto (max) 57.000 -
465.tonto (max) (percentage) 0.630 -
465.tonto (unexplained diff vs previous) 57.000 -
465.tonto (unexplained diff vs previous) (percentage) 0.630 -
470.lbm 22.000 -
470.lbm (avg) 22.000 -
470.lbm (avg) (percentage) 0.680 -
470.lbm (max) 24.000 -
470.lbm (max) (percentage) 0.740 -
470.lbm (unexplained diff vs previous) 25.000 -
470.lbm (unexplained diff vs previous) (percentage) 0.750 -
471.omnetpp 49.000 -
471.omnetpp (avg) 49.000 -
471.omnetpp (avg) (percentage) 1.980 -
471.omnetpp (max) 62.000 -
471.omnetpp (max) (percentage) 2.530 -
471.omnetpp (unexplained diff vs previous) 41.000 -
471.omnetpp (unexplained diff vs previous) (percentage) 1.650 -
473.astar 59.000 -
473.astar (avg) 59.000 -
473.astar (avg) (percentage) 1.110 -
473.astar (max) 19.000 -
473.astar (max) (percentage) 0.360 -
473.astar (unexplained diff vs previous) 11.000 -
473.astar (unexplained diff vs previous) (percentage) 0.200 -
481.wrf (avg) (percentage) 1.320 -
481.wrf (max) (percentage) 0.750 -
482.sphinx3 10.000 -
482.sphinx3 (avg) 10.000 -
482.sphinx3 (avg) (percentage) 1.300 -
482.sphinx3 (max) 9.000 -
482.sphinx3 (max) (percentage) 1.140 -
482.sphinx3 (unexplained diff vs previous) 9.000 -
482.sphinx3 (unexplained diff vs previous) (percentage) 1.120 -
483.xalancbmk (avg) (percentage) 2.290 -
483.xalancbmk (max) (percentage) 2.530 -
Geometric Mean 4.895 -