Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=95ebc6fdec5780bf59685739cdd55cd41d0f55ac (+ 80 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/4341106354c6a463ce3628a4ef9c1a1d37193b59 (+ 204 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=91689649656314b04f3dbee0415a9254eb1424dd (+ 27 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=71897434024c86029bf47273558c0b8f82387f4a (+ 119 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-aarch64-master-Os_LTO-build/1/
Filter

gnu-aarch64-master-Os_LTO test results

Run Order Start Time Duration
Current 0001 (4-changed-components) 2023-02-20T22:48:24 0:00:00
No Previous Run
Baseline 0001 (4-changed-components) 2023-02-20T22:48:24 0:00:00


Tests Summary

Status Group # # (B)
Added Tests 264 0
Unchanged Tests 972 1236
Total Tests 1236

Added Tests - Code Size
400.perlbench
401.bzip2
403.gcc
410.bwaves
416.gamess
429.mcf
433.milc
434.zeusmp
435.gromacs
436.cactusADM
437.leslie3d
444.namd
445.gobmk
447.dealII
450.soplex
453.povray
454.calculix
456.hmmer
458.sjeng
459.GemsFDTD
462.libquantum
464.h264ref
465.tonto
470.lbm
471.omnetpp
473.astar
481.wrf
482.sphinx3
483.xalancbmk

Added Tests - Execution
400.perlbench
401.bzip2
403.gcc
410.bwaves
416.gamess
429.mcf
433.milc
434.zeusmp
435.gromacs
436.cactusADM
437.leslie3d
444.namd
445.gobmk
447.dealII
450.soplex
453.povray
454.calculix
456.hmmer
458.sjeng
459.GemsFDTD
462.libquantum
464.h264ref
465.tonto
470.lbm
471.omnetpp
473.astar
481.wrf
482.sphinx3
483.xalancbmk

Added Tests - sample variability
400.perlbench
400.perlbench (avg)
400.perlbench (avg) (percentage)
400.perlbench (max)
400.perlbench (max) (percentage)
400.perlbench (unexplained diff vs previous)
400.perlbench (unexplained diff vs previous) (percentage)
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
401.bzip2 (unexplained diff vs previous)
401.bzip2 (unexplained diff vs previous) (percentage)
403.gcc
403.gcc (avg)
403.gcc (avg) (percentage)
403.gcc (max)
403.gcc (max) (percentage)
403.gcc (unexplained diff vs previous)
403.gcc (unexplained diff vs previous) (percentage)
410.bwaves
410.bwaves (avg)
410.bwaves (avg) (percentage)
410.bwaves (max)
410.bwaves (max) (percentage)
410.bwaves (unexplained diff vs previous)
410.bwaves (unexplained diff vs previous) (percentage)
416.gamess
416.gamess (avg)
416.gamess (avg) (percentage)
416.gamess (max)
416.gamess (max) (percentage)
416.gamess (unexplained diff vs previous)
416.gamess (unexplained diff vs previous) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
429.mcf (unexplained diff vs previous)
429.mcf (unexplained diff vs previous) (percentage)
433.milc
433.milc (avg)
433.milc (avg) (percentage)
433.milc (max)
433.milc (max) (percentage)
433.milc (unexplained diff vs previous)
433.milc (unexplained diff vs previous) (percentage)
434.zeusmp
434.zeusmp (avg)
434.zeusmp (avg) (percentage)
434.zeusmp (max)
434.zeusmp (max) (percentage)
434.zeusmp (unexplained diff vs previous)
434.zeusmp (unexplained diff vs previous) (percentage)
435.gromacs
435.gromacs (avg)
435.gromacs (avg) (percentage)
435.gromacs (max)
435.gromacs (max) (percentage)
435.gromacs (unexplained diff vs previous)
435.gromacs (unexplained diff vs previous) (percentage)
436.cactusADM
436.cactusADM (avg)
436.cactusADM (avg) (percentage)
436.cactusADM (max)
436.cactusADM (max) (percentage)
436.cactusADM (unexplained diff vs previous)
436.cactusADM (unexplained diff vs previous) (percentage)
437.leslie3d
437.leslie3d (avg)
437.leslie3d (avg) (percentage)
437.leslie3d (max)
437.leslie3d (max) (percentage)
437.leslie3d (unexplained diff vs previous)
437.leslie3d (unexplained diff vs previous) (percentage)
444.namd
444.namd (avg)
444.namd (avg) (percentage)
444.namd (max)
444.namd (max) (percentage)
444.namd (unexplained diff vs previous)
444.namd (unexplained diff vs previous) (percentage)
445.gobmk
445.gobmk (avg)
445.gobmk (avg) (percentage)
445.gobmk (max)
445.gobmk (max) (percentage)
445.gobmk (unexplained diff vs previous)
445.gobmk (unexplained diff vs previous) (percentage)
447.dealII
447.dealII (avg)
447.dealII (avg) (percentage)
447.dealII (max)
447.dealII (max) (percentage)
447.dealII (unexplained diff vs previous)
447.dealII (unexplained diff vs previous) (percentage)
450.soplex
450.soplex (avg)
450.soplex (avg) (percentage)
450.soplex (max)
450.soplex (max) (percentage)
450.soplex (unexplained diff vs previous)
450.soplex (unexplained diff vs previous) (percentage)
453.povray
453.povray (avg)
453.povray (avg) (percentage)
453.povray (max)
453.povray (max) (percentage)
453.povray (unexplained diff vs previous)
453.povray (unexplained diff vs previous) (percentage)
454.calculix
454.calculix (avg)
454.calculix (avg) (percentage)
454.calculix (max)
454.calculix (max) (percentage)
454.calculix (unexplained diff vs previous)
454.calculix (unexplained diff vs previous) (percentage)
456.hmmer
456.hmmer (avg)
456.hmmer (avg) (percentage)
456.hmmer (max)
456.hmmer (max) (percentage)
456.hmmer (unexplained diff vs previous)
456.hmmer (unexplained diff vs previous) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
458.sjeng (unexplained diff vs previous)
458.sjeng (unexplained diff vs previous) (percentage)
459.GemsFDTD
459.GemsFDTD (avg)
459.GemsFDTD (avg) (percentage)
459.GemsFDTD (max)
459.GemsFDTD (max) (percentage)
459.GemsFDTD (unexplained diff vs previous)
459.GemsFDTD (unexplained diff vs previous) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)
462.libquantum (unexplained diff vs previous)
462.libquantum (unexplained diff vs previous) (percentage)
464.h264ref
464.h264ref (avg)
464.h264ref (avg) (percentage)
464.h264ref (max)
464.h264ref (max) (percentage)
464.h264ref (unexplained diff vs previous)
464.h264ref (unexplained diff vs previous) (percentage)
465.tonto
465.tonto (avg)
465.tonto (avg) (percentage)
465.tonto (max)
465.tonto (max) (percentage)
465.tonto (unexplained diff vs previous)
465.tonto (unexplained diff vs previous) (percentage)
470.lbm
470.lbm (avg)
470.lbm (avg) (percentage)
470.lbm (max)
470.lbm (max) (percentage)
470.lbm (unexplained diff vs previous)
470.lbm (unexplained diff vs previous) (percentage)
471.omnetpp
471.omnetpp (avg)
471.omnetpp (avg) (percentage)
471.omnetpp (max)
471.omnetpp (max) (percentage)
471.omnetpp (unexplained diff vs previous)
471.omnetpp (unexplained diff vs previous) (percentage)
473.astar
473.astar (avg)
473.astar (avg) (percentage)
473.astar (max)
473.astar (max) (percentage)
473.astar (unexplained diff vs previous)
473.astar (unexplained diff vs previous) (percentage)
481.wrf
481.wrf (avg)
481.wrf (avg) (percentage)
481.wrf (max)
481.wrf (max) (percentage)
481.wrf (unexplained diff vs previous)
481.wrf (unexplained diff vs previous) (percentage)
482.sphinx3
482.sphinx3 (avg)
482.sphinx3 (avg) (percentage)
482.sphinx3 (max)
482.sphinx3 (max) (percentage)
482.sphinx3 (unexplained diff vs previous)
482.sphinx3 (unexplained diff vs previous) (percentage)
483.xalancbmk
483.xalancbmk (avg)
483.xalancbmk (avg) (percentage)
483.xalancbmk (max)
483.xalancbmk (max) (percentage)
483.xalancbmk (unexplained diff vs previous)
483.xalancbmk (unexplained diff vs previous) (percentage)

Added Tests - Score
nb_compile_successful
nb_execution_successful
nb_total_tests


Report Time: 0.35s
Name Current %
400.perlbench 1663.000 -
401.bzip2 2941.000 -
403.gcc 56.000 -
410.bwaves 5652.000 -
416.gamess 12465.000 -
429.mcf 1424.000 -
433.milc 1151.000 -
434.zeusmp 2514.000 -
435.gromacs 7269.000 -
436.cactusADM 2083.000 -
437.leslie3d 11640.000 -
444.namd 747.000 -
445.gobmk 5023.000 -
447.dealII 1724.000 -
450.soplex 567.000 -
453.povray 547.000 -
454.calculix 62.000 -
456.hmmer 2882.000 -
458.sjeng 7567.000 -
459.GemsFDTD 6173.000 -
462.libquantum 140.000 -
464.h264ref 5761.000 -
465.tonto 10941.000 -
470.lbm 3788.000 -
471.omnetpp 2724.000 -
473.astar 5128.000 -
481.wrf 5534.000 -
482.sphinx3 945.000 -
483.xalancbmk 3818.000 -
Geometric Mean 2099.272 -
Name Current %
400.perlbench 893848.000 -
401.bzip2 44233.000 -
403.gcc 2448807.000 -
410.bwaves 16760.000 -
416.gamess 5735529.000 -
429.mcf 9123.000 -
433.milc 61382.000 -
434.zeusmp 152037.000 -
435.gromacs 499261.000 -
436.cactusADM 352891.000 -
437.leslie3d 59479.000 -
444.namd 188385.000 -
445.gobmk 1377778.000 -
447.dealII 311591.000 -
450.soplex 205081.000 -
453.povray 661389.000 -
454.calculix 845495.000 -
456.hmmer 108691.000 -
458.sjeng 104048.000 -
459.GemsFDTD 244728.000 -
462.libquantum 16085.000 -
464.h264ref 387748.000 -
465.tonto 1946163.000 -
470.lbm 9691.000 -
471.omnetpp 478024.000 -
473.astar 22968.000 -
481.wrf 1956607.000 -
482.sphinx3 112859.000 -
483.xalancbmk 2342811.000 -
Geometric Mean 223935.319 -
Name Current %
400.perlbench 105.000 -
400.perlbench (avg) 105.000 -
400.perlbench (avg) (percentage) 6.350 -
400.perlbench (max) 1397.000 -
400.perlbench (max) (percentage) 84.060 -
400.perlbench (unexplained diff vs previous) 8772.000 -
400.perlbench (unexplained diff vs previous) (percentage) 527.480 -
401.bzip2 161.000 -
401.bzip2 (avg) 161.000 -
401.bzip2 (avg) (percentage) 5.480 -
401.bzip2 (max) 2313.000 -
401.bzip2 (max) (percentage) 78.650 -
401.bzip2 (unexplained diff vs previous) 10833.000 -
401.bzip2 (unexplained diff vs previous) (percentage) 368.340 -
403.gcc 4.000 -
403.gcc (avg) 4.000 -
403.gcc (avg) (percentage) 7.320 -
403.gcc (max) 55.000 -
403.gcc (max) (percentage) 99.360 -
403.gcc (unexplained diff vs previous) 8644.000 -
403.gcc (unexplained diff vs previous) (percentage) 15435.710 -
410.bwaves 249.000 -
410.bwaves (avg) 249.000 -
410.bwaves (avg) (percentage) 4.410 -
410.bwaves (max) 3276.000 -
410.bwaves (max) (percentage) 57.970 -
410.bwaves (unexplained diff vs previous) 7794.000 -
410.bwaves (unexplained diff vs previous) (percentage) 137.900 -
416.gamess 550.000 -
416.gamess (avg) 550.000 -
416.gamess (avg) (percentage) 4.420 -
416.gamess (max) 4805.000 -
416.gamess (max) (percentage) 38.550 -
416.gamess (unexplained diff vs previous) 7819.000 -
416.gamess (unexplained diff vs previous) (percentage) 62.730 -
429.mcf 109.000 -
429.mcf (avg) 109.000 -
429.mcf (avg) (percentage) 7.670 -
429.mcf (max) 1322.000 -
429.mcf (max) (percentage) 92.890 -
429.mcf (unexplained diff vs previous) 18593.000 -
429.mcf (unexplained diff vs previous) (percentage) 1305.690 -
433.milc 69.000 -
433.milc (avg) 69.000 -
433.milc (avg) (percentage) 6.050 -
433.milc (max) 1044.000 -
433.milc (max) (percentage) 90.750 -
433.milc (unexplained diff vs previous) 11289.000 -
433.milc (unexplained diff vs previous) (percentage) 980.800 -
434.zeusmp 147.000 -
434.zeusmp (avg) 147.000 -
434.zeusmp (avg) (percentage) 5.850 -
434.zeusmp (max) 2055.000 -
434.zeusmp (max) (percentage) 81.770 -
434.zeusmp (unexplained diff vs previous) 11280.000 -
434.zeusmp (unexplained diff vs previous) (percentage) 448.690 -
435.gromacs 367.000 -
435.gromacs (avg) 367.000 -
435.gromacs (avg) (percentage) 5.060 -
435.gromacs (max) 3573.000 -
435.gromacs (max) (percentage) 49.160 -
435.gromacs (unexplained diff vs previous) 7028.000 -
435.gromacs (unexplained diff vs previous) (percentage) 96.680 -
436.cactusADM 124.000 -
436.cactusADM (avg) 124.000 -
436.cactusADM (avg) (percentage) 5.980 -
436.cactusADM (max) 1848.000 -
436.cactusADM (max) (percentage) 88.730 -
436.cactusADM (unexplained diff vs previous) 16396.000 -
436.cactusADM (unexplained diff vs previous) (percentage) 787.130 -
437.leslie3d 355.000 -
437.leslie3d (avg) 355.000 -
437.leslie3d (avg) (percentage) 3.050 -
437.leslie3d (max) 1929.000 -
437.leslie3d (max) (percentage) 16.580 -
437.leslie3d (unexplained diff vs previous) 2314.000 -
437.leslie3d (unexplained diff vs previous) (percentage) 19.880 -
444.namd 68.000 -
444.namd (avg) 68.000 -
444.namd (avg) (percentage) 9.220 -
444.namd (max) 685.000 -
444.namd (max) (percentage) 91.790 -
444.namd (unexplained diff vs previous) 8356.000 -
444.namd (unexplained diff vs previous) (percentage) 1118.610 -
445.gobmk 196.000 -
445.gobmk (avg) 196.000 -
445.gobmk (avg) (percentage) 3.910 -
445.gobmk (max) 2643.000 -
445.gobmk (max) (percentage) 52.630 -
445.gobmk (unexplained diff vs previous) 5581.000 -
445.gobmk (unexplained diff vs previous) (percentage) 111.110 -
447.dealII 99.000 -
447.dealII (avg) 99.000 -
447.dealII (avg) (percentage) 5.770 -
447.dealII (max) 1384.000 -
447.dealII (max) (percentage) 80.280 -
447.dealII (unexplained diff vs previous) 7017.000 -
447.dealII (unexplained diff vs previous) (percentage) 407.020 -
450.soplex 36.000 -
450.soplex (avg) 36.000 -
450.soplex (avg) (percentage) 6.430 -
450.soplex (max) 545.000 -
450.soplex (max) (percentage) 96.240 -
450.soplex (unexplained diff vs previous) 14500.000 -
450.soplex (unexplained diff vs previous) (percentage) 2557.320 -
453.povray 42.000 -
453.povray (avg) 42.000 -
453.povray (avg) (percentage) 7.810 -
453.povray (max) 499.000 -
453.povray (max) (percentage) 91.250 -
453.povray (unexplained diff vs previous) 5707.000 -
453.povray (unexplained diff vs previous) (percentage) 1043.330 -
454.calculix 4.000 -
454.calculix (avg) 4.000 -
454.calculix (avg) (percentage) 8.020 -
454.calculix (max) 61.000 -
454.calculix (max) (percentage) 99.730 -
454.calculix (unexplained diff vs previous) 22953.000 -
454.calculix (unexplained diff vs previous) (percentage) 37020.970 -
456.hmmer 127.000 -
456.hmmer (avg) 127.000 -
456.hmmer (avg) (percentage) 4.410 -
456.hmmer (max) 2120.000 -
456.hmmer (max) (percentage) 73.590 -
456.hmmer (unexplained diff vs previous) 8030.000 -
456.hmmer (unexplained diff vs previous) (percentage) 278.630 -
458.sjeng 241.000 -
458.sjeng (avg) 241.000 -
458.sjeng (avg) (percentage) 3.190 -
458.sjeng (max) 3602.000 -
458.sjeng (max) (percentage) 47.610 -
458.sjeng (unexplained diff vs previous) 6876.000 -
458.sjeng (unexplained diff vs previous) (percentage) 90.870 -
459.GemsFDTD 360.000 -
459.GemsFDTD (avg) 360.000 -
459.GemsFDTD (avg) (percentage) 5.840 -
459.GemsFDTD (max) 4411.000 -
459.GemsFDTD (max) (percentage) 71.460 -
459.GemsFDTD (unexplained diff vs previous) 15458.000 -
459.GemsFDTD (unexplained diff vs previous) (percentage) 250.410 -
462.libquantum 10.000 -
462.libquantum (avg) 10.000 -
462.libquantum (avg) (percentage) 7.660 -
462.libquantum (max) 138.000 -
462.libquantum (max) (percentage) 98.970 -
462.libquantum (unexplained diff vs previous) 13518.000 -
462.libquantum (unexplained diff vs previous) (percentage) 9655.710 -
464.h264ref 293.000 -
464.h264ref (avg) 293.000 -
464.h264ref (avg) (percentage) 5.090 -
464.h264ref (max) 3127.000 -
464.h264ref (max) (percentage) 54.290 -
464.h264ref (unexplained diff vs previous) 6843.000 -
464.h264ref (unexplained diff vs previous) (percentage) 118.780 -
465.tonto 365.000 -
465.tonto (avg) 365.000 -
465.tonto (avg) (percentage) 3.340 -
465.tonto (max) 2112.000 -
465.tonto (max) (percentage) 19.310 -
465.tonto (unexplained diff vs previous) 1771.000 -
465.tonto (unexplained diff vs previous) (percentage) 16.190 -
470.lbm 239.000 -
470.lbm (avg) 239.000 -
470.lbm (avg) (percentage) 6.330 -
470.lbm (max) 2746.000 -
470.lbm (max) (percentage) 72.510 -
470.lbm (unexplained diff vs previous) 9990.000 -
470.lbm (unexplained diff vs previous) (percentage) 263.730 -
471.omnetpp 223.000 -
471.omnetpp (avg) 223.000 -
471.omnetpp (avg) (percentage) 8.200 -
471.omnetpp (max) 2169.000 -
471.omnetpp (max) (percentage) 79.650 -
471.omnetpp (unexplained diff vs previous) 10659.000 -
471.omnetpp (unexplained diff vs previous) (percentage) 391.300 -
473.astar 213.000 -
473.astar (avg) 213.000 -
473.astar (avg) (percentage) 4.160 -
473.astar (max) 3406.000 -
473.astar (max) (percentage) 66.430 -
473.astar (unexplained diff vs previous) 10146.000 -
473.astar (unexplained diff vs previous) (percentage) 197.850 -
481.wrf 345.000 -
481.wrf (avg) 345.000 -
481.wrf (avg) (percentage) 6.240 -
481.wrf (max) 3801.000 -
481.wrf (max) (percentage) 68.700 -
481.wrf (unexplained diff vs previous) 12149.000 -
481.wrf (unexplained diff vs previous) (percentage) 219.530 -
482.sphinx3 74.000 -
482.sphinx3 (avg) 74.000 -
482.sphinx3 (avg) (percentage) 7.930 -
482.sphinx3 (max) 911.000 -
482.sphinx3 (max) (percentage) 96.500 -
482.sphinx3 (unexplained diff vs previous) 26073.000 -
482.sphinx3 (unexplained diff vs previous) (percentage) 2759.050 -
483.xalancbmk 248.000 -
483.xalancbmk (avg) 248.000 -
483.xalancbmk (avg) (percentage) 6.500 -
483.xalancbmk (max) 2621.000 -
483.xalancbmk (max) (percentage) 68.670 -
483.xalancbmk (unexplained diff vs previous) 8368.000 -
483.xalancbmk (unexplained diff vs previous) (percentage) 219.170 -
Geometric Mean 225.952 -