Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=eefa43c9366e3665f1451d6bbfd46b84dea0d15d (+ 49 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/e28869670c9879fe7c67caf6cc11af202509ef78 (+ 112 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=2aa0974d2573441bffd596b07bff8698b1f2f18c (+ 7 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=87c70f5e18e519ad859e54636487afdabd89dfbd (+ 191 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-arm-master-O2_LTO-build/77/
View Options
Report
Filter

gnu-arm-master-O2_LTO test results

Run Order Start Time Duration
Current 0077 (4-changed-components) 2023-10-16T04:44:17 0:00:00
Previous 0077 (4-changed-components) 2023-10-16T04:44:17 0:00:00
Baseline 0001 (4-changed-components) 2023-03-23T21:38:29 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 0 18
Performance Improvements 0 10
Added Tests 0 140
Unchanged Tests 1188 1020
Total Tests 1188

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
447.dealII 3.64% 381188.000 395078.000 - 0.00% -
481.wrf 2.85% 3709079.000 3814678.000 - 0.00% -
444.namd 2.57% 225019.000 230797.000 - 0.00% -
437.leslie3d 2.34% 79677.000 81541.000 - 0.00% -
410.bwaves 2.25% 22626.000 23134.000 - 0.00% -
459.GemsFDTD 2.04% 326542.000 333206.000 - 0.00% -
464.h264ref 1.75% 448678.000 456510.000 - 0.00% -
416.gamess 1.57% 6775160.000 6881352.000 - 0.00% -
401.bzip2 1.36% 48792.000 49456.000 - 0.00% -
436.cactusADM 1.36% 409394.000 414946.000 - 0.00% -
470.lbm 1.33% 10803.000 10947.000 - 0.00% -
400.perlbench 1.25% 1025894.000 1038713.000 - 0.00% -
456.hmmer 1.23% 125735.000 127287.000 - 0.00% -
465.tonto 1.11% 2255286.000 2280305.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
403.gcc 5.77% 52.000 55.000 - 0.00% -
416.gamess 4.70% 14139.000 14804.000 - 0.00% -
435.gromacs 1.05% 5720.000 5780.000 - 0.00% -
401.bzip2 1.03% 2728.000 2756.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
454.calculix -5.08% 59.000 56.000 - 0.00% -
462.libquantum -4.42% 113.000 108.000 - 0.00% -
429.mcf -3.35% 924.000 893.000 - 0.00% -
445.gobmk -1.68% 4771.000 4691.000 - 0.00% -
437.leslie3d -1.67% 10347.000 10174.000 - 0.00% -
450.soplex -1.50% 532.000 524.000 - 0.00% -
482.sphinx3 -1.18% 760.000 751.000 - 0.00% -
444.namd -1.16% 776.000 767.000 - 0.00% -
471.omnetpp -1.06% 2171.000 2148.000 - 0.00% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 3.57% 28.000 29.000 - 0.00% -

Added Tests - sample variability
400.perlbench
400.perlbench (avg)
400.perlbench (avg) (percentage)
400.perlbench (max)
400.perlbench (max) (percentage)
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
403.gcc
403.gcc (avg)
403.gcc (avg) (percentage)
403.gcc (max)
403.gcc (max) (percentage)
410.bwaves
410.bwaves (avg)
410.bwaves (avg) (percentage)
410.bwaves (max)
410.bwaves (max) (percentage)
416.gamess
416.gamess (avg)
416.gamess (avg) (percentage)
416.gamess (max)
416.gamess (max) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
433.milc
433.milc (avg)
433.milc (avg) (percentage)
433.milc (max)
433.milc (max) (percentage)
434.zeusmp
434.zeusmp (avg)
434.zeusmp (avg) (percentage)
434.zeusmp (max)
434.zeusmp (max) (percentage)
435.gromacs
435.gromacs (avg)
435.gromacs (avg) (percentage)
435.gromacs (max)
435.gromacs (max) (percentage)
436.cactusADM
436.cactusADM (avg)
436.cactusADM (avg) (percentage)
436.cactusADM (max)
436.cactusADM (max) (percentage)
437.leslie3d
437.leslie3d (avg)
437.leslie3d (avg) (percentage)
437.leslie3d (max)
437.leslie3d (max) (percentage)
444.namd
444.namd (avg)
444.namd (avg) (percentage)
444.namd (max)
444.namd (max) (percentage)
445.gobmk
445.gobmk (avg)
445.gobmk (avg) (percentage)
445.gobmk (max)
445.gobmk (max) (percentage)
447.dealII
447.dealII (avg)
447.dealII (avg) (percentage)
447.dealII (max)
447.dealII (max) (percentage)
450.soplex
450.soplex (avg)
450.soplex (avg) (percentage)
450.soplex (max)
450.soplex (max) (percentage)
453.povray
453.povray (avg)
453.povray (avg) (percentage)
453.povray (max)
453.povray (max) (percentage)
454.calculix
454.calculix (avg)
454.calculix (avg) (percentage)
454.calculix (max)
454.calculix (max) (percentage)
456.hmmer
456.hmmer (avg)
456.hmmer (avg) (percentage)
456.hmmer (max)
456.hmmer (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
459.GemsFDTD
459.GemsFDTD (avg)
459.GemsFDTD (avg) (percentage)
459.GemsFDTD (max)
459.GemsFDTD (max) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)
464.h264ref
464.h264ref (avg)
464.h264ref (avg) (percentage)
464.h264ref (max)
464.h264ref (max) (percentage)
465.tonto
465.tonto (avg)
465.tonto (avg) (percentage)
465.tonto (max)
465.tonto (max) (percentage)
470.lbm
470.lbm (avg)
470.lbm (avg) (percentage)
470.lbm (max)
470.lbm (max) (percentage)
471.omnetpp
471.omnetpp (avg)
471.omnetpp (avg) (percentage)
471.omnetpp (max)
471.omnetpp (max) (percentage)
473.astar
473.astar (avg)
473.astar (avg) (percentage)
473.astar (max)
473.astar (max) (percentage)
481.wrf
481.wrf (avg)
481.wrf (avg) (percentage)
481.wrf (max)
481.wrf (max) (percentage)
482.sphinx3
482.sphinx3 (avg)
482.sphinx3 (avg) (percentage)
482.sphinx3 (max)
482.sphinx3 (max) (percentage)

Report Time: 0.34s
Execution (seconds)
Name Current %
400.perlbench 1372.000 -
401.bzip2 2756.000 -
403.gcc 55.000 -
410.bwaves 5363.000 -
416.gamess 14804.000 -
429.mcf 893.000 -
433.milc 1112.000 -
434.zeusmp 2404.000 -
435.gromacs 5780.000 -
436.cactusADM 2357.000 -
437.leslie3d 10174.000 -
444.namd 767.000 -
445.gobmk 4691.000 -
447.dealII 1399.000 -
450.soplex 524.000 -
453.povray 431.000 -
454.calculix 56.000 -
456.hmmer 3383.000 -
458.sjeng 6724.000 -
459.GemsFDTD 5220.000 -
462.libquantum 108.000 -
464.h264ref 5353.000 -
465.tonto 9892.000 -
470.lbm 3914.000 -
471.omnetpp 2148.000 -
473.astar 4845.000 -
481.wrf 5078.000 -
482.sphinx3 751.000 -
Geometric Mean 1862.779 -
Code Size (bytes)
Name Current %
400.perlbench 1038713.000 -
401.bzip2 49456.000 -
403.gcc 2969605.000 -
410.bwaves 23134.000 -
416.gamess 6881352.000 -
429.mcf 9683.000 -
433.milc 70537.000 -
434.zeusmp 220104.000 -
435.gromacs 575980.000 -
436.cactusADM 414946.000 -
437.leslie3d 81541.000 -
444.namd 230797.000 -
445.gobmk 1398781.000 -
447.dealII 395078.000 -
450.soplex 245847.000 -
453.povray 793975.000 -
454.calculix 1000265.000 -
456.hmmer 127287.000 -
458.sjeng 118447.000 -
459.GemsFDTD 333206.000 -
462.libquantum 19981.000 -
464.h264ref 456510.000 -
465.tonto 2280305.000 -
470.lbm 10947.000 -
471.omnetpp 525311.000 -
473.astar 23644.000 -
481.wrf 3814678.000 -
482.sphinx3 129603.000 -
Geometric Mean 249029.126 -
sample variability
Name Current %
400.perlbench 17.000 -
400.perlbench (avg) 17.000 -
400.perlbench (avg) (percentage) 1.300 -
400.perlbench (max) 26.000 -
400.perlbench (max) (percentage) 1.920 -
400.perlbench (unexplained diff vs previous) 17.000 -
400.perlbench (unexplained diff vs previous) (percentage) 1.240 -
401.bzip2 40.000 -
401.bzip2 (avg) 40.000 -
401.bzip2 (avg) (percentage) 1.470 -
401.bzip2 (max) 86.000 -
401.bzip2 (max) (percentage) 3.130 -
403.gcc 1.000 -
403.gcc (avg) 1.000 -
403.gcc (avg) (percentage) 3.060 -
403.gcc (max) 1.000 -
403.gcc (max) (percentage) 3.240 -
410.bwaves 54.000 -
410.bwaves (avg) 54.000 -
410.bwaves (avg) (percentage) 1.020 -
410.bwaves (max) 15.000 -
410.bwaves (max) (percentage) 0.290 -
416.gamess 19.000 -
416.gamess (avg) 19.000 -
416.gamess (avg) (percentage) 0.130 -
416.gamess (max) 29.000 -
416.gamess (max) (percentage) 0.200 -
429.mcf 50.000 -
429.mcf (avg) 50.000 -
429.mcf (avg) (percentage) 5.640 -
429.mcf (max) 92.000 -
429.mcf (max) (percentage) 10.310 -
429.mcf (unexplained diff vs previous) 13.000 -
429.mcf (unexplained diff vs previous) (percentage) 1.460 -
433.milc 14.000 -
433.milc (avg) 14.000 -
433.milc (avg) (percentage) 1.330 -
433.milc (max) 7.000 -
433.milc (max) (percentage) 0.710 -
434.zeusmp 24.000 -
434.zeusmp (avg) 24.000 -
434.zeusmp (avg) (percentage) 1.010 -
434.zeusmp (max) 43.000 -
434.zeusmp (max) (percentage) 1.810 -
435.gromacs 142.000 -
435.gromacs (avg) 142.000 -
435.gromacs (avg) (percentage) 2.460 -
435.gromacs (max) 195.000 -
435.gromacs (max) (percentage) 3.380 -
436.cactusADM 14.000 -
436.cactusADM (avg) 14.000 -
436.cactusADM (avg) (percentage) 0.610 -
436.cactusADM (max) 10.000 -
436.cactusADM (max) (percentage) 0.440 -
436.cactusADM (unexplained diff vs previous) 10.000 -
436.cactusADM (unexplained diff vs previous) (percentage) 0.420 -
437.leslie3d 209.000 -
437.leslie3d (avg) 209.000 -
437.leslie3d (avg) (percentage) 2.060 -
437.leslie3d (max) 189.000 -
437.leslie3d (max) (percentage) 1.860 -
444.namd 2.000 -
444.namd (avg) 2.000 -
444.namd (avg) (percentage) 0.380 -
444.namd (max) 4.000 -
444.namd (max) (percentage) 0.650 -
444.namd (unexplained diff vs previous) 2.000 -
444.namd (unexplained diff vs previous) (percentage) 0.260 -
445.gobmk 31.000 -
445.gobmk (avg) 31.000 -
445.gobmk (avg) (percentage) 0.680 -
445.gobmk (max) 41.000 -
445.gobmk (max) (percentage) 0.890 -
447.dealII 10.000 -
447.dealII (avg) 10.000 -
447.dealII (avg) (percentage) 0.780 -
447.dealII (max) 24.000 -
447.dealII (max) (percentage) 1.780 -
447.dealII (unexplained diff vs previous) 1.000 -
447.dealII (unexplained diff vs previous) (percentage) 0.070 -
450.soplex 14.000 -
450.soplex (avg) 14.000 -
450.soplex (avg) (percentage) 2.680 -
450.soplex (max) 10.000 -
450.soplex (max) (percentage) 2.060 -
450.soplex (unexplained diff vs previous) 11.000 -
450.soplex (unexplained diff vs previous) (percentage) 2.100 -
453.povray 4.000 -
453.povray (avg) 4.000 -
453.povray (avg) (percentage) 1.020 -
453.povray (max) 5.000 -
453.povray (max) (percentage) 1.300 -
454.calculix 1.000 -
454.calculix (avg) 1.000 -
454.calculix (avg) (percentage) 2.600 -
454.calculix (max) 2.000 -
454.calculix (max) (percentage) 4.020 -
456.hmmer 6.000 -
456.hmmer (avg) 6.000 -
456.hmmer (avg) (percentage) 0.190 -
456.hmmer (max) 4.000 -
456.hmmer (max) (percentage) 0.140 -
458.sjeng 22.000 -
458.sjeng (avg) 22.000 -
458.sjeng (avg) (percentage) 0.330 -
458.sjeng (max) 16.000 -
458.sjeng (max) (percentage) 0.250 -
458.sjeng (unexplained diff vs previous) 3.000 -
458.sjeng (unexplained diff vs previous) (percentage) 0.040 -
459.GemsFDTD 70.000 -
459.GemsFDTD (avg) 70.000 -
459.GemsFDTD (avg) (percentage) 1.360 -
459.GemsFDTD (max) 40.000 -
459.GemsFDTD (max) (percentage) 0.770 -
462.libquantum 1.000 -
462.libquantum (avg) 1.000 -
462.libquantum (avg) (percentage) 1.500 -
462.libquantum (max) 1.000 -
462.libquantum (max) (percentage) 1.160 -
464.h264ref 23.000 -
464.h264ref (avg) 23.000 -
464.h264ref (avg) (percentage) 0.440 -
464.h264ref (max) 39.000 -
464.h264ref (max) (percentage) 0.730 -
465.tonto 48.000 -
465.tonto (avg) 48.000 -
465.tonto (avg) (percentage) 0.490 -
465.tonto (max) 104.000 -
465.tonto (max) (percentage) 1.060 -
470.lbm 30.000 -
470.lbm (avg) 30.000 -
470.lbm (avg) (percentage) 0.770 -
470.lbm (max) 23.000 -
470.lbm (max) (percentage) 0.610 -
470.lbm (unexplained diff vs previous) 24.000 -
470.lbm (unexplained diff vs previous) (percentage) 0.610 -
471.omnetpp 29.000 -
471.omnetpp (avg) 29.000 -
471.omnetpp (avg) (percentage) 1.360 -
471.omnetpp (max) 32.000 -
471.omnetpp (max) (percentage) 1.490 -
471.omnetpp (unexplained diff vs previous) 11.000 -
471.omnetpp (unexplained diff vs previous) (percentage) 0.510 -
473.astar 57.000 -
473.astar (avg) 57.000 -
473.astar (avg) (percentage) 1.190 -
473.astar (max) 46.000 -
473.astar (max) (percentage) 0.960 -
473.astar (unexplained diff vs previous) 18.000 -
473.astar (unexplained diff vs previous) (percentage) 0.370 -
481.wrf 86.000 -
481.wrf (avg) 86.000 -
481.wrf (avg) (percentage) 1.710 -
481.wrf (max) 102.000 -
481.wrf (max) (percentage) 2.010 -
482.sphinx3 8.000 -
482.sphinx3 (avg) 8.000 -
482.sphinx3 (avg) (percentage) 1.190 -
482.sphinx3 (max) 9.000 -
482.sphinx3 (max) (percentage) 1.300 -
Geometric Mean 5.032 -