Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=1d8f691da90daae3e34c69ba553817e261166f5b (+ 35 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/f416a3fdbee32ae12b055b8e3e4ee11c3df7c117 (+ 51 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=d90b43a4ed475dac5b0cd6e01ceb35c7b0f7f2ff (+ 5 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=fa6f8700a990ab643c50f053d9aae1f5801befc3 (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_vect-spec2k6--gnu-arm-master-O3_LTO-build/129/
Filter

gnu-arm-master-O3_LTO test results

Run Order Start Time Duration
Current 0129 (3-changed-components) 2023-09-28T09:22:03 0:00:00
Previous 0129 (3-changed-components) 2023-09-28T09:22:03 0:00:00
Baseline 0001 (4-changed-components) 2023-03-04T00:55:39 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 0 31
Performance Improvements 0 6
Added Tests 0 137
Unchanged Tests 1188 1014
Total Tests 1188

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d 6.17% 95053.000 100921.000 - 0.00% -
447.dealII 4.30% 460638.000 480432.000 - 0.00% -
436.cactusADM 3.45% 520390.000 538318.000 - 0.00% -
410.bwaves 2.99% 22757.000 23437.000 - 0.00% -
444.namd 2.59% 232647.000 238674.000 - 0.00% -
481.wrf 2.17% 5813871.000 5939898.000 - 0.00% -
462.libquantum 2.13% 21437.000 21893.000 - 0.00% -
433.milc 2.07% 105180.000 107360.000 - 0.00% -
464.h264ref 1.59% 782902.000 795354.000 - 0.00% -
453.povray 1.35% 1079635.000 1094231.000 - 0.00% -
454.calculix 1.25% 1295314.000 1311449.000 - 0.00% -
403.gcc 1.23% 3746957.000 3793225.000 - 0.00% -
445.gobmk 1.15% 1706409.000 1726113.000 - 0.00% -
401.bzip2 1.05% 71216.000 71964.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
459.GemsFDTD 6.51% 4827.000 5141.000 - 0.00% -
462.libquantum 5.26% 114.000 120.000 - 0.00% -
401.bzip2 4.39% 2733.000 2853.000 - 0.00% -
473.astar 4.27% 4595.000 4791.000 - 0.00% -
403.gcc 4.08% 49.000 51.000 - 0.00% -
435.gromacs 3.88% 5488.000 5701.000 - 0.00% -
447.dealII 2.76% 978.000 1005.000 - 0.00% -
465.tonto 2.75% 9078.000 9328.000 - 0.00% -
445.gobmk 2.46% 4479.000 4589.000 - 0.00% -
464.h264ref 2.06% 5004.000 5107.000 - 0.00% -
482.sphinx3 2.05% 634.000 647.000 - 0.00% -
400.perlbench 2.02% 1289.000 1315.000 - 0.00% -
444.namd 1.96% 766.000 781.000 - 0.00% -
470.lbm 1.68% 3330.000 3386.000 - 0.00% -
437.leslie3d 1.30% 8821.000 8936.000 - 0.00% -
458.sjeng 1.04% 6628.000 6697.000 - 0.00% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_execution_successful -3.57% 28.000 27.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
429.mcf -26.28% 1214.000 895.000 - 0.00% -
456.hmmer -7.41% 3374.000 3124.000 - 0.00% -
433.milc -3.30% 940.000 909.000 - 0.00% -
436.cactusADM -2.42% 2359.000 2302.000 - 0.00% -
453.povray -1.60% 437.000 430.000 - 0.00% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 3.57% 28.000 29.000 - 0.00% -

Added Tests - sample variability
400.perlbench
400.perlbench (avg)
400.perlbench (avg) (percentage)
400.perlbench (max)
400.perlbench (max) (percentage)
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
403.gcc
403.gcc (avg)
403.gcc (avg) (percentage)
403.gcc (max)
403.gcc (max) (percentage)
410.bwaves
410.bwaves (avg)
410.bwaves (avg) (percentage)
410.bwaves (max)
410.bwaves (max) (percentage)
416.gamess (avg) (percentage)
416.gamess (max) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
433.milc
433.milc (avg)
433.milc (avg) (percentage)
433.milc (max)
433.milc (max) (percentage)
434.zeusmp
434.zeusmp (avg)
434.zeusmp (avg) (percentage)
434.zeusmp (max)
434.zeusmp (max) (percentage)
435.gromacs
435.gromacs (avg)
435.gromacs (avg) (percentage)
435.gromacs (max)
435.gromacs (max) (percentage)
436.cactusADM
436.cactusADM (avg)
436.cactusADM (avg) (percentage)
436.cactusADM (max)
436.cactusADM (max) (percentage)
437.leslie3d
437.leslie3d (avg)
437.leslie3d (avg) (percentage)
437.leslie3d (max)
437.leslie3d (max) (percentage)
444.namd
444.namd (avg)
444.namd (avg) (percentage)
444.namd (max)
444.namd (max) (percentage)
445.gobmk
445.gobmk (avg)
445.gobmk (avg) (percentage)
445.gobmk (max)
445.gobmk (max) (percentage)
447.dealII
447.dealII (avg)
447.dealII (avg) (percentage)
447.dealII (max)
447.dealII (max) (percentage)
450.soplex
450.soplex (avg)
450.soplex (avg) (percentage)
450.soplex (max)
450.soplex (max) (percentage)
453.povray
453.povray (avg)
453.povray (avg) (percentage)
453.povray (max)
453.povray (max) (percentage)
454.calculix
454.calculix (avg)
454.calculix (avg) (percentage)
454.calculix (max)
454.calculix (max) (percentage)
456.hmmer
456.hmmer (avg)
456.hmmer (avg) (percentage)
456.hmmer (max)
456.hmmer (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
459.GemsFDTD
459.GemsFDTD (avg)
459.GemsFDTD (avg) (percentage)
459.GemsFDTD (max)
459.GemsFDTD (max) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)
464.h264ref
464.h264ref (avg)
464.h264ref (avg) (percentage)
464.h264ref (max)
464.h264ref (max) (percentage)
465.tonto
465.tonto (avg)
465.tonto (avg) (percentage)
465.tonto (max)
465.tonto (max) (percentage)
470.lbm
470.lbm (avg)
470.lbm (avg) (percentage)
470.lbm (max)
470.lbm (max) (percentage)
471.omnetpp
471.omnetpp (avg)
471.omnetpp (avg) (percentage)
471.omnetpp (max)
471.omnetpp (max) (percentage)
473.astar
473.astar (avg)
473.astar (avg) (percentage)
473.astar (max)
473.astar (max) (percentage)
481.wrf
481.wrf (avg)
481.wrf (avg) (percentage)
481.wrf (max)
481.wrf (max) (percentage)
482.sphinx3
482.sphinx3 (avg)
482.sphinx3 (avg) (percentage)
482.sphinx3 (max)
482.sphinx3 (max) (percentage)


Report Time: 0.36s
Name Current %
400.perlbench 1315.000 -
401.bzip2 2853.000 -
403.gcc 51.000 -
410.bwaves 4598.000 -
429.mcf 895.000 -
433.milc 909.000 -
434.zeusmp 2241.000 -
435.gromacs 5701.000 -
436.cactusADM 2302.000 -
437.leslie3d 8936.000 -
444.namd 781.000 -
445.gobmk 4589.000 -
447.dealII 1005.000 -
450.soplex 513.000 -
453.povray 430.000 -
454.calculix 55.000 -
456.hmmer 3124.000 -
458.sjeng 6697.000 -
459.GemsFDTD 5141.000 -
462.libquantum 120.000 -
464.h264ref 5107.000 -
465.tonto 9328.000 -
470.lbm 3386.000 -
471.omnetpp 2041.000 -
473.astar 4791.000 -
481.wrf 4424.000 -
482.sphinx3 647.000 -
Geometric Mean 1623.240 -
Name Current %
400.perlbench 1269265.000 -
401.bzip2 71964.000 -
403.gcc 3793225.000 -
410.bwaves 23437.000 -
429.mcf 10135.000 -
433.milc 107360.000 -
434.zeusmp 322012.000 -
435.gromacs 738960.000 -
436.cactusADM 538318.000 -
437.leslie3d 100921.000 -
444.namd 238674.000 -
445.gobmk 1726113.000 -
447.dealII 480432.000 -
450.soplex 328867.000 -
453.povray 1094231.000 -
454.calculix 1311449.000 -
456.hmmer 156907.000 -
458.sjeng 153795.000 -
459.GemsFDTD 396962.000 -
462.libquantum 21893.000 -
464.h264ref 795354.000 -
465.tonto 3072037.000 -
470.lbm 11043.000 -
471.omnetpp 589089.000 -
473.astar 30280.000 -
481.wrf 5939898.000 -
482.sphinx3 156991.000 -
Geometric Mean 278299.800 -
Name Current %
400.perlbench 17.000 -
400.perlbench (avg) 17.000 -
400.perlbench (avg) (percentage) 1.340 -
400.perlbench (max) 16.000 -
400.perlbench (max) (percentage) 1.220 -
401.bzip2 43.000 -
401.bzip2 (avg) 43.000 -
401.bzip2 (avg) (percentage) 1.510 -
401.bzip2 (max) 49.000 -
401.bzip2 (max) (percentage) 1.740 -
403.gcc 4.000 -
403.gcc (avg) 4.000 -
403.gcc (avg) (percentage) 8.020 -
403.gcc (max) 2.000 -
403.gcc (max) (percentage) 4.240 -
410.bwaves 63.000 -
410.bwaves (avg) 63.000 -
410.bwaves (avg) (percentage) 1.390 -
410.bwaves (max) 55.000 -
410.bwaves (max) (percentage) 1.200 -
416.gamess (avg) (percentage) 0.170 -
416.gamess (max) (percentage) 0.140 -
429.mcf 70.000 -
429.mcf (avg) 70.000 -
429.mcf (avg) (percentage) 7.860 -
429.mcf (max) 156.000 -
429.mcf (max) (percentage) 17.530 -
433.milc 10.000 -
433.milc (avg) 10.000 -
433.milc (avg) (percentage) 1.170 -
433.milc (max) 9.000 -
433.milc (max) (percentage) 1.000 -
434.zeusmp 23.000 -
434.zeusmp (avg) 23.000 -
434.zeusmp (avg) (percentage) 1.050 -
434.zeusmp (max) 8.000 -
434.zeusmp (max) (percentage) 0.370 -
435.gromacs 148.000 -
435.gromacs (avg) 148.000 -
435.gromacs (avg) (percentage) 2.600 -
435.gromacs (max) 230.000 -
435.gromacs (max) (percentage) 4.050 -
436.cactusADM 9.000 -
436.cactusADM (avg) 9.000 -
436.cactusADM (avg) (percentage) 0.410 -
436.cactusADM (max) 5.000 -
436.cactusADM (max) (percentage) 0.260 -
437.leslie3d 465.000 -
437.leslie3d (avg) 465.000 -
437.leslie3d (avg) (percentage) 5.210 -
437.leslie3d (max) 412.000 -
437.leslie3d (max) (percentage) 4.620 -
444.namd 6.000 -
444.namd (avg) 6.000 -
444.namd (avg) (percentage) 0.780 -
444.namd (max) 16.000 -
444.namd (max) (percentage) 2.100 -
445.gobmk 44.000 -
445.gobmk (avg) 44.000 -
445.gobmk (avg) (percentage) 0.960 -
445.gobmk (max) 62.000 -
445.gobmk (max) (percentage) 1.370 -
447.dealII 14.000 -
447.dealII (avg) 14.000 -
447.dealII (avg) (percentage) 1.460 -
447.dealII (max) 13.000 -
447.dealII (max) (percentage) 1.320 -
450.soplex 13.000 -
450.soplex (avg) 13.000 -
450.soplex (avg) (percentage) 2.690 -
450.soplex (max) 24.000 -
450.soplex (max) (percentage) 4.800 -
453.povray 6.000 -
453.povray (avg) 6.000 -
453.povray (avg) (percentage) 1.530 -
453.povray (max) 20.000 -
453.povray (max) (percentage) 4.810 -
454.calculix 1.000 -
454.calculix (avg) 1.000 -
454.calculix (avg) (percentage) 2.330 -
454.calculix (max) 1.000 -
454.calculix (max) (percentage) 3.120 -
456.hmmer 9.000 -
456.hmmer (avg) 9.000 -
456.hmmer (avg) (percentage) 0.300 -
456.hmmer (max) 8.000 -
456.hmmer (max) (percentage) 0.270 -
458.sjeng 38.000 -
458.sjeng (avg) 38.000 -
458.sjeng (avg) (percentage) 0.580 -
458.sjeng (max) 58.000 -
458.sjeng (max) (percentage) 0.880 -
459.GemsFDTD 74.000 -
459.GemsFDTD (avg) 74.000 -
459.GemsFDTD (avg) (percentage) 1.440 -
459.GemsFDTD (max) 229.000 -
459.GemsFDTD (max) (percentage) 4.460 -
462.libquantum 2.000 -
462.libquantum (avg) 2.000 -
462.libquantum (avg) (percentage) 1.730 -
462.libquantum (max) 1.000 -
462.libquantum (max) (percentage) 0.840 -
462.libquantum (unexplained diff vs previous) 1.000 -
462.libquantum (unexplained diff vs previous) (percentage) 0.830 -
464.h264ref 34.000 -
464.h264ref (avg) 34.000 -
464.h264ref (avg) (percentage) 0.670 -
464.h264ref (max) 37.000 -
464.h264ref (max) (percentage) 0.730 -
465.tonto 84.000 -
465.tonto (avg) 84.000 -
465.tonto (avg) (percentage) 0.910 -
465.tonto (max) 117.000 -
465.tonto (max) (percentage) 1.260 -
470.lbm 33.000 -
470.lbm (avg) 33.000 -
470.lbm (avg) (percentage) 0.990 -
470.lbm (max) 131.000 -
470.lbm (max) (percentage) 3.890 -
470.lbm (unexplained diff vs previous) 137.000 -
470.lbm (unexplained diff vs previous) (percentage) 4.050 -
471.omnetpp 26.000 -
471.omnetpp (avg) 26.000 -
471.omnetpp (avg) (percentage) 1.320 -
471.omnetpp (max) 14.000 -
471.omnetpp (max) (percentage) 0.720 -
473.astar 57.000 -
473.astar (avg) 57.000 -
473.astar (avg) (percentage) 1.190 -
473.astar (max) 36.000 -
473.astar (max) (percentage) 0.770 -
473.astar (unexplained diff vs previous) 4.000 -
473.astar (unexplained diff vs previous) (percentage) 0.080 -
481.wrf 53.000 -
481.wrf (avg) 53.000 -
481.wrf (avg) (percentage) 1.200 -
481.wrf (max) 80.000 -
481.wrf (max) (percentage) 1.810 -
482.sphinx3 11.000 -
482.sphinx3 (avg) 11.000 -
482.sphinx3 (avg) (percentage) 1.820 -
482.sphinx3 (max) 32.000 -
482.sphinx3 (max) (percentage) 5.000 -
Geometric Mean 7.108 -