Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=5764bd565a9ca570e330c44c32cdbf1dce212c02 (unchanged)
git_gcc https://github.com/gcc-mirror/gcc/commit/55e94561e97ed0bce4774aa1c6b5d5d82209a379 (+ 1 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=d370155b9ab73d0c45bf968b7a9c823f4697a505 (unchanged)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=c31318e1020b48610ab9b22ea7cf8fa0b22da882 (unchanged)
regression GNU-1055
test_url https://ci.linaro.org/job/tcwg_bmk-code_vect-spec2k6--gnu-aarch64-master-O3-build/188/
Filter

gnu-aarch64-master-O3 test results

Run Order Start Time Duration
Current 0188 (basepoints/gcc-14-06033-g55e94561e97) 2024-02-23T10:46:41 0:00:00
Previous 0188 (basepoints/gcc-14-06033-g55e94561e97) 2024-02-23T10:46:41 0:00:00
Baseline 0001 (4-changed-components) 2023-03-07T16:12:14 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 0 30
Performance Improvements 0 6
Added Tests 2 137
Unchanged Tests 1186 1015
Total Tests 1188

Added Tests - sample variability
444.namd (unexplained diff vs previous)
444.namd (unexplained diff vs previous) (percentage)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
433.milc 9.69% 135823.000 148991.000 - 0.00% -
437.leslie3d 9.12% 109542.000 119534.000 - 0.00% -
429.mcf 8.77% 12224.000 13296.000 - 0.00% -
410.bwaves 7.75% 24460.000 26356.000 - 0.00% -
436.cactusADM 5.17% 853781.000 897890.000 - 0.00% -
465.tonto 4.19% 3968188.000 4134504.000 - 0.00% -
473.astar 3.04% 41933.000 43209.000 - 0.00% -
434.zeusmp 2.82% 308615.000 317307.000 - 0.00% -
447.dealII 2.73% 3212233.000 3299888.000 - 0.00% -
453.povray 2.03% 1000090.000 1020386.000 - 0.00% -
462.libquantum 1.61% 40624.000 41280.000 - 0.00% -
450.soplex 1.30% 425268.000 430795.000 - 0.00% -
403.gcc 1.29% 3487708.000 3532852.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
403.gcc 10.00% 50.000 55.000 - 0.00% -
471.omnetpp 6.41% 2341.000 2491.000 - 0.00% -
473.astar 6.36% 4651.000 4947.000 - 0.00% -
462.libquantum 5.13% 78.000 82.000 - 0.00% -
470.lbm 3.18% 3274.000 3378.000 - 0.00% -
482.sphinx3 3.06% 752.000 775.000 - 0.00% -
429.mcf 3.05% 2000.000 2061.000 - 0.00% -
435.gromacs 2.83% 4949.000 5089.000 - 0.00% -
465.tonto 2.59% 7891.000 8095.000 - 0.00% -
456.hmmer 2.13% 1928.000 1969.000 - 0.00% -
400.perlbench 1.95% 1383.000 1410.000 - 0.00% -
445.gobmk 1.94% 4640.000 4730.000 - 0.00% -
464.h264ref 1.70% 3931.000 3998.000 - 0.00% -
459.GemsFDTD 1.39% 4314.000 4374.000 - 0.00% -
450.soplex 1.29% 541.000 548.000 - 0.00% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -13.79% 29.000 25.000 - 0.00% -
nb_execution_successful -13.79% 29.000 25.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
436.cactusADM -4.96% 1654.000 1572.000 - 0.00% -
433.milc -4.91% 1059.000 1007.000 - 0.00% -
444.namd -1.73% 635.000 624.000 - 0.00% -
434.zeusmp -1.59% 1759.000 1731.000 - 0.00% -
453.povray -1.20% 418.000 413.000 - 0.00% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 13.79% 29.000 33.000 - 0.00% -

Added Tests - sample variability
400.perlbench
400.perlbench (avg)
400.perlbench (avg) (percentage)
400.perlbench (max)
400.perlbench (max) (percentage)
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
403.gcc
403.gcc (avg)
403.gcc (avg) (percentage)
403.gcc (max)
403.gcc (max) (percentage)
403.gcc (unexplained diff vs previous)
403.gcc (unexplained diff vs previous) (percentage)
410.bwaves
410.bwaves (avg)
410.bwaves (avg) (percentage)
410.bwaves (max)
410.bwaves (max) (percentage)
416.gamess (avg) (percentage)
416.gamess (max) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
433.milc
433.milc (avg)
433.milc (avg) (percentage)
433.milc (max)
433.milc (max) (percentage)
434.zeusmp
434.zeusmp (avg)
434.zeusmp (avg) (percentage)
434.zeusmp (max)
434.zeusmp (max) (percentage)
435.gromacs
435.gromacs (avg)
435.gromacs (avg) (percentage)
435.gromacs (max)
435.gromacs (max) (percentage)
436.cactusADM
436.cactusADM (avg)
436.cactusADM (avg) (percentage)
436.cactusADM (max)
436.cactusADM (max) (percentage)
437.leslie3d
437.leslie3d (avg)
437.leslie3d (avg) (percentage)
437.leslie3d (max)
437.leslie3d (max) (percentage)
444.namd
444.namd (avg)
444.namd (avg) (percentage)
444.namd (max)
444.namd (max) (percentage)
444.namd (unexplained diff vs previous)
444.namd (unexplained diff vs previous) (percentage)
445.gobmk
445.gobmk (avg)
445.gobmk (avg) (percentage)
445.gobmk (max)
445.gobmk (max) (percentage)
447.dealII
447.dealII (avg)
447.dealII (avg) (percentage)
447.dealII (max)
447.dealII (max) (percentage)
450.soplex
450.soplex (avg)
450.soplex (avg) (percentage)
450.soplex (max)
450.soplex (max) (percentage)
453.povray
453.povray (avg)
453.povray (avg) (percentage)
453.povray (max)
453.povray (max) (percentage)
454.calculix (avg) (percentage)
454.calculix (max) (percentage)
456.hmmer
456.hmmer (avg)
456.hmmer (avg) (percentage)
456.hmmer (max)
456.hmmer (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
459.GemsFDTD
459.GemsFDTD (avg)
459.GemsFDTD (avg) (percentage)
459.GemsFDTD (max)
459.GemsFDTD (max) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)
464.h264ref
464.h264ref (avg)
464.h264ref (avg) (percentage)
464.h264ref (max)
464.h264ref (max) (percentage)
465.tonto
465.tonto (avg)
465.tonto (avg) (percentage)
465.tonto (max)
465.tonto (max) (percentage)
470.lbm
470.lbm (avg)
470.lbm (avg) (percentage)
470.lbm (max)
470.lbm (max) (percentage)
471.omnetpp
471.omnetpp (avg)
471.omnetpp (avg) (percentage)
471.omnetpp (max)
471.omnetpp (max) (percentage)
473.astar
473.astar (avg)
473.astar (avg) (percentage)
473.astar (max)
473.astar (max) (percentage)
481.wrf (avg) (percentage)
481.wrf (max) (percentage)
482.sphinx3
482.sphinx3 (avg)
482.sphinx3 (avg) (percentage)
482.sphinx3 (max)
482.sphinx3 (max) (percentage)
483.xalancbmk (avg) (percentage)
483.xalancbmk (max) (percentage)


Report Time: 0.36s
Name Current %
400.perlbench 1410.000 -
401.bzip2 2705.000 -
403.gcc 55.000 -
410.bwaves 4270.000 -
429.mcf 2061.000 -
433.milc 1007.000 -
434.zeusmp 1731.000 -
435.gromacs 5089.000 -
436.cactusADM 1572.000 -
437.leslie3d 6862.000 -
444.namd 624.000 -
445.gobmk 4730.000 -
447.dealII 1337.000 -
450.soplex 548.000 -
453.povray 413.000 -
456.hmmer 1969.000 -
458.sjeng 6442.000 -
459.GemsFDTD 4374.000 -
462.libquantum 82.000 -
464.h264ref 3998.000 -
465.tonto 8095.000 -
470.lbm 3378.000 -
471.omnetpp 2491.000 -
473.astar 4947.000 -
482.sphinx3 775.000 -
Geometric Mean 1717.864 -
Name Current %
400.perlbench 1292612.000 -
401.bzip2 83969.000 -
403.gcc 3532852.000 -
410.bwaves 26356.000 -
429.mcf 13296.000 -
433.milc 148991.000 -
434.zeusmp 317307.000 -
435.gromacs 950630.000 -
436.cactusADM 897890.000 -
437.leslie3d 119534.000 -
444.namd 238454.000 -
445.gobmk 1676695.000 -
447.dealII 3299888.000 -
450.soplex 430795.000 -
453.povray 1020386.000 -
456.hmmer 324407.000 -
458.sjeng 165271.000 -
459.GemsFDTD 370648.000 -
462.libquantum 41280.000 -
464.h264ref 733586.000 -
465.tonto 4134504.000 -
470.lbm 12693.000 -
471.omnetpp 687904.000 -
473.astar 43209.000 -
482.sphinx3 202912.000 -
Geometric Mean 297986.334 -
Name Current %
400.perlbench 22.000 -
400.perlbench (avg) 22.000 -
400.perlbench (avg) (percentage) 1.620 -
400.perlbench (max) 14.000 -
400.perlbench (max) (percentage) 1.000 -
400.perlbench (unexplained diff vs previous) 14.000 -
400.perlbench (unexplained diff vs previous) (percentage) 0.990 -
401.bzip2 61.000 -
401.bzip2 (avg) 61.000 -
401.bzip2 (avg) (percentage) 2.290 -
401.bzip2 (max) 255.000 -
401.bzip2 (max) (percentage) 9.460 -
401.bzip2 (unexplained diff vs previous) 82.000 -
401.bzip2 (unexplained diff vs previous) (percentage) 3.030 -
403.gcc 2.000 -
403.gcc (avg) 2.000 -
403.gcc (avg) (percentage) 3.750 -
403.gcc (max) 3.000 -
403.gcc (max) (percentage) 6.780 -
403.gcc (unexplained diff vs previous) 4.000 -
403.gcc (unexplained diff vs previous) (percentage) 7.270 -
410.bwaves 44.000 -
410.bwaves (avg) 44.000 -
410.bwaves (avg) (percentage) 1.050 -
410.bwaves (max) 37.000 -
410.bwaves (max) (percentage) 0.870 -
410.bwaves (unexplained diff vs previous) 7.000 -
410.bwaves (unexplained diff vs previous) (percentage) 0.160 -
416.gamess (avg) (percentage) 0.210 -
416.gamess (max) (percentage) 0.520 -
429.mcf 151.000 -
429.mcf (avg) 151.000 -
429.mcf (avg) (percentage) 7.370 -
429.mcf (max) 219.000 -
429.mcf (max) (percentage) 10.630 -
429.mcf (unexplained diff vs previous) 198.000 -
429.mcf (unexplained diff vs previous) (percentage) 9.610 -
433.milc 10.000 -
433.milc (avg) 10.000 -
433.milc (avg) (percentage) 1.090 -
433.milc (max) 11.000 -
433.milc (max) (percentage) 1.180 -
433.milc (unexplained diff vs previous) 7.000 -
433.milc (unexplained diff vs previous) (percentage) 0.700 -
434.zeusmp 19.000 -
434.zeusmp (avg) 19.000 -
434.zeusmp (avg) (percentage) 1.120 -
434.zeusmp (max) 20.000 -
434.zeusmp (max) (percentage) 1.160 -
434.zeusmp (unexplained diff vs previous) 20.000 -
434.zeusmp (unexplained diff vs previous) (percentage) 1.160 -
435.gromacs 119.000 -
435.gromacs (avg) 119.000 -
435.gromacs (avg) (percentage) 2.340 -
435.gromacs (max) 174.000 -
435.gromacs (max) (percentage) 3.420 -
435.gromacs (unexplained diff vs previous) 180.000 -
435.gromacs (unexplained diff vs previous) (percentage) 3.540 -
436.cactusADM 9.000 -
436.cactusADM (avg) 9.000 -
436.cactusADM (avg) (percentage) 0.590 -
436.cactusADM (max) 7.000 -
436.cactusADM (max) (percentage) 0.450 -
436.cactusADM (unexplained diff vs previous) 7.000 -
436.cactusADM (unexplained diff vs previous) (percentage) 0.450 -
437.leslie3d 446.000 -
437.leslie3d (avg) 446.000 -
437.leslie3d (avg) (percentage) 6.510 -
437.leslie3d (max) 1115.000 -
437.leslie3d (max) (percentage) 16.250 -
437.leslie3d (unexplained diff vs previous) 179.000 -
437.leslie3d (unexplained diff vs previous) (percentage) 2.610 -
444.namd 4.000 -
444.namd (avg) 4.000 -
444.namd (avg) (percentage) 0.750 -
444.namd (max) 3.000 -
444.namd (max) (percentage) 0.640 -
444.namd (unexplained diff vs previous) 0.000 -
444.namd (unexplained diff vs previous) (percentage) 0.000 -
445.gobmk 46.000 -
445.gobmk (avg) 46.000 -
445.gobmk (avg) (percentage) 0.990 -
445.gobmk (max) 17.000 -
445.gobmk (max) (percentage) 0.380 -
445.gobmk (unexplained diff vs previous) 18.000 -
445.gobmk (unexplained diff vs previous) (percentage) 0.380 -
447.dealII 16.000 -
447.dealII (avg) 16.000 -
447.dealII (avg) (percentage) 1.220 -
447.dealII (max) 16.000 -
447.dealII (max) (percentage) 1.210 -
447.dealII (unexplained diff vs previous) 12.000 -
447.dealII (unexplained diff vs previous) (percentage) 0.900 -
450.soplex 12.000 -
450.soplex (avg) 12.000 -
450.soplex (avg) (percentage) 2.360 -
450.soplex (max) 9.000 -
450.soplex (max) (percentage) 1.670 -
450.soplex (unexplained diff vs previous) 9.000 -
450.soplex (unexplained diff vs previous) (percentage) 1.640 -
453.povray 5.000 -
453.povray (avg) 5.000 -
453.povray (avg) (percentage) 1.330 -
453.povray (max) 7.000 -
453.povray (max) (percentage) 1.930 -
453.povray (unexplained diff vs previous) 5.000 -
453.povray (unexplained diff vs previous) (percentage) 1.210 -
454.calculix (avg) (percentage) 2.830 -
454.calculix (max) (percentage) 1.110 -
456.hmmer 12.000 -
456.hmmer (avg) 12.000 -
456.hmmer (avg) (percentage) 0.660 -
456.hmmer (max) 19.000 -
456.hmmer (max) (percentage) 1.010 -
456.hmmer (unexplained diff vs previous) 20.000 -
456.hmmer (unexplained diff vs previous) (percentage) 1.020 -
458.sjeng 38.000 -
458.sjeng (avg) 38.000 -
458.sjeng (avg) (percentage) 0.590 -
458.sjeng (max) 27.000 -
458.sjeng (max) (percentage) 0.420 -
458.sjeng (unexplained diff vs previous) 24.000 -
458.sjeng (unexplained diff vs previous) (percentage) 0.370 -
459.GemsFDTD 40.000 -
459.GemsFDTD (avg) 40.000 -
459.GemsFDTD (avg) (percentage) 0.930 -
459.GemsFDTD (max) 52.000 -
459.GemsFDTD (max) (percentage) 1.200 -
459.GemsFDTD (unexplained diff vs previous) 53.000 -
459.GemsFDTD (unexplained diff vs previous) (percentage) 1.210 -
462.libquantum 1.000 -
462.libquantum (avg) 1.000 -
462.libquantum (avg) (percentage) 1.750 -
462.libquantum (max) 1.000 -
462.libquantum (max) (percentage) 1.240 -
462.libquantum (unexplained diff vs previous) 1.000 -
462.libquantum (unexplained diff vs previous) (percentage) 1.220 -
464.h264ref 34.000 -
464.h264ref (avg) 34.000 -
464.h264ref (avg) (percentage) 0.860 -
464.h264ref (max) 26.000 -
464.h264ref (max) (percentage) 0.660 -
464.h264ref (unexplained diff vs previous) 11.000 -
464.h264ref (unexplained diff vs previous) (percentage) 0.280 -
465.tonto 65.000 -
465.tonto (avg) 65.000 -
465.tonto (avg) (percentage) 0.810 -
465.tonto (max) 79.000 -
465.tonto (max) (percentage) 0.980 -
465.tonto (unexplained diff vs previous) 80.000 -
465.tonto (unexplained diff vs previous) (percentage) 0.990 -
470.lbm 27.000 -
470.lbm (avg) 27.000 -
470.lbm (avg) (percentage) 0.820 -
470.lbm (max) 16.000 -
470.lbm (max) (percentage) 0.500 -
470.lbm (unexplained diff vs previous) 3.000 -
470.lbm (unexplained diff vs previous) (percentage) 0.090 -
471.omnetpp 54.000 -
471.omnetpp (avg) 54.000 -
471.omnetpp (avg) (percentage) 2.180 -
471.omnetpp (max) 64.000 -
471.omnetpp (max) (percentage) 2.580 -
471.omnetpp (unexplained diff vs previous) 66.000 -
471.omnetpp (unexplained diff vs previous) (percentage) 2.650 -
473.astar 96.000 -
473.astar (avg) 96.000 -
473.astar (avg) (percentage) 1.950 -
473.astar (max) 50.000 -
473.astar (max) (percentage) 1.020 -
473.astar (unexplained diff vs previous) 10.000 -
473.astar (unexplained diff vs previous) (percentage) 0.200 -
481.wrf (avg) (percentage) 1.850 -
481.wrf (max) (percentage) 1.600 -
482.sphinx3 9.000 -
482.sphinx3 (avg) 9.000 -
482.sphinx3 (avg) (percentage) 1.230 -
482.sphinx3 (max) 7.000 -
482.sphinx3 (max) (percentage) 1.020 -
482.sphinx3 (unexplained diff vs previous) 8.000 -
482.sphinx3 (unexplained diff vs previous) (percentage) 1.030 -
483.xalancbmk (avg) (percentage) 1.550 -
483.xalancbmk (max) (percentage) 2.930 -
Geometric Mean 5.320 -11.33%