Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=49c3ed081fed6b8e2b48fdc48f805f11e4589514 (unchanged)
git_gcc https://github.com/gcc-mirror/gcc/commit/7d37c7f67c1bb75f85ad0c07bfff51ca579e1476 (unchanged)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=5652e12cce80825297c3e0666991deb10310343c (unchanged)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=85b49e2cff27a81badba95e274bf47402836a9cd (+ 191 commits)
test_url https://ci.linaro.org/job/tcwg_bmk_ci_gnu-build-tcwg_bmk_apm-gnu-master-aarch64-spec2k6-Os_LTO/301/
Filter

gnu-aarch64-master-Os_LTO test results

Run Order Start Time Duration
Current 0301 (v5.19.9-39053-g85b49e2cff27) 2022-09-15T10:57:22 0:00:00
Previous 0301 (4-changed-components) 2024-09-28T06:29:19 0:00:00
Baseline 0001 (4-changed-components) 2023-02-20T22:48:24 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 41 31
Performance Improvements 5 1
Added Tests 10 0
Unchanged Tests 1180 1204
Total Tests 1236

Performance Regressions - Code Size Δ Previous Current σ Δ (B) σ (B)
437.leslie3d 8.43% 54786.000 59403.000 - -0.13% -
459.GemsFDTD 6.53% 232732.000 247940.000 - 1.31% -
434.zeusmp 4.93% 146667.000 153897.000 - 1.22% -
450.soplex 4.20% 202582.000 211092.000 - 2.93% -
435.gromacs 2.13% 489749.000 500203.000 - 0.19% -
464.h264ref 2.02% 379544.000 387228.000 - -0.13% -
453.povray 1.87% 649829.000 661959.000 - 0.09% -
410.bwaves 1.85% 16464.000 16768.000 - 0.05% -
470.lbm 1.72% 9547.000 9711.000 - 0.21% -
447.dealII 1.64% 307892.000 312944.000 - 0.43% -
471.omnetpp 1.49% 475384.000 482480.000 - 0.93% -
444.namd 1.36% 185768.000 188301.000 - -0.04% -
436.cactusADM 1.29% 348331.000 352831.000 - -0.02% -
456.hmmer 1.28% 107255.000 108631.000 - -0.06% -
433.milc 1.19% 60509.000 61230.000 - -0.25% -
401.bzip2 1.15% 43719.000 44221.000 - -0.03% -
482.sphinx3 1.05% 111659.000 112831.000 - -0.02% -

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
462.libquantum 8255.80% 138.000 11531.000 - 8136.43% -
482.sphinx3 3440.43% 836.000 29598.000 - 3032.06% -
450.soplex 2656.78% 583.000 16072.000 - 2734.57% -
444.namd 1147.62% 777.000 9694.000 - 1197.72% -
433.milc 1073.33% 1140.000 13376.000 - 1062.12% -
453.povray 1060.51% 552.000 6406.000 - 1071.12% -
436.cactusADM 766.24% 2103.000 18217.000 - 774.56% -
429.mcf 736.70% 2068.000 17303.000 - 1115.10% -
400.perlbench 622.73% 1540.000 11130.000 - 569.27% -
447.dealII 446.30% 1637.000 8943.000 - 418.74% -
434.zeusmp 445.67% 2527.000 13789.000 - 448.49% -
401.bzip2 403.68% 2960.000 14909.000 - 406.94% -
459.GemsFDTD 335.70% 5339.000 23262.000 - 276.83% -
471.omnetpp 303.25% 2681.000 10811.000 - 296.88% -
456.hmmer 290.56% 2882.000 11256.000 - 290.56% -
470.lbm 225.57% 3785.000 12323.000 - 225.32% -
473.astar 176.93% 5114.000 14162.000 - 176.17% -
410.bwaves 140.62% 5920.000 14245.000 - 152.03% -
464.h264ref 138.89% 5762.000 13765.000 - 138.93% -
445.gobmk 135.19% 4973.000 11696.000 - 132.85% -
435.gromacs 116.30% 7234.000 15647.000 - 115.26% -
458.sjeng 91.13% 7361.000 14069.000 - 85.93% -
437.leslie3d 31.01% 11202.000 14676.000 - 26.08% -

Performance Regressions - Score Δ Previous Current σ Δ (B) σ (B)
nb_total_tests -14.71% 34.000 29.000 - 0.00% -

Performance Improvements - Code Size Δ Previous Current σ Δ (B) σ (B)
458.sjeng -2.21% 106376.000 104028.000 - -0.02% -
465.tonto -1.37% 1972539.000 1945443.000 - -0.04% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
465.tonto -21.54% 11111.000 8718.000 - -20.32% -

Performance Improvements - Score Δ Previous Current σ Δ (B) σ (B)
nb_compile_successful 20.83% 24.000 29.000 - 0.00% -
nb_execution_successful 20.83% 24.000 29.000 - 0.00% -

Added Tests - Code Size
403.gcc
416.gamess
454.calculix
481.wrf
483.xalancbmk

Added Tests - Execution
403.gcc
416.gamess
454.calculix
481.wrf
483.xalancbmk

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
450.soplex 2.93% 205081.000 211092.000 - 4.20% -
459.GemsFDTD 1.31% 244728.000 247940.000 - 6.53% -
434.zeusmp 1.22% 152037.000 153897.000 - 4.93% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
454.calculix 43675.81% 62.000 27141.000 - 0.00% -
403.gcc 16191.07% 56.000 9123.000 - 0.00% -
462.libquantum 8136.43% 140.000 11531.000 - 8255.80% -
482.sphinx3 3032.06% 945.000 29598.000 - 3440.43% -
450.soplex 2734.57% 567.000 16072.000 - 2656.78% -
444.namd 1197.72% 747.000 9694.000 - 1147.62% -
429.mcf 1115.10% 1424.000 17303.000 - 736.70% -
453.povray 1071.12% 547.000 6406.000 - 1060.51% -
433.milc 1062.12% 1151.000 13376.000 - 1073.33% -
436.cactusADM 774.56% 2083.000 18217.000 - 766.24% -
400.perlbench 569.27% 1663.000 11130.000 - 622.73% -
434.zeusmp 448.49% 2514.000 13789.000 - 445.67% -
447.dealII 418.74% 1724.000 8943.000 - 446.30% -
401.bzip2 406.94% 2941.000 14909.000 - 403.68% -
471.omnetpp 296.88% 2724.000 10811.000 - 303.25% -
456.hmmer 290.56% 2882.000 11256.000 - 290.56% -
459.GemsFDTD 276.83% 6173.000 23262.000 - 335.70% -
470.lbm 225.32% 3788.000 12323.000 - 225.57% -
483.xalancbmk 202.17% 3818.000 11537.000 - 0.00% -
481.wrf 193.19% 5534.000 16225.000 - 0.00% -
473.astar 176.17% 5128.000 14162.000 - 176.93% -
410.bwaves 152.03% 5652.000 14245.000 - 140.62% -
464.h264ref 138.93% 5761.000 13765.000 - 138.89% -
445.gobmk 132.85% 5023.000 11696.000 - 135.19% -
435.gromacs 115.26% 7269.000 15647.000 - 116.30% -
458.sjeng 85.93% 7567.000 14069.000 - 91.13% -
416.gamess 70.29% 12465.000 21227.000 - 0.00% -
437.leslie3d 26.08% 11640.000 14676.000 - 31.01% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
465.tonto -20.32% 10941.000 8718.000 - -21.54% -


Report Time: 0.37s
Name Current %
400.perlbench 11130.000 622.73%
401.bzip2 14909.000 403.68%
403.gcc 9123.000 -
410.bwaves 14245.000 140.62%
416.gamess 21227.000 -
429.mcf 17303.000 736.70%
433.milc 13376.000 1073.33%
434.zeusmp 13789.000 445.67%
435.gromacs 15647.000 116.30%
436.cactusADM 18217.000 766.24%
437.leslie3d 14676.000 31.01%
444.namd 9694.000 1147.62%
445.gobmk 11696.000 135.19%
447.dealII 8943.000 446.30%
450.soplex 16072.000 2656.78%
453.povray 6406.000 1060.51%
454.calculix 27141.000 -
456.hmmer 11256.000 290.56%
458.sjeng 14069.000 91.13%
459.GemsFDTD 23262.000 335.70%
462.libquantum 11531.000 8255.80%
464.h264ref 13765.000 138.89%
465.tonto 8718.000 -21.54%
470.lbm 12323.000 225.57%
471.omnetpp 10811.000 303.25%
473.astar 14162.000 176.93%
481.wrf 16225.000 -
482.sphinx3 29598.000 3440.43%
483.xalancbmk 11537.000 -
Geometric Mean 13700.152 456.83%
Name Current %
400.perlbench 897104.000 -
401.bzip2 44221.000 1.15%
403.gcc 2460192.000 -
410.bwaves 16768.000 1.85%
416.gamess 5742349.000 -
429.mcf 9123.000 -
433.milc 61230.000 1.19%
434.zeusmp 153897.000 4.93%
435.gromacs 500203.000 2.13%
436.cactusADM 352831.000 1.29%
437.leslie3d 59403.000 8.43%
444.namd 188301.000 1.36%
445.gobmk 1377598.000 -
447.dealII 312944.000 1.64%
450.soplex 211092.000 4.20%
453.povray 661959.000 1.87%
454.calculix 844607.000 -
456.hmmer 108631.000 1.28%
458.sjeng 104028.000 -2.21%
459.GemsFDTD 247940.000 6.53%
462.libquantum 16045.000 -
464.h264ref 387228.000 2.02%
465.tonto 1945443.000 -1.37%
470.lbm 9711.000 1.72%
471.omnetpp 482480.000 1.49%
473.astar 22952.000 -
481.wrf 1962288.000 -
482.sphinx3 112831.000 1.05%
483.xalancbmk 2342185.000 -
Geometric Mean 224502.528 64.13%
Name Current %
nb_compile_successful 29.000 20.83%
nb_execution_successful 29.000 20.83%
nb_total_tests 29.000 -14.71%
Geometric Mean 29.000 7.59%