Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=f35cc0decdd7595b34daa30803038342864b7888 (unchanged)
git_gcc https://github.com/gcc-mirror/gcc/commit/73f7109ffb159302e9d8f70948a5b43b046b38bc (+ 9 commits)
git_gdb https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=f35cc0decdd7595b34daa30803038342864b7888 (unchanged)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=a26238d3ca21fda6d7d41b4d56541fcf4546fbe7 (unchanged)
git_linux https://git.linaro.org/kernel-org/linux.git/commit/?id=ac9a78681b921877518763ba0e89202254349d1b (unchanged)
git_qemu https://gitlab.com/qemu-project/qemu/commit/792f77f376adef944f9a03e601f6ad90c2f891b2 (unchanged)
test_url https://ci.linaro.org/job/tcwg_gnu_cross_check_gcc--master-arm-build/258/
Filter

master-arm test results

Run Order Start Time Duration
Current 0258 (basepoints/gcc-14-00591-g73f7109ffb15) 2023-05-08T13:31:56 0:00:00
Previous 0278 (6-changed-components) 2023-05-10T06:46:26 0:00:00
Baseline 0067 (6-changed-components) 2023-04-19T10:48:24 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 12 12
Performance Improvements 0 5
Added Tests 46 46
Unchanged Tests 1427 1422
Total Tests 1485

Performance Regressions - ERROR Δ Previous Current σ Δ (B) σ (B)
TOTAL.ERROR 7400.00% 1.000 75.000 - 7400.00% -
gcc.ERROR 7400.00% 1.000 75.000 - 7400.00% -

Performance Regressions - PASS Δ Previous Current σ Δ (B) σ (B)
gcc.PASS -3.75% 168087.000 161790.000 - -3.54% -
TOTAL.PASS -1.28% 498837.000 492439.000 - -1.11% -

Performance Regressions - UNRESOLVED Δ Previous Current σ Δ (B) σ (B)
gcc.UNRESOLVED 58.04% 143.000 226.000 - 58.04% -
TOTAL.UNRESOLVED 28.33% 293.000 376.000 - 17.50% -

Performance Regressions - all Δ Previous Current σ Δ (B) σ (B)
TOTAL.all -1.21% 524279.000 517946.000 - -1.04% -

Performance Regressions - bad Δ Previous Current σ Δ (B) σ (B)
gcc.bad 64.08% 245.000 402.000 - 62.75% -
TOTAL.bad 25.78% 609.000 766.000 - 15.36% -

Performance Regressions - fails Δ Previous Current σ Δ (B) σ (B)
TOTAL.fails 16.22% 524.000 609.000 - 5.55% -

Performance Regressions - good Δ Previous Current σ Δ (B) σ (B)
gcc.good -3.60% 177106.000 170737.000 - -3.40% -
TOTAL.good -1.24% 523670.000 517180.000 - -1.06% -

Added Tests - ERROR
g++.ERROR
gfortran.ERROR
libatomic.ERROR
libgomp.ERROR
libitm.ERROR
libstdc++.ERROR

Added Tests - FAIL
libatomic.FAIL
libitm.FAIL

Added Tests - KFAIL
TOTAL.KFAIL
g++.KFAIL
gcc.KFAIL
gfortran.KFAIL
libatomic.KFAIL
libgomp.KFAIL
libitm.KFAIL
libstdc++.KFAIL

Added Tests - OTHER
TOTAL.OTHER
g++.OTHER
gcc.OTHER
gfortran.OTHER
libatomic.OTHER
libgomp.OTHER
libitm.OTHER
libstdc++.OTHER

Added Tests - UNRESOLVED
libatomic.UNRESOLVED
libgomp.UNRESOLVED
libitm.UNRESOLVED
libstdc++.UNRESOLVED

Added Tests - UNTESTED
TOTAL.UNTESTED
g++.UNTESTED
gcc.UNTESTED
gfortran.UNTESTED
libatomic.UNTESTED
libgomp.UNTESTED
libitm.UNTESTED
libstdc++.UNTESTED

Added Tests - XFAIL
libatomic.XFAIL

Added Tests - XPASS
gcc.XPASS
gfortran.XPASS
libatomic.XPASS
libgomp.XPASS
libitm.XPASS
libstdc++.XPASS

Added Tests - bad
libatomic.bad
libitm.bad

Added Tests - flaky
TOTAL.flaky

Performance Regressions - ERROR Δ (B) Baseline Current σ (B) Δ σ
TOTAL.ERROR 7400.00% 1.000 75.000 - 7400.00% -
gcc.ERROR 7400.00% 1.000 75.000 - 7400.00% -

Performance Regressions - PASS Δ (B) Baseline Current σ (B) Δ σ
gcc.PASS -3.54% 167730.000 161790.000 - -3.75% -
TOTAL.PASS -1.11% 497942.000 492439.000 - -1.28% -

Performance Regressions - UNRESOLVED Δ (B) Baseline Current σ (B) Δ σ
gcc.UNRESOLVED 58.04% 143.000 226.000 - 58.04% -
TOTAL.UNRESOLVED 17.50% 320.000 376.000 - 28.33% -

Performance Regressions - all Δ (B) Baseline Current σ (B) Δ σ
TOTAL.all -1.04% 523380.000 517946.000 - -1.21% -

Performance Regressions - bad Δ (B) Baseline Current σ (B) Δ σ
gcc.bad 62.75% 247.000 402.000 - 64.08% -
TOTAL.bad 15.36% 664.000 766.000 - 25.78% -

Performance Regressions - fails Δ (B) Baseline Current σ (B) Δ σ
TOTAL.fails 5.55% 577.000 609.000 - 16.22% -

Performance Regressions - good Δ (B) Baseline Current σ (B) Δ σ
gcc.good -3.40% 176752.000 170737.000 - -3.60% -
TOTAL.good -1.06% 522716.000 517180.000 - -1.24% -

Performance Improvements - FAIL Δ (B) Baseline Current σ (B) Δ σ
g++.FAIL -12.26% 212.000 186.000 - 0.00% -
TOTAL.FAIL -8.21% 341.000 313.000 - 0.00% -
gcc.FAIL -1.94% 103.000 101.000 - 0.00% -

Performance Improvements - UNRESOLVED Δ (B) Baseline Current σ (B) Δ σ
g++.UNRESOLVED -15.52% 174.000 147.000 - 0.00% -

Performance Improvements - bad Δ (B) Baseline Current σ (B) Δ σ
g++.bad -13.66% 388.000 335.000 - 0.00% -

Added Tests - ERROR
g++.ERROR
gfortran.ERROR
libatomic.ERROR
libgomp.ERROR
libitm.ERROR
libstdc++.ERROR

Added Tests - FAIL
libatomic.FAIL
libitm.FAIL

Added Tests - KFAIL
TOTAL.KFAIL
g++.KFAIL
gcc.KFAIL
gfortran.KFAIL
libatomic.KFAIL
libgomp.KFAIL
libitm.KFAIL
libstdc++.KFAIL

Added Tests - OTHER
TOTAL.OTHER
g++.OTHER
gcc.OTHER
gfortran.OTHER
libatomic.OTHER
libgomp.OTHER
libitm.OTHER
libstdc++.OTHER

Added Tests - UNRESOLVED
libatomic.UNRESOLVED
libgomp.UNRESOLVED
libitm.UNRESOLVED
libstdc++.UNRESOLVED

Added Tests - UNTESTED
TOTAL.UNTESTED
g++.UNTESTED
gcc.UNTESTED
gfortran.UNTESTED
libatomic.UNTESTED
libgomp.UNTESTED
libitm.UNTESTED
libstdc++.UNTESTED

Added Tests - XFAIL
libatomic.XFAIL

Added Tests - XPASS
gcc.XPASS
gfortran.XPASS
libatomic.XPASS
libgomp.XPASS
libitm.XPASS
libstdc++.XPASS

Added Tests - bad
libatomic.bad
libitm.bad

Added Tests - flaky
TOTAL.flaky


Report Time: 0.33s
Name Current %
TOTAL.PASS 492439.000 -1.28%
g++.PASS 234479.000 -
gcc.PASS 161790.000 -3.75%
gfortran.PASS 66285.000 -
libatomic.PASS 44.000 -
libgomp.PASS 15072.000 -
libitm.PASS 44.000 -
libstdc++.PASS 14725.000 -
Geometric Mean 12323.799 -
Name Current %
TOTAL.FAIL 313.000 -
g++.FAIL 186.000 -
gcc.FAIL 101.000 -
gfortran.FAIL 6.000 -
libatomic.FAIL 0.000 -
libgomp.FAIL 15.000 -
libitm.FAIL 0.000 -
libstdc++.FAIL 5.000 -
Geometric Mean 1.506 -95.95%
Name Current %
TOTAL.XFAIL 3901.000 -
g++.XFAIL 2070.000 -
gcc.XFAIL 1187.000 -
gfortran.XFAIL 251.000 -
libatomic.XFAIL 0.000 -
libgomp.XFAIL 284.000 -
libitm.XFAIL 3.000 -
libstdc++.XFAIL 106.000 -
Geometric Mean 46.465 -84.50%
Name Current %
TOTAL.ERROR 75.000 7400.00%
g++.ERROR 0.000 -
gcc.ERROR 75.000 7400.00%
gfortran.ERROR 0.000 -
libatomic.ERROR 0.000 -
libgomp.ERROR 0.000 -
libitm.ERROR 0.000 -
libstdc++.ERROR 0.000 -
Geometric Mean 0.003 -99.72%
Name Current %
TOTAL.good 517180.000 -1.24%
g++.good 247668.000 -
gcc.good 170737.000 -3.60%
gfortran.good 67062.000 -
libatomic.good 49.000 -
libgomp.good 16032.000 -
libitm.good 48.000 -
libstdc++.good 15584.000 -
Geometric Mean 13089.640 -
bad
Name Current %
TOTAL.bad 766.000 25.78%
g++.bad 335.000 -
gcc.bad 402.000 64.08%
gfortran.bad 9.000 -
libatomic.bad 0.000 -
libgomp.bad 15.000 -
libitm.bad 0.000 -
libstdc++.bad 5.000 -
Geometric Mean 2.266 -96.01%
Name Current %
TOTAL.fails 609.000 16.22%
Geometric Mean 609.000 16.22%
Name Current %
TOTAL.flaky 0.000 -
Geometric Mean 0.000 -
all
Name Current %
TOTAL.all 517946.000 -1.21%
Geometric Mean 517946.000 -1.21%