Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=f35cc0decdd7595b34daa30803038342864b7888 (unchanged)
git_gcc https://github.com/gcc-mirror/gcc/commit/d6654a4be3ba44c0d57be7c8a51d76d9721345e1 (+ 1 commits)
git_gdb https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=f35cc0decdd7595b34daa30803038342864b7888 (unchanged)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=a26238d3ca21fda6d7d41b4d56541fcf4546fbe7 (unchanged)
git_linux https://git.linaro.org/kernel-org/linux.git/commit/?id=ac9a78681b921877518763ba0e89202254349d1b (unchanged)
git_qemu https://gitlab.com/qemu-project/qemu/commit/792f77f376adef944f9a03e601f6ad90c2f891b2 (unchanged)
test_url https://ci.linaro.org/job/tcwg_gnu_cross_check_gcc--master-arm-build/255/
Filter

master-arm test results

Run Order Start Time Duration
Current 0255 (basepoints/gcc-14-00582-gd6654a4be3b) 2023-05-07T23:12:05 0:00:00
Previous 0254 (5-changed-components) 2023-05-07T08:24:46 0:00:00
Baseline 0067 (6-changed-components) 2023-04-19T10:48:24 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 14 12
Performance Improvements 0 5
Added Tests 46 48
Unchanged Tests 1425 1420
Total Tests 1485

Performance Regressions - ERROR Δ Previous Current σ Δ (B) σ (B)
TOTAL.ERROR 7200.00% 1.000 73.000 - 7200.00% -
gcc.ERROR 7200.00% 1.000 73.000 - 7200.00% -

Performance Regressions - FAIL Δ Previous Current σ Δ (B) σ (B)
libstdc++.FAIL 20.00% 5.000 6.000 - 20.00% -

Performance Regressions - PASS Δ Previous Current σ Δ (B) σ (B)
gcc.PASS -3.71% 168020.000 161790.000 - -3.54% -
TOTAL.PASS -1.25% 498665.000 492434.000 - -1.11% -

Performance Regressions - UNRESOLVED Δ Previous Current σ Δ (B) σ (B)
gcc.UNRESOLVED 58.04% 143.000 226.000 - 58.04% -
TOTAL.UNRESOLVED 28.33% 293.000 376.000 - 17.50% -

Performance Regressions - all Δ Previous Current σ Δ (B) σ (B)
TOTAL.all -1.17% 524087.000 517940.000 - 0.00% -

Performance Regressions - bad Δ Previous Current σ Δ (B) σ (B)
gcc.bad 63.27% 245.000 400.000 - 61.94% -
TOTAL.bad 25.62% 609.000 765.000 - 15.21% -
libstdc++.bad 20.00% 5.000 6.000 - 20.00% -

Performance Regressions - fails Δ Previous Current σ Δ (B) σ (B)
TOTAL.fails 16.41% 524.000 610.000 - 0.00% -

Performance Regressions - good Δ Previous Current σ Δ (B) σ (B)
gcc.good -3.56% 177039.000 170737.000 - -3.40% -
TOTAL.good -1.20% 523478.000 517175.000 - -1.06% -

Added Tests - ERROR
g++.ERROR
gfortran.ERROR
libatomic.ERROR
libgomp.ERROR
libitm.ERROR
libstdc++.ERROR

Added Tests - FAIL
libatomic.FAIL
libitm.FAIL

Added Tests - KFAIL
TOTAL.KFAIL
g++.KFAIL
gcc.KFAIL
gfortran.KFAIL
libatomic.KFAIL
libgomp.KFAIL
libitm.KFAIL
libstdc++.KFAIL

Added Tests - OTHER
TOTAL.OTHER
g++.OTHER
gcc.OTHER
gfortran.OTHER
libatomic.OTHER
libgomp.OTHER
libitm.OTHER
libstdc++.OTHER

Added Tests - UNRESOLVED
libatomic.UNRESOLVED
libgomp.UNRESOLVED
libitm.UNRESOLVED
libstdc++.UNRESOLVED

Added Tests - UNTESTED
TOTAL.UNTESTED
g++.UNTESTED
gcc.UNTESTED
gfortran.UNTESTED
libatomic.UNTESTED
libgomp.UNTESTED
libitm.UNTESTED
libstdc++.UNTESTED

Added Tests - XFAIL
libatomic.XFAIL

Added Tests - XPASS
gcc.XPASS
gfortran.XPASS
libatomic.XPASS
libgomp.XPASS
libitm.XPASS
libstdc++.XPASS

Added Tests - bad
libatomic.bad
libitm.bad

Added Tests - flaky
TOTAL.flaky

Performance Regressions - ERROR Δ (B) Baseline Current σ (B) Δ σ
TOTAL.ERROR 7200.00% 1.000 73.000 - 7200.00% -
gcc.ERROR 7200.00% 1.000 73.000 - 7200.00% -

Performance Regressions - FAIL Δ (B) Baseline Current σ (B) Δ σ
libstdc++.FAIL 20.00% 5.000 6.000 - 20.00% -

Performance Regressions - PASS Δ (B) Baseline Current σ (B) Δ σ
gcc.PASS -3.54% 167730.000 161790.000 - -3.71% -
TOTAL.PASS -1.11% 497942.000 492434.000 - -1.25% -

Performance Regressions - UNRESOLVED Δ (B) Baseline Current σ (B) Δ σ
gcc.UNRESOLVED 58.04% 143.000 226.000 - 58.04% -
TOTAL.UNRESOLVED 17.50% 320.000 376.000 - 28.33% -

Performance Regressions - bad Δ (B) Baseline Current σ (B) Δ σ
gcc.bad 61.94% 247.000 400.000 - 63.27% -
libstdc++.bad 20.00% 5.000 6.000 - 20.00% -
TOTAL.bad 15.21% 664.000 765.000 - 25.62% -

Performance Regressions - good Δ (B) Baseline Current σ (B) Δ σ
gcc.good -3.40% 176752.000 170737.000 - -3.56% -
TOTAL.good -1.06% 522716.000 517175.000 - -1.20% -

Performance Improvements - FAIL Δ (B) Baseline Current σ (B) Δ σ
g++.FAIL -12.26% 212.000 186.000 - 0.00% -
TOTAL.FAIL -7.92% 341.000 314.000 - 0.32% -
gcc.FAIL -1.94% 103.000 101.000 - 0.00% -

Performance Improvements - UNRESOLVED Δ (B) Baseline Current σ (B) Δ σ
g++.UNRESOLVED -15.52% 174.000 147.000 - 0.00% -

Performance Improvements - bad Δ (B) Baseline Current σ (B) Δ σ
g++.bad -13.66% 388.000 335.000 - 0.00% -

Added Tests - ERROR
g++.ERROR
gfortran.ERROR
libatomic.ERROR
libgomp.ERROR
libitm.ERROR
libstdc++.ERROR

Added Tests - FAIL
libatomic.FAIL
libitm.FAIL

Added Tests - KFAIL
TOTAL.KFAIL
g++.KFAIL
gcc.KFAIL
gfortran.KFAIL
libatomic.KFAIL
libgomp.KFAIL
libitm.KFAIL
libstdc++.KFAIL

Added Tests - OTHER
TOTAL.OTHER
g++.OTHER
gcc.OTHER
gfortran.OTHER
libatomic.OTHER
libgomp.OTHER
libitm.OTHER
libstdc++.OTHER

Added Tests - UNRESOLVED
libatomic.UNRESOLVED
libgomp.UNRESOLVED
libitm.UNRESOLVED
libstdc++.UNRESOLVED

Added Tests - UNTESTED
TOTAL.UNTESTED
g++.UNTESTED
gcc.UNTESTED
gfortran.UNTESTED
libatomic.UNTESTED
libgomp.UNTESTED
libitm.UNTESTED
libstdc++.UNTESTED

Added Tests - XFAIL
libatomic.XFAIL

Added Tests - XPASS
gcc.XPASS
gfortran.XPASS
libatomic.XPASS
libgomp.XPASS
libitm.XPASS
libstdc++.XPASS

Added Tests - all
TOTAL.all

Added Tests - bad
libatomic.bad
libitm.bad

Added Tests - fails
TOTAL.fails

Added Tests - flaky
TOTAL.flaky


Report Time: 0.36s
Name Current %
TOTAL.PASS 492434.000 -1.25%
g++.PASS 234475.000 -
gcc.PASS 161790.000 -3.71%
gfortran.PASS 66285.000 -
libatomic.PASS 44.000 -
libgomp.PASS 15072.000 -
libitm.PASS 44.000 -
libstdc++.PASS 14724.000 -
Geometric Mean 12323.652 -
Name Current %
TOTAL.FAIL 314.000 -
g++.FAIL 186.000 -
gcc.FAIL 101.000 -
gfortran.FAIL 6.000 -
libatomic.FAIL 0.000 -
libgomp.FAIL 15.000 -
libitm.FAIL 0.000 -
libstdc++.FAIL 6.000 20.00%
Geometric Mean 1.541 -95.86%
Name Current %
TOTAL.XFAIL 3901.000 -
g++.XFAIL 2070.000 -
gcc.XFAIL 1187.000 -
gfortran.XFAIL 251.000 -
libatomic.XFAIL 0.000 -
libgomp.XFAIL 284.000 -
libitm.XFAIL 3.000 -
libstdc++.XFAIL 106.000 -
Geometric Mean 46.465 -84.50%
Name Current %
TOTAL.ERROR 73.000 7200.00%
g++.ERROR 0.000 -
gcc.ERROR 73.000 7200.00%
gfortran.ERROR 0.000 -
libatomic.ERROR 0.000 -
libgomp.ERROR 0.000 -
libitm.ERROR 0.000 -
libstdc++.ERROR 0.000 -
Geometric Mean 0.003 -99.72%
Name Current %
TOTAL.good 517175.000 -1.20%
g++.good 247664.000 -
gcc.good 170737.000 -3.56%
gfortran.good 67062.000 -
libatomic.good 49.000 -
libgomp.good 16032.000 -
libitm.good 48.000 -
libstdc++.good 15583.000 -
Geometric Mean 13089.492 -
bad
Name Current %
TOTAL.bad 765.000 25.62%
g++.bad 335.000 -
gcc.bad 400.000 63.27%
gfortran.bad 9.000 -
libatomic.bad 0.000 -
libgomp.bad 15.000 -
libitm.bad 0.000 -
libstdc++.bad 6.000 20.00%
Geometric Mean 2.317 -95.92%
Name Current %
TOTAL.fails 610.000 16.41%
Geometric Mean 610.000 16.41%
Name Current %
TOTAL.flaky 0.000 -
Geometric Mean 0.000 -
all
Name Current %
TOTAL.all 517940.000 -1.17%
Geometric Mean 517940.000 -1.17%