Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=c7face14225296a2f5d3ebeb8ace88c166d80c3e (unchanged)
git_gcc https://github.com/gcc-mirror/gcc/commit/efecb298d880cda20f8d7bea2d7b500a9752ce56 (unchanged)
git_gdb https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=75e73c6cadcc064c2a0fd03396666574cd5335ca (unchanged)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=4290aed05135ae4c0272006442d147f2155e70d7 (unchanged)
git_linux https://git.linaro.org/kernel-org/linux.git/commit/?id=692b7dc87ca6d55ab254f8259e6f970171dc9d01 (unchanged)
git_qemu https://gitlab.com/qemu-project/qemu/commit/d7ee93e24359703debf4137f4cc632563aa4e8d1 (+ 1 commits)
test_url https://ci.linaro.org/job/tcwg_gnu_cross_check_gcc--master-arm-build/535/
Filter

master-arm test results

Run Order Start Time Duration
Current 0535 (v8.0.0-01943-gd7ee93e243) 2023-06-20T09:02:47 0:00:00
Previous 0534 (v8.0.0-01942-g708906dcd6) 2023-06-20T01:09:37 0:00:00
Baseline 0067 (6-changed-components) 2023-04-19T10:48:24 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 18 18
Performance Improvements 0 4
Added Tests 44 44
Unchanged Tests 1423 1419
Total Tests 1485

Performance Regressions - FAIL Δ Previous Current σ Δ (B) σ (B)
libgomp.FAIL 12650.00% 16.000 2040.000 - 13500.00% -
libstdc++.FAIL 1583.33% 6.000 101.000 - 1920.00% -
TOTAL.FAIL 820.66% 271.000 2495.000 - 631.67% -
gfortran.FAIL 200.00% 6.000 18.000 - 200.00% -
gcc.FAIL 89.74% 78.000 148.000 - 43.69% -
g++.FAIL 10.91% 165.000 183.000 - -13.68% -

Performance Regressions - PASS Δ Previous Current σ Δ (B) σ (B)
libgomp.PASS -13.34% 15214.000 13184.000 - -12.20% -
libitm.PASS -11.36% 44.000 39.000 - -11.36% -

Performance Regressions - UNRESOLVED Δ Previous Current σ Δ (B) σ (B)
gcc.UNRESOLVED 1.42% 141.000 143.000 - 0.00% -

Performance Regressions - bad Δ Previous Current σ Δ (B) σ (B)
libgomp.bad 12650.00% 16.000 2040.000 - 13500.00% -
libstdc++.bad 1583.33% 6.000 101.000 - 1920.00% -
TOTAL.bad 393.98% 565.000 2791.000 - 320.33% -
gfortran.bad 133.33% 9.000 21.000 - 133.33% -
gcc.bad 32.73% 220.000 292.000 - 18.22% -
g++.bad 5.73% 314.000 332.000 - -14.43% -

Performance Regressions - fails Δ Previous Current σ Δ (B) σ (B)
TOTAL.fails 463.75% 480.000 2706.000 - 368.98% -

Performance Regressions - good Δ Previous Current σ Δ (B) σ (B)
libgomp.good -12.55% 16177.000 14147.000 - -11.45% -
libitm.good -10.42% 48.000 43.000 - -10.42% -

Added Tests - ERROR
g++.ERROR
gfortran.ERROR
libatomic.ERROR
libgomp.ERROR
libitm.ERROR
libstdc++.ERROR

Added Tests - FAIL
libatomic.FAIL

Added Tests - KFAIL
TOTAL.KFAIL
g++.KFAIL
gcc.KFAIL
gfortran.KFAIL
libatomic.KFAIL
libgomp.KFAIL
libitm.KFAIL
libstdc++.KFAIL

Added Tests - OTHER
TOTAL.OTHER
g++.OTHER
gcc.OTHER
gfortran.OTHER
libatomic.OTHER
libgomp.OTHER
libitm.OTHER
libstdc++.OTHER

Added Tests - UNRESOLVED
libatomic.UNRESOLVED
libgomp.UNRESOLVED
libitm.UNRESOLVED
libstdc++.UNRESOLVED

Added Tests - UNTESTED
TOTAL.UNTESTED
g++.UNTESTED
gcc.UNTESTED
gfortran.UNTESTED
libatomic.UNTESTED
libgomp.UNTESTED
libitm.UNTESTED
libstdc++.UNTESTED

Added Tests - XFAIL
libatomic.XFAIL

Added Tests - XPASS
gcc.XPASS
gfortran.XPASS
libatomic.XPASS
libgomp.XPASS
libitm.XPASS
libstdc++.XPASS

Added Tests - bad
libatomic.bad

Added Tests - flaky
TOTAL.flaky

Performance Regressions - FAIL Δ (B) Baseline Current σ (B) Δ σ
libgomp.FAIL 13500.00% 15.000 2040.000 - 12650.00% -
libstdc++.FAIL 1920.00% 5.000 101.000 - 1583.33% -
TOTAL.FAIL 631.67% 341.000 2495.000 - 820.66% -
gfortran.FAIL 200.00% 6.000 18.000 - 200.00% -
gcc.FAIL 43.69% 103.000 148.000 - 89.74% -

Performance Regressions - PASS Δ (B) Baseline Current σ (B) Δ σ
libgomp.PASS -12.20% 15016.000 13184.000 - -13.34% -
libitm.PASS -11.36% 44.000 39.000 - -11.36% -

Performance Regressions - XFAIL Δ (B) Baseline Current σ (B) Δ σ
gcc.XFAIL 1.85% 1191.000 1213.000 - 0.00% -
g++.XFAIL 1.55% 2070.000 2102.000 - 0.00% -
TOTAL.XFAIL 1.38% 3905.000 3959.000 - 0.00% -

Performance Regressions - bad Δ (B) Baseline Current σ (B) Δ σ
libgomp.bad 13500.00% 15.000 2040.000 - 12650.00% -
libstdc++.bad 1920.00% 5.000 101.000 - 1583.33% -
TOTAL.bad 320.33% 664.000 2791.000 - 393.98% -
gfortran.bad 133.33% 9.000 21.000 - 133.33% -
gcc.bad 18.22% 247.000 292.000 - 32.73% -

Performance Regressions - fails Δ (B) Baseline Current σ (B) Δ σ
TOTAL.fails 368.98% 577.000 2706.000 - 463.75% -

Performance Regressions - good Δ (B) Baseline Current σ (B) Δ σ
libgomp.good -11.45% 15976.000 14147.000 - -12.55% -
libitm.good -10.42% 48.000 43.000 - -10.42% -

Performance Improvements - FAIL Δ (B) Baseline Current σ (B) Δ σ
g++.FAIL -13.68% 212.000 183.000 - 10.91% -

Performance Improvements - UNRESOLVED Δ (B) Baseline Current σ (B) Δ σ
g++.UNRESOLVED -15.52% 174.000 147.000 - 0.00% -
TOTAL.UNRESOLVED -8.44% 320.000 293.000 - 0.69% -

Performance Improvements - bad Δ (B) Baseline Current σ (B) Δ σ
g++.bad -14.43% 388.000 332.000 - 5.73% -

Added Tests - ERROR
g++.ERROR
gfortran.ERROR
libatomic.ERROR
libgomp.ERROR
libitm.ERROR
libstdc++.ERROR

Added Tests - FAIL
libatomic.FAIL

Added Tests - KFAIL
TOTAL.KFAIL
g++.KFAIL
gcc.KFAIL
gfortran.KFAIL
libatomic.KFAIL
libgomp.KFAIL
libitm.KFAIL
libstdc++.KFAIL

Added Tests - OTHER
TOTAL.OTHER
g++.OTHER
gcc.OTHER
gfortran.OTHER
libatomic.OTHER
libgomp.OTHER
libitm.OTHER
libstdc++.OTHER

Added Tests - UNRESOLVED
libatomic.UNRESOLVED
libgomp.UNRESOLVED
libitm.UNRESOLVED
libstdc++.UNRESOLVED

Added Tests - UNTESTED
TOTAL.UNTESTED
g++.UNTESTED
gcc.UNTESTED
gfortran.UNTESTED
libatomic.UNTESTED
libgomp.UNTESTED
libitm.UNTESTED
libstdc++.UNTESTED

Added Tests - XFAIL
libatomic.XFAIL

Added Tests - XPASS
gcc.XPASS
gfortran.XPASS
libatomic.XPASS
libgomp.XPASS
libitm.XPASS
libstdc++.XPASS

Added Tests - bad
libatomic.bad

Added Tests - flaky
TOTAL.flaky


Report Time: 0.22s
Name Current %
TOTAL.PASS 498216.000 -
g++.PASS 235010.000 -
gcc.PASS 168620.000 -
gfortran.PASS 66669.000 -
libatomic.PASS 44.000 -
libgomp.PASS 13184.000 -13.34%
libitm.PASS 39.000 -11.36%
libstdc++.PASS 14650.000 -
Geometric Mean 12021.749 -3.38%
Name Current %
TOTAL.FAIL 2495.000 820.66%
g++.FAIL 183.000 10.91%
gcc.FAIL 148.000 89.74%
gfortran.FAIL 18.000 200.00%
libatomic.FAIL 0.000 -
libgomp.FAIL 2040.000 12650.00%
libitm.FAIL 5.000 -
libstdc++.FAIL 101.000 1583.33%
Geometric Mean 24.392 326.27%
Name Current %
TOTAL.XFAIL 3959.000 -
g++.XFAIL 2102.000 -
gcc.XFAIL 1213.000 -
gfortran.XFAIL 251.000 -
libatomic.XFAIL 0.000 -
libgomp.XFAIL 284.000 -
libitm.XFAIL 3.000 -
libstdc++.XFAIL 106.000 -
Geometric Mean 46.767 -84.51%
Name Current %
TOTAL.good 523151.000 -
g++.good 248282.000 -
gcc.good 177675.000 -
gfortran.good 67446.000 -
libatomic.good 49.000 -
libgomp.good 14147.000 -12.55%
libitm.good 43.000 -10.42%
libstdc++.good 15509.000 -
Geometric Mean 12797.751 -3.14%
bad
Name Current %
TOTAL.bad 2791.000 393.98%
g++.bad 332.000 5.73%
gcc.bad 292.000 32.73%
gfortran.bad 21.000 133.33%
libatomic.bad 0.000 -
libgomp.bad 2040.000 12650.00%
libitm.bad 5.000 -
libstdc++.bad 101.000 1583.33%
Geometric Mean 29.575 245.44%
Name Current %
TOTAL.fails 2706.000 463.75%
Geometric Mean 2706.000 463.75%
Name Current %
TOTAL.flaky 0.000 -
Geometric Mean 0.000 -
all
Name Current %
TOTAL.all 525942.000 -
Geometric Mean 525942.000 -