Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=d8bcb8723602f03351ea583cbc9ba21f39054eb1 (+ 22 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/577223aebc7acdd31e62b33c1682fe54a622ae27 (+ 23 commits)
git_gdb https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=d8bcb8723602f03351ea583cbc9ba21f39054eb1 (+ 28 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=99f9ae4ed0ba9f2c84520b78fd0eeed96a7ed40e (+ 9 commits)
git_linux https://git.linaro.org/kernel-org/linux.git/commit/?id=2214170caabbff673935eb046a7edf4621213931 (+ 53 commits)
git_qemu https://gitlab.com/qemu-project/qemu/commit/67fe6ae41da64368bc4936b196fee2bf61f8c720 (+ 25 commits)
test_url https://ci.linaro.org/job/tcwg_gnu_cross_check_gcc--master-arm-build/548/
Filter

master-arm test results

Run Order Start Time Duration
Current 0548 (6-changed-components) 2023-06-21T06:42:03 0:00:00
Previous 0535 (v8.0.0-01943-gd7ee93e243) 2023-06-20T09:02:47 0:00:00
Baseline 0067 (6-changed-components) 2023-04-19T10:48:24 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 0 7
Performance Improvements 18 11
Added Tests 46 48
Unchanged Tests 1421 1419
Total Tests 1485

Performance Improvements - FAIL Δ Previous Current σ Δ (B) σ (B)
libgomp.FAIL -99.17% 2040.000 17.000 - 13.33% -
libstdc++.FAIL -94.06% 101.000 6.000 - 20.00% -
TOTAL.FAIL -89.10% 2495.000 272.000 - -20.23% -
gfortran.FAIL -66.67% 18.000 6.000 - 0.00% -
gcc.FAIL -47.30% 148.000 78.000 - -24.27% -
g++.FAIL -9.84% 183.000 165.000 - -22.17% -

Performance Improvements - PASS Δ Previous Current σ Δ (B) σ (B)
libgomp.PASS 15.39% 13184.000 15213.000 - 1.31% -
libitm.PASS 12.82% 39.000 44.000 - 0.00% -

Performance Improvements - UNRESOLVED Δ Previous Current σ Δ (B) σ (B)
gcc.UNRESOLVED -1.40% 143.000 141.000 - -1.40% -

Performance Improvements - bad Δ Previous Current σ Δ (B) σ (B)
libgomp.bad -99.17% 2040.000 17.000 - 13.33% -
libstdc++.bad -94.06% 101.000 6.000 - 20.00% -
TOTAL.bad -79.72% 2791.000 566.000 - -14.76% -
gfortran.bad -57.14% 21.000 9.000 - 0.00% -
gcc.bad -24.66% 292.000 220.000 - -10.93% -
g++.bad -5.42% 332.000 314.000 - -19.07% -

Performance Improvements - fails Δ Previous Current σ Δ (B) σ (B)
TOTAL.fails -82.22% 2706.000 481.000 - 0.00% -

Performance Improvements - good Δ Previous Current σ Δ (B) σ (B)
libgomp.good 14.34% 14147.000 16176.000 - 1.25% -
libitm.good 11.63% 43.000 48.000 - 0.00% -

Added Tests - ERROR
g++.ERROR
gfortran.ERROR
libatomic.ERROR
libgomp.ERROR
libitm.ERROR
libstdc++.ERROR

Added Tests - FAIL
libatomic.FAIL
libitm.FAIL

Added Tests - KFAIL
TOTAL.KFAIL
g++.KFAIL
gcc.KFAIL
gfortran.KFAIL
libatomic.KFAIL
libgomp.KFAIL
libitm.KFAIL
libstdc++.KFAIL

Added Tests - OTHER
TOTAL.OTHER
g++.OTHER
gcc.OTHER
gfortran.OTHER
libatomic.OTHER
libgomp.OTHER
libitm.OTHER
libstdc++.OTHER

Added Tests - UNRESOLVED
libatomic.UNRESOLVED
libgomp.UNRESOLVED
libitm.UNRESOLVED
libstdc++.UNRESOLVED

Added Tests - UNTESTED
TOTAL.UNTESTED
g++.UNTESTED
gcc.UNTESTED
gfortran.UNTESTED
libatomic.UNTESTED
libgomp.UNTESTED
libitm.UNTESTED
libstdc++.UNTESTED

Added Tests - XFAIL
libatomic.XFAIL

Added Tests - XPASS
gcc.XPASS
gfortran.XPASS
libatomic.XPASS
libgomp.XPASS
libitm.XPASS
libstdc++.XPASS

Added Tests - bad
libatomic.bad
libitm.bad

Added Tests - flaky
TOTAL.flaky

Performance Regressions - FAIL Δ (B) Baseline Current σ (B) Δ σ
libstdc++.FAIL 20.00% 5.000 6.000 - -94.06% -
libgomp.FAIL 13.33% 15.000 17.000 - -99.17% -

Performance Regressions - XFAIL Δ (B) Baseline Current σ (B) Δ σ
gcc.XFAIL 1.85% 1191.000 1213.000 - 0.00% -
g++.XFAIL 1.55% 2070.000 2102.000 - 0.00% -
TOTAL.XFAIL 1.38% 3905.000 3959.000 - 0.00% -

Performance Regressions - bad Δ (B) Baseline Current σ (B) Δ σ
libstdc++.bad 20.00% 5.000 6.000 - -94.06% -
libgomp.bad 13.33% 15.000 17.000 - -99.17% -

Performance Improvements - FAIL Δ (B) Baseline Current σ (B) Δ σ
gcc.FAIL -24.27% 103.000 78.000 - -47.30% -
g++.FAIL -22.17% 212.000 165.000 - -9.84% -
TOTAL.FAIL -20.23% 341.000 272.000 - -89.10% -

Performance Improvements - PASS Δ (B) Baseline Current σ (B) Δ σ
libgomp.PASS 1.31% 15016.000 15213.000 - 15.39% -

Performance Improvements - UNRESOLVED Δ (B) Baseline Current σ (B) Δ σ
g++.UNRESOLVED -15.52% 174.000 147.000 - 0.00% -
TOTAL.UNRESOLVED -9.06% 320.000 291.000 - -0.68% -
gcc.UNRESOLVED -1.40% 143.000 141.000 - -1.40% -

Performance Improvements - bad Δ (B) Baseline Current σ (B) Δ σ
g++.bad -19.07% 388.000 314.000 - -5.42% -
TOTAL.bad -14.76% 664.000 566.000 - -79.72% -
gcc.bad -10.93% 247.000 220.000 - -24.66% -

Performance Improvements - good Δ (B) Baseline Current σ (B) Δ σ
libgomp.good 1.25% 15976.000 16176.000 - 14.34% -

Added Tests - ERROR
g++.ERROR
gfortran.ERROR
libatomic.ERROR
libgomp.ERROR
libitm.ERROR
libstdc++.ERROR

Added Tests - FAIL
libatomic.FAIL
libitm.FAIL

Added Tests - KFAIL
TOTAL.KFAIL
g++.KFAIL
gcc.KFAIL
gfortran.KFAIL
libatomic.KFAIL
libgomp.KFAIL
libitm.KFAIL
libstdc++.KFAIL

Added Tests - OTHER
TOTAL.OTHER
g++.OTHER
gcc.OTHER
gfortran.OTHER
libatomic.OTHER
libgomp.OTHER
libitm.OTHER
libstdc++.OTHER

Added Tests - UNRESOLVED
libatomic.UNRESOLVED
libgomp.UNRESOLVED
libitm.UNRESOLVED
libstdc++.UNRESOLVED

Added Tests - UNTESTED
TOTAL.UNTESTED
g++.UNTESTED
gcc.UNTESTED
gfortran.UNTESTED
libatomic.UNTESTED
libgomp.UNTESTED
libitm.UNTESTED
libstdc++.UNTESTED

Added Tests - XFAIL
libatomic.XFAIL

Added Tests - XPASS
gcc.XPASS
gfortran.XPASS
libatomic.XPASS
libgomp.XPASS
libitm.XPASS
libstdc++.XPASS

Added Tests - all
TOTAL.all

Added Tests - bad
libatomic.bad
libitm.bad

Added Tests - fails
TOTAL.fails

Added Tests - flaky
TOTAL.flaky


Report Time: 0.38s
Name Current %
TOTAL.PASS 500560.000 -
g++.PASS 235088.000 -
gcc.PASS 168707.000 -
gfortran.PASS 66719.000 -
libatomic.PASS 44.000 -
libgomp.PASS 15213.000 15.39%
libitm.PASS 44.000 12.82%
libstdc++.PASS 14745.000 -
Geometric Mean 12444.559 3.52%
Name Current %
TOTAL.FAIL 272.000 -89.10%
g++.FAIL 165.000 -9.84%
gcc.FAIL 78.000 -47.30%
gfortran.FAIL 6.000 -66.67%
libatomic.FAIL 0.000 -
libgomp.FAIL 17.000 -99.17%
libitm.FAIL 0.000 -
libstdc++.FAIL 6.000 -94.06%
Geometric Mean 1.467 -99.42%
Name Current %
TOTAL.XFAIL 3959.000 -
g++.XFAIL 2102.000 -
gcc.XFAIL 1213.000 -
gfortran.XFAIL 251.000 -
libatomic.XFAIL 0.000 -
libgomp.XFAIL 284.000 -
libitm.XFAIL 3.000 -
libstdc++.XFAIL 106.000 -
Geometric Mean 46.767 -84.51%
Name Current %
TOTAL.good 525495.000 -
g++.good 248360.000 -
gcc.good 177762.000 -
gfortran.good 67496.000 -
libatomic.good 49.000 -
libgomp.good 16176.000 14.34%
libitm.good 48.000 11.63%
libstdc++.good 15604.000 -
Geometric Mean 13214.148 3.25%
bad
Name Current %
TOTAL.bad 566.000 -79.72%
g++.bad 314.000 -5.42%
gcc.bad 220.000 -24.66%
gfortran.bad 9.000 -57.14%
libatomic.bad 0.000 -
libgomp.bad 17.000 -99.17%
libitm.bad 0.000 -
libstdc++.bad 6.000 -94.06%
Geometric Mean 2.086 -99.36%
Name Current %
TOTAL.fails 481.000 -82.22%
Geometric Mean 481.000 -82.22%
Name Current %
TOTAL.flaky 0.000 -
Geometric Mean 0.000 -
all
Name Current %
TOTAL.all 526061.000 -
Geometric Mean 526061.000 -