Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=56c1f748a5df6d0f7c75586204e3010fa3e164f9 (unchanged)
git_gcc https://github.com/gcc-mirror/gcc/commit/057e537e2a6f0fead3ebb503c8dcc08c9c6491ec (+ 45 commits)
git_gdb https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=66b8e6c7b8d3c137029f4f2ab8c5b798aa1cbdd7 (+ 6 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=bea1a4a77305cef90dac47b873bd9f01a6409c22 (+ 1 commits)
git_linux https://git.linaro.org/kernel-org/linux.git/commit/?id=f1fcbaa18b28dec10281551dfe6ed3a3ed80e3d6 (unchanged)
git_qemu https://gitlab.com/qemu-project/qemu/commit/ab4c44d657aeca7e1da6d6dcb1741c8e7d357b8b (unchanged)
test_url https://ci.linaro.org/job/tcwg_gnu_cross_check_gcc--master-arm-build/318/
Filter

master-arm test results

Run Order Start Time Duration
Current 0318 (3-changed-components) 2023-05-15T13:15:18 0:00:00
Previous 0258 (basepoints/gcc-14-00591-g73f7109ffb15) 2023-05-08T13:31:56 0:00:00
Baseline 0067 (6-changed-components) 2023-04-19T10:48:24 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 2 2
Performance Improvements 12 10
Added Tests 46 46
Unchanged Tests 1425 1427
Total Tests 1485

Performance Regressions - FAIL Δ Previous Current σ Δ (B) σ (B)
libgomp.FAIL 6.67% 15.000 16.000 - 6.67% -

Performance Regressions - bad Δ Previous Current σ Δ (B) σ (B)
libgomp.bad 6.67% 15.000 16.000 - 6.67% -

Performance Improvements - ERROR Δ Previous Current σ Δ (B) σ (B)
TOTAL.ERROR -98.67% 75.000 1.000 - 0.00% -
gcc.ERROR -98.67% 75.000 1.000 - 0.00% -

Performance Improvements - PASS Δ Previous Current σ Δ (B) σ (B)
gcc.PASS 3.93% 161790.000 168148.000 - 0.25% -
TOTAL.PASS 1.32% 492439.000 498948.000 - 0.20% -

Performance Improvements - UNRESOLVED Δ Previous Current σ Δ (B) σ (B)
gcc.UNRESOLVED -37.61% 226.000 141.000 - -1.40% -
TOTAL.UNRESOLVED -22.61% 376.000 291.000 - -9.06% -

Performance Improvements - all Δ Previous Current σ Δ (B) σ (B)
TOTAL.all 1.24% 517946.000 524391.000 - 0.19% -

Performance Improvements - bad Δ Previous Current σ Δ (B) σ (B)
gcc.bad -39.55% 402.000 243.000 - -1.62% -
TOTAL.bad -20.63% 766.000 608.000 - -8.43% -

Performance Improvements - fails Δ Previous Current σ Δ (B) σ (B)
TOTAL.fails -14.12% 609.000 523.000 - -9.36% -

Performance Improvements - good Δ Previous Current σ Δ (B) σ (B)
gcc.good 3.77% 170737.000 177169.000 - 0.24% -
TOTAL.good 1.28% 517180.000 523783.000 - 0.20% -

Added Tests - ERROR
g++.ERROR
gfortran.ERROR
libatomic.ERROR
libgomp.ERROR
libitm.ERROR
libstdc++.ERROR

Added Tests - FAIL
libatomic.FAIL
libitm.FAIL

Added Tests - KFAIL
TOTAL.KFAIL
g++.KFAIL
gcc.KFAIL
gfortran.KFAIL
libatomic.KFAIL
libgomp.KFAIL
libitm.KFAIL
libstdc++.KFAIL

Added Tests - OTHER
TOTAL.OTHER
g++.OTHER
gcc.OTHER
gfortran.OTHER
libatomic.OTHER
libgomp.OTHER
libitm.OTHER
libstdc++.OTHER

Added Tests - UNRESOLVED
libatomic.UNRESOLVED
libgomp.UNRESOLVED
libitm.UNRESOLVED
libstdc++.UNRESOLVED

Added Tests - UNTESTED
TOTAL.UNTESTED
g++.UNTESTED
gcc.UNTESTED
gfortran.UNTESTED
libatomic.UNTESTED
libgomp.UNTESTED
libitm.UNTESTED
libstdc++.UNTESTED

Added Tests - XFAIL
libatomic.XFAIL

Added Tests - XPASS
gcc.XPASS
gfortran.XPASS
libatomic.XPASS
libgomp.XPASS
libitm.XPASS
libstdc++.XPASS

Added Tests - bad
libatomic.bad
libitm.bad

Added Tests - flaky
TOTAL.flaky

Performance Regressions - FAIL Δ (B) Baseline Current σ (B) Δ σ
libgomp.FAIL 6.67% 15.000 16.000 - 6.67% -

Performance Regressions - bad Δ (B) Baseline Current σ (B) Δ σ
libgomp.bad 6.67% 15.000 16.000 - 6.67% -

Performance Improvements - FAIL Δ (B) Baseline Current σ (B) Δ σ
g++.FAIL -12.26% 212.000 186.000 - 0.00% -
TOTAL.FAIL -7.92% 341.000 314.000 - 0.32% -
gcc.FAIL -1.94% 103.000 101.000 - 0.00% -

Performance Improvements - UNRESOLVED Δ (B) Baseline Current σ (B) Δ σ
g++.UNRESOLVED -15.52% 174.000 147.000 - 0.00% -
TOTAL.UNRESOLVED -9.06% 320.000 291.000 - -22.61% -
gcc.UNRESOLVED -1.40% 143.000 141.000 - -37.61% -

Performance Improvements - bad Δ (B) Baseline Current σ (B) Δ σ
g++.bad -13.66% 388.000 335.000 - 0.00% -
TOTAL.bad -8.43% 664.000 608.000 - -20.63% -
gcc.bad -1.62% 247.000 243.000 - -39.55% -

Performance Improvements - fails Δ (B) Baseline Current σ (B) Δ σ
TOTAL.fails -9.36% 577.000 523.000 - -14.12% -

Added Tests - ERROR
g++.ERROR
gfortran.ERROR
libatomic.ERROR
libgomp.ERROR
libitm.ERROR
libstdc++.ERROR

Added Tests - FAIL
libatomic.FAIL
libitm.FAIL

Added Tests - KFAIL
TOTAL.KFAIL
g++.KFAIL
gcc.KFAIL
gfortran.KFAIL
libatomic.KFAIL
libgomp.KFAIL
libitm.KFAIL
libstdc++.KFAIL

Added Tests - OTHER
TOTAL.OTHER
g++.OTHER
gcc.OTHER
gfortran.OTHER
libatomic.OTHER
libgomp.OTHER
libitm.OTHER
libstdc++.OTHER

Added Tests - UNRESOLVED
libatomic.UNRESOLVED
libgomp.UNRESOLVED
libitm.UNRESOLVED
libstdc++.UNRESOLVED

Added Tests - UNTESTED
TOTAL.UNTESTED
g++.UNTESTED
gcc.UNTESTED
gfortran.UNTESTED
libatomic.UNTESTED
libgomp.UNTESTED
libitm.UNTESTED
libstdc++.UNTESTED

Added Tests - XFAIL
libatomic.XFAIL

Added Tests - XPASS
gcc.XPASS
gfortran.XPASS
libatomic.XPASS
libgomp.XPASS
libitm.XPASS
libstdc++.XPASS

Added Tests - bad
libatomic.bad
libitm.bad

Added Tests - flaky
TOTAL.flaky


Report Time: 0.35s
Name Current %
TOTAL.PASS 498948.000 1.32%
g++.PASS 234571.000 -
gcc.PASS 168148.000 3.93%
gfortran.PASS 66338.000 -
libatomic.PASS 44.000 -
libgomp.PASS 15075.000 -
libitm.PASS 44.000 -
libstdc++.PASS 14728.000 -
Geometric Mean 12406.135 -
Name Current %
TOTAL.FAIL 314.000 -
g++.FAIL 186.000 -
gcc.FAIL 101.000 -
gfortran.FAIL 6.000 -
libatomic.FAIL 0.000 -
libgomp.FAIL 16.000 6.67%
libitm.FAIL 0.000 -
libstdc++.FAIL 5.000 -
Geometric Mean 1.519 -95.92%
Name Current %
TOTAL.XFAIL 3901.000 -
g++.XFAIL 2070.000 -
gcc.XFAIL 1187.000 -
gfortran.XFAIL 251.000 -
libatomic.XFAIL 0.000 -
libgomp.XFAIL 284.000 -
libitm.XFAIL 3.000 -
libstdc++.XFAIL 106.000 -
Geometric Mean 46.465 -84.50%
Name Current %
TOTAL.ERROR 1.000 -98.67%
g++.ERROR 0.000 -
gcc.ERROR 1.000 -98.67%
gfortran.ERROR 0.000 -
libatomic.ERROR 0.000 -
libgomp.ERROR 0.000 -
libitm.ERROR 0.000 -
libstdc++.ERROR 0.000 -
Geometric Mean 0.001 -100.00%
Name Current %
TOTAL.good 523783.000 1.28%
g++.good 247780.000 -
gcc.good 177169.000 3.77%
gfortran.good 67115.000 -
libatomic.good 49.000 -
libgomp.good 16035.000 -
libitm.good 48.000 -
libstdc++.good 15587.000 -
Geometric Mean 13173.827 -
bad
Name Current %
TOTAL.bad 608.000 -20.63%
g++.bad 335.000 -
gcc.bad 243.000 -39.55%
gfortran.bad 9.000 -
libatomic.bad 0.000 -
libgomp.bad 16.000 6.67%
libitm.bad 0.000 -
libstdc++.bad 5.000 -
Geometric Mean 2.084 -96.75%
Name Current %
TOTAL.fails 523.000 -14.12%
Geometric Mean 523.000 -14.12%
Name Current %
TOTAL.flaky 0.000 -
Geometric Mean 0.000 -
all
Name Current %
TOTAL.all 524391.000 1.24%
Geometric Mean 524391.000 1.24%