Machine Info

Fields

hardware	None
os	None

Parameters

Run Info

Fields

Name	Value

Parameters

Name	Value
git_binutils	https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=e8723b48d9ebbc1d1dd21b2840326c8e871facd7 (+ 114 commits)
git_gcc	https://github.com/gcc-mirror/gcc/commit/113b5ce0610207717f651a3f8a3f1123d93f97af (+ 252 commits)
git_gdb	https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=e8723b48d9ebbc1d1dd21b2840326c8e871facd7 (+ 114 commits)
git_newlib	https://sourceware.org/git/?p=newlib-cygwin.git;a=commit;h=1339af44679aee0895fe311cfad89d38cfc2b919 (+ 20 commits)
git_qemu	https://gitlab.com/qemu-project/qemu/commit/37fbfda8f4145ba1700f63f0cb7be4c108d545de (+ 446 commits)
test_url	https://ci.linaro.org/job/tcwg_gnu_embed_check_gcc--master-thumb_v8a_hard_eabi-build/514/

Report

Filter

master-thumb_v8a_hard_eabi test results

Run	Order	Start Time	Duration
Current	0514 (5-changed-components)	2024-07-05T14:38:18	0:00:00
Previous	0500 (basepoints/gcc-15-01619-g3b9b8d6cfdf)	2024-06-27T05:49:15	0:00:00
Baseline	0005 (5-changed-components)	2023-08-03T03:04:36	0:00:00

Tests Summary

Status Group	#	# (B)
Performance Regressions	0	15
Performance Improvements	0	14
Added Tests	16	16
Unchanged Tests	749	720
Total Tests	765

Run-Over-Run Changes Detail

Added Tests - ERROR
TOTAL.ERROR
g++.ERROR
gcc.ERROR
libstdc++.ERROR

Added Tests - KFAIL
TOTAL.KFAIL
g++.KFAIL
gcc.KFAIL
libstdc++.KFAIL

Added Tests - OTHER
TOTAL.OTHER
g++.OTHER
gcc.OTHER
libstdc++.OTHER

Added Tests - UNTESTED
TOTAL.UNTESTED
g++.UNTESTED
gcc.UNTESTED
libstdc++.UNTESTED

Run-Over-Baseline Changes Detail

Performance Regressions - FAIL	Δ (B)	Baseline	Current	σ (B)	Δ	σ
g++.FAIL	112.50%	16.000	34.000	-	0.00%	-
gcc.FAIL	27.12%	177.000	225.000	-	-0.88%	-
TOTAL.FAIL	26.85%	216.000	274.000	-	-0.72%	-

Performance Regressions - UNSUPPORTED	Δ (B)	Baseline	Current	σ (B)	Δ	σ
gcc.UNSUPPORTED	17.31%	5713.000	6702.000	-	0.03%	-
TOTAL.UNSUPPORTED	10.69%	17815.000	19719.000	-	0.14%	-
g++.UNSUPPORTED	7.81%	11121.000	11990.000	-	0.21%	-
libstdc++.UNSUPPORTED	4.69%	981.000	1027.000	-	0.10%	-

Performance Regressions - XFAIL	Δ (B)	Baseline	Current	σ (B)	Δ	σ
g++.XFAIL	53.26%	1211.000	1856.000	-	0.00%	-
TOTAL.XFAIL	28.19%	2515.000	3224.000	-	0.06%	-
libstdc++.XFAIL	18.02%	111.000	131.000	-	0.00%	-
gcc.XFAIL	3.69%	1193.000	1237.000	-	0.16%	-

Performance Regressions - bad	Δ (B)	Baseline	Current	σ (B)	Δ	σ
g++.bad	80.77%	26.000	47.000	-	0.00%	-
gcc.bad	18.42%	228.000	270.000	-	-0.74%	-
TOTAL.bad	14.92%	295.000	339.000	-	-0.59%	-

Performance Regressions - fails	Δ (B)	Baseline	Current	σ (B)	Δ	σ
TOTAL.fails	14.92%	295.000	339.000	-	-0.59%	-

Performance Improvements - FAIL	Δ (B)	Baseline	Current	σ (B)	Δ	σ
libstdc++.FAIL	-34.78%	23.000	15.000	-	0.00%	-

Performance Improvements - PASS	Δ (B)	Baseline	Current	σ (B)	Δ	σ
libstdc++.PASS	17.99%	13545.000	15982.000	-	-0.09%	-
g++.PASS	12.32%	200217.000	224885.000	-	0.21%	-
TOTAL.PASS	9.49%	376203.000	411911.000	-	0.13%	-
gcc.PASS	5.30%	162441.000	171044.000	-	0.06%	-

Performance Improvements - UNRESOLVED	Δ (B)	Baseline	Current	σ (B)	Δ	σ
libstdc++.UNRESOLVED	-68.75%	16.000	5.000	-	0.00%	-
TOTAL.UNRESOLVED	-35.00%	40.000	26.000	-	0.00%	-
gcc.UNRESOLVED	-25.00%	24.000	18.000	-	0.00%	-

Performance Improvements - all	Δ (B)	Baseline	Current	σ (B)	Δ	σ
TOTAL.all	9.67%	396828.000	435193.000	-	0.13%	-

Performance Improvements - bad	Δ (B)	Baseline	Current	σ (B)	Δ	σ
libstdc++.bad	-46.34%	41.000	22.000	-	0.00%	-

Performance Improvements - good	Δ (B)	Baseline	Current	σ (B)	Δ	σ
libstdc++.good	17.10%	14637.000	17140.000	-	-0.08%	-
g++.good	12.32%	212549.000	238731.000	-	0.21%	-
TOTAL.good	9.66%	396533.000	434854.000	-	0.13%	-
gcc.good	5.69%	169347.000	178983.000	-	0.06%	-

Added Tests - ERROR
TOTAL.ERROR
g++.ERROR
gcc.ERROR
libstdc++.ERROR

Added Tests - KFAIL
TOTAL.KFAIL
g++.KFAIL
gcc.KFAIL
libstdc++.KFAIL

Added Tests - OTHER
TOTAL.OTHER
g++.OTHER
gcc.OTHER
libstdc++.OTHER

Added Tests - UNTESTED
TOTAL.UNTESTED
g++.UNTESTED
gcc.UNTESTED
libstdc++.UNTESTED

Report Time: 0.20s

PASS

	Name	Current	%
	TOTAL.PASS	411911.000	-
	g++.PASS	224885.000	-
	gcc.PASS	171044.000	-
	libstdc++.PASS	15982.000	-
	Geometric Mean	126146.647	-

XPASS

	Name	Current	%
	TOTAL.XPASS	39.000	-
	g++.XPASS	10.000	-
	gcc.XPASS	27.000	-
	libstdc++.XPASS	2.000	-
	Geometric Mean	12.047	-

FAIL

	Name	Current	%
	TOTAL.FAIL	274.000	-
	g++.FAIL	34.000	-
	gcc.FAIL	225.000	-
	libstdc++.FAIL	15.000	-
	Geometric Mean	74.882	-

XFAIL

	Name	Current	%
	TOTAL.XFAIL	3224.000	-
	g++.XFAIL	1856.000	-
	gcc.XFAIL	1237.000	-
	libstdc++.XFAIL	131.000	-
	Geometric Mean	992.324	-

KFAIL

	Name	Current	%
	TOTAL.KFAIL	0.000	-
	g++.KFAIL	0.000	-
	gcc.KFAIL	0.000	-
	libstdc++.KFAIL	0.000	-
	Geometric Mean	0.000	-

UNSUPPORTED

	Name	Current	%
	TOTAL.UNSUPPORTED	19719.000	-
	g++.UNSUPPORTED	11990.000	-
	gcc.UNSUPPORTED	6702.000	-
	libstdc++.UNSUPPORTED	1027.000	-
	Geometric Mean	6351.404	-

UNRESOLVED

	Name	Current	%
	TOTAL.UNRESOLVED	26.000	-
	g++.UNRESOLVED	3.000	-
	gcc.UNRESOLVED	18.000	-
	libstdc++.UNRESOLVED	5.000	-
	Geometric Mean	9.153	-

UNTESTED

	Name	Current	%
	TOTAL.UNTESTED	0.000	-
	g++.UNTESTED	0.000	-
	gcc.UNTESTED	0.000	-
	libstdc++.UNTESTED	0.000	-
	Geometric Mean	0.000	-

ERROR

	Name	Current	%
	TOTAL.ERROR	0.000	-
	g++.ERROR	0.000	-
	gcc.ERROR	0.000	-
	libstdc++.ERROR	0.000	-
	Geometric Mean	0.000	-

OTHER

	Name	Current	%
	TOTAL.OTHER	0.000	-
	g++.OTHER	0.000	-
	gcc.OTHER	0.000	-
	libstdc++.OTHER	0.000	-
	Geometric Mean	0.000	-

good

	Name	Current	%
	TOTAL.good	434854.000	-
	g++.good	238731.000	-
	gcc.good	178983.000	-
	libstdc++.good	17140.000	-
	Geometric Mean	133588.392	-

bad

	Name	Current	%
	TOTAL.bad	339.000	-
	g++.bad	47.000	-
	gcc.bad	270.000	-
	libstdc++.bad	22.000	-
	Geometric Mean	98.633	-

fails

	Name	Current	%
	TOTAL.fails	339.000	-
	Geometric Mean	339.000	-

flaky

	Name	Current	%
	TOTAL.flaky	122.000	-
	Geometric Mean	122.000	-

all

	Name	Current	%
	TOTAL.all	435193.000	-
	Geometric Mean	435193.000	-