Machine Info

Fields

hardware	None
os	None

Parameters

Run Info

Fields

Name	Value

Parameters

Name	Value
git_binutils	https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=a16f37e8881b9b76472dbac260309c236b413b74 (unchanged)
git_gcc	git+ssh://linaroci@gcc.gnu.org/git/gcc.git (49f421a31f63405d3ca466e144d010c550206e72) (+ 77 commits)
git_gdb	https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=a16f37e8881b9b76472dbac260309c236b413b74 (unchanged)
git_newlib	https://sourceware.org/git/?p=newlib-cygwin.git;a=commit;h=04f4da794de2f7fee0e8b813db031bb7ac8513c7 (unchanged)
git_qemu	https://gitlab.com/qemu-project/qemu/commit/3e82ddaa8db260a232dbbbf488d8ac7851d124c5 (unchanged)
test_url	https://ci.linaro.org/job/tcwg_gnu_embed_check_gcc--master-thumb_m7_hard_eabi-build/406/

Report

Filter

master-thumb_m7_hard_eabi test results

Run	Order	Start Time	Duration
Current	0406 (basepoints/gcc-16-01061-g49f421a31f6)	2025-06-01T18:25:57	0:00:00
Previous	0405 (basepoints/gcc-16-00984-ge322dff09d0)	2025-05-31T17:51:39	0:00:00
Baseline	0049 (basepoints/gcc-15-00267-gcb478e0a6f3)	2024-05-23T17:43:55	0:00:00

Tests Summary

Status Group	#	# (B)
Performance Regressions	2	8
Performance Improvements	5	20
Added Tests	16	16
Unchanged Tests	742	721
Total Tests	765

Run-Over-Run Changes Detail

Performance Regressions - bad	Δ	Previous	Current	σ	Δ (B)	σ (B)
libstdc++.bad	4.76%	21.000	22.000	-	0.00%	-

Performance Regressions - flaky	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.flaky	40.00%	5.000	7.000	-	0.00%	-

Performance Improvements - FAIL	Δ	Previous	Current	σ	Δ (B)	σ (B)
g++.FAIL	-42.86%	14.000	8.000	-	-81.82%	-
TOTAL.FAIL	-4.20%	143.000	137.000	-	-58.23%	-

Performance Improvements - bad	Δ	Previous	Current	σ	Δ (B)	σ (B)
g++.bad	-31.58%	19.000	13.000	-	-78.33%	-
TOTAL.bad	-3.27%	153.000	148.000	-	-57.83%	-

Performance Improvements - fails	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.fails	-3.92%	153.000	147.000	-	-58.12%	-

Added Tests - ERROR
TOTAL.ERROR
g++.ERROR
gcc.ERROR
libstdc++.ERROR

Added Tests - KFAIL
TOTAL.KFAIL
g++.KFAIL
gcc.KFAIL
libstdc++.KFAIL

Added Tests - OTHER
g++.OTHER
gcc.OTHER

Added Tests - UNRESOLVED
g++.UNRESOLVED

Added Tests - UNTESTED
TOTAL.UNTESTED
g++.UNTESTED
gcc.UNTESTED
libstdc++.UNTESTED

Added Tests - XPASS
gcc.XPASS

Run-Over-Baseline Changes Detail

Performance Regressions - FAIL	Δ (B)	Baseline	Current	σ (B)	Δ	σ
libstdc++.FAIL	6.25%	16.000	17.000	-	0.00%	-

Performance Regressions - PASS	Δ (B)	Baseline	Current	σ (B)	Δ	σ
g++.PASS	-3.67%	223179.000	214994.000	-	0.01%	-

Performance Regressions - UNSUPPORTED	Δ (B)	Baseline	Current	σ (B)	Δ	σ
gcc.UNSUPPORTED	8.88%	9379.000	10212.000	-	0.02%	-
libstdc++.UNSUPPORTED	3.80%	1025.000	1064.000	-	0.00%	-

Performance Regressions - XFAIL	Δ (B)	Baseline	Current	σ (B)	Δ	σ
libstdc++.XFAIL	3.82%	131.000	136.000	-	0.00%	-

Performance Regressions - all	Δ (B)	Baseline	Current	σ (B)	Δ	σ
TOTAL.all	-1.63%	425280.000	418363.000	-	0.03%	-

Performance Regressions - good	Δ (B)	Baseline	Current	σ (B)	Δ	σ
g++.good	-7.51%	236918.000	219127.000	-	0.02%	-
TOTAL.good	-1.58%	424929.000	418215.000	-	0.03%	-

Performance Improvements - FAIL	Δ (B)	Baseline	Current	σ (B)	Δ	σ
g++.FAIL	-81.82%	44.000	8.000	-	-42.86%	-
TOTAL.FAIL	-58.23%	328.000	137.000	-	-4.20%	-
gcc.FAIL	-58.21%	268.000	112.000	-	0.00%	-

Performance Improvements - PASS	Δ (B)	Baseline	Current	σ (B)	Δ	σ
gcc.PASS	5.80%	160521.000	169837.000	-	0.03%	-
libstdc++.PASS	5.63%	15939.000	16836.000	-	0.29%	-

Performance Improvements - UNRESOLVED	Δ (B)	Baseline	Current	σ (B)	Δ	σ
TOTAL.UNRESOLVED	-72.73%	11.000	3.000	-	0.00%	-
libstdc++.UNRESOLVED	-50.00%	4.000	2.000	-	0.00%	-

Performance Improvements - UNSUPPORTED	Δ (B)	Baseline	Current	σ (B)	Δ	σ
g++.UNSUPPORTED	-78.28%	11885.000	2582.000	-	0.23%	-
TOTAL.UNSUPPORTED	-37.83%	22289.000	13858.000	-	0.06%	-

Performance Improvements - XFAIL	Δ (B)	Baseline	Current	σ (B)	Δ	σ
g++.XFAIL	-16.34%	1854.000	1551.000	-	0.00%	-
TOTAL.XFAIL	-10.36%	3001.000	2690.000	-	0.00%	-
gcc.XFAIL	-1.28%	1016.000	1003.000	-	0.00%	-

Performance Improvements - XPASS	Δ (B)	Baseline	Current	σ (B)	Δ	σ
g++.XPASS	-50.00%	10.000	5.000	-	0.00%	-
TOTAL.XPASS	-41.67%	12.000	7.000	-	0.00%	-

Performance Improvements - bad	Δ (B)	Baseline	Current	σ (B)	Δ	σ
g++.bad	-78.33%	60.000	13.000	-	-31.58%	-
gcc.bad	-57.99%	269.000	113.000	-	0.00%	-
TOTAL.bad	-57.83%	351.000	148.000	-	-3.27%	-

Performance Improvements - fails	Δ (B)	Baseline	Current	σ (B)	Δ	σ
TOTAL.fails	-58.12%	351.000	147.000	-	-3.92%	-

Performance Improvements - good	Δ (B)	Baseline	Current	σ (B)	Δ	σ
gcc.good	5.93%	170916.000	181052.000	-	0.03%	-
libstdc++.good	5.50%	17095.000	18036.000	-	0.27%	-

Added Tests - ERROR
TOTAL.ERROR
g++.ERROR
gcc.ERROR
libstdc++.ERROR

Added Tests - KFAIL
TOTAL.KFAIL
g++.KFAIL
gcc.KFAIL
libstdc++.KFAIL

Added Tests - OTHER
g++.OTHER
gcc.OTHER

Added Tests - UNRESOLVED
g++.UNRESOLVED

Added Tests - UNTESTED
TOTAL.UNTESTED
g++.UNTESTED
gcc.UNTESTED
libstdc++.UNTESTED

Added Tests - XPASS
gcc.XPASS

Report Time: 0.23s

PASS

	Name	Current	%
	TOTAL.PASS	401667.000	-
	g++.PASS	214994.000	-
	gcc.PASS	169837.000	-
	libstdc++.PASS	16836.000	-
	Geometric Mean	125354.789	-

XPASS

	Name	Current	%
	TOTAL.XPASS	7.000	-
	g++.XPASS	5.000	-
	gcc.XPASS	0.000	-
	libstdc++.XPASS	2.000	-
	Geometric Mean	0.289	-92.98%

FAIL

	Name	Current	%
	TOTAL.FAIL	137.000	-4.20%
	g++.FAIL	8.000	-42.86%
	gcc.FAIL	112.000	-
	libstdc++.FAIL	17.000	-
	Geometric Mean	38.008	-13.98%

XFAIL

	Name	Current	%
	TOTAL.XFAIL	2690.000	-
	g++.XFAIL	1551.000	-
	gcc.XFAIL	1003.000	-
	libstdc++.XFAIL	136.000	-
	Geometric Mean	868.562	-

KFAIL

	Name	Current	%
	TOTAL.KFAIL	0.000	-
	g++.KFAIL	0.000	-
	gcc.KFAIL	0.000	-
	libstdc++.KFAIL	0.000	-
	Geometric Mean	0.000	-

UNSUPPORTED

	Name	Current	%
	TOTAL.UNSUPPORTED	13858.000	-
	g++.UNSUPPORTED	2582.000	-
	gcc.UNSUPPORTED	10212.000	-
	libstdc++.UNSUPPORTED	1064.000	-
	Geometric Mean	4440.453	-

UNRESOLVED

	Name	Current	%
	TOTAL.UNRESOLVED	3.000	-
	g++.UNRESOLVED	0.000	-
	gcc.UNRESOLVED	1.000	-
	libstdc++.UNRESOLVED	2.000	-
	Geometric Mean	0.156	-91.39%

UNTESTED

	Name	Current	%
	TOTAL.UNTESTED	0.000	-
	g++.UNTESTED	0.000	-
	gcc.UNTESTED	0.000	-
	libstdc++.UNTESTED	0.000	-
	Geometric Mean	0.000	-

ERROR

	Name	Current	%
	TOTAL.ERROR	0.000	-
	g++.ERROR	0.000	-
	gcc.ERROR	0.000	-
	libstdc++.ERROR	0.000	-
	Geometric Mean	0.000	-

OTHER

	Name	Current	%
	TOTAL.OTHER	1.000	-
	g++.OTHER	0.000	-
	gcc.OTHER	0.000	-
	libstdc++.OTHER	1.000	-
	Geometric Mean	0.010	-

good

	Name	Current	%
	TOTAL.good	418215.000	-
	g++.good	219127.000	-
	gcc.good	181052.000	-
	libstdc++.good	18036.000	-
	Geometric Mean	131525.440	-

bad

	Name	Current	%
	TOTAL.bad	148.000	-3.27%
	g++.bad	13.000	-31.58%
	gcc.bad	113.000	-
	libstdc++.bad	22.000	4.76%
	Geometric Mean	46.766	-8.75%

fails

	Name	Current	%
	TOTAL.fails	147.000	-3.92%
	Geometric Mean	147.000	-3.92%

flaky

	Name	Current	%
	TOTAL.flaky	7.000	40.00%
	Geometric Mean	7.000	40.00%

all

	Name	Current	%
	TOTAL.all	418363.000	-
	Geometric Mean	418363.000	-