Machine Info

Fields

hardware	None
os	None

Parameters

Run Info

Fields

Name	Value

Parameters

Name	Value
git_binutils	https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=3e35b4deae28d3653226403452328c680ef7f5b2 (+ 459 commits)
git_gcc	https://github.com/gcc-mirror/gcc/commit/1ec49897253e093e1ef6261eb104ac0c111bac83 (+ 628 commits)
git_gdb	https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=3e35b4deae28d3653226403452328c680ef7f5b2 (+ 459 commits)
git_newlib	https://sourceware.org/git/?p=newlib-cygwin.git;a=commit;h=10b921681108b333d17d8438a45afe6fbc1169dd (+ 21 commits)
git_qemu	https://gitlab.com/qemu-project/qemu/commit/d67a6e054b92e5e1cbb7b0bd5782a670cc7f0df7 (+ 1156 commits)
test_url	https://ci.linaro.org/job/tcwg_gnu_embed_check_gcc--master-thumb_m0_soft_eabi-build/31/

Report

Filter

master-thumb_m0_soft_eabi test results

Run	Order	Start Time	Duration
Current	0031 (5-changed-components)	2024-05-11T00:25:33	0:00:00
Previous	0171 (basepoints/gcc-15-03575-gc07cf418fdde)	2024-09-28T02:38:31	0:00:00
Baseline	0002 (5-changed-components)	2024-04-16T12:17:35	0:00:00

Tests Summary

Status Group	#	# (B)
Performance Regressions	7	0
Performance Improvements	25	7
Added Tests	16	16
Unchanged Tests	717	742
Total Tests	765

Run-Over-Run Changes Detail

Performance Regressions - UNSUPPORTED	Δ	Previous	Current	σ	Δ (B)	σ (B)
g++.UNSUPPORTED	370.40%	2524.000	11873.000	-	0.45%	-
TOTAL.UNSUPPORTED	98.06%	9186.000	18194.000	-	0.40%	-

Performance Regressions - XFAIL	Δ	Previous	Current	σ	Δ (B)	σ (B)
libstdc++.XFAIL	1355.56%	9.000	131.000	-	0.00%	-
g++.XFAIL	20.99%	1410.000	1706.000	-	-0.18%	-
TOTAL.XFAIL	18.37%	2313.000	2738.000	-	-0.11%	-

Performance Regressions - XPASS	Δ	Previous	Current	σ	Δ (B)	σ (B)
g++.XPASS	400.00%	2.000	10.000	-	0.00%	-
TOTAL.XPASS	114.29%	7.000	15.000	-	0.00%	-

Performance Improvements - FAIL	Δ	Previous	Current	σ	Δ (B)	σ (B)
libstdc++.FAIL	-99.68%	4689.000	15.000	-	0.00%	-
g++.FAIL	-99.53%	10197.000	48.000	-	-2.04%	-
TOTAL.FAIL	-99.47%	37321.000	198.000	-	-1.49%	-
gcc.FAIL	-99.40%	22435.000	135.000	-	-1.46%	-

Performance Improvements - PASS	Δ	Previous	Current	σ	Δ (B)	σ (B)
libstdc++.PASS	162.72%	6036.000	15858.000	-	0.15%	-
gcc.PASS	40.42%	105562.000	148230.000	-	0.07%	-
TOTAL.PASS	32.30%	292452.000	386901.000	-	0.25%	-
g++.PASS	23.20%	180854.000	222813.000	-	0.37%	-

Performance Improvements - UNRESOLVED	Δ	Previous	Current	σ	Δ (B)	σ (B)
g++.UNRESOLVED	-99.97%	8910.000	3.000	-	0.00%	-
libstdc++.UNRESOLVED	-99.91%	4637.000	4.000	-	0.00%	-
TOTAL.UNRESOLVED	-99.90%	34295.000	35.000	-	0.00%	-
gcc.UNRESOLVED	-99.87%	20748.000	28.000	-	0.00%	-

Performance Improvements - UNSUPPORTED	Δ	Previous	Current	σ	Δ (B)	σ (B)
libstdc++.UNSUPPORTED	-11.85%	1198.000	1056.000	-	0.00%	-
gcc.UNSUPPORTED	-3.64%	5464.000	5265.000	-	0.38%	-

Performance Improvements - XPASS	Δ	Previous	Current	σ	Δ (B)	σ (B)
gcc.XPASS	-40.00%	5.000	3.000	-	0.00%	-

Performance Improvements - all	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.all	8.66%	375574.000	408081.000	-	0.25%	-

Performance Improvements - bad	Δ	Previous	Current	σ	Δ (B)	σ (B)
libstdc++.bad	-99.77%	9326.000	21.000	-	0.00%	-
g++.bad	-99.68%	19109.000	61.000	-	-1.61%	-
TOTAL.bad	-99.65%	71623.000	248.000	-	-1.20%	-
gcc.bad	-99.62%	43188.000	166.000	-	-1.19%	-

Performance Improvements - fails	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.fails	-99.65%	71623.000	248.000	-	-1.20%	-

Performance Improvements - good	Δ	Previous	Current	σ	Δ (B)	σ (B)
libstdc++.good	135.33%	7243.000	17045.000	-	0.14%	-
gcc.good	37.95%	111920.000	154396.000	-	0.08%	-
TOTAL.good	34.18%	303951.000	407833.000	-	0.25%	-
g++.good	27.93%	184788.000	236392.000	-	0.37%	-

Added Tests - ERROR
TOTAL.ERROR
g++.ERROR
gcc.ERROR
libstdc++.ERROR

Added Tests - KFAIL
TOTAL.KFAIL
g++.KFAIL
gcc.KFAIL
libstdc++.KFAIL

Added Tests - OTHER
TOTAL.OTHER
g++.OTHER
gcc.OTHER
libstdc++.OTHER

Added Tests - UNTESTED
TOTAL.UNTESTED
g++.UNTESTED
gcc.UNTESTED
libstdc++.UNTESTED

Run-Over-Baseline Changes Detail

Performance Improvements - FAIL	Δ (B)	Baseline	Current	σ (B)	Δ	σ
g++.FAIL	-2.04%	49.000	48.000	-	-99.53%	-
TOTAL.FAIL	-1.49%	201.000	198.000	-	-99.47%	-
gcc.FAIL	-1.46%	137.000	135.000	-	-99.40%	-

Performance Improvements - bad	Δ (B)	Baseline	Current	σ (B)	Δ	σ
g++.bad	-1.61%	62.000	61.000	-	-99.68%	-
TOTAL.bad	-1.20%	251.000	248.000	-	-99.65%	-
gcc.bad	-1.19%	168.000	166.000	-	-99.62%	-

Performance Improvements - fails	Δ (B)	Baseline	Current	σ (B)	Δ	σ
TOTAL.fails	-1.20%	251.000	248.000	-	-99.65%	-

Added Tests - ERROR
TOTAL.ERROR
g++.ERROR
gcc.ERROR
libstdc++.ERROR

Added Tests - KFAIL
TOTAL.KFAIL
g++.KFAIL
gcc.KFAIL
libstdc++.KFAIL

Added Tests - OTHER
TOTAL.OTHER
g++.OTHER
gcc.OTHER
libstdc++.OTHER

Added Tests - UNTESTED
TOTAL.UNTESTED
g++.UNTESTED
gcc.UNTESTED
libstdc++.UNTESTED

Report Time: 0.18s

PASS

	Name	Current	%
	TOTAL.PASS	386901.000	32.30%
	g++.PASS	222813.000	23.20%
	gcc.PASS	148230.000	40.42%
	libstdc++.PASS	15858.000	162.72%
	Geometric Mean	119311.203	56.59%

XPASS

	Name	Current	%
	TOTAL.XPASS	15.000	114.29%
	g++.XPASS	10.000	400.00%
	gcc.XPASS	3.000	-40.00%
	libstdc++.XPASS	2.000	-
	Geometric Mean	5.477	1794.22%

FAIL

	Name	Current	%
	TOTAL.FAIL	198.000	-99.47%
	g++.FAIL	48.000	-99.53%
	gcc.FAIL	135.000	-99.40%
	libstdc++.FAIL	15.000	-99.68%
	Geometric Mean	66.234	-99.53%

XFAIL

	Name	Current	%
	TOTAL.XFAIL	2738.000	18.37%
	g++.XFAIL	1706.000	20.99%
	gcc.XFAIL	901.000	-
	libstdc++.XFAIL	131.000	1355.56%
	Geometric Mean	861.692	114.10%

KFAIL

	Name	Current	%
	TOTAL.KFAIL	0.000	-
	g++.KFAIL	0.000	-
	gcc.KFAIL	0.000	-
	libstdc++.KFAIL	0.000	-
	Geometric Mean	0.000	-

UNSUPPORTED

	Name	Current	%
	TOTAL.UNSUPPORTED	18194.000	98.06%
	g++.UNSUPPORTED	11873.000	370.40%
	gcc.UNSUPPORTED	5265.000	-3.64%
	libstdc++.UNSUPPORTED	1056.000	-11.85%
	Geometric Mean	5886.915	67.72%

UNRESOLVED

	Name	Current	%
	TOTAL.UNRESOLVED	35.000	-99.90%
	g++.UNRESOLVED	3.000	-99.97%
	gcc.UNRESOLVED	28.000	-99.87%
	libstdc++.UNRESOLVED	4.000	-99.91%
	Geometric Mean	10.414	-99.92%

UNTESTED

	Name	Current	%
	TOTAL.UNTESTED	0.000	-
	g++.UNTESTED	0.000	-
	gcc.UNTESTED	0.000	-
	libstdc++.UNTESTED	0.000	-
	Geometric Mean	0.000	-

ERROR

	Name	Current	%
	TOTAL.ERROR	0.000	-
	g++.ERROR	0.000	-
	gcc.ERROR	0.000	-
	libstdc++.ERROR	0.000	-
	Geometric Mean	0.000	-

OTHER

	Name	Current	%
	TOTAL.OTHER	0.000	-
	g++.OTHER	0.000	-
	gcc.OTHER	0.000	-
	libstdc++.OTHER	0.000	-
	Geometric Mean	0.000	-

good

	Name	Current	%
	TOTAL.good	407833.000	34.18%
	g++.good	236392.000	27.93%
	gcc.good	154396.000	37.95%
	libstdc++.good	17045.000	135.33%
	Geometric Mean	126208.047	53.64%

bad

	Name	Current	%
	TOTAL.bad	248.000	-99.65%
	g++.bad	61.000	-99.68%
	gcc.bad	166.000	-99.62%
	libstdc++.bad	21.000	-99.77%
	Geometric Mean	85.217	-99.69%

fails

	Name	Current	%
	TOTAL.fails	248.000	-99.65%
	Geometric Mean	248.000	-99.65%

flaky

	Name	Current	%
	TOTAL.flaky	51.000	-
	Geometric Mean	51.000	-

all

	Name	Current	%
	TOTAL.all	408081.000	8.66%
	Geometric Mean	408081.000	8.66%