Machine Info

Fields

hardware	None
os	None

Parameters

Run Info

Fields

Name	Value

Parameters

Name	Value
git_binutils	https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=086a2beb152c95ac43ac6b73859eb9e9081fc2df (unchanged)
git_gcc	https://gcc.gnu.org/git/gcc.git (9eaecce3d8c1d9349adbf8c2cdaf8d87672ed29c) (+ 372 commits)
git_gdb	https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=086a2beb152c95ac43ac6b73859eb9e9081fc2df (unchanged)
git_newlib	https://sourceware.org/git/?p=newlib-cygwin.git;a=commit;h=c607889824395f0eac7e85d5b81c906bf8025321 (unchanged)
git_qemu	https://gitlab.com/qemu-project/qemu/commit/92ec7805190313c9e628f8fc4eb4f932c15247bd (unchanged)
test_url	https://ci.linaro.org/job/tcwg_gnu_embed_check_gcc--master-thumb_m7_hard_eabi-build/229/

Report

Filter

master-thumb_m7_hard_eabi test results

Run	Order	Start Time	Duration
Current	0229 (basepoints/gcc-15-04234-g9eaecce3d8c)	2024-10-24T21:51:27	0:00:00
Previous	0232 (basepoints/gcc-15-04467-gd3d41ec6092)	2024-10-30T18:23:17	0:00:00
Baseline	0049 (basepoints/gcc-15-00267-gcb478e0a6f3)	2024-05-23T17:43:55	0:00:00

Tests Summary

Status Group	#	# (B)
Performance Regressions	3	10
Performance Improvements	7	12
Added Tests	16	16
Unchanged Tests	739	727
Total Tests	765

Run-Over-Run Changes Detail

Performance Regressions - FAIL	Δ	Previous	Current	σ	Δ (B)	σ (B)
libstdc++.FAIL	6.67%	15.000	16.000	-	0.00%	-

Performance Regressions - XFAIL	Δ	Previous	Current	σ	Δ (B)	σ (B)
gcc.XFAIL	1.20%	1002.000	1014.000	-	-0.20%	-

Performance Regressions - bad	Δ	Previous	Current	σ	Δ (B)	σ (B)
libstdc++.bad	4.76%	21.000	22.000	-	0.00%	-

Performance Improvements - FAIL	Δ	Previous	Current	σ	Δ (B)	σ (B)
gcc.FAIL	-1.74%	288.000	283.000	-	5.60%	-
TOTAL.FAIL	-1.20%	334.000	330.000	-	0.61%	-

Performance Improvements - XPASS	Δ	Previous	Current	σ	Δ (B)	σ (B)
gcc.XPASS	-33.33%	3.000	2.000	-	0.00%	-
TOTAL.XPASS	-14.29%	7.000	6.000	-	-50.00%	-

Performance Improvements - bad	Δ	Previous	Current	σ	Δ (B)	σ (B)
gcc.bad	-2.05%	293.000	287.000	-	6.69%	-
TOTAL.bad	-1.42%	353.000	348.000	-	-0.85%	-

Performance Improvements - fails	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.fails	-1.42%	353.000	348.000	-	-0.85%	-

Added Tests - ERROR
TOTAL.ERROR
g++.ERROR
gcc.ERROR
libstdc++.ERROR

Added Tests - KFAIL
TOTAL.KFAIL
g++.KFAIL
gcc.KFAIL
libstdc++.KFAIL

Added Tests - OTHER
TOTAL.OTHER
g++.OTHER
gcc.OTHER
libstdc++.OTHER

Added Tests - UNTESTED
TOTAL.UNTESTED
g++.UNTESTED
gcc.UNTESTED
libstdc++.UNTESTED

Run-Over-Baseline Changes Detail

Performance Regressions - FAIL	Δ (B)	Baseline	Current	σ (B)	Δ	σ
gcc.FAIL	5.60%	268.000	283.000	-	-1.74%	-

Performance Regressions - PASS	Δ (B)	Baseline	Current	σ (B)	Δ	σ
g++.PASS	-9.15%	223179.000	202764.000	-	-0.20%	-
TOTAL.PASS	-4.54%	399639.000	381502.000	-	-0.28%	-

Performance Regressions - UNRESOLVED	Δ (B)	Baseline	Current	σ (B)	Δ	σ
gcc.UNRESOLVED	100.00%	1.000	2.000	-	0.00%	-
TOTAL.UNRESOLVED	9.09%	11.000	12.000	-	0.00%	-

Performance Regressions - UNSUPPORTED	Δ (B)	Baseline	Current	σ (B)	Δ	σ
gcc.UNSUPPORTED	2.15%	9379.000	9581.000	-	-0.36%	-

Performance Regressions - all	Δ (B)	Baseline	Current	σ (B)	Δ	σ
TOTAL.all	-6.50%	425280.000	397617.000	-	-0.27%	-

Performance Regressions - bad	Δ (B)	Baseline	Current	σ (B)	Δ	σ
gcc.bad	6.69%	269.000	287.000	-	-2.05%	-

Performance Regressions - good	Δ (B)	Baseline	Current	σ (B)	Δ	σ
g++.good	-12.72%	236918.000	206773.000	-	-0.19%	-
TOTAL.good	-6.51%	424929.000	397269.000	-	-0.27%	-

Performance Improvements - FAIL	Δ (B)	Baseline	Current	σ (B)	Δ	σ
g++.FAIL	-29.55%	44.000	31.000	-	0.00%	-

Performance Improvements - PASS	Δ (B)	Baseline	Current	σ (B)	Δ	σ
gcc.PASS	1.30%	160521.000	162614.000	-	-0.40%	-
libstdc++.PASS	1.16%	15939.000	16124.000	-	-0.02%	-

Performance Improvements - UNSUPPORTED	Δ (B)	Baseline	Current	σ (B)	Δ	σ
g++.UNSUPPORTED	-79.13%	11885.000	2480.000	-	0.00%	-
TOTAL.UNSUPPORTED	-41.26%	22289.000	13092.000	-	-0.28%	-

Performance Improvements - XFAIL	Δ (B)	Baseline	Current	σ (B)	Δ	σ
g++.XFAIL	-17.53%	1854.000	1529.000	-	0.79%	-
TOTAL.XFAIL	-10.86%	3001.000	2675.000	-	0.91%	-

Performance Improvements - XPASS	Δ (B)	Baseline	Current	σ (B)	Δ	σ
g++.XPASS	-80.00%	10.000	2.000	-	0.00%	-
TOTAL.XPASS	-50.00%	12.000	6.000	-	-14.29%	-

Performance Improvements - bad	Δ (B)	Baseline	Current	σ (B)	Δ	σ
g++.bad	-35.00%	60.000	39.000	-	0.00%	-

Performance Improvements - good	Δ (B)	Baseline	Current	σ (B)	Δ	σ
gcc.good	1.34%	170916.000	173209.000	-	-0.39%	-
libstdc++.good	1.12%	17095.000	17287.000	-	-0.03%	-

Added Tests - ERROR
TOTAL.ERROR
g++.ERROR
gcc.ERROR
libstdc++.ERROR

Added Tests - KFAIL
TOTAL.KFAIL
g++.KFAIL
gcc.KFAIL
libstdc++.KFAIL

Added Tests - OTHER
TOTAL.OTHER
g++.OTHER
gcc.OTHER
libstdc++.OTHER

Added Tests - UNTESTED
TOTAL.UNTESTED
g++.UNTESTED
gcc.UNTESTED
libstdc++.UNTESTED

Report Time: 0.35s

PASS

	Name	Current	%
	TOTAL.PASS	381502.000	-
	g++.PASS	202764.000	-
	gcc.PASS	162614.000	-
	libstdc++.PASS	16124.000	-
	Geometric Mean	119338.232	-

XPASS

	Name	Current	%
	TOTAL.XPASS	6.000	-14.29%
	g++.XPASS	2.000	-
	gcc.XPASS	2.000	-33.33%
	libstdc++.XPASS	2.000	-
	Geometric Mean	2.632	-13.06%

FAIL

	Name	Current	%
	TOTAL.FAIL	330.000	-1.20%
	g++.FAIL	31.000	-
	gcc.FAIL	283.000	-1.74%
	libstdc++.FAIL	16.000	6.67%
	Geometric Mean	82.499	-

XFAIL

	Name	Current	%
	TOTAL.XFAIL	2675.000	-
	g++.XFAIL	1529.000	-
	gcc.XFAIL	1014.000	1.20%
	libstdc++.XFAIL	132.000	-
	Geometric Mean	860.173	-

KFAIL

	Name	Current	%
	TOTAL.KFAIL	0.000	-
	g++.KFAIL	0.000	-
	gcc.KFAIL	0.000	-
	libstdc++.KFAIL	0.000	-
	Geometric Mean	0.000	-

UNSUPPORTED

	Name	Current	%
	TOTAL.UNSUPPORTED	13092.000	-
	g++.UNSUPPORTED	2480.000	-
	gcc.UNSUPPORTED	9581.000	-
	libstdc++.UNSUPPORTED	1031.000	-
	Geometric Mean	4231.865	-

UNRESOLVED

	Name	Current	%
	TOTAL.UNRESOLVED	12.000	-
	g++.UNRESOLVED	6.000	-
	gcc.UNRESOLVED	2.000	-
	libstdc++.UNRESOLVED	4.000	-
	Geometric Mean	4.899	-

UNTESTED

	Name	Current	%
	TOTAL.UNTESTED	0.000	-
	g++.UNTESTED	0.000	-
	gcc.UNTESTED	0.000	-
	libstdc++.UNTESTED	0.000	-
	Geometric Mean	0.000	-

ERROR

	Name	Current	%
	TOTAL.ERROR	0.000	-
	g++.ERROR	0.000	-
	gcc.ERROR	0.000	-
	libstdc++.ERROR	0.000	-
	Geometric Mean	0.000	-

OTHER

	Name	Current	%
	TOTAL.OTHER	0.000	-
	g++.OTHER	0.000	-
	gcc.OTHER	0.000	-
	libstdc++.OTHER	0.000	-
	Geometric Mean	0.000	-

good

	Name	Current	%
	TOTAL.good	397269.000	-
	g++.good	206773.000	-
	gcc.good	173209.000	-
	libstdc++.good	17287.000	-
	Geometric Mean	125232.528	-

bad

	Name	Current	%
	TOTAL.bad	348.000	-1.42%
	g++.bad	39.000	-
	gcc.bad	287.000	-2.05%
	libstdc++.bad	22.000	4.76%
	Geometric Mean	96.214	-

fails

	Name	Current	%
	TOTAL.fails	348.000	-1.42%
	Geometric Mean	348.000	-1.42%

flaky

	Name	Current	%
	TOTAL.flaky	1.000	-
	Geometric Mean	1.000	-

all

	Name	Current	%
	TOTAL.all	397617.000	-
	Geometric Mean	397617.000	-