Machine Info

Fields

hardware	None
os	None

Parameters

Run Info

Fields

Name	Value

Parameters

Name	Value
git_binutils	https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=74affa1bc070ff0530b2a1b92d8d9fbcae6024ec (unchanged)
git_gcc	https://github.com/gcc-mirror/gcc/commit/c7f6537db94f7c6320a5a8ecaa387c9b9ce1f0ac (+ 1 commits)
git_gdb	https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=74affa1bc070ff0530b2a1b92d8d9fbcae6024ec (unchanged)
git_newlib	https://sourceware.org/git/?p=newlib-cygwin.git;a=commit;h=61ccd3f94f92bcfc0940f0595ea5b3b72bce3c6d (unchanged)
git_qemu	https://gitlab.com/qemu-project/qemu/commit/34a5cb6d8434303c170230644b2a7c1d5781d197 (unchanged)
regression	https://linaro.atlassian.net/browse/GNU-1014
test_url	https://ci.linaro.org/job/tcwg_gnu_embed_check_gcc--master-thumb_m3_eabi-build/204/

Report

Filter

master-thumb_m3_eabi test results

Run	Order	Start Time	Duration
Current	0204 (basepoints/gcc-14-05524-gc7f6537db94)	2023-11-17T03:19:50	0:00:00
Previous	0203 (basepoints/gcc-14-05523-g7ffa63df8f5)	2023-11-16T18:29:21	0:00:00
Baseline	0005 (5-changed-components)	2023-08-03T00:00:40	0:00:00

Tests Summary

Status Group	#	# (B)
Performance Regressions	6	17
Performance Improvements	0	11
Added Tests	17	20
Unchanged Tests	742	717
Total Tests	765

Run-Over-Run Changes Detail

Performance Regressions - FAIL	Δ	Previous	Current	σ	Δ (B)	σ (B)
g++.FAIL	5.56%	108.000	114.000	-	280.00%	-
TOTAL.FAIL	1.71%	350.000	356.000	-	229.63%	-

Performance Regressions - bad	Δ	Previous	Current	σ	Δ (B)	σ (B)
g++.bad	4.48%	134.000	140.000	-	241.46%	-
TOTAL.bad	1.48%	405.000	411.000	-	197.83%	-

Performance Regressions - fails	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.fails	1.48%	405.000	411.000	-	0.00%	-

Performance Regressions - flaky	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.flaky	50.00%	2.000	3.000	-	0.00%	-

Added Tests - ERROR
TOTAL.ERROR
g++.ERROR
gcc.ERROR
libstdc++.ERROR

Added Tests - KFAIL
TOTAL.KFAIL
g++.KFAIL
gcc.KFAIL
libstdc++.KFAIL

Added Tests - OTHER
TOTAL.OTHER
g++.OTHER
gcc.OTHER
libstdc++.OTHER

Added Tests - UNRESOLVED
libstdc++.UNRESOLVED

Added Tests - UNTESTED
TOTAL.UNTESTED
g++.UNTESTED
gcc.UNTESTED
libstdc++.UNTESTED

Run-Over-Baseline Changes Detail

Performance Regressions - FAIL	Δ (B)	Baseline	Current	σ (B)	Δ	σ
gcc.FAIL	303.64%	55.000	222.000	-	0.00%	-
g++.FAIL	280.00%	30.000	114.000	-	5.56%	-
TOTAL.FAIL	229.63%	108.000	356.000	-	1.71%	-

Performance Regressions - UNRESOLVED	Δ (B)	Baseline	Current	σ (B)	Δ	σ
gcc.UNRESOLVED	2400.00%	1.000	25.000	-	0.00%	-
TOTAL.UNRESOLVED	40.00%	20.000	28.000	-	0.00%	-

Performance Regressions - UNSUPPORTED	Δ (B)	Baseline	Current	σ (B)	Δ	σ
gcc.UNSUPPORTED	33.45%	6774.000	9040.000	-	0.00%	-
libstdc++.UNSUPPORTED	3.47%	981.000	1015.000	-	0.00%	-

Performance Regressions - XFAIL	Δ (B)	Baseline	Current	σ (B)	Δ	σ
g++.XFAIL	41.14%	1179.000	1664.000	-	0.00%	-
TOTAL.XFAIL	28.33%	2174.000	2790.000	-	0.00%	-
libstdc++.XFAIL	17.12%	111.000	130.000	-	0.00%	-
gcc.XFAIL	12.67%	884.000	996.000	-	0.00%	-

Performance Regressions - XPASS	Δ (B)	Baseline	Current	σ (B)	Δ	σ
g++.XPASS	187.50%	8.000	23.000	-	0.00%	-
TOTAL.XPASS	170.00%	10.000	27.000	-	0.00%	-
libstdc++.XPASS	50.00%	2.000	3.000	-	0.00%	-

Performance Regressions - bad	Δ (B)	Baseline	Current	σ (B)	Δ	σ
gcc.bad	342.86%	56.000	248.000	-	0.00%	-
g++.bad	241.46%	41.000	140.000	-	4.48%	-
TOTAL.bad	197.83%	138.000	411.000	-	1.48%	-

Performance Improvements - FAIL	Δ (B)	Baseline	Current	σ (B)	Δ	σ
libstdc++.FAIL	-13.04%	23.000	20.000	-	0.00%	-

Performance Improvements - PASS	Δ (B)	Baseline	Current	σ (B)	Δ	σ
gcc.PASS	18.52%	129391.000	153349.000	-	0.00%	-
libstdc++.PASS	14.95%	13541.000	15566.000	-	0.21%	-
TOTAL.PASS	13.45%	332658.000	377406.000	-	0.01%	-
g++.PASS	9.89%	189726.000	208491.000	-	-0.00%	-

Performance Improvements - UNSUPPORTED	Δ (B)	Baseline	Current	σ (B)	Δ	σ
g++.UNSUPPORTED	-15.97%	13485.000	11331.000	-	0.00%	-

Performance Improvements - bad	Δ (B)	Baseline	Current	σ (B)	Δ	σ
libstdc++.bad	-43.90%	41.000	23.000	-	0.00%	-

Performance Improvements - good	Δ (B)	Baseline	Current	σ (B)	Δ	σ
gcc.good	19.22%	137049.000	163385.000	-	0.00%	-
libstdc++.good	14.20%	14633.000	16711.000	-	0.19%	-
TOTAL.good	12.78%	356072.000	401582.000	-	0.01%	-
g++.good	8.36%	204390.000	221486.000	-	-0.00%	-

Added Tests - ERROR
TOTAL.ERROR
g++.ERROR
gcc.ERROR
libstdc++.ERROR

Added Tests - KFAIL
TOTAL.KFAIL
g++.KFAIL
gcc.KFAIL
libstdc++.KFAIL

Added Tests - OTHER
TOTAL.OTHER
g++.OTHER
gcc.OTHER
libstdc++.OTHER

Added Tests - UNRESOLVED
libstdc++.UNRESOLVED

Added Tests - UNTESTED
TOTAL.UNTESTED
g++.UNTESTED
gcc.UNTESTED
libstdc++.UNTESTED

Added Tests - all
TOTAL.all

Added Tests - fails
TOTAL.fails

Added Tests - flaky
TOTAL.flaky

Report Time: 0.35s

PASS

	Name	Current	%
	TOTAL.PASS	377406.000	-
	g++.PASS	208491.000	-
	gcc.PASS	153349.000	-
	libstdc++.PASS	15566.000	-
	Geometric Mean	117068.087	-

XPASS

	Name	Current	%
	TOTAL.XPASS	27.000	-
	g++.XPASS	23.000	-
	gcc.XPASS	1.000	-
	libstdc++.XPASS	3.000	-
	Geometric Mean	6.570	-

FAIL

	Name	Current	%
	TOTAL.FAIL	356.000	1.71%
	g++.FAIL	114.000	5.56%
	gcc.FAIL	222.000	-
	libstdc++.FAIL	20.000	-
	Geometric Mean	115.860	1.79%

XFAIL

	Name	Current	%
	TOTAL.XFAIL	2790.000	-
	g++.XFAIL	1664.000	-
	gcc.XFAIL	996.000	-
	libstdc++.XFAIL	130.000	-
	Geometric Mean	880.522	-

KFAIL

	Name	Current	%
	TOTAL.KFAIL	0.000	-
	g++.KFAIL	0.000	-
	gcc.KFAIL	0.000	-
	libstdc++.KFAIL	0.000	-
	Geometric Mean	0.000	-

UNSUPPORTED

	Name	Current	%
	TOTAL.UNSUPPORTED	21386.000	-
	g++.UNSUPPORTED	11331.000	-
	gcc.UNSUPPORTED	9040.000	-
	libstdc++.UNSUPPORTED	1015.000	-
	Geometric Mean	6866.858	-

UNRESOLVED

	Name	Current	%
	TOTAL.UNRESOLVED	28.000	-
	g++.UNRESOLVED	3.000	-
	gcc.UNRESOLVED	25.000	-
	libstdc++.UNRESOLVED	0.000	-
	Geometric Mean	0.677	-94.71%

UNTESTED

	Name	Current	%
	TOTAL.UNTESTED	0.000	-
	g++.UNTESTED	0.000	-
	gcc.UNTESTED	0.000	-
	libstdc++.UNTESTED	0.000	-
	Geometric Mean	0.000	-

ERROR

	Name	Current	%
	TOTAL.ERROR	0.000	-
	g++.ERROR	0.000	-
	gcc.ERROR	0.000	-
	libstdc++.ERROR	0.000	-
	Geometric Mean	0.000	-

OTHER

	Name	Current	%
	TOTAL.OTHER	0.000	-
	g++.OTHER	0.000	-
	gcc.OTHER	0.000	-
	libstdc++.OTHER	0.000	-
	Geometric Mean	0.000	-

good

	Name	Current	%
	TOTAL.good	401582.000	-
	g++.good	221486.000	-
	gcc.good	163385.000	-
	libstdc++.good	16711.000	-
	Geometric Mean	124834.258	-

bad

	Name	Current	%
	TOTAL.bad	411.000	1.48%
	g++.bad	140.000	4.48%
	gcc.bad	248.000	-
	libstdc++.bad	23.000	-
	Geometric Mean	134.598	1.47%

fails

	Name	Current	%
	TOTAL.fails	411.000	1.48%
	Geometric Mean	411.000	1.48%

flaky

	Name	Current	%
	TOTAL.flaky	3.000	50.00%
	Geometric Mean	3.000	50.00%

all

	Name	Current	%
	TOTAL.all	401993.000	-
	Geometric Mean	401993.000	-