Baseline and compare_to are the same: disabling baseline. ×

Machine Info

Fields

hardware	None
os	None

Parameters

Run Info

Fields

Name	Value

Parameters

Name	Value
git_binutils	https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=fa4f2d46f95a1c673b025fab7f292cb864a99020 (unchanged)
git_gcc	https://github.com/gcc-mirror/gcc/commit/ddd64a6ec3b38e18aefb9fcba50c0d9297e5e711 (+ 1 commits)
git_gdb	https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=fa4f2d46f95a1c673b025fab7f292cb864a99020 (unchanged)
git_newlib	https://sourceware.org/git/?p=newlib-cygwin.git;a=commit;h=90d3b16d2b93d573501394d88538c99335edc343 (unchanged)
git_qemu	https://gitlab.com/qemu-project/qemu/commit/b0dd9a7d6dd15a6898e9c585b521e6bec79b25aa (unchanged)
regression	https://linaro.atlassian.net/browse/GNU-894
test_url	https://ci.linaro.org/job/tcwg_gnu_embed_check_gcc--master-thumb_m23_eabi-build/94/

Report

Filter

master-thumb_m23_eabi test results

Run	Order	Start Time	Duration
Current	0094 (basepoints/gcc-14-03432-gddd64a6ec3b)	2023-08-23T21:22:45	0:00:00
Previous	0001 (5-changed-components)	2023-08-01T01:14:40	0:00:00
No Baseline Run

Tests Summary

Status Group	#
Performance Regressions	16
Performance Improvements	9
Added Tests	19
Unchanged Tests	721
Total Tests	765

Run-Over-Run Changes Detail

Performance Regressions - FAIL	Δ	Previous	Current	σ
gcc.FAIL	367.44%	43.000	201.000	-
TOTAL.FAIL	171.43%	98.000	266.000	-
g++.FAIL	24.24%	33.000	41.000	-
libstdc++.FAIL	9.09%	22.000	24.000	-

Performance Regressions - UNRESOLVED	Δ	Previous	Current	σ
gcc.UNRESOLVED	600.00%	6.000	42.000	-
TOTAL.UNRESOLVED	152.00%	25.000	63.000	-
libstdc++.UNRESOLVED	12.50%	16.000	18.000	-

Performance Regressions - XFAIL	Δ	Previous	Current	σ
gcc.XFAIL	2.63%	837.000	859.000	-
TOTAL.XFAIL	1.91%	1987.000	2025.000	-
g++.XFAIL	1.54%	1039.000	1055.000	-

Performance Regressions - XPASS	Δ	Previous	Current	σ
g++.XPASS	25.00%	8.000	10.000	-
TOTAL.XPASS	15.38%	13.000	15.000	-

Performance Regressions - bad	Δ	Previous	Current	σ
gcc.bad	373.08%	52.000	246.000	-
TOTAL.bad	152.94%	136.000	344.000	-
g++.bad	22.73%	44.000	54.000	-
libstdc++.bad	10.00%	40.000	44.000	-

Performance Improvements - PASS	Δ	Previous	Current	σ
gcc.PASS	12.99%	129607.000	146445.000	-
TOTAL.PASS	8.04%	332802.000	359547.000	-
g++.PASS	5.22%	189653.000	199548.000	-

Performance Improvements - UNSUPPORTED	Δ	Previous	Current	σ
gcc.UNSUPPORTED	-37.63%	7069.000	4409.000	-
TOTAL.UNSUPPORTED	-23.36%	21587.000	16545.000	-
g++.UNSUPPORTED	-17.63%	13537.000	11151.000	-

Performance Improvements - good	Δ	Previous	Current	σ
gcc.good	10.33%	137513.000	151713.000	-
TOTAL.good	6.10%	356376.000	378117.000	-
g++.good	3.68%	204229.000	211754.000	-

Added Tests - ERROR
TOTAL.ERROR
g++.ERROR
gcc.ERROR
libstdc++.ERROR

Added Tests - KFAIL
TOTAL.KFAIL
g++.KFAIL
gcc.KFAIL
libstdc++.KFAIL

Added Tests - OTHER
TOTAL.OTHER
g++.OTHER
gcc.OTHER
libstdc++.OTHER

Added Tests - UNTESTED
TOTAL.UNTESTED
g++.UNTESTED
gcc.UNTESTED
libstdc++.UNTESTED

Added Tests - all
TOTAL.all

Added Tests - fails
TOTAL.fails

Added Tests - flaky
TOTAL.flaky

Run-Over-Baseline Changes Detail

Report Time: 0.32s

PASS

	Name	Current	%
	TOTAL.PASS	359547.000	8.04%
	g++.PASS	199548.000	5.22%
	gcc.PASS	146445.000	12.99%
	libstdc++.PASS	13554.000	-
	Geometric Mean	109241.152	6.48%

XPASS

	Name	Current	%
	TOTAL.XPASS	15.000	15.38%
	g++.XPASS	10.000	25.00%
	gcc.XPASS	3.000	-
	libstdc++.XPASS	2.000	-
	Geometric Mean	5.477	9.59%

FAIL

	Name	Current	%
	TOTAL.FAIL	266.000	171.43%
	g++.FAIL	41.000	24.24%
	gcc.FAIL	201.000	367.44%
	libstdc++.FAIL	24.000	9.09%
	Geometric Mean	85.166	103.64%

XFAIL

	Name	Current	%
	TOTAL.XFAIL	2025.000	1.91%
	g++.XFAIL	1055.000	1.54%
	gcc.XFAIL	859.000	2.63%
	libstdc++.XFAIL	111.000	-
	Geometric Mean	671.813	1.52%

KFAIL

	Name	Current	%
	TOTAL.KFAIL	0.000	-
	g++.KFAIL	0.000	-
	gcc.KFAIL	0.000	-
	libstdc++.KFAIL	0.000	-
	Geometric Mean	0.000	-

UNSUPPORTED

	Name	Current	%
	TOTAL.UNSUPPORTED	16545.000	-23.36%
	g++.UNSUPPORTED	11151.000	-17.63%
	gcc.UNSUPPORTED	4409.000	-37.63%
	libstdc++.UNSUPPORTED	985.000	-
	Geometric Mean	5320.338	-20.70%

UNRESOLVED

	Name	Current	%
	TOTAL.UNRESOLVED	63.000	152.00%
	g++.UNRESOLVED	3.000	-
	gcc.UNRESOLVED	42.000	600.00%
	libstdc++.UNRESOLVED	18.000	12.50%
	Geometric Mean	19.442	111.06%

UNTESTED

	Name	Current	%
	TOTAL.UNTESTED	0.000	-
	g++.UNTESTED	0.000	-
	gcc.UNTESTED	0.000	-
	libstdc++.UNTESTED	0.000	-
	Geometric Mean	0.000	-

ERROR

	Name	Current	%
	TOTAL.ERROR	0.000	-
	g++.ERROR	0.000	-
	gcc.ERROR	0.000	-
	libstdc++.ERROR	0.000	-
	Geometric Mean	0.000	-

OTHER

	Name	Current	%
	TOTAL.OTHER	0.000	-
	g++.OTHER	0.000	-
	gcc.OTHER	0.000	-
	libstdc++.OTHER	0.000	-
	Geometric Mean	0.000	-

good

	Name	Current	%
	TOTAL.good	378117.000	6.10%
	g++.good	211754.000	3.68%
	gcc.good	151713.000	10.33%
	libstdc++.good	14650.000	-
	Geometric Mean	115499.356	4.99%

bad

	Name	Current	%
	TOTAL.bad	344.000	152.94%
	g++.bad	54.000	22.73%
	gcc.bad	246.000	373.08%
	libstdc++.bad	44.000	10.00%
	Geometric Mean	119.079	100.48%

fails

	Name	Current	%
	TOTAL.fails	344.000	-
	Geometric Mean	344.000	-

flaky

	Name	Current	%
	TOTAL.flaky	76.000	-
	Geometric Mean	76.000	-

all

	Name	Current	%
	TOTAL.all	378461.000	-
	Geometric Mean	378461.000	-