Machine Info

Fields

hardware	None
os	None

Parameters

Run Info

Fields

Name	Value

Parameters

Name	Value
git_binutils	https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=fd8ec8ed8258990700aaf422cea0e12208356014 (unchanged)
git_gcc	https://github.com/gcc-mirror/gcc/commit/691f682fe24d07ff5854f1f53d81909320110c9c (+ 103 commits)
git_gdb	https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=fd8ec8ed8258990700aaf422cea0e12208356014 (unchanged)
git_newlib	https://sourceware.org/git/?p=newlib-cygwin.git;a=commit;h=a422196c56fa2b5c4823d67cf92acdfc164e5da4 (unchanged)
git_qemu	https://gitlab.com/qemu-project/qemu/commit/afaee42f777bc359db95f692804f7fc7e12c0c02 (unchanged)
test_url	https://ci.linaro.org/job/tcwg_gnu_embed_check_gcc--master-thumb_m33_eabi-build/548/

Report

Filter

master-thumb_m33_eabi test results

Run	Order	Start Time	Duration
Current	0548 (basepoints/gcc-15-03231-g691f682fe24)	2024-08-27T08:05:36	0:00:00
Previous	0565 (basepoints/gcc-15-03514-gea9d4bf45ef9)	2024-09-08T23:42:24	0:00:00
Baseline	0193 (5-changed-components)	2023-10-18T15:23:24	0:00:00

Tests Summary

Status Group	#	# (B)
Performance Regressions	3	12
Performance Improvements	27	15
Added Tests	16	19
Unchanged Tests	719	719
Total Tests	765

Run-Over-Run Changes Detail

Performance Regressions - XFAIL	Δ	Previous	Current	σ	Δ (B)	σ (B)
libstdc++.XFAIL	1366.67%	9.000	132.000	-	0.76%	-
TOTAL.XFAIL	5.91%	2522.000	2671.000	-	-4.71%	-
gcc.XFAIL	1.81%	995.000	1013.000	-	1.40%	-

Performance Improvements - FAIL	Δ	Previous	Current	σ	Δ (B)	σ (B)
libstdc++.FAIL	-99.68%	4697.000	15.000	-	25.00%	-
g++.FAIL	-99.60%	10206.000	41.000	-	-60.19%	-
TOTAL.FAIL	-99.02%	37977.000	372.000	-	5.08%	-
gcc.FAIL	-98.63%	23074.000	316.000	-	32.22%	-

Performance Improvements - PASS	Δ	Previous	Current	σ	Δ (B)	σ (B)
libstdc++.PASS	164.44%	6080.000	16078.000	-	3.88%	-
gcc.PASS	36.05%	123058.000	167422.000	-	8.48%	-
TOTAL.PASS	23.67%	310538.000	384047.000	-	2.08%	-
g++.PASS	10.56%	181400.000	200547.000	-	-2.84%	-

Performance Improvements - UNRESOLVED	Δ	Previous	Current	σ	Δ (B)	σ (B)
gcc.UNRESOLVED	-99.99%	20828.000	2.000	-	-50.00%	-
TOTAL.UNRESOLVED	-99.97%	34396.000	12.000	-	9.09%	-
g++.UNRESOLVED	-99.93%	8925.000	6.000	-	-14.29%	-
libstdc++.UNRESOLVED	-99.91%	4643.000	4.000	-	0.00%	-

Performance Improvements - UNSUPPORTED	Δ	Previous	Current	σ	Δ (B)	σ (B)
libstdc++.UNSUPPORTED	-13.08%	1185.000	1030.000	-	1.58%	-
TOTAL.UNSUPPORTED	-2.57%	13452.000	13106.000	-	-38.00%	-
g++.UNSUPPORTED	-2.44%	2504.000	2443.000	-	-78.31%	-
gcc.UNSUPPORTED	-1.33%	9763.000	9633.000	-	8.69%	-

Performance Improvements - XPASS	Δ	Previous	Current	σ	Δ (B)	σ (B)
gcc.XPASS	-66.67%	6.000	2.000	-	100.00%	-
TOTAL.XPASS	-25.00%	8.000	6.000	-	-76.92%	-

Performance Improvements - bad	Δ	Previous	Current	σ	Δ (B)	σ (B)
libstdc++.bad	-99.78%	9340.000	21.000	-	50.00%	-
g++.bad	-99.74%	19133.000	49.000	-	-63.16%	-
TOTAL.bad	-99.46%	72381.000	390.000	-	-0.26%	-
gcc.bad	-99.27%	43908.000	320.000	-	31.15%	-

Performance Improvements - fails	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.fails	-99.46%	72381.000	390.000	-	0.00%	-

Performance Improvements - good	Δ	Previous	Current	σ	Δ (B)	σ (B)
libstdc++.good	137.01%	7274.000	17240.000	-	3.71%	-
gcc.good	33.07%	133816.000	178068.000	-	8.45%	-
TOTAL.good	22.45%	326512.000	399824.000	-	-0.08%	-
g++.good	10.30%	185422.000	204516.000	-	-6.76%	-

Added Tests - ERROR
TOTAL.ERROR
g++.ERROR
gcc.ERROR
libstdc++.ERROR

Added Tests - KFAIL
TOTAL.KFAIL
g++.KFAIL
gcc.KFAIL
libstdc++.KFAIL

Added Tests - OTHER
TOTAL.OTHER
g++.OTHER
gcc.OTHER
libstdc++.OTHER

Added Tests - UNTESTED
TOTAL.UNTESTED
g++.UNTESTED
gcc.UNTESTED
libstdc++.UNTESTED

Run-Over-Baseline Changes Detail

Performance Regressions - FAIL	Δ (B)	Baseline	Current	σ (B)	Δ	σ
gcc.FAIL	32.22%	239.000	316.000	-	-98.63%	-
libstdc++.FAIL	25.00%	12.000	15.000	-	-99.68%	-
TOTAL.FAIL	5.08%	354.000	372.000	-	-99.02%	-

Performance Regressions - PASS	Δ (B)	Baseline	Current	σ (B)	Δ	σ
g++.PASS	-2.84%	206412.000	200547.000	-	10.56%	-

Performance Regressions - UNRESOLVED	Δ (B)	Baseline	Current	σ (B)	Δ	σ
TOTAL.UNRESOLVED	9.09%	11.000	12.000	-	-99.97%	-

Performance Regressions - UNSUPPORTED	Δ (B)	Baseline	Current	σ (B)	Δ	σ
gcc.UNSUPPORTED	8.69%	8863.000	9633.000	-	-1.33%	-
libstdc++.UNSUPPORTED	1.58%	1014.000	1030.000	-	-13.08%	-

Performance Regressions - XFAIL	Δ (B)	Baseline	Current	σ (B)	Δ	σ
gcc.XFAIL	1.40%	999.000	1013.000	-	1.81%	-

Performance Regressions - XPASS	Δ (B)	Baseline	Current	σ (B)	Δ	σ
gcc.XPASS	100.00%	1.000	2.000	-	-66.67%	-

Performance Regressions - bad	Δ (B)	Baseline	Current	σ (B)	Δ	σ
libstdc++.bad	50.00%	14.000	21.000	-	-99.78%	-
gcc.bad	31.15%	244.000	320.000	-	-99.27%	-

Performance Regressions - good	Δ (B)	Baseline	Current	σ (B)	Δ	σ
g++.good	-6.76%	219346.000	204516.000	-	10.30%	-

Performance Improvements - FAIL	Δ (B)	Baseline	Current	σ (B)	Δ	σ
g++.FAIL	-60.19%	103.000	41.000	-	-99.60%	-

Performance Improvements - PASS	Δ (B)	Baseline	Current	σ (B)	Δ	σ
gcc.PASS	8.48%	154328.000	167422.000	-	36.05%	-
libstdc++.PASS	3.88%	15478.000	16078.000	-	164.44%	-
TOTAL.PASS	2.08%	376218.000	384047.000	-	23.67%	-

Performance Improvements - UNRESOLVED	Δ (B)	Baseline	Current	σ (B)	Δ	σ
gcc.UNRESOLVED	-50.00%	4.000	2.000	-	-99.99%	-
g++.UNRESOLVED	-14.29%	7.000	6.000	-	-99.93%	-

Performance Improvements - UNSUPPORTED	Δ (B)	Baseline	Current	σ (B)	Δ	σ
g++.UNSUPPORTED	-78.31%	11261.000	2443.000	-	-2.44%	-
TOTAL.UNSUPPORTED	-38.00%	21138.000	13106.000	-	-2.57%	-

Performance Improvements - XFAIL	Δ (B)	Baseline	Current	σ (B)	Δ	σ
g++.XFAIL	-8.79%	1673.000	1526.000	-	0.53%	-
TOTAL.XFAIL	-4.71%	2803.000	2671.000	-	5.91%	-

Performance Improvements - XPASS	Δ (B)	Baseline	Current	σ (B)	Δ	σ
g++.XPASS	-91.30%	23.000	2.000	-	0.00%	-
TOTAL.XPASS	-76.92%	26.000	6.000	-	-25.00%	-

Performance Improvements - bad	Δ (B)	Baseline	Current	σ (B)	Δ	σ
g++.bad	-63.16%	133.000	49.000	-	-99.74%	-

Performance Improvements - good	Δ (B)	Baseline	Current	σ (B)	Δ	σ
gcc.good	8.45%	164190.000	178068.000	-	33.07%	-
libstdc++.good	3.71%	16623.000	17240.000	-	137.01%	-

Added Tests - ERROR
TOTAL.ERROR
g++.ERROR
gcc.ERROR
libstdc++.ERROR

Added Tests - KFAIL
TOTAL.KFAIL
g++.KFAIL
gcc.KFAIL
libstdc++.KFAIL

Added Tests - OTHER
TOTAL.OTHER
g++.OTHER
gcc.OTHER
libstdc++.OTHER

Added Tests - UNTESTED
TOTAL.UNTESTED
g++.UNTESTED
gcc.UNTESTED
libstdc++.UNTESTED

Added Tests - all
TOTAL.all

Added Tests - fails
TOTAL.fails

Added Tests - flaky
TOTAL.flaky

Report Time: 0.34s

PASS

	Name	Current	%
	TOTAL.PASS	384047.000	23.67%
	g++.PASS	200547.000	10.56%
	gcc.PASS	167422.000	36.05%
	libstdc++.PASS	16078.000	164.44%
	Geometric Mean	119994.482	48.93%

XPASS

	Name	Current	%
	TOTAL.XPASS	6.000	-25.00%
	g++.XPASS	2.000	-
	gcc.XPASS	2.000	-66.67%
	libstdc++.XPASS	2.000	-
	Geometric Mean	2.632	741.15%

FAIL

	Name	Current	%
	TOTAL.FAIL	372.000	-99.02%
	g++.FAIL	41.000	-99.60%
	gcc.FAIL	316.000	-98.63%
	libstdc++.FAIL	15.000	-99.68%
	Geometric Mean	92.210	-99.36%

XFAIL

	Name	Current	%
	TOTAL.XFAIL	2671.000	5.91%
	g++.XFAIL	1526.000	-
	gcc.XFAIL	1013.000	1.81%
	libstdc++.XFAIL	132.000	1366.67%
	Geometric Mean	859.217	99.68%

KFAIL

	Name	Current	%
	TOTAL.KFAIL	0.000	-
	g++.KFAIL	0.000	-
	gcc.KFAIL	0.000	-
	libstdc++.KFAIL	0.000	-
	Geometric Mean	0.000	-

UNSUPPORTED

	Name	Current	%
	TOTAL.UNSUPPORTED	13106.000	-2.57%
	g++.UNSUPPORTED	2443.000	-2.44%
	gcc.UNSUPPORTED	9633.000	-1.33%
	libstdc++.UNSUPPORTED	1030.000	-13.08%
	Geometric Mean	4221.804	-4.98%

UNRESOLVED

	Name	Current	%
	TOTAL.UNRESOLVED	12.000	-99.97%
	g++.UNRESOLVED	6.000	-99.93%
	gcc.UNRESOLVED	2.000	-99.99%
	libstdc++.UNRESOLVED	4.000	-99.91%
	Geometric Mean	4.899	-99.96%

UNTESTED

	Name	Current	%
	TOTAL.UNTESTED	0.000	-
	g++.UNTESTED	0.000	-
	gcc.UNTESTED	0.000	-
	libstdc++.UNTESTED	0.000	-
	Geometric Mean	0.000	-

ERROR

	Name	Current	%
	TOTAL.ERROR	0.000	-
	g++.ERROR	0.000	-
	gcc.ERROR	0.000	-
	libstdc++.ERROR	0.000	-
	Geometric Mean	0.000	-

OTHER

	Name	Current	%
	TOTAL.OTHER	0.000	-
	g++.OTHER	0.000	-
	gcc.OTHER	0.000	-
	libstdc++.OTHER	0.000	-
	Geometric Mean	0.000	-

good

	Name	Current	%
	TOTAL.good	399824.000	22.45%
	g++.good	204516.000	10.30%
	gcc.good	178068.000	33.07%
	libstdc++.good	17240.000	137.01%
	Geometric Mean	125872.200	43.66%

bad

	Name	Current	%
	TOTAL.bad	390.000	-99.46%
	g++.bad	49.000	-99.74%
	gcc.bad	320.000	-99.27%
	libstdc++.bad	21.000	-99.78%
	Geometric Mean	106.453	-99.61%

fails

	Name	Current	%
	TOTAL.fails	390.000	-99.46%
	Geometric Mean	390.000	-99.46%

flaky

	Name	Current	%
	TOTAL.flaky	72.000	-
	Geometric Mean	72.000	-

all

	Name	Current	%
	TOTAL.all	400214.000	-
	Geometric Mean	400214.000	-