Machine Info

Fields

hardware	None
os	None

Parameters

Run Info

Fields

Name	Value

Parameters

Name	Value
git_binutils	https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=308d7670f038de523d5ecbb06e05446a798c36dc (unchanged)
git_gcc	https://gcc.gnu.org/git/gcc.git (cfd7c54bdfe109f7e801122a093d0d2a85324fc5) (+ 149 commits)
git_gdb	https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=308d7670f038de523d5ecbb06e05446a798c36dc (unchanged)
git_newlib	https://sourceware.org/git/?p=newlib-cygwin.git;a=commit;h=b42ac298bb2ea7c39b0827429779d800ee7f5ac0 (unchanged)
git_qemu	https://gitlab.com/qemu-project/qemu/commit/bc6afa1c711da5b4f37c9685a812c77b114d84cb (unchanged)
test_url	https://ci.linaro.org/job/tcwg_gnu_embed_check_gcc--master-thumb_m33_hard_eabi-build/358/

Report

Filter

master-thumb_m33_hard_eabi test results

Run	Order	Start Time	Duration
Current	0358 (basepoints/gcc-15-06801-gcfd7c54bdfe)	2025-01-09T04:31:36	0:00:00
Previous	0357 (4-changed-components)	2025-01-07T14:30:30	0:00:00
Baseline	0048 (basepoints/gcc-15-00267-gcb478e0a6f3)	2024-05-23T18:15:38	0:00:00

Tests Summary

Status Group	#	# (B)
Performance Regressions	0	9
Performance Improvements	7	20
Added Tests	15	15
Unchanged Tests	743	721
Total Tests	765

Run-Over-Run Changes Detail

Performance Improvements - FAIL	Δ	Previous	Current	σ	Δ (B)	σ (B)
g++.FAIL	-54.55%	33.000	15.000	-	-71.15%	-
TOTAL.FAIL	-14.87%	195.000	166.000	-	-52.16%	-
gcc.FAIL	-7.69%	143.000	132.000	-	-52.69%	-

Performance Improvements - bad	Δ	Previous	Current	σ	Δ (B)	σ (B)
g++.bad	-47.37%	38.000	20.000	-	-70.59%	-
TOTAL.bad	-13.94%	208.000	179.000	-	-51.62%	-
gcc.bad	-7.59%	145.000	134.000	-	-52.14%	-

Performance Improvements - fails	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.fails	-14.01%	207.000	178.000	-	-51.89%	-

Added Tests - ERROR
TOTAL.ERROR
g++.ERROR
gcc.ERROR
libstdc++.ERROR

Added Tests - KFAIL
TOTAL.KFAIL
g++.KFAIL
gcc.KFAIL
libstdc++.KFAIL

Added Tests - OTHER
g++.OTHER
libstdc++.OTHER

Added Tests - UNTESTED
TOTAL.UNTESTED
g++.UNTESTED
gcc.UNTESTED
libstdc++.UNTESTED

Added Tests - XPASS
gcc.XPASS

Run-Over-Baseline Changes Detail

Performance Regressions - FAIL	Δ (B)	Baseline	Current	σ (B)	Δ	σ
libstdc++.FAIL	18.75%	16.000	19.000	-	0.00%	-

Performance Regressions - PASS	Δ (B)	Baseline	Current	σ (B)	Δ	σ
g++.PASS	-6.24%	223194.000	209274.000	-	0.22%	-
TOTAL.PASS	-1.53%	405344.000	399158.000	-	0.14%	-

Performance Regressions - UNSUPPORTED	Δ (B)	Baseline	Current	σ (B)	Δ	σ
gcc.UNSUPPORTED	8.11%	9466.000	10234.000	-	-0.03%	-

Performance Regressions - XFAIL	Δ (B)	Baseline	Current	σ (B)	Δ	σ
libstdc++.XFAIL	3.82%	131.000	136.000	-	0.00%	-

Performance Regressions - all	Δ (B)	Baseline	Current	σ (B)	Δ	σ
TOTAL.all	-3.56%	431076.000	415744.000	-	0.13%	-

Performance Regressions - bad	Δ (B)	Baseline	Current	σ (B)	Δ	σ
libstdc++.bad	13.64%	22.000	25.000	-	0.00%	-

Performance Regressions - good	Δ (B)	Baseline	Current	σ (B)	Δ	σ
g++.good	-9.98%	236918.000	213276.000	-	0.21%	-
TOTAL.good	-3.52%	430706.000	415565.000	-	0.13%	-

Performance Improvements - FAIL	Δ (B)	Baseline	Current	σ (B)	Δ	σ
g++.FAIL	-71.15%	52.000	15.000	-	-54.55%	-
gcc.FAIL	-52.69%	279.000	132.000	-	-7.69%	-
TOTAL.FAIL	-52.16%	347.000	166.000	-	-14.87%	-

Performance Improvements - PASS	Δ (B)	Baseline	Current	σ (B)	Δ	σ
gcc.PASS	4.41%	166211.000	173547.000	-	0.06%	-
libstdc++.PASS	2.50%	15939.000	16337.000	-	0.04%	-

Performance Improvements - UNRESOLVED	Δ (B)	Baseline	Current	σ (B)	Δ	σ
g++.UNRESOLVED	-50.00%	6.000	3.000	-	0.00%	-
TOTAL.UNRESOLVED	-27.27%	11.000	8.000	-	0.00%	-

Performance Improvements - UNSUPPORTED	Δ (B)	Baseline	Current	σ (B)	Δ	σ
g++.UNSUPPORTED	-79.19%	11870.000	2470.000	-	0.04%	-
TOTAL.UNSUPPORTED	-38.56%	22361.000	13739.000	-	-0.01%	-

Performance Improvements - XFAIL	Δ (B)	Baseline	Current	σ (B)	Δ	σ
g++.XFAIL	-17.37%	1854.000	1532.000	-	0.00%	-
TOTAL.XFAIL	-11.10%	3001.000	2668.000	-	0.00%	-
gcc.XFAIL	-1.57%	1016.000	1000.000	-	0.00%	-

Performance Improvements - XPASS	Δ (B)	Baseline	Current	σ (B)	Δ	σ
g++.XPASS	-80.00%	10.000	2.000	-	0.00%	-
TOTAL.XPASS	-66.67%	12.000	4.000	-	0.00%	-

Performance Improvements - bad	Δ (B)	Baseline	Current	σ (B)	Δ	σ
g++.bad	-70.59%	68.000	20.000	-	-47.37%	-
gcc.bad	-52.14%	280.000	134.000	-	-7.59%	-
TOTAL.bad	-51.62%	370.000	179.000	-	-13.94%	-

Performance Improvements - fails	Δ (B)	Baseline	Current	σ (B)	Δ	σ
TOTAL.fails	-51.89%	370.000	178.000	-	-14.01%	-

Performance Improvements - good	Δ (B)	Baseline	Current	σ (B)	Δ	σ
gcc.good	4.58%	176693.000	184781.000	-	0.05%	-
libstdc++.good	2.42%	17095.000	17508.000	-	0.03%	-

Added Tests - ERROR
TOTAL.ERROR
g++.ERROR
gcc.ERROR
libstdc++.ERROR

Added Tests - KFAIL
TOTAL.KFAIL
g++.KFAIL
gcc.KFAIL
libstdc++.KFAIL

Added Tests - OTHER
g++.OTHER
libstdc++.OTHER

Added Tests - UNTESTED
TOTAL.UNTESTED
g++.UNTESTED
gcc.UNTESTED
libstdc++.UNTESTED

Added Tests - XPASS
gcc.XPASS

Report Time: 0.23s

PASS

	Name	Current	%
	TOTAL.PASS	399158.000	-
	g++.PASS	209274.000	-
	gcc.PASS	173547.000	-
	libstdc++.PASS	16337.000	-
	Geometric Mean	124054.460	-

XPASS

	Name	Current	%
	TOTAL.XPASS	4.000	-
	g++.XPASS	2.000	-
	gcc.XPASS	0.000	-
	libstdc++.XPASS	2.000	-
	Geometric Mean	0.200	-92.07%

FAIL

	Name	Current	%
	TOTAL.FAIL	166.000	-14.87%
	g++.FAIL	15.000	-54.55%
	gcc.FAIL	132.000	-7.69%
	libstdc++.FAIL	19.000	-
	Geometric Mean	49.990	-22.69%

XFAIL

	Name	Current	%
	TOTAL.XFAIL	2668.000	-
	g++.XFAIL	1532.000	-
	gcc.XFAIL	1000.000	-
	libstdc++.XFAIL	136.000	-
	Geometric Mean	863.467	-

KFAIL

	Name	Current	%
	TOTAL.KFAIL	0.000	-
	g++.KFAIL	0.000	-
	gcc.KFAIL	0.000	-
	libstdc++.KFAIL	0.000	-
	Geometric Mean	0.000	-

UNSUPPORTED

	Name	Current	%
	TOTAL.UNSUPPORTED	13739.000	-
	g++.UNSUPPORTED	2470.000	-
	gcc.UNSUPPORTED	10234.000	-
	libstdc++.UNSUPPORTED	1035.000	-
	Geometric Mean	4354.211	-

UNRESOLVED

	Name	Current	%
	TOTAL.UNRESOLVED	8.000	-
	g++.UNRESOLVED	3.000	-
	gcc.UNRESOLVED	1.000	-
	libstdc++.UNRESOLVED	4.000	-
	Geometric Mean	3.130	-

UNTESTED

	Name	Current	%
	TOTAL.UNTESTED	0.000	-
	g++.UNTESTED	0.000	-
	gcc.UNTESTED	0.000	-
	libstdc++.UNTESTED	0.000	-
	Geometric Mean	0.000	-

ERROR

	Name	Current	%
	TOTAL.ERROR	0.000	-
	g++.ERROR	0.000	-
	gcc.ERROR	0.000	-
	libstdc++.ERROR	0.000	-
	Geometric Mean	0.000	-

OTHER

	Name	Current	%
	TOTAL.OTHER	1.000	-
	g++.OTHER	0.000	-
	gcc.OTHER	1.000	-
	libstdc++.OTHER	0.000	-
	Geometric Mean	0.010	-99.01%

good

	Name	Current	%
	TOTAL.good	415565.000	-
	g++.good	213276.000	-
	gcc.good	184781.000	-
	libstdc++.good	17508.000	-
	Geometric Mean	130127.384	-

bad

	Name	Current	%
	TOTAL.bad	179.000	-13.94%
	g++.bad	20.000	-47.37%
	gcc.bad	134.000	-7.59%
	libstdc++.bad	25.000	-
	Geometric Mean	58.848	-19.57%

fails

	Name	Current	%
	TOTAL.fails	178.000	-14.01%
	Geometric Mean	178.000	-14.01%

flaky

	Name	Current	%
	TOTAL.flaky	90.000	-
	Geometric Mean	90.000	-

all

	Name	Current	%
	TOTAL.all	415744.000	-
	Geometric Mean	415744.000	-