Machine Info

Fields

hardware	None
os	None

Parameters

Run Info

Fields

Name	Value

Parameters

Name	Value
git_binutils	https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=086a2beb152c95ac43ac6b73859eb9e9081fc2df (+ 124 commits)
git_gcc	https://gcc.gnu.org/git/gcc.git (d949b94ea0c4206c5188a38aa045729cfc149386) (+ 547 commits)
git_gdb	https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=086a2beb152c95ac43ac6b73859eb9e9081fc2df (+ 124 commits)
git_newlib	https://sourceware.org/git/?p=newlib-cygwin.git;a=commit;h=c607889824395f0eac7e85d5b81c906bf8025321 (+ 9 commits)
git_qemu	https://gitlab.com/qemu-project/qemu/commit/92ec7805190313c9e628f8fc4eb4f932c15247bd (+ 433 commits)
test_url	https://ci.linaro.org/job/tcwg_gnu_embed_check_binutils--master-thumb_m33_hard_eabi-build/73/

Report

Filter

master-thumb_m33_hard_eabi test results

Run	Order	Start Time	Duration
Current	0073 (5-changed-components)	2024-10-22T12:03:44	0:00:00
Previous	0054 (binutils-2_41-release-04273-g1628e022674)	2024-09-12T09:01:31	0:00:00
Baseline	0002 (5-changed-components)	2024-04-16T17:06:15	0:00:00

Tests Summary

Status Group	#	# (B)
Performance Regressions	2	3
Performance Improvements	9	7
Added Tests	27	27
Unchanged Tests	727	728
Total Tests	765

Run-Over-Run Changes Detail

Performance Regressions - UNSUPPORTED	Δ	Previous	Current	σ	Δ (B)	σ (B)
ld.UNSUPPORTED	9.13%	252.000	275.000	-	10.00%	-
TOTAL.UNSUPPORTED	6.86%	277.000	296.000	-	9.23%	-

Performance Improvements - PASS	Δ	Previous	Current	σ	Δ (B)	σ (B)
binutils.PASS	8.26%	242.000	262.000	-	1.16%	-

Performance Improvements - UNSUPPORTED	Δ	Previous	Current	σ	Δ (B)	σ (B)
binutils.UNSUPPORTED	-23.53%	17.000	13.000	-	8.33%	-

Performance Improvements - UNTESTED	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.UNTESTED	-37.50%	32.000	20.000	-	0.00%	-

Performance Improvements - all	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.all	1.09%	2741.000	2771.000	-	1.46%	-

Performance Improvements - bad	Δ	Previous	Current	σ	Δ (B)	σ (B)
binutils.bad	-91.67%	12.000	1.000	-	0.00%	-
TOTAL.bad	-34.38%	32.000	21.000	-	0.00%	-

Performance Improvements - good	Δ	Previous	Current	σ	Δ (B)	σ (B)
binutils.good	6.15%	260.000	276.000	-	1.47%	-
ld.good	2.19%	1142.000	1167.000	-	3.00%	-
TOTAL.good	1.51%	2709.000	2750.000	-	1.48%	-

Added Tests - ERROR
TOTAL.ERROR
binutils.ERROR
gas.ERROR
ld.ERROR

Added Tests - FAIL
gas.FAIL
ld.FAIL

Added Tests - KFAIL
TOTAL.KFAIL
binutils.KFAIL
gas.KFAIL
ld.KFAIL

Added Tests - OTHER
TOTAL.OTHER
binutils.OTHER
gas.OTHER
ld.OTHER

Added Tests - UNRESOLVED
TOTAL.UNRESOLVED
binutils.UNRESOLVED
gas.UNRESOLVED
ld.UNRESOLVED

Added Tests - UNTESTED
binutils.UNTESTED
gas.UNTESTED

Added Tests - XFAIL
gas.XFAIL

Added Tests - XPASS
TOTAL.XPASS
binutils.XPASS
gas.XPASS
ld.XPASS

Added Tests - bad
gas.bad

Added Tests - flaky
TOTAL.flaky

Run-Over-Baseline Changes Detail

Performance Regressions - UNSUPPORTED	Δ (B)	Baseline	Current	σ (B)	Δ	σ
ld.UNSUPPORTED	10.00%	250.000	275.000	-	9.13%	-
TOTAL.UNSUPPORTED	9.23%	271.000	296.000	-	6.86%	-
binutils.UNSUPPORTED	8.33%	12.000	13.000	-	-23.53%	-

Performance Improvements - PASS	Δ (B)	Baseline	Current	σ (B)	Δ	σ
binutils.PASS	1.16%	259.000	262.000	-	8.26%	-
ld.PASS	1.03%	872.000	881.000	-	0.23%	-

Performance Improvements - UNSUPPORTED	Δ (B)	Baseline	Current	σ (B)	Δ	σ
gas.UNSUPPORTED	-11.11%	9.000	8.000	-	0.00%	-

Performance Improvements - all	Δ (B)	Baseline	Current	σ (B)	Δ	σ
TOTAL.all	1.46%	2731.000	2771.000	-	1.09%	-

Performance Improvements - good	Δ (B)	Baseline	Current	σ (B)	Δ	σ
ld.good	3.00%	1133.000	1167.000	-	2.19%	-
TOTAL.good	1.48%	2710.000	2750.000	-	1.51%	-
binutils.good	1.47%	272.000	276.000	-	6.15%	-

Added Tests - ERROR
TOTAL.ERROR
binutils.ERROR
gas.ERROR
ld.ERROR

Added Tests - FAIL
gas.FAIL
ld.FAIL

Added Tests - KFAIL
TOTAL.KFAIL
binutils.KFAIL
gas.KFAIL
ld.KFAIL

Added Tests - OTHER
TOTAL.OTHER
binutils.OTHER
gas.OTHER
ld.OTHER

Added Tests - UNRESOLVED
TOTAL.UNRESOLVED
binutils.UNRESOLVED
gas.UNRESOLVED
ld.UNRESOLVED

Added Tests - UNTESTED
binutils.UNTESTED
gas.UNTESTED

Added Tests - XFAIL
gas.XFAIL

Added Tests - XPASS
TOTAL.XPASS
binutils.XPASS
gas.XPASS
ld.XPASS

Added Tests - bad
gas.bad

Added Tests - flaky
TOTAL.flaky

Report Time: 0.19s

PASS

	Name	Current	%
	TOTAL.PASS	2442.000	-
	binutils.PASS	262.000	8.26%
	gas.PASS	1299.000	-
	ld.PASS	881.000	-
	Geometric Mean	925.035	2.29%

XPASS

	Name	Current	%
	TOTAL.XPASS	0.000	-
	binutils.XPASS	0.000	-
	gas.XPASS	0.000	-
	ld.XPASS	0.000	-
	Geometric Mean	0.000	-

FAIL

	Name	Current	%
	TOTAL.FAIL	1.000	-
	binutils.FAIL	1.000	-
	gas.FAIL	0.000	-
	ld.FAIL	0.000	-
	Geometric Mean	0.010	-

XFAIL

	Name	Current	%
	TOTAL.XFAIL	12.000	-
	binutils.XFAIL	1.000	-
	gas.XFAIL	0.000	-
	ld.XFAIL	11.000	-
	Geometric Mean	0.339	-93.34%

KFAIL

	Name	Current	%
	TOTAL.KFAIL	0.000	-
	binutils.KFAIL	0.000	-
	gas.KFAIL	0.000	-
	ld.KFAIL	0.000	-
	Geometric Mean	0.000	-

UNSUPPORTED

	Name	Current	%
	TOTAL.UNSUPPORTED	296.000	6.86%
	binutils.UNSUPPORTED	13.000	-23.53%
	gas.UNSUPPORTED	8.000	-
	ld.UNSUPPORTED	275.000	9.13%
	Geometric Mean	53.941	-2.82%

UNRESOLVED

	Name	Current	%
	TOTAL.UNRESOLVED	0.000	-
	binutils.UNRESOLVED	0.000	-
	gas.UNRESOLVED	0.000	-
	ld.UNRESOLVED	0.000	-
	Geometric Mean	0.000	-

UNTESTED

	Name	Current	%
	TOTAL.UNTESTED	20.000	-37.50%
	binutils.UNTESTED	0.000	-
	gas.UNTESTED	0.000	-
	ld.UNTESTED	20.000	-
	Geometric Mean	0.045	-99.82%

ERROR

	Name	Current	%
	TOTAL.ERROR	0.000	-
	binutils.ERROR	0.000	-
	gas.ERROR	0.000	-
	ld.ERROR	0.000	-
	Geometric Mean	0.000	-

OTHER

	Name	Current	%
	TOTAL.OTHER	0.000	-
	binutils.OTHER	0.000	-
	gas.OTHER	0.000	-
	ld.OTHER	0.000	-
	Geometric Mean	0.000	-

good

	Name	Current	%
	TOTAL.good	2750.000	1.51%
	binutils.good	276.000	6.15%
	gas.good	1307.000	-
	ld.good	1167.000	2.19%
	Geometric Mean	1037.283	2.44%

bad

	Name	Current	%
	TOTAL.bad	21.000	-34.38%
	binutils.bad	1.000	-91.67%
	gas.bad	0.000	-
	ld.bad	20.000	-
	Geometric Mean	0.453	-97.71%

fails

	Name	Current	%
	TOTAL.fails	1.000	-
	Geometric Mean	1.000	-

flaky

	Name	Current	%
	TOTAL.flaky	0.000	-
	Geometric Mean	0.000	-

all

	Name	Current	%
	TOTAL.all	2771.000	1.09%
	Geometric Mean	2771.000	1.09%