Machine Info

Fields

hardware	None
os	None

Parameters

Run Info

Fields

Name	Value

Parameters

Name	Value
git_binutils	https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=f9b44496e631edfa5c8218699d5a5ffe59b21033 (+ 17 commits)
git_gcc	https://github.com/gcc-mirror/gcc/commit/a183b255be8ec8f434c3c39f3f4e01d6bd5566f8 (+ 52 commits)
git_gdb	https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=f9b44496e631edfa5c8218699d5a5ffe59b21033 (+ 17 commits)
git_newlib	https://sourceware.org/git/?p=newlib-cygwin.git;a=commit;h=b2e05e03df85ba84f11e10445663fb23ebd21e23 (+ 5 commits)
git_qemu	https://gitlab.com/qemu-project/qemu/commit/2eefd4fcec4b8fe41ceee2a8f00cdec1fe81b75c (+ 29 commits)
test_url	https://ci.linaro.org/job/tcwg_gnu_embed_check_binutils--master-arm_eabi-build/287/

Report

Filter

master-arm_eabi test results

Run	Order	Start Time	Duration
Current	0287 (5-changed-components)	2024-08-14T05:00:05	0:00:00
Previous	0051 (5-changed-components)	2023-06-14T14:14:35	0:00:00
Baseline	0011 (5-changed-components)	2023-06-05T16:56:22	0:00:00

Tests Summary

Status Group	#	# (B)
Performance Regressions	2	8
Performance Improvements	13	10
Added Tests	27	27
Unchanged Tests	723	720
Total Tests	765

Run-Over-Run Changes Detail

Performance Regressions - UNSUPPORTED	Δ	Previous	Current	σ	Δ (B)	σ (B)
ld.UNSUPPORTED	2.02%	247.000	252.000	-	-36.36%	-
TOTAL.UNSUPPORTED	1.49%	269.000	273.000	-	-34.06%	-

Performance Improvements - PASS	Δ	Previous	Current	σ	Δ (B)	σ (B)
binutils.PASS	12.93%	232.000	262.000	-	3.97%	-
ld.PASS	4.15%	843.000	878.000	-	-32.62%	-
TOTAL.PASS	3.48%	2354.000	2436.000	-	-14.04%	-
gas.PASS	1.33%	1279.000	1296.000	-	1.33%	-

Performance Improvements - UNSUPPORTED	Δ	Previous	Current	σ	Δ (B)	σ (B)
binutils.UNSUPPORTED	-7.14%	14.000	13.000	-	30.00%	-

Performance Improvements - UNTESTED	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.UNTESTED	-35.48%	31.000	20.000	-	0.00%	-

Performance Improvements - all	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.all	2.85%	2666.000	2742.000	-	-16.40%	-

Performance Improvements - bad	Δ	Previous	Current	σ	Δ (B)	σ (B)
binutils.bad	-90.91%	11.000	1.000	-	0.00%	-
TOTAL.bad	-32.26%	31.000	21.000	-	10.53%	-

Performance Improvements - good	Δ	Previous	Current	σ	Δ (B)	σ (B)
binutils.good	11.74%	247.000	276.000	-	4.94%	-
ld.good	3.63%	1101.000	1141.000	-	-33.31%	-
TOTAL.good	3.26%	2635.000	2721.000	-	-16.56%	-
gas.good	1.32%	1287.000	1304.000	-	1.32%	-

Added Tests - ERROR
TOTAL.ERROR
binutils.ERROR
gas.ERROR
ld.ERROR

Added Tests - FAIL
gas.FAIL
ld.FAIL

Added Tests - KFAIL
TOTAL.KFAIL
binutils.KFAIL
gas.KFAIL
ld.KFAIL

Added Tests - OTHER
TOTAL.OTHER
binutils.OTHER
gas.OTHER
ld.OTHER

Added Tests - UNRESOLVED
TOTAL.UNRESOLVED
binutils.UNRESOLVED
gas.UNRESOLVED
ld.UNRESOLVED

Added Tests - UNTESTED
binutils.UNTESTED
gas.UNTESTED

Added Tests - XFAIL
gas.XFAIL

Added Tests - XPASS
TOTAL.XPASS
binutils.XPASS
gas.XPASS
ld.XPASS

Added Tests - bad
gas.bad

Added Tests - flaky
TOTAL.flaky

Run-Over-Baseline Changes Detail

Performance Regressions - PASS	Δ (B)	Baseline	Current	σ (B)	Δ	σ
ld.PASS	-32.62%	1303.000	878.000	-	4.15%	-
TOTAL.PASS	-14.04%	2834.000	2436.000	-	3.48%	-

Performance Regressions - UNSUPPORTED	Δ (B)	Baseline	Current	σ (B)	Δ	σ
binutils.UNSUPPORTED	30.00%	10.000	13.000	-	-7.14%	-

Performance Regressions - all	Δ (B)	Baseline	Current	σ (B)	Δ	σ
TOTAL.all	-16.40%	3280.000	2742.000	-	2.85%	-

Performance Regressions - bad	Δ (B)	Baseline	Current	σ (B)	Δ	σ
ld.bad	11.11%	18.000	20.000	-	0.00%	-
TOTAL.bad	10.53%	19.000	21.000	-	-32.26%	-

Performance Regressions - good	Δ (B)	Baseline	Current	σ (B)	Δ	σ
ld.good	-33.31%	1711.000	1141.000	-	3.63%	-
TOTAL.good	-16.56%	3261.000	2721.000	-	3.26%	-

Performance Improvements - FAIL	Δ (B)	Baseline	Current	σ (B)	Δ	σ
TOTAL.FAIL	-94.74%	19.000	1.000	-	0.00%	-

Performance Improvements - PASS	Δ (B)	Baseline	Current	σ (B)	Δ	σ
binutils.PASS	3.97%	252.000	262.000	-	12.93%	-
gas.PASS	1.33%	1279.000	1296.000	-	1.33%	-

Performance Improvements - UNSUPPORTED	Δ (B)	Baseline	Current	σ (B)	Δ	σ
ld.UNSUPPORTED	-36.36%	396.000	252.000	-	2.02%	-
TOTAL.UNSUPPORTED	-34.06%	414.000	273.000	-	1.49%	-

Performance Improvements - XFAIL	Δ (B)	Baseline	Current	σ (B)	Δ	σ
ld.XFAIL	-8.33%	12.000	11.000	-	0.00%	-
TOTAL.XFAIL	-7.69%	13.000	12.000	-	0.00%	-

Performance Improvements - fails	Δ (B)	Baseline	Current	σ (B)	Δ	σ
TOTAL.fails	-94.74%	19.000	1.000	-	0.00%	-

Performance Improvements - good	Δ (B)	Baseline	Current	σ (B)	Δ	σ
binutils.good	4.94%	263.000	276.000	-	11.74%	-
gas.good	1.32%	1287.000	1304.000	-	1.32%	-

Added Tests - ERROR
TOTAL.ERROR
binutils.ERROR
gas.ERROR
ld.ERROR

Added Tests - FAIL
gas.FAIL
ld.FAIL

Added Tests - KFAIL
TOTAL.KFAIL
binutils.KFAIL
gas.KFAIL
ld.KFAIL

Added Tests - OTHER
TOTAL.OTHER
binutils.OTHER
gas.OTHER
ld.OTHER

Added Tests - UNRESOLVED
TOTAL.UNRESOLVED
binutils.UNRESOLVED
gas.UNRESOLVED
ld.UNRESOLVED

Added Tests - UNTESTED
binutils.UNTESTED
gas.UNTESTED

Added Tests - XFAIL
gas.XFAIL

Added Tests - XPASS
TOTAL.XPASS
binutils.XPASS
gas.XPASS
ld.XPASS

Added Tests - bad
gas.bad

Added Tests - flaky
TOTAL.flaky

Report Time: 0.20s

PASS

	Name	Current	%
	TOTAL.PASS	2436.000	3.48%
	binutils.PASS	262.000	12.93%
	gas.PASS	1296.000	1.33%
	ld.PASS	878.000	4.15%
	Geometric Mean	923.144	5.38%

XPASS

	Name	Current	%
	TOTAL.XPASS	0.000	-
	binutils.XPASS	0.000	-
	gas.XPASS	0.000	-
	ld.XPASS	0.000	-
	Geometric Mean	0.000	-

FAIL

	Name	Current	%
	TOTAL.FAIL	1.000	-
	binutils.FAIL	1.000	-
	gas.FAIL	0.000	-
	ld.FAIL	0.000	-
	Geometric Mean	0.010	-

XFAIL

	Name	Current	%
	TOTAL.XFAIL	12.000	-
	binutils.XFAIL	1.000	-
	gas.XFAIL	0.000	-
	ld.XFAIL	11.000	-
	Geometric Mean	0.339	-93.34%

KFAIL

	Name	Current	%
	TOTAL.KFAIL	0.000	-
	binutils.KFAIL	0.000	-
	gas.KFAIL	0.000	-
	ld.KFAIL	0.000	-
	Geometric Mean	0.000	-

UNSUPPORTED

	Name	Current	%
	TOTAL.UNSUPPORTED	273.000	1.49%
	binutils.UNSUPPORTED	13.000	-7.14%
	gas.UNSUPPORTED	8.000	-
	ld.UNSUPPORTED	252.000	2.02%
	Geometric Mean	51.719	-

UNRESOLVED

	Name	Current	%
	TOTAL.UNRESOLVED	0.000	-
	binutils.UNRESOLVED	0.000	-
	gas.UNRESOLVED	0.000	-
	ld.UNRESOLVED	0.000	-
	Geometric Mean	0.000	-

UNTESTED

	Name	Current	%
	TOTAL.UNTESTED	20.000	-35.48%
	binutils.UNTESTED	0.000	-
	gas.UNTESTED	0.000	-
	ld.UNTESTED	20.000	-
	Geometric Mean	0.045	-99.82%

ERROR

	Name	Current	%
	TOTAL.ERROR	0.000	-
	binutils.ERROR	0.000	-
	gas.ERROR	0.000	-
	ld.ERROR	0.000	-
	Geometric Mean	0.000	-

OTHER

	Name	Current	%
	TOTAL.OTHER	0.000	-
	binutils.OTHER	0.000	-
	gas.OTHER	0.000	-
	ld.OTHER	0.000	-
	Geometric Mean	0.000	-

good

	Name	Current	%
	TOTAL.good	2721.000	3.26%
	binutils.good	276.000	11.74%
	gas.good	1304.000	1.32%
	ld.good	1141.000	3.63%
	Geometric Mean	1028.135	4.92%

bad

	Name	Current	%
	TOTAL.bad	21.000	-32.26%
	binutils.bad	1.000	-90.91%
	gas.bad	0.000	-
	ld.bad	20.000	-
	Geometric Mean	0.453	-97.61%

fails

	Name	Current	%
	TOTAL.fails	1.000	-
	Geometric Mean	1.000	-

flaky

	Name	Current	%
	TOTAL.flaky	0.000	-
	Geometric Mean	0.000	-

all

	Name	Current	%
	TOTAL.all	2742.000	2.85%
	Geometric Mean	2742.000	2.85%