Machine Info

Fields

hardware	None
os	None

Parameters

Run Info

Fields

Name	Value

Parameters

Name	Value
git_binutils	https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=0ec2cde4f48fbe19c72d0963101888743015041e (+ 174 commits)
git_gcc	https://github.com/gcc-mirror/gcc/commit/270742ceb5141db498ef63373512ed071923b940 (+ 485 commits)
git_gdb	https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=8a269c262e3d0611c01edd915f230bbd2ad78015 (+ 173 commits)
git_newlib	https://sourceware.org/git/?p=newlib-cygwin.git;a=commit;h=6b2ae32ecdfdb8ca1337e19fac3b6e0a4079e769 (+ 8 commits)
git_qemu	https://gitlab.com/qemu-project/qemu/commit/b455ce4c2f300c8ba47cba7232dd03261368a4cb (+ 445 commits)
test_url	https://ci.linaro.org/job/tcwg_gnu_embed_check_binutils--master-arm_eabi-build/51/

Report

Filter

master-arm_eabi test results

Run	Order	Start Time	Duration
Current	0051 (5-changed-components)	2023-06-14T14:14:35	0:00:00
Previous	0237 (5-changed-components)	2023-10-26T09:28:30	0:00:00
Baseline	0011 (5-changed-components)	2023-06-05T16:56:22	0:00:00

Tests Summary

Status Group	#	# (B)
Performance Regressions	13	11
Performance Improvements	2	4
Added Tests	29	29
Unchanged Tests	721	721
Total Tests	765

Run-Over-Run Changes Detail

Performance Regressions - PASS	Δ	Previous	Current	σ	Δ (B)	σ (B)
binutils.PASS	-9.38%	256.000	232.000	-	-7.94%	-
ld.PASS	-3.21%	871.000	843.000	-	-35.30%	-
TOTAL.PASS	-2.81%	2422.000	2354.000	-	-16.94%	-
gas.PASS	-1.24%	1295.000	1279.000	-	0.00%	-

Performance Regressions - UNSUPPORTED	Δ	Previous	Current	σ	Δ (B)	σ (B)
binutils.UNSUPPORTED	27.27%	11.000	14.000	-	40.00%	-

Performance Regressions - UNTESTED	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.UNTESTED	55.00%	20.000	31.000	-	0.00%	-

Performance Regressions - all	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.all	-2.17%	2725.000	2666.000	-	-18.72%	-

Performance Regressions - bad	Δ	Previous	Current	σ	Δ (B)	σ (B)
binutils.bad	1000.00%	1.000	11.000	-	1000.00%	-
TOTAL.bad	47.62%	21.000	31.000	-	63.16%	-

Performance Regressions - good	Δ	Previous	Current	σ	Δ (B)	σ (B)
binutils.good	-7.84%	268.000	247.000	-	-6.08%	-
ld.good	-2.74%	1132.000	1101.000	-	-35.65%	-
TOTAL.good	-2.55%	2704.000	2635.000	-	-19.20%	-
gas.good	-1.30%	1304.000	1287.000	-	0.00%	-

Performance Improvements - UNSUPPORTED	Δ	Previous	Current	σ	Δ (B)	σ (B)
gas.UNSUPPORTED	-11.11%	9.000	8.000	-	0.00%	-
ld.UNSUPPORTED	-1.20%	250.000	247.000	-	-37.63%	-

Added Tests - ERROR
TOTAL.ERROR
binutils.ERROR
gas.ERROR
ld.ERROR

Added Tests - FAIL
TOTAL.FAIL
binutils.FAIL
gas.FAIL
ld.FAIL

Added Tests - KFAIL
TOTAL.KFAIL
binutils.KFAIL
gas.KFAIL
ld.KFAIL

Added Tests - OTHER
TOTAL.OTHER
binutils.OTHER
gas.OTHER
ld.OTHER

Added Tests - UNRESOLVED
TOTAL.UNRESOLVED
binutils.UNRESOLVED
gas.UNRESOLVED
ld.UNRESOLVED

Added Tests - UNTESTED
gas.UNTESTED

Added Tests - XFAIL
gas.XFAIL

Added Tests - XPASS
TOTAL.XPASS
binutils.XPASS
gas.XPASS
ld.XPASS

Added Tests - bad
gas.bad

Added Tests - fails
TOTAL.fails

Added Tests - flaky
TOTAL.flaky

Run-Over-Baseline Changes Detail

Performance Regressions - PASS	Δ (B)	Baseline	Current	σ (B)	Δ	σ
ld.PASS	-35.30%	1303.000	843.000	-	-3.21%	-
TOTAL.PASS	-16.94%	2834.000	2354.000	-	-2.81%	-
binutils.PASS	-7.94%	252.000	232.000	-	-9.38%	-

Performance Regressions - UNSUPPORTED	Δ (B)	Baseline	Current	σ (B)	Δ	σ
binutils.UNSUPPORTED	40.00%	10.000	14.000	-	27.27%	-

Performance Regressions - all	Δ (B)	Baseline	Current	σ (B)	Δ	σ
TOTAL.all	-18.72%	3280.000	2666.000	-	-2.17%	-

Performance Regressions - bad	Δ (B)	Baseline	Current	σ (B)	Δ	σ
binutils.bad	1000.00%	1.000	11.000	-	1000.00%	-
TOTAL.bad	63.16%	19.000	31.000	-	47.62%	-
ld.bad	11.11%	18.000	20.000	-	0.00%	-

Performance Regressions - good	Δ (B)	Baseline	Current	σ (B)	Δ	σ
ld.good	-35.65%	1711.000	1101.000	-	-2.74%	-
TOTAL.good	-19.20%	3261.000	2635.000	-	-2.55%	-
binutils.good	-6.08%	263.000	247.000	-	-7.84%	-

Performance Improvements - UNSUPPORTED	Δ (B)	Baseline	Current	σ (B)	Δ	σ
ld.UNSUPPORTED	-37.63%	396.000	247.000	-	-1.20%	-
TOTAL.UNSUPPORTED	-35.02%	414.000	269.000	-	-0.37%	-

Performance Improvements - XFAIL	Δ (B)	Baseline	Current	σ (B)	Δ	σ
ld.XFAIL	-8.33%	12.000	11.000	-	0.00%	-
TOTAL.XFAIL	-7.69%	13.000	12.000	-	0.00%	-

Added Tests - ERROR
TOTAL.ERROR
binutils.ERROR
gas.ERROR
ld.ERROR

Added Tests - FAIL
TOTAL.FAIL
binutils.FAIL
gas.FAIL
ld.FAIL

Added Tests - KFAIL
TOTAL.KFAIL
binutils.KFAIL
gas.KFAIL
ld.KFAIL

Added Tests - OTHER
TOTAL.OTHER
binutils.OTHER
gas.OTHER
ld.OTHER

Added Tests - UNRESOLVED
TOTAL.UNRESOLVED
binutils.UNRESOLVED
gas.UNRESOLVED
ld.UNRESOLVED

Added Tests - UNTESTED
gas.UNTESTED

Added Tests - XFAIL
gas.XFAIL

Added Tests - XPASS
TOTAL.XPASS
binutils.XPASS
gas.XPASS
ld.XPASS

Added Tests - bad
gas.bad

Added Tests - fails
TOTAL.fails

Added Tests - flaky
TOTAL.flaky

Report Time: 0.20s

PASS

	Name	Current	%
	TOTAL.PASS	2354.000	-2.81%
	binutils.PASS	232.000	-9.38%
	gas.PASS	1279.000	-1.24%
	ld.PASS	843.000	-3.21%
	Geometric Mean	875.988	-4.21%

XPASS

	Name	Current	%
	TOTAL.XPASS	0.000	-
	binutils.XPASS	0.000	-
	gas.XPASS	0.000	-
	ld.XPASS	0.000	-
	Geometric Mean	0.000	-

FAIL

	Name	Current	%
	TOTAL.FAIL	0.000	-
	binutils.FAIL	0.000	-
	gas.FAIL	0.000	-
	ld.FAIL	0.000	-
	Geometric Mean	0.000	-

XFAIL

	Name	Current	%
	TOTAL.XFAIL	12.000	-
	binutils.XFAIL	1.000	-
	gas.XFAIL	0.000	-
	ld.XFAIL	11.000	-
	Geometric Mean	0.339	-93.34%

KFAIL

	Name	Current	%
	TOTAL.KFAIL	0.000	-
	binutils.KFAIL	0.000	-
	gas.KFAIL	0.000	-
	ld.KFAIL	0.000	-
	Geometric Mean	0.000	-

UNSUPPORTED

	Name	Current	%
	TOTAL.UNSUPPORTED	269.000	-
	binutils.UNSUPPORTED	14.000	27.27%
	gas.UNSUPPORTED	8.000	-11.11%
	ld.UNSUPPORTED	247.000	-1.20%
	Geometric Mean	52.230	2.73%

UNRESOLVED

	Name	Current	%
	TOTAL.UNRESOLVED	0.000	-
	binutils.UNRESOLVED	0.000	-
	gas.UNRESOLVED	0.000	-
	ld.UNRESOLVED	0.000	-
	Geometric Mean	0.000	-

UNTESTED

	Name	Current	%
	TOTAL.UNTESTED	31.000	55.00%
	binutils.UNTESTED	11.000	-
	gas.UNTESTED	0.000	-
	ld.UNTESTED	20.000	-
	Geometric Mean	0.909	165.77%

ERROR

	Name	Current	%
	TOTAL.ERROR	0.000	-
	binutils.ERROR	0.000	-
	gas.ERROR	0.000	-
	ld.ERROR	0.000	-
	Geometric Mean	0.000	-

OTHER

	Name	Current	%
	TOTAL.OTHER	0.000	-
	binutils.OTHER	0.000	-
	gas.OTHER	0.000	-
	ld.OTHER	0.000	-
	Geometric Mean	0.000	-

good

	Name	Current	%
	TOTAL.good	2635.000	-2.55%
	binutils.good	247.000	-7.84%
	gas.good	1287.000	-1.30%
	ld.good	1101.000	-2.74%
	Geometric Mean	979.966	-3.64%

bad

	Name	Current	%
	TOTAL.bad	31.000	47.62%
	binutils.bad	11.000	1000.00%
	gas.bad	0.000	-
	ld.bad	20.000	-
	Geometric Mean	0.909	-87.87%

fails

	Name	Current	%
	TOTAL.fails	0.000	-
	Geometric Mean	0.000	-

flaky

	Name	Current	%
	TOTAL.flaky	0.000	-
	Geometric Mean	0.000	-

all

	Name	Current	%
	TOTAL.all	2666.000	-2.17%
	Geometric Mean	2666.000	-2.17%