Machine Info

Fields

hardware	None
os	None

Parameters

Run Info

Fields

Name	Value

Parameters

Name	Value
git_binutils	https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=057a2b4c4b57ef495dd32c9087e4af28bda41737 (+ 1 commits)
git_gcc	https://github.com/gcc-mirror/gcc/commit/73ad57c244c283bf6da0c16630212f11b945eda5 (unchanged)
git_gdb	https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=973563710c2f7c184fb6769e1b1d0fc5f3f181f5 (unchanged)
git_glibc	https://sourceware.org/git/?p=glibc.git;a=commit;h=21738846a19eb4a36981efd37d9ee7cb6d687494 (unchanged)
git_linux	https://git.linaro.org/kernel-org/linux.git/commit/?id=afcd48134c58d6af45fb3fdb648f1260b20f2326 (unchanged)
regression	https://linaro.atlassian.net/browse/GNU-1271
test_url	https://ci.linaro.org/job/tcwg_gnu_native_check_binutils--master-aarch64-build/757/

Report

Filter

master-aarch64 test results

Run	Order	Start Time	Duration
Current	0757 (binutils-2_41-release-03611-g057a2b4c4b5)	2024-06-26T19:11:04	0:00:00
Previous	0922 (5-changed-components)	2024-12-12T00:33:50	0:00:00
Baseline	0583 (5-changed-components)	2024-01-29T02:35:05	0:00:00

Tests Summary

Status Group	#	# (B)
Performance Regressions	17	5
Performance Improvements	2	10
Added Tests	24	26
Unchanged Tests	722	724
Total Tests	765

Run-Over-Run Changes Detail

Performance Regressions - FAIL	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.FAIL	60.00%	5.000	8.000	-	60.00%	-
ld.FAIL	60.00%	5.000	8.000	-	60.00%	-

Performance Regressions - PASS	Δ	Previous	Current	σ	Δ (B)	σ (B)
gas.PASS	-6.96%	992.000	923.000	-	9.75%	-
TOTAL.PASS	-5.06%	3261.000	3096.000	-	4.98%	-
ld.PASS	-4.65%	2001.000	1908.000	-	3.30%	-
binutils.PASS	-1.12%	268.000	265.000	-	1.53%	-

Performance Regressions - UNSUPPORTED	Δ	Previous	Current	σ	Δ (B)	σ (B)
gas.UNSUPPORTED	20.00%	5.000	6.000	-	0.00%	-

Performance Regressions - XFAIL	Δ	Previous	Current	σ	Δ (B)	σ (B)
ld.XFAIL	62.50%	8.000	13.000	-	0.00%	-
TOTAL.XFAIL	27.27%	11.000	14.000	-	0.00%	-

Performance Regressions - all	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.all	-4.67%	3451.000	3290.000	-	0.00%	-

Performance Regressions - bad	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.bad	200.00%	6.000	18.000	-	200.00%	-
ld.bad	200.00%	6.000	18.000	-	200.00%	-

Performance Regressions - fails	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.fails	140.00%	5.000	12.000	-	0.00%	-

Performance Regressions - good	Δ	Previous	Current	σ	Δ (B)	σ (B)
gas.good	-7.01%	999.000	929.000	-	9.68%	-
TOTAL.good	-4.88%	3445.000	3277.000	-	4.26%	-
ld.good	-4.38%	2170.000	2075.000	-	2.32%	-
binutils.good	-1.09%	276.000	273.000	-	1.87%	-

Performance Improvements - UNSUPPORTED	Δ	Previous	Current	σ	Δ (B)	σ (B)
ld.UNSUPPORTED	-4.35%	161.000	154.000	-	-8.33%	-
TOTAL.UNSUPPORTED	-3.47%	173.000	167.000	-	-7.22%	-

Added Tests - ERROR
binutils.ERROR
gas.ERROR

Added Tests - FAIL
binutils.FAIL
gas.FAIL

Added Tests - KFAIL
TOTAL.KFAIL
binutils.KFAIL
gas.KFAIL
ld.KFAIL

Added Tests - OTHER
TOTAL.OTHER
binutils.OTHER
gas.OTHER
ld.OTHER

Added Tests - UNRESOLVED
binutils.UNRESOLVED
gas.UNRESOLVED

Added Tests - UNTESTED
binutils.UNTESTED
gas.UNTESTED

Added Tests - XFAIL
gas.XFAIL

Added Tests - XPASS
TOTAL.XPASS
binutils.XPASS
gas.XPASS
ld.XPASS

Added Tests - bad
binutils.bad
gas.bad

Added Tests - flaky
TOTAL.flaky

Run-Over-Baseline Changes Detail

Performance Regressions - FAIL	Δ (B)	Baseline	Current	σ (B)	Δ	σ
TOTAL.FAIL	60.00%	5.000	8.000	-	60.00%	-
ld.FAIL	60.00%	5.000	8.000	-	60.00%	-

Performance Regressions - UNSUPPORTED	Δ (B)	Baseline	Current	σ (B)	Δ	σ
binutils.UNSUPPORTED	16.67%	6.000	7.000	-	0.00%	-

Performance Regressions - bad	Δ (B)	Baseline	Current	σ (B)	Δ	σ
TOTAL.bad	200.00%	6.000	18.000	-	200.00%	-
ld.bad	200.00%	6.000	18.000	-	200.00%	-

Performance Improvements - PASS	Δ (B)	Baseline	Current	σ (B)	Δ	σ
gas.PASS	9.75%	841.000	923.000	-	-6.96%	-
TOTAL.PASS	4.98%	2949.000	3096.000	-	-5.06%	-
ld.PASS	3.30%	1847.000	1908.000	-	-4.65%	-
binutils.PASS	1.53%	261.000	265.000	-	-1.12%	-

Performance Improvements - UNSUPPORTED	Δ (B)	Baseline	Current	σ (B)	Δ	σ
ld.UNSUPPORTED	-8.33%	168.000	154.000	-	-4.35%	-
TOTAL.UNSUPPORTED	-7.22%	180.000	167.000	-	-3.47%	-

Performance Improvements - good	Δ (B)	Baseline	Current	σ (B)	Δ	σ
gas.good	9.68%	847.000	929.000	-	-7.01%	-
TOTAL.good	4.26%	3143.000	3277.000	-	-4.88%	-
ld.good	2.32%	2028.000	2075.000	-	-4.38%	-
binutils.good	1.87%	268.000	273.000	-	-1.09%	-

Added Tests - ERROR
binutils.ERROR
gas.ERROR

Added Tests - FAIL
binutils.FAIL
gas.FAIL

Added Tests - KFAIL
TOTAL.KFAIL
binutils.KFAIL
gas.KFAIL
ld.KFAIL

Added Tests - OTHER
TOTAL.OTHER
binutils.OTHER
gas.OTHER
ld.OTHER

Added Tests - UNRESOLVED
binutils.UNRESOLVED
gas.UNRESOLVED

Added Tests - UNTESTED
binutils.UNTESTED
gas.UNTESTED

Added Tests - XFAIL
gas.XFAIL

Added Tests - XPASS
TOTAL.XPASS
binutils.XPASS
gas.XPASS
ld.XPASS

Added Tests - all
TOTAL.all

Added Tests - bad
binutils.bad
gas.bad

Added Tests - fails
TOTAL.fails

Added Tests - flaky
TOTAL.flaky

Report Time: 0.23s

PASS

	Name	Current	%
	TOTAL.PASS	3096.000	-5.06%
	binutils.PASS	265.000	-1.12%
	gas.PASS	923.000	-6.96%
	ld.PASS	1908.000	-4.65%
	Geometric Mean	1096.369	-4.47%

XPASS

	Name	Current	%
	TOTAL.XPASS	0.000	-
	binutils.XPASS	0.000	-
	gas.XPASS	0.000	-
	ld.XPASS	0.000	-
	Geometric Mean	0.000	-

FAIL

	Name	Current	%
	TOTAL.FAIL	8.000	60.00%
	binutils.FAIL	0.000	-
	gas.FAIL	0.000	-
	ld.FAIL	8.000	60.00%
	Geometric Mean	0.028	-99.44%

XFAIL

	Name	Current	%
	TOTAL.XFAIL	14.000	27.27%
	binutils.XFAIL	1.000	-
	gas.XFAIL	0.000	-
	ld.XFAIL	13.000	62.50%
	Geometric Mean	0.367	-91.74%

KFAIL

	Name	Current	%
	TOTAL.KFAIL	0.000	-
	binutils.KFAIL	0.000	-
	gas.KFAIL	0.000	-
	ld.KFAIL	0.000	-
	Geometric Mean	0.000	-

UNSUPPORTED

	Name	Current	%
	TOTAL.UNSUPPORTED	167.000	-3.47%
	binutils.UNSUPPORTED	7.000	-
	gas.UNSUPPORTED	6.000	20.00%
	ld.UNSUPPORTED	154.000	-4.35%
	Geometric Mean	32.238	2.60%

UNRESOLVED

	Name	Current	%
	TOTAL.UNRESOLVED	1.000	-
	binutils.UNRESOLVED	0.000	-
	gas.UNRESOLVED	0.000	-
	ld.UNRESOLVED	1.000	-
	Geometric Mean	0.010	-

UNTESTED

	Name	Current	%
	TOTAL.UNTESTED	1.000	-
	binutils.UNTESTED	0.000	-
	gas.UNTESTED	0.000	-
	ld.UNTESTED	1.000	-
	Geometric Mean	0.010	-99.01%

ERROR

	Name	Current	%
	TOTAL.ERROR	8.000	-
	binutils.ERROR	0.000	-
	gas.ERROR	0.000	-
	ld.ERROR	8.000	-
	Geometric Mean	0.028	-

OTHER

	Name	Current	%
	TOTAL.OTHER	0.000	-
	binutils.OTHER	0.000	-
	gas.OTHER	0.000	-
	ld.OTHER	0.000	-
	Geometric Mean	0.000	-

good

	Name	Current	%
	TOTAL.good	3277.000	-4.88%
	binutils.good	273.000	-1.09%
	gas.good	929.000	-7.01%
	ld.good	2075.000	-4.38%
	Geometric Mean	1145.957	-4.36%

bad

	Name	Current	%
	TOTAL.bad	18.000	200.00%
	binutils.bad	0.000	-
	gas.bad	0.000	-
	ld.bad	18.000	200.00%
	Geometric Mean	0.042	-99.29%

fails

	Name	Current	%
	TOTAL.fails	12.000	140.00%
	Geometric Mean	12.000	140.00%

flaky

	Name	Current	%
	TOTAL.flaky	0.000	-
	Geometric Mean	0.000	-

all

	Name	Current	%
	TOTAL.all	3290.000	-4.67%
	Geometric Mean	3290.000	-4.67%