Machine Info

Fields

hardware	None
os	None

Parameters

Run Info

Fields

Name	Value

Parameters

Name	Value
git_binutils	https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=e3fa5cf492e09dc0e4041263751720c73799a3cd (+ 14 commits)
git_gcc	https://gcc.gnu.org/git/gcc.git (fa878dc8c45fa30aeeaafbe8ab2ff2bae3fbb572) (+ 57 commits)
git_gdb	https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=e3fa5cf492e09dc0e4041263751720c73799a3cd (+ 14 commits)
git_glibc	https://sourceware.org/git/?p=glibc.git;a=commit;h=6bc301672bfbde618d4ec02e51e6e2cbadd4ac1e (+ 10 commits)
git_linux	https://gitlab.com/Linaro/lkft/mirrors/torvalds/linux-mainline/commit/231825b2e1ff6ba799c5eaf396d3ab2354e37c6b (+ 18 commits)
test_url	https://ci.linaro.org/job/tcwg_gnu_native_check_binutils--master-aarch64-build/921/

Report

Filter

master-aarch64 test results

Run	Order	Start Time	Duration
Current	0921 (5-changed-components)	2024-12-10T17:47:09	0:00:00
Previous	0757 (binutils-2_41-release-03611-g057a2b4c4b5)	2024-06-26T19:11:04	0:00:00
Baseline	0583 (5-changed-components)	2024-01-29T02:35:05	0:00:00

Tests Summary

Status Group	#	# (B)
Performance Regressions	2	1
Performance Improvements	17	13
Added Tests	27	29
Unchanged Tests	719	722
Total Tests	765

Run-Over-Run Changes Detail

Performance Regressions - UNSUPPORTED	Δ	Previous	Current	σ	Δ (B)	σ (B)
ld.UNSUPPORTED	4.55%	154.000	161.000	-	-4.17%	-
TOTAL.UNSUPPORTED	3.59%	167.000	173.000	-	-3.89%	-

Performance Improvements - FAIL	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.FAIL	-37.50%	8.000	5.000	-	0.00%	-
ld.FAIL	-37.50%	8.000	5.000	-	0.00%	-

Performance Improvements - PASS	Δ	Previous	Current	σ	Δ (B)	σ (B)
gas.PASS	7.48%	923.000	992.000	-	17.95%	-
TOTAL.PASS	5.33%	3096.000	3261.000	-	10.58%	-
ld.PASS	4.87%	1908.000	2001.000	-	8.34%	-
binutils.PASS	1.13%	265.000	268.000	-	2.68%	-

Performance Improvements - UNSUPPORTED	Δ	Previous	Current	σ	Δ (B)	σ (B)
gas.UNSUPPORTED	-16.67%	6.000	5.000	-	-16.67%	-

Performance Improvements - XFAIL	Δ	Previous	Current	σ	Δ (B)	σ (B)
ld.XFAIL	-38.46%	13.000	8.000	-	-38.46%	-
TOTAL.XFAIL	-21.43%	14.000	11.000	-	-21.43%	-

Performance Improvements - all	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.all	4.89%	3290.000	3451.000	-	0.00%	-

Performance Improvements - bad	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.bad	-66.67%	18.000	6.000	-	0.00%	-
ld.bad	-66.67%	18.000	6.000	-	0.00%	-

Performance Improvements - fails	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.fails	-58.33%	12.000	5.000	-	0.00%	-

Performance Improvements - good	Δ	Previous	Current	σ	Δ (B)	σ (B)
gas.good	7.53%	929.000	999.000	-	17.95%	-
TOTAL.good	5.13%	3277.000	3445.000	-	9.61%	-
ld.good	4.58%	2075.000	2170.000	-	7.00%	-
binutils.good	1.10%	273.000	276.000	-	2.99%	-

Added Tests - ERROR
TOTAL.ERROR
binutils.ERROR
gas.ERROR
ld.ERROR

Added Tests - FAIL
binutils.FAIL
gas.FAIL

Added Tests - KFAIL
TOTAL.KFAIL
binutils.KFAIL
gas.KFAIL
ld.KFAIL

Added Tests - OTHER
TOTAL.OTHER
binutils.OTHER
gas.OTHER
ld.OTHER

Added Tests - UNRESOLVED
TOTAL.UNRESOLVED
binutils.UNRESOLVED
gas.UNRESOLVED
ld.UNRESOLVED

Added Tests - UNTESTED
binutils.UNTESTED
gas.UNTESTED

Added Tests - XPASS
TOTAL.XPASS
binutils.XPASS
gas.XPASS
ld.XPASS

Added Tests - bad
binutils.bad
gas.bad

Added Tests - flaky
TOTAL.flaky

Run-Over-Baseline Changes Detail

Performance Regressions - UNSUPPORTED	Δ (B)	Baseline	Current	σ (B)	Δ	σ
binutils.UNSUPPORTED	16.67%	6.000	7.000	-	0.00%	-

Performance Improvements - PASS	Δ (B)	Baseline	Current	σ (B)	Δ	σ
gas.PASS	17.95%	841.000	992.000	-	7.48%	-
TOTAL.PASS	10.58%	2949.000	3261.000	-	5.33%	-
ld.PASS	8.34%	1847.000	2001.000	-	4.87%	-
binutils.PASS	2.68%	261.000	268.000	-	1.13%	-

Performance Improvements - UNSUPPORTED	Δ (B)	Baseline	Current	σ (B)	Δ	σ
gas.UNSUPPORTED	-16.67%	6.000	5.000	-	-16.67%	-
ld.UNSUPPORTED	-4.17%	168.000	161.000	-	4.55%	-
TOTAL.UNSUPPORTED	-3.89%	180.000	173.000	-	3.59%	-

Performance Improvements - XFAIL	Δ (B)	Baseline	Current	σ (B)	Δ	σ
ld.XFAIL	-38.46%	13.000	8.000	-	-38.46%	-
TOTAL.XFAIL	-21.43%	14.000	11.000	-	-21.43%	-

Performance Improvements - good	Δ (B)	Baseline	Current	σ (B)	Δ	σ
gas.good	17.95%	847.000	999.000	-	7.53%	-
TOTAL.good	9.61%	3143.000	3445.000	-	5.13%	-
ld.good	7.00%	2028.000	2170.000	-	4.58%	-
binutils.good	2.99%	268.000	276.000	-	1.10%	-

Added Tests - ERROR
TOTAL.ERROR
binutils.ERROR
gas.ERROR
ld.ERROR

Added Tests - FAIL
binutils.FAIL
gas.FAIL

Added Tests - KFAIL
TOTAL.KFAIL
binutils.KFAIL
gas.KFAIL
ld.KFAIL

Added Tests - OTHER
TOTAL.OTHER
binutils.OTHER
gas.OTHER
ld.OTHER

Added Tests - UNRESOLVED
TOTAL.UNRESOLVED
binutils.UNRESOLVED
gas.UNRESOLVED
ld.UNRESOLVED

Added Tests - UNTESTED
binutils.UNTESTED
gas.UNTESTED

Added Tests - XPASS
TOTAL.XPASS
binutils.XPASS
gas.XPASS
ld.XPASS

Added Tests - all
TOTAL.all

Added Tests - bad
binutils.bad
gas.bad

Added Tests - fails
TOTAL.fails

Added Tests - flaky
TOTAL.flaky

Report Time: 0.22s

PASS

	Name	Current	%
	TOTAL.PASS	3261.000	5.33%
	binutils.PASS	268.000	1.13%
	gas.PASS	992.000	7.48%
	ld.PASS	2001.000	4.87%
	Geometric Mean	1147.654	4.68%

XPASS

	Name	Current	%
	TOTAL.XPASS	0.000	-
	binutils.XPASS	0.000	-
	gas.XPASS	0.000	-
	ld.XPASS	0.000	-
	Geometric Mean	0.000	-

FAIL

	Name	Current	%
	TOTAL.FAIL	5.000	-37.50%
	binutils.FAIL	0.000	-
	gas.FAIL	0.000	-
	ld.FAIL	5.000	-37.50%
	Geometric Mean	0.022	-99.72%

XFAIL

	Name	Current	%
	TOTAL.XFAIL	11.000	-21.43%
	binutils.XFAIL	1.000	-
	gas.XFAIL	2.000	-
	ld.XFAIL	8.000	-38.46%
	Geometric Mean	3.642	891.91%

KFAIL

	Name	Current	%
	TOTAL.KFAIL	0.000	-
	binutils.KFAIL	0.000	-
	gas.KFAIL	0.000	-
	ld.KFAIL	0.000	-
	Geometric Mean	0.000	-

UNSUPPORTED

	Name	Current	%
	TOTAL.UNSUPPORTED	173.000	3.59%
	binutils.UNSUPPORTED	7.000	-
	gas.UNSUPPORTED	5.000	-16.67%
	ld.UNSUPPORTED	161.000	4.55%
	Geometric Mean	31.422	-2.53%

UNRESOLVED

	Name	Current	%
	TOTAL.UNRESOLVED	0.000	-
	binutils.UNRESOLVED	0.000	-
	gas.UNRESOLVED	0.000	-
	ld.UNRESOLVED	0.000	-
	Geometric Mean	0.000	-

UNTESTED

	Name	Current	%
	TOTAL.UNTESTED	1.000	-
	binutils.UNTESTED	0.000	-
	gas.UNTESTED	0.000	-
	ld.UNTESTED	1.000	-
	Geometric Mean	0.010	-99.01%

ERROR

	Name	Current	%
	TOTAL.ERROR	0.000	-
	binutils.ERROR	0.000	-
	gas.ERROR	0.000	-
	ld.ERROR	0.000	-
	Geometric Mean	0.000	-

OTHER

	Name	Current	%
	TOTAL.OTHER	0.000	-
	binutils.OTHER	0.000	-
	gas.OTHER	0.000	-
	ld.OTHER	0.000	-
	Geometric Mean	0.000	-

good

	Name	Current	%
	TOTAL.good	3445.000	5.13%
	binutils.good	276.000	1.10%
	gas.good	999.000	7.53%
	ld.good	2170.000	4.58%
	Geometric Mean	1198.204	4.56%

bad

	Name	Current	%
	TOTAL.bad	6.000	-66.67%
	binutils.bad	0.000	-
	gas.bad	0.000	-
	ld.bad	6.000	-66.67%
	Geometric Mean	0.024	-99.86%

fails

	Name	Current	%
	TOTAL.fails	5.000	-58.33%
	Geometric Mean	5.000	-58.33%

flaky

	Name	Current	%
	TOTAL.flaky	0.000	-
	Geometric Mean	0.000	-

all

	Name	Current	%
	TOTAL.all	3451.000	4.89%
	Geometric Mean	3451.000	4.89%