Machine Info

Fields

hardware	None
os	None

Parameters

Run Info

Fields

Name	Value

Parameters

Name	Value
git_binutils	https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=057a2b4c4b57ef495dd32c9087e4af28bda41737 (+ 298 commits)
git_gcc	https://github.com/gcc-mirror/gcc/commit/73ad57c244c283bf6da0c16630212f11b945eda5 (+ 1122 commits)
git_gdb	https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=973563710c2f7c184fb6769e1b1d0fc5f3f181f5 (+ 300 commits)
git_glibc	https://sourceware.org/git/?p=glibc.git;a=commit;h=21738846a19eb4a36981efd37d9ee7cb6d687494 (+ 86 commits)
git_linux	https://git.linaro.org/kernel-org/linux.git/commit/?id=afcd48134c58d6af45fb3fdb648f1260b20f2326 (+ 999 commits)
regression	https://linaro.atlassian.net/browse/GNU-1271
test_url	https://ci.linaro.org/job/tcwg_gnu_native_check_binutils--master-aarch64-build/757/

Report

Filter

master-aarch64 test results

Run	Order	Start Time	Duration
Current	0757 (5-changed-components)	2024-05-30T18:08:31	0:00:00
Previous	1040 (5-changed-components)	2024-11-11T13:15:53	0:00:00
Baseline	0583 (5-changed-components)	2024-01-29T02:35:05	0:00:00

Tests Summary

Status Group	#	# (B)
Performance Regressions	16	6
Performance Improvements	0	11
Added Tests	24	24
Unchanged Tests	725	724
Total Tests	765

Run-Over-Run Changes Detail

Performance Regressions - FAIL	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.FAIL	60.00%	5.000	8.000	-	60.00%	-
ld.FAIL	60.00%	5.000	8.000	-	60.00%	-

Performance Regressions - PASS	Δ	Previous	Current	σ	Δ (B)	σ (B)
gas.PASS	-12.18%	1051.000	923.000	-	9.75%	-
TOTAL.PASS	-8.43%	3381.000	3096.000	-	4.98%	-
ld.PASS	-7.29%	2058.000	1908.000	-	3.30%	-
binutils.PASS	-2.57%	272.000	265.000	-	1.53%	-

Performance Regressions - UNSUPPORTED	Δ	Previous	Current	σ	Δ (B)	σ (B)
gas.UNSUPPORTED	20.00%	5.000	6.000	-	0.00%	-
binutils.UNSUPPORTED	16.67%	6.000	7.000	-	16.67%	-

Performance Regressions - all	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.all	-7.77%	3567.000	3290.000	-	4.48%	-

Performance Regressions - bad	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.bad	200.00%	6.000	18.000	-	200.00%	-
ld.bad	200.00%	6.000	18.000	-	200.00%	-

Performance Regressions - fails	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.fails	140.00%	5.000	12.000	-	140.00%	-

Performance Regressions - good	Δ	Previous	Current	σ	Δ (B)	σ (B)
gas.good	-12.03%	1056.000	929.000	-	9.68%	-
TOTAL.good	-7.98%	3561.000	3277.000	-	4.26%	-
ld.good	-6.78%	2226.000	2075.000	-	2.32%	-
binutils.good	-2.15%	279.000	273.000	-	1.87%	-

Added Tests - ERROR
binutils.ERROR
gas.ERROR

Added Tests - FAIL
binutils.FAIL
gas.FAIL

Added Tests - KFAIL
TOTAL.KFAIL
binutils.KFAIL
gas.KFAIL
ld.KFAIL

Added Tests - OTHER
TOTAL.OTHER
binutils.OTHER
gas.OTHER
ld.OTHER

Added Tests - UNRESOLVED
binutils.UNRESOLVED
gas.UNRESOLVED

Added Tests - UNTESTED
binutils.UNTESTED
gas.UNTESTED

Added Tests - XFAIL
gas.XFAIL

Added Tests - XPASS
TOTAL.XPASS
binutils.XPASS
gas.XPASS
ld.XPASS

Added Tests - bad
binutils.bad
gas.bad

Added Tests - flaky
TOTAL.flaky

Run-Over-Baseline Changes Detail

Performance Regressions - FAIL	Δ (B)	Baseline	Current	σ (B)	Δ	σ
TOTAL.FAIL	60.00%	5.000	8.000	-	60.00%	-
ld.FAIL	60.00%	5.000	8.000	-	60.00%	-

Performance Regressions - UNSUPPORTED	Δ (B)	Baseline	Current	σ (B)	Δ	σ
binutils.UNSUPPORTED	16.67%	6.000	7.000	-	16.67%	-

Performance Regressions - bad	Δ (B)	Baseline	Current	σ (B)	Δ	σ
TOTAL.bad	200.00%	6.000	18.000	-	200.00%	-
ld.bad	200.00%	6.000	18.000	-	200.00%	-

Performance Regressions - fails	Δ (B)	Baseline	Current	σ (B)	Δ	σ
TOTAL.fails	140.00%	5.000	12.000	-	140.00%	-

Performance Improvements - PASS	Δ (B)	Baseline	Current	σ (B)	Δ	σ
gas.PASS	9.75%	841.000	923.000	-	-12.18%	-
TOTAL.PASS	4.98%	2949.000	3096.000	-	-8.43%	-
ld.PASS	3.30%	1847.000	1908.000	-	-7.29%	-
binutils.PASS	1.53%	261.000	265.000	-	-2.57%	-

Performance Improvements - UNSUPPORTED	Δ (B)	Baseline	Current	σ (B)	Δ	σ
ld.UNSUPPORTED	-8.33%	168.000	154.000	-	-0.65%	-
TOTAL.UNSUPPORTED	-7.22%	180.000	167.000	-	0.60%	-

Performance Improvements - all	Δ (B)	Baseline	Current	σ (B)	Δ	σ
TOTAL.all	4.48%	3149.000	3290.000	-	-7.77%	-

Performance Improvements - good	Δ (B)	Baseline	Current	σ (B)	Δ	σ
gas.good	9.68%	847.000	929.000	-	-12.03%	-
TOTAL.good	4.26%	3143.000	3277.000	-	-7.98%	-
ld.good	2.32%	2028.000	2075.000	-	-6.78%	-
binutils.good	1.87%	268.000	273.000	-	-2.15%	-

Added Tests - ERROR
binutils.ERROR
gas.ERROR

Added Tests - FAIL
binutils.FAIL
gas.FAIL

Added Tests - KFAIL
TOTAL.KFAIL
binutils.KFAIL
gas.KFAIL
ld.KFAIL

Added Tests - OTHER
TOTAL.OTHER
binutils.OTHER
gas.OTHER
ld.OTHER

Added Tests - UNRESOLVED
binutils.UNRESOLVED
gas.UNRESOLVED

Added Tests - UNTESTED
binutils.UNTESTED
gas.UNTESTED

Added Tests - XFAIL
gas.XFAIL

Added Tests - XPASS
TOTAL.XPASS
binutils.XPASS
gas.XPASS
ld.XPASS

Added Tests - bad
binutils.bad
gas.bad

Added Tests - flaky
TOTAL.flaky

Report Time: 0.19s

PASS

	Name	Current	%
	TOTAL.PASS	3096.000	-8.43%
	binutils.PASS	265.000	-2.57%
	gas.PASS	923.000	-12.18%
	ld.PASS	1908.000	-7.29%
	Geometric Mean	1096.369	-7.68%

XPASS

	Name	Current	%
	TOTAL.XPASS	0.000	-
	binutils.XPASS	0.000	-
	gas.XPASS	0.000	-
	ld.XPASS	0.000	-
	Geometric Mean	0.000	-

FAIL

	Name	Current	%
	TOTAL.FAIL	8.000	60.00%
	binutils.FAIL	0.000	-
	gas.FAIL	0.000	-
	ld.FAIL	8.000	60.00%
	Geometric Mean	0.028	-99.44%

XFAIL

	Name	Current	%
	TOTAL.XFAIL	14.000	-
	binutils.XFAIL	1.000	-
	gas.XFAIL	0.000	-
	ld.XFAIL	13.000	-
	Geometric Mean	0.367	-93.52%

KFAIL

	Name	Current	%
	TOTAL.KFAIL	0.000	-
	binutils.KFAIL	0.000	-
	gas.KFAIL	0.000	-
	ld.KFAIL	0.000	-
	Geometric Mean	0.000	-

UNSUPPORTED

	Name	Current	%
	TOTAL.UNSUPPORTED	167.000	-
	binutils.UNSUPPORTED	7.000	16.67%
	gas.UNSUPPORTED	6.000	20.00%
	ld.UNSUPPORTED	154.000	-
	Geometric Mean	32.238	8.76%

UNRESOLVED

	Name	Current	%
	TOTAL.UNRESOLVED	1.000	-
	binutils.UNRESOLVED	0.000	-
	gas.UNRESOLVED	0.000	-
	ld.UNRESOLVED	1.000	-
	Geometric Mean	0.010	-

UNTESTED

	Name	Current	%
	TOTAL.UNTESTED	1.000	-
	binutils.UNTESTED	0.000	-
	gas.UNTESTED	0.000	-
	ld.UNTESTED	1.000	-
	Geometric Mean	0.010	-99.01%

ERROR

	Name	Current	%
	TOTAL.ERROR	8.000	-
	binutils.ERROR	0.000	-
	gas.ERROR	0.000	-
	ld.ERROR	8.000	-
	Geometric Mean	0.028	-

OTHER

	Name	Current	%
	TOTAL.OTHER	0.000	-
	binutils.OTHER	0.000	-
	gas.OTHER	0.000	-
	ld.OTHER	0.000	-
	Geometric Mean	0.000	-

good

	Name	Current	%
	TOTAL.good	3277.000	-7.98%
	binutils.good	273.000	-2.15%
	gas.good	929.000	-12.03%
	ld.good	2075.000	-6.78%
	Geometric Mean	1145.957	-7.30%

bad

	Name	Current	%
	TOTAL.bad	18.000	200.00%
	binutils.bad	0.000	-
	gas.bad	0.000	-
	ld.bad	18.000	200.00%
	Geometric Mean	0.042	-99.29%

fails

	Name	Current	%
	TOTAL.fails	12.000	140.00%
	Geometric Mean	12.000	140.00%

flaky

	Name	Current	%
	TOTAL.flaky	0.000	-
	Geometric Mean	0.000	-

all

	Name	Current	%
	TOTAL.all	3290.000	-7.77%
	Geometric Mean	3290.000	-7.77%