Machine Info

Fields

hardware	None
os	None

Parameters

Run Info

Fields

Name	Value

Parameters

Name	Value
git_binutils	https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=d5cbf916be4a049580dfed8682f3f8795e57ecfa (+ 1 commits)
git_gcc	https://gcc.gnu.org/git/gcc.git (fff5cfa4353e0c45400d8cb9cbff5c40c55fc97a) (unchanged)
git_gdb	https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=77bcfb741cbec8cadec7a0d450a32c8a5b161f23 (unchanged)
git_glibc	https://sourceware.org/git/?p=glibc.git;a=commit;h=7f045c0b48633b198b42bebdff0024d7cfab3901 (unchanged)
git_linux	https://gitlab.com/Linaro/lkft/mirrors/torvalds/linux-mainline/commit/c6d64479d6093a5c3d709d4cc992a5344877cc3c (unchanged)
git_qemu	https://gitlab.com/qemu-project/qemu/commit/3428a3894c6fdf43bc07405090699b1de5013cfc (unchanged)
regression	https://linaro.atlassian.net/browse/GNU-1427
test_url	https://ci.linaro.org/job/tcwg_gnu_cross_check_binutils--master-arm-build/866/

Report

Filter

master-arm test results

Run	Order	Start Time	Duration
Current	0866 (binutils-2_41-release-04788-gd5cbf916be4)	2024-08-26T22:00:44	0:00:00
Previous	0070 (basepoints/gcc-13-07175-g48d0244b6050)	2023-04-15T22:47:03	0:00:00
Baseline	0025 (6-changed-components)	2023-04-13T19:58:35	0:00:00

Tests Summary

Status Group	#	# (B)
Performance Regressions	6	6
Performance Improvements	11	11
Added Tests	30	30
Unchanged Tests	718	718
Total Tests	765

Run-Over-Run Changes Detail

Performance Regressions - UNSUPPORTED	Δ	Previous	Current	σ	Δ (B)	σ (B)
binutils.UNSUPPORTED	28.57%	7.000	9.000	-	28.57%	-
TOTAL.UNSUPPORTED	12.47%	393.000	442.000	-	12.47%	-
ld.UNSUPPORTED	12.43%	378.000	425.000	-	12.43%	-

Performance Regressions - bad	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.bad	250.00%	6.000	21.000	-	250.00%	-
ld.bad	250.00%	6.000	21.000	-	250.00%	-

Performance Regressions - fails	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.fails	133.33%	6.000	14.000	-	133.33%	-

Performance Improvements - PASS	Δ	Previous	Current	σ	Δ (B)	σ (B)
ld.PASS	7.06%	1614.000	1728.000	-	7.06%	-
TOTAL.PASS	4.61%	3148.000	3293.000	-	4.61%	-
binutils.PASS	4.30%	256.000	267.000	-	4.30%	-
gas.PASS	1.56%	1278.000	1298.000	-	1.56%	-

Performance Improvements - XFAIL	Δ	Previous	Current	σ	Δ (B)	σ (B)
ld.XFAIL	-50.00%	56.000	28.000	-	-50.00%	-
TOTAL.XFAIL	-49.12%	57.000	29.000	-	-49.12%	-

Performance Improvements - all	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.all	5.02%	3604.000	3785.000	-	5.02%	-

Performance Improvements - good	Δ	Previous	Current	σ	Δ (B)	σ (B)
ld.good	6.49%	2048.000	2181.000	-	6.49%	-
binutils.good	4.92%	264.000	277.000	-	4.92%	-
TOTAL.good	4.61%	3598.000	3764.000	-	4.61%	-
gas.good	1.56%	1286.000	1306.000	-	1.56%	-

Added Tests - ERROR
TOTAL.ERROR
binutils.ERROR
gas.ERROR
ld.ERROR

Added Tests - FAIL
binutils.FAIL
gas.FAIL

Added Tests - KFAIL
TOTAL.KFAIL
binutils.KFAIL
gas.KFAIL
ld.KFAIL

Added Tests - OTHER
TOTAL.OTHER
binutils.OTHER
gas.OTHER
ld.OTHER

Added Tests - UNRESOLVED
TOTAL.UNRESOLVED
binutils.UNRESOLVED
gas.UNRESOLVED
ld.UNRESOLVED

Added Tests - UNTESTED
TOTAL.UNTESTED
binutils.UNTESTED
gas.UNTESTED
ld.UNTESTED

Added Tests - XFAIL
gas.XFAIL

Added Tests - XPASS
TOTAL.XPASS
binutils.XPASS
gas.XPASS
ld.XPASS

Added Tests - bad
binutils.bad
gas.bad

Added Tests - flaky
TOTAL.flaky

Run-Over-Baseline Changes Detail

Performance Regressions - UNSUPPORTED	Δ (B)	Baseline	Current	σ (B)	Δ	σ
binutils.UNSUPPORTED	28.57%	7.000	9.000	-	28.57%	-
TOTAL.UNSUPPORTED	12.47%	393.000	442.000	-	12.47%	-
ld.UNSUPPORTED	12.43%	378.000	425.000	-	12.43%	-

Performance Regressions - bad	Δ (B)	Baseline	Current	σ (B)	Δ	σ
TOTAL.bad	250.00%	6.000	21.000	-	250.00%	-
ld.bad	250.00%	6.000	21.000	-	250.00%	-

Performance Regressions - fails	Δ (B)	Baseline	Current	σ (B)	Δ	σ
TOTAL.fails	133.33%	6.000	14.000	-	133.33%	-

Performance Improvements - PASS	Δ (B)	Baseline	Current	σ (B)	Δ	σ
ld.PASS	7.06%	1614.000	1728.000	-	7.06%	-
TOTAL.PASS	4.61%	3148.000	3293.000	-	4.61%	-
binutils.PASS	4.30%	256.000	267.000	-	4.30%	-
gas.PASS	1.56%	1278.000	1298.000	-	1.56%	-

Performance Improvements - XFAIL	Δ (B)	Baseline	Current	σ (B)	Δ	σ
ld.XFAIL	-50.00%	56.000	28.000	-	-50.00%	-
TOTAL.XFAIL	-49.12%	57.000	29.000	-	-49.12%	-

Performance Improvements - all	Δ (B)	Baseline	Current	σ (B)	Δ	σ
TOTAL.all	5.02%	3604.000	3785.000	-	5.02%	-

Performance Improvements - good	Δ (B)	Baseline	Current	σ (B)	Δ	σ
ld.good	6.49%	2048.000	2181.000	-	6.49%	-
binutils.good	4.92%	264.000	277.000	-	4.92%	-
TOTAL.good	4.61%	3598.000	3764.000	-	4.61%	-
gas.good	1.56%	1286.000	1306.000	-	1.56%	-

Added Tests - ERROR
TOTAL.ERROR
binutils.ERROR
gas.ERROR
ld.ERROR

Added Tests - FAIL
binutils.FAIL
gas.FAIL

Added Tests - KFAIL
TOTAL.KFAIL
binutils.KFAIL
gas.KFAIL
ld.KFAIL

Added Tests - OTHER
TOTAL.OTHER
binutils.OTHER
gas.OTHER
ld.OTHER

Added Tests - UNRESOLVED
TOTAL.UNRESOLVED
binutils.UNRESOLVED
gas.UNRESOLVED
ld.UNRESOLVED

Added Tests - UNTESTED
TOTAL.UNTESTED
binutils.UNTESTED
gas.UNTESTED
ld.UNTESTED

Added Tests - XFAIL
gas.XFAIL

Added Tests - XPASS
TOTAL.XPASS
binutils.XPASS
gas.XPASS
ld.XPASS

Added Tests - bad
binutils.bad
gas.bad

Added Tests - flaky
TOTAL.flaky

Report Time: 0.19s

PASS

	Name	Current	%
	TOTAL.PASS	3293.000	4.61%
	binutils.PASS	267.000	4.30%
	gas.PASS	1298.000	1.56%
	ld.PASS	1728.000	7.06%
	Geometric Mean	1185.033	4.36%

XPASS

	Name	Current	%
	TOTAL.XPASS	0.000	-
	binutils.XPASS	0.000	-
	gas.XPASS	0.000	-
	ld.XPASS	0.000	-
	Geometric Mean	0.000	-

FAIL

	Name	Current	%
	TOTAL.FAIL	21.000	-
	binutils.FAIL	0.000	-
	gas.FAIL	0.000	-
	ld.FAIL	21.000	-
	Geometric Mean	0.046	-

XFAIL

	Name	Current	%
	TOTAL.XFAIL	29.000	-49.12%
	binutils.XFAIL	1.000	-
	gas.XFAIL	0.000	-
	ld.XFAIL	28.000	-50.00%
	Geometric Mean	0.534	-96.38%

KFAIL

	Name	Current	%
	TOTAL.KFAIL	0.000	-
	binutils.KFAIL	0.000	-
	gas.KFAIL	0.000	-
	ld.KFAIL	0.000	-
	Geometric Mean	0.000	-

UNSUPPORTED

	Name	Current	%
	TOTAL.UNSUPPORTED	442.000	12.47%
	binutils.UNSUPPORTED	9.000	28.57%
	gas.UNSUPPORTED	8.000	-
	ld.UNSUPPORTED	425.000	12.43%
	Geometric Mean	60.644	12.92%

UNRESOLVED

	Name	Current	%
	TOTAL.UNRESOLVED	0.000	-
	binutils.UNRESOLVED	0.000	-
	gas.UNRESOLVED	0.000	-
	ld.UNRESOLVED	0.000	-
	Geometric Mean	0.000	-

UNTESTED

	Name	Current	%
	TOTAL.UNTESTED	0.000	-
	binutils.UNTESTED	0.000	-
	gas.UNTESTED	0.000	-
	ld.UNTESTED	0.000	-
	Geometric Mean	0.000	-

ERROR

	Name	Current	%
	TOTAL.ERROR	0.000	-
	binutils.ERROR	0.000	-
	gas.ERROR	0.000	-
	ld.ERROR	0.000	-
	Geometric Mean	0.000	-

OTHER

	Name	Current	%
	TOTAL.OTHER	0.000	-
	binutils.OTHER	0.000	-
	gas.OTHER	0.000	-
	ld.OTHER	0.000	-
	Geometric Mean	0.000	-

good

	Name	Current	%
	TOTAL.good	3764.000	4.61%
	binutils.good	277.000	4.92%
	gas.good	1306.000	1.56%
	ld.good	2181.000	6.49%
	Geometric Mean	1312.750	4.38%

bad

	Name	Current	%
	TOTAL.bad	21.000	250.00%
	binutils.bad	0.000	-
	gas.bad	0.000	-
	ld.bad	21.000	250.00%
	Geometric Mean	0.046	-99.24%

fails

	Name	Current	%
	TOTAL.fails	14.000	133.33%
	Geometric Mean	14.000	133.33%

flaky

	Name	Current	%
	TOTAL.flaky	0.000	-
	Geometric Mean	0.000	-

all

	Name	Current	%
	TOTAL.all	3785.000	5.02%
	Geometric Mean	3785.000	5.02%