Machine Info

Fields

hardware	None
os	None

Parameters

Run Info

Fields

Name	Value

Parameters

Name	Value
git_binutils	https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=87860ef6f4650d513530af4cb4e3e85a863139cf (+ 77 commits)
git_gcc	https://github.com/gcc-mirror/gcc/commit/59221dc587f369695d9b0c2f73aedf8458931f0f (+ 178 commits)
git_gdb	https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=ff05ed68edc34235d06c48cb2178a97642424593 (+ 81 commits)
git_glibc	https://sourceware.org/git/?p=glibc.git;a=commit;h=da61ba3f8930e9b39fe35f88cb2ed4bc4571e598 (+ 44 commits)
git_linux	https://git.linaro.org/kernel-org/linux.git/commit/?id=50736169ecc8387247fe6a00932852ce7b057083 (+ 305 commits)
test_url	https://ci.linaro.org/job/tcwg_gnu_native_check_gdb--master-arm-build/1314/

Report

Filter

master-arm test results

Run	Order	Start Time	Duration
Current	1314 (5-changed-components)	2024-06-17T12:24:04	0:00:00
Previous	1284 (gdb-15-branchpoint-00116-g9102a6c15c7)	2024-06-08T07:49:23	0:00:00
Baseline	1080 (5-changed-components)	2024-01-29T02:35:05	0:00:00

Tests Summary

Status Group	#	# (B)
Performance Regressions	3	4
Performance Improvements	18	20
Unchanged Tests	384	381
Total Tests	405

Run-Over-Run Changes Detail

Performance Regressions - KFAIL	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.KFAIL	1.61%	124.000	126.000	-	13.51%	-
gdb.KFAIL	1.61%	124.000	126.000	-	13.51%	-

Performance Regressions - flaky	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.flaky	32.54%	676.000	896.000	-	0.00%	-

Performance Improvements - ERROR	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.ERROR	-50.00%	8.000	4.000	-	-99.06%	-
gdb.ERROR	-50.00%	8.000	4.000	-	-99.06%	-

Performance Improvements - FAIL	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.FAIL	-3.99%	1377.000	1322.000	-	-5.64%	-
gdb.FAIL	-3.99%	1377.000	1322.000	-	-5.64%	-

Performance Improvements - OTHER	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.OTHER	-90.00%	40.000	4.000	-	-63.64%	-
gdb.OTHER	-90.00%	40.000	4.000	-	-63.64%	-

Performance Improvements - PASS	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.PASS	3.97%	100893.000	104898.000	-	5.29%	-
gdb.PASS	3.97%	100893.000	104898.000	-	5.29%	-

Performance Improvements - UNRESOLVED	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.UNRESOLVED	-25.00%	4.000	3.000	-	-97.60%	-
gdb.UNRESOLVED	-25.00%	4.000	3.000	-	-97.60%	-

Performance Improvements - XFAIL	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.XFAIL	-3.33%	240.000	232.000	-	5.45%	-
gdb.XFAIL	-3.33%	240.000	232.000	-	5.45%	-

Performance Improvements - all	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.all	3.78%	103272.000	107177.000	-	4.54%	-

Performance Improvements - bad	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.bad	-6.30%	1523.000	1427.000	-	-30.66%	-
gdb.bad	-6.30%	1523.000	1427.000	-	-30.66%	-

Performance Improvements - fails	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.fails	-4.43%	1377.000	1316.000	-	-19.21%	-

Performance Improvements - good	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.good	3.93%	101749.000	105750.000	-	5.26%	-
gdb.good	3.93%	101749.000	105750.000	-	5.26%	-

Run-Over-Baseline Changes Detail

Performance Regressions - KFAIL	Δ (B)	Baseline	Current	σ (B)	Δ	σ
TOTAL.KFAIL	13.51%	111.000	126.000	-	1.61%	-
gdb.KFAIL	13.51%	111.000	126.000	-	1.61%	-

Performance Regressions - XFAIL	Δ (B)	Baseline	Current	σ (B)	Δ	σ
TOTAL.XFAIL	5.45%	220.000	232.000	-	-3.33%	-
gdb.XFAIL	5.45%	220.000	232.000	-	-3.33%	-

Performance Improvements - ERROR	Δ (B)	Baseline	Current	σ (B)	Δ	σ
TOTAL.ERROR	-99.06%	424.000	4.000	-	-50.00%	-
gdb.ERROR	-99.06%	424.000	4.000	-	-50.00%	-

Performance Improvements - FAIL	Δ (B)	Baseline	Current	σ (B)	Δ	σ
TOTAL.FAIL	-5.64%	1401.000	1322.000	-	-3.99%	-
gdb.FAIL	-5.64%	1401.000	1322.000	-	-3.99%	-

Performance Improvements - OTHER	Δ (B)	Baseline	Current	σ (B)	Δ	σ
TOTAL.OTHER	-63.64%	11.000	4.000	-	-90.00%	-
gdb.OTHER	-63.64%	11.000	4.000	-	-90.00%	-

Performance Improvements - PASS	Δ (B)	Baseline	Current	σ (B)	Δ	σ
TOTAL.PASS	5.29%	99624.000	104898.000	-	3.97%	-
gdb.PASS	5.29%	99624.000	104898.000	-	3.97%	-

Performance Improvements - UNRESOLVED	Δ (B)	Baseline	Current	σ (B)	Δ	σ
TOTAL.UNRESOLVED	-97.60%	125.000	3.000	-	-25.00%	-
gdb.UNRESOLVED	-97.60%	125.000	3.000	-	-25.00%	-

Performance Improvements - UNSUPPORTED	Δ (B)	Baseline	Current	σ (B)	Δ	σ
TOTAL.UNSUPPORTED	-2.37%	506.000	494.000	-	0.41%	-
gdb.UNSUPPORTED	-2.37%	506.000	494.000	-	0.41%	-

Performance Improvements - UNTESTED	Δ (B)	Baseline	Current	σ (B)	Δ	σ
TOTAL.UNTESTED	-3.12%	96.000	93.000	-	0.00%	-
gdb.UNTESTED	-3.12%	96.000	93.000	-	0.00%	-

Performance Improvements - all	Δ (B)	Baseline	Current	σ (B)	Δ	σ
TOTAL.all	4.54%	102519.000	107177.000	-	3.78%	-

Performance Improvements - bad	Δ (B)	Baseline	Current	σ (B)	Δ	σ
TOTAL.bad	-30.66%	2058.000	1427.000	-	-6.30%	-
gdb.bad	-30.66%	2058.000	1427.000	-	-6.30%	-

Performance Improvements - fails	Δ (B)	Baseline	Current	σ (B)	Δ	σ
TOTAL.fails	-19.21%	1629.000	1316.000	-	-4.43%	-

Performance Improvements - good	Δ (B)	Baseline	Current	σ (B)	Δ	σ
TOTAL.good	5.26%	100461.000	105750.000	-	3.93%	-
gdb.good	5.26%	100461.000	105750.000	-	3.93%	-

Report Time: 0.18s

PASS

	Name	Current	%
	TOTAL.PASS	104898.000	3.97%
	gdb.PASS	104898.000	3.97%
	Geometric Mean	104898.000	3.97%

XPASS

	Name	Current	%
	TOTAL.XPASS	1.000	-
	gdb.XPASS	1.000	-
	Geometric Mean	1.000	-

FAIL

	Name	Current	%
	TOTAL.FAIL	1322.000	-3.99%
	gdb.FAIL	1322.000	-3.99%
	Geometric Mean	1322.000	-3.99%

XFAIL

	Name	Current	%
	TOTAL.XFAIL	232.000	-3.33%
	gdb.XFAIL	232.000	-3.33%
	Geometric Mean	232.000	-3.33%

KFAIL

	Name	Current	%
	TOTAL.KFAIL	126.000	1.61%
	gdb.KFAIL	126.000	1.61%
	Geometric Mean	126.000	1.61%

UNSUPPORTED

	Name	Current	%
	TOTAL.UNSUPPORTED	494.000	-
	gdb.UNSUPPORTED	494.000	-
	Geometric Mean	494.000	-

UNRESOLVED

	Name	Current	%
	TOTAL.UNRESOLVED	3.000	-25.00%
	gdb.UNRESOLVED	3.000	-25.00%
	Geometric Mean	3.000	-25.00%

UNTESTED

	Name	Current	%
	TOTAL.UNTESTED	93.000	-
	gdb.UNTESTED	93.000	-
	Geometric Mean	93.000	-

ERROR

	Name	Current	%
	TOTAL.ERROR	4.000	-50.00%
	gdb.ERROR	4.000	-50.00%
	Geometric Mean	4.000	-50.00%

OTHER

	Name	Current	%
	TOTAL.OTHER	4.000	-90.00%
	gdb.OTHER	4.000	-90.00%
	Geometric Mean	4.000	-90.00%

good

	Name	Current	%
	TOTAL.good	105750.000	3.93%
	gdb.good	105750.000	3.93%
	Geometric Mean	105750.000	3.93%

bad

	Name	Current	%
	TOTAL.bad	1427.000	-6.30%
	gdb.bad	1427.000	-6.30%
	Geometric Mean	1427.000	-6.30%

fails

	Name	Current	%
	TOTAL.fails	1316.000	-4.43%
	Geometric Mean	1316.000	-4.43%

flaky

	Name	Current	%
	TOTAL.flaky	896.000	32.54%
	Geometric Mean	896.000	32.54%

all

	Name	Current	%
	TOTAL.all	107177.000	3.78%
	Geometric Mean	107177.000	3.78%