Machine Info

Fields

hardware	None
os	None

Parameters

Run Info

Fields

Name	Value

Parameters

Name	Value
git_binutils	https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=9a50e260ee1cf3b7e355371f0f4248407101795d (+ 59 commits)
git_gcc	https://github.com/gcc-mirror/gcc/commit/da57b4562c5ada8971b6684b6aad1c996e1ef9cc (+ 73 commits)
git_gdb	https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=292b9a302933418abcb8b76b23e83af8028c659a (+ 63 commits)
git_glibc	https://sourceware.org/git/?p=glibc.git;a=commit;h=29807a271edca3e47195bda0c69ae45e245551a9 (+ 12 commits)
git_linux	https://git.linaro.org/kernel-org/linux.git/commit/?id=2ccbdf43d5e758f8493a95252073cf9078a5fea5 (+ 62 commits)
test_url	https://ci.linaro.org/job/tcwg_gnu_native_check_gdb--master-arm-build/1296/

Report

Filter

master-arm test results

Run	Order	Start Time	Duration
Current	1296 (5-changed-components)	2024-06-10T15:53:44	0:00:00
Previous	1278 (basepoints/gcc-15-00276-gbed6ec161be8)	2024-06-06T00:35:26	0:00:00
Baseline	1080 (5-changed-components)	2024-01-29T02:35:05	0:00:00

Tests Summary

Status Group	#	# (B)
Performance Regressions	7	4
Performance Improvements	12	20
Unchanged Tests	386	381
Total Tests	405

Run-Over-Run Changes Detail

Performance Regressions - KFAIL	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.KFAIL	2.48%	121.000	124.000	-	11.71%	-
gdb.KFAIL	2.48%	121.000	124.000	-	11.71%	-

Performance Regressions - UNRESOLVED	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.UNRESOLVED	50.00%	2.000	3.000	-	-97.60%	-
gdb.UNRESOLVED	50.00%	2.000	3.000	-	-97.60%	-

Performance Regressions - XFAIL	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.XFAIL	3.03%	231.000	238.000	-	8.18%	-
gdb.XFAIL	3.03%	231.000	238.000	-	8.18%	-

Performance Regressions - flaky	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.flaky	37.05%	502.000	688.000	-	0.00%	-

Performance Improvements - ERROR	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.ERROR	-50.00%	6.000	3.000	-	-99.29%	-
gdb.ERROR	-50.00%	6.000	3.000	-	-99.29%	-

Performance Improvements - FAIL	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.FAIL	-3.16%	1360.000	1317.000	-	-6.00%	-
gdb.FAIL	-3.16%	1360.000	1317.000	-	-6.00%	-

Performance Improvements - PASS	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.PASS	3.55%	101203.000	104791.000	-	5.19%	-
gdb.PASS	3.55%	101203.000	104791.000	-	5.19%	-

Performance Improvements - all	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.all	3.44%	103510.000	107067.000	-	4.44%	-

Performance Improvements - bad	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.bad	-3.07%	1466.000	1421.000	-	-30.95%	-
gdb.bad	-3.07%	1466.000	1421.000	-	-30.95%	-

Performance Improvements - fails	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.fails	-3.39%	1356.000	1310.000	-	-19.58%	-

Performance Improvements - good	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.good	3.53%	102044.000	105646.000	-	5.16%	-
gdb.good	3.53%	102044.000	105646.000	-	5.16%	-

Run-Over-Baseline Changes Detail

Performance Regressions - KFAIL	Δ (B)	Baseline	Current	σ (B)	Δ	σ
TOTAL.KFAIL	11.71%	111.000	124.000	-	2.48%	-
gdb.KFAIL	11.71%	111.000	124.000	-	2.48%	-

Performance Regressions - XFAIL	Δ (B)	Baseline	Current	σ (B)	Δ	σ
TOTAL.XFAIL	8.18%	220.000	238.000	-	3.03%	-
gdb.XFAIL	8.18%	220.000	238.000	-	3.03%	-

Performance Improvements - ERROR	Δ (B)	Baseline	Current	σ (B)	Δ	σ
TOTAL.ERROR	-99.29%	424.000	3.000	-	-50.00%	-
gdb.ERROR	-99.29%	424.000	3.000	-	-50.00%	-

Performance Improvements - FAIL	Δ (B)	Baseline	Current	σ (B)	Δ	σ
TOTAL.FAIL	-6.00%	1401.000	1317.000	-	-3.16%	-
gdb.FAIL	-6.00%	1401.000	1317.000	-	-3.16%	-

Performance Improvements - OTHER	Δ (B)	Baseline	Current	σ (B)	Δ	σ
TOTAL.OTHER	-63.64%	11.000	4.000	-	0.00%	-
gdb.OTHER	-63.64%	11.000	4.000	-	0.00%	-

Performance Improvements - PASS	Δ (B)	Baseline	Current	σ (B)	Δ	σ
TOTAL.PASS	5.19%	99624.000	104791.000	-	3.55%	-
gdb.PASS	5.19%	99624.000	104791.000	-	3.55%	-

Performance Improvements - UNRESOLVED	Δ (B)	Baseline	Current	σ (B)	Δ	σ
TOTAL.UNRESOLVED	-97.60%	125.000	3.000	-	50.00%	-
gdb.UNRESOLVED	-97.60%	125.000	3.000	-	50.00%	-

Performance Improvements - UNSUPPORTED	Δ (B)	Baseline	Current	σ (B)	Δ	σ
TOTAL.UNSUPPORTED	-2.57%	506.000	493.000	-	0.82%	-
gdb.UNSUPPORTED	-2.57%	506.000	493.000	-	0.82%	-

Performance Improvements - UNTESTED	Δ (B)	Baseline	Current	σ (B)	Δ	σ
TOTAL.UNTESTED	-3.12%	96.000	93.000	-	0.00%	-
gdb.UNTESTED	-3.12%	96.000	93.000	-	0.00%	-

Performance Improvements - all	Δ (B)	Baseline	Current	σ (B)	Δ	σ
TOTAL.all	4.44%	102519.000	107067.000	-	3.44%	-

Performance Improvements - bad	Δ (B)	Baseline	Current	σ (B)	Δ	σ
TOTAL.bad	-30.95%	2058.000	1421.000	-	-3.07%	-
gdb.bad	-30.95%	2058.000	1421.000	-	-3.07%	-

Performance Improvements - fails	Δ (B)	Baseline	Current	σ (B)	Δ	σ
TOTAL.fails	-19.58%	1629.000	1310.000	-	-3.39%	-

Performance Improvements - good	Δ (B)	Baseline	Current	σ (B)	Δ	σ
TOTAL.good	5.16%	100461.000	105646.000	-	3.53%	-
gdb.good	5.16%	100461.000	105646.000	-	3.53%	-

Report Time: 0.20s

PASS

	Name	Current	%
	TOTAL.PASS	104791.000	3.55%
	gdb.PASS	104791.000	3.55%
	Geometric Mean	104791.000	3.55%

XPASS

	Name	Current	%
	TOTAL.XPASS	1.000	-
	gdb.XPASS	1.000	-
	Geometric Mean	1.000	-

FAIL

	Name	Current	%
	TOTAL.FAIL	1317.000	-3.16%
	gdb.FAIL	1317.000	-3.16%
	Geometric Mean	1317.000	-3.16%

XFAIL

	Name	Current	%
	TOTAL.XFAIL	238.000	3.03%
	gdb.XFAIL	238.000	3.03%
	Geometric Mean	238.000	3.03%

KFAIL

	Name	Current	%
	TOTAL.KFAIL	124.000	2.48%
	gdb.KFAIL	124.000	2.48%
	Geometric Mean	124.000	2.48%

UNSUPPORTED

	Name	Current	%
	TOTAL.UNSUPPORTED	493.000	-
	gdb.UNSUPPORTED	493.000	-
	Geometric Mean	493.000	-

UNRESOLVED

	Name	Current	%
	TOTAL.UNRESOLVED	3.000	50.00%
	gdb.UNRESOLVED	3.000	50.00%
	Geometric Mean	3.000	50.00%

UNTESTED

	Name	Current	%
	TOTAL.UNTESTED	93.000	-
	gdb.UNTESTED	93.000	-
	Geometric Mean	93.000	-

ERROR

	Name	Current	%
	TOTAL.ERROR	3.000	-50.00%
	gdb.ERROR	3.000	-50.00%
	Geometric Mean	3.000	-50.00%

OTHER

	Name	Current	%
	TOTAL.OTHER	4.000	-
	gdb.OTHER	4.000	-
	Geometric Mean	4.000	-

good

	Name	Current	%
	TOTAL.good	105646.000	3.53%
	gdb.good	105646.000	3.53%
	Geometric Mean	105646.000	3.53%

bad

	Name	Current	%
	TOTAL.bad	1421.000	-3.07%
	gdb.bad	1421.000	-3.07%
	Geometric Mean	1421.000	-3.07%

fails

	Name	Current	%
	TOTAL.fails	1310.000	-3.39%
	Geometric Mean	1310.000	-3.39%

flaky

	Name	Current	%
	TOTAL.flaky	688.000	37.05%
	Geometric Mean	688.000	37.05%

all

	Name	Current	%
	TOTAL.all	107067.000	3.44%
	Geometric Mean	107067.000	3.44%