Machine Info

Fields

hardware	None
os	None

Parameters

Run Info

Fields

Name	Value

Parameters

Name	Value
git_binutils	https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=646d754d14c2fe70a492a893506a74b0463b6ae8 (+ 25 commits)
git_gcc	https://github.com/gcc-mirror/gcc/commit/1438b15e5430f7fab3832c35d262d6b58caba469 (+ 136 commits)
git_gdb	https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=56c82e7029464dbd8b2b7237bf3176f3199f9e71 (+ 14 commits)
git_glibc	https://sourceware.org/git/?p=glibc.git;a=commit;h=97aa7b7346bb9f1807e450c889fccbd2a7d8ff49 (+ 2 commits)
git_linux	https://git.linaro.org/kernel-org/linux.git/commit/?id=d20f6b3d747c36889b7ce75ee369182af3decb6b (+ 55 commits)
test_url	https://ci.linaro.org/job/tcwg_gnu_native_check_gdb--master-arm-build/1302/

Report

Filter

master-arm test results

Run	Order	Start Time	Duration
Current	1302 (5-changed-components)	2024-06-13T02:45:02	0:00:00
Previous	1284 (gdb-15-branchpoint-00116-g9102a6c15c7)	2024-06-08T07:49:23	0:00:00
Baseline	1080 (5-changed-components)	2024-01-29T02:35:05	0:00:00

Tests Summary

Status Group	#	# (B)
Performance Regressions	3	4
Performance Improvements	18	20
Unchanged Tests	384	381
Total Tests	405

Run-Over-Run Changes Detail

Performance Regressions - ERROR	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.ERROR	50.00%	8.000	12.000	-	-97.17%	-
gdb.ERROR	50.00%	8.000	12.000	-	-97.17%	-

Performance Regressions - flaky	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.flaky	28.99%	676.000	872.000	-	0.00%	-

Performance Improvements - FAIL	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.FAIL	-4.07%	1377.000	1321.000	-	-5.71%	-
gdb.FAIL	-4.07%	1377.000	1321.000	-	-5.71%	-

Performance Improvements - KFAIL	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.KFAIL	-2.42%	124.000	121.000	-	9.01%	-
gdb.KFAIL	-2.42%	124.000	121.000	-	9.01%	-

Performance Improvements - OTHER	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.OTHER	-85.00%	40.000	6.000	-	-45.45%	-
gdb.OTHER	-85.00%	40.000	6.000	-	-45.45%	-

Performance Improvements - PASS	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.PASS	4.16%	100893.000	105094.000	-	5.49%	-
gdb.PASS	4.16%	100893.000	105094.000	-	5.49%	-

Performance Improvements - UNRESOLVED	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.UNRESOLVED	-25.00%	4.000	3.000	-	-97.60%	-
gdb.UNRESOLVED	-25.00%	4.000	3.000	-	-97.60%	-

Performance Improvements - XFAIL	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.XFAIL	-3.33%	240.000	232.000	-	5.45%	-
gdb.XFAIL	-3.33%	240.000	232.000	-	5.45%	-

Performance Improvements - all	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.all	3.97%	103272.000	107376.000	-	4.74%	-

Performance Improvements - bad	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.bad	-5.71%	1523.000	1436.000	-	-30.22%	-
gdb.bad	-5.71%	1523.000	1436.000	-	-30.22%	-

Performance Improvements - fails	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.fails	-4.43%	1377.000	1316.000	-	-19.21%	-

Performance Improvements - good	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.good	4.12%	101749.000	105940.000	-	5.45%	-
gdb.good	4.12%	101749.000	105940.000	-	5.45%	-

Run-Over-Baseline Changes Detail

Performance Regressions - KFAIL	Δ (B)	Baseline	Current	σ (B)	Δ	σ
TOTAL.KFAIL	9.01%	111.000	121.000	-	-2.42%	-
gdb.KFAIL	9.01%	111.000	121.000	-	-2.42%	-

Performance Regressions - XFAIL	Δ (B)	Baseline	Current	σ (B)	Δ	σ
TOTAL.XFAIL	5.45%	220.000	232.000	-	-3.33%	-
gdb.XFAIL	5.45%	220.000	232.000	-	-3.33%	-

Performance Improvements - ERROR	Δ (B)	Baseline	Current	σ (B)	Δ	σ
TOTAL.ERROR	-97.17%	424.000	12.000	-	50.00%	-
gdb.ERROR	-97.17%	424.000	12.000	-	50.00%	-

Performance Improvements - FAIL	Δ (B)	Baseline	Current	σ (B)	Δ	σ
TOTAL.FAIL	-5.71%	1401.000	1321.000	-	-4.07%	-
gdb.FAIL	-5.71%	1401.000	1321.000	-	-4.07%	-

Performance Improvements - OTHER	Δ (B)	Baseline	Current	σ (B)	Δ	σ
TOTAL.OTHER	-45.45%	11.000	6.000	-	-85.00%	-
gdb.OTHER	-45.45%	11.000	6.000	-	-85.00%	-

Performance Improvements - PASS	Δ (B)	Baseline	Current	σ (B)	Δ	σ
TOTAL.PASS	5.49%	99624.000	105094.000	-	4.16%	-
gdb.PASS	5.49%	99624.000	105094.000	-	4.16%	-

Performance Improvements - UNRESOLVED	Δ (B)	Baseline	Current	σ (B)	Δ	σ
TOTAL.UNRESOLVED	-97.60%	125.000	3.000	-	-25.00%	-
gdb.UNRESOLVED	-97.60%	125.000	3.000	-	-25.00%	-

Performance Improvements - UNSUPPORTED	Δ (B)	Baseline	Current	σ (B)	Δ	σ
TOTAL.UNSUPPORTED	-2.57%	506.000	493.000	-	0.20%	-
gdb.UNSUPPORTED	-2.57%	506.000	493.000	-	0.20%	-

Performance Improvements - UNTESTED	Δ (B)	Baseline	Current	σ (B)	Δ	σ
TOTAL.UNTESTED	-3.12%	96.000	93.000	-	0.00%	-
gdb.UNTESTED	-3.12%	96.000	93.000	-	0.00%	-

Performance Improvements - all	Δ (B)	Baseline	Current	σ (B)	Δ	σ
TOTAL.all	4.74%	102519.000	107376.000	-	3.97%	-

Performance Improvements - bad	Δ (B)	Baseline	Current	σ (B)	Δ	σ
TOTAL.bad	-30.22%	2058.000	1436.000	-	-5.71%	-
gdb.bad	-30.22%	2058.000	1436.000	-	-5.71%	-

Performance Improvements - fails	Δ (B)	Baseline	Current	σ (B)	Δ	σ
TOTAL.fails	-19.21%	1629.000	1316.000	-	-4.43%	-

Performance Improvements - good	Δ (B)	Baseline	Current	σ (B)	Δ	σ
TOTAL.good	5.45%	100461.000	105940.000	-	4.12%	-
gdb.good	5.45%	100461.000	105940.000	-	4.12%	-

Report Time: 0.19s

PASS

	Name	Current	%
	TOTAL.PASS	105094.000	4.16%
	gdb.PASS	105094.000	4.16%
	Geometric Mean	105094.000	4.16%

XPASS

	Name	Current	%
	TOTAL.XPASS	1.000	-
	gdb.XPASS	1.000	-
	Geometric Mean	1.000	-

FAIL

	Name	Current	%
	TOTAL.FAIL	1321.000	-4.07%
	gdb.FAIL	1321.000	-4.07%
	Geometric Mean	1321.000	-4.07%

XFAIL

	Name	Current	%
	TOTAL.XFAIL	232.000	-3.33%
	gdb.XFAIL	232.000	-3.33%
	Geometric Mean	232.000	-3.33%

KFAIL

	Name	Current	%
	TOTAL.KFAIL	121.000	-2.42%
	gdb.KFAIL	121.000	-2.42%
	Geometric Mean	121.000	-2.42%

UNSUPPORTED

	Name	Current	%
	TOTAL.UNSUPPORTED	493.000	-
	gdb.UNSUPPORTED	493.000	-
	Geometric Mean	493.000	-

UNRESOLVED

	Name	Current	%
	TOTAL.UNRESOLVED	3.000	-25.00%
	gdb.UNRESOLVED	3.000	-25.00%
	Geometric Mean	3.000	-25.00%

UNTESTED

	Name	Current	%
	TOTAL.UNTESTED	93.000	-
	gdb.UNTESTED	93.000	-
	Geometric Mean	93.000	-

ERROR

	Name	Current	%
	TOTAL.ERROR	12.000	50.00%
	gdb.ERROR	12.000	50.00%
	Geometric Mean	12.000	50.00%

OTHER

	Name	Current	%
	TOTAL.OTHER	6.000	-85.00%
	gdb.OTHER	6.000	-85.00%
	Geometric Mean	6.000	-85.00%

good

	Name	Current	%
	TOTAL.good	105940.000	4.12%
	gdb.good	105940.000	4.12%
	Geometric Mean	105940.000	4.12%

bad

	Name	Current	%
	TOTAL.bad	1436.000	-5.71%
	gdb.bad	1436.000	-5.71%
	Geometric Mean	1436.000	-5.71%

fails

	Name	Current	%
	TOTAL.fails	1316.000	-4.43%
	Geometric Mean	1316.000	-4.43%

flaky

	Name	Current	%
	TOTAL.flaky	872.000	28.99%
	Geometric Mean	872.000	28.99%

all

	Name	Current	%
	TOTAL.all	107376.000	3.97%
	Geometric Mean	107376.000	3.97%