Machine Info

Fields

hardware	None
os	None

Parameters

Run Info

Fields

Name	Value

Parameters

Name	Value
git_binutils	https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=c2d091ff5c8b68d9682a070d7970ba6ebc4b5760 (+ 76 commits)
git_gcc	https://github.com/gcc-mirror/gcc/commit/e29af8de31ba4b73dcee82917c8cec60d53dfa82 (+ 48 commits)
git_gdb	https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=c2d091ff5c8b68d9682a070d7970ba6ebc4b5760 (+ 81 commits)
git_glibc	https://sourceware.org/git/?p=glibc.git;a=commit;h=97aa7b7346bb9f1807e450c889fccbd2a7d8ff49 (+ 14 commits)
git_linux	https://git.linaro.org/kernel-org/linux.git/commit/?id=d20f6b3d747c36889b7ce75ee369182af3decb6b (+ 168 commits)
test_url	https://ci.linaro.org/job/tcwg_gnu_native_check_gdb--master-aarch64-build/1063/

Report

Filter

master-aarch64 test results

Run	Order	Start Time	Duration
Current	1063 (5-changed-components)	2024-06-08T22:56:53	0:00:00
Previous	1035 (5-changed-components)	2024-05-07T01:16:57	0:00:00
Baseline	0037 (5-changed-components)	2023-03-20T09:33:23	0:00:00

Tests Summary

Status Group	#	# (B)
Performance Regressions	5	6
Performance Improvements	12	18
Added Tests	2	2
Unchanged Tests	386	379
Total Tests	405

Run-Over-Run Changes Detail

Performance Regressions - FAIL	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.FAIL	3.57%	84.000	87.000	-	-87.45%	-
gdb.FAIL	3.57%	84.000	87.000	-	-87.45%	-

Performance Regressions - XFAIL	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.XFAIL	20.51%	78.000	94.000	-	25.33%	-
gdb.XFAIL	20.51%	78.000	94.000	-	25.33%	-

Performance Regressions - flaky	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.flaky	215.52%	116.000	366.000	-	0.00%	-

Performance Improvements - ERROR	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.ERROR	-25.00%	8.000	6.000	-	-45.45%	-
gdb.ERROR	-25.00%	8.000	6.000	-	-45.45%	-

Performance Improvements - OTHER	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.OTHER	-20.00%	5.000	4.000	-	-98.83%	-
gdb.OTHER	-20.00%	5.000	4.000	-	-98.83%	-

Performance Improvements - PASS	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.PASS	1.04%	116923.000	118141.000	-	7.24%	-
gdb.PASS	1.04%	116923.000	118141.000	-	7.24%	-

Performance Improvements - UNTESTED	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.UNTESTED	-3.12%	32.000	31.000	-	-41.51%	-
gdb.UNTESTED	-3.12%	32.000	31.000	-	-41.51%	-

Performance Improvements - all	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.all	1.05%	117732.000	118970.000	-	6.32%	-

Performance Improvements - fails	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.fails	-10.00%	90.000	81.000	-	-79.55%	-

Performance Improvements - good	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.good	1.05%	117601.000	118840.000	-	7.27%	-
gdb.good	1.05%	117601.000	118840.000	-	7.27%	-

Added Tests - XPASS
TOTAL.XPASS
gdb.XPASS

Run-Over-Baseline Changes Detail

Performance Regressions - KFAIL	Δ (B)	Baseline	Current	σ (B)	Δ	σ
TOTAL.KFAIL	17.76%	107.000	126.000	-	0.80%	-
gdb.KFAIL	17.76%	107.000	126.000	-	0.80%	-

Performance Regressions - UNSUPPORTED	Δ (B)	Baseline	Current	σ (B)	Δ	σ
TOTAL.UNSUPPORTED	9.61%	437.000	479.000	-	0.84%	-
gdb.UNSUPPORTED	9.61%	437.000	479.000	-	0.84%	-

Performance Regressions - XFAIL	Δ (B)	Baseline	Current	σ (B)	Δ	σ
TOTAL.XFAIL	25.33%	75.000	94.000	-	20.51%	-
gdb.XFAIL	25.33%	75.000	94.000	-	20.51%	-

Performance Improvements - ERROR	Δ (B)	Baseline	Current	σ (B)	Δ	σ
TOTAL.ERROR	-45.45%	11.000	6.000	-	-25.00%	-
gdb.ERROR	-45.45%	11.000	6.000	-	-25.00%	-

Performance Improvements - FAIL	Δ (B)	Baseline	Current	σ (B)	Δ	σ
TOTAL.FAIL	-87.45%	693.000	87.000	-	3.57%	-
gdb.FAIL	-87.45%	693.000	87.000	-	3.57%	-

Performance Improvements - OTHER	Δ (B)	Baseline	Current	σ (B)	Δ	σ
TOTAL.OTHER	-98.83%	341.000	4.000	-	-20.00%	-
gdb.OTHER	-98.83%	341.000	4.000	-	-20.00%	-

Performance Improvements - PASS	Δ (B)	Baseline	Current	σ (B)	Δ	σ
TOTAL.PASS	7.24%	110169.000	118141.000	-	1.04%	-
gdb.PASS	7.24%	110169.000	118141.000	-	1.04%	-

Performance Improvements - UNRESOLVED	Δ (B)	Baseline	Current	σ (B)	Δ	σ
TOTAL.UNRESOLVED	-84.62%	13.000	2.000	-	0.00%	-
gdb.UNRESOLVED	-84.62%	13.000	2.000	-	0.00%	-

Performance Improvements - UNTESTED	Δ (B)	Baseline	Current	σ (B)	Δ	σ
TOTAL.UNTESTED	-41.51%	53.000	31.000	-	-3.12%	-
gdb.UNTESTED	-41.51%	53.000	31.000	-	-3.12%	-

Performance Improvements - all	Δ (B)	Baseline	Current	σ (B)	Δ	σ
TOTAL.all	6.32%	111899.000	118970.000	-	1.05%	-

Performance Improvements - bad	Δ (B)	Baseline	Current	σ (B)	Δ	σ
TOTAL.bad	-88.30%	1111.000	130.000	-	-0.76%	-
gdb.bad	-88.30%	1111.000	130.000	-	-0.76%	-

Performance Improvements - fails	Δ (B)	Baseline	Current	σ (B)	Δ	σ
TOTAL.fails	-79.55%	396.000	81.000	-	-10.00%	-

Performance Improvements - good	Δ (B)	Baseline	Current	σ (B)	Δ	σ
TOTAL.good	7.27%	110788.000	118840.000	-	1.05%	-
gdb.good	7.27%	110788.000	118840.000	-	1.05%	-

Added Tests - XPASS
TOTAL.XPASS
gdb.XPASS

Report Time: 0.18s

PASS

	Name	Current	%
	TOTAL.PASS	118141.000	1.04%
	gdb.PASS	118141.000	1.04%
	Geometric Mean	118141.000	1.04%

XPASS

	Name	Current	%
	TOTAL.XPASS	0.000	-
	gdb.XPASS	0.000	-
	Geometric Mean	0.000	-

FAIL

	Name	Current	%
	TOTAL.FAIL	87.000	3.57%
	gdb.FAIL	87.000	3.57%
	Geometric Mean	87.000	3.57%

XFAIL

	Name	Current	%
	TOTAL.XFAIL	94.000	20.51%
	gdb.XFAIL	94.000	20.51%
	Geometric Mean	94.000	20.51%

KFAIL

	Name	Current	%
	TOTAL.KFAIL	126.000	-
	gdb.KFAIL	126.000	-
	Geometric Mean	126.000	-

UNSUPPORTED

	Name	Current	%
	TOTAL.UNSUPPORTED	479.000	-
	gdb.UNSUPPORTED	479.000	-
	Geometric Mean	479.000	-

UNRESOLVED

	Name	Current	%
	TOTAL.UNRESOLVED	2.000	-
	gdb.UNRESOLVED	2.000	-
	Geometric Mean	2.000	-

UNTESTED

	Name	Current	%
	TOTAL.UNTESTED	31.000	-3.12%
	gdb.UNTESTED	31.000	-3.12%
	Geometric Mean	31.000	-3.13%

ERROR

	Name	Current	%
	TOTAL.ERROR	6.000	-25.00%
	gdb.ERROR	6.000	-25.00%
	Geometric Mean	6.000	-25.00%

OTHER

	Name	Current	%
	TOTAL.OTHER	4.000	-20.00%
	gdb.OTHER	4.000	-20.00%
	Geometric Mean	4.000	-20.00%

good

	Name	Current	%
	TOTAL.good	118840.000	1.05%
	gdb.good	118840.000	1.05%
	Geometric Mean	118840.000	1.05%

bad

	Name	Current	%
	TOTAL.bad	130.000	-
	gdb.bad	130.000	-
	Geometric Mean	130.000	-

fails

	Name	Current	%
	TOTAL.fails	81.000	-10.00%
	Geometric Mean	81.000	-10.00%

flaky

	Name	Current	%
	TOTAL.flaky	366.000	215.52%
	Geometric Mean	366.000	215.52%

all

	Name	Current	%
	TOTAL.all	118970.000	1.05%
	Geometric Mean	118970.000	1.05%