Machine Info

Fields

hardware	None
os	None

Parameters

Run Info

Fields

Name	Value

Parameters

Name	Value
git_binutils	https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=c2d091ff5c8b68d9682a070d7970ba6ebc4b5760 (+ 76 commits)
git_gcc	https://github.com/gcc-mirror/gcc/commit/e29af8de31ba4b73dcee82917c8cec60d53dfa82 (+ 48 commits)
git_gdb	https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=c2d091ff5c8b68d9682a070d7970ba6ebc4b5760 (+ 81 commits)
git_glibc	https://sourceware.org/git/?p=glibc.git;a=commit;h=97aa7b7346bb9f1807e450c889fccbd2a7d8ff49 (+ 14 commits)
git_linux	https://git.linaro.org/kernel-org/linux.git/commit/?id=d20f6b3d747c36889b7ce75ee369182af3decb6b (+ 168 commits)
test_url	https://ci.linaro.org/job/tcwg_gnu_native_check_gdb--master-aarch64-build/1063/

Report

Filter

master-aarch64 test results

Run	Order	Start Time	Duration
Current	1063 (5-changed-components)	2024-06-08T22:56:53	0:00:00
Previous	0849 (5-changed-components)	2024-01-01T17:23:18	0:00:00
Baseline	0037 (5-changed-components)	2023-03-20T09:33:23	0:00:00

Tests Summary

Status Group	#	# (B)
Performance Regressions	10	6
Performance Improvements	13	18
Added Tests	2	2
Unchanged Tests	380	379
Total Tests	405

Run-Over-Run Changes Detail

Performance Regressions - FAIL	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.FAIL	102.33%	43.000	87.000	-	-87.45%	-
gdb.FAIL	102.33%	43.000	87.000	-	-87.45%	-

Performance Regressions - KFAIL	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.KFAIL	4.13%	121.000	126.000	-	17.76%	-
gdb.KFAIL	4.13%	121.000	126.000	-	17.76%	-

Performance Regressions - XFAIL	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.XFAIL	22.08%	77.000	94.000	-	25.33%	-
gdb.XFAIL	22.08%	77.000	94.000	-	25.33%	-

Performance Regressions - bad	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.bad	46.07%	89.000	130.000	-	-88.30%	-
gdb.bad	46.07%	89.000	130.000	-	-88.30%	-

Performance Regressions - fails	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.fails	88.37%	43.000	81.000	-	-79.55%	-

Performance Regressions - flaky	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.flaky	542.11%	57.000	366.000	-	0.00%	-

Performance Improvements - ERROR	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.ERROR	-14.29%	7.000	6.000	-	-45.45%	-
gdb.ERROR	-14.29%	7.000	6.000	-	-45.45%	-

Performance Improvements - OTHER	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.OTHER	-20.00%	5.000	4.000	-	-98.83%	-
gdb.OTHER	-20.00%	5.000	4.000	-	-98.83%	-

Performance Improvements - PASS	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.PASS	2.10%	115715.000	118141.000	-	7.24%	-
gdb.PASS	2.10%	115715.000	118141.000	-	7.24%	-

Performance Improvements - UNSUPPORTED	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.UNSUPPORTED	-2.44%	491.000	479.000	-	9.61%	-
gdb.UNSUPPORTED	-2.44%	491.000	479.000	-	9.61%	-

Performance Improvements - UNTESTED	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.UNTESTED	-8.82%	34.000	31.000	-	-41.51%	-
gdb.UNTESTED	-8.82%	34.000	31.000	-	-41.51%	-

Performance Improvements - all	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.all	2.13%	116493.000	118970.000	-	6.32%	-

Performance Improvements - good	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.good	2.09%	116404.000	118840.000	-	7.27%	-
gdb.good	2.09%	116404.000	118840.000	-	7.27%	-

Added Tests - XPASS
TOTAL.XPASS
gdb.XPASS

Run-Over-Baseline Changes Detail

Performance Regressions - KFAIL	Δ (B)	Baseline	Current	σ (B)	Δ	σ
TOTAL.KFAIL	17.76%	107.000	126.000	-	4.13%	-
gdb.KFAIL	17.76%	107.000	126.000	-	4.13%	-

Performance Regressions - UNSUPPORTED	Δ (B)	Baseline	Current	σ (B)	Δ	σ
TOTAL.UNSUPPORTED	9.61%	437.000	479.000	-	-2.44%	-
gdb.UNSUPPORTED	9.61%	437.000	479.000	-	-2.44%	-

Performance Regressions - XFAIL	Δ (B)	Baseline	Current	σ (B)	Δ	σ
TOTAL.XFAIL	25.33%	75.000	94.000	-	22.08%	-
gdb.XFAIL	25.33%	75.000	94.000	-	22.08%	-

Performance Improvements - ERROR	Δ (B)	Baseline	Current	σ (B)	Δ	σ
TOTAL.ERROR	-45.45%	11.000	6.000	-	-14.29%	-
gdb.ERROR	-45.45%	11.000	6.000	-	-14.29%	-

Performance Improvements - FAIL	Δ (B)	Baseline	Current	σ (B)	Δ	σ
TOTAL.FAIL	-87.45%	693.000	87.000	-	102.33%	-
gdb.FAIL	-87.45%	693.000	87.000	-	102.33%	-

Performance Improvements - OTHER	Δ (B)	Baseline	Current	σ (B)	Δ	σ
TOTAL.OTHER	-98.83%	341.000	4.000	-	-20.00%	-
gdb.OTHER	-98.83%	341.000	4.000	-	-20.00%	-

Performance Improvements - PASS	Δ (B)	Baseline	Current	σ (B)	Δ	σ
TOTAL.PASS	7.24%	110169.000	118141.000	-	2.10%	-
gdb.PASS	7.24%	110169.000	118141.000	-	2.10%	-

Performance Improvements - UNRESOLVED	Δ (B)	Baseline	Current	σ (B)	Δ	σ
TOTAL.UNRESOLVED	-84.62%	13.000	2.000	-	0.00%	-
gdb.UNRESOLVED	-84.62%	13.000	2.000	-	0.00%	-

Performance Improvements - UNTESTED	Δ (B)	Baseline	Current	σ (B)	Δ	σ
TOTAL.UNTESTED	-41.51%	53.000	31.000	-	-8.82%	-
gdb.UNTESTED	-41.51%	53.000	31.000	-	-8.82%	-

Performance Improvements - all	Δ (B)	Baseline	Current	σ (B)	Δ	σ
TOTAL.all	6.32%	111899.000	118970.000	-	2.13%	-

Performance Improvements - bad	Δ (B)	Baseline	Current	σ (B)	Δ	σ
TOTAL.bad	-88.30%	1111.000	130.000	-	46.07%	-
gdb.bad	-88.30%	1111.000	130.000	-	46.07%	-

Performance Improvements - fails	Δ (B)	Baseline	Current	σ (B)	Δ	σ
TOTAL.fails	-79.55%	396.000	81.000	-	88.37%	-

Performance Improvements - good	Δ (B)	Baseline	Current	σ (B)	Δ	σ
TOTAL.good	7.27%	110788.000	118840.000	-	2.09%	-
gdb.good	7.27%	110788.000	118840.000	-	2.09%	-

Added Tests - XPASS
TOTAL.XPASS
gdb.XPASS

Report Time: 0.18s

PASS

	Name	Current	%
	TOTAL.PASS	118141.000	2.10%
	gdb.PASS	118141.000	2.10%
	Geometric Mean	118141.000	2.10%

XPASS

	Name	Current	%
	TOTAL.XPASS	0.000	-
	gdb.XPASS	0.000	-
	Geometric Mean	0.000	-

FAIL

	Name	Current	%
	TOTAL.FAIL	87.000	102.33%
	gdb.FAIL	87.000	102.33%
	Geometric Mean	87.000	102.33%

XFAIL

	Name	Current	%
	TOTAL.XFAIL	94.000	22.08%
	gdb.XFAIL	94.000	22.08%
	Geometric Mean	94.000	22.08%

KFAIL

	Name	Current	%
	TOTAL.KFAIL	126.000	4.13%
	gdb.KFAIL	126.000	4.13%
	Geometric Mean	126.000	4.13%

UNSUPPORTED

	Name	Current	%
	TOTAL.UNSUPPORTED	479.000	-2.44%
	gdb.UNSUPPORTED	479.000	-2.44%
	Geometric Mean	479.000	-2.44%

UNRESOLVED

	Name	Current	%
	TOTAL.UNRESOLVED	2.000	-
	gdb.UNRESOLVED	2.000	-
	Geometric Mean	2.000	-

UNTESTED

	Name	Current	%
	TOTAL.UNTESTED	31.000	-8.82%
	gdb.UNTESTED	31.000	-8.82%
	Geometric Mean	31.000	-8.82%

ERROR

	Name	Current	%
	TOTAL.ERROR	6.000	-14.29%
	gdb.ERROR	6.000	-14.29%
	Geometric Mean	6.000	-14.29%

OTHER

	Name	Current	%
	TOTAL.OTHER	4.000	-20.00%
	gdb.OTHER	4.000	-20.00%
	Geometric Mean	4.000	-20.00%

good

	Name	Current	%
	TOTAL.good	118840.000	2.09%
	gdb.good	118840.000	2.09%
	Geometric Mean	118840.000	2.09%

bad

	Name	Current	%
	TOTAL.bad	130.000	46.07%
	gdb.bad	130.000	46.07%
	Geometric Mean	130.000	46.07%

fails

	Name	Current	%
	TOTAL.fails	81.000	88.37%
	Geometric Mean	81.000	88.37%

flaky

	Name	Current	%
	TOTAL.flaky	366.000	542.11%
	Geometric Mean	366.000	542.11%

all

	Name	Current	%
	TOTAL.all	118970.000	2.13%
	Geometric Mean	118970.000	2.13%