Machine Info

Fields

hardware	None
os	None

Parameters

Run Info

Fields

Name	Value

Parameters

Name	Value
git_binutils	https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=9f26b04c3e95c84f3f44555b9db61c25a3741360 (+ 376 commits)
git_gcc	https://github.com/gcc-mirror/gcc/commit/e0d997e913f811ecf4b3e10891e6a4aab5b38a31 (+ 1011 commits)
git_gdb	https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=6d45af96ea53daffea125ffb9ef5f070a159c674 (+ 319 commits)
git_glibc	https://sourceware.org/git/?p=glibc.git;a=commit;h=ab5748118f86a82c4a29a7476f6cc0b9c40be926 (+ 112 commits)
git_linux	https://gitlab.com/Linaro/lkft/mirrors/torvalds/linux-mainline/commit/3c3ff7be9729959699eb6cbc7fd7303566d74069 (+ 12082 commits)
test_url	https://ci.linaro.org/job/tcwg_gnu_native_check_gdb--master-aarch64-build/1104/

Report

Filter

master-aarch64 test results

Run	Order	Start Time	Duration
Current	1104 (5-changed-components)	2024-06-29T17:51:38	0:00:00
Previous	0970 (5-changed-components)	2024-04-05T06:17:33	0:00:00
Baseline	0037 (5-changed-components)	2023-03-20T09:33:23	0:00:00

Tests Summary

Status Group	#	# (B)
Performance Regressions	15	6
Performance Improvements	6	18
Added Tests	2	2
Unchanged Tests	382	379
Total Tests	405

Run-Over-Run Changes Detail

Performance Regressions - ERROR	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.ERROR	14.29%	7.000	8.000	-	-27.27%	-
gdb.ERROR	14.29%	7.000	8.000	-	-27.27%	-

Performance Regressions - FAIL	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.FAIL	2.88%	104.000	107.000	-	-84.56%	-
gdb.FAIL	2.88%	104.000	107.000	-	-84.56%	-

Performance Regressions - KFAIL	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.KFAIL	4.10%	122.000	127.000	-	18.69%	-
gdb.KFAIL	4.10%	122.000	127.000	-	18.69%	-

Performance Regressions - UNRESOLVED	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.UNRESOLVED	66.67%	3.000	5.000	-	-61.54%	-
gdb.UNRESOLVED	66.67%	3.000	5.000	-	-61.54%	-

Performance Regressions - UNSUPPORTED	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.UNSUPPORTED	1.27%	474.000	480.000	-	9.84%	-
gdb.UNSUPPORTED	1.27%	474.000	480.000	-	9.84%	-

Performance Regressions - XFAIL	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.XFAIL	15.19%	79.000	91.000	-	21.33%	-
gdb.XFAIL	15.19%	79.000	91.000	-	21.33%	-

Performance Regressions - bad	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.bad	4.00%	150.000	156.000	-	-85.96%	-
gdb.bad	4.00%	150.000	156.000	-	-85.96%	-

Performance Regressions - flaky	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.flaky	225.58%	86.000	280.000	-	0.00%	-

Performance Improvements - PASS	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.PASS	1.28%	116789.000	118286.000	-	7.37%	-
gdb.PASS	1.28%	116789.000	118286.000	-	7.37%	-

Performance Improvements - all	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.all	1.30%	117614.000	119140.000	-	6.47%	-

Performance Improvements - fails	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.fails	-24.56%	114.000	86.000	-	-78.28%	-

Performance Improvements - good	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.good	1.29%	117464.000	118984.000	-	7.40%	-
gdb.good	1.29%	117464.000	118984.000	-	7.40%	-

Added Tests - XPASS
TOTAL.XPASS
gdb.XPASS

Run-Over-Baseline Changes Detail

Performance Regressions - KFAIL	Δ (B)	Baseline	Current	σ (B)	Δ	σ
TOTAL.KFAIL	18.69%	107.000	127.000	-	4.10%	-
gdb.KFAIL	18.69%	107.000	127.000	-	4.10%	-

Performance Regressions - UNSUPPORTED	Δ (B)	Baseline	Current	σ (B)	Δ	σ
TOTAL.UNSUPPORTED	9.84%	437.000	480.000	-	1.27%	-
gdb.UNSUPPORTED	9.84%	437.000	480.000	-	1.27%	-

Performance Regressions - XFAIL	Δ (B)	Baseline	Current	σ (B)	Δ	σ
TOTAL.XFAIL	21.33%	75.000	91.000	-	15.19%	-
gdb.XFAIL	21.33%	75.000	91.000	-	15.19%	-

Performance Improvements - ERROR	Δ (B)	Baseline	Current	σ (B)	Δ	σ
TOTAL.ERROR	-27.27%	11.000	8.000	-	14.29%	-
gdb.ERROR	-27.27%	11.000	8.000	-	14.29%	-

Performance Improvements - FAIL	Δ (B)	Baseline	Current	σ (B)	Δ	σ
TOTAL.FAIL	-84.56%	693.000	107.000	-	2.88%	-
gdb.FAIL	-84.56%	693.000	107.000	-	2.88%	-

Performance Improvements - OTHER	Δ (B)	Baseline	Current	σ (B)	Δ	σ
TOTAL.OTHER	-98.53%	341.000	5.000	-	0.00%	-
gdb.OTHER	-98.53%	341.000	5.000	-	0.00%	-

Performance Improvements - PASS	Δ (B)	Baseline	Current	σ (B)	Δ	σ
TOTAL.PASS	7.37%	110169.000	118286.000	-	1.28%	-
gdb.PASS	7.37%	110169.000	118286.000	-	1.28%	-

Performance Improvements - UNRESOLVED	Δ (B)	Baseline	Current	σ (B)	Δ	σ
TOTAL.UNRESOLVED	-61.54%	13.000	5.000	-	66.67%	-
gdb.UNRESOLVED	-61.54%	13.000	5.000	-	66.67%	-

Performance Improvements - UNTESTED	Δ (B)	Baseline	Current	σ (B)	Δ	σ
TOTAL.UNTESTED	-41.51%	53.000	31.000	-	0.00%	-
gdb.UNTESTED	-41.51%	53.000	31.000	-	0.00%	-

Performance Improvements - all	Δ (B)	Baseline	Current	σ (B)	Δ	σ
TOTAL.all	6.47%	111899.000	119140.000	-	1.30%	-

Performance Improvements - bad	Δ (B)	Baseline	Current	σ (B)	Δ	σ
TOTAL.bad	-85.96%	1111.000	156.000	-	4.00%	-
gdb.bad	-85.96%	1111.000	156.000	-	4.00%	-

Performance Improvements - fails	Δ (B)	Baseline	Current	σ (B)	Δ	σ
TOTAL.fails	-78.28%	396.000	86.000	-	-24.56%	-

Performance Improvements - good	Δ (B)	Baseline	Current	σ (B)	Δ	σ
TOTAL.good	7.40%	110788.000	118984.000	-	1.29%	-
gdb.good	7.40%	110788.000	118984.000	-	1.29%	-

Added Tests - XPASS
TOTAL.XPASS
gdb.XPASS

Report Time: 0.18s

PASS

	Name	Current	%
	TOTAL.PASS	118286.000	1.28%
	gdb.PASS	118286.000	1.28%
	Geometric Mean	118286.000	1.28%

XPASS

	Name	Current	%
	TOTAL.XPASS	0.000	-
	gdb.XPASS	0.000	-
	Geometric Mean	0.000	-

FAIL

	Name	Current	%
	TOTAL.FAIL	107.000	2.88%
	gdb.FAIL	107.000	2.88%
	Geometric Mean	107.000	2.88%

XFAIL

	Name	Current	%
	TOTAL.XFAIL	91.000	15.19%
	gdb.XFAIL	91.000	15.19%
	Geometric Mean	91.000	15.19%

KFAIL

	Name	Current	%
	TOTAL.KFAIL	127.000	4.10%
	gdb.KFAIL	127.000	4.10%
	Geometric Mean	127.000	4.10%

UNSUPPORTED

	Name	Current	%
	TOTAL.UNSUPPORTED	480.000	1.27%
	gdb.UNSUPPORTED	480.000	1.27%
	Geometric Mean	480.000	1.27%

UNRESOLVED

	Name	Current	%
	TOTAL.UNRESOLVED	5.000	66.67%
	gdb.UNRESOLVED	5.000	66.67%
	Geometric Mean	5.000	66.67%

UNTESTED

	Name	Current	%
	TOTAL.UNTESTED	31.000	-
	gdb.UNTESTED	31.000	-
	Geometric Mean	31.000	-

ERROR

	Name	Current	%
	TOTAL.ERROR	8.000	14.29%
	gdb.ERROR	8.000	14.29%
	Geometric Mean	8.000	14.29%

OTHER

	Name	Current	%
	TOTAL.OTHER	5.000	-
	gdb.OTHER	5.000	-
	Geometric Mean	5.000	-

good

	Name	Current	%
	TOTAL.good	118984.000	1.29%
	gdb.good	118984.000	1.29%
	Geometric Mean	118984.000	1.29%

bad

	Name	Current	%
	TOTAL.bad	156.000	4.00%
	gdb.bad	156.000	4.00%
	Geometric Mean	156.000	4.00%

fails

	Name	Current	%
	TOTAL.fails	86.000	-24.56%
	Geometric Mean	86.000	-24.56%

flaky

	Name	Current	%
	TOTAL.flaky	280.000	225.58%
	Geometric Mean	280.000	225.58%

all

	Name	Current	%
	TOTAL.all	119140.000	1.30%
	Geometric Mean	119140.000	1.30%