Baseline and compare_to are the same: disabling baseline. ×

Machine Info

Fields

hardware	None
os	None

Parameters

Run Info

Fields

Name	Value

Parameters

Name	Value
git_binutils	https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=7418ba8ab2706f697003448a3877be4b50c874d0 (+ 104 commits)
git_gcc	https://github.com/gcc-mirror/gcc/commit/eed9eeaab30fd7b9e509ec3cf78f5f3c881b0abf (+ 243 commits)
git_gdb	https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=7418ba8ab2706f697003448a3877be4b50c874d0 (+ 105 commits)
git_newlib	https://sourceware.org/git/?p=newlib-cygwin.git;a=commit;h=bfb16b0edef49b8e694bcb1b419bfcb5a0a3dfac (+ 2 commits)
git_qemu	https://gitlab.com/qemu-project/qemu/commit/d145c0da22cde391d8c6672d33146ce306e8bf75 (+ 323 commits)
test_url	https://ci.linaro.org/job/tcwg_gnu_embed_check_binutils--master-arm_eabi-build/73/

Report

Filter

master-arm_eabi test results

Run	Order	Start Time	Duration
Current	0073 (5-changed-components)	2023-06-24T08:47:00	0:00:00
Previous	0011 (5-changed-components)	2023-06-05T16:56:22	0:00:00
No Baseline Run

Tests Summary

Status Group	#
Performance Regressions	7
Performance Improvements	6
Added Tests	27
Unchanged Tests	725
Total Tests	765

Run-Over-Run Changes Detail

Performance Regressions - PASS	Δ	Previous	Current	σ
ld.PASS	-35.15%	1303.000	845.000	-
TOTAL.PASS	-16.13%	2834.000	2377.000	-

Performance Regressions - all	Δ	Previous	Current	σ
TOTAL.all	-18.41%	3280.000	2676.000	-

Performance Regressions - bad	Δ	Previous	Current	σ
ld.bad	11.11%	18.000	20.000	-
TOTAL.bad	10.53%	19.000	21.000	-

Performance Regressions - good	Δ	Previous	Current	σ
ld.good	-35.48%	1711.000	1104.000	-
TOTAL.good	-18.58%	3261.000	2655.000	-

Performance Improvements - FAIL	Δ	Previous	Current	σ
TOTAL.FAIL	-94.74%	19.000	1.000	-

Performance Improvements - UNSUPPORTED	Δ	Previous	Current	σ
ld.UNSUPPORTED	-37.37%	396.000	248.000	-
TOTAL.UNSUPPORTED	-35.75%	414.000	266.000	-

Performance Improvements - XFAIL	Δ	Previous	Current	σ
ld.XFAIL	-8.33%	12.000	11.000	-
TOTAL.XFAIL	-7.69%	13.000	12.000	-

Performance Improvements - fails	Δ	Previous	Current	σ
TOTAL.fails	-94.74%	19.000	1.000	-

Added Tests - ERROR
TOTAL.ERROR
binutils.ERROR
gas.ERROR
ld.ERROR

Added Tests - FAIL
gas.FAIL
ld.FAIL

Added Tests - KFAIL
TOTAL.KFAIL
binutils.KFAIL
gas.KFAIL
ld.KFAIL

Added Tests - OTHER
TOTAL.OTHER
binutils.OTHER
gas.OTHER
ld.OTHER

Added Tests - UNRESOLVED
TOTAL.UNRESOLVED
binutils.UNRESOLVED
gas.UNRESOLVED
ld.UNRESOLVED

Added Tests - UNTESTED
binutils.UNTESTED
gas.UNTESTED

Added Tests - XFAIL
gas.XFAIL

Added Tests - XPASS
TOTAL.XPASS
binutils.XPASS
gas.XPASS
ld.XPASS

Added Tests - bad
gas.bad

Added Tests - flaky
TOTAL.flaky

Run-Over-Baseline Changes Detail

Report Time: 0.19s

PASS

	Name	Current	%
	TOTAL.PASS	2377.000	-16.13%
	binutils.PASS	253.000	-
	gas.PASS	1279.000	-
	ld.PASS	845.000	-35.15%
	Geometric Mean	897.882	-14.04%

XPASS

	Name	Current	%
	TOTAL.XPASS	0.000	-
	binutils.XPASS	0.000	-
	gas.XPASS	0.000	-
	ld.XPASS	0.000	-
	Geometric Mean	0.000	-

FAIL

	Name	Current	%
	TOTAL.FAIL	1.000	-94.74%
	binutils.FAIL	1.000	-
	gas.FAIL	0.000	-
	ld.FAIL	0.000	-
	Geometric Mean	0.010	-99.77%

XFAIL

	Name	Current	%
	TOTAL.XFAIL	12.000	-7.69%
	binutils.XFAIL	1.000	-
	gas.XFAIL	0.000	-
	ld.XFAIL	11.000	-8.33%
	Geometric Mean	0.339	-93.71%

KFAIL

	Name	Current	%
	TOTAL.KFAIL	0.000	-
	binutils.KFAIL	0.000	-
	gas.KFAIL	0.000	-
	ld.KFAIL	0.000	-
	Geometric Mean	0.000	-

UNSUPPORTED

	Name	Current	%
	TOTAL.UNSUPPORTED	266.000	-35.75%
	binutils.UNSUPPORTED	10.000	-
	gas.UNSUPPORTED	8.000	-
	ld.UNSUPPORTED	248.000	-37.37%
	Geometric Mean	47.930	-20.35%

UNRESOLVED

	Name	Current	%
	TOTAL.UNRESOLVED	0.000	-
	binutils.UNRESOLVED	0.000	-
	gas.UNRESOLVED	0.000	-
	ld.UNRESOLVED	0.000	-
	Geometric Mean	0.000	-

UNTESTED

	Name	Current	%
	TOTAL.UNTESTED	20.000	-
	binutils.UNTESTED	0.000	-
	gas.UNTESTED	0.000	-
	ld.UNTESTED	20.000	-
	Geometric Mean	0.045	-

ERROR

	Name	Current	%
	TOTAL.ERROR	0.000	-
	binutils.ERROR	0.000	-
	gas.ERROR	0.000	-
	ld.ERROR	0.000	-
	Geometric Mean	0.000	-

OTHER

	Name	Current	%
	TOTAL.OTHER	0.000	-
	binutils.OTHER	0.000	-
	gas.OTHER	0.000	-
	ld.OTHER	0.000	-
	Geometric Mean	0.000	-

good

	Name	Current	%
	TOTAL.good	2655.000	-18.58%
	binutils.good	264.000	-
	gas.good	1287.000	-
	ld.good	1104.000	-35.48%
	Geometric Mean	998.974	-14.78%

bad

	Name	Current	%
	TOTAL.bad	21.000	10.53%
	binutils.bad	1.000	-
	gas.bad	0.000	-
	ld.bad	20.000	11.11%
	Geometric Mean	0.453	-93.53%

fails

	Name	Current	%
	TOTAL.fails	1.000	-94.74%
	Geometric Mean	1.000	-94.74%

flaky

	Name	Current	%
	TOTAL.flaky	0.000	-
	Geometric Mean	0.000	-

all

	Name	Current	%
	TOTAL.all	2676.000	-18.41%
	Geometric Mean	2676.000	-18.41%