Machine Info

Fields

hardware	None
os	None

Parameters

Run Info

Fields

Name	Value

Parameters

Name	Value
git_binutils	https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=7e4f57dc1bb29588b87fd38fcc5d9afd28eefeb0 (+ 56 commits)
git_gcc	https://github.com/gcc-mirror/gcc/commit/bb8dd0980b39cfd601f88703fd356055727ef24d (unchanged)
git_gdb	https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=2bf0419eea579e0b4a8935be91f34e6871263096 (unchanged)
git_newlib	https://sourceware.org/git/?p=newlib-cygwin.git;a=commit;h=1b3dcfdc6f1fd2bd3e1ef2f8b7df736c076c6042 (unchanged)
git_qemu	https://gitlab.com/qemu-project/qemu/commit/7bbadc60b58b742494555f06cd342311ddab9351 (unchanged)
test_url	https://ci.linaro.org/job/tcwg_gnu_embed_check_gcc--master-thumb_m0_eabi-build/510/

Report

Filter

master-thumb_m0_eabi test results

Run	Order	Start Time	Duration
Current	0510 (binutils-2_41-release-04243-g7e4f57dc1bb)	2024-09-09T16:58:17	0:00:00
Previous	0503 (gdb-15-branchpoint-00991-g2bf0419eea5)	2024-09-05T09:16:51	0:00:00
Baseline	0001 (5-changed-components)	2023-08-01T06:00:40	0:00:00

Tests Summary

Status Group	#	# (B)
Performance Regressions	26	25
Performance Improvements	2	6
Added Tests	17	20
Unchanged Tests	720	714
Total Tests	765

Run-Over-Run Changes Detail

Performance Regressions - FAIL	Δ	Previous	Current	σ	Δ (B)	σ (B)
libstdc++.FAIL	35961.54%	13.000	4688.000	-	15526.67%	-
g++.FAIL	26038.46%	39.000	10194.000	-	30790.91%	-
TOTAL.FAIL	17257.21%	215.000	37318.000	-	36131.07%	-
gcc.FAIL	13664.42%	163.000	22436.000	-	55990.00%	-

Performance Regressions - PASS	Δ	Previous	Current	σ	Δ (B)	σ (B)
libstdc++.PASS	-62.28%	16002.000	6036.000	-	-55.20%	-
gcc.PASS	-29.43%	149561.000	105550.000	-	-17.60%	-
TOTAL.PASS	-20.06%	365797.000	292427.000	-	-11.71%	-
g++.PASS	-9.69%	200234.000	180841.000	-	-4.64%	-

Performance Regressions - UNRESOLVED	Δ	Previous	Current	σ	Δ (B)	σ (B)
g++.UNRESOLVED	296800.00%	3.000	8907.000	-	296800.00%	-
libstdc++.UNRESOLVED	115800.00%	4.000	4636.000	-	19216.67%	-
TOTAL.UNRESOLVED	95152.78%	36.000	34291.000	-	103812.12%	-
gcc.UNRESOLVED	71444.83%	29.000	20748.000	-	345700.00%	-

Performance Regressions - UNSUPPORTED	Δ	Previous	Current	σ	Δ (B)	σ (B)
libstdc++.UNSUPPORTED	13.02%	1060.000	1198.000	-	20.40%	-
TOTAL.UNSUPPORTED	2.88%	8928.000	9185.000	-	-57.62%	-
g++.UNSUPPORTED	2.06%	2473.000	2524.000	-	-81.38%	-
gcc.UNSUPPORTED	1.26%	5395.000	5463.000	-	-23.34%	-

Performance Regressions - XPASS	Δ	Previous	Current	σ	Δ (B)	σ (B)
gcc.XPASS	66.67%	3.000	5.000	-	66.67%	-

Performance Regressions - bad	Δ	Previous	Current	σ	Δ (B)	σ (B)
libstdc++.bad	48973.68%	19.000	9324.000	-	16550.00%	-
g++.bad	43315.91%	44.000	19103.000	-	43315.91%	-
TOTAL.bad	27658.14%	258.000	71616.000	-	47964.43%	-
gcc.bad	22048.21%	195.000	43189.000	-	88040.82%	-

Performance Regressions - fails	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.fails	27765.76%	257.000	71615.000	-	0.00%	-

Performance Regressions - good	Δ	Previous	Current	σ	Δ (B)	σ (B)
libstdc++.good	-57.87%	17194.000	7243.000	-	-50.32%	-
gcc.good	-28.20%	155856.000	111907.000	-	-17.75%	-
TOTAL.good	-19.42%	377172.000	303925.000	-	-14.36%	-
g++.good	-9.48%	204122.000	184775.000	-	-9.53%	-

Performance Improvements - XFAIL	Δ	Previous	Current	σ	Δ (B)	σ (B)
libstdc++.XFAIL	-93.18%	132.000	9.000	-	-91.89%	-
TOTAL.XFAIL	-5.48%	2447.000	2313.000	-	16.41%	-

Added Tests - ERROR
TOTAL.ERROR
g++.ERROR
gcc.ERROR
libstdc++.ERROR

Added Tests - KFAIL
TOTAL.KFAIL
g++.KFAIL
gcc.KFAIL
libstdc++.KFAIL

Added Tests - OTHER
TOTAL.OTHER
g++.OTHER
gcc.OTHER
libstdc++.OTHER

Added Tests - UNTESTED
TOTAL.UNTESTED
g++.UNTESTED
gcc.UNTESTED
libstdc++.UNTESTED

Added Tests - XPASS
libstdc++.XPASS

Run-Over-Baseline Changes Detail

Performance Regressions - FAIL	Δ (B)	Baseline	Current	σ (B)	Δ	σ
gcc.FAIL	55990.00%	40.000	22436.000	-	13664.42%	-
TOTAL.FAIL	36131.07%	103.000	37318.000	-	17257.21%	-
g++.FAIL	30790.91%	33.000	10194.000	-	26038.46%	-
libstdc++.FAIL	15526.67%	30.000	4688.000	-	35961.54%	-

Performance Regressions - PASS	Δ (B)	Baseline	Current	σ (B)	Δ	σ
libstdc++.PASS	-55.20%	13472.000	6036.000	-	-62.28%	-
gcc.PASS	-17.60%	128100.000	105550.000	-	-29.43%	-
TOTAL.PASS	-11.71%	331210.000	292427.000	-	-20.06%	-
g++.PASS	-4.64%	189638.000	180841.000	-	-9.69%	-

Performance Regressions - UNRESOLVED	Δ (B)	Baseline	Current	σ (B)	Δ	σ
gcc.UNRESOLVED	345700.00%	6.000	20748.000	-	71444.83%	-
g++.UNRESOLVED	296800.00%	3.000	8907.000	-	296800.00%	-
TOTAL.UNRESOLVED	103812.12%	33.000	34291.000	-	95152.78%	-
libstdc++.UNRESOLVED	19216.67%	24.000	4636.000	-	115800.00%	-

Performance Regressions - UNSUPPORTED	Δ (B)	Baseline	Current	σ (B)	Δ	σ
libstdc++.UNSUPPORTED	20.40%	995.000	1198.000	-	13.02%	-

Performance Regressions - XFAIL	Δ (B)	Baseline	Current	σ (B)	Δ	σ
g++.XFAIL	35.71%	1039.000	1410.000	-	-0.35%	-
TOTAL.XFAIL	16.41%	1987.000	2313.000	-	-5.48%	-
gcc.XFAIL	6.81%	837.000	894.000	-	-0.67%	-

Performance Regressions - XPASS	Δ (B)	Baseline	Current	σ (B)	Δ	σ
gcc.XPASS	66.67%	3.000	5.000	-	66.67%	-

Performance Regressions - bad	Δ (B)	Baseline	Current	σ (B)	Δ	σ
gcc.bad	88040.82%	49.000	43189.000	-	22048.21%	-
TOTAL.bad	47964.43%	149.000	71616.000	-	27658.14%	-
g++.bad	43315.91%	44.000	19103.000	-	43315.91%	-
libstdc++.bad	16550.00%	56.000	9324.000	-	48973.68%	-

Performance Regressions - good	Δ (B)	Baseline	Current	σ (B)	Δ	σ
libstdc++.good	-50.32%	14578.000	7243.000	-	-57.87%	-
gcc.good	-17.75%	136063.000	111907.000	-	-28.20%	-
TOTAL.good	-14.36%	354870.000	303925.000	-	-19.42%	-
g++.good	-9.53%	204229.000	184775.000	-	-9.48%	-

Performance Improvements - UNSUPPORTED	Δ (B)	Baseline	Current	σ (B)	Δ	σ
g++.UNSUPPORTED	-81.38%	13552.000	2524.000	-	2.06%	-
TOTAL.UNSUPPORTED	-57.62%	21673.000	9185.000	-	2.88%	-
gcc.UNSUPPORTED	-23.34%	7126.000	5463.000	-	1.26%	-

Performance Improvements - XFAIL	Δ (B)	Baseline	Current	σ (B)	Δ	σ
libstdc++.XFAIL	-91.89%	111.000	9.000	-	-93.18%	-

Performance Improvements - XPASS	Δ (B)	Baseline	Current	σ (B)	Δ	σ
g++.XPASS	-75.00%	8.000	2.000	-	0.00%	-
TOTAL.XPASS	-46.15%	13.000	7.000	-	0.00%	-

Added Tests - ERROR
TOTAL.ERROR
g++.ERROR
gcc.ERROR
libstdc++.ERROR

Added Tests - KFAIL
TOTAL.KFAIL
g++.KFAIL
gcc.KFAIL
libstdc++.KFAIL

Added Tests - OTHER
TOTAL.OTHER
g++.OTHER
gcc.OTHER
libstdc++.OTHER

Added Tests - UNTESTED
TOTAL.UNTESTED
g++.UNTESTED
gcc.UNTESTED
libstdc++.UNTESTED

Added Tests - XPASS
libstdc++.XPASS

Added Tests - all
TOTAL.all

Added Tests - fails
TOTAL.fails

Added Tests - flaky
TOTAL.flaky

Report Time: 0.36s

PASS

	Name	Current	%
	TOTAL.PASS	292427.000	-20.06%
	g++.PASS	180841.000	-9.69%
	gcc.PASS	105550.000	-29.43%
	libstdc++.PASS	6036.000	-62.28%
	Geometric Mean	76186.928	-33.79%

XPASS

	Name	Current	%
	TOTAL.XPASS	7.000	-
	g++.XPASS	2.000	-
	gcc.XPASS	5.000	66.67%
	libstdc++.XPASS	0.000	-
	Geometric Mean	0.289	-91.68%

FAIL

	Name	Current	%
	TOTAL.FAIL	37318.000	17257.21%
	g++.FAIL	10194.000	26038.46%
	gcc.FAIL	22436.000	13664.42%
	libstdc++.FAIL	4688.000	35961.54%
	Geometric Mean	14143.243	21684.12%

XFAIL

	Name	Current	%
	TOTAL.XFAIL	2313.000	-5.48%
	g++.XFAIL	1410.000	-
	gcc.XFAIL	894.000	-
	libstdc++.XFAIL	9.000	-93.18%
	Geometric Mean	402.480	-49.74%

KFAIL

	Name	Current	%
	TOTAL.KFAIL	0.000	-
	g++.KFAIL	0.000	-
	gcc.KFAIL	0.000	-
	libstdc++.KFAIL	0.000	-
	Geometric Mean	0.000	-

UNSUPPORTED

	Name	Current	%
	TOTAL.UNSUPPORTED	9185.000	2.88%
	g++.UNSUPPORTED	2524.000	2.06%
	gcc.UNSUPPORTED	5463.000	1.26%
	libstdc++.UNSUPPORTED	1198.000	13.02%
	Geometric Mean	3509.653	4.70%

UNRESOLVED

	Name	Current	%
	TOTAL.UNRESOLVED	34291.000	95152.78%
	g++.UNRESOLVED	8907.000	296800.00%
	gcc.UNRESOLVED	20748.000	71444.83%
	libstdc++.UNRESOLVED	4636.000	115800.00%
	Geometric Mean	13092.055	123646.94%

UNTESTED

	Name	Current	%
	TOTAL.UNTESTED	0.000	-
	g++.UNTESTED	0.000	-
	gcc.UNTESTED	0.000	-
	libstdc++.UNTESTED	0.000	-
	Geometric Mean	0.000	-

ERROR

	Name	Current	%
	TOTAL.ERROR	0.000	-
	g++.ERROR	0.000	-
	gcc.ERROR	0.000	-
	libstdc++.ERROR	0.000	-
	Geometric Mean	0.000	-

OTHER

	Name	Current	%
	TOTAL.OTHER	0.000	-
	g++.OTHER	0.000	-
	gcc.OTHER	0.000	-
	libstdc++.OTHER	0.000	-
	Geometric Mean	0.000	-

good

	Name	Current	%
	TOTAL.good	303925.000	-19.42%
	g++.good	184775.000	-9.48%
	gcc.good	111907.000	-28.20%
	libstdc++.good	7243.000	-57.87%
	Geometric Mean	82138.420	-31.46%

bad

	Name	Current	%
	TOTAL.bad	71616.000	27658.14%
	g++.bad	19103.000	43315.91%
	gcc.bad	43189.000	22048.21%
	libstdc++.bad	9324.000	48973.68%
	Geometric Mean	27244.056	33730.33%

fails

	Name	Current	%
	TOTAL.fails	71615.000	27765.76%
	Geometric Mean	71615.000	27765.76%

flaky

	Name	Current	%
	TOTAL.flaky	34.000	-
	Geometric Mean	34.000	-

all

	Name	Current	%
	TOTAL.all	375541.000	-
	Geometric Mean	375541.000	-