Machine Info

Fields

hardware	None
os	None

Parameters

Run Info

Fields

Name	Value

Parameters

Name	Value
git_binutils	https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=486b7204e96b325fdc53baffd0fa6ce51f9d4247 (+ 41 commits)
git_gcc	https://github.com/gcc-mirror/gcc/commit/f432a594fe6d3a0de1330ba69200d158e6248083 (+ 121 commits)
git_gdb	https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=486b7204e96b325fdc53baffd0fa6ce51f9d4247 (+ 41 commits)
git_newlib	https://sourceware.org/git/?p=newlib-cygwin.git;a=commit;h=12e3bac3ce562007e83c3c67243c85fcb5ee70a4 (+ 4 commits)
git_qemu	https://gitlab.com/qemu-project/qemu/commit/6c9ae1ce82b65faa3f266fd103729878cf11e07e (+ 301 commits)
test_url	https://ci.linaro.org/job/tcwg_gnu_embed_check_gcc--master-thumb_m23_eabi-build/164/

Report

Filter

master-thumb_m23_eabi test results

Run	Order	Start Time	Duration
Current	0164 (5-changed-components)	2023-10-29T23:47:03	0:00:00
Previous	0162 (basepoints/gcc-14-04944-gf55cdce3f8d)	2023-10-25T19:01:15	0:00:00
Baseline	0001 (5-changed-components)	2023-08-01T01:14:40	0:00:00

Tests Summary

Status Group	#	# (B)
Performance Regressions	5	16
Performance Improvements	12	13
Added Tests	17	20
Unchanged Tests	731	716
Total Tests	765

Run-Over-Run Changes Detail

Performance Regressions - PASS	Δ	Previous	Current	σ	Δ (B)	σ (B)
libstdc++.PASS	-49.96%	30926.000	15476.000	-	14.28%	-
TOTAL.PASS	-3.82%	386087.000	371334.000	-	11.58%	-

Performance Regressions - all	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.all	-3.94%	407372.000	391312.000	-	0.00%	-

Performance Regressions - good	Δ	Previous	Current	σ	Δ (B)	σ (B)
libstdc++.good	-49.96%	33214.000	16621.000	-	13.58%	-
TOTAL.good	-3.91%	406851.000	390955.000	-	9.70%	-

Performance Improvements - FAIL	Δ	Previous	Current	σ	Δ (B)	σ (B)
libstdc++.FAIL	-58.33%	24.000	10.000	-	-54.55%	-
TOTAL.FAIL	-5.03%	298.000	283.000	-	188.78%	-

Performance Improvements - UNRESOLVED	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.UNRESOLVED	-22.41%	58.000	45.000	-	80.00%	-

Performance Improvements - UNSUPPORTED	Δ	Previous	Current	σ	Δ (B)	σ (B)
libstdc++.UNSUPPORTED	-49.95%	2026.000	1014.000	-	3.36%	-
TOTAL.UNSUPPORTED	-5.53%	18080.000	17080.000	-	-20.88%	-

Performance Improvements - XFAIL	Δ	Previous	Current	σ	Δ (B)	σ (B)
libstdc++.XFAIL	-50.00%	262.000	131.000	-	18.02%	-
TOTAL.XFAIL	-5.33%	2684.000	2541.000	-	27.88%	-

Performance Improvements - XPASS	Δ	Previous	Current	σ	Δ (B)	σ (B)
libstdc++.XPASS	-50.00%	4.000	2.000	-	0.00%	-
TOTAL.XPASS	-6.45%	31.000	29.000	-	123.08%	-

Performance Improvements - bad	Δ	Previous	Current	σ	Δ (B)	σ (B)
libstdc++.bad	-93.33%	180.000	12.000	-	-70.00%	-
TOTAL.bad	-32.13%	526.000	357.000	-	162.50%	-

Performance Improvements - fails	Δ	Previous	Current	σ	Δ (B)	σ (B)
TOTAL.fails	-1.92%	364.000	357.000	-	0.00%	-

Added Tests - ERROR
TOTAL.ERROR
g++.ERROR
gcc.ERROR
libstdc++.ERROR

Added Tests - KFAIL
TOTAL.KFAIL
g++.KFAIL
gcc.KFAIL
libstdc++.KFAIL

Added Tests - OTHER
TOTAL.OTHER
g++.OTHER
gcc.OTHER
libstdc++.OTHER

Added Tests - UNRESOLVED
libstdc++.UNRESOLVED

Added Tests - UNTESTED
TOTAL.UNTESTED
g++.UNTESTED
gcc.UNTESTED
libstdc++.UNTESTED

Run-Over-Baseline Changes Detail

Performance Regressions - FAIL	Δ (B)	Baseline	Current	σ (B)	Δ	σ
gcc.FAIL	288.37%	43.000	167.000	-	-0.60%	-
g++.FAIL	221.21%	33.000	106.000	-	0.00%	-
TOTAL.FAIL	188.78%	98.000	283.000	-	-5.03%	-

Performance Regressions - UNRESOLVED	Δ (B)	Baseline	Current	σ (B)	Δ	σ
gcc.UNRESOLVED	600.00%	6.000	42.000	-	0.00%	-
TOTAL.UNRESOLVED	80.00%	25.000	45.000	-	-22.41%	-

Performance Regressions - UNSUPPORTED	Δ (B)	Baseline	Current	σ (B)	Δ	σ
libstdc++.UNSUPPORTED	3.36%	981.000	1014.000	-	-49.95%	-

Performance Regressions - XFAIL	Δ (B)	Baseline	Current	σ (B)	Δ	σ
g++.XFAIL	45.62%	1039.000	1513.000	-	-0.79%	-
TOTAL.XFAIL	27.88%	1987.000	2541.000	-	-5.33%	-
libstdc++.XFAIL	18.02%	111.000	131.000	-	-50.00%	-
gcc.XFAIL	7.17%	837.000	897.000	-	0.00%	-

Performance Regressions - XPASS	Δ (B)	Baseline	Current	σ (B)	Δ	σ
g++.XPASS	187.50%	8.000	23.000	-	0.00%	-
TOTAL.XPASS	123.08%	13.000	29.000	-	-6.45%	-
gcc.XPASS	33.33%	3.000	4.000	-	0.00%	-

Performance Regressions - bad	Δ (B)	Baseline	Current	σ (B)	Δ	σ
gcc.bad	309.62%	52.000	213.000	-	-0.47%	-
g++.bad	200.00%	44.000	132.000	-	0.00%	-
TOTAL.bad	162.50%	136.000	357.000	-	-32.13%	-

Performance Improvements - FAIL	Δ (B)	Baseline	Current	σ (B)	Δ	σ
libstdc++.FAIL	-54.55%	22.000	10.000	-	-58.33%	-

Performance Improvements - PASS	Δ (B)	Baseline	Current	σ (B)	Δ	σ
gcc.PASS	14.44%	129607.000	148326.000	-	0.11%	-
libstdc++.PASS	14.28%	13542.000	15476.000	-	-49.96%	-
TOTAL.PASS	11.58%	332802.000	371334.000	-	-3.82%	-
g++.PASS	9.43%	189653.000	207532.000	-	0.26%	-

Performance Improvements - UNSUPPORTED	Δ (B)	Baseline	Current	σ (B)	Δ	σ
gcc.UNSUPPORTED	-32.10%	7069.000	4800.000	-	0.06%	-
TOTAL.UNSUPPORTED	-20.88%	21587.000	17080.000	-	-5.53%	-
g++.UNSUPPORTED	-16.78%	13537.000	11266.000	-	0.08%	-

Performance Improvements - bad	Δ (B)	Baseline	Current	σ (B)	Δ	σ
libstdc++.bad	-70.00%	40.000	12.000	-	-93.33%	-

Performance Improvements - good	Δ (B)	Baseline	Current	σ (B)	Δ	σ
libstdc++.good	13.58%	14634.000	16621.000	-	-49.96%	-
gcc.good	12.01%	137513.000	154023.000	-	0.11%	-
TOTAL.good	9.70%	356376.000	390955.000	-	-3.91%	-
g++.good	7.87%	204229.000	220311.000	-	0.24%	-

Added Tests - ERROR
TOTAL.ERROR
g++.ERROR
gcc.ERROR
libstdc++.ERROR

Added Tests - KFAIL
TOTAL.KFAIL
g++.KFAIL
gcc.KFAIL
libstdc++.KFAIL

Added Tests - OTHER
TOTAL.OTHER
g++.OTHER
gcc.OTHER
libstdc++.OTHER

Added Tests - UNRESOLVED
libstdc++.UNRESOLVED

Added Tests - UNTESTED
TOTAL.UNTESTED
g++.UNTESTED
gcc.UNTESTED
libstdc++.UNTESTED

Added Tests - all
TOTAL.all

Added Tests - fails
TOTAL.fails

Added Tests - flaky
TOTAL.flaky

Report Time: 0.35s

PASS

	Name	Current	%
	TOTAL.PASS	371334.000	-3.82%
	g++.PASS	207532.000	-
	gcc.PASS	148326.000	-
	libstdc++.PASS	15476.000	-49.96%
	Geometric Mean	115327.121	-16.63%

XPASS

	Name	Current	%
	TOTAL.XPASS	29.000	-6.45%
	g++.XPASS	23.000	-
	gcc.XPASS	4.000	-
	libstdc++.XPASS	2.000	-50.00%
	Geometric Mean	8.547	-17.30%

FAIL

	Name	Current	%
	TOTAL.FAIL	283.000	-5.03%
	g++.FAIL	106.000	-
	gcc.FAIL	167.000	-
	libstdc++.FAIL	10.000	-58.33%
	Geometric Mean	84.130	-20.81%

XFAIL

	Name	Current	%
	TOTAL.XFAIL	2541.000	-5.33%
	g++.XFAIL	1513.000	-
	gcc.XFAIL	897.000	-
	libstdc++.XFAIL	131.000	-50.00%
	Geometric Mean	819.836	-17.22%

KFAIL

	Name	Current	%
	TOTAL.KFAIL	0.000	-
	g++.KFAIL	0.000	-
	gcc.KFAIL	0.000	-
	libstdc++.KFAIL	0.000	-
	Geometric Mean	0.000	-

UNSUPPORTED

	Name	Current	%
	TOTAL.UNSUPPORTED	17080.000	-5.53%
	g++.UNSUPPORTED	11266.000	-
	gcc.UNSUPPORTED	4800.000	-
	libstdc++.UNSUPPORTED	1014.000	-49.95%
	Geometric Mean	5532.026	-17.05%

UNRESOLVED

	Name	Current	%
	TOTAL.UNRESOLVED	45.000	-22.41%
	g++.UNRESOLVED	3.000	-
	gcc.UNRESOLVED	42.000	-
	libstdc++.UNRESOLVED	0.000	-
	Geometric Mean	0.868	-95.53%

UNTESTED

	Name	Current	%
	TOTAL.UNTESTED	0.000	-
	g++.UNTESTED	0.000	-
	gcc.UNTESTED	0.000	-
	libstdc++.UNTESTED	0.000	-
	Geometric Mean	0.000	-

ERROR

	Name	Current	%
	TOTAL.ERROR	0.000	-
	g++.ERROR	0.000	-
	gcc.ERROR	0.000	-
	libstdc++.ERROR	0.000	-
	Geometric Mean	0.000	-

OTHER

	Name	Current	%
	TOTAL.OTHER	0.000	-
	g++.OTHER	0.000	-
	gcc.OTHER	0.000	-
	libstdc++.OTHER	0.000	-
	Geometric Mean	0.000	-

good

	Name	Current	%
	TOTAL.good	390955.000	-3.91%
	g++.good	220311.000	-
	gcc.good	154023.000	-
	libstdc++.good	16621.000	-49.96%
	Geometric Mean	121857.263	-16.65%

bad

	Name	Current	%
	TOTAL.bad	357.000	-32.13%
	g++.bad	132.000	-
	gcc.bad	213.000	-
	libstdc++.bad	12.000	-93.33%
	Geometric Mean	104.761	-53.93%

fails

	Name	Current	%
	TOTAL.fails	357.000	-1.92%
	Geometric Mean	357.000	-1.92%

flaky

	Name	Current	%
	TOTAL.flaky	53.000	-
	Geometric Mean	53.000	-

all

	Name	Current	%
	TOTAL.all	391312.000	-3.94%
	Geometric Mean	391312.000	-3.94%