Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=260aa570edcf120332daefb4a102a08c90e4d9b4 (unchanged)
git_gcc https://github.com/gcc-mirror/gcc/commit/7a6a29c455e7755b501c0006e39beb4e56ec2729 (+ 1 commits)
git_gdb https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=260aa570edcf120332daefb4a102a08c90e4d9b4 (unchanged)
git_newlib https://sourceware.org/git/?p=newlib-cygwin.git;a=commit;h=65f7ab0bb928162f6a6ea60e2803d6b9e5d95e8b (unchanged)
git_qemu https://gitlab.com/qemu-project/qemu/commit/29b5d70cb70574b499517ec9e9f80dea496a3cc0 (unchanged)
regression https://linaro.atlassian.net/browse/GNU-1036
test_url https://ci.linaro.org/job/tcwg_gnu_embed_check_gcc--master-thumb_m3_eabi-build/237/
Filter

master-thumb_m3_eabi test results

Run Order Start Time Duration
Current 0237 (basepoints/gcc-14-05794-g7a6a29c455e) 2023-12-02T00:33:34 0:00:00
Previous 0223 (basepoints/gcc-14-05628-g53ba8d66955) 2023-11-25T07:14:44 0:00:00
Baseline 0005 (5-changed-components) 2023-08-03T00:00:40 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 0 17
Performance Improvements 9 11
Added Tests 17 20
Unchanged Tests 739 717
Total Tests 765

Performance Improvements - FAIL Δ Previous Current σ Δ (B) σ (B)
g++.FAIL -6.14% 114.000 107.000 - 256.67% -
TOTAL.FAIL -3.06% 360.000 349.000 - 223.15% -
gcc.FAIL -1.72% 232.000 228.000 - 314.55% -

Performance Improvements - XPASS Δ Previous Current σ Δ (B) σ (B)
g++.XPASS -4.35% 23.000 22.000 - 175.00% -
TOTAL.XPASS -3.70% 27.000 26.000 - 160.00% -

Performance Improvements - bad Δ Previous Current σ Δ (B) σ (B)
g++.bad -5.71% 140.000 132.000 - 221.95% -
TOTAL.bad -3.36% 417.000 403.000 - 192.03% -
gcc.bad -2.30% 261.000 255.000 - 355.36% -

Performance Improvements - fails Δ Previous Current σ Δ (B) σ (B)
TOTAL.fails -3.12% 416.000 403.000 - 0.00% -

Added Tests - ERROR
TOTAL.ERROR
g++.ERROR
gcc.ERROR
libstdc++.ERROR

Added Tests - KFAIL
TOTAL.KFAIL
g++.KFAIL
gcc.KFAIL
libstdc++.KFAIL

Added Tests - OTHER
TOTAL.OTHER
g++.OTHER
gcc.OTHER
libstdc++.OTHER

Added Tests - UNRESOLVED
libstdc++.UNRESOLVED

Added Tests - UNTESTED
TOTAL.UNTESTED
g++.UNTESTED
gcc.UNTESTED
libstdc++.UNTESTED

Performance Regressions - FAIL Δ (B) Baseline Current σ (B) Δ σ
gcc.FAIL 314.55% 55.000 228.000 - -1.72% -
g++.FAIL 256.67% 30.000 107.000 - -6.14% -
TOTAL.FAIL 223.15% 108.000 349.000 - -3.06% -

Performance Regressions - UNRESOLVED Δ (B) Baseline Current σ (B) Δ σ
gcc.UNRESOLVED 2400.00% 1.000 25.000 - 0.00% -
TOTAL.UNRESOLVED 40.00% 20.000 28.000 - 0.00% -

Performance Regressions - UNSUPPORTED Δ (B) Baseline Current σ (B) Δ σ
gcc.UNSUPPORTED 33.72% 6774.000 9058.000 - 0.19% -
libstdc++.UNSUPPORTED 3.47% 981.000 1015.000 - 0.00% -
TOTAL.UNSUPPORTED 1.13% 21240.000 21480.000 - 0.39% -

Performance Regressions - XFAIL Δ (B) Baseline Current σ (B) Δ σ
g++.XFAIL 41.39% 1179.000 1667.000 - 0.00% -
TOTAL.XFAIL 28.66% 2174.000 2797.000 - 0.00% -
libstdc++.XFAIL 18.02% 111.000 131.000 - 0.00% -
gcc.XFAIL 13.01% 884.000 999.000 - 0.00% -

Performance Regressions - XPASS Δ (B) Baseline Current σ (B) Δ σ
g++.XPASS 175.00% 8.000 22.000 - -4.35% -
TOTAL.XPASS 160.00% 10.000 26.000 - -3.70% -

Performance Regressions - bad Δ (B) Baseline Current σ (B) Δ σ
gcc.bad 355.36% 56.000 255.000 - -2.30% -
g++.bad 221.95% 41.000 132.000 - -5.71% -
TOTAL.bad 192.03% 138.000 403.000 - -3.36% -

Performance Improvements - FAIL Δ (B) Baseline Current σ (B) Δ σ
libstdc++.FAIL -39.13% 23.000 14.000 - 0.00% -

Performance Improvements - PASS Δ (B) Baseline Current σ (B) Δ σ
gcc.PASS 19.45% 129391.000 154555.000 - 0.71% -
libstdc++.PASS 15.35% 13541.000 15619.000 - 0.22% -
TOTAL.PASS 14.01% 332658.000 379273.000 - 0.39% -
g++.PASS 10.21% 189726.000 209099.000 - 0.17% -

Performance Improvements - UNSUPPORTED Δ (B) Baseline Current σ (B) Δ σ
g++.UNSUPPORTED -15.41% 13485.000 11407.000 - 0.59% -

Performance Improvements - bad Δ (B) Baseline Current σ (B) Δ σ
libstdc++.bad -60.98% 41.000 16.000 - 0.00% -

Performance Improvements - good Δ (B) Baseline Current σ (B) Δ σ
gcc.good 20.11% 137049.000 164612.000 - 0.68% -
libstdc++.good 14.57% 14633.000 16765.000 - 0.21% -
TOTAL.good 13.33% 356072.000 403550.000 - 0.39% -
g++.good 8.70% 204390.000 222173.000 - 0.19% -

Added Tests - ERROR
TOTAL.ERROR
g++.ERROR
gcc.ERROR
libstdc++.ERROR

Added Tests - KFAIL
TOTAL.KFAIL
g++.KFAIL
gcc.KFAIL
libstdc++.KFAIL

Added Tests - OTHER
TOTAL.OTHER
g++.OTHER
gcc.OTHER
libstdc++.OTHER

Added Tests - UNRESOLVED
libstdc++.UNRESOLVED

Added Tests - UNTESTED
TOTAL.UNTESTED
g++.UNTESTED
gcc.UNTESTED
libstdc++.UNTESTED

Added Tests - all
TOTAL.all

Added Tests - fails
TOTAL.fails

Added Tests - flaky
TOTAL.flaky


Report Time: 0.34s
Name Current %
TOTAL.PASS 379273.000 -
g++.PASS 209099.000 -
gcc.PASS 154555.000 -
libstdc++.PASS 15619.000 -
Geometric Mean 117627.818 -
Name Current %
TOTAL.XPASS 26.000 -3.70%
g++.XPASS 22.000 -4.35%
gcc.XPASS 2.000 -
libstdc++.XPASS 2.000 -
Geometric Mean 6.916 -2.03%
Name Current %
TOTAL.FAIL 349.000 -3.06%
g++.FAIL 107.000 -6.14%
gcc.FAIL 228.000 -1.72%
libstdc++.FAIL 14.000 -
Geometric Mean 104.489 -2.76%
Name Current %
TOTAL.XFAIL 2797.000 -
g++.XFAIL 1667.000 -
gcc.XFAIL 999.000 -
libstdc++.XFAIL 131.000 -
Geometric Mean 883.825 -
Name Current %
TOTAL.KFAIL 0.000 -
g++.KFAIL 0.000 -
gcc.KFAIL 0.000 -
libstdc++.KFAIL 0.000 -
Geometric Mean 0.000 -
Name Current %
TOTAL.UNSUPPORTED 21480.000 -
g++.UNSUPPORTED 11407.000 -
gcc.UNSUPPORTED 9058.000 -
libstdc++.UNSUPPORTED 1015.000 -
Geometric Mean 6889.315 -
Name Current %
TOTAL.ERROR 0.000 -
g++.ERROR 0.000 -
gcc.ERROR 0.000 -
libstdc++.ERROR 0.000 -
Geometric Mean 0.000 -
Name Current %
TOTAL.OTHER 0.000 -
g++.OTHER 0.000 -
gcc.OTHER 0.000 -
libstdc++.OTHER 0.000 -
Geometric Mean 0.000 -
Name Current %
TOTAL.good 403550.000 -
g++.good 222173.000 -
gcc.good 164612.000 -
libstdc++.good 16765.000 -
Geometric Mean 125419.025 -
bad
Name Current %
TOTAL.bad 403.000 -3.36%
g++.bad 132.000 -5.71%
gcc.bad 255.000 -2.30%
libstdc++.bad 16.000 -
Geometric Mean 121.377 -2.86%
Name Current %
TOTAL.fails 403.000 -3.12%
Geometric Mean 403.000 -3.12%
Name Current %
TOTAL.flaky 3.000 -
Geometric Mean 3.000 -
all
Name Current %
TOTAL.all 403953.000 -
Geometric Mean 403953.000 -