Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=f2172071e6b6f20a0401b68a70655930e40f6455 (+ 28 commits)
git_gcc git+ssh://linaroci@gcc.gnu.org/git/gcc.git (0f73ae763c02ad3b2917c33eecba9b47efdcc73b) (+ 67 commits)
git_gdb https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=f2172071e6b6f20a0401b68a70655930e40f6455 (+ 28 commits)
git_newlib https://sourceware.org/git/?p=newlib-cygwin.git;a=commit;h=1f2628b667704df752ebc9385054c7c85654dafd (+ 6 commits)
git_qemu https://gitlab.com/qemu-project/qemu/commit/80db93b2b88f9b3ed8927ae7ac74ca30e643a83e (+ 70 commits)
test_url https://ci.linaro.org/job/tcwg_gnu_embed_check_gcc--master-thumb_m33_hard_eabi-build/456/
Filter

master-thumb_m33_hard_eabi test results

Run Order Start Time Duration
Current 0456 (5-changed-components) 2025-05-26T08:13:28 0:00:00
Previous 0460 (basepoints/gcc-16-00983-g48973e8783e5) 2025-05-30T23:46:24 0:00:00
Baseline 0002 (5-changed-components) 2024-04-16T14:06:34 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 5 7
Performance Improvements 0 20
Added Tests 16 16
Unchanged Tests 744 722
Total Tests 765

Performance Regressions - FAIL Δ Previous Current σ Δ (B) σ (B)
libstdc++.FAIL 5.88% 17.000 18.000 - 0.00% -

Performance Regressions - UNRESOLVED Δ Previous Current σ Δ (B) σ (B)
libstdc++.UNRESOLVED 50.00% 2.000 3.000 - -25.00% -
TOTAL.UNRESOLVED 33.33% 3.000 4.000 - -63.64% -

Performance Regressions - bad Δ Previous Current σ Δ (B) σ (B)
libstdc++.bad 14.29% 21.000 24.000 - 0.00% -
TOTAL.bad 1.90% 158.000 161.000 - -57.07% -

Added Tests - ERROR
TOTAL.ERROR
g++.ERROR
gcc.ERROR
libstdc++.ERROR

Added Tests - KFAIL
TOTAL.KFAIL
g++.KFAIL
gcc.KFAIL
libstdc++.KFAIL

Added Tests - OTHER
g++.OTHER
gcc.OTHER

Added Tests - UNRESOLVED
g++.UNRESOLVED

Added Tests - UNTESTED
TOTAL.UNTESTED
g++.UNTESTED
gcc.UNTESTED
libstdc++.UNTESTED

Added Tests - XPASS
gcc.XPASS

Performance Regressions - PASS Δ (B) Baseline Current σ (B) Δ σ
g++.PASS -3.43% 222609.000 214972.000 - -0.01% -

Performance Regressions - UNSUPPORTED Δ (B) Baseline Current σ (B) Δ σ
gcc.UNSUPPORTED 8.92% 9450.000 10293.000 - 0.00% -
libstdc++.UNSUPPORTED 3.80% 1025.000 1064.000 - 0.00% -

Performance Regressions - XFAIL Δ (B) Baseline Current σ (B) Δ σ
libstdc++.XFAIL 3.82% 131.000 136.000 - 0.00% -

Performance Regressions - all Δ (B) Baseline Current σ (B) Δ σ
TOTAL.all -1.59% 430300.000 423438.000 - -0.01% -

Performance Regressions - good Δ (B) Baseline Current σ (B) Δ σ
g++.good -7.30% 236316.000 219074.000 - -0.01% -
TOTAL.good -1.55% 429925.000 423277.000 - -0.01% -

Performance Improvements - FAIL Δ (B) Baseline Current σ (B) Δ σ
g++.FAIL -62.26% 53.000 20.000 - 0.00% -
gcc.FAIL -60.50% 281.000 111.000 - 0.00% -
TOTAL.FAIL -57.67% 352.000 149.000 - 0.68% -

Performance Improvements - PASS Δ (B) Baseline Current σ (B) Δ σ
libstdc++.PASS 5.43% 15922.000 16786.000 - -0.01% -
gcc.PASS 5.33% 166065.000 174921.000 - -0.00% -

Performance Improvements - UNRESOLVED Δ (B) Baseline Current σ (B) Δ σ
TOTAL.UNRESOLVED -63.64% 11.000 4.000 - 33.33% -
libstdc++.UNRESOLVED -25.00% 4.000 3.000 - 50.00% -

Performance Improvements - UNSUPPORTED Δ (B) Baseline Current σ (B) Δ σ
g++.UNSUPPORTED -78.47% 11850.000 2551.000 - 0.00% -
TOTAL.UNSUPPORTED -37.70% 22325.000 13908.000 - 0.00% -

Performance Improvements - XFAIL Δ (B) Baseline Current σ (B) Δ σ
g++.XFAIL -16.48% 1857.000 1551.000 - 0.00% -
TOTAL.XFAIL -10.45% 3004.000 2690.000 - 0.00% -
gcc.XFAIL -1.28% 1016.000 1003.000 - 0.00% -

Performance Improvements - XPASS Δ (B) Baseline Current σ (B) Δ σ
g++.XPASS -50.00% 10.000 5.000 - 0.00% -
TOTAL.XPASS -41.67% 12.000 7.000 - 0.00% -

Performance Improvements - bad Δ (B) Baseline Current σ (B) Δ σ
g++.bad -63.77% 69.000 25.000 - 0.00% -
gcc.bad -60.28% 282.000 112.000 - 0.00% -
TOTAL.bad -57.07% 375.000 161.000 - 1.90% -

Performance Improvements - fails Δ (B) Baseline Current σ (B) Δ σ
TOTAL.fails -57.87% 375.000 158.000 - 0.00% -

Performance Improvements - good Δ (B) Baseline Current σ (B) Δ σ
gcc.good 5.49% 176531.000 186217.000 - -0.00% -
libstdc++.good 5.32% 17078.000 17986.000 - -0.01% -

Added Tests - ERROR
TOTAL.ERROR
g++.ERROR
gcc.ERROR
libstdc++.ERROR

Added Tests - KFAIL
TOTAL.KFAIL
g++.KFAIL
gcc.KFAIL
libstdc++.KFAIL

Added Tests - OTHER
g++.OTHER
gcc.OTHER

Added Tests - UNRESOLVED
g++.UNRESOLVED

Added Tests - UNTESTED
TOTAL.UNTESTED
g++.UNTESTED
gcc.UNTESTED
libstdc++.UNTESTED

Added Tests - XPASS
gcc.XPASS


Report Time: 0.20s
Name Current %
TOTAL.PASS 406679.000 -
g++.PASS 214972.000 -
gcc.PASS 174921.000 -
libstdc++.PASS 16786.000 -
Geometric Mean 126577.264 -
Name Current %
TOTAL.XPASS 7.000 -
g++.XPASS 5.000 -
gcc.XPASS 0.000 -
libstdc++.XPASS 2.000 -
Geometric Mean 0.289 -92.98%
Name Current %
TOTAL.FAIL 149.000 -
g++.FAIL 20.000 -
gcc.FAIL 111.000 -
libstdc++.FAIL 18.000 5.88%
Geometric Mean 49.397 1.61%
Name Current %
TOTAL.XFAIL 2690.000 -
g++.XFAIL 1551.000 -
gcc.XFAIL 1003.000 -
libstdc++.XFAIL 136.000 -
Geometric Mean 868.562 -
Name Current %
TOTAL.KFAIL 0.000 -
g++.KFAIL 0.000 -
gcc.KFAIL 0.000 -
libstdc++.KFAIL 0.000 -
Geometric Mean 0.000 -
Name Current %
TOTAL.UNSUPPORTED 13908.000 -
g++.UNSUPPORTED 2551.000 -
gcc.UNSUPPORTED 10293.000 -
libstdc++.UNSUPPORTED 1064.000 -
Geometric Mean 4439.813 -
Name Current %
TOTAL.UNRESOLVED 4.000 33.33%
g++.UNRESOLVED 0.000 -
gcc.UNRESOLVED 1.000 -
libstdc++.UNRESOLVED 3.000 50.00%
Geometric Mean 0.186 -89.76%
Name Current %
TOTAL.ERROR 0.000 -
g++.ERROR 0.000 -
gcc.ERROR 0.000 -
libstdc++.ERROR 0.000 -
Geometric Mean 0.000 -
Name Current %
TOTAL.OTHER 1.000 -
g++.OTHER 0.000 -
gcc.OTHER 0.000 -
libstdc++.OTHER 1.000 -
Geometric Mean 0.010 -
Name Current %
TOTAL.good 423277.000 -
g++.good 219074.000 -
gcc.good 186217.000 -
libstdc++.good 17986.000 -
Geometric Mean 132752.392 -
bad
Name Current %
TOTAL.bad 161.000 1.90%
g++.bad 25.000 -
gcc.bad 112.000 -
libstdc++.bad 24.000 14.29%
Geometric Mean 57.352 3.88%
Name Current %
TOTAL.fails 158.000 -
Geometric Mean 158.000 -
Name Current %
TOTAL.flaky 8.000 -
Geometric Mean 8.000 -
all
Name Current %
TOTAL.all 423438.000 -
Geometric Mean 423438.000 -