Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=63b6693fc457425a4f8e697e5e76f6f333898fcb (unchanged)
git_gcc git+ssh://linaroci@gcc.gnu.org/git/gcc.git (3cb6c01d2a9ab0ff44767a5866a4a7b929334263) (+ 1 commits)
git_gdb https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=63b6693fc457425a4f8e697e5e76f6f333898fcb (unchanged)
git_newlib https://sourceware.org/git/?p=newlib-cygwin.git;a=commit;h=3a03874f73db015d93c3b54c6bad32a2852c591e (unchanged)
git_qemu https://gitlab.com/qemu-project/qemu/commit/91589bcd9fee0e66b241d04e5f37cd4f218187a2 (unchanged)
regression https://linaro.atlassian.net/browse/GNU-1673
test_url https://ci.linaro.org/job/tcwg_gnu_embed_check_gcc--master-thumb_m0_soft_eabi-build/479/
Filter

master-thumb_m0_soft_eabi test results

Run Order Start Time Duration
Current 0479 (basepoints/gcc-16-03492-g3cb6c01d2a9) 2025-09-01T11:36:17 0:00:00
Previous 0483 (4-changed-components) 2025-09-06T21:23:00 0:00:00
Baseline 0002 (5-changed-components) 2024-04-16T12:17:35 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 5 9
Performance Improvements 0 21
Added Tests 17 17
Unchanged Tests 743 718
Total Tests 765

Performance Regressions - FAIL Δ Previous Current σ Δ (B) σ (B)
g++.FAIL 9.68% 31.000 34.000 - -30.61% -
TOTAL.FAIL 3.90% 77.000 80.000 - -60.20% -

Performance Regressions - bad Δ Previous Current σ Δ (B) σ (B)
g++.bad 7.50% 40.000 43.000 - -30.65% -
TOTAL.bad 3.03% 99.000 102.000 - -59.36% -

Performance Regressions - fails Δ Previous Current σ Δ (B) σ (B)
TOTAL.fails 3.03% 99.000 102.000 - -59.36% -

Added Tests - ERROR
TOTAL.ERROR
g++.ERROR
gcc.ERROR
libstdc++.ERROR

Added Tests - KFAIL
TOTAL.KFAIL
g++.KFAIL
gcc.KFAIL
libstdc++.KFAIL

Added Tests - OTHER
TOTAL.OTHER
g++.OTHER
gcc.OTHER
libstdc++.OTHER

Added Tests - UNRESOLVED
gcc.UNRESOLVED

Added Tests - UNTESTED
TOTAL.UNTESTED
g++.UNTESTED
gcc.UNTESTED
libstdc++.UNTESTED

Performance Regressions - FAIL Δ (B) Baseline Current σ (B) Δ σ
libstdc++.FAIL 13.33% 15.000 17.000 - 0.00% -

Performance Regressions - UNRESOLVED Δ (B) Baseline Current σ (B) Δ σ
g++.UNRESOLVED 33.33% 3.000 4.000 - 0.00% -

Performance Regressions - UNSUPPORTED Δ (B) Baseline Current σ (B) Δ σ
gcc.UNSUPPORTED 112.60% 5245.000 11151.000 - -0.04% -
libstdc++.UNSUPPORTED 4.17% 1056.000 1100.000 - 0.00% -

Performance Regressions - XFAIL Δ (B) Baseline Current σ (B) Δ σ
libstdc++.XFAIL 5.34% 131.000 138.000 - 0.00% -
gcc.XFAIL 4.44% 901.000 941.000 - 0.11% -

Performance Regressions - XPASS Δ (B) Baseline Current σ (B) Δ σ
gcc.XPASS 200.00% 3.000 9.000 - 0.00% -
TOTAL.XPASS 6.67% 15.000 16.000 - 0.00% -

Performance Regressions - good Δ (B) Baseline Current σ (B) Δ σ
g++.good -3.21% 235524.000 227964.000 - -0.11% -

Performance Improvements - FAIL Δ (B) Baseline Current σ (B) Δ σ
gcc.FAIL -78.83% 137.000 29.000 - 0.00% -
TOTAL.FAIL -60.20% 201.000 80.000 - 3.90% -
g++.FAIL -30.61% 49.000 34.000 - 9.68% -

Performance Improvements - PASS Δ (B) Baseline Current σ (B) Δ σ
gcc.PASS 10.83% 148121.000 164168.000 - -0.05% -
libstdc++.PASS 9.56% 15835.000 17349.000 - -0.13% -
TOTAL.PASS 5.00% 385951.000 405242.000 - -0.08% -

Performance Improvements - UNRESOLVED Δ (B) Baseline Current σ (B) Δ σ
TOTAL.UNRESOLVED -82.86% 35.000 6.000 - 0.00% -
libstdc++.UNRESOLVED -50.00% 4.000 2.000 - 0.00% -

Performance Improvements - UNSUPPORTED Δ (B) Baseline Current σ (B) Δ σ
g++.UNSUPPORTED -76.25% 11820.000 2807.000 - -0.21% -
TOTAL.UNSUPPORTED -16.90% 18121.000 15058.000 - -0.07% -

Performance Improvements - XFAIL Δ (B) Baseline Current σ (B) Δ σ
g++.XFAIL -16.21% 1709.000 1432.000 - -0.62% -
TOTAL.XFAIL -8.39% 2741.000 2511.000 - -0.32% -

Performance Improvements - XPASS Δ (B) Baseline Current σ (B) Δ σ
g++.XPASS -50.00% 10.000 5.000 - 0.00% -

Performance Improvements - all Δ (B) Baseline Current σ (B) Δ σ
TOTAL.all 3.89% 407064.000 422913.000 - -0.08% -

Performance Improvements - bad Δ (B) Baseline Current σ (B) Δ σ
gcc.bad -77.38% 168.000 38.000 - 0.00% -
TOTAL.bad -59.36% 251.000 102.000 - 3.03% -
g++.bad -30.65% 62.000 43.000 - 7.50% -

Performance Improvements - fails Δ (B) Baseline Current σ (B) Δ σ
TOTAL.fails -59.36% 251.000 102.000 - 3.03% -

Performance Improvements - good Δ (B) Baseline Current σ (B) Δ σ
gcc.good 14.26% 154267.000 176260.000 - -0.05% -
libstdc++.good 9.19% 17022.000 18587.000 - -0.12% -
TOTAL.good 3.93% 406813.000 422811.000 - -0.08% -

Added Tests - ERROR
TOTAL.ERROR
g++.ERROR
gcc.ERROR
libstdc++.ERROR

Added Tests - KFAIL
TOTAL.KFAIL
g++.KFAIL
gcc.KFAIL
libstdc++.KFAIL

Added Tests - OTHER
TOTAL.OTHER
g++.OTHER
gcc.OTHER
libstdc++.OTHER

Added Tests - UNRESOLVED
gcc.UNRESOLVED

Added Tests - UNTESTED
TOTAL.UNTESTED
g++.UNTESTED
gcc.UNTESTED
libstdc++.UNTESTED


Report Time: 0.19s
Name Current %
TOTAL.PASS 405242.000 -
g++.PASS 223725.000 -
gcc.PASS 164168.000 -
libstdc++.PASS 17349.000 -
Geometric Mean 126764.597 -
Name Current %
TOTAL.XPASS 16.000 -
g++.XPASS 5.000 -
gcc.XPASS 9.000 -
libstdc++.XPASS 2.000 -
Geometric Mean 6.160 -
Name Current %
TOTAL.FAIL 80.000 3.90%
g++.FAIL 34.000 9.68%
gcc.FAIL 29.000 -
libstdc++.FAIL 17.000 -
Geometric Mean 34.029 3.32%
Name Current %
TOTAL.XFAIL 2511.000 -
g++.XFAIL 1432.000 -
gcc.XFAIL 941.000 -
libstdc++.XFAIL 138.000 -
Geometric Mean 826.637 -
Name Current %
TOTAL.KFAIL 0.000 -
g++.KFAIL 0.000 -
gcc.KFAIL 0.000 -
libstdc++.KFAIL 0.000 -
Geometric Mean 0.000 -
Name Current %
TOTAL.UNSUPPORTED 15058.000 -
g++.UNSUPPORTED 2807.000 -
gcc.UNSUPPORTED 11151.000 -
libstdc++.UNSUPPORTED 1100.000 -
Geometric Mean 4771.765 -
Name Current %
TOTAL.ERROR 0.000 -
g++.ERROR 0.000 -
gcc.ERROR 0.000 -
libstdc++.ERROR 0.000 -
Geometric Mean 0.000 -
Name Current %
TOTAL.OTHER 0.000 -
g++.OTHER 0.000 -
gcc.OTHER 0.000 -
libstdc++.OTHER 0.000 -
Geometric Mean 0.000 -
Name Current %
TOTAL.good 422811.000 -
g++.good 227964.000 -
gcc.good 176260.000 -
libstdc++.good 18587.000 -
Geometric Mean 133304.222 -
bad
Name Current %
TOTAL.bad 102.000 3.03%
g++.bad 43.000 7.50%
gcc.bad 38.000 -
libstdc++.bad 21.000 -
Geometric Mean 43.253 2.59%
Name Current %
TOTAL.fails 102.000 3.03%
Geometric Mean 102.000 3.03%
Name Current %
TOTAL.flaky 8.000 -
Geometric Mean 8.000 -
all
Name Current %
TOTAL.all 422913.000 -
Geometric Mean 422913.000 -