Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=3e488d8ccd0fb25d9c2d33feceb9eac3e336c1b0 (unchanged)
git_gcc git+ssh://linaroci@gcc.gnu.org/git/gcc.git (b4cf69503bcb32491dbd7ab63fe7f0f9fcdcca38) (+ 109 commits)
git_gdb https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=3e488d8ccd0fb25d9c2d33feceb9eac3e336c1b0 (unchanged)
git_newlib https://sourceware.org/git/?p=newlib-cygwin.git;a=commit;h=b39b510c1ce68757e79410585262ca2cd48da839 (unchanged)
git_qemu https://gitlab.com/qemu-project/qemu/commit/2af4a82ab2cce3412ffc92cd4c96bd870e33bc8e (unchanged)
test_url https://ci.linaro.org/job/tcwg_gnu_embed_check_gcc--master-thumb_m55_hard_eabi-build/829/
Filter

master-thumb_m55_hard_eabi test results

Run Order Start Time Duration
Current 0829 (basepoints/gcc-15-09486-gb4cf69503bcb) 2025-05-13T12:13:44 0:00:00
Previous 0817 (4-changed-components) 2025-04-13T10:18:52 0:00:00
Baseline 0004 (5-changed-components) 2023-08-02T19:43:22 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 3 6
Performance Improvements 0 26
Added Tests 14 14
Unchanged Tests 748 719
Total Tests 765

Performance Regressions - FAIL Δ Previous Current σ Δ (B) σ (B)
libstdc++.FAIL 5.26% 19.000 20.000 - -13.04% -

Performance Regressions - bad Δ Previous Current σ Δ (B) σ (B)
libstdc++.bad 8.70% 23.000 25.000 - -39.02% -
TOTAL.bad 1.27% 157.000 159.000 - -66.88% -

Added Tests - ERROR
TOTAL.ERROR
g++.ERROR
gcc.ERROR
libstdc++.ERROR

Added Tests - KFAIL
TOTAL.KFAIL
g++.KFAIL
gcc.KFAIL
libstdc++.KFAIL

Added Tests - OTHER
g++.OTHER
gcc.OTHER

Added Tests - UNTESTED
TOTAL.UNTESTED
g++.UNTESTED
gcc.UNTESTED
libstdc++.UNTESTED

Performance Regressions - UNSUPPORTED Δ (B) Baseline Current σ (B) Δ σ
gcc.UNSUPPORTED 18.35% 8612.000 10192.000 - 0.08% -
libstdc++.UNSUPPORTED 6.01% 981.000 1040.000 - 0.00% -

Performance Regressions - XFAIL Δ (B) Baseline Current σ (B) Δ σ
g++.XFAIL 32.50% 1083.000 1435.000 - 0.00% -
libstdc++.XFAIL 22.52% 111.000 136.000 - 0.00% -
TOTAL.XFAIL 19.63% 2114.000 2529.000 - 0.00% -
gcc.XFAIL 4.13% 920.000 958.000 - 0.00% -

Performance Improvements - FAIL Δ (B) Baseline Current σ (B) Δ σ
gcc.FAIL -67.19% 317.000 104.000 - 0.00% -
g++.FAIL -64.71% 34.000 12.000 - 0.00% -
TOTAL.FAIL -63.64% 374.000 136.000 - 0.74% -
libstdc++.FAIL -13.04% 23.000 20.000 - 5.26% -

Performance Improvements - PASS Δ (B) Baseline Current σ (B) Δ σ
libstdc++.PASS 22.78% 13545.000 16631.000 - 0.12% -
gcc.PASS 14.54% 152856.000 175084.000 - 0.01% -
TOTAL.PASS 10.63% 366522.000 405469.000 - 0.02% -
g++.PASS 6.81% 200121.000 213754.000 - 0.02% -

Performance Improvements - UNRESOLVED Δ (B) Baseline Current σ (B) Δ σ
libstdc++.UNRESOLVED -87.50% 16.000 2.000 - 0.00% -
gcc.UNRESOLVED -86.57% 67.000 9.000 - 0.00% -
TOTAL.UNRESOLVED -84.44% 90.000 14.000 - 0.00% -
g++.UNRESOLVED -57.14% 7.000 3.000 - 0.00% -

Performance Improvements - UNSUPPORTED Δ (B) Baseline Current σ (B) Δ σ
g++.UNSUPPORTED -77.25% 11148.000 2536.000 - 0.20% -
TOTAL.UNSUPPORTED -33.62% 20741.000 13768.000 - 0.09% -

Performance Improvements - XPASS Δ (B) Baseline Current σ (B) Δ σ
g++.XPASS -80.00% 10.000 2.000 - 0.00% -
TOTAL.XPASS -50.00% 16.000 8.000 - 0.00% -

Performance Improvements - all Δ (B) Baseline Current σ (B) Δ σ
TOTAL.all 8.23% 389857.000 421925.000 - 0.02% -

Performance Improvements - bad Δ (B) Baseline Current σ (B) Δ σ
gcc.bad -69.85% 388.000 117.000 - 0.00% -
TOTAL.bad -66.88% 480.000 159.000 - 1.27% -
g++.bad -66.67% 51.000 17.000 - 0.00% -
libstdc++.bad -39.02% 41.000 25.000 - 8.70% -

Performance Improvements - fails Δ (B) Baseline Current σ (B) Δ σ
TOTAL.fails -67.08% 480.000 158.000 - 0.64% -

Performance Improvements - good Δ (B) Baseline Current σ (B) Δ σ
libstdc++.good 21.66% 14637.000 17807.000 - 0.11% -
gcc.good 14.68% 162388.000 186234.000 - 0.01% -
TOTAL.good 8.32% 389377.000 421766.000 - 0.02% -
g++.good 2.53% 212352.000 217725.000 - 0.02% -

Added Tests - ERROR
TOTAL.ERROR
g++.ERROR
gcc.ERROR
libstdc++.ERROR

Added Tests - KFAIL
TOTAL.KFAIL
g++.KFAIL
gcc.KFAIL
libstdc++.KFAIL

Added Tests - OTHER
g++.OTHER
gcc.OTHER

Added Tests - UNTESTED
TOTAL.UNTESTED
g++.UNTESTED
gcc.UNTESTED
libstdc++.UNTESTED


Report Time: 0.19s
Name Current %
TOTAL.PASS 405469.000 -
g++.PASS 213754.000 -
gcc.PASS 175084.000 -
libstdc++.PASS 16631.000 -
Geometric Mean 126040.229 -
Name Current %
TOTAL.XPASS 8.000 -
g++.XPASS 2.000 -
gcc.XPASS 4.000 -
libstdc++.XPASS 2.000 -
Geometric Mean 3.364 -
Name Current %
TOTAL.FAIL 136.000 -
g++.FAIL 12.000 -
gcc.FAIL 104.000 -
libstdc++.FAIL 20.000 5.26%
Geometric Mean 42.924 1.48%
Name Current %
TOTAL.XFAIL 2529.000 -
g++.XFAIL 1435.000 -
gcc.XFAIL 958.000 -
libstdc++.XFAIL 136.000 -
Geometric Mean 829.233 -
Name Current %
TOTAL.KFAIL 0.000 -
g++.KFAIL 0.000 -
gcc.KFAIL 0.000 -
libstdc++.KFAIL 0.000 -
Geometric Mean 0.000 -
Name Current %
TOTAL.UNSUPPORTED 13768.000 -
g++.UNSUPPORTED 2536.000 -
gcc.UNSUPPORTED 10192.000 -
libstdc++.UNSUPPORTED 1040.000 -
Geometric Mean 4386.097 -
Name Current %
TOTAL.ERROR 0.000 -
g++.ERROR 0.000 -
gcc.ERROR 0.000 -
libstdc++.ERROR 0.000 -
Geometric Mean 0.000 -
Name Current %
TOTAL.OTHER 1.000 -
g++.OTHER 0.000 -
gcc.OTHER 0.000 -
libstdc++.OTHER 1.000 -
Geometric Mean 0.010 -
Name Current %
TOTAL.good 421766.000 -
g++.good 217725.000 -
gcc.good 186234.000 -
libstdc++.good 17807.000 -
Geometric Mean 132101.394 -
bad
Name Current %
TOTAL.bad 159.000 1.27%
g++.bad 17.000 -
gcc.bad 117.000 -
libstdc++.bad 25.000 8.70%
Geometric Mean 53.027 2.43%
Name Current %
TOTAL.fails 158.000 -
Geometric Mean 158.000 -
Name Current %
TOTAL.flaky 4.000 -
Geometric Mean 4.000 -
all
Name Current %
TOTAL.all 421925.000 -
Geometric Mean 421925.000 -