Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=657f10397eb2fd16c638248d9a9a35490b875741 (+ 25 commits)
git_gcc git+ssh://linaroci@gcc.gnu.org/git/gcc.git (7999eb8672c7a5bb6923b1df75dbf29d60637713) (unchanged)
git_gdb https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=657f10397eb2fd16c638248d9a9a35490b875741 (+ 25 commits)
git_newlib https://sourceware.org/git/?p=newlib-cygwin.git;a=commit;h=4613a9a9799792a53444576de61bd1569f346ffa (+ 3 commits)
git_qemu https://gitlab.com/qemu-project/qemu/commit/4bc8fb0135ac48cd1c8f0698976b7d73c60b7caa (+ 102 commits)
test_url https://ci.linaro.org/job/tcwg_gnu_embed_check_gcc--master-thumb_m33_hard_eabi-build/509/
Filter

master-thumb_m33_hard_eabi test results

Run Order Start Time Duration
Current 0509 (4-changed-components) 2025-07-20T05:52:37 0:00:00
Previous 0594 (basepoints/gcc-16-04081-g966cdec2b23b) 2025-09-24T12:17:16 0:00:00
Baseline 0002 (5-changed-components) 2024-04-16T14:06:34 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 13 13
Performance Improvements 5 17
Added Tests 17 17
Unchanged Tests 730 718
Total Tests 765

Performance Regressions - FAIL Δ Previous Current σ Δ (B) σ (B)
gcc.FAIL 594.62% 130.000 903.000 - 221.35% -
TOTAL.FAIL 140.31% 392.000 942.000 - 167.61% -

Performance Regressions - PASS Δ Previous Current σ Δ (B) σ (B)
g++.PASS -3.40% 224541.000 216917.000 - -2.56% -
gcc.PASS -3.29% 176486.000 170675.000 - 2.78% -
TOTAL.PASS -3.25% 418522.000 404934.000 - 0.08% -

Performance Regressions - UNRESOLVED Δ Previous Current σ Δ (B) σ (B)
TOTAL.UNRESOLVED 20390.48% 21.000 4303.000 - 39018.18% -

Performance Regressions - all Δ Previous Current σ Δ (B) σ (B)
TOTAL.all -2.03% 435663.000 426833.000 - -0.81% -

Performance Regressions - bad Δ Previous Current σ Δ (B) σ (B)
gcc.bad 3902.31% 130.000 5203.000 - 1745.04% -
TOTAL.bad 1150.48% 420.000 5252.000 - 1300.53% -

Performance Regressions - fails Δ Previous Current σ Δ (B) σ (B)
TOTAL.fails 1145.71% 420.000 5232.000 - 1295.20% -

Performance Regressions - good Δ Previous Current σ Δ (B) σ (B)
g++.good -3.33% 228652.000 221030.000 - -6.47% -
TOTAL.good -3.14% 435243.000 421581.000 - -1.94% -
gcc.good -3.13% 187880.000 182005.000 - 3.10% -

Performance Improvements - FAIL Δ Previous Current σ Δ (B) σ (B)
g++.FAIL -91.02% 245.000 22.000 - -58.49% -

Performance Improvements - UNRESOLVED Δ Previous Current σ Δ (B) σ (B)
g++.UNRESOLVED -94.74% 19.000 1.000 - -83.33% -

Performance Improvements - UNSUPPORTED Δ Previous Current σ Δ (B) σ (B)
libstdc++.UNSUPPORTED -1.02% 1078.000 1067.000 - 4.10% -

Performance Improvements - bad Δ Previous Current σ Δ (B) σ (B)
g++.bad -89.59% 269.000 28.000 - -59.42% -

Performance Improvements - flaky Δ Previous Current σ Δ (B) σ (B)
TOTAL.flaky -75.00% 32.000 8.000 - 0.00% -

Added Tests - ERROR
TOTAL.ERROR
g++.ERROR
gcc.ERROR
libstdc++.ERROR

Added Tests - KFAIL
TOTAL.KFAIL
g++.KFAIL
gcc.KFAIL
libstdc++.KFAIL

Added Tests - OTHER
TOTAL.OTHER
g++.OTHER
gcc.OTHER
libstdc++.OTHER

Added Tests - UNTESTED
TOTAL.UNTESTED
g++.UNTESTED
gcc.UNTESTED
libstdc++.UNTESTED

Added Tests - XPASS
gcc.XPASS

Performance Regressions - FAIL Δ (B) Baseline Current σ (B) Δ σ
gcc.FAIL 221.35% 281.000 903.000 - 594.62% -
TOTAL.FAIL 167.61% 352.000 942.000 - 140.31% -

Performance Regressions - PASS Δ (B) Baseline Current σ (B) Δ σ
g++.PASS -2.56% 222609.000 216917.000 - -3.40% -

Performance Regressions - UNRESOLVED Δ (B) Baseline Current σ (B) Δ σ
gcc.UNRESOLVED 429900.00% 1.000 4300.000 - 0.00% -
TOTAL.UNRESOLVED 39018.18% 11.000 4303.000 - 20390.48% -

Performance Regressions - UNSUPPORTED Δ (B) Baseline Current σ (B) Δ σ
gcc.UNSUPPORTED 9.28% 9450.000 10327.000 - -0.62% -
libstdc++.UNSUPPORTED 4.10% 1025.000 1067.000 - -1.02% -

Performance Regressions - XFAIL Δ (B) Baseline Current σ (B) Δ σ
libstdc++.XFAIL 4.58% 131.000 137.000 - -0.72% -

Performance Regressions - bad Δ (B) Baseline Current σ (B) Δ σ
gcc.bad 1745.04% 282.000 5203.000 - 3902.31% -
TOTAL.bad 1300.53% 375.000 5252.000 - 1150.48% -

Performance Regressions - fails Δ (B) Baseline Current σ (B) Δ σ
TOTAL.fails 1295.20% 375.000 5232.000 - 1145.71% -

Performance Regressions - good Δ (B) Baseline Current σ (B) Δ σ
g++.good -6.47% 236316.000 221030.000 - -3.33% -
TOTAL.good -1.94% 429925.000 421581.000 - -3.14% -

Performance Improvements - FAIL Δ (B) Baseline Current σ (B) Δ σ
g++.FAIL -58.49% 53.000 22.000 - -91.02% -
libstdc++.FAIL -5.56% 18.000 17.000 - 0.00% -

Performance Improvements - PASS Δ (B) Baseline Current σ (B) Δ σ
libstdc++.PASS 8.92% 15922.000 17342.000 - -0.87% -
gcc.PASS 2.78% 166065.000 170675.000 - -3.29% -

Performance Improvements - UNRESOLVED Δ (B) Baseline Current σ (B) Δ σ
g++.UNRESOLVED -83.33% 6.000 1.000 - -94.74% -
libstdc++.UNRESOLVED -50.00% 4.000 2.000 - 0.00% -

Performance Improvements - UNSUPPORTED Δ (B) Baseline Current σ (B) Δ σ
g++.UNSUPPORTED -78.35% 11850.000 2565.000 - -0.39% -
TOTAL.UNSUPPORTED -37.47% 22325.000 13959.000 - -0.61% -

Performance Improvements - XFAIL Δ (B) Baseline Current σ (B) Δ σ
g++.XFAIL -16.64% 1857.000 1548.000 - 0.78% -
TOTAL.XFAIL -10.52% 3004.000 2688.000 - 0.41% -
gcc.XFAIL -1.28% 1016.000 1003.000 - 0.00% -

Performance Improvements - XPASS Δ (B) Baseline Current σ (B) Δ σ
g++.XPASS -50.00% 10.000 5.000 - 0.00% -
TOTAL.XPASS -41.67% 12.000 7.000 - 0.00% -

Performance Improvements - bad Δ (B) Baseline Current σ (B) Δ σ
g++.bad -59.42% 69.000 28.000 - -89.59% -
libstdc++.bad -12.50% 24.000 21.000 - 0.00% -

Performance Improvements - good Δ (B) Baseline Current σ (B) Δ σ
libstdc++.good 8.60% 17078.000 18546.000 - -0.88% -
gcc.good 3.10% 176531.000 182005.000 - -3.13% -

Added Tests - ERROR
TOTAL.ERROR
g++.ERROR
gcc.ERROR
libstdc++.ERROR

Added Tests - KFAIL
TOTAL.KFAIL
g++.KFAIL
gcc.KFAIL
libstdc++.KFAIL

Added Tests - OTHER
TOTAL.OTHER
g++.OTHER
gcc.OTHER
libstdc++.OTHER

Added Tests - UNTESTED
TOTAL.UNTESTED
g++.UNTESTED
gcc.UNTESTED
libstdc++.UNTESTED

Added Tests - XPASS
gcc.XPASS


Report Time: 0.19s
Name Current %
TOTAL.PASS 404934.000 -3.25%
g++.PASS 216917.000 -3.40%
gcc.PASS 170675.000 -3.29%
libstdc++.PASS 17342.000 -
Geometric Mean 126980.412 -2.71%
Name Current %
TOTAL.XPASS 7.000 -
g++.XPASS 5.000 -
gcc.XPASS 0.000 -
libstdc++.XPASS 2.000 -
Geometric Mean 0.289 -92.98%
Name Current %
TOTAL.FAIL 942.000 140.31%
g++.FAIL 22.000 -91.02%
gcc.FAIL 903.000 594.62%
libstdc++.FAIL 17.000 -
Geometric Mean 133.553 10.65%
Name Current %
TOTAL.XFAIL 2688.000 -
g++.XFAIL 1548.000 -
gcc.XFAIL 1003.000 -
libstdc++.XFAIL 137.000 -
Geometric Mean 869.572 -
Name Current %
TOTAL.KFAIL 0.000 -
g++.KFAIL 0.000 -
gcc.KFAIL 0.000 -
libstdc++.KFAIL 0.000 -
Geometric Mean 0.000 -
Name Current %
TOTAL.UNSUPPORTED 13959.000 -
g++.UNSUPPORTED 2565.000 -
gcc.UNSUPPORTED 10327.000 -
libstdc++.UNSUPPORTED 1067.000 -1.02%
Geometric Mean 4456.768 -
Name Current %
TOTAL.UNRESOLVED 4303.000 20390.48%
g++.UNRESOLVED 1.000 -94.74%
gcc.UNRESOLVED 4300.000 -
libstdc++.UNRESOLVED 2.000 -
Geometric Mean 77.998 14577.69%
Name Current %
TOTAL.ERROR 0.000 -
g++.ERROR 0.000 -
gcc.ERROR 0.000 -
libstdc++.ERROR 0.000 -
Geometric Mean 0.000 -
Name Current %
TOTAL.OTHER 0.000 -
g++.OTHER 0.000 -
gcc.OTHER 0.000 -
libstdc++.OTHER 0.000 -
Geometric Mean 0.000 -
Name Current %
TOTAL.good 421581.000 -3.14%
g++.good 221030.000 -3.33%
gcc.good 182005.000 -3.13%
libstdc++.good 18546.000 -
Geometric Mean 133173.084 -2.63%
bad
Name Current %
TOTAL.bad 5252.000 1150.48%
g++.bad 28.000 -89.59%
gcc.bad 5203.000 3902.31%
libstdc++.bad 21.000 -
Geometric Mean 356.033 168.66%
Name Current %
TOTAL.fails 5232.000 1145.71%
Geometric Mean 5232.000 1145.71%
Name Current %
TOTAL.flaky 8.000 -75.00%
Geometric Mean 8.000 -75.00%
all
Name Current %
TOTAL.all 426833.000 -2.03%
Geometric Mean 426833.000 -2.03%