Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=e02e2c75154a0c8cf2800c4676934b708b89b2f7 (+ 10 commits)
git_gcc git+ssh://linaroci@gcc.gnu.org/git/gcc.git (b0419798447ae25de2f58d1a695db6dadb5d8547) (+ 35 commits)
git_gdb https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=e02e2c75154a0c8cf2800c4676934b708b89b2f7 (+ 10 commits)
git_newlib https://sourceware.org/git/?p=newlib-cygwin.git;a=commit;h=f4ba145056dbe99adf4dbe632bec035e006539f8 (+ 4 commits)
git_qemu https://gitlab.com/qemu-project/qemu/commit/43ba160cb4bbb193560eb0d2d7decc4b5fc599fe (+ 25 commits)
test_url https://ci.linaro.org/job/tcwg_gnu_embed_check_gcc--master-thumb_m33_hard_eabi-build/485/
Filter

master-thumb_m33_hard_eabi test results

Run Order Start Time Duration
Current 0485 (5-changed-components) 2025-06-19T20:49:58 0:00:00
Previous 0541 (basepoints/gcc-16-03223-gcdd015c4ddbb) 2025-08-19T03:23:02 0:00:00
Baseline 0002 (5-changed-components) 2024-04-16T14:06:34 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 16 14
Performance Improvements 3 17
Added Tests 17 17
Unchanged Tests 729 717
Total Tests 765

Performance Regressions - FAIL Δ Previous Current σ Δ (B) σ (B)
gcc.FAIL 579.55% 132.000 897.000 - 219.22% -
TOTAL.FAIL 376.80% 194.000 925.000 - 162.78% -

Performance Regressions - PASS Δ Previous Current σ Δ (B) σ (B)
g++.PASS -3.80% 223714.000 215209.000 - -3.32% -
TOTAL.PASS -3.49% 417064.000 402513.000 - -0.51% -
gcc.PASS -3.17% 175952.000 170378.000 - 2.60% -
libstdc++.PASS -2.71% 17398.000 16926.000 - 6.31% -

Performance Regressions - UNRESOLVED Δ Previous Current σ Δ (B) σ (B)
TOTAL.UNRESOLVED 61371.43% 7.000 4303.000 - 39018.18% -

Performance Regressions - XFAIL Δ Previous Current σ Δ (B) σ (B)
g++.XFAIL 1.37% 1530.000 1551.000 - -16.48% -

Performance Regressions - all Δ Previous Current σ Δ (B) σ (B)
TOTAL.all -2.21% 433951.000 424359.000 - -1.38% -

Performance Regressions - bad Δ Previous Current σ Δ (B) σ (B)
gcc.bad 3837.12% 132.000 5197.000 - 1742.91% -
TOTAL.bad 2416.83% 208.000 5235.000 - 1296.00% -

Performance Regressions - fails Δ Previous Current σ Δ (B) σ (B)
TOTAL.fails 2407.21% 208.000 5215.000 - 1290.67% -

Performance Regressions - good Δ Previous Current σ Δ (B) σ (B)
g++.good -3.73% 227813.000 219320.000 - -7.19% -
TOTAL.good -3.37% 433743.000 419124.000 - -2.51% -
gcc.good -3.02% 187328.000 181678.000 - 2.92% -
libstdc++.good -2.56% 18602.000 18126.000 - 6.14% -

Performance Improvements - FAIL Δ Previous Current σ Δ (B) σ (B)
g++.FAIL -75.56% 45.000 11.000 - -79.25% -

Performance Improvements - UNRESOLVED Δ Previous Current σ Δ (B) σ (B)
g++.UNRESOLVED -80.00% 5.000 1.000 - -83.33% -

Performance Improvements - bad Δ Previous Current σ Δ (B) σ (B)
g++.bad -69.09% 55.000 17.000 - -75.36% -

Added Tests - ERROR
TOTAL.ERROR
g++.ERROR
gcc.ERROR
libstdc++.ERROR

Added Tests - KFAIL
TOTAL.KFAIL
g++.KFAIL
gcc.KFAIL
libstdc++.KFAIL

Added Tests - OTHER
TOTAL.OTHER
g++.OTHER
gcc.OTHER
libstdc++.OTHER

Added Tests - UNTESTED
TOTAL.UNTESTED
g++.UNTESTED
gcc.UNTESTED
libstdc++.UNTESTED

Added Tests - XPASS
gcc.XPASS

Performance Regressions - FAIL Δ (B) Baseline Current σ (B) Δ σ
gcc.FAIL 219.22% 281.000 897.000 - 579.55% -
TOTAL.FAIL 162.78% 352.000 925.000 - 376.80% -

Performance Regressions - PASS Δ (B) Baseline Current σ (B) Δ σ
g++.PASS -3.32% 222609.000 215209.000 - -3.80% -

Performance Regressions - UNRESOLVED Δ (B) Baseline Current σ (B) Δ σ
gcc.UNRESOLVED 429900.00% 1.000 4300.000 - 0.00% -
TOTAL.UNRESOLVED 39018.18% 11.000 4303.000 - 61371.43% -

Performance Regressions - UNSUPPORTED Δ (B) Baseline Current σ (B) Δ σ
gcc.UNSUPPORTED 8.96% 9450.000 10297.000 - -0.74% -
libstdc++.UNSUPPORTED 3.80% 1025.000 1064.000 - -0.28% -

Performance Regressions - XFAIL Δ (B) Baseline Current σ (B) Δ σ
libstdc++.XFAIL 3.82% 131.000 136.000 - -0.73% -

Performance Regressions - all Δ (B) Baseline Current σ (B) Δ σ
TOTAL.all -1.38% 430300.000 424359.000 - -2.21% -

Performance Regressions - bad Δ (B) Baseline Current σ (B) Δ σ
gcc.bad 1742.91% 282.000 5197.000 - 3837.12% -
TOTAL.bad 1296.00% 375.000 5235.000 - 2416.83% -

Performance Regressions - fails Δ (B) Baseline Current σ (B) Δ σ
TOTAL.fails 1290.67% 375.000 5215.000 - 2407.21% -

Performance Regressions - good Δ (B) Baseline Current σ (B) Δ σ
g++.good -7.19% 236316.000 219320.000 - -3.73% -
TOTAL.good -2.51% 429925.000 419124.000 - -3.37% -

Performance Improvements - FAIL Δ (B) Baseline Current σ (B) Δ σ
g++.FAIL -79.25% 53.000 11.000 - -75.56% -
libstdc++.FAIL -5.56% 18.000 17.000 - 0.00% -

Performance Improvements - PASS Δ (B) Baseline Current σ (B) Δ σ
libstdc++.PASS 6.31% 15922.000 16926.000 - -2.71% -
gcc.PASS 2.60% 166065.000 170378.000 - -3.17% -

Performance Improvements - UNRESOLVED Δ (B) Baseline Current σ (B) Δ σ
g++.UNRESOLVED -83.33% 6.000 1.000 - -80.00% -
libstdc++.UNRESOLVED -50.00% 4.000 2.000 - 0.00% -

Performance Improvements - UNSUPPORTED Δ (B) Baseline Current σ (B) Δ σ
g++.UNSUPPORTED -78.40% 11850.000 2560.000 - -0.35% -
TOTAL.UNSUPPORTED -37.64% 22325.000 13921.000 - -0.64% -

Performance Improvements - XFAIL Δ (B) Baseline Current σ (B) Δ σ
g++.XFAIL -16.48% 1857.000 1551.000 - 1.37% -
TOTAL.XFAIL -10.45% 3004.000 2690.000 - 0.79% -
gcc.XFAIL -1.28% 1016.000 1003.000 - 0.10% -

Performance Improvements - XPASS Δ (B) Baseline Current σ (B) Δ σ
g++.XPASS -50.00% 10.000 5.000 - 0.00% -
TOTAL.XPASS -41.67% 12.000 7.000 - 0.00% -

Performance Improvements - bad Δ (B) Baseline Current σ (B) Δ σ
g++.bad -75.36% 69.000 17.000 - -69.09% -
libstdc++.bad -12.50% 24.000 21.000 - 0.00% -

Performance Improvements - good Δ (B) Baseline Current σ (B) Δ σ
libstdc++.good 6.14% 17078.000 18126.000 - -2.56% -
gcc.good 2.92% 176531.000 181678.000 - -3.02% -

Added Tests - ERROR
TOTAL.ERROR
g++.ERROR
gcc.ERROR
libstdc++.ERROR

Added Tests - KFAIL
TOTAL.KFAIL
g++.KFAIL
gcc.KFAIL
libstdc++.KFAIL

Added Tests - OTHER
TOTAL.OTHER
g++.OTHER
gcc.OTHER
libstdc++.OTHER

Added Tests - UNTESTED
TOTAL.UNTESTED
g++.UNTESTED
gcc.UNTESTED
libstdc++.UNTESTED

Added Tests - XPASS
gcc.XPASS


Report Time: 0.23s
Name Current %
TOTAL.PASS 402513.000 -3.49%
g++.PASS 215209.000 -3.80%
gcc.PASS 170378.000 -3.17%
libstdc++.PASS 16926.000 -2.71%
Geometric Mean 125719.327 -3.29%
Name Current %
TOTAL.XPASS 7.000 -
g++.XPASS 5.000 -
gcc.XPASS 0.000 -
libstdc++.XPASS 2.000 -
Geometric Mean 0.289 -92.98%
Name Current %
TOTAL.FAIL 925.000 376.80%
g++.FAIL 11.000 -75.56%
gcc.FAIL 897.000 579.55%
libstdc++.FAIL 17.000 -
Geometric Mean 111.608 67.76%
Name Current %
TOTAL.XFAIL 2690.000 -
g++.XFAIL 1551.000 1.37%
gcc.XFAIL 1003.000 -
libstdc++.XFAIL 136.000 -
Geometric Mean 868.562 -
Name Current %
TOTAL.KFAIL 0.000 -
g++.KFAIL 0.000 -
gcc.KFAIL 0.000 -
libstdc++.KFAIL 0.000 -
Geometric Mean 0.000 -
Name Current %
TOTAL.UNSUPPORTED 13921.000 -
g++.UNSUPPORTED 2560.000 -
gcc.UNSUPPORTED 10297.000 -
libstdc++.UNSUPPORTED 1064.000 -
Geometric Mean 4445.194 -
Name Current %
TOTAL.UNRESOLVED 4303.000 61371.43%
g++.UNRESOLVED 1.000 -80.00%
gcc.UNRESOLVED 4300.000 -
libstdc++.UNRESOLVED 2.000 -
Geometric Mean 77.998 26874.27%
Name Current %
TOTAL.ERROR 0.000 -
g++.ERROR 0.000 -
gcc.ERROR 0.000 -
libstdc++.ERROR 0.000 -
Geometric Mean 0.000 -
Name Current %
TOTAL.OTHER 0.000 -
g++.OTHER 0.000 -
gcc.OTHER 0.000 -
libstdc++.OTHER 0.000 -
Geometric Mean 0.000 -
Name Current %
TOTAL.good 419124.000 -3.37%
g++.good 219320.000 -3.73%
gcc.good 181678.000 -3.02%
libstdc++.good 18126.000 -2.56%
Geometric Mean 131903.485 -3.17%
bad
Name Current %
TOTAL.bad 5235.000 2416.83%
g++.bad 17.000 -69.09%
gcc.bad 5197.000 3837.12%
libstdc++.bad 21.000 -
Geometric Mean 313.932 318.34%
Name Current %
TOTAL.fails 5215.000 2407.21%
Geometric Mean 5215.000 2407.21%
Name Current %
TOTAL.flaky 8.000 -
Geometric Mean 8.000 -
all
Name Current %
TOTAL.all 424359.000 -2.21%
Geometric Mean 424359.000 -2.21%