Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=0004c4efea88c1244040a4f79cb2b6ecc3e4708b (unchanged)
git_gcc git+ssh://linaroci@gcc.gnu.org/git/gcc.git (38d76a4e6033016b5e2dcaae57df67075a605edd) (+ 9 commits)
git_gdb https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=570f4c0c11910d845c35e94764ded54cb1111583 (unchanged)
git_newlib https://sourceware.org/git/?p=newlib-cygwin.git;a=commit;h=52730a0623a3f6871a9f3ab588b1e1abd795d9a9 (unchanged)
git_qemu https://gitlab.com/qemu-project/qemu/commit/5836af0783213b9355a6bbf85d9e6bc4c9c9363f (unchanged)
test_url https://ci.linaro.org/job/tcwg_gnu_embed_check_gcc--master-arm_eabi-build/1087/
Filter

master-arm_eabi test results

Run Order Start Time Duration
Current 1087 (basepoints/gcc-16-03232-g38d76a4e603) 2025-08-17T16:17:06 0:00:00
Previous 0980 (5-changed-components) 2025-04-07T19:49:55 0:00:00
Baseline 0011 (5-changed-components) 2023-06-05T17:27:31 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 16 7
Performance Improvements 7 24
Added Tests 18 18
Unchanged Tests 904 896
Total Tests 945

Performance Regressions - FAIL Δ Previous Current σ Δ (B) σ (B)
g++.FAIL 216.67% 12.000 38.000 - -79.89% -
TOTAL.FAIL 115.38% 39.000 84.000 - -99.55% -
gcc.FAIL 80.00% 10.000 18.000 - -76.62% -
libstdc++.FAIL 64.71% 17.000 28.000 - -93.91% -

Performance Regressions - UNRESOLVED Δ Previous Current σ Δ (B) σ (B)
g++.UNRESOLVED 33.33% 3.000 4.000 - -97.32% -
TOTAL.UNRESOLVED 16.67% 6.000 7.000 - -99.96% -

Performance Regressions - UNSUPPORTED Δ Previous Current σ Δ (B) σ (B)
libstdc++.UNSUPPORTED 2.50% 1082.000 1109.000 - 69.83% -
g++.UNSUPPORTED 1.74% 2694.000 2741.000 - -75.51% -
TOTAL.UNSUPPORTED 1.24% 14024.000 14198.000 - -32.30% -

Performance Regressions - XPASS Δ Previous Current σ Δ (B) σ (B)
g++.XPASS 150.00% 2.000 5.000 - -50.00% -
TOTAL.XPASS 30.00% 10.000 13.000 - -27.78% -

Performance Regressions - bad Δ Previous Current σ Δ (B) σ (B)
g++.bad 176.47% 17.000 47.000 - -86.49% -
TOTAL.bad 89.09% 55.000 104.000 - -99.72% -
gcc.bad 50.00% 16.000 24.000 - -88.12% -
libstdc++.bad 50.00% 22.000 33.000 - -94.79% -

Performance Regressions - fails Δ Previous Current σ Δ (B) σ (B)
TOTAL.fails 89.09% 55.000 104.000 - -99.70% -

Performance Improvements - PASS Δ Previous Current σ Δ (B) σ (B)
g++.PASS 4.87% 213280.000 223663.000 - 12.68% -
libstdc++.PASS 4.56% 16525.000 17279.000 - 26.73% -
TOTAL.PASS 3.16% 397027.000 409567.000 - 7.12% -

Performance Improvements - all Δ Previous Current σ Δ (B) σ (B)
TOTAL.all 3.09% 413609.000 426373.000 - -3.62% -

Performance Improvements - good Δ Previous Current σ Δ (B) σ (B)
g++.good 4.80% 217400.000 227829.000 - 8.11% -
libstdc++.good 4.41% 17743.000 18525.000 - 29.51% -
TOTAL.good 3.07% 413554.000 426269.000 - 5.17% -

Added Tests - ERROR
TOTAL.ERROR
g++.ERROR
gcc.ERROR
libstdc++.ERROR

Added Tests - KFAIL
TOTAL.KFAIL
g++.KFAIL
gcc.KFAIL
libstdc++.KFAIL

Added Tests - OTHER
TOTAL.OTHER
g++.OTHER
gcc.OTHER
libstdc++.OTHER

Added Tests - UNRESOLVED
gcc.UNRESOLVED

Added Tests - UNTESTED
TOTAL.UNTESTED
g++.UNTESTED
gcc.UNTESTED
libstdc++.UNTESTED

Added Tests - flaky
TOTAL.flaky

Performance Regressions - UNSUPPORTED Δ (B) Baseline Current σ (B) Δ σ
libstdc++.UNSUPPORTED 69.83% 653.000 1109.000 - 2.50% -
gcc.UNSUPPORTED 25.34% 8256.000 10348.000 - 0.98% -

Performance Regressions - XFAIL Δ (B) Baseline Current σ (B) Δ σ
libstdc++.XFAIL 705.88% 17.000 137.000 - 0.74% -
g++.XFAIL 35.07% 1055.000 1425.000 - -0.07% -
TOTAL.XFAIL 24.39% 2013.000 2504.000 - 0.04% -
gcc.XFAIL 2.50% 919.000 942.000 - 0.11% -

Performance Regressions - all Δ (B) Baseline Current σ (B) Δ σ
TOTAL.all -3.62% 442374.000 426373.000 - 3.09% -

Performance Improvements - FAIL Δ (B) Baseline Current σ (B) Δ σ
TOTAL.FAIL -99.55% 18705.000 84.000 - 115.38% -
libstdc++.FAIL -93.91% 460.000 28.000 - 64.71% -
g++.FAIL -79.89% 189.000 38.000 - 216.67% -
gcc.FAIL -76.62% 77.000 18.000 - 80.00% -

Performance Improvements - PASS Δ (B) Baseline Current σ (B) Δ σ
libstdc++.PASS 26.73% 13634.000 17279.000 - 4.56% -
gcc.PASS 13.15% 149024.000 168625.000 - 0.84% -
g++.PASS 12.68% 198496.000 223663.000 - 4.87% -
TOTAL.PASS 7.12% 382336.000 409567.000 - 3.16% -

Performance Improvements - UNRESOLVED Δ (B) Baseline Current σ (B) Δ σ
TOTAL.UNRESOLVED -99.96% 16578.000 7.000 - 16.67% -
libstdc++.UNRESOLVED -98.26% 172.000 3.000 - 0.00% -
g++.UNRESOLVED -97.32% 149.000 4.000 - 33.33% -

Performance Improvements - UNSUPPORTED Δ (B) Baseline Current σ (B) Δ σ
g++.UNSUPPORTED -75.51% 11192.000 2741.000 - 1.74% -
TOTAL.UNSUPPORTED -32.30% 20971.000 14198.000 - 1.24% -

Performance Improvements - XPASS Δ (B) Baseline Current σ (B) Δ σ
g++.XPASS -50.00% 10.000 5.000 - 150.00% -
TOTAL.XPASS -27.78% 18.000 13.000 - 30.00% -

Performance Improvements - bad Δ (B) Baseline Current σ (B) Δ σ
TOTAL.bad -99.72% 37054.000 104.000 - 89.09% -
libstdc++.bad -94.79% 634.000 33.000 - 50.00% -
gcc.bad -88.12% 202.000 24.000 - 50.00% -
g++.bad -86.49% 348.000 47.000 - 176.47% -

Performance Improvements - fails Δ (B) Baseline Current σ (B) Δ σ
TOTAL.fails -99.70% 35217.000 104.000 - 89.09% -

Performance Improvements - good Δ (B) Baseline Current σ (B) Δ σ
libstdc++.good 29.51% 14304.000 18525.000 - 4.41% -
gcc.good 13.73% 158199.000 179915.000 - 0.84% -
g++.good 8.11% 210743.000 227829.000 - 4.80% -
TOTAL.good 5.17% 405320.000 426269.000 - 3.07% -

Added Tests - ERROR
TOTAL.ERROR
g++.ERROR
gcc.ERROR
libstdc++.ERROR

Added Tests - KFAIL
TOTAL.KFAIL
g++.KFAIL
gcc.KFAIL
libstdc++.KFAIL

Added Tests - OTHER
TOTAL.OTHER
g++.OTHER
gcc.OTHER
libstdc++.OTHER

Added Tests - UNRESOLVED
gcc.UNRESOLVED

Added Tests - UNTESTED
TOTAL.UNTESTED
g++.UNTESTED
gcc.UNTESTED
libstdc++.UNTESTED

Added Tests - flaky
TOTAL.flaky


Report Time: 0.22s
Name Current %
TOTAL.PASS 409567.000 3.16%
g++.PASS 223663.000 4.87%
gcc.PASS 168625.000 -
libstdc++.PASS 17279.000 4.56%
Geometric Mean 127817.382 3.34%
Name Current %
TOTAL.XPASS 13.000 30.00%
g++.XPASS 5.000 150.00%
gcc.XPASS 6.000 -
libstdc++.XPASS 2.000 -
Geometric Mean 5.285 34.27%
Name Current %
TOTAL.FAIL 84.000 115.38%
g++.FAIL 38.000 216.67%
gcc.FAIL 18.000 80.00%
libstdc++.FAIL 28.000 64.71%
Geometric Mean 35.614 112.06%
Name Current %
TOTAL.XFAIL 2504.000 -
g++.XFAIL 1425.000 -
gcc.XFAIL 942.000 -
libstdc++.XFAIL 137.000 -
Geometric Mean 823.769 -
Name Current %
TOTAL.KFAIL 0.000 -
g++.KFAIL 0.000 -
gcc.KFAIL 0.000 -
libstdc++.KFAIL 0.000 -
Geometric Mean 0.000 -
Name Current %
TOTAL.UNSUPPORTED 14198.000 1.24%
g++.UNSUPPORTED 2741.000 1.74%
gcc.UNSUPPORTED 10348.000 -
libstdc++.UNSUPPORTED 1109.000 2.50%
Geometric Mean 4597.069 1.61%
Name Current %
TOTAL.UNRESOLVED 7.000 16.67%
g++.UNRESOLVED 4.000 33.33%
gcc.UNRESOLVED 0.000 -
libstdc++.UNRESOLVED 3.000 -
Geometric Mean 0.303 -91.99%
Name Current %
TOTAL.ERROR 0.000 -
g++.ERROR 0.000 -
gcc.ERROR 0.000 -
libstdc++.ERROR 0.000 -
Geometric Mean 0.000 -
Name Current %
TOTAL.OTHER 0.000 -
g++.OTHER 0.000 -
gcc.OTHER 0.000 -
libstdc++.OTHER 0.000 -
Geometric Mean 0.000 -
Name Current %
TOTAL.good 426269.000 3.07%
g++.good 227829.000 4.80%
gcc.good 179915.000 -
libstdc++.good 18525.000 4.41%
Geometric Mean 134131.131 3.27%
bad
Name Current %
TOTAL.bad 104.000 89.09%
g++.bad 47.000 176.47%
gcc.bad 24.000 50.00%
libstdc++.bad 33.000 50.00%
Geometric Mean 44.357 85.19%
Name Current %
TOTAL.fails 104.000 89.09%
Geometric Mean 104.000 89.09%
Name Current %
TOTAL.flaky 0.000 -
Geometric Mean 0.000 -
all
Name Current %
TOTAL.all 426373.000 3.09%
Geometric Mean 426373.000 3.09%