Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=86a53c0b2ead2d0da2a6bf91741c705df6b97f76 (+ 183 commits)
git_gcc https://gcc.gnu.org/git/gcc.git (f0ff7539626e25341c1b450b537e69f86e0bd1f6) (+ 116 commits)
git_gdb https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=86a53c0b2ead2d0da2a6bf91741c705df6b97f76 (+ 183 commits)
git_newlib https://sourceware.org/git/?p=newlib-cygwin.git;a=commit;h=a3863bfeb73f3c3832038685498c7c4148a06890 (+ 11 commits)
git_qemu https://gitlab.com/qemu-project/qemu/commit/98c7362b1efe651327385a25874a73e008c6549e (+ 390 commits)
test_url https://ci.linaro.org/job/tcwg_gnu_embed_check_gcc--master-thumb_m55_hard_eabi-build/787/
Filter

master-thumb_m55_hard_eabi test results

Run Order Start Time Duration
Current 0787 (5-changed-components) 2025-03-05T01:11:08 0:00:00
Previous 0788 (5-changed-components) 2025-03-08T04:20:53 0:00:00
Baseline 0004 (5-changed-components) 2023-08-02T19:43:22 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 7 6
Performance Improvements 0 26
Added Tests 15 15
Unchanged Tests 743 718
Total Tests 765

Performance Regressions - FAIL Δ Previous Current σ Δ (B) σ (B)
g++.FAIL 200.00% 9.000 27.000 - -20.59% -
TOTAL.FAIL 16.54% 133.000 155.000 - -58.56% -
gcc.FAIL 3.81% 105.000 109.000 - -65.62% -

Performance Regressions - bad Δ Previous Current σ Δ (B) σ (B)
g++.bad 128.57% 14.000 32.000 - -37.25% -
TOTAL.bad 14.01% 157.000 179.000 - -62.71% -
gcc.bad 3.33% 120.000 124.000 - -68.04% -

Performance Regressions - fails Δ Previous Current σ Δ (B) σ (B)
TOTAL.fails 14.10% 156.000 178.000 - -62.92% -

Added Tests - ERROR
TOTAL.ERROR
g++.ERROR
gcc.ERROR
libstdc++.ERROR

Added Tests - KFAIL
TOTAL.KFAIL
g++.KFAIL
gcc.KFAIL
libstdc++.KFAIL

Added Tests - OTHER
g++.OTHER
libstdc++.OTHER

Added Tests - UNTESTED
TOTAL.UNTESTED
g++.UNTESTED
gcc.UNTESTED
libstdc++.UNTESTED

Added Tests - flaky
TOTAL.flaky

Performance Regressions - UNSUPPORTED Δ (B) Baseline Current σ (B) Δ σ
gcc.UNSUPPORTED 18.58% 8612.000 10212.000 - -0.01% -
libstdc++.UNSUPPORTED 5.81% 981.000 1038.000 - 0.00% -

Performance Regressions - XFAIL Δ (B) Baseline Current σ (B) Δ σ
g++.XFAIL 32.87% 1083.000 1439.000 - 0.70% -
libstdc++.XFAIL 22.52% 111.000 136.000 - 0.00% -
TOTAL.XFAIL 20.01% 2114.000 2537.000 - 0.55% -
gcc.XFAIL 4.57% 920.000 962.000 - 0.42% -

Performance Improvements - FAIL Δ (B) Baseline Current σ (B) Δ σ
gcc.FAIL -65.62% 317.000 109.000 - 3.81% -
TOTAL.FAIL -58.56% 374.000 155.000 - 16.54% -
g++.FAIL -20.59% 34.000 27.000 - 200.00% -
libstdc++.FAIL -17.39% 23.000 19.000 - 0.00% -

Performance Improvements - PASS Δ (B) Baseline Current σ (B) Δ σ
libstdc++.PASS 21.03% 13545.000 16394.000 - -0.08% -
gcc.PASS 14.28% 152856.000 174681.000 - -0.01% -
TOTAL.PASS 10.11% 366522.000 403592.000 - 0.00% -
g++.PASS 6.19% 200121.000 212517.000 - 0.02% -

Performance Improvements - UNRESOLVED Δ (B) Baseline Current σ (B) Δ σ
libstdc++.UNRESOLVED -87.50% 16.000 2.000 - 0.00% -
gcc.UNRESOLVED -85.07% 67.000 10.000 - 0.00% -
TOTAL.UNRESOLVED -83.33% 90.000 15.000 - 0.00% -
g++.UNRESOLVED -57.14% 7.000 3.000 - 0.00% -

Performance Improvements - UNSUPPORTED Δ (B) Baseline Current σ (B) Δ σ
g++.UNSUPPORTED -77.47% 11148.000 2512.000 - 0.00% -
TOTAL.UNSUPPORTED -33.65% 20741.000 13762.000 - -0.01% -

Performance Improvements - XPASS Δ (B) Baseline Current σ (B) Δ σ
g++.XPASS -80.00% 10.000 2.000 - 0.00% -
TOTAL.XPASS -50.00% 16.000 8.000 - 0.00% -

Performance Improvements - all Δ (B) Baseline Current σ (B) Δ σ
TOTAL.all 7.75% 389857.000 420070.000 - 0.01% -

Performance Improvements - bad Δ (B) Baseline Current σ (B) Δ σ
gcc.bad -68.04% 388.000 124.000 - 3.33% -
TOTAL.bad -62.71% 480.000 179.000 - 14.01% -
libstdc++.bad -43.90% 41.000 23.000 - 0.00% -
g++.bad -37.25% 51.000 32.000 - 128.57% -

Performance Improvements - fails Δ (B) Baseline Current σ (B) Δ σ
TOTAL.fails -62.92% 480.000 178.000 - 14.10% -

Performance Improvements - good Δ (B) Baseline Current σ (B) Δ σ
libstdc++.good 20.02% 14637.000 17568.000 - -0.07% -
gcc.good 14.45% 162388.000 185855.000 - -0.01% -
TOTAL.good 7.84% 389377.000 419891.000 - 0.00% -
g++.good 1.94% 212352.000 216468.000 - 0.02% -

Added Tests - ERROR
TOTAL.ERROR
g++.ERROR
gcc.ERROR
libstdc++.ERROR

Added Tests - KFAIL
TOTAL.KFAIL
g++.KFAIL
gcc.KFAIL
libstdc++.KFAIL

Added Tests - OTHER
g++.OTHER
libstdc++.OTHER

Added Tests - UNTESTED
TOTAL.UNTESTED
g++.UNTESTED
gcc.UNTESTED
libstdc++.UNTESTED

Added Tests - flaky
TOTAL.flaky


Report Time: 0.21s
Name Current %
TOTAL.PASS 403592.000 -
g++.PASS 212517.000 -
gcc.PASS 174681.000 -
libstdc++.PASS 16394.000 -
Geometric Mean 125189.155 -
Name Current %
TOTAL.XPASS 8.000 -
g++.XPASS 2.000 -
gcc.XPASS 4.000 -
libstdc++.XPASS 2.000 -
Geometric Mean 3.364 -
Name Current %
TOTAL.FAIL 155.000 16.54%
g++.FAIL 27.000 200.00%
gcc.FAIL 109.000 3.81%
libstdc++.FAIL 19.000 -
Geometric Mean 54.259 38.03%
Name Current %
TOTAL.XFAIL 2537.000 -
g++.XFAIL 1439.000 -
gcc.XFAIL 962.000 -
libstdc++.XFAIL 136.000 -
Geometric Mean 831.331 -
Name Current %
TOTAL.KFAIL 0.000 -
g++.KFAIL 0.000 -
gcc.KFAIL 0.000 -
libstdc++.KFAIL 0.000 -
Geometric Mean 0.000 -
Name Current %
TOTAL.UNSUPPORTED 13762.000 -
g++.UNSUPPORTED 2512.000 -
gcc.UNSUPPORTED 10212.000 -
libstdc++.UNSUPPORTED 1038.000 -
Geometric Mean 4375.245 -
Name Current %
TOTAL.ERROR 0.000 -
g++.ERROR 0.000 -
gcc.ERROR 0.000 -
libstdc++.ERROR 0.000 -
Geometric Mean 0.000 -
Name Current %
TOTAL.OTHER 1.000 -
g++.OTHER 0.000 -
gcc.OTHER 1.000 -
libstdc++.OTHER 0.000 -
Geometric Mean 0.010 -99.01%
Name Current %
TOTAL.good 419891.000 -
g++.good 216468.000 -
gcc.good 185855.000 -
libstdc++.good 17568.000 -
Geometric Mean 131252.236 -
bad
Name Current %
TOTAL.bad 179.000 14.01%
g++.bad 32.000 128.57%
gcc.bad 124.000 3.33%
libstdc++.bad 23.000 -
Geometric Mean 63.575 28.10%
Name Current %
TOTAL.fails 178.000 14.10%
Geometric Mean 178.000 14.10%
Name Current %
TOTAL.flaky 0.000 -
Geometric Mean 0.000 -
all
Name Current %
TOTAL.all 420070.000 -
Geometric Mean 420070.000 -