Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=e3f5898021ba21d9ad855b325cef92019a17b04d (unchanged)
git_gcc https://github.com/gcc-mirror/gcc/commit/f93a612fc4567652b75ffc916d31a446378e6613 (+ 69 commits)
git_gdb https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=e3f5898021ba21d9ad855b325cef92019a17b04d (unchanged)
git_newlib https://sourceware.org/git/?p=newlib-cygwin.git;a=commit;h=2e7332d6bd0219da491e899e0c3cee335ec8c9ab (unchanged)
git_qemu https://gitlab.com/qemu-project/qemu/commit/0450cf08976f9036feaded438031b4cba94f6452 (unchanged)
test_url https://ci.linaro.org/job/tcwg_gnu_embed_check_gcc--master-thumb_m55_hard_eabi-build/96/
View Options
Report
Filter

master-thumb_m55_hard_eabi test results

Run Order Start Time Duration
Current 0096 (basepoints/gcc-14-03164-gf93a612fc456) 2023-08-10T09:22:09 0:00:00
Previous 0004 (5-changed-components) 2023-08-02T19:43:22 0:00:00
No Baseline Run

Tests Summary

Status Group #
Performance Regressions 14
Performance Improvements 2
Added Tests 16
Unchanged Tests 733
Total Tests 765

Run-Over-Run Changes Detail

Performance Regressions - FAIL Δ Previous Current σ
g++.FAIL 23.53% 34.000 42.000 -
gcc.FAIL 16.40% 317.000 369.000 -
TOTAL.FAIL 16.31% 374.000 435.000 -
libstdc++.FAIL 4.35% 23.000 24.000 -

Performance Regressions - UNRESOLVED Δ Previous Current σ
gcc.UNRESOLVED 20.90% 67.000 81.000 -
TOTAL.UNRESOLVED 15.56% 90.000 104.000 -

Performance Regressions - XFAIL Δ Previous Current σ
gcc.XFAIL 1.09% 920.000 930.000 -

Performance Regressions - XPASS Δ Previous Current σ
gcc.XPASS 25.00% 4.000 5.000 -
TOTAL.XPASS 6.25% 16.000 17.000 -

Performance Regressions - bad Δ Previous Current σ
gcc.bad 17.27% 388.000 455.000 -
TOTAL.bad 15.83% 480.000 556.000 -
g++.bad 15.69% 51.000 59.000 -
libstdc++.bad 2.44% 41.000 42.000 -

Performance Regressions - fails Δ Previous Current σ
TOTAL.fails 15.62% 480.000 555.000 -

Performance Improvements - UNSUPPORTED Δ Previous Current σ
gcc.UNSUPPORTED -2.96% 8612.000 8357.000 -
TOTAL.UNSUPPORTED -1.12% 20741.000 20508.000 -

Added Tests - ERROR
TOTAL.ERROR
g++.ERROR
gcc.ERROR
libstdc++.ERROR

Added Tests - KFAIL
TOTAL.KFAIL
g++.KFAIL
gcc.KFAIL
libstdc++.KFAIL

Added Tests - OTHER
TOTAL.OTHER
g++.OTHER
gcc.OTHER
libstdc++.OTHER

Added Tests - UNTESTED
TOTAL.UNTESTED
g++.UNTESTED
gcc.UNTESTED
libstdc++.UNTESTED

Report Time: 0.18s
PASS
Name Current %
TOTAL.PASS 367202.000 -
g++.PASS 200108.000 -
gcc.PASS 153548.000 -
libstdc++.PASS 13546.000 -
Geometric Mean 111187.555 -
XPASS
Name Current %
TOTAL.XPASS 17.000 6.25%
g++.XPASS 10.000 -
gcc.XPASS 5.000 25.00%
libstdc++.XPASS 2.000 -
Geometric Mean 6.421 7.35%
FAIL
Name Current %
TOTAL.FAIL 435.000 16.31%
g++.FAIL 42.000 23.53%
gcc.FAIL 369.000 16.40%
libstdc++.FAIL 24.000 4.35%
Geometric Mean 112.783 14.94%
XFAIL
Name Current %
TOTAL.XFAIL 2116.000 -
g++.XFAIL 1075.000 -
gcc.XFAIL 930.000 1.09%
libstdc++.XFAIL 111.000 -
Geometric Mean 696.118 -
KFAIL
Name Current %
TOTAL.KFAIL 0.000 -
g++.KFAIL 0.000 -
gcc.KFAIL 0.000 -
libstdc++.KFAIL 0.000 -
Geometric Mean 0.000 -
UNSUPPORTED
Name Current %
TOTAL.UNSUPPORTED 20508.000 -1.12%
g++.UNSUPPORTED 11170.000 -
gcc.UNSUPPORTED 8357.000 -2.96%
libstdc++.UNSUPPORTED 981.000 -
Geometric Mean 6583.002 -
UNRESOLVED
Name Current %
TOTAL.UNRESOLVED 104.000 15.56%
g++.UNRESOLVED 7.000 -
gcc.UNRESOLVED 81.000 20.90%
libstdc++.UNRESOLVED 16.000 -
Geometric Mean 31.166 8.72%
ERROR
Name Current %
TOTAL.ERROR 0.000 -
g++.ERROR 0.000 -
gcc.ERROR 0.000 -
libstdc++.ERROR 0.000 -
Geometric Mean 0.000 -
OTHER
Name Current %
TOTAL.OTHER 0.000 -
g++.OTHER 0.000 -
gcc.OTHER 0.000 -
libstdc++.OTHER 0.000 -
Geometric Mean 0.000 -
good
Name Current %
TOTAL.good 389826.000 -
g++.good 212353.000 -
gcc.good 162835.000 -
libstdc++.good 14638.000 -
Geometric Mean 118519.463 -
bad
Name Current %
TOTAL.bad 556.000 15.83%
g++.bad 59.000 15.69%
gcc.bad 455.000 17.27%
libstdc++.bad 42.000 2.44%
Geometric Mean 158.233 12.64%
fails
Name Current %
TOTAL.fails 555.000 15.62%
Geometric Mean 555.000 15.62%
flaky
Name Current %
TOTAL.flaky 215.000 -
Geometric Mean 215.000 -
all
Name Current %
TOTAL.all 390382.000 -
Geometric Mean 390382.000 -