Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=07a88d7f2121630956997bc5edd495af40d4494f (unchanged)
git_gcc https://github.com/gcc-mirror/gcc/commit/0e466e978c728697f18c67c4eace9ba4633f9ef5 (+ 1 commits)
git_gdb https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=07a88d7f2121630956997bc5edd495af40d4494f (unchanged)
git_newlib https://sourceware.org/git/?p=newlib-cygwin.git;a=commit;h=6b2ae32ecdfdb8ca1337e19fac3b6e0a4079e769 (unchanged)
git_qemu https://gitlab.com/qemu-project/qemu/commit/67fe6ae41da64368bc4936b196fee2bf61f8c720 (unchanged)
test_url https://ci.linaro.org/job/tcwg_gnu_embed_check_gcc--master-arm_eabi-build/110/
Filter

master-arm_eabi test results

Run Order Start Time Duration
Current 0110 (basepoints/gcc-14-02029-g0e466e978c7) 2023-06-21T14:10:17 0:00:00
Previous 0095 (3-changed-components) 2023-06-18T23:41:09 0:00:00
Baseline 0011 (5-changed-components) 2023-06-05T17:27:31 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 0 25
Performance Improvements 0 2
Added Tests 16 16
Unchanged Tests 929 902
Total Tests 945

Added Tests - ERROR
g++.ERROR
libstdc++.ERROR

Added Tests - KFAIL
TOTAL.KFAIL
g++.KFAIL
gcc.KFAIL
libstdc++.KFAIL

Added Tests - OTHER
TOTAL.OTHER
g++.OTHER
gcc.OTHER
libstdc++.OTHER

Added Tests - UNTESTED
TOTAL.UNTESTED
g++.UNTESTED
gcc.UNTESTED
libstdc++.UNTESTED

Added Tests - XPASS
libstdc++.XPASS

Added Tests - flaky
TOTAL.flaky

Performance Regressions - FAIL Δ (B) Baseline Current σ (B) Δ σ
gcc.FAIL 27300.00% 77.000 21098.000 - 0.03% -
g++.FAIL 5874.60% 189.000 11292.000 - 0.00% -
libstdc++.FAIL 801.74% 460.000 4148.000 - 0.00% -
TOTAL.FAIL 95.34% 18705.000 36538.000 - 0.02% -

Performance Regressions - PASS Δ (B) Baseline Current σ (B) Δ σ
libstdc++.PASS -65.93% 13634.000 4645.000 - 0.00% -
gcc.PASS -28.96% 149024.000 105861.000 - 0.14% -
TOTAL.PASS -24.71% 382336.000 287865.000 - 0.07% -
g++.PASS -10.65% 198496.000 177359.000 - 0.04% -

Performance Regressions - UNRESOLVED Δ (B) Baseline Current σ (B) Δ σ
gcc.UNRESOLVED 16234.75% 118.000 19275.000 - 0.00% -
g++.UNRESOLVED 6580.54% 149.000 9954.000 - 0.00% -
libstdc++.UNRESOLVED 2284.88% 172.000 4102.000 - 0.00% -
TOTAL.UNRESOLVED 101.06% 16578.000 33331.000 - 0.00% -

Performance Regressions - UNSUPPORTED Δ (B) Baseline Current σ (B) Δ σ
libstdc++.UNSUPPORTED 70.44% 653.000 1113.000 - 0.00% -
gcc.UNSUPPORTED 4.99% 8256.000 8668.000 - 0.02% -

Performance Regressions - XPASS Δ (B) Baseline Current σ (B) Δ σ
gcc.XPASS 33.33% 6.000 8.000 - 0.00% -

Performance Regressions - all Δ (B) Baseline Current σ (B) Δ σ
TOTAL.all -13.93% 442374.000 380757.000 - 0.06% -

Performance Regressions - bad Δ (B) Baseline Current σ (B) Δ σ
gcc.bad 19891.09% 202.000 40382.000 - 0.02% -
g++.bad 6008.05% 348.000 21256.000 - 0.00% -
libstdc++.bad 1201.26% 634.000 8250.000 - 0.00% -
TOTAL.bad 88.61% 37054.000 69888.000 - 0.01% -

Performance Regressions - fails Δ (B) Baseline Current σ (B) Δ σ
TOTAL.fails 98.21% 35217.000 69803.000 - 0.01% -

Performance Regressions - good Δ (B) Baseline Current σ (B) Δ σ
libstdc++.good -59.70% 14304.000 5764.000 - 0.00% -
gcc.good -27.02% 158199.000 115446.000 - 0.13% -
TOTAL.good -23.30% 405320.000 310869.000 - 0.07% -
g++.good -10.00% 210743.000 189659.000 - 0.03% -

Performance Improvements - XFAIL Δ (B) Baseline Current σ (B) Δ σ
libstdc++.XFAIL -64.71% 17.000 6.000 - 0.00% -
TOTAL.XFAIL -1.74% 2013.000 1978.000 - 0.00% -

Added Tests - ERROR
g++.ERROR
libstdc++.ERROR

Added Tests - KFAIL
TOTAL.KFAIL
g++.KFAIL
gcc.KFAIL
libstdc++.KFAIL

Added Tests - OTHER
TOTAL.OTHER
g++.OTHER
gcc.OTHER
libstdc++.OTHER

Added Tests - UNTESTED
TOTAL.UNTESTED
g++.UNTESTED
gcc.UNTESTED
libstdc++.UNTESTED

Added Tests - XPASS
libstdc++.XPASS

Added Tests - flaky
TOTAL.flaky


Report Time: 0.20s
Name Current %
TOTAL.PASS 287865.000 -
g++.PASS 177359.000 -
gcc.PASS 105861.000 -
libstdc++.PASS 4645.000 -
Geometric Mean 70784.954 -
Name Current %
TOTAL.XPASS 18.000 -
g++.XPASS 10.000 -
gcc.XPASS 8.000 -
libstdc++.XPASS 0.000 -
Geometric Mean 0.616 -94.55%
Name Current %
TOTAL.FAIL 36538.000 -
g++.FAIL 11292.000 -
gcc.FAIL 21098.000 -
libstdc++.FAIL 4148.000 -
Geometric Mean 13784.751 -
Name Current %
TOTAL.XFAIL 1978.000 -
g++.XFAIL 1055.000 -
gcc.XFAIL 917.000 -
libstdc++.XFAIL 6.000 -
Geometric Mean 327.342 -
Name Current %
TOTAL.KFAIL 0.000 -
g++.KFAIL 0.000 -
gcc.KFAIL 0.000 -
libstdc++.KFAIL 0.000 -
Geometric Mean 0.000 -
Name Current %
TOTAL.UNSUPPORTED 21026.000 -
g++.UNSUPPORTED 11245.000 -
gcc.UNSUPPORTED 8668.000 -
libstdc++.UNSUPPORTED 1113.000 -
Geometric Mean 6910.867 -
Name Current %
TOTAL.UNRESOLVED 33331.000 -
g++.UNRESOLVED 9954.000 -
gcc.UNRESOLVED 19275.000 -
libstdc++.UNRESOLVED 4102.000 -
Geometric Mean 12726.501 -
Name Current %
TOTAL.ERROR 1.000 -
g++.ERROR 0.000 -
gcc.ERROR 1.000 -
libstdc++.ERROR 0.000 -
Geometric Mean 0.010 -99.01%
Name Current %
TOTAL.OTHER 0.000 -
g++.OTHER 0.000 -
gcc.OTHER 0.000 -
libstdc++.OTHER 0.000 -
Geometric Mean 0.000 -
Name Current %
TOTAL.good 310869.000 -
g++.good 189659.000 -
gcc.good 115446.000 -
libstdc++.good 5764.000 -
Geometric Mean 79143.169 -
bad
Name Current %
TOTAL.bad 69888.000 -
g++.bad 21256.000 -
gcc.bad 40382.000 -
libstdc++.bad 8250.000 -
Geometric Mean 26523.540 -
Name Current %
TOTAL.fails 69803.000 -
Geometric Mean 69803.000 -
Name Current %
TOTAL.flaky 0.000 -
Geometric Mean 0.000 -
all
Name Current %
TOTAL.all 380757.000 -
Geometric Mean 380757.000 -