Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=07a88d7f2121630956997bc5edd495af40d4494f (+ 10 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/4f01ae3761ca1f8dd7a33b833ae30624f047ac9c (+ 27 commits)
git_gdb https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=07a88d7f2121630956997bc5edd495af40d4494f (+ 10 commits)
git_newlib https://sourceware.org/git/?p=newlib-cygwin.git;a=commit;h=6b2ae32ecdfdb8ca1337e19fac3b6e0a4079e769 (+ 1 commits)
git_qemu https://gitlab.com/qemu-project/qemu/commit/67fe6ae41da64368bc4936b196fee2bf61f8c720 (+ 21 commits)
test_url https://ci.linaro.org/job/tcwg_gnu_embed_check_gcc--master-arm_eabi-build/109/
Filter

master-arm_eabi test results

Run Order Start Time Duration
Current 0109 (5-changed-components) 2023-06-21T02:31:35 0:00:00
Previous 0144 (5-changed-components) 2023-06-24T00:38:20 0:00:00
Baseline 0011 (5-changed-components) 2023-06-05T17:27:31 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 2 25
Performance Improvements 0 2
Added Tests 16 16
Unchanged Tests 927 902
Total Tests 945

Performance Regressions - UNRESOLVED Δ Previous Current σ Δ (B) σ (B)
g++.UNRESOLVED 1.19% 9837.000 9954.000 - 6580.54% -

Performance Regressions - bad Δ Previous Current σ Δ (B) σ (B)
g++.bad 1.01% 21043.000 21256.000 - 6008.05% -

Added Tests - ERROR
g++.ERROR
libstdc++.ERROR

Added Tests - KFAIL
TOTAL.KFAIL
g++.KFAIL
gcc.KFAIL
libstdc++.KFAIL

Added Tests - OTHER
TOTAL.OTHER
g++.OTHER
gcc.OTHER
libstdc++.OTHER

Added Tests - UNTESTED
TOTAL.UNTESTED
g++.UNTESTED
gcc.UNTESTED
libstdc++.UNTESTED

Added Tests - XPASS
libstdc++.XPASS

Added Tests - flaky
TOTAL.flaky

Performance Regressions - FAIL Δ (B) Baseline Current σ (B) Δ σ
gcc.FAIL 27289.61% 77.000 21090.000 - -0.15% -
g++.FAIL 5874.60% 189.000 11292.000 - 0.86% -
libstdc++.FAIL 801.74% 460.000 4148.000 - 0.00% -
TOTAL.FAIL 95.30% 18705.000 36530.000 - 0.18% -

Performance Regressions - PASS Δ (B) Baseline Current σ (B) Δ σ
libstdc++.PASS -65.93% 13634.000 4645.000 - 0.00% -
gcc.PASS -29.02% 149024.000 105774.000 - -0.31% -
TOTAL.PASS -24.73% 382336.000 287778.000 - -0.33% -
g++.PASS -10.65% 198496.000 177359.000 - -0.35% -

Performance Regressions - UNRESOLVED Δ (B) Baseline Current σ (B) Δ σ
gcc.UNRESOLVED 16234.75% 118.000 19275.000 - 0.53% -
g++.UNRESOLVED 6580.54% 149.000 9954.000 - 1.19% -
libstdc++.UNRESOLVED 2284.88% 172.000 4102.000 - 0.00% -
TOTAL.UNRESOLVED 101.06% 16578.000 33331.000 - 0.66% -

Performance Regressions - UNSUPPORTED Δ (B) Baseline Current σ (B) Δ σ
libstdc++.UNSUPPORTED 70.44% 653.000 1113.000 - 0.00% -
gcc.UNSUPPORTED 4.97% 8256.000 8666.000 - 0.78% -

Performance Regressions - XPASS Δ (B) Baseline Current σ (B) Δ σ
gcc.XPASS 33.33% 6.000 8.000 - 0.00% -

Performance Regressions - all Δ (B) Baseline Current σ (B) Δ σ
TOTAL.all -13.95% 442374.000 380660.000 - -0.13% -

Performance Regressions - bad Δ (B) Baseline Current σ (B) Δ σ
gcc.bad 19887.13% 202.000 40374.000 - 0.17% -
g++.bad 6008.05% 348.000 21256.000 - 1.01% -
libstdc++.bad 1201.26% 634.000 8250.000 - 0.00% -
TOTAL.bad 88.59% 37054.000 69880.000 - 0.41% -

Performance Regressions - fails Δ (B) Baseline Current σ (B) Δ σ
TOTAL.fails 98.19% 35217.000 69795.000 - 0.28% -

Performance Regressions - good Δ (B) Baseline Current σ (B) Δ σ
libstdc++.good -59.70% 14304.000 5764.000 - 0.00% -
gcc.good -27.08% 158199.000 115357.000 - -0.23% -
TOTAL.good -23.32% 405320.000 310780.000 - -0.25% -
g++.good -10.00% 210743.000 189659.000 - -0.27% -

Performance Improvements - XFAIL Δ (B) Baseline Current σ (B) Δ σ
libstdc++.XFAIL -64.71% 17.000 6.000 - 0.00% -
TOTAL.XFAIL -1.74% 2013.000 1978.000 - 0.00% -

Added Tests - ERROR
g++.ERROR
libstdc++.ERROR

Added Tests - KFAIL
TOTAL.KFAIL
g++.KFAIL
gcc.KFAIL
libstdc++.KFAIL

Added Tests - OTHER
TOTAL.OTHER
g++.OTHER
gcc.OTHER
libstdc++.OTHER

Added Tests - UNTESTED
TOTAL.UNTESTED
g++.UNTESTED
gcc.UNTESTED
libstdc++.UNTESTED

Added Tests - XPASS
libstdc++.XPASS

Added Tests - flaky
TOTAL.flaky


Report Time: 0.20s
Name Current %
TOTAL.PASS 287778.000 -
g++.PASS 177359.000 -
gcc.PASS 105774.000 -
libstdc++.PASS 4645.000 -
Geometric Mean 70765.058 -
Name Current %
TOTAL.XPASS 18.000 -
g++.XPASS 10.000 -
gcc.XPASS 8.000 -
libstdc++.XPASS 0.000 -
Geometric Mean 0.616 -94.55%
Name Current %
TOTAL.FAIL 36530.000 -
g++.FAIL 11292.000 -
gcc.FAIL 21090.000 -
libstdc++.FAIL 4148.000 -
Geometric Mean 13782.689 -
Name Current %
TOTAL.XFAIL 1978.000 -
g++.XFAIL 1055.000 -
gcc.XFAIL 917.000 -
libstdc++.XFAIL 6.000 -
Geometric Mean 327.342 -
Name Current %
TOTAL.KFAIL 0.000 -
g++.KFAIL 0.000 -
gcc.KFAIL 0.000 -
libstdc++.KFAIL 0.000 -
Geometric Mean 0.000 -
Name Current %
TOTAL.UNSUPPORTED 21024.000 -
g++.UNSUPPORTED 11245.000 -
gcc.UNSUPPORTED 8666.000 -
libstdc++.UNSUPPORTED 1113.000 -
Geometric Mean 6910.304 -
Name Current %
TOTAL.UNRESOLVED 33331.000 -
g++.UNRESOLVED 9954.000 1.19%
gcc.UNRESOLVED 19275.000 -
libstdc++.UNRESOLVED 4102.000 -
Geometric Mean 12726.501 -
Name Current %
TOTAL.ERROR 1.000 -
g++.ERROR 0.000 -
gcc.ERROR 1.000 -
libstdc++.ERROR 0.000 -
Geometric Mean 0.010 -
Name Current %
TOTAL.OTHER 0.000 -
g++.OTHER 0.000 -
gcc.OTHER 0.000 -
libstdc++.OTHER 0.000 -
Geometric Mean 0.000 -
Name Current %
TOTAL.good 310780.000 -
g++.good 189659.000 -
gcc.good 115357.000 -
libstdc++.good 5764.000 -
Geometric Mean 79122.247 -
bad
Name Current %
TOTAL.bad 69880.000 -
g++.bad 21256.000 1.01%
gcc.bad 40374.000 -
libstdc++.bad 8250.000 -
Geometric Mean 26521.467 -
Name Current %
TOTAL.fails 69795.000 -
Geometric Mean 69795.000 -
Name Current %
TOTAL.flaky 0.000 -
Geometric Mean 0.000 -
all
Name Current %
TOTAL.all 380660.000 -
Geometric Mean 380660.000 -