Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=d367563d55c0ff2bd406397c773bca767e8fccce (unchanged)
git_gcc https://github.com/gcc-mirror/gcc/commit/99b5921bfc8f9122fb7ccb0a4284179fd3a2f2ba (+ 1 commits)
git_gdb https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=d367563d55c0ff2bd406397c773bca767e8fccce (unchanged)
git_newlib https://sourceware.org/git/?p=newlib-cygwin.git;a=commit;h=90d3b16d2b93d573501394d88538c99335edc343 (unchanged)
git_qemu https://gitlab.com/qemu-project/qemu/commit/b0dd9a7d6dd15a6898e9c585b521e6bec79b25aa (unchanged)
regression https://linaro.atlassian.net/browse/GNU-885
test_url https://ci.linaro.org/job/tcwg_gnu_embed_check_gcc--master-thumb_m3_eabi-build/84/
Filter

master-thumb_m3_eabi test results

Run Order Start Time Duration
Current 0084 (basepoints/gcc-14-03281-g99b5921bfc8) 2023-08-23T04:41:18 0:00:00
Previous 0083 (basepoints/gcc-14-03280-g17d670dbca1) 2023-08-22T22:41:38 0:00:00
Baseline 0005 (5-changed-components) 2023-08-03T00:00:40 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 11 18
Performance Improvements 2 9
Added Tests 10 13
Unchanged Tests 742 725
Total Tests 765

Performance Regressions - FAIL Δ Previous Current σ Δ (B) σ (B)
g++.FAIL 2.56% 39.000 40.000 - 33.33% -
gcc.FAIL 1.02% 294.000 297.000 - 440.00% -

Performance Regressions - UNRESOLVED Δ Previous Current σ Δ (B) σ (B)
libstdc++.UNRESOLVED 200.00% 18.000 54.000 - 237.50% -
TOTAL.UNRESOLVED 31.90% 116.000 153.000 - 665.00% -
gcc.UNRESOLVED 1.10% 91.000 92.000 - 9100.00% -

Performance Regressions - bad Δ Previous Current σ Δ (B) σ (B)
libstdc++.bad 451.11% 45.000 248.000 - 504.88% -
TOTAL.bad 43.33% 487.000 698.000 - 405.80% -
g++.bad 5.36% 56.000 59.000 - 43.90% -
gcc.bad 1.30% 386.000 391.000 - 598.21% -

Performance Regressions - fails Δ Previous Current σ Δ (B) σ (B)
TOTAL.fails 2.26% 442.000 452.000 - 0.00% -

Performance Regressions - flaky Δ Previous Current σ Δ (B) σ (B)
TOTAL.flaky 10.54% 351.000 388.000 - 0.00% -

Performance Improvements - FAIL Δ Previous Current σ Δ (B) σ (B)
libstdc++.FAIL -4.00% 25.000 24.000 - 4.35% -

Performance Improvements - UNSUPPORTED Δ Previous Current σ Δ (B) σ (B)
libstdc++.UNSUPPORTED -1.53% 983.000 968.000 - -1.33% -

Added Tests - ERROR
g++.ERROR
gcc.ERROR

Added Tests - KFAIL
TOTAL.KFAIL
g++.KFAIL
gcc.KFAIL
libstdc++.KFAIL

Added Tests - UNTESTED
TOTAL.UNTESTED
g++.UNTESTED
gcc.UNTESTED
libstdc++.UNTESTED

Performance Regressions - FAIL Δ (B) Baseline Current σ (B) Δ σ
gcc.FAIL 440.00% 55.000 297.000 - 1.02% -
TOTAL.FAIL 234.26% 108.000 361.000 - 0.84% -
g++.FAIL 33.33% 30.000 40.000 - 2.56% -
libstdc++.FAIL 4.35% 23.000 24.000 - -4.00% -

Performance Regressions - UNRESOLVED Δ (B) Baseline Current σ (B) Δ σ
gcc.UNRESOLVED 9100.00% 1.000 92.000 - 1.10% -
TOTAL.UNRESOLVED 665.00% 20.000 153.000 - 31.90% -
libstdc++.UNRESOLVED 237.50% 16.000 54.000 - 200.00% -
g++.UNRESOLVED 133.33% 3.000 7.000 - 0.00% -

Performance Regressions - UNSUPPORTED Δ (B) Baseline Current σ (B) Δ σ
gcc.UNSUPPORTED 27.12% 6774.000 8611.000 - 0.00% -

Performance Regressions - XFAIL Δ (B) Baseline Current σ (B) Δ σ
gcc.XFAIL 8.37% 884.000 958.000 - 0.00% -
TOTAL.XFAIL 4.51% 2174.000 2272.000 - 0.00% -
g++.XFAIL 2.04% 1179.000 1203.000 - 0.00% -

Performance Regressions - XPASS Δ (B) Baseline Current σ (B) Δ σ
TOTAL.XPASS 30.00% 10.000 13.000 - 0.00% -
g++.XPASS 25.00% 8.000 10.000 - 0.00% -

Performance Regressions - bad Δ (B) Baseline Current σ (B) Δ σ
gcc.bad 598.21% 56.000 391.000 - 1.30% -
libstdc++.bad 504.88% 41.000 248.000 - 451.11% -
TOTAL.bad 405.80% 138.000 698.000 - 43.33% -
g++.bad 43.90% 41.000 59.000 - 5.36% -

Performance Improvements - PASS Δ (B) Baseline Current σ (B) Δ σ
gcc.PASS 16.59% 129391.000 150861.000 - -0.00% -
TOTAL.PASS 9.55% 332658.000 364429.000 - -0.00% -
g++.PASS 5.43% 189726.000 200034.000 - -0.00% -

Performance Improvements - UNSUPPORTED Δ (B) Baseline Current σ (B) Δ σ
g++.UNSUPPORTED -17.03% 13485.000 11188.000 - 0.00% -
TOTAL.UNSUPPORTED -2.23% 21240.000 20767.000 - -0.07% -
libstdc++.UNSUPPORTED -1.33% 981.000 968.000 - -1.53% -

Performance Improvements - good Δ (B) Baseline Current σ (B) Δ σ
gcc.good 17.06% 137049.000 160430.000 - -0.00% -
TOTAL.good 8.82% 356072.000 387468.000 - -0.01% -
g++.good 3.93% 204390.000 212425.000 - -0.00% -

Added Tests - ERROR
g++.ERROR
gcc.ERROR

Added Tests - KFAIL
TOTAL.KFAIL
g++.KFAIL
gcc.KFAIL
libstdc++.KFAIL

Added Tests - UNTESTED
TOTAL.UNTESTED
g++.UNTESTED
gcc.UNTESTED
libstdc++.UNTESTED

Added Tests - all
TOTAL.all

Added Tests - fails
TOTAL.fails

Added Tests - flaky
TOTAL.flaky


Report Time: 0.33s
Name Current %
TOTAL.PASS 364429.000 -
g++.PASS 200034.000 -
gcc.PASS 150861.000 -
libstdc++.PASS 13534.000 -
Geometric Mean 110453.626 -
Name Current %
TOTAL.XPASS 13.000 -
g++.XPASS 10.000 -
gcc.XPASS 1.000 -
libstdc++.XPASS 2.000 -
Geometric Mean 4.016 -
Name Current %
TOTAL.FAIL 361.000 -
g++.FAIL 40.000 2.56%
gcc.FAIL 297.000 1.02%
libstdc++.FAIL 24.000 -4.00%
Geometric Mean 100.724 -
Name Current %
TOTAL.XFAIL 2272.000 -
g++.XFAIL 1203.000 -
gcc.XFAIL 958.000 -
libstdc++.XFAIL 111.000 -
Geometric Mean 734.244 -
Name Current %
TOTAL.KFAIL 0.000 -
g++.KFAIL 0.000 -
gcc.KFAIL 0.000 -
libstdc++.KFAIL 0.000 -
Geometric Mean 0.000 -
Name Current %
TOTAL.UNSUPPORTED 20767.000 -
g++.UNSUPPORTED 11188.000 -
gcc.UNSUPPORTED 8611.000 -
libstdc++.UNSUPPORTED 968.000 -1.53%
Geometric Mean 6633.822 -
Name Current %
TOTAL.UNRESOLVED 153.000 31.90%
g++.UNRESOLVED 7.000 -
gcc.UNRESOLVED 92.000 1.10%
libstdc++.UNRESOLVED 54.000 200.00%
Geometric Mean 48.028 41.42%
Name Current %
TOTAL.ERROR 113.000 -
g++.ERROR 0.000 -
gcc.ERROR 0.000 -
libstdc++.ERROR 113.000 -
Geometric Mean 0.106 -
Name Current %
TOTAL.OTHER 58.000 -
g++.OTHER 2.000 -
gcc.OTHER 1.000 -
libstdc++.OTHER 55.000 -
Geometric Mean 8.938 32973625310234258964480.00%
Name Current %
TOTAL.good 387468.000 -
g++.good 212425.000 -
gcc.good 160430.000 -
libstdc++.good 14613.000 -
Geometric Mean 117860.047 -
bad
Name Current %
TOTAL.bad 698.000 43.33%
g++.bad 59.000 5.36%
gcc.bad 391.000 1.30%
libstdc++.bad 248.000 451.11%
Geometric Mean 251.382 70.39%
Name Current %
TOTAL.fails 452.000 2.26%
Geometric Mean 452.000 2.26%
Name Current %
TOTAL.flaky 388.000 10.54%
Geometric Mean 388.000 10.54%
all
Name Current %
TOTAL.all 388161.000 -
Geometric Mean 388161.000 -