Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=e3f5898021ba21d9ad855b325cef92019a17b04d (unchanged)
git_gcc https://github.com/gcc-mirror/gcc/commit/b66e613a1a8d5b8fc9d8b03f7b60260700acf833 (+ 1 commits)
git_gdb https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=e3f5898021ba21d9ad855b325cef92019a17b04d (unchanged)
git_newlib https://sourceware.org/git/?p=newlib-cygwin.git;a=commit;h=2e7332d6bd0219da491e899e0c3cee335ec8c9ab (unchanged)
git_qemu https://gitlab.com/qemu-project/qemu/commit/0450cf08976f9036feaded438031b4cba94f6452 (unchanged)
regression https://linaro.atlassian.net/browse/GNU-920
test_url https://ci.linaro.org/job/tcwg_gnu_embed_check_gcc--master-thumb_m55_hard_eabi-build/92/
Filter

master-thumb_m55_hard_eabi test results

Run Order Start Time Duration
Current 0092 (basepoints/gcc-14-03095-gb66e613a1a8) 2023-08-08T22:27:39 0:00:00
Previous 0091 (basepoints/gcc-14-03094-g0412f0e374d) 2023-08-08T14:08:21 0:00:00
Baseline 0004 (5-changed-components) 2023-08-02T19:43:22 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 7 12
Performance Improvements 1 2
Added Tests 10 13
Unchanged Tests 747 738
Total Tests 765

Performance Regressions - UNRESOLVED Δ Previous Current σ Δ (B) σ (B)
libstdc++.UNRESOLVED 25.00% 16.000 20.000 - 25.00% -
g++.UNRESOLVED 14.29% 7.000 8.000 - 14.29% -
TOTAL.UNRESOLVED 4.81% 104.000 109.000 - 21.11% -

Performance Regressions - bad Δ Previous Current σ Δ (B) σ (B)
libstdc++.bad 78.57% 42.000 75.000 - 82.93% -
g++.bad 13.56% 59.000 67.000 - 31.37% -
TOTAL.bad 8.14% 553.000 598.000 - 24.58% -

Performance Regressions - flaky Δ Previous Current σ Δ (B) σ (B)
TOTAL.flaky 194.52% 73.000 215.000 - 0.00% -

Performance Improvements - FAIL Δ Previous Current σ Δ (B) σ (B)
libstdc++.FAIL -4.17% 24.000 23.000 - 0.00% -

Added Tests - ERROR
g++.ERROR
gcc.ERROR

Added Tests - KFAIL
TOTAL.KFAIL
g++.KFAIL
gcc.KFAIL
libstdc++.KFAIL

Added Tests - UNTESTED
TOTAL.UNTESTED
g++.UNTESTED
gcc.UNTESTED
libstdc++.UNTESTED

Performance Regressions - FAIL Δ (B) Baseline Current σ (B) Δ σ
g++.FAIL 23.53% 34.000 42.000 - 0.00% -
gcc.FAIL 15.77% 317.000 367.000 - 0.00% -
TOTAL.FAIL 15.51% 374.000 432.000 - -0.23% -

Performance Regressions - UNRESOLVED Δ (B) Baseline Current σ (B) Δ σ
libstdc++.UNRESOLVED 25.00% 16.000 20.000 - 25.00% -
TOTAL.UNRESOLVED 21.11% 90.000 109.000 - 4.81% -
gcc.UNRESOLVED 20.90% 67.000 81.000 - 0.00% -
g++.UNRESOLVED 14.29% 7.000 8.000 - 14.29% -

Performance Regressions - XFAIL Δ (B) Baseline Current σ (B) Δ σ
gcc.XFAIL 1.20% 920.000 931.000 - 0.00% -

Performance Regressions - bad Δ (B) Baseline Current σ (B) Δ σ
libstdc++.bad 82.93% 41.000 75.000 - 78.57% -
g++.bad 31.37% 51.000 67.000 - 13.56% -
TOTAL.bad 24.58% 480.000 598.000 - 8.14% -
gcc.bad 17.53% 388.000 456.000 - 0.88% -

Performance Improvements - UNSUPPORTED Δ (B) Baseline Current σ (B) Δ σ
gcc.UNSUPPORTED -2.96% 8612.000 8357.000 - 0.00% -
TOTAL.UNSUPPORTED -1.15% 20741.000 20502.000 - -0.00% -

Added Tests - ERROR
g++.ERROR
gcc.ERROR

Added Tests - KFAIL
TOTAL.KFAIL
g++.KFAIL
gcc.KFAIL
libstdc++.KFAIL

Added Tests - UNTESTED
TOTAL.UNTESTED
g++.UNTESTED
gcc.UNTESTED
libstdc++.UNTESTED

Added Tests - all
TOTAL.all

Added Tests - fails
TOTAL.fails

Added Tests - flaky
TOTAL.flaky


Report Time: 0.32s
Name Current %
TOTAL.PASS 367046.000 -
g++.PASS 200101.000 -
gcc.PASS 153406.000 -
libstdc++.PASS 13539.000 -
Geometric Mean 111134.698 -
Name Current %
TOTAL.XPASS 16.000 -
g++.XPASS 10.000 -
gcc.XPASS 4.000 -
libstdc++.XPASS 2.000 -
Geometric Mean 5.981 -
Name Current %
TOTAL.FAIL 432.000 -
g++.FAIL 42.000 -
gcc.FAIL 367.000 -
libstdc++.FAIL 23.000 -4.17%
Geometric Mean 111.245 -1.12%
Name Current %
TOTAL.XFAIL 2117.000 -
g++.XFAIL 1075.000 -
gcc.XFAIL 931.000 -
libstdc++.XFAIL 111.000 -
Geometric Mean 696.387 -
Name Current %
TOTAL.KFAIL 0.000 -
g++.KFAIL 0.000 -
gcc.KFAIL 0.000 -
libstdc++.KFAIL 0.000 -
Geometric Mean 0.000 -
Name Current %
TOTAL.UNSUPPORTED 20502.000 -
g++.UNSUPPORTED 11164.000 -
gcc.UNSUPPORTED 8357.000 -
libstdc++.UNSUPPORTED 981.000 -
Geometric Mean 6581.636 -
Name Current %
TOTAL.UNRESOLVED 109.000 4.81%
g++.UNRESOLVED 8.000 14.29%
gcc.UNRESOLVED 81.000 -
libstdc++.UNRESOLVED 20.000 25.00%
Geometric Mean 34.475 10.62%
Name Current %
TOTAL.ERROR 17.000 -
g++.ERROR 0.000 -
gcc.ERROR 0.000 -
libstdc++.ERROR 17.000 -
Geometric Mean 0.041 -
Name Current %
TOTAL.OTHER 24.000 -
g++.OTHER 7.000 -
gcc.OTHER 4.000 -
libstdc++.OTHER 13.000 -
Geometric Mean 9.668 35668014562099953926144.00%
Name Current %
TOTAL.good 389665.000 -
g++.good 212340.000 -
gcc.good 162694.000 -
libstdc++.good 14631.000 -
Geometric Mean 118465.581 -
bad
Name Current %
TOTAL.bad 598.000 8.14%
g++.bad 67.000 13.56%
gcc.bad 456.000 -
libstdc++.bad 75.000 78.57%
Geometric Mean 192.398 21.96%
Name Current %
TOTAL.fails 556.000 -
Geometric Mean 556.000 -
Name Current %
TOTAL.flaky 215.000 194.52%
Geometric Mean 215.000 194.52%
all
Name Current %
TOTAL.all 390258.000 -
Geometric Mean 390258.000 -