Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=1f08d324601ef7fd4cce3cff8f8db4a774791828 (unchanged)
git_gcc https://github.com/gcc-mirror/gcc/commit/99b5921bfc8f9122fb7ccb0a4284179fd3a2f2ba (+ 1 commits)
git_gdb https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=1f08d324601ef7fd4cce3cff8f8db4a774791828 (unchanged)
git_newlib https://sourceware.org/git/?p=newlib-cygwin.git;a=commit;h=90d3b16d2b93d573501394d88538c99335edc343 (unchanged)
git_qemu https://gitlab.com/qemu-project/qemu/commit/50e7a40af372ee5931c99ef7390f5d3d6fbf6ec4 (unchanged)
regression https://linaro.atlassian.net/browse/GNU-885
test_url https://ci.linaro.org/job/tcwg_gnu_embed_check_gcc--master-thumb_m7_eabi-build/89/
Filter

master-thumb_m7_eabi test results

Run Order Start Time Duration
Current 0089 (basepoints/gcc-14-03281-g99b5921bfc8) 2023-08-24T09:52:33 0:00:00
Previous 0070 (basepoints/gcc-14-03128-g8afe9d5d2fd) 2023-08-16T07:29:45 0:00:00
Baseline 0005 (5-changed-components) 2023-08-03T00:00:40 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 10 18
Performance Improvements 0 8
Added Tests 16 19
Unchanged Tests 739 720
Total Tests 765

Performance Regressions - FAIL Δ Previous Current σ Δ (B) σ (B)
libstdc++.FAIL 8.70% 23.000 25.000 - 8.70% -
gcc.FAIL 4.36% 344.000 359.000 - 322.35% -
TOTAL.FAIL 4.20% 405.000 422.000 - 205.80% -

Performance Regressions - UNRESOLVED Δ Previous Current σ Δ (B) σ (B)
libstdc++.UNRESOLVED 12.50% 16.000 18.000 - 12.50% -
TOTAL.UNRESOLVED 2.15% 93.000 95.000 - 375.00% -

Performance Regressions - XPASS Δ Previous Current σ Δ (B) σ (B)
TOTAL.XPASS 8.33% 12.000 13.000 - 30.00% -

Performance Regressions - bad Δ Previous Current σ Δ (B) σ (B)
libstdc++.bad 9.76% 41.000 45.000 - 9.76% -
TOTAL.bad 3.92% 510.000 530.000 - 215.48% -
gcc.bad 3.86% 414.000 430.000 - 400.00% -

Performance Regressions - fails Δ Previous Current σ Δ (B) σ (B)
TOTAL.fails 3.92% 510.000 530.000 - 0.00% -

Added Tests - ERROR
TOTAL.ERROR
g++.ERROR
gcc.ERROR
libstdc++.ERROR

Added Tests - KFAIL
TOTAL.KFAIL
g++.KFAIL
gcc.KFAIL
libstdc++.KFAIL

Added Tests - OTHER
TOTAL.OTHER
g++.OTHER
gcc.OTHER
libstdc++.OTHER

Added Tests - UNTESTED
TOTAL.UNTESTED
g++.UNTESTED
gcc.UNTESTED
libstdc++.UNTESTED

Performance Regressions - FAIL Δ (B) Baseline Current σ (B) Δ σ
gcc.FAIL 322.35% 85.000 359.000 - 4.36% -
TOTAL.FAIL 205.80% 138.000 422.000 - 4.20% -
g++.FAIL 26.67% 30.000 38.000 - 0.00% -
libstdc++.FAIL 8.70% 23.000 25.000 - 8.70% -

Performance Regressions - UNRESOLVED Δ (B) Baseline Current σ (B) Δ σ
gcc.UNRESOLVED 6900.00% 1.000 70.000 - 0.00% -
TOTAL.UNRESOLVED 375.00% 20.000 95.000 - 2.15% -
g++.UNRESOLVED 133.33% 3.000 7.000 - 0.00% -
libstdc++.UNRESOLVED 12.50% 16.000 18.000 - 12.50% -

Performance Regressions - UNSUPPORTED Δ (B) Baseline Current σ (B) Δ σ
gcc.UNSUPPORTED 25.43% 6689.000 8390.000 - 0.02% -

Performance Regressions - XFAIL Δ (B) Baseline Current σ (B) Δ σ
gcc.XFAIL 9.93% 886.000 974.000 - 0.00% -
TOTAL.XFAIL 5.15% 2176.000 2288.000 - 0.00% -
g++.XFAIL 2.04% 1179.000 1203.000 - 0.00% -

Performance Regressions - XPASS Δ (B) Baseline Current σ (B) Δ σ
TOTAL.XPASS 30.00% 10.000 13.000 - 8.33% -
g++.XPASS 25.00% 8.000 10.000 - 0.00% -

Performance Regressions - bad Δ (B) Baseline Current σ (B) Δ σ
gcc.bad 400.00% 86.000 430.000 - 3.86% -
TOTAL.bad 215.48% 168.000 530.000 - 3.92% -
g++.bad 34.15% 41.000 55.000 - 0.00% -
libstdc++.bad 9.76% 41.000 45.000 - 9.76% -

Performance Improvements - PASS Δ (B) Baseline Current σ (B) Δ σ
gcc.PASS 16.92% 129983.000 151982.000 - 0.12% -
TOTAL.PASS 9.72% 333250.000 365629.000 - 0.06% -
g++.PASS 5.47% 189726.000 200102.000 - 0.03% -

Performance Improvements - UNSUPPORTED Δ (B) Baseline Current σ (B) Δ σ
g++.UNSUPPORTED -17.09% 13485.000 11180.000 - 0.11% -
TOTAL.UNSUPPORTED -2.85% 21155.000 20553.000 - 0.08% -

Performance Improvements - good Δ (B) Baseline Current σ (B) Δ σ
gcc.good 17.29% 137558.000 161346.000 - 0.11% -
TOTAL.good 8.94% 356581.000 388470.000 - 0.06% -
g++.good 3.96% 204390.000 212485.000 - 0.03% -

Added Tests - ERROR
TOTAL.ERROR
g++.ERROR
gcc.ERROR
libstdc++.ERROR

Added Tests - KFAIL
TOTAL.KFAIL
g++.KFAIL
gcc.KFAIL
libstdc++.KFAIL

Added Tests - OTHER
TOTAL.OTHER
g++.OTHER
gcc.OTHER
libstdc++.OTHER

Added Tests - UNTESTED
TOTAL.UNTESTED
g++.UNTESTED
gcc.UNTESTED
libstdc++.UNTESTED

Added Tests - all
TOTAL.all

Added Tests - fails
TOTAL.fails

Added Tests - flaky
TOTAL.flaky


Report Time: 0.34s
Name Current %
TOTAL.PASS 365629.000 -
g++.PASS 200102.000 -
gcc.PASS 151982.000 -
libstdc++.PASS 13545.000 -
Geometric Mean 110781.134 -
Name Current %
TOTAL.XPASS 13.000 8.33%
g++.XPASS 10.000 -
gcc.XPASS 1.000 -
libstdc++.XPASS 2.000 -
Geometric Mean 4.016 920.47%
Name Current %
TOTAL.FAIL 422.000 4.20%
g++.FAIL 38.000 -
gcc.FAIL 359.000 4.36%
libstdc++.FAIL 25.000 8.70%
Geometric Mean 109.530 4.27%
Name Current %
TOTAL.XFAIL 2288.000 -
g++.XFAIL 1203.000 -
gcc.XFAIL 974.000 -
libstdc++.XFAIL 111.000 -
Geometric Mean 738.586 -
Name Current %
TOTAL.KFAIL 0.000 -
g++.KFAIL 0.000 -
gcc.KFAIL 0.000 -
libstdc++.KFAIL 0.000 -
Geometric Mean 0.000 -
Name Current %
TOTAL.UNSUPPORTED 20553.000 -
g++.UNSUPPORTED 11180.000 -
gcc.UNSUPPORTED 8390.000 -
libstdc++.UNSUPPORTED 983.000 -
Geometric Mean 6597.937 -
Name Current %
TOTAL.UNRESOLVED 95.000 2.15%
g++.UNRESOLVED 7.000 -
gcc.UNRESOLVED 70.000 -
libstdc++.UNRESOLVED 18.000 12.50%
Geometric Mean 30.255 3.54%
Name Current %
TOTAL.ERROR 0.000 -
g++.ERROR 0.000 -
gcc.ERROR 0.000 -
libstdc++.ERROR 0.000 -
Geometric Mean 0.000 -
Name Current %
TOTAL.OTHER 0.000 -
g++.OTHER 0.000 -
gcc.OTHER 0.000 -
libstdc++.OTHER 0.000 -
Geometric Mean 0.000 -
Name Current %
TOTAL.good 388470.000 -
g++.good 212485.000 -
gcc.good 161346.000 -
libstdc++.good 14639.000 -
Geometric Mean 118164.996 -
bad
Name Current %
TOTAL.bad 530.000 3.92%
g++.bad 55.000 -
gcc.bad 430.000 3.86%
libstdc++.bad 45.000 9.76%
Geometric Mean 154.110 4.33%
Name Current %
TOTAL.fails 530.000 3.92%
Geometric Mean 530.000 3.92%
Name Current %
TOTAL.flaky 24.000 -
Geometric Mean 24.000 -
all
Name Current %
TOTAL.all 389000.000 -
Geometric Mean 389000.000 -