Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=c171609cc698a153176305ff53127d99db1f6971 (unchanged)
git_gcc https://github.com/gcc-mirror/gcc/commit/eb846114ed7c49e426fccb826a3f81b7abbc84be (+ 17 commits)
git_gdb https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=c171609cc698a153176305ff53127d99db1f6971 (unchanged)
git_newlib https://sourceware.org/git/?p=newlib-cygwin.git;a=commit;h=241b50a7abe25fc017f36eeb8704199f48d0b404 (unchanged)
git_qemu https://gitlab.com/qemu-project/qemu/commit/977542ded7e6b28d2bc077bcda24568c716e393c (unchanged)
test_url https://ci.linaro.org/job/tcwg_gnu_embed_check_gcc--master-arm_v7a_softfp_eabi-build/368/
Filter

master-arm_v7a_softfp_eabi test results

Run Order Start Time Duration
Current 0368 (basepoints/gcc-14-07007-geb846114ed7) 2024-01-12T15:55:34 0:00:00
Previous 0373 (basepoints/gcc-14-07242-ge037a0fa040) 2024-01-14T17:01:23 0:00:00
Baseline 0243 (5-changed-components) 2023-10-17T06:57:04 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 2 12
Performance Improvements 2 12
Added Tests 18 21
Unchanged Tests 743 720
Total Tests 765

Performance Regressions - FAIL Δ Previous Current σ Δ (B) σ (B)
g++.FAIL 1.19% 84.000 85.000 - -8.60% -

Performance Regressions - bad Δ Previous Current σ Δ (B) σ (B)
g++.bad 1.02% 98.000 99.000 - -14.66% -

Performance Improvements - XFAIL Δ Previous Current σ Δ (B) σ (B)
g++.XFAIL -5.38% 1860.000 1760.000 - 5.20% -
TOTAL.XFAIL -3.31% 3019.000 2919.000 - 3.44% -

Added Tests - ERROR
TOTAL.ERROR
g++.ERROR
gcc.ERROR
libstdc++.ERROR

Added Tests - KFAIL
TOTAL.KFAIL
g++.KFAIL
gcc.KFAIL
libstdc++.KFAIL

Added Tests - OTHER
TOTAL.OTHER
g++.OTHER
gcc.OTHER
libstdc++.OTHER

Added Tests - UNRESOLVED
g++.UNRESOLVED

Added Tests - UNTESTED
TOTAL.UNTESTED
g++.UNTESTED
gcc.UNTESTED
libstdc++.UNTESTED

Added Tests - XPASS
gcc.XPASS

Performance Regressions - FAIL Δ (B) Baseline Current σ (B) Δ σ
gcc.FAIL 1675.41% 61.000 1083.000 - 0.93% -
TOTAL.FAIL 613.25% 166.000 1184.000 - 0.94% -
libstdc++.FAIL 33.33% 12.000 16.000 - 0.00% -

Performance Regressions - UNRESOLVED Δ (B) Baseline Current σ (B) Δ σ
TOTAL.UNRESOLVED 8.33% 24.000 26.000 - 0.00% -

Performance Regressions - UNSUPPORTED Δ (B) Baseline Current σ (B) Δ σ
gcc.UNSUPPORTED 3.91% 8542.000 8876.000 - -0.57% -
TOTAL.UNSUPPORTED 3.38% 20843.000 21547.000 - -0.28% -
g++.UNSUPPORTED 3.27% 11287.000 11656.000 - -0.08% -

Performance Regressions - XFAIL Δ (B) Baseline Current σ (B) Δ σ
g++.XFAIL 5.20% 1673.000 1760.000 - -5.38% -
TOTAL.XFAIL 3.44% 2822.000 2919.000 - -3.31% -

Performance Regressions - bad Δ (B) Baseline Current σ (B) Δ σ
gcc.bad 1202.35% 85.000 1107.000 - 0.91% -
TOTAL.bad 470.23% 215.000 1226.000 - 0.91% -
libstdc++.bad 42.86% 14.000 20.000 - 0.00% -

Performance Improvements - FAIL Δ (B) Baseline Current σ (B) Δ σ
g++.FAIL -8.60% 93.000 85.000 - 1.19% -

Performance Improvements - PASS Δ (B) Baseline Current σ (B) Δ σ
g++.PASS 5.64% 206312.000 217949.000 - -0.83% -
TOTAL.PASS 4.23% 376816.000 392767.000 - -0.50% -
gcc.PASS 2.64% 155026.000 159126.000 - -0.08% -
libstdc++.PASS 1.38% 15478.000 15692.000 - -0.28% -

Performance Improvements - XPASS Δ (B) Baseline Current σ (B) Δ σ
g++.XPASS -39.13% 23.000 14.000 - 0.00% -
TOTAL.XPASS -36.00% 25.000 16.000 - 0.00% -

Performance Improvements - bad Δ (B) Baseline Current σ (B) Δ σ
g++.bad -14.66% 116.000 99.000 - 1.02% -

Performance Improvements - good Δ (B) Baseline Current σ (B) Δ σ
g++.good 5.52% 219272.000 231365.000 - -0.82% -
TOTAL.good 4.18% 400481.000 417233.000 - -0.51% -
gcc.good 2.70% 164586.000 169030.000 - -0.10% -
libstdc++.good 1.29% 16623.000 16838.000 - -0.27% -

Added Tests - ERROR
TOTAL.ERROR
g++.ERROR
gcc.ERROR
libstdc++.ERROR

Added Tests - KFAIL
TOTAL.KFAIL
g++.KFAIL
gcc.KFAIL
libstdc++.KFAIL

Added Tests - OTHER
TOTAL.OTHER
g++.OTHER
gcc.OTHER
libstdc++.OTHER

Added Tests - UNRESOLVED
g++.UNRESOLVED

Added Tests - UNTESTED
TOTAL.UNTESTED
g++.UNTESTED
gcc.UNTESTED
libstdc++.UNTESTED

Added Tests - XPASS
gcc.XPASS

Added Tests - all
TOTAL.all

Added Tests - fails
TOTAL.fails

Added Tests - flaky
TOTAL.flaky


Report Time: 0.32s
Name Current %
TOTAL.PASS 392767.000 -
g++.PASS 217949.000 -
gcc.PASS 159126.000 -
libstdc++.PASS 15692.000 -
Geometric Mean 120914.206 -
Name Current %
TOTAL.XPASS 16.000 -
g++.XPASS 14.000 -
gcc.XPASS 0.000 -
libstdc++.XPASS 2.000 -
Geometric Mean 0.460 -93.99%
Name Current %
TOTAL.FAIL 1184.000 -
g++.FAIL 85.000 1.19%
gcc.FAIL 1083.000 -
libstdc++.FAIL 16.000 -
Geometric Mean 204.353 -
Name Current %
TOTAL.XFAIL 2919.000 -3.31%
g++.XFAIL 1760.000 -5.38%
gcc.XFAIL 1028.000 -
libstdc++.XFAIL 131.000 -
Geometric Mean 912.017 -2.20%
Name Current %
TOTAL.KFAIL 0.000 -
g++.KFAIL 0.000 -
gcc.KFAIL 0.000 -
libstdc++.KFAIL 0.000 -
Geometric Mean 0.000 -
Name Current %
TOTAL.UNSUPPORTED 21547.000 -
g++.UNSUPPORTED 11656.000 -
gcc.UNSUPPORTED 8876.000 -
libstdc++.UNSUPPORTED 1015.000 -
Geometric Mean 6896.916 -
Name Current %
TOTAL.ERROR 0.000 -
g++.ERROR 0.000 -
gcc.ERROR 0.000 -
libstdc++.ERROR 0.000 -
Geometric Mean 0.000 -
Name Current %
TOTAL.OTHER 0.000 -
g++.OTHER 0.000 -
gcc.OTHER 0.000 -
libstdc++.OTHER 0.000 -
Geometric Mean 0.000 -
Name Current %
TOTAL.good 417233.000 -
g++.good 231365.000 -
gcc.good 169030.000 -
libstdc++.good 16838.000 -
Geometric Mean 128745.676 -
bad
Name Current %
TOTAL.bad 1226.000 -
g++.bad 99.000 1.02%
gcc.bad 1107.000 -
libstdc++.bad 20.000 -
Geometric Mean 227.681 -
Name Current %
TOTAL.fails 1226.000 -
Geometric Mean 1226.000 -
Name Current %
TOTAL.flaky 20.000 -
Geometric Mean 20.000 -
all
Name Current %
TOTAL.all 418459.000 -
Geometric Mean 418459.000 -