Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=e3f5898021ba21d9ad855b325cef92019a17b04d (unchanged)
git_gcc https://github.com/gcc-mirror/gcc/commit/7997f0d35efca8a24d1b0ceae5066b1019d633d7 (+ 337 commits)
git_gdb https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=e3f5898021ba21d9ad855b325cef92019a17b04d (unchanged)
git_newlib https://sourceware.org/git/?p=newlib-cygwin.git;a=commit;h=2e7332d6bd0219da491e899e0c3cee335ec8c9ab (unchanged)
git_qemu https://gitlab.com/qemu-project/qemu/commit/0450cf08976f9036feaded438031b4cba94f6452 (unchanged)
test_url https://ci.linaro.org/job/tcwg_gnu_embed_check_gcc--master-thumb_m0_eabi-build/103/
Filter

master-thumb_m0_eabi test results

Run Order Start Time Duration
Current 0103 (basepoints/gcc-14-03502-g7997f0d35ef) 2023-08-19T03:51:29 0:00:00
Previous 0101 (no-change) 2023-08-11T07:26:03 0:00:00
Baseline 0001 (5-changed-components) 2023-08-01T06:00:40 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 0 16
Performance Improvements 7 9
Added Tests 16 19
Unchanged Tests 742 721
Total Tests 765

Performance Improvements - FAIL Δ Previous Current σ Δ (B) σ (B)
gcc.FAIL -4.49% 178.000 170.000 - 325.00% -
TOTAL.FAIL -3.19% 251.000 243.000 - 135.92% -

Performance Improvements - XPASS Δ Previous Current σ Δ (B) σ (B)
gcc.XPASS -25.00% 4.000 3.000 - 0.00% -
TOTAL.XPASS -6.25% 16.000 15.000 - 15.38% -

Performance Improvements - bad Δ Previous Current σ Δ (B) σ (B)
gcc.bad -4.29% 210.000 201.000 - 310.20% -
TOTAL.bad -2.78% 324.000 315.000 - 111.41% -

Performance Improvements - fails Δ Previous Current σ Δ (B) σ (B)
TOTAL.fails -2.80% 321.000 312.000 - 0.00% -

Added Tests - ERROR
TOTAL.ERROR
g++.ERROR
gcc.ERROR
libstdc++.ERROR

Added Tests - KFAIL
TOTAL.KFAIL
g++.KFAIL
gcc.KFAIL
libstdc++.KFAIL

Added Tests - OTHER
TOTAL.OTHER
g++.OTHER
gcc.OTHER
libstdc++.OTHER

Added Tests - UNTESTED
TOTAL.UNTESTED
g++.UNTESTED
gcc.UNTESTED
libstdc++.UNTESTED

Performance Regressions - FAIL Δ (B) Baseline Current σ (B) Δ σ
gcc.FAIL 325.00% 40.000 170.000 - -4.49% -
TOTAL.FAIL 135.92% 103.000 243.000 - -3.19% -
g++.FAIL 24.24% 33.000 41.000 - 0.00% -
libstdc++.FAIL 6.67% 30.000 32.000 - 0.00% -

Performance Regressions - UNRESOLVED Δ (B) Baseline Current σ (B) Δ σ
gcc.UNRESOLVED 366.67% 6.000 28.000 - 0.00% -
TOTAL.UNRESOLVED 72.73% 33.000 57.000 - 0.00% -
libstdc++.UNRESOLVED 8.33% 24.000 26.000 - 0.00% -

Performance Regressions - XFAIL Δ (B) Baseline Current σ (B) Δ σ
gcc.XFAIL 2.63% 837.000 859.000 - 0.23% -
TOTAL.XFAIL 1.91% 1987.000 2025.000 - 0.10% -
g++.XFAIL 1.54% 1039.000 1055.000 - 0.00% -

Performance Regressions - XPASS Δ (B) Baseline Current σ (B) Δ σ
g++.XPASS 25.00% 8.000 10.000 - 0.00% -
TOTAL.XPASS 15.38% 13.000 15.000 - -6.25% -

Performance Regressions - bad Δ (B) Baseline Current σ (B) Δ σ
gcc.bad 310.20% 49.000 201.000 - -4.29% -
TOTAL.bad 111.41% 149.000 315.000 - -2.78% -
g++.bad 22.73% 44.000 54.000 - 0.00% -
libstdc++.bad 7.14% 56.000 60.000 - 0.00% -

Performance Improvements - PASS Δ (B) Baseline Current σ (B) Δ σ
gcc.PASS 9.78% 128100.000 140633.000 - 0.32% -
TOTAL.PASS 6.78% 331210.000 353656.000 - 0.15% -
g++.PASS 5.22% 189638.000 199539.000 - 0.04% -

Performance Improvements - UNSUPPORTED Δ (B) Baseline Current σ (B) Δ σ
gcc.UNSUPPORTED -37.43% 7126.000 4459.000 - 0.02% -
TOTAL.UNSUPPORTED -23.29% 21673.000 16625.000 - 0.11% -
g++.UNSUPPORTED -17.60% 13552.000 11167.000 - 0.13% -

Performance Improvements - good Δ (B) Baseline Current σ (B) Δ σ
gcc.good 7.27% 136063.000 145951.000 - 0.31% -
TOTAL.good 4.91% 354870.000 372306.000 - 0.15% -
g++.good 3.69% 204229.000 211761.000 - 0.04% -

Added Tests - ERROR
TOTAL.ERROR
g++.ERROR
gcc.ERROR
libstdc++.ERROR

Added Tests - KFAIL
TOTAL.KFAIL
g++.KFAIL
gcc.KFAIL
libstdc++.KFAIL

Added Tests - OTHER
TOTAL.OTHER
g++.OTHER
gcc.OTHER
libstdc++.OTHER

Added Tests - UNTESTED
TOTAL.UNTESTED
g++.UNTESTED
gcc.UNTESTED
libstdc++.UNTESTED

Added Tests - all
TOTAL.all

Added Tests - fails
TOTAL.fails

Added Tests - flaky
TOTAL.flaky


Report Time: 0.35s
Name Current %
TOTAL.PASS 353656.000 -
g++.PASS 199539.000 -
gcc.PASS 140633.000 -
libstdc++.PASS 13484.000 -
Geometric Mean 107554.529 -
Name Current %
TOTAL.XPASS 15.000 -6.25%
g++.XPASS 10.000 -
gcc.XPASS 3.000 -25.00%
libstdc++.XPASS 2.000 -
Geometric Mean 5.477 -8.43%
Name Current %
TOTAL.FAIL 243.000 -3.19%
g++.FAIL 41.000 -
gcc.FAIL 170.000 -4.49%
libstdc++.FAIL 32.000 -
Geometric Mean 85.802 -1.94%
Name Current %
TOTAL.XFAIL 2025.000 -
g++.XFAIL 1055.000 -
gcc.XFAIL 859.000 -
libstdc++.XFAIL 111.000 -
Geometric Mean 671.813 -
Name Current %
TOTAL.KFAIL 0.000 -
g++.KFAIL 0.000 -
gcc.KFAIL 0.000 -
libstdc++.KFAIL 0.000 -
Geometric Mean 0.000 -
Name Current %
TOTAL.UNSUPPORTED 16625.000 -
g++.UNSUPPORTED 11167.000 -
gcc.UNSUPPORTED 4459.000 -
libstdc++.UNSUPPORTED 999.000 -
Geometric Mean 5362.599 -
Name Current %
TOTAL.ERROR 0.000 -
g++.ERROR 0.000 -
gcc.ERROR 0.000 -
libstdc++.ERROR 0.000 -
Geometric Mean 0.000 -
Name Current %
TOTAL.OTHER 0.000 -
g++.OTHER 0.000 -
gcc.OTHER 0.000 -
libstdc++.OTHER 0.000 -
Geometric Mean 0.000 -
Name Current %
TOTAL.good 372306.000 -
g++.good 211761.000 -
gcc.good 145951.000 -
libstdc++.good 14594.000 -
Geometric Mean 113836.585 -
bad
Name Current %
TOTAL.bad 315.000 -2.78%
g++.bad 54.000 -
gcc.bad 201.000 -4.29%
libstdc++.bad 60.000 -
Geometric Mean 119.678 -1.78%
Name Current %
TOTAL.fails 312.000 -2.80%
Geometric Mean 312.000 -2.80%
Name Current %
TOTAL.flaky 113.000 -
Geometric Mean 113.000 -
all
Name Current %
TOTAL.all 372621.000 -
Geometric Mean 372621.000 -