Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=4ece39c56cfdd5647d4061f3c084b9de6f9e443c (unchanged)
git_gcc https://github.com/gcc-mirror/gcc/commit/74a0dab18292bef54f316eb086112332befbc6a7 (+ 51 commits)
git_gdb https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=4ece39c56cfdd5647d4061f3c084b9de6f9e443c (unchanged)
git_newlib https://sourceware.org/git/?p=newlib-cygwin.git;a=commit;h=d11629ddb38e5bc30fd0528b1e81c4fd1b99d331 (unchanged)
git_qemu https://gitlab.com/qemu-project/qemu/commit/34eac35f893664eb8545b98142e23d9954722766 (unchanged)
test_url https://ci.linaro.org/job/tcwg_gnu_embed_check_gcc--master-arm_v7a_softfp_eabi-build/363/
Filter

master-arm_v7a_softfp_eabi test results

Run Order Start Time Duration
Current 0363 (basepoints/gcc-14-06990-g74a0dab1829) 2024-01-07T11:37:00 0:00:00
Previous 0382 (basepoints/gcc-14-08412-g0801a88af40) 2024-01-25T00:50:58 0:00:00
Baseline 0243 (5-changed-components) 2023-10-17T06:57:04 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 3 12
Performance Improvements 2 12
Added Tests 18 21
Unchanged Tests 742 720
Total Tests 765

Performance Regressions - FAIL Δ Previous Current σ Δ (B) σ (B)
g++.FAIL 2.41% 83.000 85.000 - -8.60% -

Performance Regressions - bad Δ Previous Current σ Δ (B) σ (B)
g++.bad 2.06% 97.000 99.000 - -14.66% -

Performance Regressions - flaky Δ Previous Current σ Δ (B) σ (B)
TOTAL.flaky 300.00% 5.000 20.000 - 0.00% -

Performance Improvements - XFAIL Δ Previous Current σ Δ (B) σ (B)
g++.XFAIL -4.97% 1852.000 1760.000 - 5.20% -
TOTAL.XFAIL -2.86% 3005.000 2919.000 - 3.44% -

Added Tests - ERROR
TOTAL.ERROR
g++.ERROR
gcc.ERROR
libstdc++.ERROR

Added Tests - KFAIL
TOTAL.KFAIL
g++.KFAIL
gcc.KFAIL
libstdc++.KFAIL

Added Tests - OTHER
TOTAL.OTHER
g++.OTHER
gcc.OTHER
libstdc++.OTHER

Added Tests - UNRESOLVED
g++.UNRESOLVED

Added Tests - UNTESTED
TOTAL.UNTESTED
g++.UNTESTED
gcc.UNTESTED
libstdc++.UNTESTED

Added Tests - XPASS
gcc.XPASS

Performance Regressions - FAIL Δ (B) Baseline Current σ (B) Δ σ
gcc.FAIL 1673.77% 61.000 1082.000 - 0.37% -
TOTAL.FAIL 612.65% 166.000 1183.000 - 0.51% -
libstdc++.FAIL 33.33% 12.000 16.000 - 0.00% -

Performance Regressions - UNRESOLVED Δ (B) Baseline Current σ (B) Δ σ
TOTAL.UNRESOLVED 8.33% 24.000 26.000 - 0.00% -

Performance Regressions - UNSUPPORTED Δ (B) Baseline Current σ (B) Δ σ
gcc.UNSUPPORTED 3.89% 8542.000 8874.000 - -0.97% -
TOTAL.UNSUPPORTED 3.37% 20843.000 21545.000 - -0.65% -
g++.UNSUPPORTED 3.27% 11287.000 11656.000 - -0.44% -

Performance Regressions - XFAIL Δ (B) Baseline Current σ (B) Δ σ
g++.XFAIL 5.20% 1673.000 1760.000 - -4.97% -
TOTAL.XFAIL 3.44% 2822.000 2919.000 - -2.86% -

Performance Regressions - bad Δ (B) Baseline Current σ (B) Δ σ
gcc.bad 1201.18% 85.000 1106.000 - 0.36% -
TOTAL.bad 469.77% 215.000 1225.000 - 0.49% -
libstdc++.bad 42.86% 14.000 20.000 - 0.00% -

Performance Improvements - FAIL Δ (B) Baseline Current σ (B) Δ σ
g++.FAIL -8.60% 93.000 85.000 - 2.41% -

Performance Improvements - PASS Δ (B) Baseline Current σ (B) Δ σ
g++.PASS 5.64% 206312.000 217949.000 - -0.97% -
TOTAL.PASS 4.22% 376816.000 392710.000 - -0.64% -
gcc.PASS 2.61% 155026.000 159079.000 - -0.20% -
libstdc++.PASS 1.32% 15478.000 15682.000 - -0.45% -

Performance Improvements - XPASS Δ (B) Baseline Current σ (B) Δ σ
g++.XPASS -39.13% 23.000 14.000 - 0.00% -
TOTAL.XPASS -36.00% 25.000 16.000 - 0.00% -

Performance Improvements - bad Δ (B) Baseline Current σ (B) Δ σ
g++.bad -14.66% 116.000 99.000 - 2.06% -

Performance Improvements - good Δ (B) Baseline Current σ (B) Δ σ
g++.good 5.52% 219272.000 231365.000 - -0.97% -
TOTAL.good 4.17% 400481.000 417174.000 - -0.65% -
gcc.good 2.67% 164586.000 168981.000 - -0.24% -
libstdc++.good 1.23% 16623.000 16828.000 - -0.44% -

Added Tests - ERROR
TOTAL.ERROR
g++.ERROR
gcc.ERROR
libstdc++.ERROR

Added Tests - KFAIL
TOTAL.KFAIL
g++.KFAIL
gcc.KFAIL
libstdc++.KFAIL

Added Tests - OTHER
TOTAL.OTHER
g++.OTHER
gcc.OTHER
libstdc++.OTHER

Added Tests - UNRESOLVED
g++.UNRESOLVED

Added Tests - UNTESTED
TOTAL.UNTESTED
g++.UNTESTED
gcc.UNTESTED
libstdc++.UNTESTED

Added Tests - XPASS
gcc.XPASS

Added Tests - all
TOTAL.all

Added Tests - fails
TOTAL.fails

Added Tests - flaky
TOTAL.flaky


Report Time: 0.35s
Name Current %
TOTAL.PASS 392710.000 -
g++.PASS 217949.000 -
gcc.PASS 159079.000 -
libstdc++.PASS 15682.000 -
Geometric Mean 120881.624 -
Name Current %
TOTAL.XPASS 16.000 -
g++.XPASS 14.000 -
gcc.XPASS 0.000 -
libstdc++.XPASS 2.000 -
Geometric Mean 0.460 -93.99%
Name Current %
TOTAL.FAIL 1183.000 -
g++.FAIL 85.000 2.41%
gcc.FAIL 1082.000 -
libstdc++.FAIL 16.000 -
Geometric Mean 204.262 -
Name Current %
TOTAL.XFAIL 2919.000 -2.86%
g++.XFAIL 1760.000 -4.97%
gcc.XFAIL 1028.000 -
libstdc++.XFAIL 131.000 -
Geometric Mean 912.017 -1.84%
Name Current %
TOTAL.KFAIL 0.000 -
g++.KFAIL 0.000 -
gcc.KFAIL 0.000 -
libstdc++.KFAIL 0.000 -
Geometric Mean 0.000 -
Name Current %
TOTAL.UNSUPPORTED 21545.000 -
g++.UNSUPPORTED 11656.000 -
gcc.UNSUPPORTED 8874.000 -
libstdc++.UNSUPPORTED 1015.000 -
Geometric Mean 6896.367 -
Name Current %
TOTAL.ERROR 0.000 -
g++.ERROR 0.000 -
gcc.ERROR 0.000 -
libstdc++.ERROR 0.000 -
Geometric Mean 0.000 -
Name Current %
TOTAL.OTHER 0.000 -
g++.OTHER 0.000 -
gcc.OTHER 0.000 -
libstdc++.OTHER 0.000 -
Geometric Mean 0.000 -
Name Current %
TOTAL.good 417174.000 -
g++.good 231365.000 -
gcc.good 168981.000 -
libstdc++.good 16828.000 -
Geometric Mean 128712.676 -
bad
Name Current %
TOTAL.bad 1225.000 -
g++.bad 99.000 2.06%
gcc.bad 1106.000 -
libstdc++.bad 20.000 -
Geometric Mean 227.583 -
Name Current %
TOTAL.fails 1225.000 -
Geometric Mean 1225.000 -
Name Current %
TOTAL.flaky 20.000 300.00%
Geometric Mean 20.000 300.00%
all
Name Current %
TOTAL.all 418399.000 -
Geometric Mean 418399.000 -