Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=6a6744198309c2122fed4374b97ee170a3b2d3e2 (unchanged)
git_gcc https://github.com/gcc-mirror/gcc/commit/65b4cba9d6a9ffe9b4d4bdff90727a7064cc0e3b (+ 1 commits)
git_gdb https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=6a6744198309c2122fed4374b97ee170a3b2d3e2 (unchanged)
git_newlib https://sourceware.org/git/?p=newlib-cygwin.git;a=commit;h=084f848ab9a51d0125491a6f2a7a741f9df73218 (unchanged)
git_qemu https://gitlab.com/qemu-project/qemu/commit/14639717bf379480e937716fcaf1e72b47fd4c5f (unchanged)
regression https://linaro.atlassian.net/browse/GNU-1142
test_url https://ci.linaro.org/job/tcwg_gnu_embed_check_gcc--master-arm_v7a_softfp_eabi-build/395/
Filter

master-arm_v7a_softfp_eabi test results

Run Order Start Time Duration
Current 0395 (basepoints/gcc-14-08710-g65b4cba9d6a) 2024-02-02T06:43:24 0:00:00
Previous 0394 (basepoints/gcc-14-08709-g87d162383ed) 2024-02-02T05:29:32 0:00:00
Baseline 0243 (5-changed-components) 2023-10-17T06:57:04 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 4 13
Performance Improvements 0 12
Added Tests 17 20
Unchanged Tests 744 720
Total Tests 765

Performance Regressions - FAIL Δ Previous Current σ Δ (B) σ (B)
g++.FAIL 7.41% 81.000 87.000 - -6.45% -

Performance Regressions - UNRESOLVED Δ Previous Current σ Δ (B) σ (B)
TOTAL.UNRESOLVED 21.43% 28.000 34.000 - 41.67% -

Performance Regressions - bad Δ Previous Current σ Δ (B) σ (B)
g++.bad 12.63% 95.000 107.000 - -7.76% -

Performance Regressions - flaky Δ Previous Current σ Δ (B) σ (B)
TOTAL.flaky 42.86% 7.000 10.000 - 0.00% -

Added Tests - ERROR
TOTAL.ERROR
g++.ERROR
gcc.ERROR
libstdc++.ERROR

Added Tests - KFAIL
TOTAL.KFAIL
g++.KFAIL
gcc.KFAIL
libstdc++.KFAIL

Added Tests - OTHER
TOTAL.OTHER
g++.OTHER
gcc.OTHER
libstdc++.OTHER

Added Tests - UNTESTED
TOTAL.UNTESTED
g++.UNTESTED
gcc.UNTESTED
libstdc++.UNTESTED

Added Tests - XPASS
gcc.XPASS

Performance Regressions - FAIL Δ (B) Baseline Current σ (B) Δ σ
gcc.FAIL 1680.33% 61.000 1086.000 - 0.00% -
TOTAL.FAIL 616.27% 166.000 1189.000 - 0.51% -
libstdc++.FAIL 33.33% 12.000 16.000 - 0.00% -

Performance Regressions - UNRESOLVED Δ (B) Baseline Current σ (B) Δ σ
TOTAL.UNRESOLVED 41.67% 24.000 34.000 - 21.43% -
gcc.UNRESOLVED 8.33% 24.000 26.000 - 0.00% -

Performance Regressions - UNSUPPORTED Δ (B) Baseline Current σ (B) Δ σ
gcc.UNSUPPORTED 5.39% 8542.000 9002.000 - 0.00% -
TOTAL.UNSUPPORTED 4.32% 20843.000 21744.000 - 0.00% -
g++.UNSUPPORTED 3.87% 11287.000 11724.000 - 0.00% -

Performance Regressions - XFAIL Δ (B) Baseline Current σ (B) Δ σ
g++.XFAIL 10.76% 1673.000 1853.000 - 0.00% -
TOTAL.XFAIL 6.45% 2822.000 3004.000 - 0.00% -

Performance Regressions - bad Δ (B) Baseline Current σ (B) Δ σ
gcc.bad 1208.24% 85.000 1112.000 - 0.00% -
TOTAL.bad 476.28% 215.000 1239.000 - 0.98% -
libstdc++.bad 42.86% 14.000 20.000 - 0.00% -

Performance Improvements - FAIL Δ (B) Baseline Current σ (B) Δ σ
g++.FAIL -6.45% 93.000 87.000 - 7.41% -

Performance Improvements - PASS Δ (B) Baseline Current σ (B) Δ σ
g++.PASS 6.75% 206312.000 220247.000 - -0.00% -
TOTAL.PASS 4.99% 376816.000 395633.000 - -0.00% -
gcc.PASS 2.97% 155026.000 159625.000 - 0.00% -
libstdc++.PASS 1.83% 15478.000 15761.000 - 0.05% -

Performance Improvements - XPASS Δ (B) Baseline Current σ (B) Δ σ
g++.XPASS -39.13% 23.000 14.000 - 0.00% -
TOTAL.XPASS -36.00% 25.000 16.000 - 0.00% -

Performance Improvements - bad Δ (B) Baseline Current σ (B) Δ σ
g++.bad -7.76% 116.000 107.000 - 12.63% -

Performance Improvements - good Δ (B) Baseline Current σ (B) Δ σ
g++.good 6.64% 219272.000 233824.000 - -0.00% -
TOTAL.good 4.97% 400481.000 420381.000 - -0.00% -
gcc.good 3.07% 164586.000 169647.000 - 0.00% -
libstdc++.good 1.73% 16623.000 16910.000 - 0.05% -

Added Tests - ERROR
TOTAL.ERROR
g++.ERROR
gcc.ERROR
libstdc++.ERROR

Added Tests - KFAIL
TOTAL.KFAIL
g++.KFAIL
gcc.KFAIL
libstdc++.KFAIL

Added Tests - OTHER
TOTAL.OTHER
g++.OTHER
gcc.OTHER
libstdc++.OTHER

Added Tests - UNTESTED
TOTAL.UNTESTED
g++.UNTESTED
gcc.UNTESTED
libstdc++.UNTESTED

Added Tests - XPASS
gcc.XPASS

Added Tests - all
TOTAL.all

Added Tests - fails
TOTAL.fails

Added Tests - flaky
TOTAL.flaky


Report Time: 0.35s
Name Current %
TOTAL.PASS 395633.000 -
g++.PASS 220247.000 -
gcc.PASS 159625.000 -
libstdc++.PASS 15761.000 -
Geometric Mean 121680.728 -
Name Current %
TOTAL.XPASS 16.000 -
g++.XPASS 14.000 -
gcc.XPASS 0.000 -
libstdc++.XPASS 2.000 -
Geometric Mean 0.460 -93.99%
Name Current %
TOTAL.FAIL 1189.000 -
g++.FAIL 87.000 7.41%
gcc.FAIL 1086.000 -
libstdc++.FAIL 16.000 -
Geometric Mean 205.903 1.93%
Name Current %
TOTAL.XFAIL 3004.000 -
g++.XFAIL 1853.000 -
gcc.XFAIL 1020.000 -
libstdc++.XFAIL 131.000 -
Geometric Mean 928.671 -
Name Current %
TOTAL.KFAIL 0.000 -
g++.KFAIL 0.000 -
gcc.KFAIL 0.000 -
libstdc++.KFAIL 0.000 -
Geometric Mean 0.000 -
Name Current %
TOTAL.UNSUPPORTED 21744.000 -
g++.UNSUPPORTED 11724.000 -
gcc.UNSUPPORTED 9002.000 -
libstdc++.UNSUPPORTED 1018.000 -
Geometric Mean 6952.252 -
Name Current %
TOTAL.UNRESOLVED 34.000 21.43%
g++.UNRESOLVED 6.000 -
gcc.UNRESOLVED 26.000 -
libstdc++.UNRESOLVED 2.000 -
Geometric Mean 10.149 1543.18%
Name Current %
TOTAL.ERROR 0.000 -
g++.ERROR 0.000 -
gcc.ERROR 0.000 -
libstdc++.ERROR 0.000 -
Geometric Mean 0.000 -
Name Current %
TOTAL.OTHER 0.000 -
g++.OTHER 0.000 -
gcc.OTHER 0.000 -
libstdc++.OTHER 0.000 -
Geometric Mean 0.000 -
Name Current %
TOTAL.good 420381.000 -
g++.good 233824.000 -
gcc.good 169647.000 -
libstdc++.good 16910.000 -
Geometric Mean 129585.226 -
bad
Name Current %
TOTAL.bad 1239.000 -
g++.bad 107.000 12.63%
gcc.bad 1112.000 -
libstdc++.bad 20.000 -
Geometric Mean 233.023 3.27%
Name Current %
TOTAL.fails 1239.000 -
Geometric Mean 1239.000 -
Name Current %
TOTAL.flaky 10.000 42.86%
Geometric Mean 10.000 42.86%
all
Name Current %
TOTAL.all 421620.000 -
Geometric Mean 421620.000 -