Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=004d34806331a0ca185c9bd65ac43adce11ac0f7 (+ 15 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/c01e3aaae79ecd439ad35063db3dee9775f3aefa (+ 48 commits)
git_gdb https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=004d34806331a0ca185c9bd65ac43adce11ac0f7 (+ 15 commits)
git_newlib https://sourceware.org/git/?p=newlib-cygwin.git;a=commit;h=1b7c72fdcc4bde7520407d2d3364146f04fb8312 (unchanged)
git_qemu https://gitlab.com/qemu-project/qemu/commit/2af37e791906cfda42cb9604a16d218e56994bb1 (+ 37 commits)
test_url https://ci.linaro.org/job/tcwg_gnu_embed_check_binutils--master-thumb_m23_eabi-build/176/
Filter

master-thumb_m23_eabi test results

Run Order Start Time Duration
Current 0176 (4-changed-components) 2024-10-05T00:07:26 0:00:00
Previous 0161 (4-changed-components) 2024-09-04T18:36:23 0:00:00
Baseline 0055 (5-changed-components) 2023-10-16T23:02:34 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 2 3
Performance Improvements 9 9
Added Tests 27 29
Unchanged Tests 727 724
Total Tests 765

Performance Regressions - UNSUPPORTED Δ Previous Current σ Δ (B) σ (B)
ld.UNSUPPORTED 8.73% 252.000 274.000 - 10.48% -
TOTAL.UNSUPPORTED 6.50% 277.000 295.000 - 10.49% -

Performance Improvements - PASS Δ Previous Current σ Δ (B) σ (B)
binutils.PASS 8.26% 242.000 262.000 - 2.34% -

Performance Improvements - UNSUPPORTED Δ Previous Current σ Δ (B) σ (B)
binutils.UNSUPPORTED -23.53% 17.000 13.000 - 30.00% -

Performance Improvements - UNTESTED Δ Previous Current σ Δ (B) σ (B)
TOTAL.UNTESTED -37.50% 32.000 20.000 - 0.00% -

Performance Improvements - all Δ Previous Current σ Δ (B) σ (B)
TOTAL.all 1.13% 2739.000 2770.000 - 0.00% -

Performance Improvements - bad Δ Previous Current σ Δ (B) σ (B)
binutils.bad -91.67% 12.000 1.000 - 0.00% -
TOTAL.bad -34.38% 32.000 21.000 - 0.00% -

Performance Improvements - good Δ Previous Current σ Δ (B) σ (B)
binutils.good 6.15% 260.000 276.000 - 3.37% -
ld.good 2.10% 1142.000 1166.000 - 4.29% -
TOTAL.good 1.55% 2707.000 2749.000 - 2.84% -

Added Tests - ERROR
TOTAL.ERROR
binutils.ERROR
gas.ERROR
ld.ERROR

Added Tests - FAIL
gas.FAIL
ld.FAIL

Added Tests - KFAIL
TOTAL.KFAIL
binutils.KFAIL
gas.KFAIL
ld.KFAIL

Added Tests - OTHER
TOTAL.OTHER
binutils.OTHER
gas.OTHER
ld.OTHER

Added Tests - UNRESOLVED
TOTAL.UNRESOLVED
binutils.UNRESOLVED
gas.UNRESOLVED
ld.UNRESOLVED

Added Tests - UNTESTED
binutils.UNTESTED
gas.UNTESTED

Added Tests - XFAIL
gas.XFAIL

Added Tests - XPASS
TOTAL.XPASS
binutils.XPASS
gas.XPASS
ld.XPASS

Added Tests - bad
gas.bad

Added Tests - flaky
TOTAL.flaky

Performance Regressions - UNSUPPORTED Δ (B) Baseline Current σ (B) Δ σ
binutils.UNSUPPORTED 30.00% 10.000 13.000 - -23.53% -
TOTAL.UNSUPPORTED 10.49% 267.000 295.000 - 6.50% -
ld.UNSUPPORTED 10.48% 248.000 274.000 - 8.73% -

Performance Improvements - PASS Δ (B) Baseline Current σ (B) Δ σ
ld.PASS 2.56% 859.000 881.000 - 0.23% -
binutils.PASS 2.34% 256.000 262.000 - 8.26% -
TOTAL.PASS 2.01% 2394.000 2442.000 - 0.99% -
gas.PASS 1.56% 1279.000 1299.000 - 0.15% -

Performance Improvements - UNSUPPORTED Δ (B) Baseline Current σ (B) Δ σ
gas.UNSUPPORTED -11.11% 9.000 8.000 - 0.00% -

Performance Improvements - good Δ (B) Baseline Current σ (B) Δ σ
ld.good 4.29% 1118.000 1166.000 - 2.10% -
binutils.good 3.37% 267.000 276.000 - 6.15% -
TOTAL.good 2.84% 2673.000 2749.000 - 1.55% -
gas.good 1.48% 1288.000 1307.000 - 0.15% -

Added Tests - ERROR
TOTAL.ERROR
binutils.ERROR
gas.ERROR
ld.ERROR

Added Tests - FAIL
gas.FAIL
ld.FAIL

Added Tests - KFAIL
TOTAL.KFAIL
binutils.KFAIL
gas.KFAIL
ld.KFAIL

Added Tests - OTHER
TOTAL.OTHER
binutils.OTHER
gas.OTHER
ld.OTHER

Added Tests - UNRESOLVED
TOTAL.UNRESOLVED
binutils.UNRESOLVED
gas.UNRESOLVED
ld.UNRESOLVED

Added Tests - UNTESTED
binutils.UNTESTED
gas.UNTESTED

Added Tests - XFAIL
gas.XFAIL

Added Tests - XPASS
TOTAL.XPASS
binutils.XPASS
gas.XPASS
ld.XPASS

Added Tests - all
TOTAL.all

Added Tests - bad
gas.bad

Added Tests - fails
TOTAL.fails

Added Tests - flaky
TOTAL.flaky


Report Time: 0.23s
Name Current %
TOTAL.PASS 2442.000 -
binutils.PASS 262.000 8.26%
gas.PASS 1299.000 -
ld.PASS 881.000 -
Geometric Mean 925.035 2.35%
Name Current %
TOTAL.XPASS 0.000 -
binutils.XPASS 0.000 -
gas.XPASS 0.000 -
ld.XPASS 0.000 -
Geometric Mean 0.000 -
Name Current %
TOTAL.FAIL 1.000 -
binutils.FAIL 1.000 -
gas.FAIL 0.000 -
ld.FAIL 0.000 -
Geometric Mean 0.010 -
Name Current %
TOTAL.XFAIL 12.000 -
binutils.XFAIL 1.000 -
gas.XFAIL 0.000 -
ld.XFAIL 11.000 -
Geometric Mean 0.339 -93.34%
Name Current %
TOTAL.KFAIL 0.000 -
binutils.KFAIL 0.000 -
gas.KFAIL 0.000 -
ld.KFAIL 0.000 -
Geometric Mean 0.000 -
Name Current %
TOTAL.UNSUPPORTED 295.000 6.50%
binutils.UNSUPPORTED 13.000 -23.53%
gas.UNSUPPORTED 8.000 -
ld.UNSUPPORTED 274.000 8.73%
Geometric Mean 53.846 -2.99%
Name Current %
TOTAL.UNTESTED 20.000 -37.50%
binutils.UNTESTED 0.000 -
gas.UNTESTED 0.000 -
ld.UNTESTED 20.000 -
Geometric Mean 0.045 -99.82%
Name Current %
TOTAL.ERROR 0.000 -
binutils.ERROR 0.000 -
gas.ERROR 0.000 -
ld.ERROR 0.000 -
Geometric Mean 0.000 -
Name Current %
TOTAL.OTHER 0.000 -
binutils.OTHER 0.000 -
gas.OTHER 0.000 -
ld.OTHER 0.000 -
Geometric Mean 0.000 -
Name Current %
TOTAL.good 2749.000 1.55%
binutils.good 276.000 6.15%
gas.good 1307.000 -
ld.good 1166.000 2.10%
Geometric Mean 1036.966 2.47%
bad
Name Current %
TOTAL.bad 21.000 -34.38%
binutils.bad 1.000 -91.67%
gas.bad 0.000 -
ld.bad 20.000 -
Geometric Mean 0.453 -97.71%
Name Current %
TOTAL.fails 1.000 -
Geometric Mean 1.000 -
Name Current %
TOTAL.flaky 0.000 -
Geometric Mean 0.000 -
all
Name Current %
TOTAL.all 2770.000 1.13%
Geometric Mean 2770.000 1.13%