Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=a77ccc81295f41b72f96db000d1aa44e4dc91254 (+ 1 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/5958279509c4601499ac22629512f1723e6744b4 (unchanged)
git_gdb https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=4290b2c07e2d9bc1e1661a4ad5e343e3eb307770 (unchanged)
git_newlib https://sourceware.org/git/?p=newlib-cygwin.git;a=commit;h=1b3dcfdc6f1fd2bd3e1ef2f8b7df736c076c6042 (unchanged)
git_qemu https://gitlab.com/qemu-project/qemu/commit/a4eb31c678400472de0b4915b9154a7c20d8332f (unchanged)
regression https://linaro.atlassian.net/browse/GNU-1341
test_url https://ci.linaro.org/job/tcwg_gnu_embed_check_binutils--master-thumb_m33_eabi-build/154/
Filter

master-thumb_m33_eabi test results

Run Order Start Time Duration
Current 0154 (binutils-2_41-release-04274-ga77ccc81295) 2024-09-11T05:40:40 0:00:00
Previous 0149 (4-changed-components) 2024-09-05T08:08:44 0:00:00
Baseline 0093 (5-changed-components) 2024-02-26T22:34:40 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 0 2
Performance Improvements 7 4
Added Tests 27 29
Unchanged Tests 731 730
Total Tests 765

Performance Improvements - PASS Δ Previous Current σ Δ (B) σ (B)
binutils.PASS 8.68% 242.000 263.000 - 2.33% -

Performance Improvements - UNSUPPORTED Δ Previous Current σ Δ (B) σ (B)
binutils.UNSUPPORTED -29.41% 17.000 12.000 - 20.00% -
TOTAL.UNSUPPORTED -1.81% 277.000 272.000 - 1.12% -

Performance Improvements - UNTESTED Δ Previous Current σ Δ (B) σ (B)
TOTAL.UNTESTED -37.50% 32.000 20.000 - 0.00% -

Performance Improvements - bad Δ Previous Current σ Δ (B) σ (B)
binutils.bad -91.67% 12.000 1.000 - 0.00% -
TOTAL.bad -34.38% 32.000 21.000 - 0.00% -

Performance Improvements - good Δ Previous Current σ Δ (B) σ (B)
binutils.good 6.15% 260.000 276.000 - 2.99% -

Added Tests - ERROR
TOTAL.ERROR
binutils.ERROR
gas.ERROR
ld.ERROR

Added Tests - FAIL
gas.FAIL
ld.FAIL

Added Tests - KFAIL
TOTAL.KFAIL
binutils.KFAIL
gas.KFAIL
ld.KFAIL

Added Tests - OTHER
TOTAL.OTHER
binutils.OTHER
gas.OTHER
ld.OTHER

Added Tests - UNRESOLVED
TOTAL.UNRESOLVED
binutils.UNRESOLVED
gas.UNRESOLVED
ld.UNRESOLVED

Added Tests - UNTESTED
binutils.UNTESTED
gas.UNTESTED

Added Tests - XFAIL
gas.XFAIL

Added Tests - XPASS
TOTAL.XPASS
binutils.XPASS
gas.XPASS
ld.XPASS

Added Tests - bad
gas.bad

Added Tests - flaky
TOTAL.flaky

Performance Regressions - UNSUPPORTED Δ (B) Baseline Current σ (B) Δ σ
binutils.UNSUPPORTED 20.00% 10.000 12.000 - -29.41% -
TOTAL.UNSUPPORTED 1.12% 269.000 272.000 - -1.81% -

Performance Improvements - PASS Δ (B) Baseline Current σ (B) Δ σ
binutils.PASS 2.33% 257.000 263.000 - 8.68% -
ld.PASS 1.03% 871.000 880.000 - 0.11% -

Performance Improvements - UNSUPPORTED Δ (B) Baseline Current σ (B) Δ σ
gas.UNSUPPORTED -11.11% 9.000 8.000 - 0.00% -

Performance Improvements - good Δ (B) Baseline Current σ (B) Δ σ
binutils.good 2.99% 268.000 276.000 - 6.15% -

Added Tests - ERROR
TOTAL.ERROR
binutils.ERROR
gas.ERROR
ld.ERROR

Added Tests - FAIL
gas.FAIL
ld.FAIL

Added Tests - KFAIL
TOTAL.KFAIL
binutils.KFAIL
gas.KFAIL
ld.KFAIL

Added Tests - OTHER
TOTAL.OTHER
binutils.OTHER
gas.OTHER
ld.OTHER

Added Tests - UNRESOLVED
TOTAL.UNRESOLVED
binutils.UNRESOLVED
gas.UNRESOLVED
ld.UNRESOLVED

Added Tests - UNTESTED
binutils.UNTESTED
gas.UNTESTED

Added Tests - XFAIL
gas.XFAIL

Added Tests - XPASS
TOTAL.XPASS
binutils.XPASS
gas.XPASS
ld.XPASS

Added Tests - all
TOTAL.all

Added Tests - bad
gas.bad

Added Tests - fails
TOTAL.fails

Added Tests - flaky
TOTAL.flaky


Report Time: 0.23s
Name Current %
TOTAL.PASS 2442.000 -
binutils.PASS 263.000 8.68%
gas.PASS 1299.000 -
ld.PASS 880.000 -
Geometric Mean 925.653 2.42%
Name Current %
TOTAL.XPASS 0.000 -
binutils.XPASS 0.000 -
gas.XPASS 0.000 -
ld.XPASS 0.000 -
Geometric Mean 0.000 -
Name Current %
TOTAL.FAIL 1.000 -
binutils.FAIL 1.000 -
gas.FAIL 0.000 -
ld.FAIL 0.000 -
Geometric Mean 0.010 -
Name Current %
TOTAL.XFAIL 12.000 -
binutils.XFAIL 1.000 -
gas.XFAIL 0.000 -
ld.XFAIL 11.000 -
Geometric Mean 0.339 -93.34%
Name Current %
TOTAL.KFAIL 0.000 -
binutils.KFAIL 0.000 -
gas.KFAIL 0.000 -
ld.KFAIL 0.000 -
Geometric Mean 0.000 -
Name Current %
TOTAL.UNSUPPORTED 272.000 -1.81%
binutils.UNSUPPORTED 12.000 -29.41%
gas.UNSUPPORTED 8.000 -
ld.UNSUPPORTED 252.000 -
Geometric Mean 50.648 -8.76%
Name Current %
TOTAL.UNTESTED 20.000 -37.50%
binutils.UNTESTED 0.000 -
gas.UNTESTED 0.000 -
ld.UNTESTED 20.000 -
Geometric Mean 0.045 -99.82%
Name Current %
TOTAL.ERROR 0.000 -
binutils.ERROR 0.000 -
gas.ERROR 0.000 -
ld.ERROR 0.000 -
Geometric Mean 0.000 -
Name Current %
TOTAL.OTHER 0.000 -
binutils.OTHER 0.000 -
gas.OTHER 0.000 -
ld.OTHER 0.000 -
Geometric Mean 0.000 -
Name Current %
TOTAL.good 2726.000 -
binutils.good 276.000 6.15%
gas.good 1307.000 -
ld.good 1143.000 -
Geometric Mean 1029.649 1.74%
bad
Name Current %
TOTAL.bad 21.000 -34.38%
binutils.bad 1.000 -91.67%
gas.bad 0.000 -
ld.bad 20.000 -
Geometric Mean 0.453 -97.71%
Name Current %
TOTAL.fails 1.000 -
Geometric Mean 1.000 -
Name Current %
TOTAL.flaky 0.000 -
Geometric Mean 0.000 -
all
Name Current %
TOTAL.all 2747.000 -
Geometric Mean 2747.000 -