Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=5f22c5abdc68b8a6eab049a30412511b941f65d8 (+ 42 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/1c4ca595d817ae1e1139145f86cfb58899d376bd (+ 48 commits)
git_gdb https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=5f22c5abdc68b8a6eab049a30412511b941f65d8 (+ 42 commits)
git_newlib https://sourceware.org/git/?p=newlib-cygwin.git;a=commit;h=a9e8e3d1cb8235f513f4d8434509acf287494fcf (+ 1 commits)
git_qemu https://gitlab.com/qemu-project/qemu/commit/11a629d246e4e7785a6f0efb99bd15a32c04feda (+ 57 commits)
test_url https://ci.linaro.org/job/tcwg_gnu_embed_check_binutils--master-arm_eabi-build/189/
Filter

master-arm_eabi test results

Run Order Start Time Duration
Current 0189 (5-changed-components) 2023-09-23T22:14:01 0:00:00
Previous 0186 (5-changed-components) 2023-09-13T12:59:12 0:00:00
Baseline 0011 (5-changed-components) 2023-06-05T16:56:22 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 0 8
Performance Improvements 2 7
Added Tests 27 29
Unchanged Tests 736 721
Total Tests 765

Performance Improvements - PASS Δ Previous Current σ Δ (B) σ (B)
binutils.PASS 1.19% 252.000 255.000 - 1.19% -

Performance Improvements - good Δ Previous Current σ Δ (B) σ (B)
binutils.good 1.14% 264.000 267.000 - 1.52% -

Added Tests - ERROR
TOTAL.ERROR
binutils.ERROR
gas.ERROR
ld.ERROR

Added Tests - FAIL
gas.FAIL
ld.FAIL

Added Tests - KFAIL
TOTAL.KFAIL
binutils.KFAIL
gas.KFAIL
ld.KFAIL

Added Tests - OTHER
TOTAL.OTHER
binutils.OTHER
gas.OTHER
ld.OTHER

Added Tests - UNRESOLVED
TOTAL.UNRESOLVED
binutils.UNRESOLVED
gas.UNRESOLVED
ld.UNRESOLVED

Added Tests - UNTESTED
binutils.UNTESTED
gas.UNTESTED

Added Tests - XFAIL
gas.XFAIL

Added Tests - XPASS
TOTAL.XPASS
binutils.XPASS
gas.XPASS
ld.XPASS

Added Tests - bad
gas.bad

Added Tests - flaky
TOTAL.flaky

Performance Regressions - PASS Δ (B) Baseline Current σ (B) Δ σ
ld.PASS -34.08% 1303.000 859.000 - 0.00% -
TOTAL.PASS -15.56% 2834.000 2393.000 - 0.13% -

Performance Regressions - UNSUPPORTED Δ (B) Baseline Current σ (B) Δ σ
gas.UNSUPPORTED 12.50% 8.000 9.000 - 0.00% -
binutils.UNSUPPORTED 10.00% 10.000 11.000 - 0.00% -

Performance Regressions - bad Δ (B) Baseline Current σ (B) Δ σ
ld.bad 11.11% 18.000 20.000 - 0.00% -
TOTAL.bad 10.53% 19.000 21.000 - 0.00% -

Performance Regressions - good Δ (B) Baseline Current σ (B) Δ σ
ld.good -34.66% 1711.000 1118.000 - 0.00% -
TOTAL.good -18.03% 3261.000 2673.000 - 0.11% -

Performance Improvements - FAIL Δ (B) Baseline Current σ (B) Δ σ
TOTAL.FAIL -94.74% 19.000 1.000 - 0.00% -

Performance Improvements - PASS Δ (B) Baseline Current σ (B) Δ σ
binutils.PASS 1.19% 252.000 255.000 - 1.19% -

Performance Improvements - UNSUPPORTED Δ (B) Baseline Current σ (B) Δ σ
ld.UNSUPPORTED -37.37% 396.000 248.000 - 0.00% -
TOTAL.UNSUPPORTED -35.27% 414.000 268.000 - 0.00% -

Performance Improvements - XFAIL Δ (B) Baseline Current σ (B) Δ σ
ld.XFAIL -8.33% 12.000 11.000 - 0.00% -
TOTAL.XFAIL -7.69% 13.000 12.000 - 0.00% -

Performance Improvements - good Δ (B) Baseline Current σ (B) Δ σ
binutils.good 1.52% 263.000 267.000 - 1.14% -

Added Tests - ERROR
TOTAL.ERROR
binutils.ERROR
gas.ERROR
ld.ERROR

Added Tests - FAIL
gas.FAIL
ld.FAIL

Added Tests - KFAIL
TOTAL.KFAIL
binutils.KFAIL
gas.KFAIL
ld.KFAIL

Added Tests - OTHER
TOTAL.OTHER
binutils.OTHER
gas.OTHER
ld.OTHER

Added Tests - UNRESOLVED
TOTAL.UNRESOLVED
binutils.UNRESOLVED
gas.UNRESOLVED
ld.UNRESOLVED

Added Tests - UNTESTED
binutils.UNTESTED
gas.UNTESTED

Added Tests - XFAIL
gas.XFAIL

Added Tests - XPASS
TOTAL.XPASS
binutils.XPASS
gas.XPASS
ld.XPASS

Added Tests - all
TOTAL.all

Added Tests - bad
gas.bad

Added Tests - fails
TOTAL.fails

Added Tests - flaky
TOTAL.flaky


Report Time: 0.35s
Name Current %
TOTAL.PASS 2393.000 -
binutils.PASS 255.000 1.19%
gas.PASS 1279.000 -
ld.PASS 859.000 -
Geometric Mean 904.871 -
Name Current %
TOTAL.XPASS 0.000 -
binutils.XPASS 0.000 -
gas.XPASS 0.000 -
ld.XPASS 0.000 -
Geometric Mean 0.000 -
Name Current %
TOTAL.FAIL 1.000 -
binutils.FAIL 1.000 -
gas.FAIL 0.000 -
ld.FAIL 0.000 -
Geometric Mean 0.010 -99.01%
Name Current %
TOTAL.XFAIL 12.000 -
binutils.XFAIL 1.000 -
gas.XFAIL 0.000 -
ld.XFAIL 11.000 -
Geometric Mean 0.339 -93.34%
Name Current %
TOTAL.KFAIL 0.000 -
binutils.KFAIL 0.000 -
gas.KFAIL 0.000 -
ld.KFAIL 0.000 -
Geometric Mean 0.000 -
Name Current %
TOTAL.UNTESTED 20.000 -
binutils.UNTESTED 0.000 -
gas.UNTESTED 0.000 -
ld.UNTESTED 20.000 -
Geometric Mean 0.045 -99.78%
Name Current %
TOTAL.ERROR 0.000 -
binutils.ERROR 0.000 -
gas.ERROR 0.000 -
ld.ERROR 0.000 -
Geometric Mean 0.000 -
Name Current %
TOTAL.OTHER 0.000 -
binutils.OTHER 0.000 -
gas.OTHER 0.000 -
ld.OTHER 0.000 -
Geometric Mean 0.000 -
Name Current %
TOTAL.good 2673.000 -
binutils.good 267.000 1.14%
gas.good 1288.000 -
ld.good 1118.000 -
Geometric Mean 1006.855 -
bad
Name Current %
TOTAL.bad 21.000 -
binutils.bad 1.000 -
gas.bad 0.000 -
ld.bad 20.000 -
Geometric Mean 0.453 -93.96%
Name Current %
TOTAL.fails 1.000 -
Geometric Mean 1.000 -
Name Current %
TOTAL.flaky 0.000 -
Geometric Mean 0.000 -
all
Name Current %
TOTAL.all 2694.000 -
Geometric Mean 2694.000 -