Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=8a950d80d54a751a40cc38b9ae56d7266e95c3fd (+ 16 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/dedf453477aa966493541a484b2d4ee5a17e5b61 (+ 111 commits)
git_gdb https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=8a950d80d54a751a40cc38b9ae56d7266e95c3fd (+ 16 commits)
git_newlib https://sourceware.org/git/?p=newlib-cygwin.git;a=commit;h=1b3dcfdc6f1fd2bd3e1ef2f8b7df736c076c6042 (+ 4 commits)
git_qemu https://gitlab.com/qemu-project/qemu/commit/e638d685ec2a0700fb9529cbd1b2823ac4120c53 (+ 2 commits)
test_url https://ci.linaro.org/job/tcwg_gnu_embed_check_binutils--master-thumb_m33_hard_eabi-build/48/
Filter

master-thumb_m33_hard_eabi test results

Run Order Start Time Duration
Current 0048 (5-changed-components) 2024-09-01T08:41:38 0:00:00
Previous 0047 (4-changed-components) 2024-08-28T23:39:11 0:00:00
Baseline 0018 (5-changed-components) 2024-06-01T11:10:10 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 7 7
Performance Improvements 0 1
Added Tests 29 29
Unchanged Tests 729 728
Total Tests 765

Performance Regressions - PASS Δ Previous Current σ Δ (B) σ (B)
binutils.PASS -7.25% 262.000 243.000 - -6.18% -

Performance Regressions - UNSUPPORTED Δ Previous Current σ Δ (B) σ (B)
binutils.UNSUPPORTED 23.08% 13.000 16.000 - 23.08% -
TOTAL.UNSUPPORTED 1.10% 273.000 276.000 - 1.47% -

Performance Regressions - UNTESTED Δ Previous Current σ Δ (B) σ (B)
TOTAL.UNTESTED 60.00% 20.000 32.000 - 60.00% -

Performance Regressions - bad Δ Previous Current σ Δ (B) σ (B)
binutils.bad 1100.00% 1.000 12.000 - 1100.00% -
TOTAL.bad 52.38% 21.000 32.000 - 52.38% -

Performance Regressions - good Δ Previous Current σ Δ (B) σ (B)
binutils.good -5.80% 276.000 260.000 - -4.76% -

Added Tests - ERROR
TOTAL.ERROR
binutils.ERROR
gas.ERROR
ld.ERROR

Added Tests - FAIL
TOTAL.FAIL
binutils.FAIL
gas.FAIL
ld.FAIL

Added Tests - KFAIL
TOTAL.KFAIL
binutils.KFAIL
gas.KFAIL
ld.KFAIL

Added Tests - OTHER
TOTAL.OTHER
binutils.OTHER
gas.OTHER
ld.OTHER

Added Tests - UNRESOLVED
TOTAL.UNRESOLVED
binutils.UNRESOLVED
gas.UNRESOLVED
ld.UNRESOLVED

Added Tests - UNTESTED
gas.UNTESTED

Added Tests - XFAIL
gas.XFAIL

Added Tests - XPASS
TOTAL.XPASS
binutils.XPASS
gas.XPASS
ld.XPASS

Added Tests - bad
gas.bad

Added Tests - fails
TOTAL.fails

Added Tests - flaky
TOTAL.flaky

Performance Regressions - PASS Δ (B) Baseline Current σ (B) Δ σ
binutils.PASS -6.18% 259.000 243.000 - -7.25% -

Performance Regressions - UNSUPPORTED Δ (B) Baseline Current σ (B) Δ σ
binutils.UNSUPPORTED 23.08% 13.000 16.000 - 23.08% -
TOTAL.UNSUPPORTED 1.47% 272.000 276.000 - 1.10% -

Performance Regressions - UNTESTED Δ (B) Baseline Current σ (B) Δ σ
TOTAL.UNTESTED 60.00% 20.000 32.000 - 60.00% -

Performance Regressions - bad Δ (B) Baseline Current σ (B) Δ σ
binutils.bad 1100.00% 1.000 12.000 - 1100.00% -
TOTAL.bad 52.38% 21.000 32.000 - 52.38% -

Performance Regressions - good Δ (B) Baseline Current σ (B) Δ σ
binutils.good -4.76% 273.000 260.000 - -5.80% -

Performance Improvements - UNSUPPORTED Δ (B) Baseline Current σ (B) Δ σ
gas.UNSUPPORTED -11.11% 9.000 8.000 - 0.00% -

Added Tests - ERROR
TOTAL.ERROR
binutils.ERROR
gas.ERROR
ld.ERROR

Added Tests - FAIL
TOTAL.FAIL
binutils.FAIL
gas.FAIL
ld.FAIL

Added Tests - KFAIL
TOTAL.KFAIL
binutils.KFAIL
gas.KFAIL
ld.KFAIL

Added Tests - OTHER
TOTAL.OTHER
binutils.OTHER
gas.OTHER
ld.OTHER

Added Tests - UNRESOLVED
TOTAL.UNRESOLVED
binutils.UNRESOLVED
gas.UNRESOLVED
ld.UNRESOLVED

Added Tests - UNTESTED
gas.UNTESTED

Added Tests - XFAIL
gas.XFAIL

Added Tests - XPASS
TOTAL.XPASS
binutils.XPASS
gas.XPASS
ld.XPASS

Added Tests - bad
gas.bad

Added Tests - fails
TOTAL.fails

Added Tests - flaky
TOTAL.flaky


Report Time: 0.22s
Name Current %
TOTAL.PASS 2419.000 -
binutils.PASS 243.000 -7.25%
gas.PASS 1297.000 -
ld.PASS 879.000 -
Geometric Mean 904.780 -2.02%
Name Current %
TOTAL.XPASS 0.000 -
binutils.XPASS 0.000 -
gas.XPASS 0.000 -
ld.XPASS 0.000 -
Geometric Mean 0.000 -
Name Current %
TOTAL.FAIL 0.000 -
binutils.FAIL 0.000 -
gas.FAIL 0.000 -
ld.FAIL 0.000 -
Geometric Mean 0.000 -
Name Current %
TOTAL.XFAIL 12.000 -
binutils.XFAIL 1.000 -
gas.XFAIL 0.000 -
ld.XFAIL 11.000 -
Geometric Mean 0.339 -93.34%
Name Current %
TOTAL.KFAIL 0.000 -
binutils.KFAIL 0.000 -
gas.KFAIL 0.000 -
ld.KFAIL 0.000 -
Geometric Mean 0.000 -
Name Current %
TOTAL.UNSUPPORTED 276.000 1.10%
binutils.UNSUPPORTED 16.000 23.08%
gas.UNSUPPORTED 8.000 -
ld.UNSUPPORTED 252.000 -
Geometric Mean 54.624 5.62%
Name Current %
TOTAL.UNTESTED 32.000 60.00%
binutils.UNTESTED 12.000 -
gas.UNTESTED 0.000 -
ld.UNTESTED 20.000 -
Geometric Mean 0.936 173.78%
Name Current %
TOTAL.ERROR 0.000 -
binutils.ERROR 0.000 -
gas.ERROR 0.000 -
ld.ERROR 0.000 -
Geometric Mean 0.000 -
Name Current %
TOTAL.OTHER 0.000 -
binutils.OTHER 0.000 -
gas.OTHER 0.000 -
ld.OTHER 0.000 -
Geometric Mean 0.000 -
Name Current %
TOTAL.good 2707.000 -
binutils.good 260.000 -5.80%
gas.good 1305.000 -
ld.good 1142.000 -
Geometric Mean 1012.009 -1.60%
bad
Name Current %
TOTAL.bad 32.000 52.38%
binutils.bad 12.000 1100.00%
gas.bad 0.000 -
ld.bad 20.000 -
Geometric Mean 0.936 -87.50%
Name Current %
TOTAL.fails 0.000 -
Geometric Mean 0.000 -
Name Current %
TOTAL.flaky 0.000 -
Geometric Mean 0.000 -
all
Name Current %
TOTAL.all 2739.000 -
Geometric Mean 2739.000 -