Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=42878336131e1b90623c5e2d7d011acc9b35c950 (+ 980 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/edd90d6d298f006e2c2e6c710ab97cd5ad733cb5 (+ 1996 commits)
git_gdb https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=42878336131e1b90623c5e2d7d011acc9b35c950 (+ 961 commits)
git_newlib https://sourceware.org/git/?p=newlib-cygwin.git;a=commit;h=10b921681108b333d17d8438a45afe6fbc1169dd (+ 75 commits)
git_qemu https://gitlab.com/qemu-project/qemu/commit/db2feb2df8d19592c9859efb3f682404e0052957 (+ 2433 commits)
test_url https://ci.linaro.org/job/tcwg_gnu_embed_check_binutils--master-arm_eabi-build/265/
Filter

master-arm_eabi test results

Run Order Start Time Duration
Current 0265 (5-changed-components) 2024-02-15T06:59:38 0:00:00
Previous 0051 (5-changed-components) 2023-06-14T14:14:35 0:00:00
Baseline 0011 (5-changed-components) 2023-06-05T16:56:22 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 1 8
Performance Improvements 11 8
Added Tests 27 27
Unchanged Tests 726 722
Total Tests 765

Performance Regressions - UNSUPPORTED Δ Previous Current σ Δ (B) σ (B)
ld.UNSUPPORTED 1.21% 247.000 250.000 - -36.87% -

Performance Improvements - PASS Δ Previous Current σ Δ (B) σ (B)
binutils.PASS 11.64% 232.000 259.000 - 2.78% -
ld.PASS 4.15% 843.000 878.000 - -32.62% -
TOTAL.PASS 2.93% 2354.000 2423.000 - -14.50% -

Performance Improvements - UNSUPPORTED Δ Previous Current σ Δ (B) σ (B)
binutils.UNSUPPORTED -7.14% 14.000 13.000 - 30.00% -

Performance Improvements - UNTESTED Δ Previous Current σ Δ (B) σ (B)
TOTAL.UNTESTED -35.48% 31.000 20.000 - 0.00% -

Performance Improvements - all Δ Previous Current σ Δ (B) σ (B)
TOTAL.all 2.29% 2666.000 2727.000 - -16.86% -

Performance Improvements - bad Δ Previous Current σ Δ (B) σ (B)
binutils.bad -90.91% 11.000 1.000 - 0.00% -
TOTAL.bad -32.26% 31.000 21.000 - 10.53% -

Performance Improvements - good Δ Previous Current σ Δ (B) σ (B)
binutils.good 10.53% 247.000 273.000 - 3.80% -
ld.good 3.45% 1101.000 1139.000 - -33.43% -
TOTAL.good 2.69% 2635.000 2706.000 - -17.02% -

Added Tests - ERROR
TOTAL.ERROR
binutils.ERROR
gas.ERROR
ld.ERROR

Added Tests - FAIL
gas.FAIL
ld.FAIL

Added Tests - KFAIL
TOTAL.KFAIL
binutils.KFAIL
gas.KFAIL
ld.KFAIL

Added Tests - OTHER
TOTAL.OTHER
binutils.OTHER
gas.OTHER
ld.OTHER

Added Tests - UNRESOLVED
TOTAL.UNRESOLVED
binutils.UNRESOLVED
gas.UNRESOLVED
ld.UNRESOLVED

Added Tests - UNTESTED
binutils.UNTESTED
gas.UNTESTED

Added Tests - XFAIL
gas.XFAIL

Added Tests - XPASS
TOTAL.XPASS
binutils.XPASS
gas.XPASS
ld.XPASS

Added Tests - bad
gas.bad

Added Tests - flaky
TOTAL.flaky

Performance Regressions - PASS Δ (B) Baseline Current σ (B) Δ σ
ld.PASS -32.62% 1303.000 878.000 - 4.15% -
TOTAL.PASS -14.50% 2834.000 2423.000 - 2.93% -

Performance Regressions - UNSUPPORTED Δ (B) Baseline Current σ (B) Δ σ
binutils.UNSUPPORTED 30.00% 10.000 13.000 - -7.14% -

Performance Regressions - all Δ (B) Baseline Current σ (B) Δ σ
TOTAL.all -16.86% 3280.000 2727.000 - 2.29% -

Performance Regressions - bad Δ (B) Baseline Current σ (B) Δ σ
ld.bad 11.11% 18.000 20.000 - 0.00% -
TOTAL.bad 10.53% 19.000 21.000 - -32.26% -

Performance Regressions - good Δ (B) Baseline Current σ (B) Δ σ
ld.good -33.43% 1711.000 1139.000 - 3.45% -
TOTAL.good -17.02% 3261.000 2706.000 - 2.69% -

Performance Improvements - FAIL Δ (B) Baseline Current σ (B) Δ σ
TOTAL.FAIL -94.74% 19.000 1.000 - 0.00% -

Performance Improvements - PASS Δ (B) Baseline Current σ (B) Δ σ
binutils.PASS 2.78% 252.000 259.000 - 11.64% -

Performance Improvements - UNSUPPORTED Δ (B) Baseline Current σ (B) Δ σ
ld.UNSUPPORTED -36.87% 396.000 250.000 - 1.21% -
TOTAL.UNSUPPORTED -34.54% 414.000 271.000 - 0.74% -

Performance Improvements - XFAIL Δ (B) Baseline Current σ (B) Δ σ
ld.XFAIL -8.33% 12.000 11.000 - 0.00% -
TOTAL.XFAIL -7.69% 13.000 12.000 - 0.00% -

Performance Improvements - fails Δ (B) Baseline Current σ (B) Δ σ
TOTAL.fails -94.74% 19.000 1.000 - 0.00% -

Performance Improvements - good Δ (B) Baseline Current σ (B) Δ σ
binutils.good 3.80% 263.000 273.000 - 10.53% -

Added Tests - ERROR
TOTAL.ERROR
binutils.ERROR
gas.ERROR
ld.ERROR

Added Tests - FAIL
gas.FAIL
ld.FAIL

Added Tests - KFAIL
TOTAL.KFAIL
binutils.KFAIL
gas.KFAIL
ld.KFAIL

Added Tests - OTHER
TOTAL.OTHER
binutils.OTHER
gas.OTHER
ld.OTHER

Added Tests - UNRESOLVED
TOTAL.UNRESOLVED
binutils.UNRESOLVED
gas.UNRESOLVED
ld.UNRESOLVED

Added Tests - UNTESTED
binutils.UNTESTED
gas.UNTESTED

Added Tests - XFAIL
gas.XFAIL

Added Tests - XPASS
TOTAL.XPASS
binutils.XPASS
gas.XPASS
ld.XPASS

Added Tests - bad
gas.bad

Added Tests - flaky
TOTAL.flaky


Report Time: 0.19s
Name Current %
TOTAL.PASS 2423.000 2.93%
binutils.PASS 259.000 11.64%
gas.PASS 1286.000 -
ld.PASS 878.000 4.15%
Geometric Mean 917.481 4.74%
Name Current %
TOTAL.XPASS 0.000 -
binutils.XPASS 0.000 -
gas.XPASS 0.000 -
ld.XPASS 0.000 -
Geometric Mean 0.000 -
Name Current %
TOTAL.FAIL 1.000 -
binutils.FAIL 1.000 -
gas.FAIL 0.000 -
ld.FAIL 0.000 -
Geometric Mean 0.010 -
Name Current %
TOTAL.XFAIL 12.000 -
binutils.XFAIL 1.000 -
gas.XFAIL 0.000 -
ld.XFAIL 11.000 -
Geometric Mean 0.339 -93.34%
Name Current %
TOTAL.KFAIL 0.000 -
binutils.KFAIL 0.000 -
gas.KFAIL 0.000 -
ld.KFAIL 0.000 -
Geometric Mean 0.000 -
Name Current %
TOTAL.UNSUPPORTED 271.000 -
binutils.UNSUPPORTED 13.000 -7.14%
gas.UNSUPPORTED 8.000 -
ld.UNSUPPORTED 250.000 1.21%
Geometric Mean 51.521 -1.36%
Name Current %
TOTAL.UNTESTED 20.000 -35.48%
binutils.UNTESTED 0.000 -
gas.UNTESTED 0.000 -
ld.UNTESTED 20.000 -
Geometric Mean 0.045 -99.82%
Name Current %
TOTAL.ERROR 0.000 -
binutils.ERROR 0.000 -
gas.ERROR 0.000 -
ld.ERROR 0.000 -
Geometric Mean 0.000 -
Name Current %
TOTAL.OTHER 0.000 -
binutils.OTHER 0.000 -
gas.OTHER 0.000 -
ld.OTHER 0.000 -
Geometric Mean 0.000 -
Name Current %
TOTAL.good 2706.000 2.69%
binutils.good 273.000 10.53%
gas.good 1294.000 -
ld.good 1139.000 3.45%
Geometric Mean 1021.497 4.24%
bad
Name Current %
TOTAL.bad 21.000 -32.26%
binutils.bad 1.000 -90.91%
gas.bad 0.000 -
ld.bad 20.000 -
Geometric Mean 0.453 -97.61%
Name Current %
TOTAL.fails 1.000 -
Geometric Mean 1.000 -
Name Current %
TOTAL.flaky 0.000 -
Geometric Mean 0.000 -
all
Name Current %
TOTAL.all 2727.000 2.29%
Geometric Mean 2727.000 2.29%