Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=d5cbf916be4a049580dfed8682f3f8795e57ecfa (+ 1 commits)
git_gcc https://gcc.gnu.org/git/gcc.git (fff5cfa4353e0c45400d8cb9cbff5c40c55fc97a) (unchanged)
git_gdb https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=77bcfb741cbec8cadec7a0d450a32c8a5b161f23 (unchanged)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=7f045c0b48633b198b42bebdff0024d7cfab3901 (unchanged)
git_linux https://gitlab.com/Linaro/lkft/mirrors/torvalds/linux-mainline/commit/c6d64479d6093a5c3d709d4cc992a5344877cc3c (unchanged)
git_qemu https://gitlab.com/qemu-project/qemu/commit/3428a3894c6fdf43bc07405090699b1de5013cfc (unchanged)
regression https://linaro.atlassian.net/browse/GNU-1427
test_url https://ci.linaro.org/job/tcwg_gnu_cross_check_binutils--master-arm-build/866/
Filter

master-arm test results

Run Order Start Time Duration
Current 0866 (binutils-2_41-release-04788-gd5cbf916be4) 2024-08-26T22:00:44 0:00:00
Previous 0926 (binutils-2_41-release-05322-gfd7728c8a4a) 2024-12-09T04:03:18 0:00:00
Baseline 0025 (6-changed-components) 2023-04-13T19:58:35 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 8 6
Performance Improvements 2 11
Added Tests 30 30
Unchanged Tests 725 718
Total Tests 765

Performance Regressions - PASS Δ Previous Current σ Δ (B) σ (B)
ld.PASS -1.26% 1750.000 1728.000 - 7.06% -

Performance Regressions - UNSUPPORTED Δ Previous Current σ Δ (B) σ (B)
gas.UNSUPPORTED 14.29% 7.000 8.000 - 0.00% -
ld.UNSUPPORTED 6.78% 398.000 425.000 - 12.43% -
TOTAL.UNSUPPORTED 6.76% 414.000 442.000 - 12.47% -

Performance Regressions - bad Δ Previous Current σ Δ (B) σ (B)
TOTAL.bad 250.00% 6.000 21.000 - 250.00% -
ld.bad 250.00% 6.000 21.000 - 250.00% -

Performance Regressions - fails Δ Previous Current σ Δ (B) σ (B)
TOTAL.fails 133.33% 6.000 14.000 - 133.33% -

Performance Regressions - good Δ Previous Current σ Δ (B) σ (B)
ld.good -1.09% 2205.000 2181.000 - 6.49% -

Performance Improvements - XFAIL Δ Previous Current σ Δ (B) σ (B)
ld.XFAIL -50.88% 57.000 28.000 - -50.00% -
TOTAL.XFAIL -50.00% 58.000 29.000 - -49.12% -

Added Tests - ERROR
TOTAL.ERROR
binutils.ERROR
gas.ERROR
ld.ERROR

Added Tests - FAIL
binutils.FAIL
gas.FAIL

Added Tests - KFAIL
TOTAL.KFAIL
binutils.KFAIL
gas.KFAIL
ld.KFAIL

Added Tests - OTHER
TOTAL.OTHER
binutils.OTHER
gas.OTHER
ld.OTHER

Added Tests - UNRESOLVED
TOTAL.UNRESOLVED
binutils.UNRESOLVED
gas.UNRESOLVED
ld.UNRESOLVED

Added Tests - UNTESTED
TOTAL.UNTESTED
binutils.UNTESTED
gas.UNTESTED
ld.UNTESTED

Added Tests - XFAIL
gas.XFAIL

Added Tests - XPASS
TOTAL.XPASS
binutils.XPASS
gas.XPASS
ld.XPASS

Added Tests - bad
binutils.bad
gas.bad

Added Tests - flaky
TOTAL.flaky

Performance Regressions - UNSUPPORTED Δ (B) Baseline Current σ (B) Δ σ
binutils.UNSUPPORTED 28.57% 7.000 9.000 - 0.00% -
TOTAL.UNSUPPORTED 12.47% 393.000 442.000 - 6.76% -
ld.UNSUPPORTED 12.43% 378.000 425.000 - 6.78% -

Performance Regressions - bad Δ (B) Baseline Current σ (B) Δ σ
TOTAL.bad 250.00% 6.000 21.000 - 250.00% -
ld.bad 250.00% 6.000 21.000 - 250.00% -

Performance Regressions - fails Δ (B) Baseline Current σ (B) Δ σ
TOTAL.fails 133.33% 6.000 14.000 - 133.33% -

Performance Improvements - PASS Δ (B) Baseline Current σ (B) Δ σ
ld.PASS 7.06% 1614.000 1728.000 - -1.26% -
TOTAL.PASS 4.61% 3148.000 3293.000 - -0.93% -
binutils.PASS 4.30% 256.000 267.000 - -0.37% -
gas.PASS 1.56% 1278.000 1298.000 - -0.61% -

Performance Improvements - XFAIL Δ (B) Baseline Current σ (B) Δ σ
ld.XFAIL -50.00% 56.000 28.000 - -50.88% -
TOTAL.XFAIL -49.12% 57.000 29.000 - -50.00% -

Performance Improvements - all Δ (B) Baseline Current σ (B) Δ σ
TOTAL.all 5.02% 3604.000 3785.000 - -0.45% -

Performance Improvements - good Δ (B) Baseline Current σ (B) Δ σ
ld.good 6.49% 2048.000 2181.000 - -1.09% -
binutils.good 4.92% 264.000 277.000 - -0.36% -
TOTAL.good 4.61% 3598.000 3764.000 - -0.84% -
gas.good 1.56% 1286.000 1306.000 - -0.53% -

Added Tests - ERROR
TOTAL.ERROR
binutils.ERROR
gas.ERROR
ld.ERROR

Added Tests - FAIL
binutils.FAIL
gas.FAIL

Added Tests - KFAIL
TOTAL.KFAIL
binutils.KFAIL
gas.KFAIL
ld.KFAIL

Added Tests - OTHER
TOTAL.OTHER
binutils.OTHER
gas.OTHER
ld.OTHER

Added Tests - UNRESOLVED
TOTAL.UNRESOLVED
binutils.UNRESOLVED
gas.UNRESOLVED
ld.UNRESOLVED

Added Tests - UNTESTED
TOTAL.UNTESTED
binutils.UNTESTED
gas.UNTESTED
ld.UNTESTED

Added Tests - XFAIL
gas.XFAIL

Added Tests - XPASS
TOTAL.XPASS
binutils.XPASS
gas.XPASS
ld.XPASS

Added Tests - bad
binutils.bad
gas.bad

Added Tests - flaky
TOTAL.flaky


Report Time: 0.19s
Name Current %
TOTAL.PASS 3293.000 -
binutils.PASS 267.000 -
gas.PASS 1298.000 -
ld.PASS 1728.000 -1.26%
Geometric Mean 1185.033 -
Name Current %
TOTAL.XPASS 0.000 -
binutils.XPASS 0.000 -
gas.XPASS 0.000 -
ld.XPASS 0.000 -
Geometric Mean 0.000 -
Name Current %
TOTAL.FAIL 21.000 -
binutils.FAIL 0.000 -
gas.FAIL 0.000 -
ld.FAIL 21.000 -
Geometric Mean 0.046 -
Name Current %
TOTAL.XFAIL 29.000 -50.00%
binutils.XFAIL 1.000 -
gas.XFAIL 0.000 -
ld.XFAIL 28.000 -50.88%
Geometric Mean 0.534 -96.42%
Name Current %
TOTAL.KFAIL 0.000 -
binutils.KFAIL 0.000 -
gas.KFAIL 0.000 -
ld.KFAIL 0.000 -
Geometric Mean 0.000 -
Name Current %
TOTAL.UNSUPPORTED 442.000 6.76%
binutils.UNSUPPORTED 9.000 -
gas.UNSUPPORTED 8.000 14.29%
ld.UNSUPPORTED 425.000 6.78%
Geometric Mean 60.644 6.84%
Name Current %
TOTAL.ERROR 0.000 -
binutils.ERROR 0.000 -
gas.ERROR 0.000 -
ld.ERROR 0.000 -
Geometric Mean 0.000 -
Name Current %
TOTAL.OTHER 0.000 -
binutils.OTHER 0.000 -
gas.OTHER 0.000 -
ld.OTHER 0.000 -
Geometric Mean 0.000 -
Name Current %
TOTAL.good 3764.000 -
binutils.good 277.000 -
gas.good 1306.000 -
ld.good 2181.000 -1.09%
Geometric Mean 1312.750 -
bad
Name Current %
TOTAL.bad 21.000 250.00%
binutils.bad 0.000 -
gas.bad 0.000 -
ld.bad 21.000 250.00%
Geometric Mean 0.046 -99.24%
Name Current %
TOTAL.fails 14.000 133.33%
Geometric Mean 14.000 133.33%
Name Current %
TOTAL.flaky 0.000 -
Geometric Mean 0.000 -
all
Name Current %
TOTAL.all 3785.000 -
Geometric Mean 3785.000 -