Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=d5cbf916be4a049580dfed8682f3f8795e57ecfa (+ 1 commits)
git_gcc https://gcc.gnu.org/git/gcc.git (fff5cfa4353e0c45400d8cb9cbff5c40c55fc97a) (unchanged)
git_gdb https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=77bcfb741cbec8cadec7a0d450a32c8a5b161f23 (unchanged)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=7f045c0b48633b198b42bebdff0024d7cfab3901 (unchanged)
git_linux https://gitlab.com/Linaro/lkft/mirrors/torvalds/linux-mainline/commit/c6d64479d6093a5c3d709d4cc992a5344877cc3c (unchanged)
git_qemu https://gitlab.com/qemu-project/qemu/commit/3428a3894c6fdf43bc07405090699b1de5013cfc (unchanged)
regression https://linaro.atlassian.net/browse/GNU-1427
test_url https://ci.linaro.org/job/tcwg_gnu_cross_check_binutils--master-arm-build/866/
Filter

master-arm test results

Run Order Start Time Duration
Current 0866 (binutils-2_41-release-04788-gd5cbf916be4) 2024-08-26T22:00:44 0:00:00
Previous 0719 (6-changed-components) 2023-12-18T10:45:38 0:00:00
Baseline 0025 (6-changed-components) 2023-04-13T19:58:35 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 7 6
Performance Improvements 9 11
Added Tests 30 30
Unchanged Tests 719 718
Total Tests 765

Performance Regressions - FAIL Δ Previous Current σ Δ (B) σ (B)
TOTAL.FAIL 2000.00% 1.000 21.000 - 0.00% -
ld.FAIL 2000.00% 1.000 21.000 - 0.00% -

Performance Regressions - UNSUPPORTED Δ Previous Current σ Δ (B) σ (B)
ld.UNSUPPORTED 7.05% 397.000 425.000 - 12.43% -
TOTAL.UNSUPPORTED 6.76% 414.000 442.000 - 12.47% -

Performance Regressions - bad Δ Previous Current σ Δ (B) σ (B)
TOTAL.bad 31.25% 16.000 21.000 - 250.00% -
ld.bad 31.25% 16.000 21.000 - 250.00% -

Performance Regressions - fails Δ Previous Current σ Δ (B) σ (B)
TOTAL.fails 27.27% 11.000 14.000 - 133.33% -

Performance Improvements - PASS Δ Previous Current σ Δ (B) σ (B)
ld.PASS 1.89% 1696.000 1728.000 - 7.06% -
TOTAL.PASS 1.42% 3247.000 3293.000 - 4.61% -
binutils.PASS 1.14% 264.000 267.000 - 4.30% -

Performance Improvements - XFAIL Δ Previous Current σ Δ (B) σ (B)
ld.XFAIL -50.88% 57.000 28.000 - -50.00% -
TOTAL.XFAIL -50.00% 58.000 29.000 - -49.12% -

Performance Improvements - all Δ Previous Current σ Δ (B) σ (B)
TOTAL.all 1.47% 3730.000 3785.000 - 5.02% -

Performance Improvements - good Δ Previous Current σ Δ (B) σ (B)
ld.good 1.44% 2150.000 2181.000 - 6.49% -
TOTAL.good 1.21% 3719.000 3764.000 - 4.61% -
binutils.good 1.09% 274.000 277.000 - 4.92% -

Added Tests - ERROR
TOTAL.ERROR
binutils.ERROR
gas.ERROR
ld.ERROR

Added Tests - FAIL
binutils.FAIL
gas.FAIL

Added Tests - KFAIL
TOTAL.KFAIL
binutils.KFAIL
gas.KFAIL
ld.KFAIL

Added Tests - OTHER
TOTAL.OTHER
binutils.OTHER
gas.OTHER
ld.OTHER

Added Tests - UNRESOLVED
TOTAL.UNRESOLVED
binutils.UNRESOLVED
gas.UNRESOLVED
ld.UNRESOLVED

Added Tests - UNTESTED
TOTAL.UNTESTED
binutils.UNTESTED
gas.UNTESTED
ld.UNTESTED

Added Tests - XFAIL
gas.XFAIL

Added Tests - XPASS
TOTAL.XPASS
binutils.XPASS
gas.XPASS
ld.XPASS

Added Tests - bad
binutils.bad
gas.bad

Added Tests - flaky
TOTAL.flaky

Performance Regressions - UNSUPPORTED Δ (B) Baseline Current σ (B) Δ σ
binutils.UNSUPPORTED 28.57% 7.000 9.000 - 0.00% -
TOTAL.UNSUPPORTED 12.47% 393.000 442.000 - 6.76% -
ld.UNSUPPORTED 12.43% 378.000 425.000 - 7.05% -

Performance Regressions - bad Δ (B) Baseline Current σ (B) Δ σ
TOTAL.bad 250.00% 6.000 21.000 - 31.25% -
ld.bad 250.00% 6.000 21.000 - 31.25% -

Performance Regressions - fails Δ (B) Baseline Current σ (B) Δ σ
TOTAL.fails 133.33% 6.000 14.000 - 27.27% -

Performance Improvements - PASS Δ (B) Baseline Current σ (B) Δ σ
ld.PASS 7.06% 1614.000 1728.000 - 1.89% -
TOTAL.PASS 4.61% 3148.000 3293.000 - 1.42% -
binutils.PASS 4.30% 256.000 267.000 - 1.14% -
gas.PASS 1.56% 1278.000 1298.000 - 0.85% -

Performance Improvements - XFAIL Δ (B) Baseline Current σ (B) Δ σ
ld.XFAIL -50.00% 56.000 28.000 - -50.88% -
TOTAL.XFAIL -49.12% 57.000 29.000 - -50.00% -

Performance Improvements - all Δ (B) Baseline Current σ (B) Δ σ
TOTAL.all 5.02% 3604.000 3785.000 - 1.47% -

Performance Improvements - good Δ (B) Baseline Current σ (B) Δ σ
ld.good 6.49% 2048.000 2181.000 - 1.44% -
binutils.good 4.92% 264.000 277.000 - 1.09% -
TOTAL.good 4.61% 3598.000 3764.000 - 1.21% -
gas.good 1.56% 1286.000 1306.000 - 0.85% -

Added Tests - ERROR
TOTAL.ERROR
binutils.ERROR
gas.ERROR
ld.ERROR

Added Tests - FAIL
binutils.FAIL
gas.FAIL

Added Tests - KFAIL
TOTAL.KFAIL
binutils.KFAIL
gas.KFAIL
ld.KFAIL

Added Tests - OTHER
TOTAL.OTHER
binutils.OTHER
gas.OTHER
ld.OTHER

Added Tests - UNRESOLVED
TOTAL.UNRESOLVED
binutils.UNRESOLVED
gas.UNRESOLVED
ld.UNRESOLVED

Added Tests - UNTESTED
TOTAL.UNTESTED
binutils.UNTESTED
gas.UNTESTED
ld.UNTESTED

Added Tests - XFAIL
gas.XFAIL

Added Tests - XPASS
TOTAL.XPASS
binutils.XPASS
gas.XPASS
ld.XPASS

Added Tests - bad
binutils.bad
gas.bad

Added Tests - flaky
TOTAL.flaky


Report Time: 0.19s
Name Current %
TOTAL.PASS 3293.000 1.42%
binutils.PASS 267.000 1.14%
gas.PASS 1298.000 -
ld.PASS 1728.000 1.89%
Geometric Mean 1185.033 1.32%
Name Current %
TOTAL.XPASS 0.000 -
binutils.XPASS 0.000 -
gas.XPASS 0.000 -
ld.XPASS 0.000 -
Geometric Mean 0.000 -
Name Current %
TOTAL.FAIL 21.000 2000.00%
binutils.FAIL 0.000 -
gas.FAIL 0.000 -
ld.FAIL 21.000 2000.00%
Geometric Mean 0.046 -95.43%
Name Current %
TOTAL.XFAIL 29.000 -50.00%
binutils.XFAIL 1.000 -
gas.XFAIL 0.000 -
ld.XFAIL 28.000 -50.88%
Geometric Mean 0.534 -96.42%
Name Current %
TOTAL.KFAIL 0.000 -
binutils.KFAIL 0.000 -
gas.KFAIL 0.000 -
ld.KFAIL 0.000 -
Geometric Mean 0.000 -
Name Current %
TOTAL.UNSUPPORTED 442.000 6.76%
binutils.UNSUPPORTED 9.000 -
gas.UNSUPPORTED 8.000 -
ld.UNSUPPORTED 425.000 7.05%
Geometric Mean 60.644 3.40%
Name Current %
TOTAL.ERROR 0.000 -
binutils.ERROR 0.000 -
gas.ERROR 0.000 -
ld.ERROR 0.000 -
Geometric Mean 0.000 -
Name Current %
TOTAL.OTHER 0.000 -
binutils.OTHER 0.000 -
gas.OTHER 0.000 -
ld.OTHER 0.000 -
Geometric Mean 0.000 -
Name Current %
TOTAL.good 3764.000 1.21%
binutils.good 277.000 1.09%
gas.good 1306.000 -
ld.good 2181.000 1.44%
Geometric Mean 1312.750 1.15%
bad
Name Current %
TOTAL.bad 21.000 31.25%
binutils.bad 0.000 -
gas.bad 0.000 -
ld.bad 21.000 31.25%
Geometric Mean 0.046 -99.71%
Name Current %
TOTAL.fails 14.000 27.27%
Geometric Mean 14.000 27.27%
Name Current %
TOTAL.flaky 0.000 -
Geometric Mean 0.000 -
all
Name Current %
TOTAL.all 3785.000 1.47%
Geometric Mean 3785.000 1.47%