Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=f6c714d65b7296b466089f7d0d0270a12d51742f (unchanged)
git_gcc https://github.com/gcc-mirror/gcc/commit/1f1c432226cf3db399b2a2a627e3c5720b02b1d6 (+ 1 commits)
git_gdb https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=f6c714d65b7296b466089f7d0d0270a12d51742f (unchanged)
git_newlib https://sourceware.org/git/?p=newlib-cygwin.git;a=commit;h=6bbeed74ca571b98af19dc7d52ce286f40c75229 (unchanged)
git_qemu https://gitlab.com/qemu-project/qemu/commit/0c1eccd368af8805ec0fb11e6cf25d0684d37328 (unchanged)
regression https://linaro.atlassian.net/browse/GNU-1062
test_url https://ci.linaro.org/job/tcwg_gnu_embed_check_gcc--master-thumb_m0_eabi-build/295/
Filter

master-thumb_m0_eabi test results

Run Order Start Time Duration
Current 0295 (basepoints/gcc-14-06129-g1f1c432226c) 2024-01-03T07:26:25 0:00:00
Previous 0298 (basepoints/gcc-14-06239-g08b7462d3ad) 2024-01-06T05:14:38 0:00:00
Baseline 0001 (5-changed-components) 2023-08-01T06:00:40 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 9 15
Performance Improvements 5 14
Added Tests 17 20
Unchanged Tests 734 716
Total Tests 765

Performance Regressions - FAIL Δ Previous Current σ Δ (B) σ (B)
gcc.FAIL 21.69% 166.000 202.000 - 405.00% -
TOTAL.FAIL 5.23% 306.000 322.000 - 212.62% -

Performance Regressions - UNRESOLVED Δ Previous Current σ Δ (B) σ (B)
gcc.UNRESOLVED 3.57% 28.000 29.000 - 383.33% -
TOTAL.UNRESOLVED 3.23% 31.000 32.000 - -3.03% -

Performance Regressions - XPASS Δ Previous Current σ Δ (B) σ (B)
g++.XPASS 57.14% 14.000 22.000 - 175.00% -
TOTAL.XPASS 36.36% 22.000 30.000 - 130.77% -

Performance Regressions - bad Δ Previous Current σ Δ (B) σ (B)
gcc.bad 18.50% 200.000 237.000 - 383.67% -
TOTAL.bad 6.96% 359.000 384.000 - 157.72% -

Performance Regressions - fails Δ Previous Current σ Δ (B) σ (B)
TOTAL.fails 6.96% 359.000 384.000 - 0.00% -

Performance Improvements - FAIL Δ Previous Current σ Δ (B) σ (B)
g++.FAIL -15.75% 127.000 107.000 - 224.24% -

Performance Improvements - XFAIL Δ Previous Current σ Δ (B) σ (B)
g++.XFAIL -6.05% 1619.000 1521.000 - 46.39% -
TOTAL.XFAIL -4.10% 2658.000 2549.000 - 28.28% -
gcc.XFAIL -1.21% 908.000 897.000 - 7.17% -

Performance Improvements - bad Δ Previous Current σ Δ (B) σ (B)
g++.bad -8.33% 144.000 132.000 - 200.00% -

Added Tests - ERROR
TOTAL.ERROR
g++.ERROR
gcc.ERROR
libstdc++.ERROR

Added Tests - KFAIL
TOTAL.KFAIL
g++.KFAIL
gcc.KFAIL
libstdc++.KFAIL

Added Tests - OTHER
TOTAL.OTHER
g++.OTHER
gcc.OTHER
libstdc++.OTHER

Added Tests - UNRESOLVED
libstdc++.UNRESOLVED

Added Tests - UNTESTED
TOTAL.UNTESTED
g++.UNTESTED
gcc.UNTESTED
libstdc++.UNTESTED

Performance Regressions - FAIL Δ (B) Baseline Current σ (B) Δ σ
gcc.FAIL 405.00% 40.000 202.000 - 21.69% -
g++.FAIL 224.24% 33.000 107.000 - -15.75% -
TOTAL.FAIL 212.62% 103.000 322.000 - 5.23% -

Performance Regressions - UNRESOLVED Δ (B) Baseline Current σ (B) Δ σ
gcc.UNRESOLVED 383.33% 6.000 29.000 - 3.57% -

Performance Regressions - UNSUPPORTED Δ (B) Baseline Current σ (B) Δ σ
libstdc++.UNSUPPORTED 4.92% 995.000 1044.000 - 0.00% -

Performance Regressions - XFAIL Δ (B) Baseline Current σ (B) Δ σ
g++.XFAIL 46.39% 1039.000 1521.000 - -6.05% -
TOTAL.XFAIL 28.28% 1987.000 2549.000 - -4.10% -
libstdc++.XFAIL 18.02% 111.000 131.000 - 0.00% -
gcc.XFAIL 7.17% 837.000 897.000 - -1.21% -

Performance Regressions - XPASS Δ (B) Baseline Current σ (B) Δ σ
g++.XPASS 175.00% 8.000 22.000 - 57.14% -
TOTAL.XPASS 130.77% 13.000 30.000 - 36.36% -
gcc.XPASS 100.00% 3.000 6.000 - 0.00% -

Performance Regressions - bad Δ (B) Baseline Current σ (B) Δ σ
gcc.bad 383.67% 49.000 237.000 - 18.50% -
g++.bad 200.00% 44.000 132.000 - -8.33% -
TOTAL.bad 157.72% 149.000 384.000 - 6.96% -

Performance Improvements - FAIL Δ (B) Baseline Current σ (B) Δ σ
libstdc++.FAIL -56.67% 30.000 13.000 - 0.00% -

Performance Improvements - PASS Δ (B) Baseline Current σ (B) Δ σ
libstdc++.PASS 15.31% 13472.000 15534.000 - -0.06% -
gcc.PASS 13.00% 128100.000 144747.000 - -0.81% -
TOTAL.PASS 11.64% 331210.000 369777.000 - -0.66% -
g++.PASS 10.47% 189638.000 209496.000 - -0.60% -

Performance Improvements - UNRESOLVED Δ (B) Baseline Current σ (B) Δ σ
TOTAL.UNRESOLVED -3.03% 33.000 32.000 - 3.23% -

Performance Improvements - UNSUPPORTED Δ (B) Baseline Current σ (B) Δ σ
gcc.UNSUPPORTED -31.00% 7126.000 4917.000 - -0.18% -
TOTAL.UNSUPPORTED -19.55% 21673.000 17437.000 - -0.09% -
g++.UNSUPPORTED -15.32% 13552.000 11476.000 - -0.05% -

Performance Improvements - bad Δ (B) Baseline Current σ (B) Δ σ
libstdc++.bad -73.21% 56.000 15.000 - 0.00% -

Performance Improvements - good Δ (B) Baseline Current σ (B) Δ σ
libstdc++.good 14.62% 14578.000 16709.000 - -0.06% -
gcc.good 10.66% 136063.000 150561.000 - -0.80% -
TOTAL.good 9.83% 354870.000 389763.000 - -0.66% -
g++.good 8.94% 204229.000 222493.000 - -0.61% -

Added Tests - ERROR
TOTAL.ERROR
g++.ERROR
gcc.ERROR
libstdc++.ERROR

Added Tests - KFAIL
TOTAL.KFAIL
g++.KFAIL
gcc.KFAIL
libstdc++.KFAIL

Added Tests - OTHER
TOTAL.OTHER
g++.OTHER
gcc.OTHER
libstdc++.OTHER

Added Tests - UNRESOLVED
libstdc++.UNRESOLVED

Added Tests - UNTESTED
TOTAL.UNTESTED
g++.UNTESTED
gcc.UNTESTED
libstdc++.UNTESTED

Added Tests - all
TOTAL.all

Added Tests - fails
TOTAL.fails

Added Tests - flaky
TOTAL.flaky


Report Time: 0.33s
Name Current %
TOTAL.PASS 369777.000 -
g++.PASS 209496.000 -
gcc.PASS 144747.000 -
libstdc++.PASS 15534.000 -
Geometric Mean 114882.037 -
Name Current %
TOTAL.XPASS 30.000 36.36%
g++.XPASS 22.000 57.14%
gcc.XPASS 6.000 -
libstdc++.XPASS 2.000 -
Geometric Mean 9.434 20.99%
Name Current %
TOTAL.FAIL 322.000 5.23%
g++.FAIL 107.000 -15.75%
gcc.FAIL 202.000 21.69%
libstdc++.FAIL 13.000 -
Geometric Mean 97.529 1.92%
Name Current %
TOTAL.XFAIL 2549.000 -4.10%
g++.XFAIL 1521.000 -6.05%
gcc.XFAIL 897.000 -1.21%
libstdc++.XFAIL 131.000 -
Geometric Mean 821.563 -2.87%
Name Current %
TOTAL.KFAIL 0.000 -
g++.KFAIL 0.000 -
gcc.KFAIL 0.000 -
libstdc++.KFAIL 0.000 -
Geometric Mean 0.000 -
Name Current %
TOTAL.UNSUPPORTED 17437.000 -
g++.UNSUPPORTED 11476.000 -
gcc.UNSUPPORTED 4917.000 -
libstdc++.UNSUPPORTED 1044.000 -
Geometric Mean 5661.295 -
Name Current %
TOTAL.UNRESOLVED 32.000 3.23%
g++.UNRESOLVED 3.000 -
gcc.UNRESOLVED 29.000 3.57%
libstdc++.UNRESOLVED 0.000 -
Geometric Mean 0.726 -94.72%
Name Current %
TOTAL.ERROR 0.000 -
g++.ERROR 0.000 -
gcc.ERROR 0.000 -
libstdc++.ERROR 0.000 -
Geometric Mean 0.000 -
Name Current %
TOTAL.OTHER 0.000 -
g++.OTHER 0.000 -
gcc.OTHER 0.000 -
libstdc++.OTHER 0.000 -
Geometric Mean 0.000 -
Name Current %
TOTAL.good 389763.000 -
g++.good 222493.000 -
gcc.good 150561.000 -
libstdc++.good 16709.000 -
Geometric Mean 121533.213 -
bad
Name Current %
TOTAL.bad 384.000 6.96%
g++.bad 132.000 -8.33%
gcc.bad 237.000 18.50%
libstdc++.bad 15.000 -
Geometric Mean 115.861 3.82%
Name Current %
TOTAL.fails 384.000 6.96%
Geometric Mean 384.000 6.96%
Name Current %
TOTAL.flaky 21.000 -
Geometric Mean 21.000 -
all
Name Current %
TOTAL.all 390147.000 -
Geometric Mean 390147.000 -