Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=519d634396592c5698add4a327468e6e6920576e (unchanged)
git_gcc https://github.com/gcc-mirror/gcc/commit/fe1649eea76f193732d22ec022a35326523eb37a (+ 895 commits)
git_gdb https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=519d634396592c5698add4a327468e6e6920576e (unchanged)
git_newlib https://sourceware.org/git/?p=newlib-cygwin.git;a=commit;h=d45261f62a15f8abd94a1031020b9a9f455e4eed (unchanged)
git_qemu https://gitlab.com/qemu-project/qemu/commit/d0f4aa7d50d485b1fb5ec8ab6f934e5df852ab07 (unchanged)
test_url https://ci.linaro.org/job/tcwg_gnu_embed_check_gcc--master-thumb_m0_eabi-build/321/
Filter

master-thumb_m0_eabi test results

Run Order Start Time Duration
Current 0321 (basepoints/gcc-14-08167-gfe1649eea76) 2024-01-18T00:40:02 0:00:00
Previous 0295 (basepoints/gcc-14-06129-g1f1c432226c) 2024-01-03T07:26:25 0:00:00
Baseline 0001 (5-changed-components) 2023-08-01T06:00:40 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 8 14
Performance Improvements 18 14
Added Tests 16 19
Unchanged Tests 723 718
Total Tests 765

Performance Regressions - FAIL Δ Previous Current σ Δ (B) σ (B)
libstdc++.FAIL 15.38% 13.000 15.000 - -50.00% -

Performance Regressions - UNRESOLVED Δ Previous Current σ Δ (B) σ (B)
TOTAL.UNRESOLVED 3.12% 32.000 33.000 - 0.00% -

Performance Regressions - UNSUPPORTED Δ Previous Current σ Δ (B) σ (B)
gcc.UNSUPPORTED 1.61% 4917.000 4996.000 - -29.89% -
TOTAL.UNSUPPORTED 1.18% 17437.000 17643.000 - -18.59% -
g++.UNSUPPORTED 1.10% 11476.000 11602.000 - -14.39% -

Performance Regressions - XFAIL Δ Previous Current σ Δ (B) σ (B)
g++.XFAIL 12.56% 1521.000 1712.000 - 64.77% -
TOTAL.XFAIL 7.77% 2549.000 2747.000 - 38.25% -

Performance Regressions - bad Δ Previous Current σ Δ (B) σ (B)
libstdc++.bad 26.67% 15.000 19.000 - -66.07% -

Performance Improvements - FAIL Δ Previous Current σ Δ (B) σ (B)
gcc.FAIL -26.24% 202.000 149.000 - 272.50% -
TOTAL.FAIL -18.94% 322.000 261.000 - 153.40% -
g++.FAIL -9.35% 107.000 97.000 - 193.94% -

Performance Improvements - PASS Δ Previous Current σ Δ (B) σ (B)
g++.PASS 4.70% 209496.000 219340.000 - 15.66% -
TOTAL.PASS 3.15% 369777.000 381420.000 - 15.16% -
gcc.PASS 1.16% 144747.000 146431.000 - 14.31% -

Performance Improvements - UNRESOLVED Δ Previous Current σ Δ (B) σ (B)
gcc.UNRESOLVED -3.45% 29.000 28.000 - 366.67% -

Performance Improvements - XPASS Δ Previous Current σ Δ (B) σ (B)
gcc.XPASS -50.00% 6.000 3.000 - 0.00% -
TOTAL.XPASS -36.67% 30.000 19.000 - 46.15% -
g++.XPASS -36.36% 22.000 14.000 - 75.00% -

Performance Improvements - all Δ Previous Current σ Δ (B) σ (B)
TOTAL.all 3.07% 390147.000 402123.000 - 0.00% -

Performance Improvements - bad Δ Previous Current σ Δ (B) σ (B)
gcc.bad -24.05% 237.000 180.000 - 267.35% -
TOTAL.bad -18.49% 384.000 313.000 - 110.07% -
g++.bad -13.64% 132.000 114.000 - 159.09% -

Performance Improvements - fails Δ Previous Current σ Δ (B) σ (B)
TOTAL.fails -18.49% 384.000 313.000 - 0.00% -

Performance Improvements - good Δ Previous Current σ Δ (B) σ (B)
g++.good 4.57% 222493.000 232654.000 - 13.92% -
TOTAL.good 3.09% 389763.000 401810.000 - 13.23% -
gcc.good 1.18% 150561.000 152331.000 - 11.96% -

Added Tests - ERROR
TOTAL.ERROR
g++.ERROR
gcc.ERROR
libstdc++.ERROR

Added Tests - KFAIL
TOTAL.KFAIL
g++.KFAIL
gcc.KFAIL
libstdc++.KFAIL

Added Tests - OTHER
TOTAL.OTHER
g++.OTHER
gcc.OTHER
libstdc++.OTHER

Added Tests - UNTESTED
TOTAL.UNTESTED
g++.UNTESTED
gcc.UNTESTED
libstdc++.UNTESTED

Performance Regressions - FAIL Δ (B) Baseline Current σ (B) Δ σ
gcc.FAIL 272.50% 40.000 149.000 - -26.24% -
g++.FAIL 193.94% 33.000 97.000 - -9.35% -
TOTAL.FAIL 153.40% 103.000 261.000 - -18.94% -

Performance Regressions - UNRESOLVED Δ (B) Baseline Current σ (B) Δ σ
gcc.UNRESOLVED 366.67% 6.000 28.000 - -3.45% -

Performance Regressions - UNSUPPORTED Δ (B) Baseline Current σ (B) Δ σ
libstdc++.UNSUPPORTED 5.03% 995.000 1045.000 - 0.10% -

Performance Regressions - XFAIL Δ (B) Baseline Current σ (B) Δ σ
g++.XFAIL 64.77% 1039.000 1712.000 - 12.56% -
TOTAL.XFAIL 38.25% 1987.000 2747.000 - 7.77% -
libstdc++.XFAIL 18.02% 111.000 131.000 - 0.00% -
gcc.XFAIL 8.00% 837.000 904.000 - 0.78% -

Performance Regressions - XPASS Δ (B) Baseline Current σ (B) Δ σ
g++.XPASS 75.00% 8.000 14.000 - -36.36% -
TOTAL.XPASS 46.15% 13.000 19.000 - -36.67% -

Performance Regressions - bad Δ (B) Baseline Current σ (B) Δ σ
gcc.bad 267.35% 49.000 180.000 - -24.05% -
g++.bad 159.09% 44.000 114.000 - -13.64% -
TOTAL.bad 110.07% 149.000 313.000 - -18.49% -

Performance Improvements - FAIL Δ (B) Baseline Current σ (B) Δ σ
libstdc++.FAIL -50.00% 30.000 15.000 - 15.38% -

Performance Improvements - PASS Δ (B) Baseline Current σ (B) Δ σ
libstdc++.PASS 16.16% 13472.000 15649.000 - 0.74% -
g++.PASS 15.66% 189638.000 219340.000 - 4.70% -
TOTAL.PASS 15.16% 331210.000 381420.000 - 3.15% -
gcc.PASS 14.31% 128100.000 146431.000 - 1.16% -

Performance Improvements - UNRESOLVED Δ (B) Baseline Current σ (B) Δ σ
libstdc++.UNRESOLVED -91.67% 24.000 2.000 - 0.00% -

Performance Improvements - UNSUPPORTED Δ (B) Baseline Current σ (B) Δ σ
gcc.UNSUPPORTED -29.89% 7126.000 4996.000 - 1.61% -
TOTAL.UNSUPPORTED -18.59% 21673.000 17643.000 - 1.18% -
g++.UNSUPPORTED -14.39% 13552.000 11602.000 - 1.10% -

Performance Improvements - bad Δ (B) Baseline Current σ (B) Δ σ
libstdc++.bad -66.07% 56.000 19.000 - 26.67% -

Performance Improvements - good Δ (B) Baseline Current σ (B) Δ σ
libstdc++.good 15.41% 14578.000 16825.000 - 0.69% -
g++.good 13.92% 204229.000 232654.000 - 4.57% -
TOTAL.good 13.23% 354870.000 401810.000 - 3.09% -
gcc.good 11.96% 136063.000 152331.000 - 1.18% -

Added Tests - ERROR
TOTAL.ERROR
g++.ERROR
gcc.ERROR
libstdc++.ERROR

Added Tests - KFAIL
TOTAL.KFAIL
g++.KFAIL
gcc.KFAIL
libstdc++.KFAIL

Added Tests - OTHER
TOTAL.OTHER
g++.OTHER
gcc.OTHER
libstdc++.OTHER

Added Tests - UNTESTED
TOTAL.UNTESTED
g++.UNTESTED
gcc.UNTESTED
libstdc++.UNTESTED

Added Tests - all
TOTAL.all

Added Tests - fails
TOTAL.fails

Added Tests - flaky
TOTAL.flaky


Report Time: 0.35s
Name Current %
TOTAL.PASS 381420.000 3.15%
g++.PASS 219340.000 4.70%
gcc.PASS 146431.000 1.16%
libstdc++.PASS 15649.000 -
Geometric Mean 117668.504 2.43%
Name Current %
TOTAL.XPASS 19.000 -36.67%
g++.XPASS 14.000 -36.36%
gcc.XPASS 3.000 -50.00%
libstdc++.XPASS 2.000 -
Geometric Mean 6.321 -33.00%
Name Current %
TOTAL.FAIL 261.000 -18.94%
g++.FAIL 97.000 -9.35%
gcc.FAIL 149.000 -26.24%
libstdc++.FAIL 15.000 15.38%
Geometric Mean 86.731 -11.07%
Name Current %
TOTAL.XFAIL 2747.000 7.77%
g++.XFAIL 1712.000 12.56%
gcc.XFAIL 904.000 -
libstdc++.XFAIL 131.000 -
Geometric Mean 863.874 5.15%
Name Current %
TOTAL.KFAIL 0.000 -
g++.KFAIL 0.000 -
gcc.KFAIL 0.000 -
libstdc++.KFAIL 0.000 -
Geometric Mean 0.000 -
Name Current %
TOTAL.UNSUPPORTED 17643.000 1.18%
g++.UNSUPPORTED 11602.000 1.10%
gcc.UNSUPPORTED 4996.000 1.61%
libstdc++.UNSUPPORTED 1045.000 -
Geometric Mean 5717.564 -
Name Current %
TOTAL.UNRESOLVED 33.000 3.12%
g++.UNRESOLVED 3.000 -
gcc.UNRESOLVED 28.000 -3.45%
libstdc++.UNRESOLVED 2.000 -
Geometric Mean 8.629 1088.09%
Name Current %
TOTAL.ERROR 0.000 -
g++.ERROR 0.000 -
gcc.ERROR 0.000 -
libstdc++.ERROR 0.000 -
Geometric Mean 0.000 -
Name Current %
TOTAL.OTHER 0.000 -
g++.OTHER 0.000 -
gcc.OTHER 0.000 -
libstdc++.OTHER 0.000 -
Geometric Mean 0.000 -
Name Current %
TOTAL.good 401810.000 3.09%
g++.good 232654.000 4.57%
gcc.good 152331.000 1.18%
libstdc++.good 16825.000 -
Geometric Mean 124413.830 2.37%
bad
Name Current %
TOTAL.bad 313.000 -18.49%
g++.bad 114.000 -13.64%
gcc.bad 180.000 -24.05%
libstdc++.bad 19.000 26.67%
Geometric Mean 105.104 -9.28%
Name Current %
TOTAL.fails 313.000 -18.49%
Geometric Mean 313.000 -18.49%
Name Current %
TOTAL.flaky 21.000 -
Geometric Mean 21.000 -
all
Name Current %
TOTAL.all 402123.000 3.07%
Geometric Mean 402123.000 3.07%