Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=708aee5ec64bea2c84449f63f3cdaa6d2b0b5892 (unchanged)
git_gcc https://github.com/gcc-mirror/gcc/commit/7804b4e24cd16283067225d4c2c4a4483a2b31bc (+ 80 commits)
git_gdb https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=708aee5ec64bea2c84449f63f3cdaa6d2b0b5892 (unchanged)
git_newlib https://sourceware.org/git/?p=newlib-cygwin.git;a=commit;h=3bafe2fae7a0878598a82777c623edb2faa70b74 (unchanged)
git_qemu https://gitlab.com/qemu-project/qemu/commit/d451e32ce8e1eef1b7d05d9f532113e9618f1fc1 (unchanged)
test_url https://ci.linaro.org/job/tcwg_gnu_embed_check_gcc--master-thumb_m0_eabi-build/285/
Filter

master-thumb_m0_eabi test results

Run Order Start Time Duration
Current 0285 (basepoints/gcc-14-06113-g7804b4e24cd) 2023-12-07T03:56:24 0:00:00
Previous 0282 (basepoints/gcc-14-06033-g55e94561e97) 2023-12-07T03:56:19 0:00:00
Baseline 0001 (5-changed-components) 2023-08-01T06:00:40 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 6 15
Performance Improvements 0 14
Added Tests 17 20
Unchanged Tests 742 716
Total Tests 765

Performance Regressions - FAIL Δ Previous Current σ Δ (B) σ (B)
gcc.FAIL 14.29% 175.000 200.000 - 400.00% -
TOTAL.FAIL 8.47% 295.000 320.000 - 210.68% -

Performance Regressions - bad Δ Previous Current σ Δ (B) σ (B)
gcc.bad 11.96% 209.000 234.000 - 377.55% -
TOTAL.bad 7.02% 356.000 381.000 - 155.70% -

Performance Regressions - fails Δ Previous Current σ Δ (B) σ (B)
TOTAL.fails 7.02% 356.000 381.000 - 0.00% -

Performance Regressions - flaky Δ Previous Current σ Δ (B) σ (B)
TOTAL.flaky 2000.00% 1.000 21.000 - 0.00% -

Added Tests - ERROR
TOTAL.ERROR
g++.ERROR
gcc.ERROR
libstdc++.ERROR

Added Tests - KFAIL
TOTAL.KFAIL
g++.KFAIL
gcc.KFAIL
libstdc++.KFAIL

Added Tests - OTHER
TOTAL.OTHER
g++.OTHER
gcc.OTHER
libstdc++.OTHER

Added Tests - UNRESOLVED
libstdc++.UNRESOLVED

Added Tests - UNTESTED
TOTAL.UNTESTED
g++.UNTESTED
gcc.UNTESTED
libstdc++.UNTESTED

Performance Regressions - FAIL Δ (B) Baseline Current σ (B) Δ σ
gcc.FAIL 400.00% 40.000 200.000 - 14.29% -
g++.FAIL 224.24% 33.000 107.000 - 0.00% -
TOTAL.FAIL 210.68% 103.000 320.000 - 8.47% -

Performance Regressions - UNRESOLVED Δ (B) Baseline Current σ (B) Δ σ
gcc.UNRESOLVED 366.67% 6.000 28.000 - 0.00% -

Performance Regressions - UNSUPPORTED Δ (B) Baseline Current σ (B) Δ σ
libstdc++.UNSUPPORTED 4.92% 995.000 1044.000 - 0.00% -

Performance Regressions - XFAIL Δ (B) Baseline Current σ (B) Δ σ
g++.XFAIL 46.29% 1039.000 1520.000 - 0.00% -
TOTAL.XFAIL 28.23% 1987.000 2548.000 - 0.00% -
libstdc++.XFAIL 18.02% 111.000 131.000 - 0.00% -
gcc.XFAIL 7.17% 837.000 897.000 - 0.00% -

Performance Regressions - XPASS Δ (B) Baseline Current σ (B) Δ σ
g++.XPASS 175.00% 8.000 22.000 - 0.00% -
TOTAL.XPASS 130.77% 13.000 30.000 - 0.00% -
gcc.XPASS 100.00% 3.000 6.000 - 0.00% -

Performance Regressions - bad Δ (B) Baseline Current σ (B) Δ σ
gcc.bad 377.55% 49.000 234.000 - 11.96% -
g++.bad 200.00% 44.000 132.000 - 0.00% -
TOTAL.bad 155.70% 149.000 381.000 - 7.02% -

Performance Improvements - FAIL Δ (B) Baseline Current σ (B) Δ σ
libstdc++.FAIL -56.67% 30.000 13.000 - 0.00% -

Performance Improvements - PASS Δ (B) Baseline Current σ (B) Δ σ
libstdc++.PASS 15.29% 13472.000 15532.000 - 0.00% -
gcc.PASS 12.98% 128100.000 144733.000 - 0.15% -
TOTAL.PASS 11.60% 331210.000 369618.000 - 0.09% -
g++.PASS 10.40% 189638.000 209353.000 - 0.05% -

Performance Improvements - UNRESOLVED Δ (B) Baseline Current σ (B) Δ σ
TOTAL.UNRESOLVED -6.06% 33.000 31.000 - 0.00% -

Performance Improvements - UNSUPPORTED Δ (B) Baseline Current σ (B) Δ σ
gcc.UNSUPPORTED -31.00% 7126.000 4917.000 - 0.22% -
TOTAL.UNSUPPORTED -19.83% 21673.000 17376.000 - 0.12% -
g++.UNSUPPORTED -15.77% 13552.000 11415.000 - 0.09% -

Performance Improvements - bad Δ (B) Baseline Current σ (B) Δ σ
libstdc++.bad -73.21% 56.000 15.000 - 0.00% -

Performance Improvements - good Δ (B) Baseline Current σ (B) Δ σ
libstdc++.good 14.60% 14578.000 16707.000 - 0.00% -
gcc.good 10.65% 136063.000 150547.000 - 0.16% -
TOTAL.good 9.77% 354870.000 389542.000 - 0.09% -
g++.good 8.84% 204229.000 222288.000 - 0.05% -

Added Tests - ERROR
TOTAL.ERROR
g++.ERROR
gcc.ERROR
libstdc++.ERROR

Added Tests - KFAIL
TOTAL.KFAIL
g++.KFAIL
gcc.KFAIL
libstdc++.KFAIL

Added Tests - OTHER
TOTAL.OTHER
g++.OTHER
gcc.OTHER
libstdc++.OTHER

Added Tests - UNRESOLVED
libstdc++.UNRESOLVED

Added Tests - UNTESTED
TOTAL.UNTESTED
g++.UNTESTED
gcc.UNTESTED
libstdc++.UNTESTED

Added Tests - all
TOTAL.all

Added Tests - fails
TOTAL.fails

Added Tests - flaky
TOTAL.flaky


Report Time: 0.35s
Name Current %
TOTAL.PASS 369618.000 -
g++.PASS 209353.000 -
gcc.PASS 144733.000 -
libstdc++.PASS 15532.000 -
Geometric Mean 114843.604 -
Name Current %
TOTAL.XPASS 30.000 -
g++.XPASS 22.000 -
gcc.XPASS 6.000 -
libstdc++.XPASS 2.000 -
Geometric Mean 9.434 -
Name Current %
TOTAL.FAIL 320.000 8.47%
g++.FAIL 107.000 -
gcc.FAIL 200.000 14.29%
libstdc++.FAIL 13.000 -
Geometric Mean 97.135 5.52%
Name Current %
TOTAL.XFAIL 2548.000 -
g++.XFAIL 1520.000 -
gcc.XFAIL 897.000 -
libstdc++.XFAIL 131.000 -
Geometric Mean 821.347 -
Name Current %
TOTAL.KFAIL 0.000 -
g++.KFAIL 0.000 -
gcc.KFAIL 0.000 -
libstdc++.KFAIL 0.000 -
Geometric Mean 0.000 -
Name Current %
TOTAL.UNSUPPORTED 17376.000 -
g++.UNSUPPORTED 11415.000 -
gcc.UNSUPPORTED 4917.000 -
libstdc++.UNSUPPORTED 1044.000 -
Geometric Mean 5648.805 -
Name Current %
TOTAL.ERROR 0.000 -
g++.ERROR 0.000 -
gcc.ERROR 0.000 -
libstdc++.ERROR 0.000 -
Geometric Mean 0.000 -
Name Current %
TOTAL.OTHER 0.000 -
g++.OTHER 0.000 -
gcc.OTHER 0.000 -
libstdc++.OTHER 0.000 -
Geometric Mean 0.000 -
Name Current %
TOTAL.good 389542.000 -
g++.good 222288.000 -
gcc.good 150547.000 -
libstdc++.good 16707.000 -
Geometric Mean 121481.521 -
bad
Name Current %
TOTAL.bad 381.000 7.02%
g++.bad 132.000 -
gcc.bad 234.000 11.96%
libstdc++.bad 15.000 -
Geometric Mean 115.266 4.63%
Name Current %
TOTAL.fails 381.000 7.02%
Geometric Mean 381.000 7.02%
Name Current %
TOTAL.flaky 21.000 2000.00%
Geometric Mean 21.000 2000.00%
all
Name Current %
TOTAL.all 389923.000 -
Geometric Mean 389923.000 -