Fields
hardware | None |
os | None |
Parameters
Fields
Name | Value |
---|
Parameters
Name | Value |
---|---|
git_binutils | https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=7e287afdbd62309658908a9a72f78e58281a05e7 (unchanged) |
git_gcc | https://github.com/gcc-mirror/gcc/commit/74a0dab18292bef54f316eb086112332befbc6a7 (+ 421 commits) |
git_gdb | https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=42bd6b5fd4f9e41f99d80a8f2946926503299e5e (unchanged) |
git_newlib | https://sourceware.org/git/?p=newlib-cygwin.git;a=commit;h=9a863f713af24a3b18c165c640c936a4c0b707ea (unchanged) |
git_qemu | https://gitlab.com/qemu-project/qemu/commit/9468484fe904ab4691de6d9c34616667f377ceac (unchanged) |
test_url | https://ci.linaro.org/job/tcwg_gnu_embed_check_gcc--master-thumb_m0_eabi-build/310/ |
master-thumb_m0_eabi test results
Run | Order | Start Time | Duration |
---|---|---|---|
Current | 0310 (basepoints/gcc-14-06990-g74a0dab1829) | 2024-01-10T07:32:57 | 0:00:00 |
Previous | 0298 (basepoints/gcc-14-06239-g08b7462d3ad) | 2024-01-06T05:14:38 | 0:00:00 |
Baseline | 0001 (5-changed-components) | 2023-08-01T06:00:40 | 0:00:00 |
Tests Summary
Status Group | # | # (B) |
---|---|---|
Performance Regressions | 3 | 14 |
Performance Improvements | 14 | 14 |
Added Tests | 16 | 19 |
Unchanged Tests | 732 | 718 |
Total Tests | 765 |
Performance Regressions - FAIL | Δ | Previous | Current | σ | Δ (B) | σ (B) |
---|---|---|---|---|---|---|
libstdc++.FAIL | 15.38% | 13.000 | 15.000 | - | -50.00% | - |
Performance Regressions - UNRESOLVED | Δ | Previous | Current | σ | Δ (B) | σ (B) |
---|---|---|---|---|---|---|
TOTAL.UNRESOLVED | 6.45% | 31.000 | 33.000 | - | 0.00% | - |
Performance Regressions - bad | Δ | Previous | Current | σ | Δ (B) | σ (B) |
---|---|---|---|---|---|---|
libstdc++.bad | 26.67% | 15.000 | 19.000 | - | -66.07% | - |
Performance Improvements - FAIL | Δ | Previous | Current | σ | Δ (B) | σ (B) |
---|---|---|---|---|---|---|
g++.FAIL | -22.83% | 127.000 | 98.000 | - | 196.97% | - |
TOTAL.FAIL | -11.44% | 306.000 | 271.000 | - | 163.11% | - |
gcc.FAIL | -4.82% | 166.000 | 158.000 | - | 295.00% | - |
Performance Improvements - PASS | Δ | Previous | Current | σ | Δ (B) | σ (B) |
---|---|---|---|---|---|---|
g++.PASS | 3.12% | 210768.000 | 217349.000 | - | 14.61% | - |
TOTAL.PASS | 1.87% | 372247.000 | 379200.000 | - | 14.49% | - |
Performance Improvements - XPASS | Δ | Previous | Current | σ | Δ (B) | σ (B) |
---|---|---|---|---|---|---|
gcc.XPASS | -50.00% | 6.000 | 3.000 | - | 0.00% | - |
TOTAL.XPASS | -13.64% | 22.000 | 19.000 | - | 46.15% | - |
Performance Improvements - all | Δ | Previous | Current | σ | Δ (B) | σ (B) |
---|---|---|---|---|---|---|
TOTAL.all | 1.80% | 392716.000 | 399770.000 | - | 0.00% | - |
Performance Improvements - bad | Δ | Previous | Current | σ | Δ (B) | σ (B) |
---|---|---|---|---|---|---|
g++.bad | -20.14% | 144.000 | 115.000 | - | 161.36% | - |
TOTAL.bad | -10.03% | 359.000 | 323.000 | - | 116.78% | - |
gcc.bad | -5.50% | 200.000 | 189.000 | - | 285.71% | - |
Performance Improvements - fails | Δ | Previous | Current | σ | Δ (B) | σ (B) |
---|---|---|---|---|---|---|
TOTAL.fails | -10.03% | 359.000 | 323.000 | - | 0.00% | - |
Performance Improvements - good | Δ | Previous | Current | σ | Δ (B) | σ (B) |
---|---|---|---|---|---|---|
g++.good | 2.99% | 223869.000 | 230554.000 | - | 12.89% | - |
TOTAL.good | 1.81% | 392357.000 | 399447.000 | - | 12.56% | - |
Added Tests - ERROR |
---|
TOTAL.ERROR |
g++.ERROR |
gcc.ERROR |
libstdc++.ERROR |
Added Tests - KFAIL |
---|
TOTAL.KFAIL |
g++.KFAIL |
gcc.KFAIL |
libstdc++.KFAIL |
Added Tests - OTHER |
---|
TOTAL.OTHER |
g++.OTHER |
gcc.OTHER |
libstdc++.OTHER |
Added Tests - UNTESTED |
---|
TOTAL.UNTESTED |
g++.UNTESTED |
gcc.UNTESTED |
libstdc++.UNTESTED |
Performance Regressions - FAIL | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
---|---|---|---|---|---|---|
gcc.FAIL | 295.00% | 40.000 | 158.000 | - | -4.82% | - |
g++.FAIL | 196.97% | 33.000 | 98.000 | - | -22.83% | - |
TOTAL.FAIL | 163.11% | 103.000 | 271.000 | - | -11.44% | - |
Performance Regressions - UNRESOLVED | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
---|---|---|---|---|---|---|
gcc.UNRESOLVED | 366.67% | 6.000 | 28.000 | - | 0.00% | - |
Performance Regressions - UNSUPPORTED | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
---|---|---|---|---|---|---|
libstdc++.UNSUPPORTED | 4.92% | 995.000 | 1044.000 | - | 0.00% | - |
Performance Regressions - XFAIL | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
---|---|---|---|---|---|---|
g++.XFAIL | 55.15% | 1039.000 | 1612.000 | - | -0.43% | - |
TOTAL.XFAIL | 33.42% | 1987.000 | 2651.000 | - | -0.26% | - |
libstdc++.XFAIL | 18.02% | 111.000 | 131.000 | - | 0.00% | - |
gcc.XFAIL | 8.48% | 837.000 | 908.000 | - | 0.00% | - |
Performance Regressions - XPASS | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
---|---|---|---|---|---|---|
g++.XPASS | 75.00% | 8.000 | 14.000 | - | 0.00% | - |
TOTAL.XPASS | 46.15% | 13.000 | 19.000 | - | -13.64% | - |
Performance Regressions - bad | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
---|---|---|---|---|---|---|
gcc.bad | 285.71% | 49.000 | 189.000 | - | -5.50% | - |
g++.bad | 161.36% | 44.000 | 115.000 | - | -20.14% | - |
TOTAL.bad | 116.78% | 149.000 | 323.000 | - | -10.03% | - |
Performance Improvements - FAIL | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
---|---|---|---|---|---|---|
libstdc++.FAIL | -50.00% | 30.000 | 15.000 | - | 15.38% | - |
Performance Improvements - PASS | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
---|---|---|---|---|---|---|
libstdc++.PASS | 15.76% | 13472.000 | 15595.000 | - | 0.33% | - |
g++.PASS | 14.61% | 189638.000 | 217349.000 | - | 3.12% | - |
TOTAL.PASS | 14.49% | 331210.000 | 379200.000 | - | 1.87% | - |
gcc.PASS | 14.17% | 128100.000 | 146256.000 | - | 0.22% | - |
Performance Improvements - UNRESOLVED | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
---|---|---|---|---|---|---|
libstdc++.UNRESOLVED | -91.67% | 24.000 | 2.000 | - | 0.00% | - |
Performance Improvements - UNSUPPORTED | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
---|---|---|---|---|---|---|
gcc.UNSUPPORTED | -30.41% | 7126.000 | 4959.000 | - | 0.67% | - |
TOTAL.UNSUPPORTED | -18.81% | 21673.000 | 17596.000 | - | 0.83% | - |
g++.UNSUPPORTED | -14.46% | 13552.000 | 11593.000 | - | 0.97% | - |
Performance Improvements - bad | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
---|---|---|---|---|---|---|
libstdc++.bad | -66.07% | 56.000 | 19.000 | - | 26.67% | - |
Performance Improvements - good | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
---|---|---|---|---|---|---|
libstdc++.good | 15.04% | 14578.000 | 16770.000 | - | 0.31% | - |
g++.good | 12.89% | 204229.000 | 230554.000 | - | 2.99% | - |
TOTAL.good | 12.56% | 354870.000 | 399447.000 | - | 1.81% | - |
gcc.good | 11.80% | 136063.000 | 152123.000 | - | 0.23% | - |
Added Tests - ERROR |
---|
TOTAL.ERROR |
g++.ERROR |
gcc.ERROR |
libstdc++.ERROR |
Added Tests - KFAIL |
---|
TOTAL.KFAIL |
g++.KFAIL |
gcc.KFAIL |
libstdc++.KFAIL |
Added Tests - OTHER |
---|
TOTAL.OTHER |
g++.OTHER |
gcc.OTHER |
libstdc++.OTHER |
Added Tests - UNTESTED |
---|
TOTAL.UNTESTED |
g++.UNTESTED |
gcc.UNTESTED |
libstdc++.UNTESTED |
Added Tests - all |
---|
TOTAL.all |
Added Tests - fails |
---|
TOTAL.fails |
Added Tests - flaky |
---|
TOTAL.flaky |
Report Time: 0.35s