Fields
hardware | None |
os | None |
Parameters
Fields
Name | Value |
---|
Parameters
Name | Value |
---|---|
git_binutils | https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=ad4e57ab110aba9cd90a76539ed480e9d1f8cfa5 (unchanged) |
git_gcc | https://github.com/gcc-mirror/gcc/commit/eb846114ed7c49e426fccb826a3f81b7abbc84be (+ 17 commits) |
git_gdb | https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=ad4e57ab110aba9cd90a76539ed480e9d1f8cfa5 (unchanged) |
git_newlib | https://sourceware.org/git/?p=newlib-cygwin.git;a=commit;h=9a863f713af24a3b18c165c640c936a4c0b707ea (unchanged) |
git_qemu | https://gitlab.com/qemu-project/qemu/commit/ffd454c67e38cc6df792733ebc5d967eee28ac0d (unchanged) |
test_url | https://ci.linaro.org/job/tcwg_gnu_embed_check_gcc--master-arm_eabi-build/554/ |
master-arm_eabi test results
Run | Order | Start Time | Duration |
---|---|---|---|
Current | 0554 (basepoints/gcc-14-07007-geb846114ed7) | 2024-01-08T08:28:03 | 0:00:00 |
Previous | 0533 (basepoints/gcc-14-06238-gae9e48e5c0a) | 2023-12-09T23:56:34 | 0:00:00 |
Baseline | 0011 (5-changed-components) | 2023-06-05T17:27:31 | 0:00:00 |
Tests Summary
Status Group | # | # (B) |
---|---|---|
Performance Regressions | 6 | 10 |
Performance Improvements | 16 | 19 |
Added Tests | 17 | 20 |
Unchanged Tests | 906 | 896 |
Total Tests | 945 |
Performance Regressions - FAIL | Δ | Previous | Current | σ | Δ (B) | σ (B) |
---|---|---|---|---|---|---|
libstdc++.FAIL | 14.29% | 14.000 | 16.000 | - | -96.52% | - |
Performance Regressions - UNRESOLVED | Δ | Previous | Current | σ | Δ (B) | σ (B) |
---|---|---|---|---|---|---|
TOTAL.UNRESOLVED | 66.67% | 3.000 | 5.000 | - | -99.97% | - |
Performance Regressions - UNSUPPORTED | Δ | Previous | Current | σ | Δ (B) | σ (B) |
---|---|---|---|---|---|---|
gcc.UNSUPPORTED | 2.77% | 8740.000 | 8982.000 | - | 8.79% | - |
TOTAL.UNSUPPORTED | 1.74% | 21309.000 | 21679.000 | - | 3.38% | - |
g++.UNSUPPORTED | 1.11% | 11514.000 | 11642.000 | - | 4.02% | - |
Performance Regressions - bad | Δ | Previous | Current | σ | Δ (B) | σ (B) |
---|---|---|---|---|---|---|
libstdc++.bad | 25.00% | 16.000 | 20.000 | - | -96.85% | - |
Performance Improvements - FAIL | Δ | Previous | Current | σ | Δ (B) | σ (B) |
---|---|---|---|---|---|---|
g++.FAIL | -24.37% | 119.000 | 90.000 | - | -52.38% | - |
TOTAL.FAIL | -17.53% | 194.000 | 160.000 | - | -99.14% | - |
gcc.FAIL | -11.48% | 61.000 | 54.000 | - | -29.87% | - |
Performance Improvements - PASS | Δ | Previous | Current | σ | Δ (B) | σ (B) |
---|---|---|---|---|---|---|
g++.PASS | 3.12% | 211456.000 | 218044.000 | - | 9.85% | - |
TOTAL.PASS | 1.84% | 383204.000 | 390243.000 | - | 2.07% | - |
Performance Improvements - XPASS | Δ | Previous | Current | σ | Δ (B) | σ (B) |
---|---|---|---|---|---|---|
g++.XPASS | -36.36% | 22.000 | 14.000 | - | 40.00% | - |
TOTAL.XPASS | -33.33% | 33.000 | 22.000 | - | 22.22% | - |
gcc.XPASS | -33.33% | 9.000 | 6.000 | - | 0.00% | - |
Performance Improvements - all | Δ | Previous | Current | σ | Δ (B) | σ (B) |
---|---|---|---|---|---|---|
TOTAL.all | 1.81% | 407468.000 | 414824.000 | - | 0.00% | - |
Performance Improvements - bad | Δ | Previous | Current | σ | Δ (B) | σ (B) |
---|---|---|---|---|---|---|
g++.bad | -25.69% | 144.000 | 107.000 | - | -69.25% | - |
TOTAL.bad | -18.70% | 230.000 | 187.000 | - | -99.50% | - |
gcc.bad | -14.29% | 70.000 | 60.000 | - | -70.30% | - |
Performance Improvements - fails | Δ | Previous | Current | σ | Δ (B) | σ (B) |
---|---|---|---|---|---|---|
TOTAL.fails | -18.70% | 230.000 | 187.000 | - | 0.00% | - |
Performance Improvements - flaky | Δ | Previous | Current | σ | Δ (B) | σ (B) |
---|---|---|---|---|---|---|
TOTAL.flaky | -4.35% | 23.000 | 22.000 | - | 0.00% | - |
Performance Improvements - good | Δ | Previous | Current | σ | Δ (B) | σ (B) |
---|---|---|---|---|---|---|
g++.good | 2.99% | 224597.000 | 231306.000 | - | 9.76% | - |
TOTAL.good | 1.82% | 407238.000 | 414637.000 | - | 2.30% | - |
Added Tests - ERROR |
---|
TOTAL.ERROR |
g++.ERROR |
gcc.ERROR |
libstdc++.ERROR |
Added Tests - KFAIL |
---|
TOTAL.KFAIL |
g++.KFAIL |
gcc.KFAIL |
libstdc++.KFAIL |
Added Tests - OTHER |
---|
TOTAL.OTHER |
g++.OTHER |
gcc.OTHER |
libstdc++.OTHER |
Added Tests - UNRESOLVED |
---|
gcc.UNRESOLVED |
Added Tests - UNTESTED |
---|
TOTAL.UNTESTED |
g++.UNTESTED |
gcc.UNTESTED |
libstdc++.UNTESTED |
Performance Regressions - UNSUPPORTED | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
---|---|---|---|---|---|---|
libstdc++.UNSUPPORTED | 61.56% | 653.000 | 1055.000 | - | 0.00% | - |
gcc.UNSUPPORTED | 8.79% | 8256.000 | 8982.000 | - | 2.77% | - |
g++.UNSUPPORTED | 4.02% | 11192.000 | 11642.000 | - | 1.11% | - |
TOTAL.UNSUPPORTED | 3.38% | 20971.000 | 21679.000 | - | 1.74% | - |
Performance Regressions - XFAIL | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
---|---|---|---|---|---|---|
libstdc++.XFAIL | 670.59% | 17.000 | 131.000 | - | 0.00% | - |
g++.XFAIL | 53.55% | 1055.000 | 1620.000 | - | -0.43% | - |
TOTAL.XFAIL | 34.87% | 2013.000 | 2715.000 | - | -0.37% | - |
gcc.XFAIL | 4.90% | 919.000 | 964.000 | - | -0.31% | - |
Performance Regressions - XPASS | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
---|---|---|---|---|---|---|
g++.XPASS | 40.00% | 10.000 | 14.000 | - | -36.36% | - |
TOTAL.XPASS | 22.22% | 18.000 | 22.000 | - | -33.33% | - |
Performance Improvements - FAIL | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
---|---|---|---|---|---|---|
TOTAL.FAIL | -99.14% | 18705.000 | 160.000 | - | -17.53% | - |
libstdc++.FAIL | -96.52% | 460.000 | 16.000 | - | 14.29% | - |
g++.FAIL | -52.38% | 189.000 | 90.000 | - | -24.37% | - |
gcc.FAIL | -29.87% | 77.000 | 54.000 | - | -11.48% | - |
Performance Improvements - PASS | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
---|---|---|---|---|---|---|
libstdc++.PASS | 14.32% | 13634.000 | 15586.000 | - | 0.39% | - |
g++.PASS | 9.85% | 198496.000 | 218044.000 | - | 3.12% | - |
gcc.PASS | 5.09% | 149024.000 | 156613.000 | - | 0.25% | - |
TOTAL.PASS | 2.07% | 382336.000 | 390243.000 | - | 1.84% | - |
Performance Improvements - UNRESOLVED | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
---|---|---|---|---|---|---|
TOTAL.UNRESOLVED | -99.97% | 16578.000 | 5.000 | - | 66.67% | - |
libstdc++.UNRESOLVED | -98.84% | 172.000 | 2.000 | - | 0.00% | - |
g++.UNRESOLVED | -97.99% | 149.000 | 3.000 | - | 0.00% | - |
Performance Improvements - bad | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
---|---|---|---|---|---|---|
TOTAL.bad | -99.50% | 37054.000 | 187.000 | - | -18.70% | - |
libstdc++.bad | -96.85% | 634.000 | 20.000 | - | 25.00% | - |
gcc.bad | -70.30% | 202.000 | 60.000 | - | -14.29% | - |
g++.bad | -69.25% | 348.000 | 107.000 | - | -25.69% | - |
Performance Improvements - good | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
---|---|---|---|---|---|---|
libstdc++.good | 17.25% | 14304.000 | 16772.000 | - | 0.37% | - |
g++.good | 9.76% | 210743.000 | 231306.000 | - | 2.99% | - |
gcc.good | 5.28% | 158199.000 | 166559.000 | - | 0.38% | - |
TOTAL.good | 2.30% | 405320.000 | 414637.000 | - | 1.82% | - |
Added Tests - ERROR |
---|
TOTAL.ERROR |
g++.ERROR |
gcc.ERROR |
libstdc++.ERROR |
Added Tests - KFAIL |
---|
TOTAL.KFAIL |
g++.KFAIL |
gcc.KFAIL |
libstdc++.KFAIL |
Added Tests - OTHER |
---|
TOTAL.OTHER |
g++.OTHER |
gcc.OTHER |
libstdc++.OTHER |
Added Tests - UNRESOLVED |
---|
gcc.UNRESOLVED |
Added Tests - UNTESTED |
---|
TOTAL.UNTESTED |
g++.UNTESTED |
gcc.UNTESTED |
libstdc++.UNTESTED |
Added Tests - all |
---|
TOTAL.all |
Added Tests - fails |
---|
TOTAL.fails |
Added Tests - flaky |
---|
TOTAL.flaky |
Report Time: 0.36s