Fields
hardware | None |
os | None |
Parameters
Fields
Name | Value |
---|
Parameters
Name | Value |
---|---|
git_binutils | https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=ef2a5e0d077962844db9e803e10abfee34feb312 (unchanged) |
git_gcc | https://github.com/gcc-mirror/gcc/commit/d498e79ebe90415047b0bdfdb70e0d579a88965b (+ 70 commits) |
git_gdb | https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=ef2a5e0d077962844db9e803e10abfee34feb312 (unchanged) |
git_newlib | https://sourceware.org/git/?p=newlib-cygwin.git;a=commit;h=d001c01a7c5277194e7f8891f0228a2e3c4c64e1 (unchanged) |
git_qemu | https://gitlab.com/qemu-project/qemu/commit/f9851d2ffef59b3a7f39513469263ab3b019480f (unchanged) |
test_url | https://ci.linaro.org/job/tcwg_gnu_embed_check_gcc--master-thumb_m0_soft_eabi-build/93/ |
master-thumb_m0_soft_eabi test results
Run | Order | Start Time | Duration |
---|---|---|---|
Current | 0093 (basepoints/gcc-15-02443-gd498e79ebe9) | 2024-08-02T09:33:18 | 0:00:00 |
Previous | 0070 (basepoints/gcc-15-01648-gad20ad7dddcb) | 2024-06-30T23:45:12 | 0:00:00 |
Baseline | 0031 (basepoints/gcc-15-00482-g1ec49897253) | 2024-05-23T15:16:58 | 0:00:00 |
Tests Summary
Status Group | # | # (B) |
---|---|---|
Performance Regressions | 5 | 13 |
Performance Improvements | 14 | 11 |
Added Tests | 16 | 16 |
Unchanged Tests | 730 | 725 |
Total Tests | 765 |
Performance Regressions - PASS | Δ | Previous | Current | σ | Δ (B) | σ (B) |
---|---|---|---|---|---|---|
g++.PASS | -10.93% | 223646.000 | 199197.000 | - | -10.60% | - |
TOTAL.PASS | -6.18% | 388264.000 | 364269.000 | - | -5.85% | - |
Performance Regressions - all | Δ | Previous | Current | σ | Δ (B) | σ (B) |
---|---|---|---|---|---|---|
TOTAL.all | -8.24% | 409639.000 | 375867.000 | - | -7.89% | - |
Performance Regressions - good | Δ | Previous | Current | σ | Δ (B) | σ (B) |
---|---|---|---|---|---|---|
g++.good | -14.44% | 237344.000 | 203083.000 | - | -14.09% | - |
TOTAL.good | -8.25% | 409358.000 | 375599.000 | - | -7.90% | - |
Performance Improvements - FAIL | Δ | Previous | Current | σ | Δ (B) | σ (B) |
---|---|---|---|---|---|---|
g++.FAIL | -12.50% | 48.000 | 42.000 | - | -12.50% | - |
TOTAL.FAIL | -4.78% | 230.000 | 219.000 | - | 10.61% | - |
gcc.FAIL | -2.96% | 169.000 | 164.000 | - | 21.48% | - |
Performance Improvements - UNSUPPORTED | Δ | Previous | Current | σ | Δ (B) | σ (B) |
---|---|---|---|---|---|---|
g++.UNSUPPORTED | -79.40% | 11990.000 | 2470.000 | - | -79.20% | - |
TOTAL.UNSUPPORTED | -51.60% | 18355.000 | 8883.000 | - | -51.18% | - |
Performance Improvements - XFAIL | Δ | Previous | Current | σ | Δ (B) | σ (B) |
---|---|---|---|---|---|---|
g++.XFAIL | -17.10% | 1708.000 | 1416.000 | - | -17.00% | - |
TOTAL.XFAIL | -10.66% | 2739.000 | 2447.000 | - | -10.63% | - |
Performance Improvements - XPASS | Δ | Previous | Current | σ | Δ (B) | σ (B) |
---|---|---|---|---|---|---|
g++.XPASS | -20.00% | 10.000 | 8.000 | - | -20.00% | - |
TOTAL.XPASS | -13.33% | 15.000 | 13.000 | - | -13.33% | - |
Performance Improvements - bad | Δ | Previous | Current | σ | Δ (B) | σ (B) |
---|---|---|---|---|---|---|
g++.bad | -13.11% | 61.000 | 53.000 | - | -13.11% | - |
TOTAL.bad | -4.63% | 281.000 | 268.000 | - | 8.06% | - |
gcc.bad | -2.49% | 201.000 | 196.000 | - | 18.07% | - |
Performance Improvements - fails | Δ | Previous | Current | σ | Δ (B) | σ (B) |
---|---|---|---|---|---|---|
TOTAL.fails | -4.64% | 280.000 | 267.000 | - | 7.66% | - |
Performance Improvements - flaky | Δ | Previous | Current | σ | Δ (B) | σ (B) |
---|---|---|---|---|---|---|
TOTAL.flaky | -34.62% | 52.000 | 34.000 | - | -33.33% | - |
Added Tests - ERROR |
---|
TOTAL.ERROR |
g++.ERROR |
gcc.ERROR |
libstdc++.ERROR |
Added Tests - KFAIL |
---|
TOTAL.KFAIL |
g++.KFAIL |
gcc.KFAIL |
libstdc++.KFAIL |
Added Tests - OTHER |
---|
TOTAL.OTHER |
g++.OTHER |
gcc.OTHER |
libstdc++.OTHER |
Added Tests - UNTESTED |
---|
TOTAL.UNTESTED |
g++.UNTESTED |
gcc.UNTESTED |
libstdc++.UNTESTED |
Performance Regressions - FAIL | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
---|---|---|---|---|---|---|
gcc.FAIL | 21.48% | 135.000 | 164.000 | - | -2.96% | - |
TOTAL.FAIL | 10.61% | 198.000 | 219.000 | - | -4.78% | - |
Performance Regressions - PASS | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
---|---|---|---|---|---|---|
g++.PASS | -10.60% | 222813.000 | 199197.000 | - | -10.93% | - |
TOTAL.PASS | -5.85% | 386901.000 | 364269.000 | - | -6.18% | - |
Performance Regressions - UNRESOLVED | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
---|---|---|---|---|---|---|
gcc.UNRESOLVED | 3.57% | 28.000 | 29.000 | - | 0.00% | - |
TOTAL.UNRESOLVED | 2.86% | 35.000 | 36.000 | - | 0.00% | - |
Performance Regressions - UNSUPPORTED | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
---|---|---|---|---|---|---|
gcc.UNSUPPORTED | 1.71% | 5265.000 | 5355.000 | - | 0.87% | - |
Performance Regressions - all | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
---|---|---|---|---|---|---|
TOTAL.all | -7.89% | 408081.000 | 375867.000 | - | -8.24% | - |
Performance Regressions - bad | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
---|---|---|---|---|---|---|
gcc.bad | 18.07% | 166.000 | 196.000 | - | -2.49% | - |
TOTAL.bad | 8.06% | 248.000 | 268.000 | - | -4.63% | - |
Performance Regressions - fails | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
---|---|---|---|---|---|---|
TOTAL.fails | 7.66% | 248.000 | 267.000 | - | -4.64% | - |
Performance Regressions - good | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
---|---|---|---|---|---|---|
g++.good | -14.09% | 236392.000 | 203083.000 | - | -14.44% | - |
TOTAL.good | -7.90% | 407833.000 | 375599.000 | - | -8.25% | - |
Performance Improvements - FAIL | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
---|---|---|---|---|---|---|
libstdc++.FAIL | -13.33% | 15.000 | 13.000 | - | 0.00% | - |
g++.FAIL | -12.50% | 48.000 | 42.000 | - | -12.50% | - |
Performance Improvements - UNSUPPORTED | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
---|---|---|---|---|---|---|
g++.UNSUPPORTED | -79.20% | 11873.000 | 2470.000 | - | -79.40% | - |
TOTAL.UNSUPPORTED | -51.18% | 18194.000 | 8883.000 | - | -51.60% | - |
Performance Improvements - XFAIL | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
---|---|---|---|---|---|---|
g++.XFAIL | -17.00% | 1706.000 | 1416.000 | - | -17.10% | - |
TOTAL.XFAIL | -10.63% | 2738.000 | 2447.000 | - | -10.66% | - |
Performance Improvements - XPASS | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
---|---|---|---|---|---|---|
g++.XPASS | -20.00% | 10.000 | 8.000 | - | -20.00% | - |
TOTAL.XPASS | -13.33% | 15.000 | 13.000 | - | -13.33% | - |
Performance Improvements - bad | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
---|---|---|---|---|---|---|
g++.bad | -13.11% | 61.000 | 53.000 | - | -13.11% | - |
libstdc++.bad | -9.52% | 21.000 | 19.000 | - | 0.00% | - |
Performance Improvements - flaky | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
---|---|---|---|---|---|---|
TOTAL.flaky | -33.33% | 51.000 | 34.000 | - | -34.62% | - |
Added Tests - ERROR |
---|
TOTAL.ERROR |
g++.ERROR |
gcc.ERROR |
libstdc++.ERROR |
Added Tests - KFAIL |
---|
TOTAL.KFAIL |
g++.KFAIL |
gcc.KFAIL |
libstdc++.KFAIL |
Added Tests - OTHER |
---|
TOTAL.OTHER |
g++.OTHER |
gcc.OTHER |
libstdc++.OTHER |
Added Tests - UNTESTED |
---|
TOTAL.UNTESTED |
g++.UNTESTED |
gcc.UNTESTED |
libstdc++.UNTESTED |
Report Time: 0.35s