Fields
hardware | None |
os | None |
Parameters
Fields
Name | Value |
---|
Parameters
Name | Value |
---|---|
git_binutils | https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=1fb5ccd6bfc140c0f542cdd678e5888e18599e59 (unchanged) |
git_gcc | https://gcc.gnu.org/git/gcc.git (f1c844be5202f4be446f165d9a7625eb7ec4c5b4) (+ 147 commits) |
git_gdb | https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=595e49a4b7c6769ef23a2573148db72872c61935 (unchanged) |
git_newlib | https://sourceware.org/git/?p=newlib-cygwin.git;a=commit;h=21a2c9db6952954608cdf92638b411b15e7606c6 (unchanged) |
git_qemu | https://gitlab.com/qemu-project/qemu/commit/34754a3a627e1937be7f3daaa0c5e73d91c7d9b5 (unchanged) |
test_url | https://ci.linaro.org/job/tcwg_gnu_embed_check_gcc--master-thumb_m33_hard_eabi-build/307/ |
master-thumb_m33_hard_eabi test results
Run | Order | Start Time | Duration |
---|---|---|---|
Current | 0307 (basepoints/gcc-15-04708-gf1c844be520) | 2024-11-22T01:56:51 | 0:00:00 |
Previous | 0299 (basepoints/gcc-15-04235-gbcccc3221b8) | 2024-11-22T01:55:45 | 0:00:00 |
Baseline | 0048 (basepoints/gcc-15-00267-gcb478e0a6f3) | 2024-05-23T18:15:38 | 0:00:00 |
Tests Summary
Status Group | # | # (B) |
---|---|---|
Performance Regressions | 5 | 12 |
Performance Improvements | 5 | 15 |
Added Tests | 17 | 17 |
Unchanged Tests | 738 | 721 |
Total Tests | 765 |
Performance Regressions - UNRESOLVED | Δ | Previous | Current | σ | Δ (B) | σ (B) |
---|---|---|---|---|---|---|
libstdc++.UNRESOLVED | 25.00% | 4.000 | 5.000 | - | 25.00% | - |
TOTAL.UNRESOLVED | 8.33% | 12.000 | 13.000 | - | 18.18% | - |
Performance Regressions - XPASS | Δ | Previous | Current | σ | Δ (B) | σ (B) |
---|---|---|---|---|---|---|
gcc.XPASS | 66.67% | 3.000 | 5.000 | - | 0.00% | - |
TOTAL.XPASS | 28.57% | 7.000 | 9.000 | - | -25.00% | - |
Performance Regressions - bad | Δ | Previous | Current | σ | Δ (B) | σ (B) |
---|---|---|---|---|---|---|
libstdc++.bad | 4.55% | 22.000 | 23.000 | - | 4.55% | - |
Performance Improvements - FAIL | Δ | Previous | Current | σ | Δ (B) | σ (B) |
---|---|---|---|---|---|---|
gcc.FAIL | -12.58% | 326.000 | 285.000 | - | 2.15% | - |
TOTAL.FAIL | -10.82% | 379.000 | 338.000 | - | -2.59% | - |
Performance Improvements - bad | Δ | Previous | Current | σ | Δ (B) | σ (B) |
---|---|---|---|---|---|---|
gcc.bad | -11.78% | 331.000 | 292.000 | - | 4.29% | - |
TOTAL.bad | -9.55% | 398.000 | 360.000 | - | -2.70% | - |
Performance Improvements - fails | Δ | Previous | Current | σ | Δ (B) | σ (B) |
---|---|---|---|---|---|---|
TOTAL.fails | -9.55% | 398.000 | 360.000 | - | -2.70% | - |
Added Tests - ERROR |
---|
TOTAL.ERROR |
g++.ERROR |
gcc.ERROR |
libstdc++.ERROR |
Added Tests - KFAIL |
---|
TOTAL.KFAIL |
g++.KFAIL |
gcc.KFAIL |
libstdc++.KFAIL |
Added Tests - OTHER |
---|
TOTAL.OTHER |
g++.OTHER |
gcc.OTHER |
libstdc++.OTHER |
Added Tests - UNTESTED |
---|
TOTAL.UNTESTED |
g++.UNTESTED |
gcc.UNTESTED |
libstdc++.UNTESTED |
Added Tests - flaky |
---|
TOTAL.flaky |
Performance Regressions - FAIL | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
---|---|---|---|---|---|---|
gcc.FAIL | 2.15% | 279.000 | 285.000 | - | -12.58% | - |
Performance Regressions - PASS | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
---|---|---|---|---|---|---|
g++.PASS | -8.77% | 223194.000 | 203618.000 | - | 0.41% | - |
TOTAL.PASS | -4.17% | 405344.000 | 388431.000 | - | 0.32% | - |
Performance Regressions - UNRESOLVED | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
---|---|---|---|---|---|---|
gcc.UNRESOLVED | 100.00% | 1.000 | 2.000 | - | 0.00% | - |
libstdc++.UNRESOLVED | 25.00% | 4.000 | 5.000 | - | 25.00% | - |
TOTAL.UNRESOLVED | 18.18% | 11.000 | 13.000 | - | 8.33% | - |
Performance Regressions - UNSUPPORTED | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
---|---|---|---|---|---|---|
gcc.UNSUPPORTED | 2.95% | 9466.000 | 9745.000 | - | 0.75% | - |
Performance Regressions - all | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
---|---|---|---|---|---|---|
TOTAL.all | -6.12% | 431076.000 | 404691.000 | - | 0.32% | - |
Performance Regressions - bad | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
---|---|---|---|---|---|---|
libstdc++.bad | 4.55% | 22.000 | 23.000 | - | 4.55% | - |
gcc.bad | 4.29% | 280.000 | 292.000 | - | -11.78% | - |
Performance Regressions - good | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
---|---|---|---|---|---|---|
g++.good | -12.38% | 236918.000 | 207598.000 | - | 0.40% | - |
TOTAL.good | -6.12% | 430706.000 | 404331.000 | - | 0.33% | - |
Performance Improvements - FAIL | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
---|---|---|---|---|---|---|
g++.FAIL | -28.85% | 52.000 | 37.000 | - | 0.00% | - |
TOTAL.FAIL | -2.59% | 347.000 | 338.000 | - | -10.82% | - |
Performance Improvements - PASS | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
---|---|---|---|---|---|---|
gcc.PASS | 1.48% | 166211.000 | 168664.000 | - | 0.23% | - |
libstdc++.PASS | 1.32% | 15939.000 | 16149.000 | - | 0.16% | - |
Performance Improvements - UNSUPPORTED | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
---|---|---|---|---|---|---|
g++.UNSUPPORTED | -79.25% | 11870.000 | 2463.000 | - | 0.00% | - |
TOTAL.UNSUPPORTED | -40.79% | 22361.000 | 13240.000 | - | 0.56% | - |
Performance Improvements - XFAIL | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
---|---|---|---|---|---|---|
g++.XFAIL | -18.18% | 1854.000 | 1517.000 | - | -0.78% | - |
TOTAL.XFAIL | -11.36% | 3001.000 | 2660.000 | - | -0.56% | - |
Performance Improvements - XPASS | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
---|---|---|---|---|---|---|
g++.XPASS | -80.00% | 10.000 | 2.000 | - | 0.00% | - |
TOTAL.XPASS | -25.00% | 12.000 | 9.000 | - | 28.57% | - |
Performance Improvements - bad | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
---|---|---|---|---|---|---|
g++.bad | -33.82% | 68.000 | 45.000 | - | 0.00% | - |
TOTAL.bad | -2.70% | 370.000 | 360.000 | - | -9.55% | - |
Performance Improvements - fails | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
---|---|---|---|---|---|---|
TOTAL.fails | -2.70% | 370.000 | 360.000 | - | -9.55% | - |
Performance Improvements - good | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
---|---|---|---|---|---|---|
gcc.good | 1.54% | 176693.000 | 179420.000 | - | 0.26% | - |
libstdc++.good | 1.28% | 17095.000 | 17313.000 | - | 0.15% | - |
Added Tests - ERROR |
---|
TOTAL.ERROR |
g++.ERROR |
gcc.ERROR |
libstdc++.ERROR |
Added Tests - KFAIL |
---|
TOTAL.KFAIL |
g++.KFAIL |
gcc.KFAIL |
libstdc++.KFAIL |
Added Tests - OTHER |
---|
TOTAL.OTHER |
g++.OTHER |
gcc.OTHER |
libstdc++.OTHER |
Added Tests - UNTESTED |
---|
TOTAL.UNTESTED |
g++.UNTESTED |
gcc.UNTESTED |
libstdc++.UNTESTED |
Added Tests - flaky |
---|
TOTAL.flaky |
Report Time: 0.34s