Fields
hardware | None |
os | None |
Parameters
Fields
Name | Value |
---|
Parameters
Name | Value |
---|---|
git_binutils | https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=40a1603112d2b1d330e11792b5506457d5584648 (unchanged) |
git_gcc | https://github.com/gcc-mirror/gcc/commit/a7d6f7327e9211fbb4a800c06d00c4555dbffcec (+ 1 commits) |
git_gdb | https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=28c3bf55f0f9aca8619c6d01be34a02a887c5577 (unchanged) |
git_newlib | https://sourceware.org/git/?p=newlib-cygwin.git;a=commit;h=86d63f0554ca3de8c4049d4140519708411f1e49 (unchanged) |
git_qemu | https://gitlab.com/qemu-project/qemu/commit/9eb5bfbe3394b92fb37cc6f155ceea4d6c9e401c (unchanged) |
regression | https://linaro.atlassian.net/browse/GNU-1304 |
test_url | https://ci.linaro.org/job/tcwg_gnu_embed_check_gcc--master-arm_eabi-build/755/ |
master-arm_eabi test results
Run | Order | Start Time | Duration |
---|---|---|---|
Current | 0755 (basepoints/gcc-15-02384-ga7d6f7327e9) | 2024-08-20T16:22:45 | 0:00:00 |
Previous | 0751 (basepoints/gcc-15-02359-g928116e94a5) | 2024-08-18T10:58:36 | 0:00:00 |
Baseline | 0011 (5-changed-components) | 2023-06-05T17:27:31 | 0:00:00 |
Tests Summary
Status Group | # | # (B) |
---|---|---|
Performance Regressions | 9 | 9 |
Performance Improvements | 6 | 20 |
Added Tests | 16 | 19 |
Unchanged Tests | 914 | 897 |
Total Tests | 945 |
Performance Regressions - FAIL | Δ | Previous | Current | σ | Δ (B) | σ (B) |
---|---|---|---|---|---|---|
g++.FAIL | 4.65% | 43.000 | 45.000 | - | -76.19% | - |
TOTAL.FAIL | 2.73% | 110.000 | 113.000 | - | -99.40% | - |
gcc.FAIL | 1.92% | 52.000 | 53.000 | - | -31.17% | - |
Performance Regressions - PASS | Δ | Previous | Current | σ | Δ (B) | σ (B) |
---|---|---|---|---|---|---|
g++.PASS | -11.63% | 226075.000 | 199783.000 | - | 0.65% | - |
TOTAL.PASS | -6.54% | 401587.000 | 375315.000 | - | -1.84% | - |
Performance Regressions - all | Δ | Previous | Current | σ | Δ (B) | σ (B) |
---|---|---|---|---|---|---|
TOTAL.all | -8.46% | 427127.000 | 390975.000 | - | 0.00% | - |
Performance Regressions - bad | Δ | Previous | Current | σ | Δ (B) | σ (B) |
---|---|---|---|---|---|---|
gcc.bad | 1.69% | 59.000 | 60.000 | - | -70.30% | - |
Performance Regressions - good | Δ | Previous | Current | σ | Δ (B) | σ (B) |
---|---|---|---|---|---|---|
g++.good | -15.08% | 239839.000 | 203672.000 | - | -3.36% | - |
TOTAL.good | -8.47% | 426987.000 | 390834.000 | - | -3.57% | - |
Performance Improvements - UNSUPPORTED | Δ | Previous | Current | σ | Δ (B) | σ (B) |
---|---|---|---|---|---|---|
g++.UNSUPPORTED | -79.52% | 12043.000 | 2467.000 | - | -77.96% | - |
TOTAL.UNSUPPORTED | -42.41% | 22592.000 | 13010.000 | - | -37.96% | - |
Performance Improvements - XFAIL | Δ | Previous | Current | σ | Δ (B) | σ (B) |
---|---|---|---|---|---|---|
g++.XFAIL | -17.37% | 1721.000 | 1422.000 | - | 34.79% | - |
TOTAL.XFAIL | -10.65% | 2808.000 | 2509.000 | - | 24.64% | - |
Performance Improvements - XPASS | Δ | Previous | Current | σ | Δ (B) | σ (B) |
---|---|---|---|---|---|---|
g++.XPASS | -20.00% | 10.000 | 8.000 | - | -20.00% | - |
TOTAL.XPASS | -11.11% | 18.000 | 16.000 | - | -11.11% | - |
Added Tests - ERROR |
---|
TOTAL.ERROR |
g++.ERROR |
gcc.ERROR |
libstdc++.ERROR |
Added Tests - KFAIL |
---|
TOTAL.KFAIL |
g++.KFAIL |
gcc.KFAIL |
libstdc++.KFAIL |
Added Tests - OTHER |
---|
TOTAL.OTHER |
g++.OTHER |
gcc.OTHER |
libstdc++.OTHER |
Added Tests - UNTESTED |
---|
TOTAL.UNTESTED |
g++.UNTESTED |
gcc.UNTESTED |
libstdc++.UNTESTED |
Performance Regressions - PASS | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
---|---|---|---|---|---|---|
TOTAL.PASS | -1.84% | 382336.000 | 375315.000 | - | -6.54% | - |
Performance Regressions - UNSUPPORTED | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
---|---|---|---|---|---|---|
libstdc++.UNSUPPORTED | 63.71% | 653.000 | 1069.000 | - | 0.00% | - |
gcc.UNSUPPORTED | 14.75% | 8256.000 | 9474.000 | - | -0.06% | - |
Performance Regressions - XFAIL | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
---|---|---|---|---|---|---|
libstdc++.XFAIL | 670.59% | 17.000 | 131.000 | - | 0.00% | - |
g++.XFAIL | 34.79% | 1055.000 | 1422.000 | - | -17.37% | - |
TOTAL.XFAIL | 24.64% | 2013.000 | 2509.000 | - | -10.65% | - |
gcc.XFAIL | 4.03% | 919.000 | 956.000 | - | 0.00% | - |
Performance Regressions - good | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
---|---|---|---|---|---|---|
TOTAL.good | -3.57% | 405320.000 | 390834.000 | - | -8.47% | - |
g++.good | -3.36% | 210743.000 | 203672.000 | - | -15.08% | - |
Performance Improvements - FAIL | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
---|---|---|---|---|---|---|
TOTAL.FAIL | -99.40% | 18705.000 | 113.000 | - | 2.73% | - |
libstdc++.FAIL | -96.74% | 460.000 | 15.000 | - | 0.00% | - |
g++.FAIL | -76.19% | 189.000 | 45.000 | - | 4.65% | - |
gcc.FAIL | -31.17% | 77.000 | 53.000 | - | 1.92% | - |
Performance Improvements - PASS | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
---|---|---|---|---|---|---|
libstdc++.PASS | 16.57% | 13634.000 | 15893.000 | - | 0.00% | - |
gcc.PASS | 7.12% | 149024.000 | 159639.000 | - | 0.01% | - |
Performance Improvements - UNRESOLVED | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
---|---|---|---|---|---|---|
TOTAL.UNRESOLVED | -99.93% | 16578.000 | 12.000 | - | 0.00% | - |
gcc.UNRESOLVED | -99.15% | 118.000 | 1.000 | - | 0.00% | - |
libstdc++.UNRESOLVED | -97.09% | 172.000 | 5.000 | - | 0.00% | - |
g++.UNRESOLVED | -95.97% | 149.000 | 6.000 | - | 0.00% | - |
Performance Improvements - UNSUPPORTED | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
---|---|---|---|---|---|---|
g++.UNSUPPORTED | -77.96% | 11192.000 | 2467.000 | - | -79.52% | - |
TOTAL.UNSUPPORTED | -37.96% | 20971.000 | 13010.000 | - | -42.41% | - |
Performance Improvements - XPASS | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
---|---|---|---|---|---|---|
g++.XPASS | -20.00% | 10.000 | 8.000 | - | -20.00% | - |
TOTAL.XPASS | -11.11% | 18.000 | 16.000 | - | -11.11% | - |
Performance Improvements - bad | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
---|---|---|---|---|---|---|
TOTAL.bad | -99.62% | 37054.000 | 141.000 | - | 0.71% | - |
libstdc++.bad | -96.53% | 634.000 | 22.000 | - | 0.00% | - |
g++.bad | -83.05% | 348.000 | 59.000 | - | 0.00% | - |
gcc.bad | -70.30% | 202.000 | 60.000 | - | 1.69% | - |
Performance Improvements - good | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
---|---|---|---|---|---|---|
libstdc++.good | 19.50% | 14304.000 | 17093.000 | - | 0.00% | - |
gcc.good | 7.50% | 158199.000 | 170069.000 | - | 0.01% | - |
Added Tests - ERROR |
---|
TOTAL.ERROR |
g++.ERROR |
gcc.ERROR |
libstdc++.ERROR |
Added Tests - KFAIL |
---|
TOTAL.KFAIL |
g++.KFAIL |
gcc.KFAIL |
libstdc++.KFAIL |
Added Tests - OTHER |
---|
TOTAL.OTHER |
g++.OTHER |
gcc.OTHER |
libstdc++.OTHER |
Added Tests - UNTESTED |
---|
TOTAL.UNTESTED |
g++.UNTESTED |
gcc.UNTESTED |
libstdc++.UNTESTED |
Added Tests - all |
---|
TOTAL.all |
Added Tests - fails |
---|
TOTAL.fails |
Added Tests - flaky |
---|
TOTAL.flaky |
Report Time: 0.36s