Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=387f97a1b24e968e06dd62f91a26eb0a883fff58 (unchanged)
git_gcc https://github.com/gcc-mirror/gcc/commit/de1923f9f4d5344694c22ca883aeb15caf635734 (+ 1 commits)
git_gdb https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=05b3e96495386ee41358c68b8787274ce77ae049 (unchanged)
git_newlib https://sourceware.org/git/?p=newlib-cygwin.git;a=commit;h=a422196c56fa2b5c4823d67cf92acdfc164e5da4 (unchanged)
git_qemu https://gitlab.com/qemu-project/qemu/commit/f259e4cb8a8b4ef5463326fc214a7d8d7703d5de (unchanged)
test_url https://ci.linaro.org/job/tcwg_gnu_embed_check_gcc--master-thumb_m3_softfp_eabi-build/166/
Filter

master-thumb_m3_softfp_eabi test results

Run Order Start Time Duration
Current 0166 (basepoints/gcc-15-03128-gde1923f9f4d5) 2024-08-25T14:55:47 0:00:00
Previous 0185 (4-changed-components) 2024-09-07T01:09:56 0:00:00
Baseline 0002 (5-changed-components) 2024-04-14T00:16:53 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 2 13
Performance Improvements 25 10
Added Tests 16 16
Unchanged Tests 722 726
Total Tests 765

Performance Regressions - XFAIL Δ Previous Current σ Δ (B) σ (B)
libstdc++.XFAIL 1366.67% 9.000 132.000 - 0.76% -
TOTAL.XFAIL 5.27% 2522.000 2655.000 - -11.14% -

Performance Improvements - FAIL Δ Previous Current σ Δ (B) σ (B)
libstdc++.FAIL -99.68% 4697.000 15.000 - -16.67% -
g++.FAIL -99.59% 10193.000 42.000 - -22.22% -
TOTAL.FAIL -99.15% 37873.000 321.000 - 4.56% -
gcc.FAIL -98.85% 22983.000 264.000 - 12.34% -

Performance Improvements - PASS Δ Previous Current σ Δ (B) σ (B)
libstdc++.PASS 164.21% 6080.000 16064.000 - 0.95% -
gcc.PASS 37.91% 116222.000 160280.000 - 0.80% -
TOTAL.PASS 24.08% 303587.000 376697.000 - -5.21% -
g++.PASS 10.52% 181285.000 200353.000 - -9.95% -

Performance Improvements - UNRESOLVED Δ Previous Current σ Δ (B) σ (B)
g++.UNRESOLVED -99.93% 8919.000 6.000 - 0.00% -
libstdc++.UNRESOLVED -99.91% 4643.000 4.000 - 0.00% -
TOTAL.UNRESOLVED -99.90% 34379.000 36.000 - 2.86% -
gcc.UNRESOLVED -99.88% 20817.000 26.000 - 4.00% -

Performance Improvements - UNSUPPORTED Δ Previous Current σ Δ (B) σ (B)
libstdc++.UNSUPPORTED -13.08% 1185.000 1030.000 - 0.49% -
g++.UNSUPPORTED -2.41% 2527.000 2466.000 - -79.22% -
TOTAL.UNSUPPORTED -1.68% 13557.000 13329.000 - -40.92% -

Performance Improvements - XPASS Δ Previous Current σ Δ (B) σ (B)
gcc.XPASS -50.00% 4.000 2.000 - 0.00% -

Performance Improvements - bad Δ Previous Current σ Δ (B) σ (B)
libstdc++.bad -99.78% 9340.000 21.000 - -12.50% -
g++.bad -99.74% 19114.000 50.000 - -28.57% -
TOTAL.bad -99.50% 72258.000 363.000 - 2.54% -
gcc.bad -99.33% 43804.000 292.000 - 12.31% -

Performance Improvements - fails Δ Previous Current σ Δ (B) σ (B)
TOTAL.fails -99.50% 72258.000 362.000 - 2.26% -

Performance Improvements - good Δ Previous Current σ Δ (B) σ (B)
libstdc++.good 136.82% 7274.000 17226.000 - 0.92% -
gcc.good 34.67% 127062.000 171110.000 - 0.85% -
TOTAL.good 22.84% 319666.000 392681.000 - -7.16% -
g++.good 10.26% 185330.000 204345.000 - -13.49% -

Added Tests - ERROR
TOTAL.ERROR
g++.ERROR
gcc.ERROR
libstdc++.ERROR

Added Tests - KFAIL
TOTAL.KFAIL
g++.KFAIL
gcc.KFAIL
libstdc++.KFAIL

Added Tests - OTHER
TOTAL.OTHER
g++.OTHER
gcc.OTHER
libstdc++.OTHER

Added Tests - UNTESTED
TOTAL.UNTESTED
g++.UNTESTED
gcc.UNTESTED
libstdc++.UNTESTED

Performance Regressions - FAIL Δ (B) Baseline Current σ (B) Δ σ
gcc.FAIL 12.34% 235.000 264.000 - -98.85% -
TOTAL.FAIL 4.56% 307.000 321.000 - -99.15% -

Performance Regressions - PASS Δ (B) Baseline Current σ (B) Δ σ
g++.PASS -9.95% 222480.000 200353.000 - 10.52% -
TOTAL.PASS -5.21% 397400.000 376697.000 - 24.08% -

Performance Regressions - UNRESOLVED Δ (B) Baseline Current σ (B) Δ σ
gcc.UNRESOLVED 4.00% 25.000 26.000 - -99.88% -
TOTAL.UNRESOLVED 2.86% 35.000 36.000 - -99.90% -

Performance Regressions - UNSUPPORTED Δ (B) Baseline Current σ (B) Δ σ
gcc.UNSUPPORTED 1.74% 9665.000 9833.000 - -0.12% -

Performance Regressions - all Δ (B) Baseline Current σ (B) Δ σ
TOTAL.all -7.15% 423302.000 393044.000 - 0.29% -

Performance Regressions - bad Δ (B) Baseline Current σ (B) Δ σ
gcc.bad 12.31% 260.000 292.000 - -99.33% -
TOTAL.bad 2.54% 354.000 363.000 - -99.50% -

Performance Regressions - fails Δ (B) Baseline Current σ (B) Δ σ
TOTAL.fails 2.26% 354.000 362.000 - -99.50% -

Performance Regressions - good Δ (B) Baseline Current σ (B) Δ σ
g++.good -13.49% 236207.000 204345.000 - 10.26% -
TOTAL.good -7.16% 422948.000 392681.000 - 22.84% -

Performance Improvements - FAIL Δ (B) Baseline Current σ (B) Δ σ
g++.FAIL -22.22% 54.000 42.000 - -99.59% -
libstdc++.FAIL -16.67% 18.000 15.000 - -99.68% -

Performance Improvements - UNSUPPORTED Δ (B) Baseline Current σ (B) Δ σ
g++.UNSUPPORTED -79.22% 11870.000 2466.000 - -2.41% -
TOTAL.UNSUPPORTED -40.92% 22560.000 13329.000 - -1.68% -

Performance Improvements - XFAIL Δ (B) Baseline Current σ (B) Δ σ
g++.XFAIL -17.82% 1857.000 1526.000 - 0.53% -
TOTAL.XFAIL -11.14% 2988.000 2655.000 - 5.27% -

Performance Improvements - XPASS Δ (B) Baseline Current σ (B) Δ σ
g++.XPASS -80.00% 10.000 2.000 - 0.00% -
TOTAL.XPASS -50.00% 12.000 6.000 - 0.00% -

Performance Improvements - bad Δ (B) Baseline Current σ (B) Δ σ
g++.bad -28.57% 70.000 50.000 - -99.74% -
libstdc++.bad -12.50% 24.000 21.000 - -99.78% -

Added Tests - ERROR
TOTAL.ERROR
g++.ERROR
gcc.ERROR
libstdc++.ERROR

Added Tests - KFAIL
TOTAL.KFAIL
g++.KFAIL
gcc.KFAIL
libstdc++.KFAIL

Added Tests - OTHER
TOTAL.OTHER
g++.OTHER
gcc.OTHER
libstdc++.OTHER

Added Tests - UNTESTED
TOTAL.UNTESTED
g++.UNTESTED
gcc.UNTESTED
libstdc++.UNTESTED


Report Time: 0.20s
Name Current %
TOTAL.PASS 376697.000 24.08%
g++.PASS 200353.000 10.52%
gcc.PASS 160280.000 37.91%
libstdc++.PASS 16064.000 164.21%
Geometric Mean 118067.471 49.51%
Name Current %
TOTAL.XPASS 6.000 -
g++.XPASS 2.000 -
gcc.XPASS 2.000 -50.00%
libstdc++.XPASS 2.000 -
Geometric Mean 2.632 900.36%
Name Current %
TOTAL.FAIL 321.000 -99.15%
g++.FAIL 42.000 -99.59%
gcc.FAIL 264.000 -98.85%
libstdc++.FAIL 15.000 -99.68%
Geometric Mean 85.480 -99.40%
Name Current %
TOTAL.XFAIL 2655.000 5.27%
g++.XFAIL 1526.000 -
gcc.XFAIL 997.000 -
libstdc++.XFAIL 132.000 1366.67%
Geometric Mean 854.520 98.59%
Name Current %
TOTAL.KFAIL 0.000 -
g++.KFAIL 0.000 -
gcc.KFAIL 0.000 -
libstdc++.KFAIL 0.000 -
Geometric Mean 0.000 -
Name Current %
TOTAL.UNSUPPORTED 13329.000 -1.68%
g++.UNSUPPORTED 2466.000 -2.41%
gcc.UNSUPPORTED 9833.000 -
libstdc++.UNSUPPORTED 1030.000 -13.08%
Geometric Mean 4271.481 -4.47%
Name Current %
TOTAL.UNRESOLVED 36.000 -99.90%
g++.UNRESOLVED 6.000 -99.93%
gcc.UNRESOLVED 26.000 -99.88%
libstdc++.UNRESOLVED 4.000 -99.91%
Geometric Mean 12.243 -99.91%
Name Current %
TOTAL.ERROR 0.000 -
g++.ERROR 0.000 -
gcc.ERROR 0.000 -
libstdc++.ERROR 0.000 -
Geometric Mean 0.000 -
Name Current %
TOTAL.OTHER 0.000 -
g++.OTHER 0.000 -
gcc.OTHER 0.000 -
libstdc++.OTHER 0.000 -
Geometric Mean 0.000 -
Name Current %
TOTAL.good 392681.000 22.84%
g++.good 204345.000 10.26%
gcc.good 171110.000 34.67%
libstdc++.good 17226.000 136.82%
Geometric Mean 124012.635 44.16%
bad
Name Current %
TOTAL.bad 363.000 -99.50%
g++.bad 50.000 -99.74%
gcc.bad 292.000 -99.33%
libstdc++.bad 21.000 -99.78%
Geometric Mean 102.712 -99.63%
Name Current %
TOTAL.fails 362.000 -99.50%
Geometric Mean 362.000 -99.50%
Name Current %
TOTAL.flaky 75.000 -
Geometric Mean 75.000 -
all
Name Current %
TOTAL.all 393044.000 -
Geometric Mean 393044.000 -