Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=086a2beb152c95ac43ac6b73859eb9e9081fc2df (+ 214 commits)
git_gcc https://gcc.gnu.org/git/gcc.git (9eaecce3d8c1d9349adbf8c2cdaf8d87672ed29c) (+ 372 commits)
git_gdb https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=086a2beb152c95ac43ac6b73859eb9e9081fc2df (+ 214 commits)
git_newlib https://sourceware.org/git/?p=newlib-cygwin.git;a=commit;h=c607889824395f0eac7e85d5b81c906bf8025321 (+ 9 commits)
git_qemu https://gitlab.com/qemu-project/qemu/commit/92ec7805190313c9e628f8fc4eb4f932c15247bd (+ 681 commits)
test_url https://ci.linaro.org/job/tcwg_gnu_embed_check_gcc--master-thumb_m7_hard_eabi-build/229/
Filter

master-thumb_m7_hard_eabi test results

Run Order Start Time Duration
Current 0229 (5-changed-components) 2024-10-17T01:31:28 0:00:00
Previous 0230 (basepoints/gcc-15-04235-gbcccc3221b8) 2024-10-24T21:22:41 0:00:00
Baseline 0002 (5-changed-components) 2024-04-16T12:17:35 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 0 10
Performance Improvements 7 16
Added Tests 17 17
Unchanged Tests 741 722
Total Tests 765

Performance Improvements - FAIL Δ Previous Current σ Δ (B) σ (B)
gcc.FAIL -1.74% 288.000 283.000 - 4.81% -
TOTAL.FAIL -1.49% 335.000 330.000 - -0.90% -

Performance Improvements - XPASS Δ Previous Current σ Δ (B) σ (B)
gcc.XPASS -33.33% 3.000 2.000 - 0.00% -
TOTAL.XPASS -14.29% 7.000 6.000 - -50.00% -

Performance Improvements - bad Δ Previous Current σ Δ (B) σ (B)
gcc.bad -2.05% 293.000 287.000 - 5.90% -
TOTAL.bad -1.69% 354.000 348.000 - -2.25% -

Performance Improvements - fails Δ Previous Current σ Δ (B) σ (B)
TOTAL.fails -1.69% 354.000 348.000 - -2.25% -

Added Tests - ERROR
TOTAL.ERROR
g++.ERROR
gcc.ERROR
libstdc++.ERROR

Added Tests - KFAIL
TOTAL.KFAIL
g++.KFAIL
gcc.KFAIL
libstdc++.KFAIL

Added Tests - OTHER
TOTAL.OTHER
g++.OTHER
gcc.OTHER
libstdc++.OTHER

Added Tests - UNTESTED
TOTAL.UNTESTED
g++.UNTESTED
gcc.UNTESTED
libstdc++.UNTESTED

Added Tests - flaky
TOTAL.flaky

Performance Regressions - FAIL Δ (B) Baseline Current σ (B) Δ σ
gcc.FAIL 4.81% 270.000 283.000 - -1.74% -

Performance Regressions - PASS Δ (B) Baseline Current σ (B) Δ σ
g++.PASS -8.91% 222594.000 202764.000 - 0.00% -
TOTAL.PASS -4.38% 398961.000 381502.000 - 0.00% -

Performance Regressions - UNRESOLVED Δ (B) Baseline Current σ (B) Δ σ
gcc.UNRESOLVED 100.00% 1.000 2.000 - 0.00% -
TOTAL.UNRESOLVED 9.09% 11.000 12.000 - 0.00% -

Performance Regressions - UNSUPPORTED Δ (B) Baseline Current σ (B) Δ σ
gcc.UNSUPPORTED 2.33% 9363.000 9581.000 - -0.02% -

Performance Regressions - all Δ (B) Baseline Current σ (B) Δ σ
TOTAL.all -6.35% 424574.000 397617.000 - -0.00% -

Performance Regressions - bad Δ (B) Baseline Current σ (B) Δ σ
gcc.bad 5.90% 271.000 287.000 - -2.05% -

Performance Regressions - good Δ (B) Baseline Current σ (B) Δ σ
g++.good -12.50% 236316.000 206773.000 - 0.00% -
TOTAL.good -6.35% 424218.000 397269.000 - 0.00% -

Performance Improvements - FAIL Δ (B) Baseline Current σ (B) Δ σ
g++.FAIL -31.11% 45.000 31.000 - 0.00% -
libstdc++.FAIL -11.11% 18.000 16.000 - 0.00% -

Performance Improvements - PASS Δ (B) Baseline Current σ (B) Δ σ
gcc.PASS 1.35% 160445.000 162614.000 - 0.00% -
libstdc++.PASS 1.27% 15922.000 16124.000 - 0.00% -

Performance Improvements - UNSUPPORTED Δ (B) Baseline Current σ (B) Δ σ
g++.UNSUPPORTED -79.10% 11865.000 2480.000 - 0.00% -
TOTAL.UNSUPPORTED -41.17% 22253.000 13092.000 - -0.02% -

Performance Improvements - XFAIL Δ (B) Baseline Current σ (B) Δ σ
g++.XFAIL -17.66% 1857.000 1529.000 - 0.00% -
TOTAL.XFAIL -10.95% 3004.000 2675.000 - 0.00% -

Performance Improvements - XPASS Δ (B) Baseline Current σ (B) Δ σ
g++.XPASS -80.00% 10.000 2.000 - 0.00% -
TOTAL.XPASS -50.00% 12.000 6.000 - -14.29% -

Performance Improvements - bad Δ (B) Baseline Current σ (B) Δ σ
g++.bad -36.07% 61.000 39.000 - 0.00% -
libstdc++.bad -8.33% 24.000 22.000 - 0.00% -
TOTAL.bad -2.25% 356.000 348.000 - -1.69% -

Performance Improvements - fails Δ (B) Baseline Current σ (B) Δ σ
TOTAL.fails -2.25% 356.000 348.000 - -1.69% -

Performance Improvements - good Δ (B) Baseline Current σ (B) Δ σ
gcc.good 1.40% 170824.000 173209.000 - 0.00% -
libstdc++.good 1.22% 17078.000 17287.000 - 0.00% -

Added Tests - ERROR
TOTAL.ERROR
g++.ERROR
gcc.ERROR
libstdc++.ERROR

Added Tests - KFAIL
TOTAL.KFAIL
g++.KFAIL
gcc.KFAIL
libstdc++.KFAIL

Added Tests - OTHER
TOTAL.OTHER
g++.OTHER
gcc.OTHER
libstdc++.OTHER

Added Tests - UNTESTED
TOTAL.UNTESTED
g++.UNTESTED
gcc.UNTESTED
libstdc++.UNTESTED

Added Tests - flaky
TOTAL.flaky


Report Time: 0.19s
Name Current %
TOTAL.PASS 381502.000 -
g++.PASS 202764.000 -
gcc.PASS 162614.000 -
libstdc++.PASS 16124.000 -
Geometric Mean 119338.232 -
Name Current %
TOTAL.XPASS 6.000 -14.29%
g++.XPASS 2.000 -
gcc.XPASS 2.000 -33.33%
libstdc++.XPASS 2.000 -
Geometric Mean 2.632 -13.06%
Name Current %
TOTAL.FAIL 330.000 -1.49%
g++.FAIL 31.000 -
gcc.FAIL 283.000 -1.74%
libstdc++.FAIL 16.000 -
Geometric Mean 82.499 -
Name Current %
TOTAL.XFAIL 2675.000 -
g++.XFAIL 1529.000 -
gcc.XFAIL 1014.000 -
libstdc++.XFAIL 132.000 -
Geometric Mean 860.173 -
Name Current %
TOTAL.KFAIL 0.000 -
g++.KFAIL 0.000 -
gcc.KFAIL 0.000 -
libstdc++.KFAIL 0.000 -
Geometric Mean 0.000 -
Name Current %
TOTAL.UNSUPPORTED 13092.000 -
g++.UNSUPPORTED 2480.000 -
gcc.UNSUPPORTED 9581.000 -
libstdc++.UNSUPPORTED 1031.000 -
Geometric Mean 4231.865 -
Name Current %
TOTAL.ERROR 0.000 -
g++.ERROR 0.000 -
gcc.ERROR 0.000 -
libstdc++.ERROR 0.000 -
Geometric Mean 0.000 -
Name Current %
TOTAL.OTHER 0.000 -
g++.OTHER 0.000 -
gcc.OTHER 0.000 -
libstdc++.OTHER 0.000 -
Geometric Mean 0.000 -
Name Current %
TOTAL.good 397269.000 -
g++.good 206773.000 -
gcc.good 173209.000 -
libstdc++.good 17287.000 -
Geometric Mean 125232.528 -
bad
Name Current %
TOTAL.bad 348.000 -1.69%
g++.bad 39.000 -
gcc.bad 287.000 -2.05%
libstdc++.bad 22.000 -
Geometric Mean 96.214 -
Name Current %
TOTAL.fails 348.000 -1.69%
Geometric Mean 348.000 -1.69%
Name Current %
TOTAL.flaky 0.000 -
Geometric Mean 0.000 -
all
Name Current %
TOTAL.all 397617.000 -
Geometric Mean 397617.000 -