Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=1794b3a18db2e5241f4daa88c99a5bcec9b1c311 (unchanged)
git_gcc https://github.com/gcc-mirror/gcc/commit/4308c343b8eae789ef5aa4ac2e33a1d4e6aca32a (+ 1 commits)
git_gdb https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=1794b3a18db2e5241f4daa88c99a5bcec9b1c311 (unchanged)
git_newlib https://sourceware.org/git/?p=newlib-cygwin.git;a=commit;h=5a9fe580149d302eb64ebec516c173903cd99620 (unchanged)
git_qemu https://gitlab.com/qemu-project/qemu/commit/ea9cdbcf3a0b8d5497cddf87990f1b39d8f3bb0a (unchanged)
regression https://linaro.atlassian.net/browse/GNU-1345
test_url https://ci.linaro.org/job/tcwg_gnu_embed_check_gcc--master-arm_v7a_softfp_eabi-build/613/
Filter

master-arm_v7a_softfp_eabi test results

Run Order Start Time Duration
Current 0613 (basepoints/gcc-15-03617-g4308c343b8e) 2024-09-16T11:44:32 0:00:00
Previous 0623 (basepoints/gcc-15-03861-gaf8ff0047e4) 2024-09-30T05:17:25 0:00:00
Baseline 0243 (5-changed-components) 2023-10-17T06:57:04 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 8 10
Performance Improvements 0 15
Added Tests 17 20
Unchanged Tests 740 720
Total Tests 765

Performance Regressions - FAIL Δ Previous Current σ Δ (B) σ (B)
g++.FAIL 11.54% 26.000 29.000 - -68.82% -
TOTAL.FAIL 3.64% 110.000 114.000 - -31.33% -
gcc.FAIL 1.45% 69.000 70.000 - 14.75% -

Performance Regressions - bad Δ Previous Current σ Δ (B) σ (B)
g++.bad 10.71% 28.000 31.000 - -73.28% -
TOTAL.bad 2.70% 148.000 152.000 - -29.30% -
gcc.bad 1.02% 98.000 99.000 - 16.47% -

Performance Regressions - fails Δ Previous Current σ Δ (B) σ (B)
TOTAL.fails 2.70% 148.000 152.000 - 0.00% -

Performance Regressions - flaky Δ Previous Current σ Δ (B) σ (B)
TOTAL.flaky 1600.00% 5.000 85.000 - 0.00% -

Added Tests - ERROR
TOTAL.ERROR
g++.ERROR
gcc.ERROR
libstdc++.ERROR

Added Tests - KFAIL
TOTAL.KFAIL
g++.KFAIL
gcc.KFAIL
libstdc++.KFAIL

Added Tests - OTHER
TOTAL.OTHER
g++.OTHER
gcc.OTHER
libstdc++.OTHER

Added Tests - UNRESOLVED
g++.UNRESOLVED

Added Tests - UNTESTED
TOTAL.UNTESTED
g++.UNTESTED
gcc.UNTESTED
libstdc++.UNTESTED

Performance Regressions - FAIL Δ (B) Baseline Current σ (B) Δ σ
libstdc++.FAIL 25.00% 12.000 15.000 - 0.00% -
gcc.FAIL 14.75% 61.000 70.000 - 1.45% -

Performance Regressions - PASS Δ (B) Baseline Current σ (B) Δ σ
g++.PASS -2.07% 206312.000 202032.000 - -0.14% -

Performance Regressions - UNRESOLVED Δ (B) Baseline Current σ (B) Δ σ
TOTAL.UNRESOLVED 25.00% 24.000 30.000 - 0.00% -
gcc.UNRESOLVED 4.17% 24.000 25.000 - 0.00% -

Performance Regressions - UNSUPPORTED Δ (B) Baseline Current σ (B) Δ σ
gcc.UNSUPPORTED 10.30% 8542.000 9422.000 - -0.07% -
libstdc++.UNSUPPORTED 1.58% 1014.000 1030.000 - 0.00% -

Performance Regressions - bad Δ (B) Baseline Current σ (B) Δ σ
libstdc++.bad 57.14% 14.000 22.000 - 0.00% -
gcc.bad 16.47% 85.000 99.000 - 1.02% -

Performance Regressions - good Δ (B) Baseline Current σ (B) Δ σ
g++.good -6.03% 219272.000 206056.000 - -0.14% -

Performance Improvements - FAIL Δ (B) Baseline Current σ (B) Δ σ
g++.FAIL -68.82% 93.000 29.000 - 11.54% -
TOTAL.FAIL -31.33% 166.000 114.000 - 3.64% -

Performance Improvements - PASS Δ (B) Baseline Current σ (B) Δ σ
gcc.PASS 5.82% 155026.000 164048.000 - -0.03% -
libstdc++.PASS 4.00% 15478.000 16097.000 - -0.05% -
TOTAL.PASS 1.42% 376816.000 382177.000 - -0.09% -

Performance Improvements - UNSUPPORTED Δ (B) Baseline Current σ (B) Δ σ
g++.UNSUPPORTED -77.92% 11287.000 2492.000 - -0.40% -
TOTAL.UNSUPPORTED -37.90% 20843.000 12944.000 - -0.13% -

Performance Improvements - XFAIL Δ (B) Baseline Current σ (B) Δ σ
g++.XFAIL -8.43% 1673.000 1532.000 - 0.00% -
TOTAL.XFAIL -5.07% 2822.000 2679.000 - -0.04% -

Performance Improvements - XPASS Δ (B) Baseline Current σ (B) Δ σ
g++.XPASS -91.30% 23.000 2.000 - 0.00% -
TOTAL.XPASS -68.00% 25.000 8.000 - 0.00% -

Performance Improvements - bad Δ (B) Baseline Current σ (B) Δ σ
g++.bad -73.28% 116.000 31.000 - 10.71% -
TOTAL.bad -29.30% 215.000 152.000 - 2.70% -

Performance Improvements - good Δ (B) Baseline Current σ (B) Δ σ
gcc.good 6.01% 164586.000 174485.000 - -0.04% -
libstdc++.good 3.83% 16623.000 17259.000 - -0.05% -

Added Tests - ERROR
TOTAL.ERROR
g++.ERROR
gcc.ERROR
libstdc++.ERROR

Added Tests - KFAIL
TOTAL.KFAIL
g++.KFAIL
gcc.KFAIL
libstdc++.KFAIL

Added Tests - OTHER
TOTAL.OTHER
g++.OTHER
gcc.OTHER
libstdc++.OTHER

Added Tests - UNRESOLVED
g++.UNRESOLVED

Added Tests - UNTESTED
TOTAL.UNTESTED
g++.UNTESTED
gcc.UNTESTED
libstdc++.UNTESTED

Added Tests - all
TOTAL.all

Added Tests - fails
TOTAL.fails

Added Tests - flaky
TOTAL.flaky


Report Time: 0.41s
Name Current %
TOTAL.PASS 382177.000 -
g++.PASS 202032.000 -
gcc.PASS 164048.000 -
libstdc++.PASS 16097.000 -
Geometric Mean 119495.114 -
Name Current %
TOTAL.XPASS 8.000 -
g++.XPASS 2.000 -
gcc.XPASS 4.000 -
libstdc++.XPASS 2.000 -
Geometric Mean 3.364 -
Name Current %
TOTAL.FAIL 114.000 3.64%
g++.FAIL 29.000 11.54%
gcc.FAIL 70.000 1.45%
libstdc++.FAIL 15.000 -
Geometric Mean 43.164 4.06%
Name Current %
TOTAL.XFAIL 2679.000 -
g++.XFAIL 1532.000 -
gcc.XFAIL 1015.000 -
libstdc++.XFAIL 132.000 -
Geometric Mean 861.128 -
Name Current %
TOTAL.KFAIL 0.000 -
g++.KFAIL 0.000 -
gcc.KFAIL 0.000 -
libstdc++.KFAIL 0.000 -
Geometric Mean 0.000 -
Name Current %
TOTAL.UNSUPPORTED 12944.000 -
g++.UNSUPPORTED 2492.000 -
gcc.UNSUPPORTED 9422.000 -
libstdc++.UNSUPPORTED 1030.000 -
Geometric Mean 4206.290 -
Name Current %
TOTAL.ERROR 0.000 -
g++.ERROR 0.000 -
gcc.ERROR 0.000 -
libstdc++.ERROR 0.000 -
Geometric Mean 0.000 -
Name Current %
TOTAL.OTHER 0.000 -
g++.OTHER 0.000 -
gcc.OTHER 0.000 -
libstdc++.OTHER 0.000 -
Geometric Mean 0.000 -
Name Current %
TOTAL.good 397800.000 -
g++.good 206056.000 -
gcc.good 174485.000 -
libstdc++.good 17259.000 -
Geometric Mean 125344.691 -
bad
Name Current %
TOTAL.bad 152.000 2.70%
g++.bad 31.000 10.71%
gcc.bad 99.000 1.02%
libstdc++.bad 22.000 -
Geometric Mean 56.600 3.53%
Name Current %
TOTAL.fails 152.000 2.70%
Geometric Mean 152.000 2.70%
Name Current %
TOTAL.flaky 85.000 1600.00%
Geometric Mean 85.000 1600.00%
all
Name Current %
TOTAL.all 397952.000 -
Geometric Mean 397952.000 -