Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=8a269c262e3d0611c01edd915f230bbd2ad78015 (unchanged)
git_gcc https://github.com/gcc-mirror/gcc/commit/dcd538933f8559b4ca9467da8eff3040f5af6166 (+ 1 commits)
git_gdb https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=8a269c262e3d0611c01edd915f230bbd2ad78015 (unchanged)
git_newlib https://sourceware.org/git/?p=newlib-cygwin.git;a=commit;h=4c7d0dfec5793cbf5cf3930b91f930479126d8ce (unchanged)
git_qemu https://gitlab.com/qemu-project/qemu/commit/b455ce4c2f300c8ba47cba7232dd03261368a4cb (unchanged)
test_url https://ci.linaro.org/job/tcwg_gnu_embed_check_gcc--master-arm_eabi-build/150/
Filter

master-arm_eabi test results

Run Order Start Time Duration
Current 0150 (basepoints/gcc-14-02145-gdcd538933f8) 2023-06-27T13:53:53 0:00:00
Previous 0072 (3-changed-components) 2023-06-15T03:08:57 0:00:00
Baseline 0011 (5-changed-components) 2023-06-05T17:27:31 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 25 25
Performance Improvements 2 2
Added Tests 17 17
Unchanged Tests 901 901
Total Tests 945

Performance Regressions - FAIL Δ Previous Current σ Δ (B) σ (B)
gcc.FAIL 26982.05% 78.000 21124.000 - 27333.77% -
g++.FAIL 5740.10% 192.000 11213.000 - 5832.80% -
TOTAL.FAIL 4904.80% 729.000 36485.000 - 95.05% -
libstdc++.FAIL 803.70% 459.000 4148.000 - 801.74% -

Performance Regressions - PASS Δ Previous Current σ Δ (B) σ (B)
libstdc++.PASS -65.93% 13638.000 4647.000 - -65.92% -
gcc.PASS -28.85% 149138.000 106116.000 - -28.79% -
TOTAL.PASS -20.06% 361375.000 288869.000 - -24.45% -
g++.PASS -10.32% 198599.000 178106.000 - -10.27% -

Performance Regressions - UNRESOLVED Δ Previous Current σ Δ (B) σ (B)
gcc.UNRESOLVED 16150.85% 118.000 19176.000 - 16150.85% -
TOTAL.UNRESOLVED 7444.19% 439.000 33119.000 - 99.78% -
g++.UNRESOLVED 6504.70% 149.000 9841.000 - 6504.70% -
libstdc++.UNRESOLVED 2284.88% 172.000 4102.000 - 2284.88% -

Performance Regressions - UNSUPPORTED Δ Previous Current σ Δ (B) σ (B)
libstdc++.UNSUPPORTED 70.18% 654.000 1113.000 - 70.44% -
gcc.UNSUPPORTED 4.15% 8256.000 8599.000 - 4.15% -
TOTAL.UNSUPPORTED 3.65% 20119.000 20853.000 - -0.56% -

Performance Regressions - XPASS Δ Previous Current σ Δ (B) σ (B)
gcc.XPASS 33.33% 6.000 8.000 - 33.33% -

Performance Regressions - bad Δ Previous Current σ Δ (B) σ (B)
gcc.bad 19756.16% 203.000 40308.000 - 19854.46% -
g++.bad 5901.14% 351.000 21064.000 - 5952.87% -
TOTAL.bad 5765.37% 1187.000 69622.000 - 87.89% -
libstdc++.bad 1203.32% 633.000 8250.000 - 1201.26% -

Performance Regressions - fails Δ Previous Current σ Δ (B) σ (B)
TOTAL.fails 6217.60% 1102.000 69620.000 - 97.69% -

Performance Regressions - good Δ Previous Current σ Δ (B) σ (B)
libstdc++.good -59.70% 14309.000 5766.000 - -59.69% -
gcc.good -26.96% 158313.000 115632.000 - -26.91% -
TOTAL.good -18.72% 383493.000 311700.000 - -23.10% -
g++.good -9.75% 210871.000 190302.000 - -9.70% -

Performance Improvements - XFAIL Δ Previous Current σ Δ (B) σ (B)
libstdc++.XFAIL -64.71% 17.000 6.000 - -64.71% -
TOTAL.XFAIL -1.05% 1999.000 1978.000 - -1.74% -

Added Tests - ERROR
TOTAL.ERROR
g++.ERROR
gcc.ERROR
libstdc++.ERROR

Added Tests - KFAIL
TOTAL.KFAIL
g++.KFAIL
gcc.KFAIL
libstdc++.KFAIL

Added Tests - OTHER
TOTAL.OTHER
g++.OTHER
gcc.OTHER
libstdc++.OTHER

Added Tests - UNTESTED
TOTAL.UNTESTED
g++.UNTESTED
gcc.UNTESTED
libstdc++.UNTESTED

Added Tests - XPASS
libstdc++.XPASS

Performance Regressions - FAIL Δ (B) Baseline Current σ (B) Δ σ
gcc.FAIL 27333.77% 77.000 21124.000 - 26982.05% -
g++.FAIL 5832.80% 189.000 11213.000 - 5740.10% -
libstdc++.FAIL 801.74% 460.000 4148.000 - 803.70% -
TOTAL.FAIL 95.05% 18705.000 36485.000 - 4904.80% -

Performance Regressions - PASS Δ (B) Baseline Current σ (B) Δ σ
libstdc++.PASS -65.92% 13634.000 4647.000 - -65.93% -
gcc.PASS -28.79% 149024.000 106116.000 - -28.85% -
TOTAL.PASS -24.45% 382336.000 288869.000 - -20.06% -
g++.PASS -10.27% 198496.000 178106.000 - -10.32% -

Performance Regressions - UNRESOLVED Δ (B) Baseline Current σ (B) Δ σ
gcc.UNRESOLVED 16150.85% 118.000 19176.000 - 16150.85% -
g++.UNRESOLVED 6504.70% 149.000 9841.000 - 6504.70% -
libstdc++.UNRESOLVED 2284.88% 172.000 4102.000 - 2284.88% -
TOTAL.UNRESOLVED 99.78% 16578.000 33119.000 - 7444.19% -

Performance Regressions - UNSUPPORTED Δ (B) Baseline Current σ (B) Δ σ
libstdc++.UNSUPPORTED 70.44% 653.000 1113.000 - 70.18% -
gcc.UNSUPPORTED 4.15% 8256.000 8599.000 - 4.15% -

Performance Regressions - XPASS Δ (B) Baseline Current σ (B) Δ σ
gcc.XPASS 33.33% 6.000 8.000 - 33.33% -

Performance Regressions - all Δ (B) Baseline Current σ (B) Δ σ
TOTAL.all -13.80% 442374.000 381322.000 - -0.87% -

Performance Regressions - bad Δ (B) Baseline Current σ (B) Δ σ
gcc.bad 19854.46% 202.000 40308.000 - 19756.16% -
g++.bad 5952.87% 348.000 21064.000 - 5901.14% -
libstdc++.bad 1201.26% 634.000 8250.000 - 1203.32% -
TOTAL.bad 87.89% 37054.000 69622.000 - 5765.37% -

Performance Regressions - fails Δ (B) Baseline Current σ (B) Δ σ
TOTAL.fails 97.69% 35217.000 69620.000 - 6217.60% -

Performance Regressions - good Δ (B) Baseline Current σ (B) Δ σ
libstdc++.good -59.69% 14304.000 5766.000 - -59.70% -
gcc.good -26.91% 158199.000 115632.000 - -26.96% -
TOTAL.good -23.10% 405320.000 311700.000 - -18.72% -
g++.good -9.70% 210743.000 190302.000 - -9.75% -

Performance Improvements - XFAIL Δ (B) Baseline Current σ (B) Δ σ
libstdc++.XFAIL -64.71% 17.000 6.000 - -64.71% -
TOTAL.XFAIL -1.74% 2013.000 1978.000 - -1.05% -

Added Tests - ERROR
TOTAL.ERROR
g++.ERROR
gcc.ERROR
libstdc++.ERROR

Added Tests - KFAIL
TOTAL.KFAIL
g++.KFAIL
gcc.KFAIL
libstdc++.KFAIL

Added Tests - OTHER
TOTAL.OTHER
g++.OTHER
gcc.OTHER
libstdc++.OTHER

Added Tests - UNTESTED
TOTAL.UNTESTED
g++.UNTESTED
gcc.UNTESTED
libstdc++.UNTESTED

Added Tests - XPASS
libstdc++.XPASS


Report Time: 0.20s
Name Current %
TOTAL.PASS 288869.000 -20.06%
g++.PASS 178106.000 -10.32%
gcc.PASS 106116.000 -28.85%
libstdc++.PASS 4647.000 -65.93%
Geometric Mean 70971.382 -35.43%
Name Current %
TOTAL.XPASS 18.000 -
g++.XPASS 10.000 -
gcc.XPASS 8.000 33.33%
libstdc++.XPASS 0.000 -
Geometric Mean 0.616 -94.00%
Name Current %
TOTAL.FAIL 36485.000 4904.80%
g++.FAIL 11213.000 5740.10%
gcc.FAIL 21124.000 26982.05%
libstdc++.FAIL 4148.000 803.70%
Geometric Mean 13759.821 5071.64%
Name Current %
TOTAL.XFAIL 1978.000 -1.05%
g++.XFAIL 1055.000 -
gcc.XFAIL 917.000 -
libstdc++.XFAIL 6.000 -64.71%
Geometric Mean 327.342 -23.31%
Name Current %
TOTAL.KFAIL 0.000 -
g++.KFAIL 0.000 -
gcc.KFAIL 0.000 -
libstdc++.KFAIL 0.000 -
Geometric Mean 0.000 -
Name Current %
TOTAL.UNSUPPORTED 20853.000 3.65%
g++.UNSUPPORTED 11141.000 -
gcc.UNSUPPORTED 8599.000 4.15%
libstdc++.UNSUPPORTED 1113.000 70.18%
Geometric Mean 6866.872 16.25%
Name Current %
TOTAL.UNRESOLVED 33119.000 7444.19%
g++.UNRESOLVED 9841.000 6504.70%
gcc.UNRESOLVED 19176.000 16150.85%
libstdc++.UNRESOLVED 4102.000 2284.88%
Geometric Mean 12653.700 6529.06%
Name Current %
TOTAL.ERROR 0.000 -
g++.ERROR 0.000 -
gcc.ERROR 0.000 -
libstdc++.ERROR 0.000 -
Geometric Mean 0.000 -
Name Current %
TOTAL.OTHER 0.000 -
g++.OTHER 0.000 -
gcc.OTHER 0.000 -
libstdc++.OTHER 0.000 -
Geometric Mean 0.000 -
Name Current %
TOTAL.good 311700.000 -18.72%
g++.good 190302.000 -9.75%
gcc.good 115632.000 -26.96%
libstdc++.good 5766.000 -59.70%
Geometric Mean 79301.830 -31.84%
bad
Name Current %
TOTAL.bad 69622.000 5765.37%
g++.bad 21064.000 5901.14%
gcc.bad 40308.000 19756.16%
libstdc++.bad 8250.000 1203.32%
Geometric Mean 26426.104 5393.75%
Name Current %
TOTAL.fails 69620.000 6217.60%
Geometric Mean 69620.000 6217.60%
Name Current %
TOTAL.flaky 18.000 -
Geometric Mean 18.000 -
all
Name Current %
TOTAL.all 381322.000 -
Geometric Mean 381322.000 -