Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=0d5ffd658faf6920c99405b6b68d6046f10c845f (+ 17 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/b4c6faa5375c6ea55f6a7f6d188ee404bf9922de (+ 71 commits)
git_gdb https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=6a1cf1bfedbcdb977d9ead3bf6a228360d78cc1b (+ 19 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=d6c72f976c61d3c1465699f2bcad77e62bafe61d (unchanged)
git_linux https://git.linaro.org/kernel-org/linux.git/commit/?id=f1fcbaa18b28dec10281551dfe6ed3a3ed80e3d6 (+ 90 commits)
git_qemu https://gitlab.com/qemu-project/qemu/commit/8844bb8d896595ee1d25d21c770e6e6f29803097 (+ 17 commits)
test_url https://ci.linaro.org/job/tcwg_gnu_cross_check_gcc--master-arm-build/300/
Filter

master-arm test results

Run Order Start Time Duration
Current 0300 (5-changed-components) 2023-05-13T06:43:56 0:00:00
Previous 0258 (basepoints/gcc-14-00591-g73f7109ffb15) 2023-05-08T13:31:56 0:00:00
Baseline 0067 (6-changed-components) 2023-04-19T10:48:24 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 2 2
Performance Improvements 12 8
Added Tests 46 46
Unchanged Tests 1425 1429
Total Tests 1485

Performance Regressions - FAIL Δ Previous Current σ Δ (B) σ (B)
libgomp.FAIL 13.33% 15.000 17.000 - 13.33% -

Performance Regressions - bad Δ Previous Current σ Δ (B) σ (B)
libgomp.bad 13.33% 15.000 17.000 - 13.33% -

Performance Improvements - ERROR Δ Previous Current σ Δ (B) σ (B)
TOTAL.ERROR -98.67% 75.000 1.000 - 0.00% -
gcc.ERROR -98.67% 75.000 1.000 - 0.00% -

Performance Improvements - PASS Δ Previous Current σ Δ (B) σ (B)
gcc.PASS 3.90% 161790.000 168104.000 - 0.22% -
TOTAL.PASS 1.30% 492439.000 498850.000 - 0.18% -

Performance Improvements - UNRESOLVED Δ Previous Current σ Δ (B) σ (B)
gcc.UNRESOLVED -36.73% 226.000 143.000 - 0.00% -
TOTAL.UNRESOLVED -22.07% 376.000 293.000 - -8.44% -

Performance Improvements - all Δ Previous Current σ Δ (B) σ (B)
TOTAL.all 1.23% 517946.000 524294.000 - 0.17% -

Performance Improvements - bad Δ Previous Current σ Δ (B) σ (B)
gcc.bad -39.05% 402.000 245.000 - -0.81% -
TOTAL.bad -20.23% 766.000 611.000 - -7.98% -

Performance Improvements - fails Δ Previous Current σ Δ (B) σ (B)
TOTAL.fails -13.63% 609.000 526.000 - -8.84% -

Performance Improvements - good Δ Previous Current σ Δ (B) σ (B)
gcc.good 3.74% 170737.000 177123.000 - 0.21% -
TOTAL.good 1.26% 517180.000 523683.000 - 0.18% -

Added Tests - ERROR
g++.ERROR
gfortran.ERROR
libatomic.ERROR
libgomp.ERROR
libitm.ERROR
libstdc++.ERROR

Added Tests - FAIL
libatomic.FAIL
libitm.FAIL

Added Tests - KFAIL
TOTAL.KFAIL
g++.KFAIL
gcc.KFAIL
gfortran.KFAIL
libatomic.KFAIL
libgomp.KFAIL
libitm.KFAIL
libstdc++.KFAIL

Added Tests - OTHER
TOTAL.OTHER
g++.OTHER
gcc.OTHER
gfortran.OTHER
libatomic.OTHER
libgomp.OTHER
libitm.OTHER
libstdc++.OTHER

Added Tests - UNRESOLVED
libatomic.UNRESOLVED
libgomp.UNRESOLVED
libitm.UNRESOLVED
libstdc++.UNRESOLVED

Added Tests - UNTESTED
TOTAL.UNTESTED
g++.UNTESTED
gcc.UNTESTED
gfortran.UNTESTED
libatomic.UNTESTED
libgomp.UNTESTED
libitm.UNTESTED
libstdc++.UNTESTED

Added Tests - XFAIL
libatomic.XFAIL

Added Tests - XPASS
gcc.XPASS
gfortran.XPASS
libatomic.XPASS
libgomp.XPASS
libitm.XPASS
libstdc++.XPASS

Added Tests - bad
libatomic.bad
libitm.bad

Added Tests - flaky
TOTAL.flaky

Performance Regressions - FAIL Δ (B) Baseline Current σ (B) Δ σ
libgomp.FAIL 13.33% 15.000 17.000 - 13.33% -

Performance Regressions - bad Δ (B) Baseline Current σ (B) Δ σ
libgomp.bad 13.33% 15.000 17.000 - 13.33% -

Performance Improvements - FAIL Δ (B) Baseline Current σ (B) Δ σ
g++.FAIL -12.26% 212.000 186.000 - 0.00% -
TOTAL.FAIL -7.62% 341.000 315.000 - 0.64% -
gcc.FAIL -1.94% 103.000 101.000 - 0.00% -

Performance Improvements - UNRESOLVED Δ (B) Baseline Current σ (B) Δ σ
g++.UNRESOLVED -15.52% 174.000 147.000 - 0.00% -
TOTAL.UNRESOLVED -8.44% 320.000 293.000 - -22.07% -

Performance Improvements - bad Δ (B) Baseline Current σ (B) Δ σ
g++.bad -13.66% 388.000 335.000 - 0.00% -
TOTAL.bad -7.98% 664.000 611.000 - -20.23% -

Performance Improvements - fails Δ (B) Baseline Current σ (B) Δ σ
TOTAL.fails -8.84% 577.000 526.000 - -13.63% -

Added Tests - ERROR
g++.ERROR
gfortran.ERROR
libatomic.ERROR
libgomp.ERROR
libitm.ERROR
libstdc++.ERROR

Added Tests - FAIL
libatomic.FAIL
libitm.FAIL

Added Tests - KFAIL
TOTAL.KFAIL
g++.KFAIL
gcc.KFAIL
gfortran.KFAIL
libatomic.KFAIL
libgomp.KFAIL
libitm.KFAIL
libstdc++.KFAIL

Added Tests - OTHER
TOTAL.OTHER
g++.OTHER
gcc.OTHER
gfortran.OTHER
libatomic.OTHER
libgomp.OTHER
libitm.OTHER
libstdc++.OTHER

Added Tests - UNRESOLVED
libatomic.UNRESOLVED
libgomp.UNRESOLVED
libitm.UNRESOLVED
libstdc++.UNRESOLVED

Added Tests - UNTESTED
TOTAL.UNTESTED
g++.UNTESTED
gcc.UNTESTED
gfortran.UNTESTED
libatomic.UNTESTED
libgomp.UNTESTED
libitm.UNTESTED
libstdc++.UNTESTED

Added Tests - XFAIL
libatomic.XFAIL

Added Tests - XPASS
gcc.XPASS
gfortran.XPASS
libatomic.XPASS
libgomp.XPASS
libitm.XPASS
libstdc++.XPASS

Added Tests - bad
libatomic.bad
libitm.bad

Added Tests - flaky
TOTAL.flaky


Report Time: 0.34s
Name Current %
TOTAL.PASS 498850.000 1.30%
g++.PASS 234571.000 -
gcc.PASS 168104.000 3.90%
gfortran.PASS 66285.000 -
libatomic.PASS 44.000 -
libgomp.PASS 15074.000 -
libitm.PASS 44.000 -
libstdc++.PASS 14728.000 -
Geometric Mean 12404.083 -
Name Current %
TOTAL.FAIL 315.000 -
g++.FAIL 186.000 -
gcc.FAIL 101.000 -
gfortran.FAIL 6.000 -
libatomic.FAIL 0.000 -
libgomp.FAIL 17.000 13.33%
libitm.FAIL 0.000 -
libstdc++.FAIL 5.000 -
Geometric Mean 1.531 -95.88%
Name Current %
TOTAL.XFAIL 3901.000 -
g++.XFAIL 2070.000 -
gcc.XFAIL 1187.000 -
gfortran.XFAIL 251.000 -
libatomic.XFAIL 0.000 -
libgomp.XFAIL 284.000 -
libitm.XFAIL 3.000 -
libstdc++.XFAIL 106.000 -
Geometric Mean 46.465 -84.50%
Name Current %
TOTAL.ERROR 1.000 -98.67%
g++.ERROR 0.000 -
gcc.ERROR 1.000 -98.67%
gfortran.ERROR 0.000 -
libatomic.ERROR 0.000 -
libgomp.ERROR 0.000 -
libitm.ERROR 0.000 -
libstdc++.ERROR 0.000 -
Geometric Mean 0.001 -100.00%
Name Current %
TOTAL.good 523683.000 1.26%
g++.good 247780.000 -
gcc.good 177123.000 3.74%
gfortran.good 67062.000 -
libatomic.good 49.000 -
libgomp.good 16034.000 -
libitm.good 48.000 -
libstdc++.good 15587.000 -
Geometric Mean 13171.681 -
bad
Name Current %
TOTAL.bad 611.000 -20.23%
g++.bad 335.000 -
gcc.bad 245.000 -39.05%
gfortran.bad 9.000 -
libatomic.bad 0.000 -
libgomp.bad 17.000 13.33%
libitm.bad 0.000 -
libstdc++.bad 5.000 -
Geometric Mean 2.104 -96.72%
Name Current %
TOTAL.fails 526.000 -13.63%
Geometric Mean 526.000 -13.63%
Name Current %
TOTAL.flaky 0.000 -
Geometric Mean 0.000 -
all
Name Current %
TOTAL.all 524294.000 1.23%
Geometric Mean 524294.000 1.23%