Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=6a667807390b7091b5ec088d979c779f65d3dfa5 (+ 12 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/c787f593e62869ae0b230949b4791f4f3a26e50e (unchanged)
git_gdb https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=6a667807390b7091b5ec088d979c779f65d3dfa5 (+ 12 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=d6c72f976c61d3c1465699f2bcad77e62bafe61d (unchanged)
git_linux https://git.linaro.org/kernel-org/linux.git/commit/?id=47a2ee5d4a0bda05decdda7be0a77e792cdb09a3 (+ 2 commits)
git_qemu https://gitlab.com/qemu-project/qemu/commit/278238505d28d292927bff7683f39fb4fbca7fd1 (unchanged)
test_url https://ci.linaro.org/job/tcwg_gnu_cross_check_gcc--master-arm-build/285/
Filter

master-arm test results

Run Order Start Time Duration
Current 0285 (3-changed-components) 2023-05-11T12:05:25 0:00:00
Previous 0337 (basepoints/gcc-14-00961-gf2dd012ae6cd) 2023-05-18T01:03:45 0:00:00
Baseline 0067 (6-changed-components) 2023-04-19T10:48:24 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 3 0
Performance Improvements 9 8
Added Tests 46 46
Unchanged Tests 1427 1431
Total Tests 1485

Performance Regressions - FAIL Δ Previous Current σ Δ (B) σ (B)
libgomp.FAIL 7.14% 14.000 15.000 - 0.00% -

Performance Regressions - UNRESOLVED Δ Previous Current σ Δ (B) σ (B)
gcc.UNRESOLVED 1.42% 141.000 143.000 - 0.00% -

Performance Regressions - bad Δ Previous Current σ Δ (B) σ (B)
libgomp.bad 7.14% 14.000 15.000 - 0.00% -

Performance Improvements - FAIL Δ Previous Current σ Δ (B) σ (B)
gcc.FAIL -32.67% 150.000 101.000 - -1.94% -
TOTAL.FAIL -22.52% 404.000 313.000 - -8.21% -
g++.FAIL -18.42% 228.000 186.000 - -12.26% -
libstdc++.FAIL -16.67% 6.000 5.000 - 0.00% -

Performance Improvements - bad Δ Previous Current σ Δ (B) σ (B)
libstdc++.bad -16.67% 6.000 5.000 - 0.00% -
gcc.bad -16.38% 293.000 245.000 - -0.81% -
TOTAL.bad -12.88% 699.000 609.000 - -8.28% -
g++.bad -11.14% 377.000 335.000 - -13.66% -

Performance Improvements - fails Δ Previous Current σ Δ (B) σ (B)
TOTAL.fails -14.52% 613.000 524.000 - -9.19% -

Added Tests - ERROR
g++.ERROR
gfortran.ERROR
libatomic.ERROR
libgomp.ERROR
libitm.ERROR
libstdc++.ERROR

Added Tests - FAIL
libatomic.FAIL
libitm.FAIL

Added Tests - KFAIL
TOTAL.KFAIL
g++.KFAIL
gcc.KFAIL
gfortran.KFAIL
libatomic.KFAIL
libgomp.KFAIL
libitm.KFAIL
libstdc++.KFAIL

Added Tests - OTHER
TOTAL.OTHER
g++.OTHER
gcc.OTHER
gfortran.OTHER
libatomic.OTHER
libgomp.OTHER
libitm.OTHER
libstdc++.OTHER

Added Tests - UNRESOLVED
libatomic.UNRESOLVED
libgomp.UNRESOLVED
libitm.UNRESOLVED
libstdc++.UNRESOLVED

Added Tests - UNTESTED
TOTAL.UNTESTED
g++.UNTESTED
gcc.UNTESTED
gfortran.UNTESTED
libatomic.UNTESTED
libgomp.UNTESTED
libitm.UNTESTED
libstdc++.UNTESTED

Added Tests - XFAIL
libatomic.XFAIL

Added Tests - XPASS
gcc.XPASS
gfortran.XPASS
libatomic.XPASS
libgomp.XPASS
libitm.XPASS
libstdc++.XPASS

Added Tests - bad
libatomic.bad
libitm.bad

Added Tests - flaky
TOTAL.flaky

Performance Improvements - FAIL Δ (B) Baseline Current σ (B) Δ σ
g++.FAIL -12.26% 212.000 186.000 - -18.42% -
TOTAL.FAIL -8.21% 341.000 313.000 - -22.52% -
gcc.FAIL -1.94% 103.000 101.000 - -32.67% -

Performance Improvements - UNRESOLVED Δ (B) Baseline Current σ (B) Δ σ
g++.UNRESOLVED -15.52% 174.000 147.000 - 0.00% -
TOTAL.UNRESOLVED -8.44% 320.000 293.000 - 0.69% -

Performance Improvements - bad Δ (B) Baseline Current σ (B) Δ σ
g++.bad -13.66% 388.000 335.000 - -11.14% -
TOTAL.bad -8.28% 664.000 609.000 - -12.88% -

Performance Improvements - fails Δ (B) Baseline Current σ (B) Δ σ
TOTAL.fails -9.19% 577.000 524.000 - -14.52% -

Added Tests - ERROR
g++.ERROR
gfortran.ERROR
libatomic.ERROR
libgomp.ERROR
libitm.ERROR
libstdc++.ERROR

Added Tests - FAIL
libatomic.FAIL
libitm.FAIL

Added Tests - KFAIL
TOTAL.KFAIL
g++.KFAIL
gcc.KFAIL
gfortran.KFAIL
libatomic.KFAIL
libgomp.KFAIL
libitm.KFAIL
libstdc++.KFAIL

Added Tests - OTHER
TOTAL.OTHER
g++.OTHER
gcc.OTHER
gfortran.OTHER
libatomic.OTHER
libgomp.OTHER
libitm.OTHER
libstdc++.OTHER

Added Tests - UNRESOLVED
libatomic.UNRESOLVED
libgomp.UNRESOLVED
libitm.UNRESOLVED
libstdc++.UNRESOLVED

Added Tests - UNTESTED
TOTAL.UNTESTED
g++.UNTESTED
gcc.UNTESTED
gfortran.UNTESTED
libatomic.UNTESTED
libgomp.UNTESTED
libitm.UNTESTED
libstdc++.UNTESTED

Added Tests - XFAIL
libatomic.XFAIL

Added Tests - XPASS
gcc.XPASS
gfortran.XPASS
libatomic.XPASS
libgomp.XPASS
libitm.XPASS
libstdc++.XPASS

Added Tests - bad
libatomic.bad
libitm.bad

Added Tests - flaky
TOTAL.flaky


Report Time: 0.33s
Name Current %
TOTAL.PASS 498837.000 -
g++.PASS 234577.000 -
gcc.PASS 168087.000 -
gfortran.PASS 66285.000 -
libatomic.PASS 44.000 -
libgomp.PASS 15072.000 -
libitm.PASS 44.000 -
libstdc++.PASS 14728.000 -
Geometric Mean 12403.719 -
Name Current %
TOTAL.FAIL 313.000 -22.52%
g++.FAIL 186.000 -18.42%
gcc.FAIL 101.000 -32.67%
gfortran.FAIL 6.000 -
libatomic.FAIL 0.000 -
libgomp.FAIL 15.000 7.14%
libitm.FAIL 0.000 -
libstdc++.FAIL 5.000 -16.67%
Geometric Mean 1.506 -96.55%
Name Current %
TOTAL.XFAIL 3901.000 -
g++.XFAIL 2070.000 -
gcc.XFAIL 1187.000 -
gfortran.XFAIL 251.000 -
libatomic.XFAIL 0.000 -
libgomp.XFAIL 284.000 -
libitm.XFAIL 3.000 -
libstdc++.XFAIL 106.000 -
Geometric Mean 46.465 -84.50%
Name Current %
TOTAL.good 523670.000 -
g++.good 247786.000 -
gcc.good 177106.000 -
gfortran.good 67062.000 -
libatomic.good 49.000 -
libgomp.good 16032.000 -
libitm.good 48.000 -
libstdc++.good 15587.000 -
Geometric Mean 13171.317 -
bad
Name Current %
TOTAL.bad 609.000 -12.88%
g++.bad 335.000 -11.14%
gcc.bad 245.000 -16.38%
gfortran.bad 9.000 -
libatomic.bad 0.000 -
libgomp.bad 15.000 7.14%
libitm.bad 0.000 -
libstdc++.bad 5.000 -16.67%
Geometric Mean 2.070 -96.68%
Name Current %
TOTAL.fails 524.000 -14.52%
Geometric Mean 524.000 -14.52%
Name Current %
TOTAL.flaky 0.000 -
Geometric Mean 0.000 -
all
Name Current %
TOTAL.all 524279.000 -
Geometric Mean 524279.000 -