Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=14f2724f80b156928b1a0b0f9733350558e35e63 (unchanged)
git_gcc https://github.com/gcc-mirror/gcc/commit/dabd94da0c78f4beb0c2c25f38ab6de2d8417497 (+ 1 commits)
git_gdb https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=14f2724f80b156928b1a0b0f9733350558e35e63 (unchanged)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=d0aefec49941cf6d97e2244d6aa20bafc26d5942 (unchanged)
git_linux https://git.linaro.org/kernel-org/linux.git/commit/?id=babe393974de0351c0e6cca50f5f84edaf8d7fa1 (unchanged)
regression https://linaro.atlassian.net/browse/GNU-1071
test_url https://ci.linaro.org/job/tcwg_gnu_native_check_gcc--master-aarch64-build/796/
Filter

master-aarch64 test results

Run Order Start Time Duration
Current 0796 (basepoints/gcc-14-06456-gdabd94da0c7) 2023-12-12T09:47:45 0:00:00
Previous 0795 (basepoints/gcc-14-06455-g99182ea09f1) 2023-12-12T07:27:55 0:00:00
Baseline 0071 (5-changed-components) 2023-04-21T20:39:10 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 4 6
Performance Improvements 3 25
Added Tests 62 67
Unchanged Tests 1596 1567
Total Tests 1665

Performance Regressions - FAIL Δ Previous Current σ Δ (B) σ (B)
gcc.FAIL 18.18% 22.000 26.000 - -96.66% -
TOTAL.FAIL 3.60% 111.000 115.000 - -88.61% -

Performance Regressions - PASS Δ Previous Current σ Δ (B) σ (B)
g++.PASS -1.48% 423444.000 417164.000 - 19.73% -

Performance Regressions - good Δ Previous Current σ Δ (B) σ (B)
g++.good -1.43% 438267.000 431987.000 - 19.18% -

Performance Improvements - ERROR Δ Previous Current σ Δ (B) σ (B)
TOTAL.ERROR -75.00% 8.000 2.000 - 0.00% -

Performance Improvements - bad Δ Previous Current σ Δ (B) σ (B)
gcc.bad -6.67% 30.000 28.000 - -96.41% -
TOTAL.bad -1.60% 125.000 123.000 - -88.14% -

Added Tests - ERROR
g++.ERROR
gcc.ERROR
gfortran.ERROR
libatomic.ERROR
libitm.ERROR
libstdc++.ERROR
objc.ERROR

Added Tests - FAIL
libatomic.FAIL
libgomp.FAIL
libitm.FAIL
libstdc++.FAIL
objc.FAIL

Added Tests - KFAIL
TOTAL.KFAIL
g++.KFAIL
gcc.KFAIL
gfortran.KFAIL
libatomic.KFAIL
libgomp.KFAIL
libitm.KFAIL
libstdc++.KFAIL
objc.KFAIL

Added Tests - OTHER
TOTAL.OTHER
g++.OTHER
gcc.OTHER
gfortran.OTHER
libatomic.OTHER
libgomp.OTHER
libitm.OTHER
libstdc++.OTHER
objc.OTHER

Added Tests - UNRESOLVED
TOTAL.UNRESOLVED
g++.UNRESOLVED
gcc.UNRESOLVED
gfortran.UNRESOLVED
libatomic.UNRESOLVED
libgomp.UNRESOLVED
libitm.UNRESOLVED
libstdc++.UNRESOLVED
objc.UNRESOLVED

Added Tests - UNSUPPORTED
libatomic.UNSUPPORTED

Added Tests - UNTESTED
TOTAL.UNTESTED
g++.UNTESTED
gcc.UNTESTED
gfortran.UNTESTED
libatomic.UNTESTED
libgomp.UNTESTED
libitm.UNTESTED
libstdc++.UNTESTED
objc.UNTESTED

Added Tests - XFAIL
libatomic.XFAIL
objc.XFAIL

Added Tests - XPASS
gfortran.XPASS
libatomic.XPASS
libgomp.XPASS
libitm.XPASS
libstdc++.XPASS
objc.XPASS

Added Tests - bad
libatomic.bad
libitm.bad
libstdc++.bad
objc.bad

Added Tests - flaky
TOTAL.flaky

Performance Regressions - UNSUPPORTED Δ (B) Baseline Current σ (B) Δ σ
gcc.UNSUPPORTED 29.38% 3193.000 4131.000 - 0.00% -
TOTAL.UNSUPPORTED 12.19% 15696.000 17610.000 - 0.00% -
g++.UNSUPPORTED 8.63% 10960.000 11906.000 - 0.00% -
libstdc++.UNSUPPORTED 2.79% 717.000 737.000 - 0.00% -

Performance Regressions - XFAIL Δ (B) Baseline Current σ (B) Δ σ
libstdc++.XFAIL 18.87% 106.000 126.000 - 0.00% -
gfortran.XFAIL 5.62% 249.000 263.000 - 0.00% -

Performance Improvements - FAIL Δ (B) Baseline Current σ (B) Δ σ
gcc.FAIL -96.66% 779.000 26.000 - 18.18% -
TOTAL.FAIL -88.61% 1010.000 115.000 - 3.60% -
g++.FAIL -62.61% 222.000 83.000 - 0.00% -
gfortran.FAIL -25.00% 8.000 6.000 - 0.00% -

Performance Improvements - PASS Δ (B) Baseline Current σ (B) Δ σ
g++.PASS 19.73% 348427.000 417164.000 - -1.48% -
gcc.PASS 18.23% 283600.000 335294.000 - 0.00% -
TOTAL.PASS 17.49% 730092.000 857808.000 - -0.73% -
libstdc++.PASS 14.75% 15878.000 18220.000 - 0.00% -
libgomp.PASS 6.12% 15040.000 15961.000 - 0.00% -
gfortran.PASS 1.75% 67049.000 68225.000 - 0.00% -

Performance Improvements - UNSUPPORTED Δ (B) Baseline Current σ (B) Δ σ
libgomp.UNSUPPORTED -8.44% 675.000 618.000 - 0.00% -
gfortran.UNSUPPORTED -2.00% 150.000 147.000 - 0.00% -

Performance Improvements - XFAIL Δ (B) Baseline Current σ (B) Δ σ
gcc.XFAIL -29.62% 2505.000 1763.000 - 0.00% -
TOTAL.XFAIL -14.14% 6238.000 5356.000 - 0.00% -
g++.XFAIL -5.63% 3091.000 2917.000 - 0.00% -

Performance Improvements - bad Δ (B) Baseline Current σ (B) Δ σ
gcc.bad -96.41% 779.000 28.000 - -6.67% -
TOTAL.bad -88.14% 1037.000 123.000 - -1.60% -
g++.bad -65.06% 249.000 87.000 - 0.00% -
gfortran.bad -25.00% 8.000 6.000 - 0.00% -

Performance Improvements - good Δ (B) Baseline Current σ (B) Δ σ
g++.good 19.18% 362478.000 431987.000 - -1.43% -
gcc.good 17.94% 289298.000 341188.000 - 0.00% -
TOTAL.good 17.12% 752026.000 880774.000 - -0.71% -
libstdc++.good 14.26% 16701.000 19083.000 - 0.00% -
libgomp.good 5.40% 15999.000 16863.000 - 0.00% -
gfortran.good 1.76% 67448.000 68635.000 - 0.00% -

Added Tests - ERROR
g++.ERROR
gcc.ERROR
gfortran.ERROR
libatomic.ERROR
libitm.ERROR
libstdc++.ERROR
objc.ERROR

Added Tests - FAIL
libatomic.FAIL
libgomp.FAIL
libitm.FAIL
libstdc++.FAIL
objc.FAIL

Added Tests - KFAIL
TOTAL.KFAIL
g++.KFAIL
gcc.KFAIL
gfortran.KFAIL
libatomic.KFAIL
libgomp.KFAIL
libitm.KFAIL
libstdc++.KFAIL
objc.KFAIL

Added Tests - OTHER
TOTAL.OTHER
g++.OTHER
gcc.OTHER
gfortran.OTHER
libatomic.OTHER
libgomp.OTHER
libitm.OTHER
libstdc++.OTHER
objc.OTHER

Added Tests - PASS
objc.PASS

Added Tests - UNRESOLVED
TOTAL.UNRESOLVED
g++.UNRESOLVED
gcc.UNRESOLVED
gfortran.UNRESOLVED
libatomic.UNRESOLVED
libgomp.UNRESOLVED
libitm.UNRESOLVED
libstdc++.UNRESOLVED
objc.UNRESOLVED

Added Tests - UNSUPPORTED
libatomic.UNSUPPORTED
objc.UNSUPPORTED

Added Tests - UNTESTED
TOTAL.UNTESTED
g++.UNTESTED
gcc.UNTESTED
gfortran.UNTESTED
libatomic.UNTESTED
libgomp.UNTESTED
libitm.UNTESTED
libstdc++.UNTESTED
objc.UNTESTED

Added Tests - XFAIL
libatomic.XFAIL
objc.XFAIL

Added Tests - XPASS
gfortran.XPASS
libatomic.XPASS
libgomp.XPASS
libitm.XPASS
libstdc++.XPASS
objc.XPASS

Added Tests - all
TOTAL.all

Added Tests - bad
libatomic.bad
libitm.bad
libstdc++.bad
objc.bad

Added Tests - fails
TOTAL.fails

Added Tests - flaky
TOTAL.flaky

Added Tests - good
objc.good


Report Time: 0.37s
Name Current %
TOTAL.PASS 857808.000 -
g++.PASS 417164.000 -1.48%
gcc.PASS 335294.000 -
gfortran.PASS 68225.000 -
libatomic.PASS 54.000 -
libgomp.PASS 15961.000 -
libitm.PASS 44.000 -
libstdc++.PASS 18220.000 -
objc.PASS 2846.000 -
Geometric Mean 13617.087 -
Name Current %
TOTAL.FAIL 115.000 3.60%
g++.FAIL 83.000 -
gcc.FAIL 26.000 18.18%
gfortran.FAIL 6.000 -
libatomic.FAIL 0.000 -
libgomp.FAIL 0.000 -
libitm.FAIL 0.000 -
libstdc++.FAIL 0.000 -
objc.FAIL 0.000 -
Geometric Mean 0.029 -99.91%
Name Current %
TOTAL.XFAIL 5356.000 -
g++.XFAIL 2917.000 -
gcc.XFAIL 1763.000 -
gfortran.XFAIL 263.000 -
libatomic.XFAIL 0.000 -
libgomp.XFAIL 284.000 -
libitm.XFAIL 3.000 -
libstdc++.XFAIL 126.000 -
objc.XFAIL 0.000 -
Geometric Mean 12.560 -96.51%
Name Current %
TOTAL.ERROR 2.000 -75.00%
g++.ERROR 0.000 -
gcc.ERROR 0.000 -
gfortran.ERROR 0.000 -
libatomic.ERROR 0.000 -
libgomp.ERROR 2.000 -
libitm.ERROR 0.000 -
libstdc++.ERROR 0.000 -
objc.ERROR 0.000 -
Geometric Mean 0.001 -99.98%
Name Current %
TOTAL.good 880774.000 -
g++.good 431987.000 -1.43%
gcc.good 341188.000 -
gfortran.good 68635.000 -
libatomic.good 54.000 -
libgomp.good 16863.000 -
libitm.good 48.000 -
libstdc++.good 19083.000 -
objc.good 2916.000 -
Geometric Mean 14074.441 -
bad
Name Current %
TOTAL.bad 123.000 -1.60%
g++.bad 87.000 -
gcc.bad 28.000 -6.67%
gfortran.bad 6.000 -
libatomic.bad 0.000 -
libgomp.bad 2.000 -
libitm.bad 0.000 -
libstdc++.bad 0.000 -
objc.bad 0.000 -
Geometric Mean 0.089 -99.57%
Name Current %
TOTAL.fails 112.000 -
Geometric Mean 112.000 -
Name Current %
TOTAL.flaky 0.000 -
Geometric Mean 0.000 -
all
Name Current %
TOTAL.all 880897.000 -
Geometric Mean 880897.000 -