Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=c9cfe943aaa4973d5d1e8c49e4fb6853532b3017 (unchanged)
git_gcc https://github.com/gcc-mirror/gcc/commit/63a598deb0c9fcb8704af6ef90f0b905942b0276 (+ 1 commits)
git_gdb https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=c9cfe943aaa4973d5d1e8c49e4fb6853532b3017 (unchanged)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=cc84cd389c7329ceb38228f931044e8c84ca7245 (unchanged)
git_linux https://gitlab.com/Linaro/lkft/mirrors/torvalds/linux-mainline/commit/11a299a7933e03c83818b431e6a1c53ad387423d (unchanged)
git_qemu https://gitlab.com/qemu-project/qemu/commit/a5dd9ee060b0ad65239889a62e93a33276055981 (unchanged)
regression https://linaro.atlassian.net/browse/GNU-1352
test_url https://ci.linaro.org/job/tcwg_gnu_cross_check_gcc--master-aarch64-build/1707/
Filter

master-aarch64 test results

Run Order Start Time Duration
Current 1707 (basepoints/gcc-15-03859-g63a598deb0c) 2024-09-25T19:52:23 0:00:00
Previous 1706 (basepoints/gcc-15-03858-g2407dbe1d88) 2024-09-25T15:44:33 0:00:00
Baseline 1240 (6-changed-components) 2024-01-29T01:01:12 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 3 13
Performance Improvements 0 20
Added Tests 61 64
Unchanged Tests 1601 1568
Total Tests 1665

Performance Regressions - FAIL Δ Previous Current σ Δ (B) σ (B)
TOTAL.FAIL 2.59% 116.000 119.000 - -9.85% -

Performance Regressions - bad Δ Previous Current σ Δ (B) σ (B)
TOTAL.bad 2.50% 120.000 123.000 - -13.38% -

Performance Regressions - fails Δ Previous Current σ Δ (B) σ (B)
TOTAL.fails 2.52% 119.000 122.000 - 0.00% -

Added Tests - ERROR
TOTAL.ERROR
g++.ERROR
gcc.ERROR
gfortran.ERROR
libatomic.ERROR
libgomp.ERROR
libitm.ERROR
libstdc++.ERROR
objc.ERROR

Added Tests - FAIL
libatomic.FAIL
libitm.FAIL
objc.FAIL

Added Tests - KFAIL
TOTAL.KFAIL
g++.KFAIL
gcc.KFAIL
gfortran.KFAIL
libatomic.KFAIL
libgomp.KFAIL
libitm.KFAIL
libstdc++.KFAIL
objc.KFAIL

Added Tests - OTHER
TOTAL.OTHER
g++.OTHER
gcc.OTHER
gfortran.OTHER
libatomic.OTHER
libgomp.OTHER
libitm.OTHER
libstdc++.OTHER
objc.OTHER

Added Tests - UNRESOLVED
TOTAL.UNRESOLVED
g++.UNRESOLVED
gcc.UNRESOLVED
gfortran.UNRESOLVED
libatomic.UNRESOLVED
libgomp.UNRESOLVED
libitm.UNRESOLVED
libstdc++.UNRESOLVED
objc.UNRESOLVED

Added Tests - UNSUPPORTED
libatomic.UNSUPPORTED

Added Tests - UNTESTED
TOTAL.UNTESTED
g++.UNTESTED
gcc.UNTESTED
gfortran.UNTESTED
libatomic.UNTESTED
libgomp.UNTESTED
libitm.UNTESTED
libstdc++.UNTESTED
objc.UNTESTED

Added Tests - XFAIL
libatomic.XFAIL
objc.XFAIL

Added Tests - XPASS
g++.XPASS
gfortran.XPASS
libatomic.XPASS
libgomp.XPASS
libitm.XPASS
libstdc++.XPASS
objc.XPASS

Added Tests - bad
libatomic.bad
libitm.bad
objc.bad

Performance Regressions - FAIL Δ (B) Baseline Current σ (B) Δ σ
gcc.FAIL 128.12% 32.000 73.000 - 0.00% -
libstdc++.FAIL 50.00% 2.000 3.000 - 0.00% -

Performance Regressions - PASS Δ (B) Baseline Current σ (B) Δ σ
g++.PASS -6.04% 408827.000 384122.000 - 0.00% -
TOTAL.PASS -1.62% 848244.000 834495.000 - -0.00% -

Performance Regressions - UNSUPPORTED Δ (B) Baseline Current σ (B) Δ σ
gfortran.UNSUPPORTED 10.14% 148.000 163.000 - 0.00% -
gcc.UNSUPPORTED 5.97% 4022.000 4262.000 - 0.00% -
libgomp.UNSUPPORTED 5.89% 628.000 665.000 - 0.00% -
libstdc++.UNSUPPORTED 1.33% 751.000 761.000 - 0.00% -

Performance Regressions - XPASS Δ (B) Baseline Current σ (B) Δ σ
gcc.XPASS 100.00% 2.000 4.000 - 0.00% -

Performance Regressions - bad Δ (B) Baseline Current σ (B) Δ σ
gcc.bad 102.63% 38.000 77.000 - 0.00% -
libstdc++.bad 50.00% 2.000 3.000 - 0.00% -

Performance Regressions - good Δ (B) Baseline Current σ (B) Δ σ
g++.good -8.09% 423949.000 389631.000 - 0.00% -
TOTAL.good -2.65% 871421.000 848329.000 - -0.00% -

Performance Improvements - FAIL Δ (B) Baseline Current σ (B) Δ σ
gfortran.FAIL -66.67% 6.000 2.000 - 0.00% -
g++.FAIL -65.22% 92.000 32.000 - 0.00% -
TOTAL.FAIL -9.85% 132.000 119.000 - 2.59% -

Performance Improvements - PASS Δ (B) Baseline Current σ (B) Δ σ
gfortran.PASS 2.93% 68343.000 70344.000 - 0.00% -
libgomp.PASS 2.86% 16147.000 16609.000 - 0.00% -
gcc.PASS 2.43% 334612.000 342741.000 - 0.00% -
libstdc++.PASS 2.10% 17371.000 17735.000 - -0.01% -

Performance Improvements - UNSUPPORTED Δ (B) Baseline Current σ (B) Δ σ
g++.UNSUPPORTED -74.93% 12119.000 3038.000 - 0.00% -
TOTAL.UNSUPPORTED -49.49% 17739.000 8960.000 - 0.00% -

Performance Improvements - XFAIL Δ (B) Baseline Current σ (B) Δ σ
g++.XFAIL -17.72% 3003.000 2471.000 - 0.00% -
TOTAL.XFAIL -10.37% 5438.000 4874.000 - 0.00% -
libgomp.XFAIL -7.04% 284.000 264.000 - 0.00% -

Performance Improvements - XPASS Δ (B) Baseline Current σ (B) Δ σ
TOTAL.XPASS -33.33% 6.000 4.000 - 0.00% -

Performance Improvements - bad Δ (B) Baseline Current σ (B) Δ σ
g++.bad -66.67% 96.000 32.000 - 0.00% -
gfortran.bad -66.67% 6.000 2.000 - 0.00% -
TOTAL.bad -13.38% 142.000 123.000 - 2.50% -

Performance Improvements - good Δ (B) Baseline Current σ (B) Δ σ
gfortran.good 2.93% 68754.000 70770.000 - 0.00% -
libgomp.good 2.81% 17059.000 17538.000 - 0.00% -
gcc.good 2.45% 340393.000 348749.000 - 0.00% -
libstdc++.good 2.06% 18248.000 18623.000 - -0.01% -

Added Tests - ERROR
TOTAL.ERROR
g++.ERROR
gcc.ERROR
gfortran.ERROR
libatomic.ERROR
libgomp.ERROR
libitm.ERROR
libstdc++.ERROR
objc.ERROR

Added Tests - FAIL
libatomic.FAIL
libitm.FAIL
objc.FAIL

Added Tests - KFAIL
TOTAL.KFAIL
g++.KFAIL
gcc.KFAIL
gfortran.KFAIL
libatomic.KFAIL
libgomp.KFAIL
libitm.KFAIL
libstdc++.KFAIL
objc.KFAIL

Added Tests - OTHER
TOTAL.OTHER
g++.OTHER
gcc.OTHER
gfortran.OTHER
libatomic.OTHER
libgomp.OTHER
libitm.OTHER
libstdc++.OTHER
objc.OTHER

Added Tests - UNRESOLVED
TOTAL.UNRESOLVED
g++.UNRESOLVED
gcc.UNRESOLVED
gfortran.UNRESOLVED
libatomic.UNRESOLVED
libgomp.UNRESOLVED
libitm.UNRESOLVED
libstdc++.UNRESOLVED
objc.UNRESOLVED

Added Tests - UNSUPPORTED
libatomic.UNSUPPORTED

Added Tests - UNTESTED
TOTAL.UNTESTED
g++.UNTESTED
gcc.UNTESTED
gfortran.UNTESTED
libatomic.UNTESTED
libgomp.UNTESTED
libitm.UNTESTED
libstdc++.UNTESTED
objc.UNTESTED

Added Tests - XFAIL
libatomic.XFAIL
objc.XFAIL

Added Tests - XPASS
g++.XPASS
gfortran.XPASS
libatomic.XPASS
libgomp.XPASS
libitm.XPASS
libstdc++.XPASS
objc.XPASS

Added Tests - all
TOTAL.all

Added Tests - bad
libatomic.bad
libitm.bad
objc.bad

Added Tests - fails
TOTAL.fails

Added Tests - flaky
TOTAL.flaky


Report Time: 0.39s
Name Current %
TOTAL.PASS 834495.000 -
g++.PASS 384122.000 -
gcc.PASS 342741.000 -
gfortran.PASS 70344.000 -
libatomic.PASS 54.000 -
libgomp.PASS 16609.000 -
libitm.PASS 44.000 -
libstdc++.PASS 17735.000 -
objc.PASS 2846.000 -
Geometric Mean 13549.619 -
Name Current %
TOTAL.FAIL 119.000 2.59%
g++.FAIL 32.000 -
gcc.FAIL 73.000 -
gfortran.FAIL 2.000 -
libatomic.FAIL 0.000 -
libgomp.FAIL 9.000 -
libitm.FAIL 0.000 -
libstdc++.FAIL 3.000 -
objc.FAIL 0.000 -
Geometric Mean 0.291 -89.63%
Name Current %
TOTAL.XFAIL 4874.000 -
g++.XFAIL 2471.000 -
gcc.XFAIL 1746.000 -
gfortran.XFAIL 263.000 -
libatomic.XFAIL 0.000 -
libgomp.XFAIL 264.000 -
libitm.XFAIL 3.000 -
libstdc++.XFAIL 127.000 -
objc.XFAIL 0.000 -
Geometric Mean 12.101 -96.47%
Name Current %
TOTAL.good 848329.000 -
g++.good 389631.000 -
gcc.good 348749.000 -
gfortran.good 70770.000 -
libatomic.good 54.000 -
libgomp.good 17538.000 -
libitm.good 48.000 -
libstdc++.good 18623.000 -
objc.good 2916.000 -
Geometric Mean 13960.233 -
bad
Name Current %
TOTAL.bad 123.000 2.50%
g++.bad 32.000 -
gcc.bad 77.000 -
gfortran.bad 2.000 -
libatomic.bad 0.000 -
libgomp.bad 9.000 -
libitm.bad 0.000 -
libstdc++.bad 3.000 -
objc.bad 0.000 -
Geometric Mean 0.294 -89.68%
Name Current %
TOTAL.fails 122.000 2.52%
Geometric Mean 122.000 2.52%
Name Current %
TOTAL.flaky 52.000 -
Geometric Mean 52.000 -
all
Name Current %
TOTAL.all 848452.000 -
Geometric Mean 848452.000 -