Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=ad909bee05b9b47cf9db50d0263df97342136754 (unchanged)
git_gcc https://gcc.gnu.org/git/gcc.git (9263523b7e522e5b8c9ac70df5efc73632c19380) (+ 70 commits)
git_gdb https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=ad909bee05b9b47cf9db50d0263df97342136754 (unchanged)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=7fe1fde499507126f7de10ebf12fecaf77ae6602 (unchanged)
git_linux https://gitlab.com/Linaro/lkft/mirrors/torvalds/linux-mainline/commit/e42b1a9a2557aa94fee47f078633677198386a52 (unchanged)
git_qemu https://gitlab.com/qemu-project/qemu/commit/fdf250e5a37830615e324017cb3a503e84b3712c (unchanged)
test_url https://ci.linaro.org/job/tcwg_gnu_cross_check_gcc--master-aarch64-build/1764/
Filter

master-aarch64 test results

Run Order Start Time Duration
Current 1764 (basepoints/gcc-15-04538-g9263523b7e5) 2024-10-26T10:13:40 0:00:00
Previous 1789 (6-changed-components) 2024-11-07T05:28:18 0:00:00
Baseline 1240 (6-changed-components) 2024-01-29T01:01:12 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 14 13
Performance Improvements 10 20
Added Tests 65 65
Unchanged Tests 1576 1567
Total Tests 1665

Performance Regressions - FAIL Δ Previous Current σ Δ (B) σ (B)
gcc.FAIL 26.15% 65.000 82.000 - 156.25% -
TOTAL.FAIL 12.62% 103.000 116.000 - -12.12% -

Performance Regressions - PASS Δ Previous Current σ Δ (B) σ (B)
g++.PASS -5.80% 410165.000 386384.000 - -5.49% -
gcc.PASS -5.77% 366502.000 345357.000 - 3.21% -
TOTAL.PASS -5.10% 884704.000 839561.000 - -1.02% -

Performance Regressions - XPASS Δ Previous Current σ Δ (B) σ (B)
TOTAL.XPASS 133.33% 3.000 7.000 - 16.67% -
gcc.XPASS 133.33% 3.000 7.000 - 250.00% -

Performance Regressions - all Δ Previous Current σ Δ (B) σ (B)
TOTAL.all -5.18% 900165.000 853555.000 - -2.07% -

Performance Regressions - bad Δ Previous Current σ Δ (B) σ (B)
gcc.bad 30.88% 68.000 89.000 - 134.21% -
TOTAL.bad 16.04% 106.000 123.000 - -13.38% -

Performance Regressions - fails Δ Previous Current σ Δ (B) σ (B)
TOTAL.fails 17.31% 104.000 122.000 - -7.58% -

Performance Regressions - good Δ Previous Current σ Δ (B) σ (B)
g++.good -5.89% 416426.000 391902.000 - -7.56% -
gcc.good -5.86% 373270.000 351391.000 - 3.23% -
TOTAL.good -5.18% 900059.000 853432.000 - -2.06% -

Performance Improvements - FAIL Δ Previous Current σ Δ (B) σ (B)
g++.FAIL -8.57% 35.000 32.000 - -65.22% -

Performance Improvements - UNSUPPORTED Δ Previous Current σ Δ (B) σ (B)
g++.UNSUPPORTED -18.60% 3732.000 3038.000 - -74.93% -
gcc.UNSUPPORTED -14.17% 4977.000 4272.000 - 6.22% -
TOTAL.UNSUPPORTED -13.52% 10373.000 8971.000 - -49.43% -
gfortran.UNSUPPORTED -1.81% 166.000 163.000 - 10.14% -

Performance Improvements - XFAIL Δ Previous Current σ Δ (B) σ (B)
libstdc++.XFAIL -3.05% 131.000 127.000 - 0.79% -
g++.XFAIL -1.94% 2529.000 2480.000 - -17.42% -
TOTAL.XFAIL -1.65% 4982.000 4900.000 - -9.89% -
gcc.XFAIL -1.62% 1791.000 1762.000 - 0.17% -

Performance Improvements - bad Δ Previous Current σ Δ (B) σ (B)
g++.bad -8.57% 35.000 32.000 - -66.67% -

Added Tests - ERROR
TOTAL.ERROR
g++.ERROR
gcc.ERROR
gfortran.ERROR
libatomic.ERROR
libgomp.ERROR
libitm.ERROR
libstdc++.ERROR
objc.ERROR

Added Tests - FAIL
libatomic.FAIL
libgomp.FAIL
libitm.FAIL
libstdc++.FAIL
objc.FAIL

Added Tests - KFAIL
TOTAL.KFAIL
g++.KFAIL
gcc.KFAIL
gfortran.KFAIL
libatomic.KFAIL
libgomp.KFAIL
libitm.KFAIL
libstdc++.KFAIL
objc.KFAIL

Added Tests - OTHER
TOTAL.OTHER
g++.OTHER
gcc.OTHER
gfortran.OTHER
libatomic.OTHER
libgomp.OTHER
libitm.OTHER
libstdc++.OTHER
objc.OTHER

Added Tests - UNRESOLVED
TOTAL.UNRESOLVED
g++.UNRESOLVED
gcc.UNRESOLVED
gfortran.UNRESOLVED
libatomic.UNRESOLVED
libgomp.UNRESOLVED
libitm.UNRESOLVED
libstdc++.UNRESOLVED
objc.UNRESOLVED

Added Tests - UNSUPPORTED
libatomic.UNSUPPORTED

Added Tests - UNTESTED
TOTAL.UNTESTED
g++.UNTESTED
gcc.UNTESTED
gfortran.UNTESTED
libatomic.UNTESTED
libgomp.UNTESTED
libitm.UNTESTED
libstdc++.UNTESTED
objc.UNTESTED

Added Tests - XFAIL
libatomic.XFAIL
objc.XFAIL

Added Tests - XPASS
g++.XPASS
gfortran.XPASS
libatomic.XPASS
libgomp.XPASS
libitm.XPASS
libstdc++.XPASS
objc.XPASS

Added Tests - bad
libatomic.bad
libgomp.bad
libitm.bad
libstdc++.bad
objc.bad

Performance Regressions - FAIL Δ (B) Baseline Current σ (B) Δ σ
gcc.FAIL 156.25% 32.000 82.000 - 26.15% -

Performance Regressions - PASS Δ (B) Baseline Current σ (B) Δ σ
g++.PASS -5.49% 408827.000 386384.000 - -5.80% -
TOTAL.PASS -1.02% 848244.000 839561.000 - -5.10% -

Performance Regressions - UNSUPPORTED Δ (B) Baseline Current σ (B) Δ σ
gfortran.UNSUPPORTED 10.14% 148.000 163.000 - -1.81% -
gcc.UNSUPPORTED 6.22% 4022.000 4272.000 - -14.17% -
libgomp.UNSUPPORTED 5.89% 628.000 665.000 - 0.00% -
libstdc++.UNSUPPORTED 1.46% 751.000 762.000 - 0.00% -

Performance Regressions - XPASS Δ (B) Baseline Current σ (B) Δ σ
gcc.XPASS 250.00% 2.000 7.000 - 133.33% -
TOTAL.XPASS 16.67% 6.000 7.000 - 133.33% -

Performance Regressions - all Δ (B) Baseline Current σ (B) Δ σ
TOTAL.all -2.07% 871563.000 853555.000 - -5.18% -

Performance Regressions - bad Δ (B) Baseline Current σ (B) Δ σ
gcc.bad 134.21% 38.000 89.000 - 30.88% -

Performance Regressions - good Δ (B) Baseline Current σ (B) Δ σ
g++.good -7.56% 423949.000 391902.000 - -5.89% -
TOTAL.good -2.06% 871421.000 853432.000 - -5.18% -

Performance Improvements - FAIL Δ (B) Baseline Current σ (B) Δ σ
gfortran.FAIL -66.67% 6.000 2.000 - 0.00% -
g++.FAIL -65.22% 92.000 32.000 - -8.57% -
TOTAL.FAIL -12.12% 132.000 116.000 - 12.62% -

Performance Improvements - PASS Δ (B) Baseline Current σ (B) Δ σ
gcc.PASS 3.21% 334612.000 345357.000 - -5.77% -
gfortran.PASS 3.09% 68343.000 70454.000 - -0.17% -
libgomp.PASS 3.07% 16147.000 16643.000 - -0.01% -
libstdc++.PASS 2.34% 17371.000 17777.000 - -0.55% -

Performance Improvements - UNSUPPORTED Δ (B) Baseline Current σ (B) Δ σ
g++.UNSUPPORTED -74.93% 12119.000 3038.000 - -18.60% -
TOTAL.UNSUPPORTED -49.43% 17739.000 8971.000 - -13.52% -

Performance Improvements - XFAIL Δ (B) Baseline Current σ (B) Δ σ
g++.XFAIL -17.42% 3003.000 2480.000 - -1.94% -
TOTAL.XFAIL -9.89% 5438.000 4900.000 - -1.65% -
libgomp.XFAIL -7.04% 284.000 264.000 - 0.00% -

Performance Improvements - bad Δ (B) Baseline Current σ (B) Δ σ
g++.bad -66.67% 96.000 32.000 - -8.57% -
gfortran.bad -66.67% 6.000 2.000 - 0.00% -
TOTAL.bad -13.38% 142.000 123.000 - 16.04% -

Performance Improvements - fails Δ (B) Baseline Current σ (B) Δ σ
TOTAL.fails -7.58% 132.000 122.000 - 17.31% -

Performance Improvements - good Δ (B) Baseline Current σ (B) Δ σ
gcc.good 3.23% 340393.000 351391.000 - -5.86% -
gfortran.good 3.09% 68754.000 70881.000 - -0.17% -
libgomp.good 3.01% 17059.000 17572.000 - -0.01% -
libstdc++.good 2.29% 18248.000 18666.000 - -0.54% -

Added Tests - ERROR
TOTAL.ERROR
g++.ERROR
gcc.ERROR
gfortran.ERROR
libatomic.ERROR
libgomp.ERROR
libitm.ERROR
libstdc++.ERROR
objc.ERROR

Added Tests - FAIL
libatomic.FAIL
libgomp.FAIL
libitm.FAIL
libstdc++.FAIL
objc.FAIL

Added Tests - KFAIL
TOTAL.KFAIL
g++.KFAIL
gcc.KFAIL
gfortran.KFAIL
libatomic.KFAIL
libgomp.KFAIL
libitm.KFAIL
libstdc++.KFAIL
objc.KFAIL

Added Tests - OTHER
TOTAL.OTHER
g++.OTHER
gcc.OTHER
gfortran.OTHER
libatomic.OTHER
libgomp.OTHER
libitm.OTHER
libstdc++.OTHER
objc.OTHER

Added Tests - UNRESOLVED
TOTAL.UNRESOLVED
g++.UNRESOLVED
gcc.UNRESOLVED
gfortran.UNRESOLVED
libatomic.UNRESOLVED
libgomp.UNRESOLVED
libitm.UNRESOLVED
libstdc++.UNRESOLVED
objc.UNRESOLVED

Added Tests - UNSUPPORTED
libatomic.UNSUPPORTED

Added Tests - UNTESTED
TOTAL.UNTESTED
g++.UNTESTED
gcc.UNTESTED
gfortran.UNTESTED
libatomic.UNTESTED
libgomp.UNTESTED
libitm.UNTESTED
libstdc++.UNTESTED
objc.UNTESTED

Added Tests - XFAIL
libatomic.XFAIL
objc.XFAIL

Added Tests - XPASS
g++.XPASS
gfortran.XPASS
libatomic.XPASS
libgomp.XPASS
libitm.XPASS
libstdc++.XPASS
objc.XPASS

Added Tests - bad
libatomic.bad
libgomp.bad
libitm.bad
libstdc++.bad
objc.bad


Report Time: 0.23s
Name Current %
TOTAL.PASS 839561.000 -5.10%
g++.PASS 386384.000 -5.80%
gcc.PASS 345357.000 -5.77%
gfortran.PASS 70454.000 -
libatomic.PASS 54.000 -
libgomp.PASS 16643.000 -
libitm.PASS 44.000 -
libstdc++.PASS 17777.000 -
objc.PASS 2848.000 -
Geometric Mean 13589.126 -1.97%
Name Current %
TOTAL.XPASS 7.000 133.33%
g++.XPASS 0.000 -
gcc.XPASS 7.000 133.33%
gfortran.XPASS 0.000 -
libatomic.XPASS 0.000 -
libgomp.XPASS 0.000 -
libitm.XPASS 0.000 -
libstdc++.XPASS 0.000 -
objc.XPASS 0.000 -
Geometric Mean 0.001 -99.96%
Name Current %
TOTAL.FAIL 116.000 12.62%
g++.FAIL 32.000 -8.57%
gcc.FAIL 82.000 26.15%
gfortran.FAIL 2.000 -
libatomic.FAIL 0.000 -
libgomp.FAIL 0.000 -
libitm.FAIL 0.000 -
libstdc++.FAIL 0.000 -
objc.FAIL 0.000 -
Geometric Mean 0.026 -99.90%
Name Current %
TOTAL.XFAIL 4900.000 -1.65%
g++.XFAIL 2480.000 -1.94%
gcc.XFAIL 1762.000 -1.62%
gfortran.XFAIL 264.000 -
libatomic.XFAIL 0.000 -
libgomp.XFAIL 264.000 -
libitm.XFAIL 3.000 -
libstdc++.XFAIL 127.000 -3.05%
objc.XFAIL 0.000 -
Geometric Mean 12.130 -96.51%
Name Current %
TOTAL.good 853432.000 -5.18%
g++.good 391902.000 -5.89%
gcc.good 351391.000 -5.86%
gfortran.good 70881.000 -
libatomic.good 54.000 -
libgomp.good 17572.000 -
libitm.good 48.000 -
libstdc++.good 18666.000 -
objc.good 2918.000 -
Geometric Mean 14000.390 -2.00%
bad
Name Current %
TOTAL.bad 123.000 16.04%
g++.bad 32.000 -8.57%
gcc.bad 89.000 30.88%
gfortran.bad 2.000 -
libatomic.bad 0.000 -
libgomp.bad 0.000 -
libitm.bad 0.000 -
libstdc++.bad 0.000 -
objc.bad 0.000 -
Geometric Mean 0.027 -99.90%
Name Current %
TOTAL.fails 122.000 17.31%
Geometric Mean 122.000 17.31%
Name Current %
TOTAL.flaky 7.000 -
Geometric Mean 7.000 -
all
Name Current %
TOTAL.all 853555.000 -5.18%
Geometric Mean 853555.000 -5.18%