Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=f9a37571ba647927c4f37706fe69fba8f69339dd (+ 51 commits)
git_gcc https://gcc.gnu.org/git/gcc.git (dcb9af06212e8bb36e84a1b8498c625c29abeb6f) (+ 138 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=daab2a6d19f8360248289840408e7d2e5c203c2e (+ 6 commits)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/b0d369dbad20a8c9702607e7294d63c4a0c8e0fe (+ 16054 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_vect-cpu2017fast--gnu-aarch64-master-O3-build/353/
Filter

gnu-aarch64-master-O3 test results

Run Order Start Time Duration
Current 0353 (4-changed-components) 2025-06-08T08:50:12 0:00:00
Previous 0352 (3-changed-components) 2025-06-04T17:01:01 0:00:00
Baseline 0001 (4-changed-components) 2023-03-02T21:02:50 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 14 15
Performance Improvements 48 20
Added Tests 10 113
Unchanged Tests 870 794
Total Tests 942

Performance Regressions - Code Size Δ Previous Current σ Δ (B) σ (B)
649.fotonik3d_s 1.16% 344338.000 348338.000 - -1.59% -

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
508.namd_r 1.39% 2381.000 2414.000 - 0.04% -
621.wrf_s 1.27% 6456.000 6538.000 - -0.65% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
641.leela_s (unexplained diff vs previous) 280.00% 5.000 19.000 - 0.00% -
641.leela_s (unexplained diff vs previous) (percentage) 269.23% 0.130 0.480 - 0.00% -
605.mcf_s (max) (percentage) 98.04% 0.510 1.010 - 0.00% -
605.mcf_s (max) 96.97% 33.000 65.000 - 0.00% -
625.x264_s 20.00% 5.000 6.000 - 0.00% -
625.x264_s (avg) 20.00% 5.000 6.000 - 0.00% -
641.leela_s (max) (percentage) 6.52% 0.460 0.490 - 0.00% -
641.leela_s (max) 5.56% 18.000 19.000 - 0.00% -
621.wrf_s (max) 1.29% 311.000 315.000 - 0.00% -
621.wrf_s 1.28% 470.000 476.000 - 0.00% -
621.wrf_s (avg) 1.28% 470.000 476.000 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
627.cam4_s -7.09% 141.000 131.000 - 0.00% -
511.povray_r -1.28% 390.000 385.000 - -7.00% -
605.mcf_s -1.01% 6528.000 6462.000 - -2.48% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
620.omnetpp_s (max) -56.45% 62.000 27.000 - 0.00% -
619.lbm_s (unexplained diff vs previous) (percentage) -56.25% 0.320 0.140 - 0.00% -
620.omnetpp_s (max) (percentage) -55.84% 1.540 0.680 - 0.00% -
619.lbm_s (unexplained diff vs previous) -55.79% 95.000 42.000 - 0.00% -
657.xz_s (max) (percentage) -41.67% 0.720 0.420 - 0.00% -
657.xz_s (max) -40.00% 15.000 9.000 - 0.00% -
620.omnetpp_s (unexplained diff vs previous) -37.84% 37.000 23.000 - 0.00% -
620.omnetpp_s (unexplained diff vs previous) (percentage) -37.36% 0.910 0.570 - 0.00% -
644.nab_s (unexplained diff vs previous) -21.51% 93.000 73.000 - 0.00% -
644.nab_s (unexplained diff vs previous) (percentage) -21.11% 0.900 0.710 - 0.00% -
510.parest_r (unexplained diff vs previous) (percentage) -18.18% 0.220 0.180 - 0.00% -
644.nab_s (max) -17.02% 94.000 78.000 - 0.00% -
510.parest_r (unexplained diff vs previous) -16.67% 12.000 10.000 - 0.00% -
644.nab_s (max) (percentage) -16.48% 0.910 0.760 - 0.00% -
619.lbm_s (max) -9.47% 95.000 86.000 - 0.00% -
619.lbm_s (max) (percentage) -9.38% 0.320 0.290 - 0.00% -
510.parest_r (max) (percentage) -6.35% 0.630 0.590 - 0.00% -
510.parest_r (max) -5.88% 34.000 32.000 - 0.00% -
607.cactuBSSN_s (max) (percentage) -4.59% 2.180 2.080 - 0.00% -
607.cactuBSSN_s (max) -4.59% 109.000 104.000 - 0.00% -
508.namd_r (max) (percentage) -4.50% 1.110 1.060 - 0.00% -
600.perlbench_s (max) -4.35% 23.000 22.000 - 0.00% -
648.exchange2_s (max) (percentage) -4.00% 0.250 0.240 - 0.00% -
603.bwaves_s (max) (percentage) -3.88% 1.030 0.990 - 0.00% -
631.deepsjeng_s (max) (percentage) -3.85% 0.520 0.500 - 0.00% -
508.namd_r (max) -3.85% 26.000 25.000 - 0.00% -
526.blender_r (max) -3.45% 58.000 56.000 - 0.00% -
526.blender_r (max) (percentage) -3.39% 0.590 0.570 - 0.00% -
603.bwaves_s (max) -3.26% 92.000 89.000 - 0.00% -
649.fotonik3d_s (max) (percentage) -3.13% 0.320 0.310 - 0.00% -
623.xalancbmk_s (max) (percentage) -3.12% 0.960 0.930 - 0.00% -
638.imagick_s (avg) (percentage) -2.94% 0.340 0.330 - 0.00% -
623.xalancbmk_s (max) -2.63% 38.000 37.000 - 0.00% -
600.perlbench_s (max) (percentage) -2.61% 1.150 1.120 - 0.00% -
607.cactuBSSN_s (avg) (percentage) -2.01% 1.490 1.460 - 0.00% -
511.povray_r (max) (percentage) -2.01% 1.990 1.950 - 0.00% -
657.xz_s (avg) (percentage) -1.92% 0.520 0.510 - 0.00% -
625.x264_s (max) (percentage) -1.82% 0.550 0.540 - 0.00% -
605.mcf_s -1.82% 55.000 54.000 - 0.00% -
605.mcf_s (avg) -1.82% 55.000 54.000 - 0.00% -
644.nab_s -1.59% 63.000 62.000 - 0.00% -
644.nab_s (avg) -1.59% 63.000 62.000 - 0.00% -
607.cactuBSSN_s -1.35% 74.000 73.000 - 0.00% -
607.cactuBSSN_s (avg) -1.35% 74.000 73.000 - 0.00% -
619.lbm_s (avg) (percentage) -1.15% 1.740 1.720 - 0.00% -

Added Tests - sample variability
605.mcf_s (unexplained diff vs previous)
605.mcf_s (unexplained diff vs previous) (percentage)
607.cactuBSSN_s (unexplained diff vs previous)
607.cactuBSSN_s (unexplained diff vs previous) (percentage)
623.xalancbmk_s (unexplained diff vs previous)
623.xalancbmk_s (unexplained diff vs previous) (percentage)
638.imagick_s (unexplained diff vs previous)
638.imagick_s (unexplained diff vs previous) (percentage)
657.xz_s (unexplained diff vs previous)
657.xz_s (unexplained diff vs previous) (percentage)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
648.exchange2_s 11.10% 177422.000 197116.000 - -0.02% -
508.namd_r 10.85% 738062.000 818169.000 - 0.00% -
657.xz_s 7.32% 205531.000 220567.000 - 0.00% -
511.povray_r 5.64% 1004857.000 1061485.000 - -0.00% -
607.cactuBSSN_s 5.04% 4214065.000 4426272.000 - 0.00% -
510.parest_r 4.84% 8624037.000 9041482.000 - -0.00% -
623.xalancbmk_s 2.75% 5501002.000 5652527.000 - 0.00% -
526.blender_r 2.60% 11124884.000 11414377.000 - -0.07% -
605.mcf_s 2.40% 28789.000 29481.000 - 0.00% -
602.gcc_s 2.24% 10008387.000 10232679.000 - -0.20% -
638.imagick_s 1.98% 2221404.000 2265398.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
623.xalancbmk_s 7.37% 3746.000 4022.000 - 0.93% -
607.cactuBSSN_s 2.74% 4892.000 5026.000 - 0.24% -
510.parest_r 1.81% 5400.000 5498.000 - 0.18% -
644.nab_s 1.76% 10118.000 10296.000 - -0.70% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
619.lbm_s -18.56% 21250.000 17306.000 - 0.00% -
641.leela_s -3.86% 204135.000 196246.000 - 0.00% -
603.bwaves_s -3.81% 53831.000 51779.000 - 0.00% -
654.roms_s -1.67% 1075717.000 1057777.000 - 0.01% -
625.x264_s -1.64% 626778.000 616493.000 - 0.01% -
649.fotonik3d_s -1.59% 353975.000 348338.000 - 1.16% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
625.x264_s -17.68% 1629.000 1341.000 - 0.90% -
511.povray_r -7.00% 414.000 385.000 - -1.28% -
638.imagick_s -6.62% 3367.000 3144.000 - -0.19% -
657.xz_s -4.32% 2290.000 2191.000 - 0.09% -
641.leela_s -4.23% 4110.000 3936.000 - 0.49% -
619.lbm_s -3.96% 31031.000 29803.000 - 0.14% -
654.roms_s -3.72% 24211.000 23311.000 - -0.35% -
649.fotonik3d_s -3.45% 10076.000 9728.000 - 0.50% -
631.deepsjeng_s -3.35% 3970.000 3837.000 - 0.18% -
628.pop2_s -2.62% 10047.000 9784.000 - -0.36% -
605.mcf_s -2.48% 6626.000 6462.000 - -1.01% -
620.omnetpp_s -2.05% 4146.000 4061.000 - -0.56% -
602.gcc_s -1.33% 4202.000 4146.000 - -0.12% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_execution_successful 4.55% 22.000 23.000 - 0.00% -

Added Tests - Code Size
600.perlbench_s

Added Tests - Execution
600.perlbench_s
627.cam4_s

Added Tests - sample variability
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
600.perlbench_s
600.perlbench_s (avg)
600.perlbench_s (avg) (percentage)
600.perlbench_s (max)
600.perlbench_s (max) (percentage)
603.bwaves_s
603.bwaves_s (avg)
603.bwaves_s (avg) (percentage)
603.bwaves_s (max)
603.bwaves_s (max) (percentage)
605.mcf_s
605.mcf_s (avg)
605.mcf_s (avg) (percentage)
605.mcf_s (max)
605.mcf_s (max) (percentage)
607.cactuBSSN_s
607.cactuBSSN_s (avg)
607.cactuBSSN_s (avg) (percentage)
607.cactuBSSN_s (max)
607.cactuBSSN_s (max) (percentage)
619.lbm_s
619.lbm_s (avg)
619.lbm_s (avg) (percentage)
619.lbm_s (max)
619.lbm_s (max) (percentage)
620.omnetpp_s
620.omnetpp_s (avg)
620.omnetpp_s (avg) (percentage)
620.omnetpp_s (max)
620.omnetpp_s (max) (percentage)
621.wrf_s
621.wrf_s (avg)
621.wrf_s (avg) (percentage)
621.wrf_s (max)
621.wrf_s (max) (percentage)
623.xalancbmk_s
623.xalancbmk_s (avg)
623.xalancbmk_s (avg) (percentage)
623.xalancbmk_s (max)
623.xalancbmk_s (max) (percentage)
625.x264_s
625.x264_s (avg)
625.x264_s (avg) (percentage)
625.x264_s (max)
625.x264_s (max) (percentage)
628.pop2_s
628.pop2_s (avg)
628.pop2_s (avg) (percentage)
628.pop2_s (max)
628.pop2_s (max) (percentage)
631.deepsjeng_s
631.deepsjeng_s (avg)
631.deepsjeng_s (avg) (percentage)
631.deepsjeng_s (max)
631.deepsjeng_s (max) (percentage)
638.imagick_s
638.imagick_s (avg)
638.imagick_s (avg) (percentage)
638.imagick_s (max)
638.imagick_s (max) (percentage)
641.leela_s
641.leela_s (avg)
641.leela_s (avg) (percentage)
641.leela_s (max)
641.leela_s (max) (percentage)
644.nab_s
644.nab_s (avg)
644.nab_s (avg) (percentage)
644.nab_s (max)
644.nab_s (max) (percentage)
648.exchange2_s
648.exchange2_s (avg)
648.exchange2_s (avg) (percentage)
648.exchange2_s (max)
648.exchange2_s (max) (percentage)
649.fotonik3d_s
649.fotonik3d_s (avg)
649.fotonik3d_s (avg) (percentage)
649.fotonik3d_s (max)
649.fotonik3d_s (max) (percentage)
654.roms_s
654.roms_s (avg)
654.roms_s (avg) (percentage)
654.roms_s (max)
654.roms_s (max) (percentage)
657.xz_s
657.xz_s (avg)
657.xz_s (avg) (percentage)
657.xz_s (max)
657.xz_s (max) (percentage)


Report Time: 0.35s
Name Current %
508.namd_r 2414.000 1.39%
510.parest_r 5498.000 -
511.povray_r 385.000 -1.28%
526.blender_r 9868.000 -
600.perlbench_s 2025.000 -
602.gcc_s 4146.000 -
603.bwaves_s 9010.000 -
605.mcf_s 6462.000 -1.01%
607.cactuBSSN_s 5026.000 -
619.lbm_s 29803.000 -
620.omnetpp_s 4061.000 -
621.wrf_s 6538.000 1.27%
623.xalancbmk_s 4022.000 -
625.x264_s 1341.000 -
627.cam4_s 131.000 -7.09%
628.pop2_s 9784.000 -
631.deepsjeng_s 3837.000 -
638.imagick_s 3144.000 -
641.leela_s 3936.000 -
644.nab_s 10296.000 -
648.exchange2_s 1383.000 -
649.fotonik3d_s 9728.000 -
654.roms_s 23311.000 -
657.xz_s 2191.000 -
Geometric Mean 3964.775 -
Name Current %
508.namd_r 818169.000 -
510.parest_r 9041482.000 -
511.povray_r 1061485.000 -
526.blender_r 11414377.000 -
600.perlbench_s 2589447.000 -
602.gcc_s 10232679.000 -
603.bwaves_s 51779.000 -
605.mcf_s 29481.000 -
607.cactuBSSN_s 4426272.000 -
619.lbm_s 17306.000 -
620.omnetpp_s 2234441.000 -
621.wrf_s 20399272.000 -
623.xalancbmk_s 5652527.000 -
625.x264_s 616493.000 -
628.pop2_s 26252147.000 -
631.deepsjeng_s 96626.000 -
638.imagick_s 2265398.000 -
641.leela_s 196246.000 -
644.nab_s 218891.000 -
648.exchange2_s 197116.000 -
649.fotonik3d_s 348338.000 1.16%
654.roms_s 1057777.000 -
657.xz_s 220567.000 -
Geometric Mean 926887.313 -
Name Current %
508.namd_r 12.000 -
508.namd_r (avg) 12.000 -
508.namd_r (avg) (percentage) 0.520 -
508.namd_r (max) 25.000 -3.85%
508.namd_r (max) (percentage) 1.060 -4.50%
510.parest_r 28.000 -
510.parest_r (avg) 28.000 -
510.parest_r (avg) (percentage) 0.520 -
510.parest_r (max) 32.000 -5.88%
510.parest_r (max) (percentage) 0.590 -6.35%
510.parest_r (unexplained diff vs previous) 10.000 -16.67%
510.parest_r (unexplained diff vs previous) (percentage) 0.180 -18.18%
511.povray_r 3.000 -
511.povray_r (avg) 3.000 -
511.povray_r (avg) (percentage) 0.990 -
511.povray_r (max) 7.000 -
511.povray_r (max) (percentage) 1.950 -2.01%
526.blender_r 45.000 -
526.blender_r (avg) 45.000 -
526.blender_r (avg) (percentage) 0.460 -
526.blender_r (max) 56.000 -3.45%
526.blender_r (max) (percentage) 0.570 -3.39%
600.perlbench_s 17.000 -
600.perlbench_s (avg) 17.000 -
600.perlbench_s (avg) (percentage) 0.860 -
600.perlbench_s (max) 22.000 -4.35%
600.perlbench_s (max) (percentage) 1.120 -2.61%
603.bwaves_s 95.000 -
603.bwaves_s (avg) 95.000 -
603.bwaves_s (avg) (percentage) 1.060 -
603.bwaves_s (max) 89.000 -3.26%
603.bwaves_s (max) (percentage) 0.990 -3.88%
605.mcf_s 54.000 -1.82%
605.mcf_s (avg) 54.000 -1.82%
605.mcf_s (avg) (percentage) 0.850 -
605.mcf_s (max) 65.000 96.97%
605.mcf_s (max) (percentage) 1.010 98.04%
605.mcf_s (unexplained diff vs previous) 66.000 -
605.mcf_s (unexplained diff vs previous) (percentage) 1.020 -
607.cactuBSSN_s 73.000 -1.35%
607.cactuBSSN_s (avg) 73.000 -1.35%
607.cactuBSSN_s (avg) (percentage) 1.460 -2.01%
607.cactuBSSN_s (max) 104.000 -4.59%
607.cactuBSSN_s (max) (percentage) 2.080 -4.59%
607.cactuBSSN_s (unexplained diff vs previous) 12.000 -
607.cactuBSSN_s (unexplained diff vs previous) (percentage) 0.240 -
619.lbm_s 512.000 -
619.lbm_s (avg) 512.000 -
619.lbm_s (avg) (percentage) 1.720 -1.15%
619.lbm_s (max) 86.000 -9.47%
619.lbm_s (max) (percentage) 0.290 -9.38%
619.lbm_s (unexplained diff vs previous) 42.000 -55.79%
619.lbm_s (unexplained diff vs previous) (percentage) 0.140 -56.25%
620.omnetpp_s 45.000 -
620.omnetpp_s (avg) 45.000 -
620.omnetpp_s (avg) (percentage) 1.110 -
620.omnetpp_s (max) 27.000 -56.45%
620.omnetpp_s (max) (percentage) 0.680 -55.84%
620.omnetpp_s (unexplained diff vs previous) 23.000 -37.84%
620.omnetpp_s (unexplained diff vs previous) (percentage) 0.570 -37.36%
621.wrf_s 476.000 1.28%
621.wrf_s (avg) 476.000 1.28%
621.wrf_s (avg) (percentage) 7.290 -
621.wrf_s (max) 315.000 1.29%
621.wrf_s (max) (percentage) 4.830 -
623.xalancbmk_s 22.000 -
623.xalancbmk_s (avg) 22.000 -
623.xalancbmk_s (avg) (percentage) 0.570 -
623.xalancbmk_s (max) 37.000 -2.63%
623.xalancbmk_s (max) (percentage) 0.930 -3.12%
623.xalancbmk_s (unexplained diff vs previous) 37.000 -
623.xalancbmk_s (unexplained diff vs previous) (percentage) 0.920 -
625.x264_s 6.000 20.00%
625.x264_s (avg) 6.000 20.00%
625.x264_s (avg) (percentage) 0.450 -
625.x264_s (max) 7.000 -
625.x264_s (max) (percentage) 0.540 -1.82%
628.pop2_s 72.000 -
628.pop2_s (avg) 72.000 -
628.pop2_s (avg) (percentage) 0.740 -
628.pop2_s (max) 117.000 -
628.pop2_s (max) (percentage) 1.200 -
631.deepsjeng_s 13.000 -
631.deepsjeng_s (avg) 13.000 -
631.deepsjeng_s (avg) (percentage) 0.360 -
631.deepsjeng_s (max) 19.000 -
631.deepsjeng_s (max) (percentage) 0.500 -3.85%
638.imagick_s 10.000 -
638.imagick_s (avg) 10.000 -
638.imagick_s (avg) (percentage) 0.330 -2.94%
638.imagick_s (max) 10.000 -
638.imagick_s (max) (percentage) 0.330 -
638.imagick_s (unexplained diff vs previous) 6.000 -
638.imagick_s (unexplained diff vs previous) (percentage) 0.190 -
641.leela_s 12.000 -
641.leela_s (avg) 12.000 -
641.leela_s (avg) (percentage) 0.330 -
641.leela_s (max) 19.000 5.56%
641.leela_s (max) (percentage) 0.490 6.52%
641.leela_s (unexplained diff vs previous) 19.000 280.00%
641.leela_s (unexplained diff vs previous) (percentage) 0.480 269.23%
644.nab_s 62.000 -1.59%
644.nab_s (avg) 62.000 -1.59%
644.nab_s (avg) (percentage) 0.610 -
644.nab_s (max) 78.000 -17.02%
644.nab_s (max) (percentage) 0.760 -16.48%
644.nab_s (unexplained diff vs previous) 73.000 -21.51%
644.nab_s (unexplained diff vs previous) (percentage) 0.710 -21.11%
648.exchange2_s 10.000 -
648.exchange2_s (avg) 10.000 -
648.exchange2_s (avg) (percentage) 0.790 -
648.exchange2_s (max) 3.000 -
648.exchange2_s (max) (percentage) 0.240 -4.00%
649.fotonik3d_s 58.000 -
649.fotonik3d_s (avg) 58.000 -
649.fotonik3d_s (avg) (percentage) 0.600 -
649.fotonik3d_s (max) 30.000 -
649.fotonik3d_s (max) (percentage) 0.310 -3.13%
654.roms_s 361.000 -
654.roms_s (avg) 361.000 -
654.roms_s (avg) (percentage) 1.550 -
654.roms_s (max) 676.000 -
654.roms_s (max) (percentage) 2.900 -
657.xz_s 11.000 -
657.xz_s (avg) 11.000 -
657.xz_s (avg) (percentage) 0.510 -1.92%
657.xz_s (max) 9.000 -40.00%
657.xz_s (max) (percentage) 0.420 -41.67%
657.xz_s (unexplained diff vs previous) 2.000 -
657.xz_s (unexplained diff vs previous) (percentage) 0.090 -
Geometric Mean 6.421 -11.38%