Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=51251096bc7e935d579cb2220734d2af0ab9024b (+ 23 commits)
git_gcc https://gcc.gnu.org/git/gcc.git (fd042192094c456e275c53dfe92383bec1e9fca3) (+ 95 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=62fba6d9807fc12334d7c5513407715d59539611 (+ 2 commits)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/854a85bbaa94372aab63fed6a37a8e1768cf1a84 (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_vect-cpu2017fast--gnu-aarch64-master-O3-build/352/
Filter

gnu-aarch64-master-O3 test results

Run Order Start Time Duration
Current 0352 (3-changed-components) 2025-06-04T17:01:01 0:00:00
Previous 0351 (4-changed-components) 2025-05-31T12:06:51 0:00:00
Baseline 0001 (4-changed-components) 2023-03-02T21:02:50 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 25 15
Performance Improvements 47 22
Added Tests 4 113
Unchanged Tests 866 792
Total Tests 942

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
627.cam4_s 5.22% 134.000 141.000 - 0.00% -
623.xalancbmk_s 1.63% 3921.000 3985.000 - 6.38% -
511.povray_r 1.56% 384.000 390.000 - -5.80% -
605.mcf_s 1.35% 6441.000 6528.000 - -1.48% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
644.nab_s (unexplained diff vs previous) 615.38% 13.000 93.000 - 0.00% -
644.nab_s (unexplained diff vs previous) (percentage) 592.31% 0.130 0.900 - 0.00% -
620.omnetpp_s (unexplained diff vs previous) 270.00% 10.000 37.000 - 0.00% -
620.omnetpp_s (unexplained diff vs previous) (percentage) 264.00% 0.250 0.910 - 0.00% -
603.bwaves_s (unexplained diff vs previous) (percentage) 263.64% 0.220 0.800 - 0.00% -
603.bwaves_s (unexplained diff vs previous) 260.00% 20.000 72.000 - 0.00% -
644.nab_s (max) 176.47% 34.000 94.000 - 0.00% -
644.nab_s (max) (percentage) 167.65% 0.340 0.910 - 0.00% -
649.fotonik3d_s (unexplained diff vs previous) (percentage) 50.00% 0.140 0.210 - 0.00% -
619.lbm_s (unexplained diff vs previous) (percentage) 45.45% 0.220 0.320 - 0.00% -
619.lbm_s (unexplained diff vs previous) 43.94% 66.000 95.000 - 0.00% -
649.fotonik3d_s (unexplained diff vs previous) 42.86% 14.000 20.000 - 0.00% -
619.lbm_s (max) 7.95% 88.000 95.000 - 0.00% -
619.lbm_s (max) (percentage) 6.67% 0.300 0.320 - 0.00% -
623.xalancbmk_s 4.76% 21.000 22.000 - 0.00% -
623.xalancbmk_s (avg) 4.76% 21.000 22.000 - 0.00% -
644.nab_s 3.28% 61.000 63.000 - 0.00% -
644.nab_s (avg) 3.28% 61.000 63.000 - 0.00% -
605.mcf_s 1.85% 54.000 55.000 - 0.00% -
605.mcf_s (avg) 1.85% 54.000 55.000 - 0.00% -
644.nab_s (avg) (percentage) 1.67% 0.600 0.610 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
621.wrf_s -2.05% 6591.000 6456.000 - -1.90% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
508.namd_r (unexplained diff vs previous) -85.19% 27.000 4.000 - 0.00% -
508.namd_r (unexplained diff vs previous) (percentage) -84.96% 1.130 0.170 - 0.00% -
641.leela_s (unexplained diff vs previous) -75.00% 20.000 5.000 - 0.00% -
641.leela_s (unexplained diff vs previous) (percentage) -74.51% 0.510 0.130 - 0.00% -
510.parest_r (max) -17.07% 41.000 34.000 - 0.00% -
510.parest_r (max) (percentage) -16.00% 0.750 0.630 - 0.00% -
641.leela_s (max) -10.00% 20.000 18.000 - 0.00% -
641.leela_s (max) (percentage) -9.80% 0.510 0.460 - 0.00% -
620.omnetpp_s (max) (percentage) -8.33% 1.680 1.540 - 0.00% -
620.omnetpp_s (max) -7.46% 67.000 62.000 - 0.00% -
648.exchange2_s (max) (percentage) -7.41% 0.270 0.250 - 0.00% -
605.mcf_s (max) (percentage) -7.27% 0.550 0.510 - 0.00% -
649.fotonik3d_s (max) -6.25% 32.000 30.000 - 0.00% -
657.xz_s (max) -6.25% 16.000 15.000 - 0.00% -
603.bwaves_s (max) -6.12% 98.000 92.000 - 0.00% -
649.fotonik3d_s (max) (percentage) -5.88% 0.340 0.320 - 0.00% -
605.mcf_s (max) -5.71% 35.000 33.000 - 0.00% -
607.cactuBSSN_s (max) (percentage) -5.63% 2.310 2.180 - 0.00% -
603.bwaves_s (max) (percentage) -5.50% 1.090 1.030 - 0.00% -
607.cactuBSSN_s (max) -5.22% 115.000 109.000 - 0.00% -
508.namd_r (max) (percentage) -5.13% 1.170 1.110 - 0.00% -
631.deepsjeng_s (max) -5.00% 20.000 19.000 - 0.00% -
508.namd_r (max) -3.70% 27.000 26.000 - 0.00% -
625.x264_s (max) (percentage) -3.51% 0.570 0.550 - 0.00% -
510.parest_r -3.45% 29.000 28.000 - 0.00% -
510.parest_r (avg) -3.45% 29.000 28.000 - 0.00% -
526.blender_r (max) (percentage) -3.28% 0.610 0.590 - 0.00% -
623.xalancbmk_s (max) (percentage) -3.03% 0.990 0.960 - 0.00% -
657.xz_s (max) (percentage) -2.70% 0.740 0.720 - 0.00% -
600.perlbench_s (max) (percentage) -2.54% 1.180 1.150 - 0.00% -
621.wrf_s (max) -2.20% 318.000 311.000 - 0.00% -
511.povray_r (max) (percentage) -1.97% 2.030 1.990 - 0.00% -
508.namd_r (avg) (percentage) -1.89% 0.530 0.520 - 0.00% -
510.parest_r (avg) (percentage) -1.89% 0.530 0.520 - 0.00% -
631.deepsjeng_s (max) (percentage) -1.89% 0.530 0.520 - 0.00% -
621.wrf_s -1.88% 479.000 470.000 - 0.00% -
621.wrf_s (avg) -1.88% 479.000 470.000 - 0.00% -
526.blender_r (max) -1.69% 59.000 58.000 - 0.00% -
649.fotonik3d_s -1.69% 59.000 58.000 - 0.00% -
649.fotonik3d_s (avg) -1.69% 59.000 58.000 - 0.00% -
649.fotonik3d_s (avg) (percentage) -1.64% 0.610 0.600 - 0.00% -
628.pop2_s -1.37% 73.000 72.000 - 0.00% -
628.pop2_s (avg) -1.37% 73.000 72.000 - 0.00% -
619.lbm_s (avg) (percentage) -1.14% 1.760 1.740 - 0.00% -
603.bwaves_s -1.04% 96.000 95.000 - 0.00% -
603.bwaves_s (avg) -1.04% 96.000 95.000 - 0.00% -

Added Tests - sample variability
510.parest_r (unexplained diff vs previous)
510.parest_r (unexplained diff vs previous) (percentage)
631.deepsjeng_s (unexplained diff vs previous)
631.deepsjeng_s (unexplained diff vs previous) (percentage)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
648.exchange2_s 11.12% 177422.000 197148.000 - -0.02% -
508.namd_r 10.85% 738062.000 818169.000 - 0.00% -
657.xz_s 7.32% 205531.000 220567.000 - -0.02% -
511.povray_r 5.64% 1004857.000 1061517.000 - -0.79% -
607.cactuBSSN_s 5.04% 4214065.000 4426272.000 - -0.18% -
510.parest_r 4.84% 8624037.000 9041514.000 - 0.09% -
623.xalancbmk_s 2.75% 5501002.000 5652527.000 - -0.01% -
526.blender_r 2.68% 11124884.000 11422697.000 - 0.11% -
602.gcc_s 2.45% 10008387.000 10253263.000 - -0.04% -
605.mcf_s 2.40% 28789.000 29481.000 - 0.00% -
638.imagick_s 1.98% 2221404.000 2265398.000 - -0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
623.xalancbmk_s 6.38% 3746.000 3985.000 - 1.63% -
607.cactuBSSN_s 2.49% 4892.000 5014.000 - 0.16% -
644.nab_s 2.48% 10118.000 10369.000 - 0.91% -
510.parest_r 1.63% 5400.000 5488.000 - 0.22% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
619.lbm_s -18.56% 21250.000 17306.000 - 0.00% -
641.leela_s -3.86% 204135.000 196246.000 - 0.00% -
603.bwaves_s -3.81% 53831.000 51779.000 - 0.00% -
649.fotonik3d_s -2.72% 353975.000 344338.000 - 0.00% -
654.roms_s -1.68% 1075717.000 1057681.000 - -0.00% -
625.x264_s -1.65% 626778.000 616461.000 - -0.01% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
625.x264_s -18.42% 1629.000 1329.000 - 0.00% -
638.imagick_s -6.44% 3367.000 3150.000 - 0.00% -
511.povray_r -5.80% 414.000 390.000 - 1.56% -
641.leela_s -4.70% 4110.000 3917.000 - -0.13% -
657.xz_s -4.41% 2290.000 2189.000 - 0.00% -
619.lbm_s -4.09% 31031.000 29761.000 - 0.32% -
649.fotonik3d_s -3.93% 10076.000 9680.000 - -0.21% -
631.deepsjeng_s -3.53% 3970.000 3830.000 - -0.52% -
654.roms_s -3.38% 24211.000 23393.000 - -0.15% -
628.pop2_s -2.27% 10047.000 9819.000 - -0.72% -
621.wrf_s -1.90% 6581.000 6456.000 - -2.05% -
620.omnetpp_s -1.50% 4146.000 4084.000 - 0.91% -
605.mcf_s -1.48% 6626.000 6528.000 - 1.35% -
508.namd_r -1.33% 2413.000 2381.000 - -0.17% -
602.gcc_s -1.21% 4202.000 4151.000 - -0.22% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_execution_successful 4.55% 22.000 23.000 - 0.00% -

Added Tests - Code Size
600.perlbench_s

Added Tests - Execution
600.perlbench_s
627.cam4_s

Added Tests - sample variability
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
600.perlbench_s
600.perlbench_s (avg)
600.perlbench_s (avg) (percentage)
600.perlbench_s (max)
600.perlbench_s (max) (percentage)
603.bwaves_s
603.bwaves_s (avg)
603.bwaves_s (avg) (percentage)
603.bwaves_s (max)
603.bwaves_s (max) (percentage)
605.mcf_s
605.mcf_s (avg)
605.mcf_s (avg) (percentage)
605.mcf_s (max)
605.mcf_s (max) (percentage)
607.cactuBSSN_s
607.cactuBSSN_s (avg)
607.cactuBSSN_s (avg) (percentage)
607.cactuBSSN_s (max)
607.cactuBSSN_s (max) (percentage)
619.lbm_s
619.lbm_s (avg)
619.lbm_s (avg) (percentage)
619.lbm_s (max)
619.lbm_s (max) (percentage)
620.omnetpp_s
620.omnetpp_s (avg)
620.omnetpp_s (avg) (percentage)
620.omnetpp_s (max)
620.omnetpp_s (max) (percentage)
621.wrf_s
621.wrf_s (avg)
621.wrf_s (avg) (percentage)
621.wrf_s (max)
621.wrf_s (max) (percentage)
623.xalancbmk_s
623.xalancbmk_s (avg)
623.xalancbmk_s (avg) (percentage)
623.xalancbmk_s (max)
623.xalancbmk_s (max) (percentage)
625.x264_s
625.x264_s (avg)
625.x264_s (avg) (percentage)
625.x264_s (max)
625.x264_s (max) (percentage)
628.pop2_s
628.pop2_s (avg)
628.pop2_s (avg) (percentage)
628.pop2_s (max)
628.pop2_s (max) (percentage)
631.deepsjeng_s
631.deepsjeng_s (avg)
631.deepsjeng_s (avg) (percentage)
631.deepsjeng_s (max)
631.deepsjeng_s (max) (percentage)
638.imagick_s
638.imagick_s (avg)
638.imagick_s (avg) (percentage)
638.imagick_s (max)
638.imagick_s (max) (percentage)
641.leela_s
641.leela_s (avg)
641.leela_s (avg) (percentage)
641.leela_s (max)
641.leela_s (max) (percentage)
644.nab_s
644.nab_s (avg)
644.nab_s (avg) (percentage)
644.nab_s (max)
644.nab_s (max) (percentage)
648.exchange2_s
648.exchange2_s (avg)
648.exchange2_s (avg) (percentage)
648.exchange2_s (max)
648.exchange2_s (max) (percentage)
649.fotonik3d_s
649.fotonik3d_s (avg)
649.fotonik3d_s (avg) (percentage)
649.fotonik3d_s (max)
649.fotonik3d_s (max) (percentage)
654.roms_s
654.roms_s (avg)
654.roms_s (avg) (percentage)
654.roms_s (max)
654.roms_s (max) (percentage)
657.xz_s
657.xz_s (avg)
657.xz_s (avg) (percentage)
657.xz_s (max)
657.xz_s (max) (percentage)


Report Time: 0.36s
Name Current %
508.namd_r 2381.000 -
510.parest_r 5488.000 -
511.povray_r 390.000 1.56%
526.blender_r 9882.000 -
600.perlbench_s 2005.000 -
602.gcc_s 4151.000 -
603.bwaves_s 8982.000 -
605.mcf_s 6528.000 1.35%
607.cactuBSSN_s 5014.000 -
619.lbm_s 29761.000 -
620.omnetpp_s 4084.000 -
621.wrf_s 6456.000 -2.05%
623.xalancbmk_s 3985.000 1.63%
625.x264_s 1329.000 -
627.cam4_s 141.000 5.22%
628.pop2_s 9819.000 -
631.deepsjeng_s 3830.000 -
638.imagick_s 3150.000 -
641.leela_s 3917.000 -
644.nab_s 10369.000 -
648.exchange2_s 1384.000 -
649.fotonik3d_s 9680.000 -
654.roms_s 23393.000 -
657.xz_s 2189.000 -
Geometric Mean 3972.360 -
Name Current %
508.namd_r 818169.000 -
510.parest_r 9041514.000 -
511.povray_r 1061517.000 -
526.blender_r 11422697.000 -
600.perlbench_s 2589479.000 -
602.gcc_s 10253263.000 -
603.bwaves_s 51779.000 -
605.mcf_s 29481.000 -
607.cactuBSSN_s 4426272.000 -
619.lbm_s 17306.000 -
620.omnetpp_s 2234441.000 -
621.wrf_s 20406512.000 -
623.xalancbmk_s 5652527.000 -
625.x264_s 616461.000 -
628.pop2_s 26260459.000 -
631.deepsjeng_s 96626.000 -
638.imagick_s 2265398.000 -
641.leela_s 196246.000 -
644.nab_s 218891.000 -
648.exchange2_s 197148.000 -
649.fotonik3d_s 344338.000 -
654.roms_s 1057681.000 -
657.xz_s 220567.000 -
Geometric Mean 926561.985 -
Name Current %
508.namd_r 12.000 -
508.namd_r (avg) 12.000 -
508.namd_r (avg) (percentage) 0.520 -1.89%
508.namd_r (max) 26.000 -3.70%
508.namd_r (max) (percentage) 1.110 -5.13%
508.namd_r (unexplained diff vs previous) 4.000 -85.19%
508.namd_r (unexplained diff vs previous) (percentage) 0.170 -84.96%
510.parest_r 28.000 -3.45%
510.parest_r (avg) 28.000 -3.45%
510.parest_r (avg) (percentage) 0.520 -1.89%
510.parest_r (max) 34.000 -17.07%
510.parest_r (max) (percentage) 0.630 -16.00%
510.parest_r (unexplained diff vs previous) 12.000 -
510.parest_r (unexplained diff vs previous) (percentage) 0.220 -
511.povray_r 3.000 -
511.povray_r (avg) 3.000 -
511.povray_r (avg) (percentage) 0.990 -
511.povray_r (max) 7.000 -
511.povray_r (max) (percentage) 1.990 -1.97%
526.blender_r 45.000 -
526.blender_r (avg) 45.000 -
526.blender_r (avg) (percentage) 0.460 -
526.blender_r (max) 58.000 -1.69%
526.blender_r (max) (percentage) 0.590 -3.28%
600.perlbench_s 17.000 -
600.perlbench_s (avg) 17.000 -
600.perlbench_s (avg) (percentage) 0.860 -
600.perlbench_s (max) 23.000 -
600.perlbench_s (max) (percentage) 1.150 -2.54%
603.bwaves_s 95.000 -1.04%
603.bwaves_s (avg) 95.000 -1.04%
603.bwaves_s (avg) (percentage) 1.060 -
603.bwaves_s (max) 92.000 -6.12%
603.bwaves_s (max) (percentage) 1.030 -5.50%
603.bwaves_s (unexplained diff vs previous) 72.000 260.00%
603.bwaves_s (unexplained diff vs previous) (percentage) 0.800 263.64%
605.mcf_s 55.000 1.85%
605.mcf_s (avg) 55.000 1.85%
605.mcf_s (avg) (percentage) 0.850 -
605.mcf_s (max) 33.000 -5.71%
605.mcf_s (max) (percentage) 0.510 -7.27%
607.cactuBSSN_s 74.000 -
607.cactuBSSN_s (avg) 74.000 -
607.cactuBSSN_s (avg) (percentage) 1.490 -
607.cactuBSSN_s (max) 109.000 -5.22%
607.cactuBSSN_s (max) (percentage) 2.180 -5.63%
619.lbm_s 517.000 -
619.lbm_s (avg) 517.000 -
619.lbm_s (avg) (percentage) 1.740 -1.14%
619.lbm_s (max) 95.000 7.95%
619.lbm_s (max) (percentage) 0.320 6.67%
619.lbm_s (unexplained diff vs previous) 95.000 43.94%
619.lbm_s (unexplained diff vs previous) (percentage) 0.320 45.45%
620.omnetpp_s 45.000 -
620.omnetpp_s (avg) 45.000 -
620.omnetpp_s (avg) (percentage) 1.120 -
620.omnetpp_s (max) 62.000 -7.46%
620.omnetpp_s (max) (percentage) 1.540 -8.33%
620.omnetpp_s (unexplained diff vs previous) 37.000 270.00%
620.omnetpp_s (unexplained diff vs previous) (percentage) 0.910 264.00%
621.wrf_s 470.000 -1.88%
621.wrf_s (avg) 470.000 -1.88%
621.wrf_s (avg) (percentage) 7.290 -
621.wrf_s (max) 311.000 -2.20%
621.wrf_s (max) (percentage) 4.830 -
623.xalancbmk_s 22.000 4.76%
623.xalancbmk_s (avg) 22.000 4.76%
623.xalancbmk_s (avg) (percentage) 0.560 -
623.xalancbmk_s (max) 38.000 -
623.xalancbmk_s (max) (percentage) 0.960 -3.03%
625.x264_s 5.000 -
625.x264_s (avg) 5.000 -
625.x264_s (avg) (percentage) 0.450 -
625.x264_s (max) 7.000 -
625.x264_s (max) (percentage) 0.550 -3.51%
628.pop2_s 72.000 -1.37%
628.pop2_s (avg) 72.000 -1.37%
628.pop2_s (avg) (percentage) 0.740 -
628.pop2_s (max) 117.000 -
628.pop2_s (max) (percentage) 1.200 -
631.deepsjeng_s 13.000 -
631.deepsjeng_s (avg) 13.000 -
631.deepsjeng_s (avg) (percentage) 0.360 -
631.deepsjeng_s (max) 19.000 -5.00%
631.deepsjeng_s (max) (percentage) 0.520 -1.89%
631.deepsjeng_s (unexplained diff vs previous) 20.000 -
631.deepsjeng_s (unexplained diff vs previous) (percentage) 0.520 -
638.imagick_s 10.000 -
638.imagick_s (avg) 10.000 -
638.imagick_s (avg) (percentage) 0.340 -
638.imagick_s (max) 10.000 -
638.imagick_s (max) (percentage) 0.330 -
641.leela_s 12.000 -
641.leela_s (avg) 12.000 -
641.leela_s (avg) (percentage) 0.330 -
641.leela_s (max) 18.000 -10.00%
641.leela_s (max) (percentage) 0.460 -9.80%
641.leela_s (unexplained diff vs previous) 5.000 -75.00%
641.leela_s (unexplained diff vs previous) (percentage) 0.130 -74.51%
644.nab_s 63.000 3.28%
644.nab_s (avg) 63.000 3.28%
644.nab_s (avg) (percentage) 0.610 1.67%
644.nab_s (max) 94.000 176.47%
644.nab_s (max) (percentage) 0.910 167.65%
644.nab_s (unexplained diff vs previous) 93.000 615.38%
644.nab_s (unexplained diff vs previous) (percentage) 0.900 592.31%
648.exchange2_s 10.000 -
648.exchange2_s (avg) 10.000 -
648.exchange2_s (avg) (percentage) 0.790 -
648.exchange2_s (max) 3.000 -
648.exchange2_s (max) (percentage) 0.250 -7.41%
649.fotonik3d_s 58.000 -1.69%
649.fotonik3d_s (avg) 58.000 -1.69%
649.fotonik3d_s (avg) (percentage) 0.600 -1.64%
649.fotonik3d_s (max) 30.000 -6.25%
649.fotonik3d_s (max) (percentage) 0.320 -5.88%
649.fotonik3d_s (unexplained diff vs previous) 20.000 42.86%
649.fotonik3d_s (unexplained diff vs previous) (percentage) 0.210 50.00%
654.roms_s 362.000 -
654.roms_s (avg) 362.000 -
654.roms_s (avg) (percentage) 1.550 -
654.roms_s (max) 678.000 -
654.roms_s (max) (percentage) 2.900 -
657.xz_s 11.000 -
657.xz_s (avg) 11.000 -
657.xz_s (avg) (percentage) 0.520 -
657.xz_s (max) 15.000 -6.25%
657.xz_s (max) (percentage) 0.720 -2.70%
Geometric Mean 6.785 -