Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=568ec5b9831b0d6abc7aff4e76cefcc0fa7e0c5e (unchanged)
git_gcc https://gcc.gnu.org/git/gcc.git (1a13684dfc7286139064f7d7341462c9995cbd1c) (+ 1 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=591283a68965fe61a7186c9c81f7812e71b282b4 (unchanged)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/5ba594f2049bc9eb2781500c137e3e9fcc87ef69 (unchanged)
regression GNU-1572
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-cpu2017fast--gnu-aarch64-master-O2-build/387/
Filter

gnu-aarch64-master-O2 test results

Run Order Start Time Duration
Current 0387 (basepoints/gcc-16-00303-g1a13684dfc7) 2025-05-31T15:57:13 0:00:00
Previous 0386 (basepoints/gcc-16-00302-g85e4f21f9e9) 2025-05-29T17:48:16 0:00:00
Baseline 0001 (4-changed-components) 2023-03-26T18:17:00 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 38 20
Performance Improvements 43 14
Added Tests 6 108
Unchanged Tests 807 752
Total Tests 894

Performance Regressions - Code Size Δ Previous Current σ Δ (B) σ (B)
631.deepsjeng_s 4.98% 82930.000 87058.000 - 7.52% -
603.bwaves_s 1.69% 46859.000 47651.000 - -3.04% -
621.wrf_s 1.14% 17571430.000 17772570.000 - 4.19% -

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
627.cam4_s 10.97% 155.000 172.000 - 0.00% -
605.mcf_s 8.10% 6863.000 7419.000 - 7.65% -
511.povray_r 2.15% 419.000 428.000 - 0.71% -
644.nab_s 1.82% 10960.000 11160.000 - 6.61% -
638.imagick_s 1.57% 5481.000 5567.000 - 66.38% -
621.wrf_s 1.40% 7047.000 7146.000 - -21.64% -
620.omnetpp_s 1.32% 4004.000 4057.000 - -2.55% -
628.pop2_s 1.22% 10309.000 10435.000 - -1.94% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
619.lbm_s (unexplained diff vs previous) 24250.00% 2.000 487.000 - 0.00% -
619.lbm_s (unexplained diff vs previous) (percentage) 15800.00% 0.010 1.590 - 0.00% -
605.mcf_s (unexplained diff vs previous) 3871.43% 14.000 556.000 - 0.00% -
605.mcf_s (unexplained diff vs previous) (percentage) 3645.00% 0.200 7.490 - 0.00% -
605.mcf_s (max) 1775.00% 32.000 600.000 - 0.00% -
605.mcf_s (max) (percentage) 1587.50% 0.480 8.100 - 0.00% -
619.lbm_s (max) (percentage) 642.86% 0.210 1.560 - 0.00% -
619.lbm_s (max) 635.38% 65.000 478.000 - 0.00% -
508.namd_r (max) 350.00% 6.000 27.000 - 0.00% -
508.namd_r (unexplained diff vs previous) 350.00% 6.000 27.000 - 0.00% -
508.namd_r (max) (percentage) 342.86% 0.210 0.930 - 0.00% -
508.namd_r (unexplained diff vs previous) (percentage) 338.10% 0.210 0.920 - 0.00% -
605.mcf_s 14.29% 112.000 128.000 - 0.00% -
605.mcf_s (avg) 14.29% 112.000 128.000 - 0.00% -
648.exchange2_s 14.29% 7.000 8.000 - 0.00% -
648.exchange2_s (avg) 14.29% 7.000 8.000 - 0.00% -
657.xz_s (max) 5.88% 17.000 18.000 - 0.00% -
605.mcf_s (avg) (percentage) 5.49% 1.640 1.730 - 0.00% -
631.deepsjeng_s 3.03% 33.000 34.000 - 0.00% -
631.deepsjeng_s (avg) 3.03% 33.000 34.000 - 0.00% -
508.namd_r (avg) (percentage) 1.52% 0.660 0.670 - 0.00% -
644.nab_s 1.45% 69.000 70.000 - 0.00% -
644.nab_s (avg) 1.45% 69.000 70.000 - 0.00% -
620.omnetpp_s 1.35% 74.000 75.000 - 0.00% -
620.omnetpp_s (avg) 1.35% 74.000 75.000 - 0.00% -
657.xz_s (max) (percentage) 1.33% 0.750 0.760 - 0.00% -

Performance Regressions - Score Δ Previous Current σ Δ (B) σ (B)
nb_compile_successful -4.17% 24.000 23.000 - -4.17% -

Performance Improvements - Code Size Δ Previous Current σ Δ (B) σ (B)
648.exchange2_s -5.86% 64796.000 60996.000 - 1.03% -
649.fotonik3d_s -1.20% 305046.000 301374.000 - -2.42% -
654.roms_s -1.14% 677300.000 669588.000 - -1.55% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
602.gcc_s -5.83% 4236.000 3989.000 - -7.38% -
510.parest_r -4.74% 5743.000 5471.000 - -2.94% -
619.lbm_s -1.56% 31189.000 30702.000 - 8.06% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
620.omnetpp_s (unexplained diff vs previous) (percentage) -48.02% 2.520 1.310 - 0.00% -
620.omnetpp_s (unexplained diff vs previous) -47.52% 101.000 53.000 - 0.00% -
641.leela_s (max) -42.31% 26.000 15.000 - 0.00% -
641.leela_s (max) (percentage) -41.51% 0.530 0.310 - 0.00% -
620.omnetpp_s (max) (percentage) -12.60% 2.460 2.150 - 0.00% -
620.omnetpp_s (max) -11.22% 98.000 87.000 - 0.00% -
649.fotonik3d_s (max) -10.81% 37.000 33.000 - 0.00% -
649.fotonik3d_s (max) (percentage) -10.53% 0.380 0.340 - 0.00% -
638.imagick_s (max) -8.33% 12.000 11.000 - 0.00% -
654.roms_s (max) (percentage) -7.81% 0.640 0.590 - 0.00% -
603.bwaves_s (max) (percentage) -7.50% 0.800 0.740 - 0.00% -
623.xalancbmk_s (max) -7.14% 28.000 26.000 - 0.00% -
654.roms_s (max) -7.03% 185.000 172.000 - 0.00% -
510.parest_r (max) -6.94% 72.000 67.000 - 0.00% -
603.bwaves_s (max) -6.94% 72.000 67.000 - 0.00% -
607.cactuBSSN_s (max) -6.36% 110.000 103.000 - 0.00% -
631.deepsjeng_s (max) (percentage) -6.25% 0.480 0.450 - 0.00% -
607.cactuBSSN_s (max) (percentage) -5.78% 2.250 2.120 - 0.00% -
631.deepsjeng_s (max) -5.56% 18.000 17.000 - 0.00% -
623.xalancbmk_s (max) (percentage) -5.48% 0.730 0.690 - 0.00% -
628.pop2_s (max) (percentage) -5.05% 0.990 0.940 - 0.00% -
648.exchange2_s (max) (percentage) -5.00% 0.200 0.190 - 0.00% -
526.blender_r (max) (percentage) -4.95% 1.010 0.960 - 0.00% -
638.imagick_s (max) (percentage) -4.55% 0.220 0.210 - 0.00% -
600.perlbench_s (max) (percentage) -4.24% 2.360 2.260 - 0.00% -
600.perlbench_s (max) -4.17% 48.000 46.000 - 0.00% -
628.pop2_s (max) -3.92% 102.000 98.000 - 0.00% -
526.blender_r (max) -3.81% 105.000 101.000 - 0.00% -
510.parest_r -3.75% 80.000 77.000 - 0.00% -
510.parest_r (avg) -3.75% 80.000 77.000 - 0.00% -
619.lbm_s -2.39% 1755.000 1713.000 - 0.00% -
619.lbm_s (avg) -2.39% 1755.000 1713.000 - 0.00% -
644.nab_s (max) (percentage) -2.11% 0.950 0.930 - 0.00% -
510.parest_r (max) (percentage) -1.59% 1.260 1.240 - 0.00% -
641.leela_s (avg) (percentage) -1.56% 0.640 0.630 - 0.00% -
526.blender_r (avg) (percentage) -1.11% 0.900 0.890 - 0.00% -

Performance Improvements - Score Δ Previous Current σ Δ (B) σ (B)
nb_total_tests 12.50% 24.000 27.000 - 12.50% -

Added Tests - sample variability
526.blender_r (unexplained diff vs previous)
526.blender_r (unexplained diff vs previous) (percentage)
641.leela_s (unexplained diff vs previous)
641.leela_s (unexplained diff vs previous) (percentage)
657.xz_s (unexplained diff vs previous)
657.xz_s (unexplained diff vs previous) (percentage)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
631.deepsjeng_s 7.52% 80966.000 87058.000 - 4.98% -
621.wrf_s 4.19% 17057867.000 17772570.000 - 1.14% -
510.parest_r 3.55% 7623044.000 7893551.000 - 0.27% -
508.namd_r 2.58% 627398.000 643614.000 - 0.00% -
607.cactuBSSN_s 1.70% 3224093.000 3278835.000 - 0.18% -
648.exchange2_s 1.03% 60374.000 60996.000 - -5.86% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
638.imagick_s 66.38% 3346.000 5567.000 - 1.57% -
508.namd_r 20.52% 2427.000 2925.000 - 0.93% -
648.exchange2_s 10.64% 2199.000 2433.000 - 0.45% -
619.lbm_s 8.06% 28412.000 30702.000 - -1.56% -
605.mcf_s 7.65% 6892.000 7419.000 - 8.10% -
644.nab_s 6.61% 10468.000 11160.000 - 1.82% -
654.roms_s 6.54% 27387.000 29177.000 - 0.49% -
657.xz_s 6.42% 2228.000 2371.000 - 0.76% -
526.blender_r 5.12% 10053.000 10568.000 - 0.70% -
631.deepsjeng_s 3.35% 3847.000 3976.000 - 0.79% -
607.cactuBSSN_s 3.29% 4748.000 4904.000 - -0.28% -
603.bwaves_s 1.59% 8916.000 9058.000 - 0.18% -
641.leela_s 1.06% 4906.000 4958.000 - 0.12% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -4.17% 24.000 23.000 - -4.17% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
641.leela_s -3.17% 147936.000 143241.000 - 0.00% -
603.bwaves_s -3.04% 49143.000 47651.000 - 1.69% -
649.fotonik3d_s -2.42% 308847.000 301374.000 - -1.20% -
511.povray_r -1.97% 851500.000 834700.000 - -0.44% -
654.roms_s -1.55% 680117.000 669588.000 - -1.14% -
620.omnetpp_s -1.31% 2027591.000 2001031.000 - 0.22% -
619.lbm_s -1.25% 16006.000 15806.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
621.wrf_s -21.64% 9119.000 7146.000 - 1.40% -
602.gcc_s -7.38% 4307.000 3989.000 - -5.83% -
510.parest_r -2.94% 5637.000 5471.000 - -4.74% -
620.omnetpp_s -2.55% 4163.000 4057.000 - 1.32% -
628.pop2_s -1.94% 10641.000 10435.000 - 1.22% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 12.50% 24.000 27.000 - 12.50% -
nb_execution_successful 4.55% 22.000 23.000 - 0.00% -

Added Tests - Code Size
625.x264_s

Added Tests - Execution
625.x264_s
627.cam4_s

Added Tests - sample variability
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
600.perlbench_s
600.perlbench_s (avg)
600.perlbench_s (avg) (percentage)
600.perlbench_s (max)
600.perlbench_s (max) (percentage)
603.bwaves_s
603.bwaves_s (avg)
603.bwaves_s (avg) (percentage)
603.bwaves_s (max)
603.bwaves_s (max) (percentage)
605.mcf_s
605.mcf_s (avg)
605.mcf_s (avg) (percentage)
605.mcf_s (max)
605.mcf_s (max) (percentage)
607.cactuBSSN_s
607.cactuBSSN_s (avg)
607.cactuBSSN_s (avg) (percentage)
607.cactuBSSN_s (max)
607.cactuBSSN_s (max) (percentage)
619.lbm_s
619.lbm_s (avg)
619.lbm_s (avg) (percentage)
619.lbm_s (max)
619.lbm_s (max) (percentage)
620.omnetpp_s
620.omnetpp_s (avg)
620.omnetpp_s (avg) (percentage)
620.omnetpp_s (max)
620.omnetpp_s (max) (percentage)
623.xalancbmk_s
623.xalancbmk_s (avg)
623.xalancbmk_s (avg) (percentage)
623.xalancbmk_s (max)
623.xalancbmk_s (max) (percentage)
625.x264_s
625.x264_s (avg)
625.x264_s (avg) (percentage)
625.x264_s (max)
625.x264_s (max) (percentage)
628.pop2_s
628.pop2_s (avg)
628.pop2_s (avg) (percentage)
628.pop2_s (max)
628.pop2_s (max) (percentage)
631.deepsjeng_s
631.deepsjeng_s (avg)
631.deepsjeng_s (avg) (percentage)
631.deepsjeng_s (max)
631.deepsjeng_s (max) (percentage)
638.imagick_s
638.imagick_s (avg)
638.imagick_s (avg) (percentage)
638.imagick_s (max)
638.imagick_s (max) (percentage)
641.leela_s
641.leela_s (avg)
641.leela_s (avg) (percentage)
641.leela_s (max)
641.leela_s (max) (percentage)
644.nab_s
644.nab_s (avg)
644.nab_s (avg) (percentage)
644.nab_s (max)
644.nab_s (max) (percentage)
648.exchange2_s
648.exchange2_s (avg)
648.exchange2_s (avg) (percentage)
648.exchange2_s (max)
648.exchange2_s (max) (percentage)
649.fotonik3d_s
649.fotonik3d_s (avg)
649.fotonik3d_s (avg) (percentage)
649.fotonik3d_s (max)
649.fotonik3d_s (max) (percentage)
654.roms_s
654.roms_s (avg)
654.roms_s (avg) (percentage)
654.roms_s (max)
654.roms_s (max) (percentage)
657.xz_s
657.xz_s (avg)
657.xz_s (avg) (percentage)
657.xz_s (max)
657.xz_s (max) (percentage)


Report Time: 0.35s
Name Current %
508.namd_r 2925.000 -
510.parest_r 5471.000 -4.74%
511.povray_r 428.000 2.15%
526.blender_r 10568.000 -
600.perlbench_s 2041.000 -
602.gcc_s 3989.000 -5.83%
603.bwaves_s 9058.000 -
605.mcf_s 7419.000 8.10%
607.cactuBSSN_s 4904.000 -
619.lbm_s 30702.000 -1.56%
620.omnetpp_s 4057.000 1.32%
621.wrf_s 7146.000 1.40%
623.xalancbmk_s 3821.000 -
625.x264_s 2580.000 -
627.cam4_s 172.000 10.97%
628.pop2_s 10435.000 1.22%
631.deepsjeng_s 3976.000 -
638.imagick_s 5567.000 1.57%
641.leela_s 4958.000 -
644.nab_s 11160.000 1.82%
648.exchange2_s 2433.000 -
649.fotonik3d_s 9822.000 -
654.roms_s 29177.000 -
657.xz_s 2371.000 -
Geometric Mean 4549.824 -
Name Current %
508.namd_r 643614.000 -
510.parest_r 7893551.000 -
511.povray_r 834700.000 -
526.blender_r 9756251.000 -
600.perlbench_s 2139191.000 -
602.gcc_s 9055327.000 -
603.bwaves_s 47651.000 1.69%
605.mcf_s 21057.000 -
607.cactuBSSN_s 3278835.000 -
619.lbm_s 15806.000 -
620.omnetpp_s 2001031.000 -
621.wrf_s 17772570.000 1.14%
623.xalancbmk_s 4455432.000 -
625.x264_s 445002.000 -
628.pop2_s 25507647.000 -
631.deepsjeng_s 87058.000 4.98%
638.imagick_s 1852638.000 -
641.leela_s 143241.000 -
644.nab_s 174147.000 -
648.exchange2_s 60996.000 -5.86%
649.fotonik3d_s 301374.000 -1.20%
654.roms_s 669588.000 -1.14%
657.xz_s 192339.000 -
Geometric Mean 729798.339 -
Name Current %
nb_compile_successful 23.000 -4.17%
nb_execution_successful 23.000 -
nb_total_tests 27.000 12.50%
Geometric Mean 24.263 2.54%
Name Current %
508.namd_r 19.000 -
508.namd_r (avg) 19.000 -
508.namd_r (avg) (percentage) 0.670 1.52%
508.namd_r (max) 27.000 350.00%
508.namd_r (max) (percentage) 0.930 342.86%
508.namd_r (unexplained diff vs previous) 27.000 350.00%
508.namd_r (unexplained diff vs previous) (percentage) 0.920 338.10%
510.parest_r 77.000 -3.75%
510.parest_r (avg) 77.000 -3.75%
510.parest_r (avg) (percentage) 1.410 -
510.parest_r (max) 67.000 -6.94%
510.parest_r (max) (percentage) 1.240 -1.59%
511.povray_r 4.000 -
511.povray_r (avg) 4.000 -
511.povray_r (avg) (percentage) 1.020 -
511.povray_r (max) 4.000 -
511.povray_r (max) (percentage) 1.050 -
526.blender_r 94.000 -
526.blender_r (avg) 94.000 -
526.blender_r (avg) (percentage) 0.890 -1.11%
526.blender_r (max) 101.000 -3.81%
526.blender_r (max) (percentage) 0.960 -4.95%
526.blender_r (unexplained diff vs previous) 73.000 -
526.blender_r (unexplained diff vs previous) (percentage) 0.690 -
600.perlbench_s 25.000 -
600.perlbench_s (avg) 25.000 -
600.perlbench_s (avg) (percentage) 1.250 -
600.perlbench_s (max) 46.000 -4.17%
600.perlbench_s (max) (percentage) 2.260 -4.24%
603.bwaves_s 191.000 -
603.bwaves_s (avg) 191.000 -
603.bwaves_s (avg) (percentage) 2.110 -
603.bwaves_s (max) 67.000 -6.94%
603.bwaves_s (max) (percentage) 0.740 -7.50%
605.mcf_s 128.000 14.29%
605.mcf_s (avg) 128.000 14.29%
605.mcf_s (avg) (percentage) 1.730 5.49%
605.mcf_s (max) 600.000 1775.00%
605.mcf_s (max) (percentage) 8.100 1587.50%
605.mcf_s (unexplained diff vs previous) 556.000 3871.43%
605.mcf_s (unexplained diff vs previous) (percentage) 7.490 3645.00%
607.cactuBSSN_s 149.000 -
607.cactuBSSN_s (avg) 149.000 -
607.cactuBSSN_s (avg) (percentage) 3.040 -
607.cactuBSSN_s (max) 103.000 -6.36%
607.cactuBSSN_s (max) (percentage) 2.120 -5.78%
619.lbm_s 1713.000 -2.39%
619.lbm_s (avg) 1713.000 -2.39%
619.lbm_s (avg) (percentage) 5.580 -
619.lbm_s (max) 478.000 635.38%
619.lbm_s (max) (percentage) 1.560 642.86%
619.lbm_s (unexplained diff vs previous) 487.000 24250.00%
619.lbm_s (unexplained diff vs previous) (percentage) 1.590 15800.00%
620.omnetpp_s 75.000 1.35%
620.omnetpp_s (avg) 75.000 1.35%
620.omnetpp_s (avg) (percentage) 1.860 -
620.omnetpp_s (max) 87.000 -11.22%
620.omnetpp_s (max) (percentage) 2.150 -12.60%
620.omnetpp_s (unexplained diff vs previous) 53.000 -47.52%
620.omnetpp_s (unexplained diff vs previous) (percentage) 1.310 -48.02%
623.xalancbmk_s 35.000 -
623.xalancbmk_s (avg) 35.000 -
623.xalancbmk_s (avg) (percentage) 0.920 -
623.xalancbmk_s (max) 26.000 -7.14%
623.xalancbmk_s (max) (percentage) 0.690 -5.48%
625.x264_s 23.000 -
625.x264_s (avg) 23.000 -
625.x264_s (avg) (percentage) 0.900 -
625.x264_s (max) 7.000 -
625.x264_s (max) (percentage) 0.290 -
628.pop2_s 142.000 -
628.pop2_s (avg) 142.000 -
628.pop2_s (avg) (percentage) 1.370 -
628.pop2_s (max) 98.000 -3.92%
628.pop2_s (max) (percentage) 0.940 -5.05%
631.deepsjeng_s 34.000 3.03%
631.deepsjeng_s (avg) 34.000 3.03%
631.deepsjeng_s (avg) (percentage) 0.860 -
631.deepsjeng_s (max) 17.000 -5.56%
631.deepsjeng_s (max) (percentage) 0.450 -6.25%
638.imagick_s 48.000 -
638.imagick_s (avg) 48.000 -
638.imagick_s (avg) (percentage) 0.880 -
638.imagick_s (max) 11.000 -8.33%
638.imagick_s (max) (percentage) 0.210 -4.55%
641.leela_s 31.000 -
641.leela_s (avg) 31.000 -
641.leela_s (avg) (percentage) 0.630 -1.56%
641.leela_s (max) 15.000 -42.31%
641.leela_s (max) (percentage) 0.310 -41.51%
641.leela_s (unexplained diff vs previous) 6.000 -
641.leela_s (unexplained diff vs previous) (percentage) 0.120 -
644.nab_s 70.000 1.45%
644.nab_s (avg) 70.000 1.45%
644.nab_s (avg) (percentage) 0.630 -
644.nab_s (max) 103.000 -
644.nab_s (max) (percentage) 0.930 -2.11%
648.exchange2_s 8.000 14.29%
648.exchange2_s (avg) 8.000 14.29%
648.exchange2_s (avg) (percentage) 0.330 -
648.exchange2_s (max) 4.000 -
648.exchange2_s (max) (percentage) 0.190 -5.00%
649.fotonik3d_s 135.000 -
649.fotonik3d_s (avg) 135.000 -
649.fotonik3d_s (avg) (percentage) 1.380 -
649.fotonik3d_s (max) 33.000 -10.81%
649.fotonik3d_s (max) (percentage) 0.340 -10.53%
654.roms_s 595.000 -
654.roms_s (avg) 595.000 -
654.roms_s (avg) (percentage) 2.040 -
654.roms_s (max) 172.000 -7.03%
654.roms_s (max) (percentage) 0.590 -7.81%
657.xz_s 35.000 -
657.xz_s (avg) 35.000 -
657.xz_s (avg) (percentage) 1.500 -
657.xz_s (max) 18.000 5.88%
657.xz_s (max) (percentage) 0.760 1.33%
657.xz_s (unexplained diff vs previous) 18.000 -
657.xz_s (unexplained diff vs previous) (percentage) 0.760 -
Geometric Mean 10.609 21.68%