Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=568ec5b9831b0d6abc7aff4e76cefcc0fa7e0c5e (unchanged)
git_gcc https://gcc.gnu.org/git/gcc.git (85e4f21f9e90fc70b8c7c75ec8e4d0766008ac6e) (+ 112 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=591283a68965fe61a7186c9c81f7812e71b282b4 (unchanged)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/5ba594f2049bc9eb2781500c137e3e9fcc87ef69 (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-cpu2017fast--gnu-aarch64-master-O2-build/386/
Filter

gnu-aarch64-master-O2 test results

Run Order Start Time Duration
Current 0386 (basepoints/gcc-16-00302-g85e4f21f9e9) 2025-05-29T17:48:16 0:00:00
Previous 0384 (3-changed-components) 2025-05-25T21:30:21 0:00:00
Baseline 0001 (4-changed-components) 2023-03-26T18:17:00 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 18 19
Performance Improvements 67 13
Added Tests 0 108
Unchanged Tests 833 778
Total Tests 918

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
623.xalancbmk_s 3.42% 3710.000 3837.000 - 0.87% -
628.pop2_s 1.16% 10191.000 10309.000 - -3.12% -
602.gcc_s 1.07% 4191.000 4236.000 - -1.65% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
631.deepsjeng_s (unexplained diff vs previous) (percentage) 380.00% 0.100 0.480 - 0.00% -
631.deepsjeng_s (unexplained diff vs previous) 375.00% 4.000 19.000 - 0.00% -
605.mcf_s (unexplained diff vs previous) (percentage) 185.71% 0.070 0.200 - 0.00% -
605.mcf_s (unexplained diff vs previous) 180.00% 5.000 14.000 - 0.00% -
620.omnetpp_s (unexplained diff vs previous) (percentage) 180.00% 0.900 2.520 - 0.00% -
620.omnetpp_s (unexplained diff vs previous) 172.97% 37.000 101.000 - 0.00% -
648.exchange2_s (unexplained diff vs previous) 100.00% 1.000 2.000 - 0.00% -
648.exchange2_s (unexplained diff vs previous) (percentage) 100.00% 0.040 0.080 - 0.00% -
631.deepsjeng_s (max) (percentage) 26.32% 0.380 0.480 - 0.00% -
631.deepsjeng_s (max) 20.00% 15.000 18.000 - 0.00% -
623.xalancbmk_s 2.94% 34.000 35.000 - 0.00% -
623.xalancbmk_s (avg) 2.94% 34.000 35.000 - 0.00% -
620.omnetpp_s (max) (percentage) 2.93% 2.390 2.460 - 0.00% -
628.pop2_s 1.44% 139.000 141.000 - 0.00% -
628.pop2_s (avg) 1.44% 139.000 141.000 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
620.omnetpp_s -2.46% 4105.000 4004.000 - -3.82% -
607.cactuBSSN_s -2.36% 5037.000 4918.000 - 3.58% -
621.wrf_s -1.70% 7169.000 7047.000 - -22.72% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
619.lbm_s (unexplained diff vs previous) -97.47% 79.000 2.000 - 0.00% -
619.lbm_s (unexplained diff vs previous) (percentage) -96.00% 0.250 0.010 - 0.00% -
619.lbm_s (max) -85.29% 442.000 65.000 - 0.00% -
619.lbm_s (max) (percentage) -85.21% 1.420 0.210 - 0.00% -
649.fotonik3d_s (unexplained diff vs previous) (percentage) -76.47% 0.510 0.120 - 0.00% -
649.fotonik3d_s (unexplained diff vs previous) -76.00% 50.000 12.000 - 0.00% -
603.bwaves_s (max) -71.98% 257.000 72.000 - 0.00% -
603.bwaves_s (max) (percentage) -71.83% 2.840 0.800 - 0.00% -
603.bwaves_s (unexplained diff vs previous) -67.47% 83.000 27.000 - 0.00% -
603.bwaves_s (unexplained diff vs previous) (percentage) -67.39% 0.920 0.300 - 0.00% -
654.roms_s (unexplained diff vs previous) (percentage) -63.89% 0.720 0.260 - 0.00% -
654.roms_s (unexplained diff vs previous) -63.46% 208.000 76.000 - 0.00% -
508.namd_r (max) -33.33% 9.000 6.000 - 0.00% -
508.namd_r (max) (percentage) -32.26% 0.310 0.210 - 0.00% -
649.fotonik3d_s (max) (percentage) -25.49% 0.510 0.380 - 0.00% -
649.fotonik3d_s (max) -24.49% 49.000 37.000 - 0.00% -
648.exchange2_s (max) -20.00% 5.000 4.000 - 0.00% -
508.namd_r (unexplained diff vs previous) -14.29% 7.000 6.000 - 0.00% -
508.namd_r (unexplained diff vs previous) (percentage) -12.50% 0.240 0.210 - 0.00% -
654.roms_s (max) (percentage) -9.86% 0.710 0.640 - 0.00% -
654.roms_s (max) -9.76% 205.000 185.000 - 0.00% -
607.cactuBSSN_s (max) -9.09% 121.000 110.000 - 0.00% -
638.imagick_s (max) (percentage) -8.33% 0.240 0.220 - 0.00% -
526.blender_r (max) -7.89% 114.000 105.000 - 0.00% -
638.imagick_s (max) -7.69% 13.000 12.000 - 0.00% -
607.cactuBSSN_s (max) (percentage) -7.02% 2.420 2.250 - 0.00% -
526.blender_r (max) (percentage) -6.48% 1.080 1.010 - 0.00% -
605.mcf_s (max) -5.88% 34.000 32.000 - 0.00% -
628.pop2_s (max) (percentage) -5.71% 1.050 0.990 - 0.00% -
623.xalancbmk_s (max) (percentage) -5.19% 0.770 0.730 - 0.00% -
628.pop2_s (max) -4.67% 107.000 102.000 - 0.00% -
600.perlbench_s (max) (percentage) -4.45% 2.470 2.360 - 0.00% -
605.mcf_s (max) (percentage) -4.00% 0.500 0.480 - 0.00% -
600.perlbench_s (max) -4.00% 50.000 48.000 - 0.00% -
641.leela_s (max) -3.70% 27.000 26.000 - 0.00% -
641.leela_s (max) (percentage) -3.64% 0.550 0.530 - 0.00% -
625.x264_s (max) (percentage) -3.33% 0.300 0.290 - 0.00% -
631.deepsjeng_s -2.94% 34.000 33.000 - 0.00% -
631.deepsjeng_s (avg) -2.94% 34.000 33.000 - 0.00% -
510.parest_r (max) -2.70% 74.000 72.000 - 0.00% -
620.omnetpp_s -2.63% 76.000 74.000 - 0.00% -
620.omnetpp_s (avg) -2.63% 76.000 74.000 - 0.00% -
607.cactuBSSN_s -2.61% 153.000 149.000 - 0.00% -
607.cactuBSSN_s (avg) -2.61% 153.000 149.000 - 0.00% -
510.parest_r (max) (percentage) -2.33% 1.290 1.260 - 0.00% -
644.nab_s (max) (percentage) -2.06% 0.970 0.950 - 0.00% -
644.nab_s (max) -1.89% 106.000 104.000 - 0.00% -
603.bwaves_s -1.55% 193.000 190.000 - 0.00% -
603.bwaves_s (avg) -1.55% 193.000 190.000 - 0.00% -
508.namd_r (avg) (percentage) -1.49% 0.670 0.660 - 0.00% -
649.fotonik3d_s -1.47% 136.000 134.000 - 0.00% -
649.fotonik3d_s (avg) -1.47% 136.000 134.000 - 0.00% -
654.roms_s (avg) (percentage) -1.45% 2.070 2.040 - 0.00% -
649.fotonik3d_s (avg) (percentage) -1.43% 1.400 1.380 - 0.00% -
619.lbm_s -1.40% 1780.000 1755.000 - 0.00% -
619.lbm_s (avg) -1.40% 1780.000 1755.000 - 0.00% -
619.lbm_s (avg) (percentage) -1.40% 5.710 5.630 - 0.00% -
510.parest_r -1.23% 81.000 80.000 - 0.00% -
510.parest_r (avg) -1.23% 81.000 80.000 - 0.00% -
605.mcf_s (avg) (percentage) -1.20% 1.660 1.640 - 0.00% -
654.roms_s -1.17% 599.000 592.000 - 0.00% -
654.roms_s (avg) -1.17% 599.000 592.000 - 0.00% -
526.blender_r -1.05% 95.000 94.000 - 0.00% -
526.blender_r (avg) -1.05% 95.000 94.000 - 0.00% -

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
648.exchange2_s 7.32% 60374.000 64796.000 - 0.00% -
510.parest_r 3.27% 7623044.000 7871971.000 - -0.02% -
621.wrf_s 3.01% 17057867.000 17571430.000 - -0.00% -
508.namd_r 2.58% 627398.000 643614.000 - 0.00% -
631.deepsjeng_s 2.43% 80966.000 82930.000 - 0.00% -
607.cactuBSSN_s 1.51% 3224093.000 3272931.000 - -0.11% -
600.perlbench_s 1.05% 2120214.000 2142455.000 - -0.02% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
638.imagick_s 63.81% 3346.000 5481.000 - -0.22% -
508.namd_r 19.41% 2427.000 2898.000 - -0.21% -
648.exchange2_s 10.14% 2199.000 2422.000 - -0.08% -
619.lbm_s 9.77% 28412.000 31189.000 - 0.01% -
654.roms_s 6.02% 27387.000 29036.000 - 0.26% -
657.xz_s 5.61% 2228.000 2353.000 - 0.30% -
644.nab_s 4.70% 10468.000 10960.000 - -0.56% -
526.blender_r 4.40% 10053.000 10495.000 - -0.76% -
607.cactuBSSN_s 3.58% 4748.000 4918.000 - -2.36% -
631.deepsjeng_s 2.55% 3847.000 3945.000 - -0.48% -
510.parest_r 1.88% 5637.000 5743.000 - -0.62% -
603.bwaves_s 1.41% 8916.000 9042.000 - -0.30% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
603.bwaves_s -4.65% 49143.000 46859.000 - 0.00% -
641.leela_s -3.17% 147936.000 143241.000 - -0.04% -
511.povray_r -1.54% 851500.000 838388.000 - 0.01% -
620.omnetpp_s -1.52% 2027591.000 1996711.000 - 0.00% -
619.lbm_s -1.25% 16006.000 15806.000 - 0.00% -
649.fotonik3d_s -1.23% 308847.000 305046.000 - 0.00% -
623.xalancbmk_s -1.19% 4496134.000 4442800.000 - 0.09% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
621.wrf_s -22.72% 9119.000 7047.000 - -1.70% -
620.omnetpp_s -3.82% 4163.000 4004.000 - -2.46% -
628.pop2_s -3.12% 10641.000 10309.000 - 1.16% -
602.gcc_s -1.65% 4307.000 4236.000 - 1.07% -
511.povray_r -1.41% 425.000 419.000 - -0.48% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_execution_successful 4.55% 22.000 23.000 - 0.00% -

Added Tests - Code Size
625.x264_s

Added Tests - Execution
625.x264_s
627.cam4_s

Added Tests - sample variability
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
600.perlbench_s
600.perlbench_s (avg)
600.perlbench_s (avg) (percentage)
600.perlbench_s (max)
600.perlbench_s (max) (percentage)
603.bwaves_s
603.bwaves_s (avg)
603.bwaves_s (avg) (percentage)
603.bwaves_s (max)
603.bwaves_s (max) (percentage)
605.mcf_s
605.mcf_s (avg)
605.mcf_s (avg) (percentage)
605.mcf_s (max)
605.mcf_s (max) (percentage)
607.cactuBSSN_s
607.cactuBSSN_s (avg)
607.cactuBSSN_s (avg) (percentage)
607.cactuBSSN_s (max)
607.cactuBSSN_s (max) (percentage)
619.lbm_s
619.lbm_s (avg)
619.lbm_s (avg) (percentage)
619.lbm_s (max)
619.lbm_s (max) (percentage)
620.omnetpp_s
620.omnetpp_s (avg)
620.omnetpp_s (avg) (percentage)
620.omnetpp_s (max)
620.omnetpp_s (max) (percentage)
623.xalancbmk_s
623.xalancbmk_s (avg)
623.xalancbmk_s (avg) (percentage)
623.xalancbmk_s (max)
623.xalancbmk_s (max) (percentage)
625.x264_s
625.x264_s (avg)
625.x264_s (avg) (percentage)
625.x264_s (max)
625.x264_s (max) (percentage)
628.pop2_s
628.pop2_s (avg)
628.pop2_s (avg) (percentage)
628.pop2_s (max)
628.pop2_s (max) (percentage)
631.deepsjeng_s
631.deepsjeng_s (avg)
631.deepsjeng_s (avg) (percentage)
631.deepsjeng_s (max)
631.deepsjeng_s (max) (percentage)
638.imagick_s
638.imagick_s (avg)
638.imagick_s (avg) (percentage)
638.imagick_s (max)
638.imagick_s (max) (percentage)
641.leela_s
641.leela_s (avg)
641.leela_s (avg) (percentage)
641.leela_s (max)
641.leela_s (max) (percentage)
644.nab_s
644.nab_s (avg)
644.nab_s (avg) (percentage)
644.nab_s (max)
644.nab_s (max) (percentage)
648.exchange2_s
648.exchange2_s (avg)
648.exchange2_s (avg) (percentage)
648.exchange2_s (max)
648.exchange2_s (max) (percentage)
649.fotonik3d_s
649.fotonik3d_s (avg)
649.fotonik3d_s (avg) (percentage)
649.fotonik3d_s (max)
649.fotonik3d_s (max) (percentage)
654.roms_s
654.roms_s (avg)
654.roms_s (avg) (percentage)
654.roms_s (max)
654.roms_s (max) (percentage)
657.xz_s
657.xz_s (avg)
657.xz_s (avg) (percentage)
657.xz_s (max)
657.xz_s (max) (percentage)


Report Time: 0.36s
Name Current %
508.namd_r 2898.000 -
510.parest_r 5743.000 -
511.povray_r 419.000 -
526.blender_r 10495.000 -
600.perlbench_s 2049.000 -
602.gcc_s 4236.000 1.07%
603.bwaves_s 9042.000 -
605.mcf_s 6863.000 -
607.cactuBSSN_s 4918.000 -2.36%
619.lbm_s 31189.000 -
620.omnetpp_s 4004.000 -2.46%
621.wrf_s 7047.000 -1.70%
623.xalancbmk_s 3837.000 3.42%
625.x264_s 2582.000 -
627.cam4_s 155.000 -
628.pop2_s 10309.000 1.16%
631.deepsjeng_s 3945.000 -
638.imagick_s 5481.000 -
641.leela_s 4952.000 -
644.nab_s 10960.000 -
648.exchange2_s 2422.000 -
649.fotonik3d_s 9773.000 -
654.roms_s 29036.000 -
657.xz_s 2353.000 -
Geometric Mean 4514.120 -
Name Current %
508.namd_r 643614.000 -
510.parest_r 7871971.000 -
511.povray_r 838388.000 -
526.blender_r 9741291.000 -
600.perlbench_s 2142455.000 -
602.gcc_s 9035919.000 -
603.bwaves_s 46859.000 -
605.mcf_s 21057.000 -
607.cactuBSSN_s 3272931.000 -
619.lbm_s 15806.000 -
620.omnetpp_s 1996711.000 -
621.wrf_s 17571430.000 -
623.xalancbmk_s 4442800.000 -
625.x264_s 445242.000 -
628.pop2_s 25448991.000 -
631.deepsjeng_s 82930.000 -
638.imagick_s 1851646.000 -
641.leela_s 143241.000 -
644.nab_s 174115.000 -
648.exchange2_s 64796.000 -
649.fotonik3d_s 305046.000 -
654.roms_s 677300.000 -
657.xz_s 192339.000 -
Geometric Mean 729719.275 -
Name Current %
508.namd_r 19.000 -
508.namd_r (avg) 19.000 -
508.namd_r (avg) (percentage) 0.660 -1.49%
508.namd_r (max) 6.000 -33.33%
508.namd_r (max) (percentage) 0.210 -32.26%
508.namd_r (unexplained diff vs previous) 6.000 -14.29%
508.namd_r (unexplained diff vs previous) (percentage) 0.210 -12.50%
510.parest_r 80.000 -1.23%
510.parest_r (avg) 80.000 -1.23%
510.parest_r (avg) (percentage) 1.410 -
510.parest_r (max) 72.000 -2.70%
510.parest_r (max) (percentage) 1.260 -2.33%
511.povray_r 4.000 -
511.povray_r (avg) 4.000 -
511.povray_r (avg) (percentage) 1.020 -
511.povray_r (max) 4.000 -
511.povray_r (max) (percentage) 1.050 -
526.blender_r 94.000 -1.05%
526.blender_r (avg) 94.000 -1.05%
526.blender_r (avg) (percentage) 0.900 -
526.blender_r (max) 105.000 -7.89%
526.blender_r (max) (percentage) 1.010 -6.48%
600.perlbench_s 25.000 -
600.perlbench_s (avg) 25.000 -
600.perlbench_s (avg) (percentage) 1.250 -
600.perlbench_s (max) 48.000 -4.00%
600.perlbench_s (max) (percentage) 2.360 -4.45%
603.bwaves_s 190.000 -1.55%
603.bwaves_s (avg) 190.000 -1.55%
603.bwaves_s (avg) (percentage) 2.110 -
603.bwaves_s (max) 72.000 -71.98%
603.bwaves_s (max) (percentage) 0.800 -71.83%
603.bwaves_s (unexplained diff vs previous) 27.000 -67.47%
603.bwaves_s (unexplained diff vs previous) (percentage) 0.300 -67.39%
605.mcf_s 112.000 -
605.mcf_s (avg) 112.000 -
605.mcf_s (avg) (percentage) 1.640 -1.20%
605.mcf_s (max) 32.000 -5.88%
605.mcf_s (max) (percentage) 0.480 -4.00%
605.mcf_s (unexplained diff vs previous) 14.000 180.00%
605.mcf_s (unexplained diff vs previous) (percentage) 0.200 185.71%
607.cactuBSSN_s 149.000 -2.61%
607.cactuBSSN_s (avg) 149.000 -2.61%
607.cactuBSSN_s (avg) (percentage) 3.040 -
607.cactuBSSN_s (max) 110.000 -9.09%
607.cactuBSSN_s (max) (percentage) 2.250 -7.02%
619.lbm_s 1755.000 -1.40%
619.lbm_s (avg) 1755.000 -1.40%
619.lbm_s (avg) (percentage) 5.630 -1.40%
619.lbm_s (max) 65.000 -85.29%
619.lbm_s (max) (percentage) 0.210 -85.21%
619.lbm_s (unexplained diff vs previous) 2.000 -97.47%
619.lbm_s (unexplained diff vs previous) (percentage) 0.010 -96.00%
620.omnetpp_s 74.000 -2.63%
620.omnetpp_s (avg) 74.000 -2.63%
620.omnetpp_s (avg) (percentage) 1.870 -
620.omnetpp_s (max) 98.000 -
620.omnetpp_s (max) (percentage) 2.460 2.93%
620.omnetpp_s (unexplained diff vs previous) 101.000 172.97%
620.omnetpp_s (unexplained diff vs previous) (percentage) 2.520 180.00%
623.xalancbmk_s 35.000 2.94%
623.xalancbmk_s (avg) 35.000 2.94%
623.xalancbmk_s (avg) (percentage) 0.920 -
623.xalancbmk_s (max) 28.000 -
623.xalancbmk_s (max) (percentage) 0.730 -5.19%
625.x264_s 23.000 -
625.x264_s (avg) 23.000 -
625.x264_s (avg) (percentage) 0.900 -
625.x264_s (max) 7.000 -
625.x264_s (max) (percentage) 0.290 -3.33%
628.pop2_s 141.000 1.44%
628.pop2_s (avg) 141.000 1.44%
628.pop2_s (avg) (percentage) 1.370 -
628.pop2_s (max) 102.000 -4.67%
628.pop2_s (max) (percentage) 0.990 -5.71%
631.deepsjeng_s 33.000 -2.94%
631.deepsjeng_s (avg) 33.000 -2.94%
631.deepsjeng_s (avg) (percentage) 0.860 -
631.deepsjeng_s (max) 18.000 20.00%
631.deepsjeng_s (max) (percentage) 0.480 26.32%
631.deepsjeng_s (unexplained diff vs previous) 19.000 375.00%
631.deepsjeng_s (unexplained diff vs previous) (percentage) 0.480 380.00%
638.imagick_s 48.000 -
638.imagick_s (avg) 48.000 -
638.imagick_s (avg) (percentage) 0.880 -
638.imagick_s (max) 12.000 -7.69%
638.imagick_s (max) (percentage) 0.220 -8.33%
641.leela_s 31.000 -
641.leela_s (avg) 31.000 -
641.leela_s (avg) (percentage) 0.640 -
641.leela_s (max) 26.000 -3.70%
641.leela_s (max) (percentage) 0.530 -3.64%
644.nab_s 69.000 -
644.nab_s (avg) 69.000 -
644.nab_s (avg) (percentage) 0.630 -
644.nab_s (max) 104.000 -1.89%
644.nab_s (max) (percentage) 0.950 -2.06%
648.exchange2_s 7.000 -
648.exchange2_s (avg) 7.000 -
648.exchange2_s (avg) (percentage) 0.330 -
648.exchange2_s (max) 4.000 -20.00%
648.exchange2_s (max) (percentage) 0.200 -
648.exchange2_s (unexplained diff vs previous) 2.000 100.00%
648.exchange2_s (unexplained diff vs previous) (percentage) 0.080 100.00%
649.fotonik3d_s 134.000 -1.47%
649.fotonik3d_s (avg) 134.000 -1.47%
649.fotonik3d_s (avg) (percentage) 1.380 -1.43%
649.fotonik3d_s (max) 37.000 -24.49%
649.fotonik3d_s (max) (percentage) 0.380 -25.49%
649.fotonik3d_s (unexplained diff vs previous) 12.000 -76.00%
649.fotonik3d_s (unexplained diff vs previous) (percentage) 0.120 -76.47%
654.roms_s 592.000 -1.17%
654.roms_s (avg) 592.000 -1.17%
654.roms_s (avg) (percentage) 2.040 -1.45%
654.roms_s (max) 185.000 -9.76%
654.roms_s (max) (percentage) 0.640 -9.86%
654.roms_s (unexplained diff vs previous) 76.000 -63.46%
654.roms_s (unexplained diff vs previous) (percentage) 0.260 -63.89%
657.xz_s 35.000 -
657.xz_s (avg) 35.000 -
657.xz_s (avg) (percentage) 1.510 -
657.xz_s (max) 17.000 -
657.xz_s (max) (percentage) 0.750 -
Geometric Mean 7.665 -11.35%