Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=d5827a0e838caacb0337be95e6661fd8281e1968 (unchanged)
git_gcc https://gcc.gnu.org/git/gcc.git (0895aef01c64c317b489811dbe4ac55f9c13aab3) (+ 1 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=cb4692ce1edd5a81c2521de49dfef6125141d1c7 (unchanged)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/efe163851b025508a08a08a96032adc4f8b6c82d (unchanged)
regression GNU-1480
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-cpu2017fast--gnu-aarch64-master-O2_LTO-build/363/
Filter

gnu-aarch64-master-O2_LTO test results

Run Order Start Time Duration
Current 0363 (basepoints/gcc-15-06345-g0895aef01c64) 2024-12-26T07:32:21 0:00:00
Previous 0362 (basepoints/gcc-15-06344-gbad3714b117f) 2024-12-25T04:27:01 0:00:00
Baseline 0001 (4-changed-components) 2023-03-24T00:16:56 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 5 14
Performance Improvements 82 17
Added Tests 0 106
Unchanged Tests 831 781
Total Tests 918

Performance Regressions - Code Size Δ Previous Current σ Δ (B) σ (B)
649.fotonik3d_s 2.04% 286961.000 292813.000 - -1.06% -
654.roms_s 1.35% 505173.000 511981.000 - 1.26% -

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
627.cam4_s 7.41% 135.000 145.000 - 0.00% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
619.lbm_s (unexplained diff vs previous) (percentage) 9.47% 4.860 5.320 - 0.00% -
619.lbm_s (unexplained diff vs previous) 3.85% 1482.000 1539.000 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
619.lbm_s -5.05% 30488.000 28949.000 - 1.22% -
603.bwaves_s -4.62% 9332.000 8901.000 - -1.79% -
621.wrf_s -3.67% 7117.000 6856.000 - -26.06% -
607.cactuBSSN_s -3.41% 4892.000 4725.000 - -2.28% -
623.xalancbmk_s -3.37% 3261.000 3151.000 - -3.31% -
649.fotonik3d_s -2.86% 9927.000 9643.000 - -1.53% -
654.roms_s -2.29% 28032.000 27391.000 - 0.56% -
602.gcc_s -2.07% 4156.000 4070.000 - -2.68% -
638.imagick_s -1.57% 3378.000 3325.000 - -0.27% -
644.nab_s -1.51% 10513.000 10354.000 - -1.26% -
631.deepsjeng_s -1.41% 3475.000 3426.000 - -1.52% -
510.parest_r -1.39% 5817.000 5736.000 - -0.50% -
657.xz_s -1.22% 2214.000 2187.000 - -1.09% -
625.x264_s -1.11% 2521.000 2493.000 - 5.68% -
620.omnetpp_s -1.11% 4053.000 4008.000 - -1.96% -
605.mcf_s -1.08% 6582.000 6511.000 - -3.12% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
619.lbm_s (max) -48.05% 5091.000 2645.000 - 0.00% -
619.lbm_s (max) (percentage) -45.27% 16.700 9.140 - 0.00% -
511.povray_r (max) -20.00% 5.000 4.000 - 0.00% -
603.bwaves_s (max) -9.87% 314.000 283.000 - 0.00% -
511.povray_r (max) (percentage) -8.89% 1.350 1.230 - 0.00% -
649.fotonik3d_s (max) -8.20% 317.000 291.000 - 0.00% -
638.imagick_s (max) -8.20% 61.000 56.000 - 0.00% -
620.omnetpp_s (max) -7.69% 52.000 48.000 - 0.00% -
654.roms_s (max) -7.36% 2581.000 2391.000 - 0.00% -
631.deepsjeng_s (max) -7.25% 69.000 64.000 - 0.00% -
607.cactuBSSN_s (max) -7.04% 213.000 198.000 - 0.00% -
623.xalancbmk_s (max) -6.98% 43.000 40.000 - 0.00% -
625.x264_s (max) -6.82% 44.000 41.000 - 0.00% -
657.xz_s (max) -6.67% 60.000 56.000 - 0.00% -
605.mcf_s (max) -6.41% 156.000 146.000 - 0.00% -
657.xz_s (max) (percentage) -6.20% 2.740 2.570 - 0.00% -
620.omnetpp_s (max) (percentage) -6.15% 1.300 1.220 - 0.00% -
631.deepsjeng_s (max) (percentage) -6.00% 2.000 1.880 - 0.00% -
648.exchange2_s (max) (percentage) -5.88% 0.170 0.160 - 0.00% -
625.x264_s (max) (percentage) -5.65% 1.770 1.670 - 0.00% -
649.fotonik3d_s (max) (percentage) -5.63% 3.200 3.020 - 0.00% -
641.leela_s (max) -5.56% 36.000 34.000 - 0.00% -
638.imagick_s (max) (percentage) -5.52% 1.810 1.710 - 0.00% -
605.mcf_s (max) (percentage) -5.46% 2.380 2.250 - 0.00% -
641.leela_s (max) (percentage) -5.43% 0.920 0.870 - 0.00% -
603.bwaves_s (max) (percentage) -5.34% 3.370 3.190 - 0.00% -
619.lbm_s -5.32% 2198.000 2081.000 - 0.00% -
619.lbm_s (avg) -5.32% 2198.000 2081.000 - 0.00% -
654.roms_s (max) (percentage) -5.21% 9.210 8.730 - 0.00% -
510.parest_r (max) -5.07% 138.000 131.000 - 0.00% -
508.namd_r -5.00% 20.000 19.000 - 0.00% -
508.namd_r (avg) -5.00% 20.000 19.000 - 0.00% -
508.namd_r (max) -5.00% 40.000 38.000 - 0.00% -
603.bwaves_s -4.62% 195.000 186.000 - 0.00% -
603.bwaves_s (avg) -4.62% 195.000 186.000 - 0.00% -
628.pop2_s (max) -4.48% 134.000 128.000 - 0.00% -
607.cactuBSSN_s (max) (percentage) -3.89% 4.370 4.200 - 0.00% -
600.perlbench_s (max) -3.85% 52.000 50.000 - 0.00% -
625.x264_s -3.85% 26.000 25.000 - 0.00% -
625.x264_s (avg) -3.85% 26.000 25.000 - 0.00% -
628.pop2_s (max) (percentage) -3.82% 1.310 1.260 - 0.00% -
623.xalancbmk_s (max) (percentage) -3.73% 1.340 1.290 - 0.00% -
623.xalancbmk_s -3.70% 27.000 26.000 - 0.00% -
623.xalancbmk_s (avg) -3.70% 27.000 26.000 - 0.00% -
607.cactuBSSN_s -3.57% 140.000 135.000 - 0.00% -
607.cactuBSSN_s (avg) -3.57% 140.000 135.000 - 0.00% -
600.perlbench_s (max) (percentage) -3.38% 2.660 2.570 - 0.00% -
510.parest_r (max) (percentage) -3.36% 2.380 2.300 - 0.00% -
508.namd_r (max) (percentage) -3.13% 1.600 1.550 - 0.00% -
631.deepsjeng_s -3.03% 33.000 32.000 - 0.00% -
631.deepsjeng_s (avg) -3.03% 33.000 32.000 - 0.00% -
649.fotonik3d_s -2.79% 179.000 174.000 - 0.00% -
649.fotonik3d_s (avg) -2.79% 179.000 174.000 - 0.00% -
638.imagick_s -2.70% 37.000 36.000 - 0.00% -
638.imagick_s (avg) -2.70% 37.000 36.000 - 0.00% -
654.roms_s -2.28% 922.000 901.000 - 0.00% -
654.roms_s (avg) -2.28% 922.000 901.000 - 0.00% -
644.nab_s (max) -1.85% 54.000 53.000 - 0.00% -
644.nab_s -1.59% 63.000 62.000 - 0.00% -
644.nab_s (avg) -1.59% 63.000 62.000 - 0.00% -
620.omnetpp_s -1.43% 70.000 69.000 - 0.00% -
620.omnetpp_s (avg) -1.43% 70.000 69.000 - 0.00% -
510.parest_r -1.35% 74.000 73.000 - 0.00% -
510.parest_r (avg) -1.35% 74.000 73.000 - 0.00% -
605.mcf_s -1.28% 78.000 77.000 - 0.00% -
605.mcf_s (avg) -1.28% 78.000 77.000 - 0.00% -

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
621.wrf_s 3.86% 13460511.000 13979830.000 - 0.06% -
657.xz_s 2.96% 135153.000 139153.000 - -0.11% -
508.namd_r 2.88% 613265.000 630947.000 - -0.01% -
600.perlbench_s 2.09% 2151136.000 2196147.000 - 0.40% -
510.parest_r 2.02% 1458341.000 1487779.000 - 0.02% -
628.pop2_s 2.01% 2872616.000 2930392.000 - 0.45% -
607.cactuBSSN_s 1.81% 2773236.000 2823314.000 - 0.21% -
605.mcf_s 1.47% 16285.000 16525.000 - 0.00% -
654.roms_s 1.26% 505598.000 511981.000 - 1.35% -
641.leela_s 1.20% 80027.000 80991.000 - -0.28% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
625.x264_s 5.68% 2359.000 2493.000 - -1.11% -
648.exchange2_s 5.04% 2221.000 2333.000 - -0.21% -
508.namd_r 2.76% 2428.000 2495.000 - -0.24% -
619.lbm_s 1.22% 28600.000 28949.000 - -5.05% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
648.exchange2_s -9.32% 60958.000 55276.000 - -0.06% -
649.fotonik3d_s -1.06% 295938.000 292813.000 - 2.04% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
621.wrf_s -26.06% 9272.000 6856.000 - -3.67% -
600.perlbench_s -5.38% 2080.000 1968.000 - -0.61% -
641.leela_s -4.53% 4176.000 3987.000 - -0.37% -
511.povray_r -4.46% 404.000 386.000 - -0.52% -
628.pop2_s -3.77% 10608.000 10208.000 - -0.41% -
623.xalancbmk_s -3.31% 3259.000 3151.000 - -3.37% -
605.mcf_s -3.12% 6721.000 6511.000 - -1.08% -
602.gcc_s -2.68% 4182.000 4070.000 - -2.07% -
607.cactuBSSN_s -2.28% 4835.000 4725.000 - -3.41% -
620.omnetpp_s -1.96% 4088.000 4008.000 - -1.11% -
603.bwaves_s -1.79% 9063.000 8901.000 - -4.62% -
649.fotonik3d_s -1.53% 9793.000 9643.000 - -2.86% -
631.deepsjeng_s -1.52% 3479.000 3426.000 - -1.41% -
644.nab_s -1.26% 10486.000 10354.000 - -1.51% -
657.xz_s -1.09% 2211.000 2187.000 - -1.22% -

Added Tests - Execution
627.cam4_s

Added Tests - sample variability
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
600.perlbench_s
600.perlbench_s (avg)
600.perlbench_s (avg) (percentage)
600.perlbench_s (max)
600.perlbench_s (max) (percentage)
603.bwaves_s
603.bwaves_s (avg)
603.bwaves_s (avg) (percentage)
603.bwaves_s (max)
603.bwaves_s (max) (percentage)
605.mcf_s
605.mcf_s (avg)
605.mcf_s (avg) (percentage)
605.mcf_s (max)
605.mcf_s (max) (percentage)
607.cactuBSSN_s
607.cactuBSSN_s (avg)
607.cactuBSSN_s (avg) (percentage)
607.cactuBSSN_s (max)
607.cactuBSSN_s (max) (percentage)
619.lbm_s
619.lbm_s (avg)
619.lbm_s (avg) (percentage)
619.lbm_s (max)
619.lbm_s (max) (percentage)
620.omnetpp_s
620.omnetpp_s (avg)
620.omnetpp_s (avg) (percentage)
620.omnetpp_s (max)
620.omnetpp_s (max) (percentage)
623.xalancbmk_s
623.xalancbmk_s (avg)
623.xalancbmk_s (avg) (percentage)
623.xalancbmk_s (max)
623.xalancbmk_s (max) (percentage)
625.x264_s
625.x264_s (avg)
625.x264_s (avg) (percentage)
625.x264_s (max)
625.x264_s (max) (percentage)
628.pop2_s
628.pop2_s (avg)
628.pop2_s (avg) (percentage)
628.pop2_s (max)
628.pop2_s (max) (percentage)
631.deepsjeng_s
631.deepsjeng_s (avg)
631.deepsjeng_s (avg) (percentage)
631.deepsjeng_s (max)
631.deepsjeng_s (max) (percentage)
638.imagick_s
638.imagick_s (avg)
638.imagick_s (avg) (percentage)
638.imagick_s (max)
638.imagick_s (max) (percentage)
641.leela_s
641.leela_s (avg)
641.leela_s (avg) (percentage)
641.leela_s (max)
641.leela_s (max) (percentage)
644.nab_s
644.nab_s (avg)
644.nab_s (avg) (percentage)
644.nab_s (max)
644.nab_s (max) (percentage)
648.exchange2_s
648.exchange2_s (avg)
648.exchange2_s (avg) (percentage)
648.exchange2_s (max)
648.exchange2_s (max) (percentage)
649.fotonik3d_s
649.fotonik3d_s (avg)
649.fotonik3d_s (avg) (percentage)
649.fotonik3d_s (max)
649.fotonik3d_s (max) (percentage)
654.roms_s
654.roms_s (avg)
654.roms_s (avg) (percentage)
654.roms_s (max)
654.roms_s (max) (percentage)
657.xz_s
657.xz_s (avg)
657.xz_s (avg) (percentage)
657.xz_s (max)
657.xz_s (max) (percentage)


Report Time: 0.35s
Name Current %
508.namd_r 2495.000 -
510.parest_r 5736.000 -1.39%
511.povray_r 386.000 -
526.blender_r 10059.000 -
600.perlbench_s 1968.000 -
602.gcc_s 4070.000 -2.07%
603.bwaves_s 8901.000 -4.62%
605.mcf_s 6511.000 -1.08%
607.cactuBSSN_s 4725.000 -3.41%
619.lbm_s 28949.000 -5.05%
620.omnetpp_s 4008.000 -1.11%
621.wrf_s 6856.000 -3.67%
623.xalancbmk_s 3151.000 -3.37%
625.x264_s 2493.000 -1.11%
627.cam4_s 145.000 7.41%
628.pop2_s 10208.000 -
631.deepsjeng_s 3426.000 -1.41%
638.imagick_s 3325.000 -1.57%
641.leela_s 3987.000 -
644.nab_s 10354.000 -1.51%
648.exchange2_s 2333.000 -
649.fotonik3d_s 9643.000 -2.86%
654.roms_s 27391.000 -2.29%
657.xz_s 2187.000 -1.22%
Geometric Mean 4158.292 -1.39%
Name Current %
508.namd_r 630947.000 -
510.parest_r 1487779.000 -
511.povray_r 840669.000 -
526.blender_r 9373676.000 -
600.perlbench_s 2196147.000 -
602.gcc_s 8892242.000 -
603.bwaves_s 47999.000 -
605.mcf_s 16525.000 -
607.cactuBSSN_s 2823314.000 -
619.lbm_s 12861.000 -
620.omnetpp_s 1687645.000 -
621.wrf_s 13979830.000 -
623.xalancbmk_s 3446986.000 -
625.x264_s 439498.000 -
628.pop2_s 2930392.000 -
631.deepsjeng_s 70348.000 -
638.imagick_s 1295182.000 -
641.leela_s 80991.000 -
644.nab_s 91174.000 -
648.exchange2_s 55276.000 -
649.fotonik3d_s 292813.000 2.04%
654.roms_s 511981.000 1.35%
657.xz_s 139153.000 -
Geometric Mean 523182.059 -
Name Current %
508.namd_r 19.000 -5.00%
508.namd_r (avg) 19.000 -5.00%
508.namd_r (avg) (percentage) 0.800 -
508.namd_r (max) 38.000 -5.00%
508.namd_r (max) (percentage) 1.550 -3.13%
510.parest_r 73.000 -1.35%
510.parest_r (avg) 73.000 -1.35%
510.parest_r (avg) (percentage) 1.280 -
510.parest_r (max) 131.000 -5.07%
510.parest_r (max) (percentage) 2.300 -3.36%
511.povray_r 3.000 -
511.povray_r (avg) 3.000 -
511.povray_r (avg) (percentage) 0.930 -
511.povray_r (max) 4.000 -20.00%
511.povray_r (max) (percentage) 1.230 -8.89%
526.blender_r 70.000 -
526.blender_r (avg) 70.000 -
526.blender_r (avg) (percentage) 0.700 -
526.blender_r (max) 60.000 -
526.blender_r (max) (percentage) 0.600 -
600.perlbench_s 31.000 -
600.perlbench_s (avg) 31.000 -
600.perlbench_s (avg) (percentage) 1.580 -
600.perlbench_s (max) 50.000 -3.85%
600.perlbench_s (max) (percentage) 2.570 -3.38%
603.bwaves_s 186.000 -4.62%
603.bwaves_s (avg) 186.000 -4.62%
603.bwaves_s (avg) (percentage) 2.090 -
603.bwaves_s (max) 283.000 -9.87%
603.bwaves_s (max) (percentage) 3.190 -5.34%
605.mcf_s 77.000 -1.28%
605.mcf_s (avg) 77.000 -1.28%
605.mcf_s (avg) (percentage) 1.190 -
605.mcf_s (max) 146.000 -6.41%
605.mcf_s (max) (percentage) 2.250 -5.46%
607.cactuBSSN_s 135.000 -3.57%
607.cactuBSSN_s (avg) 135.000 -3.57%
607.cactuBSSN_s (avg) (percentage) 2.870 -
607.cactuBSSN_s (max) 198.000 -7.04%
607.cactuBSSN_s (max) (percentage) 4.200 -3.89%
619.lbm_s 2081.000 -5.32%
619.lbm_s (avg) 2081.000 -5.32%
619.lbm_s (avg) (percentage) 7.190 -
619.lbm_s (max) 2645.000 -48.05%
619.lbm_s (max) (percentage) 9.140 -45.27%
619.lbm_s (unexplained diff vs previous) 1539.000 3.85%
619.lbm_s (unexplained diff vs previous) (percentage) 5.320 9.47%
620.omnetpp_s 69.000 -1.43%
620.omnetpp_s (avg) 69.000 -1.43%
620.omnetpp_s (avg) (percentage) 1.730 -
620.omnetpp_s (max) 48.000 -7.69%
620.omnetpp_s (max) (percentage) 1.220 -6.15%
623.xalancbmk_s 26.000 -3.70%
623.xalancbmk_s (avg) 26.000 -3.70%
623.xalancbmk_s (avg) (percentage) 0.850 -
623.xalancbmk_s (max) 40.000 -6.98%
623.xalancbmk_s (max) (percentage) 1.290 -3.73%
625.x264_s 25.000 -3.85%
625.x264_s (avg) 25.000 -3.85%
625.x264_s (avg) (percentage) 1.040 -
625.x264_s (max) 41.000 -6.82%
625.x264_s (max) (percentage) 1.670 -5.65%
628.pop2_s 120.000 -
628.pop2_s (avg) 120.000 -
628.pop2_s (avg) (percentage) 1.180 -
628.pop2_s (max) 128.000 -4.48%
628.pop2_s (max) (percentage) 1.260 -3.82%
631.deepsjeng_s 32.000 -3.03%
631.deepsjeng_s (avg) 32.000 -3.03%
631.deepsjeng_s (avg) (percentage) 0.950 -
631.deepsjeng_s (max) 64.000 -7.25%
631.deepsjeng_s (max) (percentage) 1.880 -6.00%
638.imagick_s 36.000 -2.70%
638.imagick_s (avg) 36.000 -2.70%
638.imagick_s (avg) (percentage) 1.110 -
638.imagick_s (max) 56.000 -8.20%
638.imagick_s (max) (percentage) 1.710 -5.52%
641.leela_s 23.000 -
641.leela_s (avg) 23.000 -
641.leela_s (avg) (percentage) 0.590 -
641.leela_s (max) 34.000 -5.56%
641.leela_s (max) (percentage) 0.870 -5.43%
644.nab_s 62.000 -1.59%
644.nab_s (avg) 62.000 -1.59%
644.nab_s (avg) (percentage) 0.600 -
644.nab_s (max) 53.000 -1.85%
644.nab_s (max) (percentage) 0.520 -
648.exchange2_s 11.000 -
648.exchange2_s (avg) 11.000 -
648.exchange2_s (avg) (percentage) 0.510 -
648.exchange2_s (max) 3.000 -
648.exchange2_s (max) (percentage) 0.160 -5.88%
649.fotonik3d_s 174.000 -2.79%
649.fotonik3d_s (avg) 174.000 -2.79%
649.fotonik3d_s (avg) (percentage) 1.810 -
649.fotonik3d_s (max) 291.000 -8.20%
649.fotonik3d_s (max) (percentage) 3.020 -5.63%
654.roms_s 901.000 -2.28%
654.roms_s (avg) 901.000 -2.28%
654.roms_s (avg) (percentage) 3.290 -
654.roms_s (max) 2391.000 -7.36%
654.roms_s (max) (percentage) 8.730 -5.21%
657.xz_s 31.000 -
657.xz_s (avg) 31.000 -
657.xz_s (avg) (percentage) 1.440 -
657.xz_s (max) 56.000 -6.67%
657.xz_s (max) (percentage) 2.570 -6.20%
Geometric Mean 14.912 -3.94%