Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=57eea4cd0dd2e2cc4fb81738ba6a310dd31b6789 (unchanged)
git_gcc https://gcc.gnu.org/git/gcc.git (8335fd561fa823d32556512c09dfce44463e8eaa) (+ 49 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=f176bf2a06b458dea8186fb2ff3bb8ea24da6d67 (unchanged)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/392c8e00cced35ed6f84559b2c12cc07fae012e3 (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-cpu2017fast--gnu-aarch64-master-Os_LTO-build/375/
Filter

gnu-aarch64-master-Os_LTO test results

Run Order Start Time Duration
Current 0375 (basepoints/gcc-16-00448-g8335fd561fa) 2025-05-02T17:54:42 0:00:00
Previous 0372 (3-changed-components) 2025-04-22T14:42:02 0:00:00
Baseline 0105 (4-changed-components) 2023-10-18T06:40:59 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 9 4
Performance Improvements 85 18
Added Tests 0 106
Unchanged Tests 824 790
Total Tests 918

Performance Regressions - Code Size Δ Previous Current σ Δ (B) σ (B)
649.fotonik3d_s 3.34% 241460.000 249528.000 - 0.46% -
607.cactuBSSN_s 2.95% 2158437.000 2222181.000 - 2.13% -

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
648.exchange2_s 4.51% 3147.000 3289.000 - -4.45% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
526.blender_r (unexplained diff vs previous) (percentage) 1233.33% 0.030 0.400 - 0.00% -
526.blender_r (unexplained diff vs previous) 1175.00% 4.000 51.000 - 0.00% -
648.exchange2_s 7.69% 13.000 14.000 - 0.00% -
648.exchange2_s (avg) 7.69% 13.000 14.000 - 0.00% -
623.xalancbmk_s 2.38% 42.000 43.000 - 0.00% -
623.xalancbmk_s (avg) 2.38% 42.000 43.000 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
654.roms_s -6.92% 35515.000 33058.000 - -2.46% -
619.lbm_s -5.50% 31796.000 30047.000 - -1.34% -
600.perlbench_s -2.30% 2261.000 2209.000 - -0.94% -
603.bwaves_s -1.37% 9567.000 9436.000 - -9.58% -
649.fotonik3d_s -1.32% 11411.000 11260.000 - 9.97% -
607.cactuBSSN_s -1.29% 5190.000 5123.000 - 0.89% -
602.gcc_s -1.02% 5076.000 5024.000 - -1.20% -
621.wrf_s -1.02% 12306.000 12180.000 - -2.78% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
620.omnetpp_s (unexplained diff vs previous) (percentage) -92.74% 4.410 0.320 - 0.00% -
620.omnetpp_s (unexplained diff vs previous) -92.67% 191.000 14.000 - 0.00% -
619.lbm_s (unexplained diff vs previous) -66.65% 5245.000 1749.000 - 0.00% -
619.lbm_s (unexplained diff vs previous) (percentage) -64.73% 16.500 5.820 - 0.00% -
605.mcf_s (unexplained diff vs previous) -61.79% 123.000 47.000 - 0.00% -
605.mcf_s (unexplained diff vs previous) (percentage) -61.63% 1.720 0.660 - 0.00% -
644.nab_s (unexplained diff vs previous) -38.16% 76.000 47.000 - 0.00% -
644.nab_s (unexplained diff vs previous) (percentage) -37.70% 0.610 0.380 - 0.00% -
603.bwaves_s (unexplained diff vs previous) -28.42% 183.000 131.000 - 0.00% -
603.bwaves_s (unexplained diff vs previous) (percentage) -27.23% 1.910 1.390 - 0.00% -
644.nab_s (max) (percentage) -19.81% 1.060 0.850 - 0.00% -
644.nab_s (max) -19.70% 132.000 106.000 - 0.00% -
619.lbm_s (max) -13.37% 4502.000 3900.000 - 0.00% -
603.bwaves_s (max) -12.50% 384.000 336.000 - 0.00% -
603.bwaves_s (max) (percentage) -11.19% 4.020 3.570 - 0.00% -
605.mcf_s (max) -10.83% 120.000 107.000 - 0.00% -
605.mcf_s (max) (percentage) -10.06% 1.690 1.520 - 0.00% -
654.roms_s (max) -9.35% 1626.000 1474.000 - 0.00% -
510.parest_r (max) -8.62% 58.000 53.000 - 0.00% -
619.lbm_s (max) (percentage) -8.33% 14.160 12.980 - 0.00% -
620.omnetpp_s (max) (percentage) -8.29% 4.220 3.870 - 0.00% -
620.omnetpp_s (max) -8.24% 182.000 167.000 - 0.00% -
510.parest_r (max) (percentage) -7.95% 0.880 0.810 - 0.00% -
607.cactuBSSN_s (max) -7.64% 288.000 266.000 - 0.00% -
654.roms_s -6.94% 1225.000 1140.000 - 0.00% -
654.roms_s (avg) -6.94% 1225.000 1140.000 - 0.00% -
625.x264_s (max) -6.82% 44.000 41.000 - 0.00% -
657.xz_s (max) -6.74% 89.000 83.000 - 0.00% -
607.cactuBSSN_s (max) (percentage) -6.31% 5.550 5.200 - 0.00% -
619.lbm_s -6.28% 3170.000 2971.000 - 0.00% -
619.lbm_s (avg) -6.28% 3170.000 2971.000 - 0.00% -
600.perlbench_s (max) -5.88% 34.000 32.000 - 0.00% -
508.namd_r (max) (percentage) -5.69% 1.230 1.160 - 0.00% -
526.blender_r (max) -5.65% 124.000 117.000 - 0.00% -
638.imagick_s (max) -5.62% 89.000 84.000 - 0.00% -
648.exchange2_s (max) (percentage) -5.61% 1.070 1.010 - 0.00% -
657.xz_s (max) (percentage) -5.56% 3.600 3.400 - 0.00% -
638.imagick_s (max) (percentage) -5.33% 1.500 1.420 - 0.00% -
625.x264_s (max) (percentage) -5.31% 1.130 1.070 - 0.00% -
526.blender_r (max) (percentage) -5.15% 0.970 0.920 - 0.00% -
508.namd_r (max) -4.76% 42.000 40.000 - 0.00% -
649.fotonik3d_s (max) -3.54% 367.000 354.000 - 0.00% -
511.povray_r (max) (percentage) -3.13% 0.640 0.620 - 0.00% -
600.perlbench_s -2.86% 35.000 34.000 - 0.00% -
600.perlbench_s (avg) -2.86% 35.000 34.000 - 0.00% -
526.blender_r -2.70% 74.000 72.000 - 0.00% -
526.blender_r (avg) -2.70% 74.000 72.000 - 0.00% -
603.bwaves_s -2.63% 304.000 296.000 - 0.00% -
603.bwaves_s (avg) -2.63% 304.000 296.000 - 0.00% -
654.roms_s (max) (percentage) -2.62% 4.580 4.460 - 0.00% -
623.xalancbmk_s (max) (percentage) -2.59% 1.160 1.130 - 0.00% -
631.deepsjeng_s (max) -2.44% 41.000 40.000 - 0.00% -
641.leela_s (max) (percentage) -2.34% 1.280 1.250 - 0.00% -
649.fotonik3d_s (max) (percentage) -2.17% 3.220 3.150 - 0.00% -
628.pop2_s (max) -2.10% 143.000 140.000 - 0.00% -
620.omnetpp_s -2.08% 96.000 94.000 - 0.00% -
620.omnetpp_s (avg) -2.08% 96.000 94.000 - 0.00% -
657.xz_s -2.08% 48.000 47.000 - 0.00% -
657.xz_s (avg) -2.08% 48.000 47.000 - 0.00% -
631.deepsjeng_s (max) (percentage) -2.02% 0.990 0.970 - 0.00% -
605.mcf_s -1.96% 102.000 100.000 - 0.00% -
605.mcf_s (avg) -1.96% 102.000 100.000 - 0.00% -
623.xalancbmk_s (max) -1.82% 55.000 54.000 - 0.00% -
641.leela_s (max) -1.75% 57.000 56.000 - 0.00% -
526.blender_r (avg) (percentage) -1.72% 0.580 0.570 - 0.00% -
644.nab_s (avg) (percentage) -1.61% 0.620 0.610 - 0.00% -
605.mcf_s (avg) (percentage) -1.40% 1.430 1.410 - 0.00% -
620.omnetpp_s (avg) (percentage) -1.35% 2.220 2.190 - 0.00% -
600.perlbench_s (max) (percentage) -1.32% 1.510 1.490 - 0.00% -
649.fotonik3d_s -1.32% 302.000 298.000 - 0.00% -
649.fotonik3d_s (avg) -1.32% 302.000 298.000 - 0.00% -
607.cactuBSSN_s -1.31% 153.000 151.000 - 0.00% -
607.cactuBSSN_s (avg) -1.31% 153.000 151.000 - 0.00% -
644.nab_s -1.30% 77.000 76.000 - 0.00% -
644.nab_s (avg) -1.30% 77.000 76.000 - 0.00% -
603.bwaves_s (avg) (percentage) -1.26% 3.180 3.140 - 0.00% -
628.pop2_s (max) (percentage) -1.02% 0.980 0.970 - 0.00% -

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
607.cactuBSSN_s 2.13% 2175790.000 2222181.000 - 2.95% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
649.fotonik3d_s 9.97% 10239.000 11260.000 - -1.32% -
628.pop2_s 2.63% 14154.000 14526.000 - -0.45% -
623.xalancbmk_s 1.14% 4727.000 4781.000 - 0.82% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
641.leela_s -2.82% 60068.000 58372.000 - -0.03% -
508.namd_r -2.81% 435429.000 423190.000 - 0.09% -
620.omnetpp_s -1.82% 1300292.000 1276662.000 - 0.31% -
603.bwaves_s -1.62% 44462.000 43742.000 - 0.00% -
510.parest_r -1.46% 1117848.000 1101507.000 - -0.01% -
644.nab_s -1.45% 76740.000 75628.000 - 0.00% -
602.gcc_s -1.33% 6596319.000 6508303.000 - -0.07% -
631.deepsjeng_s -1.18% 57255.000 56579.000 - -0.11% -
526.blender_r -1.14% 7168335.000 7086781.000 - -0.02% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
603.bwaves_s -9.58% 10436.000 9436.000 - -1.37% -
648.exchange2_s -4.45% 3442.000 3289.000 - 4.51% -
621.wrf_s -2.78% 12528.000 12180.000 - -1.02% -
654.roms_s -2.46% 33893.000 33058.000 - -6.92% -
620.omnetpp_s -1.95% 4402.000 4316.000 - -0.32% -
526.blender_r -1.65% 12996.000 12781.000 - -0.40% -
619.lbm_s -1.34% 30454.000 30047.000 - -5.50% -
602.gcc_s -1.20% 5085.000 5024.000 - -1.02% -
605.mcf_s -1.05% 7175.000 7100.000 - -0.66% -

Added Tests - Execution
627.cam4_s

Added Tests - sample variability
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
600.perlbench_s
600.perlbench_s (avg)
600.perlbench_s (avg) (percentage)
600.perlbench_s (max)
600.perlbench_s (max) (percentage)
603.bwaves_s
603.bwaves_s (avg)
603.bwaves_s (avg) (percentage)
603.bwaves_s (max)
603.bwaves_s (max) (percentage)
605.mcf_s
605.mcf_s (avg)
605.mcf_s (avg) (percentage)
605.mcf_s (max)
605.mcf_s (max) (percentage)
607.cactuBSSN_s
607.cactuBSSN_s (avg)
607.cactuBSSN_s (avg) (percentage)
607.cactuBSSN_s (max)
607.cactuBSSN_s (max) (percentage)
619.lbm_s
619.lbm_s (avg)
619.lbm_s (avg) (percentage)
619.lbm_s (max)
619.lbm_s (max) (percentage)
620.omnetpp_s
620.omnetpp_s (avg)
620.omnetpp_s (avg) (percentage)
620.omnetpp_s (max)
620.omnetpp_s (max) (percentage)
623.xalancbmk_s
623.xalancbmk_s (avg)
623.xalancbmk_s (avg) (percentage)
623.xalancbmk_s (max)
623.xalancbmk_s (max) (percentage)
625.x264_s
625.x264_s (avg)
625.x264_s (avg) (percentage)
625.x264_s (max)
625.x264_s (max) (percentage)
628.pop2_s
628.pop2_s (avg)
628.pop2_s (avg) (percentage)
628.pop2_s (max)
628.pop2_s (max) (percentage)
631.deepsjeng_s
631.deepsjeng_s (avg)
631.deepsjeng_s (avg) (percentage)
631.deepsjeng_s (max)
631.deepsjeng_s (max) (percentage)
638.imagick_s
638.imagick_s (avg)
638.imagick_s (avg) (percentage)
638.imagick_s (max)
638.imagick_s (max) (percentage)
641.leela_s
641.leela_s (avg)
641.leela_s (avg) (percentage)
641.leela_s (max)
641.leela_s (max) (percentage)
644.nab_s
644.nab_s (avg)
644.nab_s (avg) (percentage)
644.nab_s (max)
644.nab_s (max) (percentage)
648.exchange2_s
648.exchange2_s (avg)
648.exchange2_s (avg) (percentage)
648.exchange2_s (max)
648.exchange2_s (max) (percentage)
649.fotonik3d_s
649.fotonik3d_s (avg)
649.fotonik3d_s (avg) (percentage)
649.fotonik3d_s (max)
649.fotonik3d_s (max) (percentage)
654.roms_s
654.roms_s (avg)
654.roms_s (avg) (percentage)
654.roms_s (max)
654.roms_s (max) (percentage)
657.xz_s
657.xz_s (avg)
657.xz_s (avg) (percentage)
657.xz_s (max)
657.xz_s (max) (percentage)


Report Time: 0.35s
Name Current %
508.namd_r 3460.000 -
510.parest_r 6630.000 -
511.povray_r 526.000 -
526.blender_r 12781.000 -
600.perlbench_s 2209.000 -2.30%
602.gcc_s 5024.000 -1.02%
603.bwaves_s 9436.000 -1.37%
605.mcf_s 7100.000 -
607.cactuBSSN_s 5123.000 -1.29%
619.lbm_s 30047.000 -5.50%
620.omnetpp_s 4316.000 -
621.wrf_s 12180.000 -1.02%
623.xalancbmk_s 4781.000 -
625.x264_s 3914.000 -
627.cam4_s 191.000 -
628.pop2_s 14526.000 -
631.deepsjeng_s 4190.000 -
638.imagick_s 5945.000 -
641.leela_s 4482.000 -
644.nab_s 12487.000 -
648.exchange2_s 3289.000 4.51%
649.fotonik3d_s 11260.000 -1.32%
654.roms_s 33058.000 -6.92%
657.xz_s 2468.000 -
Geometric Mean 5261.851 -
Name Current %
508.namd_r 423190.000 -
510.parest_r 1101507.000 -
511.povray_r 652529.000 -
526.blender_r 7086781.000 -
600.perlbench_s 1700865.000 -
602.gcc_s 6508303.000 -
603.bwaves_s 43742.000 -
605.mcf_s 13726.000 -
607.cactuBSSN_s 2222181.000 2.95%
619.lbm_s 11924.000 -
620.omnetpp_s 1276662.000 -
621.wrf_s 9435696.000 -
623.xalancbmk_s 2537257.000 -
625.x264_s 345879.000 -
628.pop2_s 2535706.000 -
631.deepsjeng_s 56579.000 -
638.imagick_s 958109.000 -
641.leela_s 58372.000 -
644.nab_s 75628.000 -
648.exchange2_s 52105.000 -
649.fotonik3d_s 249528.000 3.34%
654.roms_s 438617.000 -
657.xz_s 103134.000 -
Geometric Mean 412552.988 -
Name Current %
508.namd_r 26.000 -
508.namd_r (avg) 26.000 -
508.namd_r (avg) (percentage) 0.770 -
508.namd_r (max) 40.000 -4.76%
508.namd_r (max) (percentage) 1.160 -5.69%
510.parest_r 85.000 -
510.parest_r (avg) 85.000 -
510.parest_r (avg) (percentage) 1.290 -
510.parest_r (max) 53.000 -8.62%
510.parest_r (max) (percentage) 0.810 -7.95%
511.povray_r 4.000 -
511.povray_r (avg) 4.000 -
511.povray_r (avg) (percentage) 0.780 -
511.povray_r (max) 3.000 -
511.povray_r (max) (percentage) 0.620 -3.13%
526.blender_r 72.000 -2.70%
526.blender_r (avg) 72.000 -2.70%
526.blender_r (avg) (percentage) 0.570 -1.72%
526.blender_r (max) 117.000 -5.65%
526.blender_r (max) (percentage) 0.920 -5.15%
526.blender_r (unexplained diff vs previous) 51.000 1175.00%
526.blender_r (unexplained diff vs previous) (percentage) 0.400 1233.33%
600.perlbench_s 34.000 -2.86%
600.perlbench_s (avg) 34.000 -2.86%
600.perlbench_s (avg) (percentage) 1.560 -
600.perlbench_s (max) 32.000 -5.88%
600.perlbench_s (max) (percentage) 1.490 -1.32%
603.bwaves_s 296.000 -2.63%
603.bwaves_s (avg) 296.000 -2.63%
603.bwaves_s (avg) (percentage) 3.140 -1.26%
603.bwaves_s (max) 336.000 -12.50%
603.bwaves_s (max) (percentage) 3.570 -11.19%
603.bwaves_s (unexplained diff vs previous) 131.000 -28.42%
603.bwaves_s (unexplained diff vs previous) (percentage) 1.390 -27.23%
605.mcf_s 100.000 -1.96%
605.mcf_s (avg) 100.000 -1.96%
605.mcf_s (avg) (percentage) 1.410 -1.40%
605.mcf_s (max) 107.000 -10.83%
605.mcf_s (max) (percentage) 1.520 -10.06%
605.mcf_s (unexplained diff vs previous) 47.000 -61.79%
605.mcf_s (unexplained diff vs previous) (percentage) 0.660 -61.63%
607.cactuBSSN_s 151.000 -1.31%
607.cactuBSSN_s (avg) 151.000 -1.31%
607.cactuBSSN_s (avg) (percentage) 2.950 -
607.cactuBSSN_s (max) 266.000 -7.64%
607.cactuBSSN_s (max) (percentage) 5.200 -6.31%
619.lbm_s 2971.000 -6.28%
619.lbm_s (avg) 2971.000 -6.28%
619.lbm_s (avg) (percentage) 9.890 -
619.lbm_s (max) 3900.000 -13.37%
619.lbm_s (max) (percentage) 12.980 -8.33%
619.lbm_s (unexplained diff vs previous) 1749.000 -66.65%
619.lbm_s (unexplained diff vs previous) (percentage) 5.820 -64.73%
620.omnetpp_s 94.000 -2.08%
620.omnetpp_s (avg) 94.000 -2.08%
620.omnetpp_s (avg) (percentage) 2.190 -1.35%
620.omnetpp_s (max) 167.000 -8.24%
620.omnetpp_s (max) (percentage) 3.870 -8.29%
620.omnetpp_s (unexplained diff vs previous) 14.000 -92.67%
620.omnetpp_s (unexplained diff vs previous) (percentage) 0.320 -92.74%
623.xalancbmk_s 43.000 2.38%
623.xalancbmk_s (avg) 43.000 2.38%
623.xalancbmk_s (avg) (percentage) 0.900 -
623.xalancbmk_s (max) 54.000 -1.82%
623.xalancbmk_s (max) (percentage) 1.130 -2.59%
625.x264_s 31.000 -
625.x264_s (avg) 31.000 -
625.x264_s (avg) (percentage) 0.810 -
625.x264_s (max) 41.000 -6.82%
625.x264_s (max) (percentage) 1.070 -5.31%
628.pop2_s 140.000 -
628.pop2_s (avg) 140.000 -
628.pop2_s (avg) (percentage) 0.970 -
628.pop2_s (max) 140.000 -2.10%
628.pop2_s (max) (percentage) 0.970 -1.02%
631.deepsjeng_s 42.000 -
631.deepsjeng_s (avg) 42.000 -
631.deepsjeng_s (avg) (percentage) 1.010 -
631.deepsjeng_s (max) 40.000 -2.44%
631.deepsjeng_s (max) (percentage) 0.970 -2.02%
638.imagick_s 64.000 -
638.imagick_s (avg) 64.000 -
638.imagick_s (avg) (percentage) 1.080 -
638.imagick_s (max) 84.000 -5.62%
638.imagick_s (max) (percentage) 1.420 -5.33%
641.leela_s 28.000 -
641.leela_s (avg) 28.000 -
641.leela_s (avg) (percentage) 0.630 -
641.leela_s (max) 56.000 -1.75%
641.leela_s (max) (percentage) 1.250 -2.34%
644.nab_s 76.000 -1.30%
644.nab_s (avg) 76.000 -1.30%
644.nab_s (avg) (percentage) 0.610 -1.61%
644.nab_s (max) 106.000 -19.70%
644.nab_s (max) (percentage) 0.850 -19.81%
644.nab_s (unexplained diff vs previous) 47.000 -38.16%
644.nab_s (unexplained diff vs previous) (percentage) 0.380 -37.70%
648.exchange2_s 14.000 7.69%
648.exchange2_s (avg) 14.000 7.69%
648.exchange2_s (avg) (percentage) 0.440 -
648.exchange2_s (max) 33.000 -
648.exchange2_s (max) (percentage) 1.010 -5.61%
649.fotonik3d_s 298.000 -1.32%
649.fotonik3d_s (avg) 298.000 -1.32%
649.fotonik3d_s (avg) (percentage) 2.650 -
649.fotonik3d_s (max) 354.000 -3.54%
649.fotonik3d_s (max) (percentage) 3.150 -2.17%
654.roms_s 1140.000 -6.94%
654.roms_s (avg) 1140.000 -6.94%
654.roms_s (avg) (percentage) 3.450 -
654.roms_s (max) 1474.000 -9.35%
654.roms_s (max) (percentage) 4.460 -2.62%
657.xz_s 47.000 -2.08%
657.xz_s (avg) 47.000 -2.08%
657.xz_s (avg) (percentage) 1.930 -
657.xz_s (max) 83.000 -6.74%
657.xz_s (max) (percentage) 3.400 -5.56%
Geometric Mean 15.828 -7.43%