Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=c9524271db0fca0a6f156e7e996584dd4e185b26 (unchanged)
git_gcc https://gcc.gnu.org/git/gcc.git (85e4f21f9e90fc70b8c7c75ec8e4d0766008ac6e) (+ 199 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=3270c50e4853d9356eb5892364c52cd1558860ec (unchanged)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/d2cb798d2d8ceb0d194721a2cb0e577b4b927573 (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-cpu2017fast--gnu-aarch64-master-O2_LTO-build/404/
Filter

gnu-aarch64-master-O2_LTO test results

Run Order Start Time Duration
Current 0404 (basepoints/gcc-16-00302-g85e4f21f9e9) 2025-04-30T06:58:41 0:00:00
Previous 0402 (3-changed-components) 2025-04-24T11:14:57 0:00:00
Baseline 0001 (4-changed-components) 2023-03-24T00:16:56 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 13 23
Performance Improvements 79 11
Added Tests 0 106
Unchanged Tests 826 778
Total Tests 918

Performance Regressions - Code Size Δ Previous Current σ Δ (B) σ (B)
508.namd_r 2.15% 633917.000 647517.000 - 5.59% -
649.fotonik3d_s 1.08% 287397.000 290496.000 - -1.84% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
644.nab_s (unexplained diff vs previous) (percentage) 552.00% 0.250 1.630 - 0.00% -
644.nab_s (unexplained diff vs previous) 532.14% 28.000 177.000 - 0.00% -
644.nab_s (max) (percentage) 122.22% 0.720 1.600 - 0.00% -
644.nab_s (max) 120.25% 79.000 174.000 - 0.00% -
603.bwaves_s (unexplained diff vs previous) (percentage) 30.51% 2.720 3.550 - 0.00% -
603.bwaves_s (unexplained diff vs previous) 26.09% 253.000 319.000 - 0.00% -
619.lbm_s (unexplained diff vs previous) (percentage) 18.40% 16.360 19.370 - 0.00% -
603.bwaves_s (max) (percentage) 17.47% 2.920 3.430 - 0.00% -
603.bwaves_s (max) 13.65% 271.000 308.000 - 0.00% -
644.nab_s (avg) (percentage) 1.69% 0.590 0.600 - 0.00% -
619.lbm_s (avg) (percentage) 1.51% 7.280 7.390 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
619.lbm_s -16.23% 37237.000 31194.000 - 9.07% -
627.cam4_s -8.84% 147.000 134.000 - 0.00% -
621.wrf_s -4.29% 7347.000 7032.000 - -24.16% -
603.bwaves_s -3.43% 9301.000 8982.000 - -0.89% -
607.cactuBSSN_s -2.84% 5036.000 4893.000 - 1.20% -
602.gcc_s -2.30% 4180.000 4084.000 - -2.34% -
600.perlbench_s -2.24% 2009.000 1964.000 - -5.58% -
649.fotonik3d_s -2.06% 9972.000 9767.000 - -0.27% -
657.xz_s -2.01% 2390.000 2342.000 - 5.92% -
620.omnetpp_s -1.71% 4157.000 4086.000 - -0.05% -
644.nab_s -1.60% 11057.000 10880.000 - 3.76% -
510.parest_r -1.46% 5840.000 5755.000 - -0.17% -
648.exchange2_s -1.40% 2433.000 2399.000 - 8.01% -
654.roms_s -1.39% 29587.000 29177.000 - 7.11% -
605.mcf_s -1.12% 6939.000 6861.000 - 2.08% -
631.deepsjeng_s -1.12% 3584.000 3544.000 - 1.87% -
638.imagick_s -1.06% 5541.000 5482.000 - 64.43% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
620.omnetpp_s (unexplained diff vs previous) -36.04% 111.000 71.000 - 0.00% -
620.omnetpp_s (unexplained diff vs previous) (percentage) -34.83% 2.670 1.740 - 0.00% -
619.lbm_s (max) -30.50% 7283.000 5062.000 - 0.00% -
619.lbm_s (max) (percentage) -17.02% 19.560 16.230 - 0.00% -
619.lbm_s -14.94% 2710.000 2305.000 - 0.00% -
619.lbm_s (avg) -14.94% 2710.000 2305.000 - 0.00% -
620.omnetpp_s (max) -13.27% 113.000 98.000 - 0.00% -
620.omnetpp_s (max) (percentage) -12.41% 2.740 2.400 - 0.00% -
508.namd_r (max) -11.11% 36.000 32.000 - 0.00% -
625.x264_s (max) -11.11% 18.000 16.000 - 0.00% -
508.namd_r (max) (percentage) -8.80% 1.250 1.140 - 0.00% -
605.mcf_s (max) -8.21% 134.000 123.000 - 0.00% -
628.pop2_s (max) -7.81% 64.000 59.000 - 0.00% -
623.xalancbmk_s (max) -7.41% 27.000 25.000 - 0.00% -
605.mcf_s (max) (percentage) -7.22% 1.940 1.800 - 0.00% -
625.x264_s (max) (percentage) -7.04% 0.710 0.660 - 0.00% -
628.pop2_s (max) (percentage) -6.45% 0.620 0.580 - 0.00% -
657.xz_s (max) -5.56% 54.000 51.000 - 0.00% -
526.blender_r (max) -5.41% 111.000 105.000 - 0.00% -
600.perlbench_s (max) -5.41% 37.000 35.000 - 0.00% -
526.blender_r (max) (percentage) -4.76% 1.050 1.000 - 0.00% -
631.deepsjeng_s (max) -4.44% 45.000 43.000 - 0.00% -
649.fotonik3d_s (max) -4.44% 248.000 237.000 - 0.00% -
654.roms_s (max) -4.35% 2159.000 2065.000 - 0.00% -
511.povray_r (max) (percentage) -3.88% 1.290 1.240 - 0.00% -
623.xalancbmk_s -3.70% 27.000 26.000 - 0.00% -
623.xalancbmk_s (avg) -3.70% 27.000 26.000 - 0.00% -
623.xalancbmk_s (max) (percentage) -3.66% 0.820 0.790 - 0.00% -
600.perlbench_s -3.33% 30.000 29.000 - 0.00% -
600.perlbench_s (avg) -3.33% 30.000 29.000 - 0.00% -
510.parest_r (max) -3.19% 94.000 91.000 - 0.00% -
631.deepsjeng_s -3.12% 32.000 31.000 - 0.00% -
631.deepsjeng_s (avg) -3.12% 32.000 31.000 - 0.00% -
657.xz_s -3.12% 32.000 31.000 - 0.00% -
657.xz_s (avg) -3.12% 32.000 31.000 - 0.00% -
657.xz_s (max) (percentage) -3.08% 2.270 2.200 - 0.00% -
654.roms_s (max) (percentage) -3.01% 7.300 7.080 - 0.00% -
603.bwaves_s -3.00% 200.000 194.000 - 0.00% -
603.bwaves_s (avg) -3.00% 200.000 194.000 - 0.00% -
638.imagick_s (max) -2.90% 69.000 67.000 - 0.00% -
607.cactuBSSN_s -2.86% 140.000 136.000 - 0.00% -
607.cactuBSSN_s (avg) -2.86% 140.000 136.000 - 0.00% -
607.cactuBSSN_s (max) -2.61% 115.000 112.000 - 0.00% -
641.leela_s (max) (percentage) -2.48% 1.210 1.180 - 0.00% -
649.fotonik3d_s (max) (percentage) -2.41% 2.490 2.430 - 0.00% -
638.imagick_s (max) (percentage) -2.38% 1.260 1.230 - 0.00% -
600.perlbench_s (max) (percentage) -2.15% 1.860 1.820 - 0.00% -
641.leela_s (max) -1.96% 51.000 50.000 - 0.00% -
510.parest_r (max) (percentage) -1.85% 1.620 1.590 - 0.00% -
649.fotonik3d_s -1.80% 167.000 164.000 - 0.00% -
649.fotonik3d_s (avg) -1.80% 167.000 164.000 - 0.00% -
638.imagick_s -1.72% 58.000 57.000 - 0.00% -
638.imagick_s (avg) -1.72% 58.000 57.000 - 0.00% -
631.deepsjeng_s (max) (percentage) -1.59% 1.260 1.240 - 0.00% -
620.omnetpp_s -1.54% 65.000 64.000 - 0.00% -
620.omnetpp_s (avg) -1.54% 65.000 64.000 - 0.00% -
510.parest_r -1.45% 69.000 68.000 - 0.00% -
510.parest_r (avg) -1.45% 69.000 68.000 - 0.00% -
654.roms_s -1.42% 988.000 974.000 - 0.00% -
654.roms_s (avg) -1.42% 988.000 974.000 - 0.00% -
605.mcf_s -1.30% 77.000 76.000 - 0.00% -
605.mcf_s (avg) -1.30% 77.000 76.000 - 0.00% -

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
508.namd_r 5.59% 613265.000 647517.000 - 2.15% -
621.wrf_s 3.91% 13460511.000 13986598.000 - 0.10% -
510.parest_r 2.77% 1458341.000 1498756.000 - -0.50% -
657.xz_s 2.36% 135153.000 138349.000 - -0.05% -
600.perlbench_s 2.03% 2151136.000 2194763.000 - 0.28% -
628.pop2_s 1.50% 2872616.000 2915689.000 - 0.30% -
605.mcf_s 1.42% 16285.000 16517.000 - 0.00% -
607.cactuBSSN_s 1.33% 2773236.000 2810205.000 - 0.77% -
625.x264_s 1.22% 435471.000 440778.000 - 0.10% -
641.leela_s 1.08% 80027.000 80891.000 - 0.24% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
638.imagick_s 64.43% 3334.000 5482.000 - -1.06% -
508.namd_r 19.03% 2428.000 2890.000 - -0.69% -
619.lbm_s 9.07% 28600.000 31194.000 - -16.23% -
625.x264_s 8.86% 2359.000 2568.000 - -0.96% -
648.exchange2_s 8.01% 2221.000 2399.000 - -1.40% -
654.roms_s 7.11% 27239.000 29177.000 - -1.39% -
657.xz_s 5.92% 2211.000 2342.000 - -2.01% -
526.blender_r 5.49% 10028.000 10579.000 - -0.03% -
644.nab_s 3.76% 10486.000 10880.000 - -1.60% -
641.leela_s 2.44% 4176.000 4278.000 - 0.47% -
605.mcf_s 2.08% 6721.000 6861.000 - -1.12% -
631.deepsjeng_s 1.87% 3479.000 3544.000 - -1.12% -
607.cactuBSSN_s 1.20% 4835.000 4893.000 - -2.84% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
648.exchange2_s -10.55% 60958.000 54528.000 - 0.01% -
619.lbm_s -2.68% 12965.000 12617.000 - 0.00% -
638.imagick_s -1.99% 1298946.000 1273094.000 - -0.14% -
603.bwaves_s -1.90% 47699.000 46791.000 - 0.34% -
649.fotonik3d_s -1.84% 295938.000 290496.000 - 1.08% -
644.nab_s -1.40% 91858.000 90574.000 - -0.03% -
654.roms_s -1.09% 505598.000 500073.000 - -0.84% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
621.wrf_s -24.16% 9272.000 7032.000 - -4.29% -
600.perlbench_s -5.58% 2080.000 1964.000 - -2.24% -
628.pop2_s -3.02% 10608.000 10288.000 - -0.36% -
602.gcc_s -2.34% 4182.000 4084.000 - -2.30% -

Added Tests - Execution
627.cam4_s

Added Tests - sample variability
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
600.perlbench_s
600.perlbench_s (avg)
600.perlbench_s (avg) (percentage)
600.perlbench_s (max)
600.perlbench_s (max) (percentage)
603.bwaves_s
603.bwaves_s (avg)
603.bwaves_s (avg) (percentage)
603.bwaves_s (max)
603.bwaves_s (max) (percentage)
605.mcf_s
605.mcf_s (avg)
605.mcf_s (avg) (percentage)
605.mcf_s (max)
605.mcf_s (max) (percentage)
607.cactuBSSN_s
607.cactuBSSN_s (avg)
607.cactuBSSN_s (avg) (percentage)
607.cactuBSSN_s (max)
607.cactuBSSN_s (max) (percentage)
619.lbm_s
619.lbm_s (avg)
619.lbm_s (avg) (percentage)
619.lbm_s (max)
619.lbm_s (max) (percentage)
620.omnetpp_s
620.omnetpp_s (avg)
620.omnetpp_s (avg) (percentage)
620.omnetpp_s (max)
620.omnetpp_s (max) (percentage)
623.xalancbmk_s
623.xalancbmk_s (avg)
623.xalancbmk_s (avg) (percentage)
623.xalancbmk_s (max)
623.xalancbmk_s (max) (percentage)
625.x264_s
625.x264_s (avg)
625.x264_s (avg) (percentage)
625.x264_s (max)
625.x264_s (max) (percentage)
628.pop2_s
628.pop2_s (avg)
628.pop2_s (avg) (percentage)
628.pop2_s (max)
628.pop2_s (max) (percentage)
631.deepsjeng_s
631.deepsjeng_s (avg)
631.deepsjeng_s (avg) (percentage)
631.deepsjeng_s (max)
631.deepsjeng_s (max) (percentage)
638.imagick_s
638.imagick_s (avg)
638.imagick_s (avg) (percentage)
638.imagick_s (max)
638.imagick_s (max) (percentage)
641.leela_s
641.leela_s (avg)
641.leela_s (avg) (percentage)
641.leela_s (max)
641.leela_s (max) (percentage)
644.nab_s
644.nab_s (avg)
644.nab_s (avg) (percentage)
644.nab_s (max)
644.nab_s (max) (percentage)
648.exchange2_s
648.exchange2_s (avg)
648.exchange2_s (avg) (percentage)
648.exchange2_s (max)
648.exchange2_s (max) (percentage)
649.fotonik3d_s
649.fotonik3d_s (avg)
649.fotonik3d_s (avg) (percentage)
649.fotonik3d_s (max)
649.fotonik3d_s (max) (percentage)
654.roms_s
654.roms_s (avg)
654.roms_s (avg) (percentage)
654.roms_s (max)
654.roms_s (max) (percentage)
657.xz_s
657.xz_s (avg)
657.xz_s (avg) (percentage)
657.xz_s (max)
657.xz_s (max) (percentage)


Report Time: 0.36s
Name Current %
508.namd_r 2890.000 -
510.parest_r 5755.000 -1.46%
511.povray_r 405.000 -
526.blender_r 10579.000 -
600.perlbench_s 1964.000 -2.24%
602.gcc_s 4084.000 -2.30%
603.bwaves_s 8982.000 -3.43%
605.mcf_s 6861.000 -1.12%
607.cactuBSSN_s 4893.000 -2.84%
619.lbm_s 31194.000 -16.23%
620.omnetpp_s 4086.000 -1.71%
621.wrf_s 7032.000 -4.29%
623.xalancbmk_s 3278.000 -
625.x264_s 2568.000 -
627.cam4_s 134.000 -8.84%
628.pop2_s 10288.000 -
631.deepsjeng_s 3544.000 -1.12%
638.imagick_s 5482.000 -1.06%
641.leela_s 4278.000 -
644.nab_s 10880.000 -1.60%
648.exchange2_s 2399.000 -1.40%
649.fotonik3d_s 9767.000 -2.06%
654.roms_s 29177.000 -1.39%
657.xz_s 2342.000 -2.01%
Geometric Mean 4387.923 -2.47%
Name Current %
508.namd_r 647517.000 2.15%
510.parest_r 1498756.000 -
511.povray_r 837097.000 -
526.blender_r 9366049.000 -
600.perlbench_s 2194763.000 -
602.gcc_s 8885450.000 -
603.bwaves_s 46791.000 -
605.mcf_s 16517.000 -
607.cactuBSSN_s 2810205.000 -
619.lbm_s 12617.000 -
620.omnetpp_s 1682893.000 -
621.wrf_s 13986598.000 -
623.xalancbmk_s 3438318.000 -
625.x264_s 440778.000 -
628.pop2_s 2915689.000 -
631.deepsjeng_s 70404.000 -
638.imagick_s 1273094.000 -
641.leela_s 80891.000 -
644.nab_s 90574.000 -
648.exchange2_s 54528.000 -
649.fotonik3d_s 290496.000 1.08%
654.roms_s 500073.000 -
657.xz_s 138349.000 -
Geometric Mean 520797.029 -
Name Current %
508.namd_r 22.000 -
508.namd_r (avg) 22.000 -
508.namd_r (avg) (percentage) 0.780 -
508.namd_r (max) 32.000 -11.11%
508.namd_r (max) (percentage) 1.140 -8.80%
510.parest_r 68.000 -1.45%
510.parest_r (avg) 68.000 -1.45%
510.parest_r (avg) (percentage) 1.190 -
510.parest_r (max) 91.000 -3.19%
510.parest_r (max) (percentage) 1.590 -1.85%
511.povray_r 3.000 -
511.povray_r (avg) 3.000 -
511.povray_r (avg) (percentage) 0.980 -
511.povray_r (max) 5.000 -
511.povray_r (max) (percentage) 1.240 -3.88%
526.blender_r 75.000 -
526.blender_r (avg) 75.000 -
526.blender_r (avg) (percentage) 0.710 -
526.blender_r (max) 105.000 -5.41%
526.blender_r (max) (percentage) 1.000 -4.76%
600.perlbench_s 29.000 -3.33%
600.perlbench_s (avg) 29.000 -3.33%
600.perlbench_s (avg) (percentage) 1.510 -
600.perlbench_s (max) 35.000 -5.41%
600.perlbench_s (max) (percentage) 1.820 -2.15%
603.bwaves_s 194.000 -3.00%
603.bwaves_s (avg) 194.000 -3.00%
603.bwaves_s (avg) (percentage) 2.170 -
603.bwaves_s (max) 308.000 13.65%
603.bwaves_s (max) (percentage) 3.430 17.47%
603.bwaves_s (unexplained diff vs previous) 319.000 26.09%
603.bwaves_s (unexplained diff vs previous) (percentage) 3.550 30.51%
605.mcf_s 76.000 -1.30%
605.mcf_s (avg) 76.000 -1.30%
605.mcf_s (avg) (percentage) 1.120 -
605.mcf_s (max) 123.000 -8.21%
605.mcf_s (max) (percentage) 1.800 -7.22%
607.cactuBSSN_s 136.000 -2.86%
607.cactuBSSN_s (avg) 136.000 -2.86%
607.cactuBSSN_s (avg) (percentage) 2.780 -
607.cactuBSSN_s (max) 112.000 -2.61%
607.cactuBSSN_s (max) (percentage) 2.290 -
619.lbm_s 2305.000 -14.94%
619.lbm_s (avg) 2305.000 -14.94%
619.lbm_s (avg) (percentage) 7.390 1.51%
619.lbm_s (max) 5062.000 -30.50%
619.lbm_s (max) (percentage) 16.230 -17.02%
619.lbm_s (unexplained diff vs previous) 6043.000 -
619.lbm_s (unexplained diff vs previous) (percentage) 19.370 18.40%
620.omnetpp_s 64.000 -1.54%
620.omnetpp_s (avg) 64.000 -1.54%
620.omnetpp_s (avg) (percentage) 1.580 -
620.omnetpp_s (max) 98.000 -13.27%
620.omnetpp_s (max) (percentage) 2.400 -12.41%
620.omnetpp_s (unexplained diff vs previous) 71.000 -36.04%
620.omnetpp_s (unexplained diff vs previous) (percentage) 1.740 -34.83%
623.xalancbmk_s 26.000 -3.70%
623.xalancbmk_s (avg) 26.000 -3.70%
623.xalancbmk_s (avg) (percentage) 0.820 -
623.xalancbmk_s (max) 25.000 -7.41%
623.xalancbmk_s (max) (percentage) 0.790 -3.66%
625.x264_s 26.000 -
625.x264_s (avg) 26.000 -
625.x264_s (avg) (percentage) 1.020 -
625.x264_s (max) 16.000 -11.11%
625.x264_s (max) (percentage) 0.660 -7.04%
628.pop2_s 101.000 -
628.pop2_s (avg) 101.000 -
628.pop2_s (avg) (percentage) 0.990 -
628.pop2_s (max) 59.000 -7.81%
628.pop2_s (max) (percentage) 0.580 -6.45%
631.deepsjeng_s 31.000 -3.12%
631.deepsjeng_s (avg) 31.000 -3.12%
631.deepsjeng_s (avg) (percentage) 0.900 -
631.deepsjeng_s (max) 43.000 -4.44%
631.deepsjeng_s (max) (percentage) 1.240 -1.59%
638.imagick_s 57.000 -1.72%
638.imagick_s (avg) 57.000 -1.72%
638.imagick_s (avg) (percentage) 1.050 -
638.imagick_s (max) 67.000 -2.90%
638.imagick_s (max) (percentage) 1.230 -2.38%
641.leela_s 24.000 -
641.leela_s (avg) 24.000 -
641.leela_s (avg) (percentage) 0.580 -
641.leela_s (max) 50.000 -1.96%
641.leela_s (max) (percentage) 1.180 -2.48%
644.nab_s 65.000 -
644.nab_s (avg) 65.000 -
644.nab_s (avg) (percentage) 0.600 1.69%
644.nab_s (max) 174.000 120.25%
644.nab_s (max) (percentage) 1.600 122.22%
644.nab_s (unexplained diff vs previous) 177.000 532.14%
644.nab_s (unexplained diff vs previous) (percentage) 1.630 552.00%
648.exchange2_s 10.000 -
648.exchange2_s (avg) 10.000 -
648.exchange2_s (avg) (percentage) 0.450 -
648.exchange2_s (max) 3.000 -
648.exchange2_s (max) (percentage) 0.130 -
649.fotonik3d_s 164.000 -1.80%
649.fotonik3d_s (avg) 164.000 -1.80%
649.fotonik3d_s (avg) (percentage) 1.680 -
649.fotonik3d_s (max) 237.000 -4.44%
649.fotonik3d_s (max) (percentage) 2.430 -2.41%
654.roms_s 974.000 -1.42%
654.roms_s (avg) 974.000 -1.42%
654.roms_s (avg) (percentage) 3.340 -
654.roms_s (max) 2065.000 -4.35%
654.roms_s (max) (percentage) 7.080 -3.01%
657.xz_s 31.000 -3.12%
657.xz_s (avg) 31.000 -3.12%
657.xz_s (avg) (percentage) 1.340 -
657.xz_s (max) 51.000 -5.56%
657.xz_s (max) (percentage) 2.200 -3.08%
Geometric Mean 15.052 1.92%