Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=4011eaac9a1fce5c44fcabb12368159b3e899d84 (unchanged)
git_gcc https://gcc.gnu.org/git/gcc.git (6901d56fea2132389e9a7ae60b4d9731e6e3c65a) (+ 1 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=4f6dae219578d6df475864e273da40bde9d30806 (unchanged)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/d2cb798d2d8ceb0d194721a2cb0e577b4b927573 (unchanged)
regression GNU-1574
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-cpu2017fast--gnu-aarch64-master-O2-build/370/
Filter

gnu-aarch64-master-O2 test results

Run Order Start Time Duration
Current 0370 (basepoints/gcc-16-00190-g6901d56fea2) 2025-05-03T21:06:58 0:00:00
Previous 0369 (basepoints/gcc-16-00189-g99aa410f5e0) 2025-05-02T09:43:02 0:00:00
Baseline 0001 (4-changed-components) 2023-03-26T18:17:00 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 14 19
Performance Improvements 55 15
Added Tests 0 108
Unchanged Tests 825 752
Total Tests 894

Performance Regressions - Code Size Δ Previous Current σ Δ (B) σ (B)
648.exchange2_s 7.05% 60520.000 64788.000 - 7.31% -
607.cactuBSSN_s 2.17% 3206951.000 3276451.000 - 1.62% -
649.fotonik3d_s 1.39% 300846.000 305038.000 - -1.23% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
619.lbm_s (unexplained diff vs previous) (percentage) 954.55% 0.220 2.320 - 0.00% -
619.lbm_s (unexplained diff vs previous) 934.29% 70.000 724.000 - 0.00% -
620.omnetpp_s (unexplained diff vs previous) (percentage) 205.56% 1.080 3.300 - 0.00% -
620.omnetpp_s (unexplained diff vs previous) 195.56% 45.000 133.000 - 0.00% -
620.omnetpp_s (max) (percentage) 43.69% 2.220 3.190 - 0.00% -
620.omnetpp_s (max) 39.13% 92.000 128.000 - 0.00% -
605.mcf_s (unexplained diff vs previous) 17.95% 39.000 46.000 - 0.00% -
605.mcf_s (unexplained diff vs previous) (percentage) 17.54% 0.570 0.670 - 0.00% -
600.perlbench_s 4.17% 24.000 25.000 - 0.00% -
600.perlbench_s (avg) 4.17% 24.000 25.000 - 0.00% -
620.omnetpp_s (avg) (percentage) 1.07% 1.870 1.890 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
627.cam4_s -3.36% 149.000 144.000 - 0.00% -
620.omnetpp_s -3.19% 4164.000 4031.000 - -3.17% -
619.lbm_s -2.27% 31933.000 31209.000 - 9.84% -
648.exchange2_s -2.14% 2474.000 2421.000 - 10.10% -
623.xalancbmk_s -2.06% 3787.000 3709.000 - -2.50% -
607.cactuBSSN_s -1.32% 4909.000 4844.000 - 2.02% -
628.pop2_s -1.30% 10333.000 10199.000 - -4.15% -
511.povray_r -1.18% 425.000 420.000 - -1.18% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
638.imagick_s (max) (percentage) -13.33% 0.150 0.130 - 0.00% -
638.imagick_s (max) -12.50% 8.000 7.000 - 0.00% -
526.blender_r (max) (percentage) -10.94% 0.640 0.570 - 0.00% -
526.blender_r (max) -10.45% 67.000 60.000 - 0.00% -
508.namd_r (max) (percentage) -8.70% 0.230 0.210 - 0.00% -
631.deepsjeng_s (max) -6.90% 29.000 27.000 - 0.00% -
641.leela_s (max) (percentage) -6.49% 0.770 0.720 - 0.00% -
657.xz_s (max) -6.25% 32.000 30.000 - 0.00% -
607.cactuBSSN_s (max) -6.09% 115.000 108.000 - 0.00% -
628.pop2_s (max) -5.74% 122.000 115.000 - 0.00% -
644.nab_s (max) -5.65% 124.000 117.000 - 0.00% -
600.perlbench_s (max) -5.56% 18.000 17.000 - 0.00% -
641.leela_s (max) -5.41% 37.000 35.000 - 0.00% -
644.nab_s (max) (percentage) -5.36% 1.120 1.060 - 0.00% -
607.cactuBSSN_s (max) (percentage) -5.08% 2.360 2.240 - 0.00% -
628.pop2_s (max) (percentage) -5.04% 1.190 1.130 - 0.00% -
649.fotonik3d_s (max) (percentage) -4.79% 1.460 1.390 - 0.00% -
510.parest_r (max) (percentage) -4.73% 1.480 1.410 - 0.00% -
654.roms_s (max) (percentage) -4.72% 1.270 1.210 - 0.00% -
603.bwaves_s (max) (percentage) -4.71% 4.250 4.050 - 0.00% -
510.parest_r (max) -4.71% 85.000 81.000 - 0.00% -
648.exchange2_s (max) (percentage) -4.55% 0.220 0.210 - 0.00% -
605.mcf_s (max) (percentage) -4.48% 1.340 1.280 - 0.00% -
600.perlbench_s (max) (percentage) -4.30% 0.930 0.890 - 0.00% -
649.fotonik3d_s (max) -4.23% 142.000 136.000 - 0.00% -
631.deepsjeng_s (max) (percentage) -4.11% 0.730 0.700 - 0.00% -
654.roms_s (max) -4.09% 367.000 352.000 - 0.00% -
603.bwaves_s (max) -3.93% 382.000 367.000 - 0.00% -
657.xz_s (max) (percentage) -3.68% 1.360 1.310 - 0.00% -
511.povray_r (max) (percentage) -3.57% 2.240 2.160 - 0.00% -
625.x264_s (max) (percentage) -3.53% 0.850 0.820 - 0.00% -
623.xalancbmk_s (max) -3.33% 30.000 29.000 - 0.00% -
605.mcf_s (max) -3.30% 91.000 88.000 - 0.00% -
619.lbm_s -3.09% 1909.000 1850.000 - 0.00% -
619.lbm_s (avg) -3.09% 1909.000 1850.000 - 0.00% -
623.xalancbmk_s -2.86% 35.000 34.000 - 0.00% -
623.xalancbmk_s (avg) -2.86% 35.000 34.000 - 0.00% -
619.lbm_s (max) -2.29% 2005.000 1959.000 - 0.00% -
644.nab_s -1.43% 70.000 69.000 - 0.00% -
644.nab_s (avg) -1.43% 70.000 69.000 - 0.00% -
628.pop2_s -1.37% 146.000 144.000 - 0.00% -
628.pop2_s (avg) -1.37% 146.000 144.000 - 0.00% -
607.cactuBSSN_s -1.30% 154.000 152.000 - 0.00% -
607.cactuBSSN_s (avg) -1.30% 154.000 152.000 - 0.00% -
620.omnetpp_s -1.30% 77.000 76.000 - 0.00% -
620.omnetpp_s (avg) -1.30% 77.000 76.000 - 0.00% -
623.xalancbmk_s (max) (percentage) -1.25% 0.800 0.790 - 0.00% -

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
648.exchange2_s 7.31% 60374.000 64788.000 - 7.05% -
510.parest_r 3.29% 7623044.000 7873759.000 - -0.03% -
621.wrf_s 3.06% 17057867.000 17579830.000 - -0.01% -
508.namd_r 2.58% 627398.000 643606.000 - 0.28% -
631.deepsjeng_s 2.42% 80966.000 82922.000 - -0.29% -
607.cactuBSSN_s 1.62% 3224093.000 3276451.000 - 2.17% -
600.perlbench_s 1.07% 2120214.000 2142911.000 - -0.19% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
638.imagick_s 63.84% 3346.000 5482.000 - -0.16% -
508.namd_r 19.70% 2427.000 2905.000 - -0.14% -
648.exchange2_s 10.10% 2199.000 2421.000 - -2.14% -
619.lbm_s 9.84% 28412.000 31209.000 - -2.27% -
654.roms_s 6.47% 27387.000 29158.000 - 0.74% -
657.xz_s 6.01% 2228.000 2362.000 - 0.17% -
526.blender_r 5.91% 10053.000 10647.000 - 0.66% -
644.nab_s 5.45% 10468.000 11038.000 - -0.81% -
631.deepsjeng_s 3.15% 3847.000 3968.000 - -0.13% -
607.cactuBSSN_s 2.02% 4748.000 4844.000 - -1.32% -
510.parest_r 1.99% 5637.000 5749.000 - -0.21% -
603.bwaves_s 1.73% 8916.000 9070.000 - 0.68% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
603.bwaves_s -4.66% 49143.000 46851.000 - 0.31% -
641.leela_s -3.14% 147936.000 143296.000 - 0.03% -
511.povray_r -1.55% 851500.000 838324.000 - -0.43% -
620.omnetpp_s -1.53% 2027591.000 1996663.000 - -0.82% -
619.lbm_s -1.30% 16006.000 15798.000 - 0.00% -
623.xalancbmk_s -1.27% 4496134.000 4438844.000 - -0.21% -
649.fotonik3d_s -1.23% 308847.000 305038.000 - 1.39% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
621.wrf_s -23.18% 9119.000 7005.000 - -0.85% -
628.pop2_s -4.15% 10641.000 10199.000 - -1.30% -
620.omnetpp_s -3.17% 4163.000 4031.000 - -3.19% -
623.xalancbmk_s -2.50% 3804.000 3709.000 - -2.06% -
602.gcc_s -2.41% 4307.000 4203.000 - 0.31% -
600.perlbench_s -1.99% 2058.000 2017.000 - 0.85% -
511.povray_r -1.18% 425.000 420.000 - -1.18% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_execution_successful 4.55% 22.000 23.000 - 0.00% -

Added Tests - Code Size
625.x264_s

Added Tests - Execution
625.x264_s
627.cam4_s

Added Tests - sample variability
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
600.perlbench_s
600.perlbench_s (avg)
600.perlbench_s (avg) (percentage)
600.perlbench_s (max)
600.perlbench_s (max) (percentage)
603.bwaves_s
603.bwaves_s (avg)
603.bwaves_s (avg) (percentage)
603.bwaves_s (max)
603.bwaves_s (max) (percentage)
605.mcf_s
605.mcf_s (avg)
605.mcf_s (avg) (percentage)
605.mcf_s (max)
605.mcf_s (max) (percentage)
607.cactuBSSN_s
607.cactuBSSN_s (avg)
607.cactuBSSN_s (avg) (percentage)
607.cactuBSSN_s (max)
607.cactuBSSN_s (max) (percentage)
619.lbm_s
619.lbm_s (avg)
619.lbm_s (avg) (percentage)
619.lbm_s (max)
619.lbm_s (max) (percentage)
620.omnetpp_s
620.omnetpp_s (avg)
620.omnetpp_s (avg) (percentage)
620.omnetpp_s (max)
620.omnetpp_s (max) (percentage)
623.xalancbmk_s
623.xalancbmk_s (avg)
623.xalancbmk_s (avg) (percentage)
623.xalancbmk_s (max)
623.xalancbmk_s (max) (percentage)
625.x264_s
625.x264_s (avg)
625.x264_s (avg) (percentage)
625.x264_s (max)
625.x264_s (max) (percentage)
628.pop2_s
628.pop2_s (avg)
628.pop2_s (avg) (percentage)
628.pop2_s (max)
628.pop2_s (max) (percentage)
631.deepsjeng_s
631.deepsjeng_s (avg)
631.deepsjeng_s (avg) (percentage)
631.deepsjeng_s (max)
631.deepsjeng_s (max) (percentage)
638.imagick_s
638.imagick_s (avg)
638.imagick_s (avg) (percentage)
638.imagick_s (max)
638.imagick_s (max) (percentage)
641.leela_s
641.leela_s (avg)
641.leela_s (avg) (percentage)
641.leela_s (max)
641.leela_s (max) (percentage)
644.nab_s
644.nab_s (avg)
644.nab_s (avg) (percentage)
644.nab_s (max)
644.nab_s (max) (percentage)
648.exchange2_s
648.exchange2_s (avg)
648.exchange2_s (avg) (percentage)
648.exchange2_s (max)
648.exchange2_s (max) (percentage)
649.fotonik3d_s
649.fotonik3d_s (avg)
649.fotonik3d_s (avg) (percentage)
649.fotonik3d_s (max)
649.fotonik3d_s (max) (percentage)
654.roms_s
654.roms_s (avg)
654.roms_s (avg) (percentage)
654.roms_s (max)
654.roms_s (max) (percentage)
657.xz_s
657.xz_s (avg)
657.xz_s (avg) (percentage)
657.xz_s (max)
657.xz_s (max) (percentage)


Report Time: 0.36s
Name Current %
508.namd_r 2905.000 -
510.parest_r 5749.000 -
511.povray_r 420.000 -1.18%
526.blender_r 10647.000 -
600.perlbench_s 2017.000 -
602.gcc_s 4203.000 -
603.bwaves_s 9070.000 -
605.mcf_s 6879.000 -
607.cactuBSSN_s 4844.000 -1.32%
619.lbm_s 31209.000 -2.27%
620.omnetpp_s 4031.000 -3.19%
621.wrf_s 7005.000 -
623.xalancbmk_s 3709.000 -2.06%
625.x264_s 2574.000 -
627.cam4_s 144.000 -3.36%
628.pop2_s 10199.000 -1.30%
631.deepsjeng_s 3968.000 -
638.imagick_s 5482.000 -
641.leela_s 4933.000 -
644.nab_s 11038.000 -
648.exchange2_s 2421.000 -2.14%
649.fotonik3d_s 9799.000 -
654.roms_s 29158.000 -
657.xz_s 2362.000 -
Geometric Mean 4492.809 -
Name Current %
508.namd_r 643606.000 -
510.parest_r 7873759.000 -
511.povray_r 838324.000 -
526.blender_r 9745563.000 -
600.perlbench_s 2142911.000 -
602.gcc_s 9043799.000 -
603.bwaves_s 46851.000 -
605.mcf_s 21049.000 -
607.cactuBSSN_s 3276451.000 2.17%
619.lbm_s 15798.000 -
620.omnetpp_s 1996663.000 -
621.wrf_s 17579830.000 -
623.xalancbmk_s 4438844.000 -
625.x264_s 445282.000 -
628.pop2_s 25464975.000 -
631.deepsjeng_s 82922.000 -
638.imagick_s 1851306.000 -
641.leela_s 143296.000 -
644.nab_s 174163.000 -
648.exchange2_s 64788.000 7.05%
649.fotonik3d_s 305038.000 1.39%
654.roms_s 677292.000 -
657.xz_s 192291.000 -
Geometric Mean 729780.458 -
Name Current %
508.namd_r 20.000 -
508.namd_r (avg) 20.000 -
508.namd_r (avg) (percentage) 0.690 -
508.namd_r (max) 6.000 -
508.namd_r (max) (percentage) 0.210 -8.70%
510.parest_r 82.000 -
510.parest_r (avg) 82.000 -
510.parest_r (avg) (percentage) 1.440 -
510.parest_r (max) 81.000 -4.71%
510.parest_r (max) (percentage) 1.410 -4.73%
511.povray_r 4.000 -
511.povray_r (avg) 4.000 -
511.povray_r (avg) (percentage) 1.070 -
511.povray_r (max) 9.000 -
511.povray_r (max) (percentage) 2.160 -3.57%
526.blender_r 94.000 -
526.blender_r (avg) 94.000 -
526.blender_r (avg) (percentage) 0.890 -
526.blender_r (max) 60.000 -10.45%
526.blender_r (max) (percentage) 0.570 -10.94%
600.perlbench_s 25.000 4.17%
600.perlbench_s (avg) 25.000 4.17%
600.perlbench_s (avg) (percentage) 1.240 -
600.perlbench_s (max) 17.000 -5.56%
600.perlbench_s (max) (percentage) 0.890 -4.30%
603.bwaves_s 197.000 -
603.bwaves_s (avg) 197.000 -
603.bwaves_s (avg) (percentage) 2.180 -
603.bwaves_s (max) 367.000 -3.93%
603.bwaves_s (max) (percentage) 4.050 -4.71%
605.mcf_s 117.000 -
605.mcf_s (avg) 117.000 -
605.mcf_s (avg) (percentage) 1.710 -
605.mcf_s (max) 88.000 -3.30%
605.mcf_s (max) (percentage) 1.280 -4.48%
605.mcf_s (unexplained diff vs previous) 46.000 17.95%
605.mcf_s (unexplained diff vs previous) (percentage) 0.670 17.54%
607.cactuBSSN_s 152.000 -1.30%
607.cactuBSSN_s (avg) 152.000 -1.30%
607.cactuBSSN_s (avg) (percentage) 3.140 -
607.cactuBSSN_s (max) 108.000 -6.09%
607.cactuBSSN_s (max) (percentage) 2.240 -5.08%
619.lbm_s 1850.000 -3.09%
619.lbm_s (avg) 1850.000 -3.09%
619.lbm_s (avg) (percentage) 5.930 -
619.lbm_s (max) 1959.000 -2.29%
619.lbm_s (max) (percentage) 6.280 -
619.lbm_s (unexplained diff vs previous) 724.000 934.29%
619.lbm_s (unexplained diff vs previous) (percentage) 2.320 954.55%
620.omnetpp_s 76.000 -1.30%
620.omnetpp_s (avg) 76.000 -1.30%
620.omnetpp_s (avg) (percentage) 1.890 1.07%
620.omnetpp_s (max) 128.000 39.13%
620.omnetpp_s (max) (percentage) 3.190 43.69%
620.omnetpp_s (unexplained diff vs previous) 133.000 195.56%
620.omnetpp_s (unexplained diff vs previous) (percentage) 3.300 205.56%
623.xalancbmk_s 34.000 -2.86%
623.xalancbmk_s (avg) 34.000 -2.86%
623.xalancbmk_s (avg) (percentage) 0.930 -
623.xalancbmk_s (max) 29.000 -3.33%
623.xalancbmk_s (max) (percentage) 0.790 -1.25%
625.x264_s 24.000 -
625.x264_s (avg) 24.000 -
625.x264_s (avg) (percentage) 0.940 -
625.x264_s (max) 21.000 -
625.x264_s (max) (percentage) 0.820 -3.53%
628.pop2_s 144.000 -1.37%
628.pop2_s (avg) 144.000 -1.37%
628.pop2_s (avg) (percentage) 1.420 -
628.pop2_s (max) 115.000 -5.74%
628.pop2_s (max) (percentage) 1.130 -5.04%
631.deepsjeng_s 35.000 -
631.deepsjeng_s (avg) 35.000 -
631.deepsjeng_s (avg) (percentage) 0.900 -
631.deepsjeng_s (max) 27.000 -6.90%
631.deepsjeng_s (max) (percentage) 0.700 -4.11%
638.imagick_s 49.000 -
638.imagick_s (avg) 49.000 -
638.imagick_s (avg) (percentage) 0.910 -
638.imagick_s (max) 7.000 -12.50%
638.imagick_s (max) (percentage) 0.130 -13.33%
641.leela_s 32.000 -
641.leela_s (avg) 32.000 -
641.leela_s (avg) (percentage) 0.660 -
641.leela_s (max) 35.000 -5.41%
641.leela_s (max) (percentage) 0.720 -6.49%
644.nab_s 69.000 -1.43%
644.nab_s (avg) 69.000 -1.43%
644.nab_s (avg) (percentage) 0.630 -
644.nab_s (max) 117.000 -5.65%
644.nab_s (max) (percentage) 1.060 -5.36%
648.exchange2_s 8.000 -
648.exchange2_s (avg) 8.000 -
648.exchange2_s (avg) (percentage) 0.340 -
648.exchange2_s (max) 5.000 -
648.exchange2_s (max) (percentage) 0.210 -4.55%
649.fotonik3d_s 142.000 -
649.fotonik3d_s (avg) 142.000 -
649.fotonik3d_s (avg) (percentage) 1.450 -
649.fotonik3d_s (max) 136.000 -4.23%
649.fotonik3d_s (max) (percentage) 1.390 -4.79%
654.roms_s 621.000 -
654.roms_s (avg) 621.000 -
654.roms_s (avg) (percentage) 2.130 -
654.roms_s (max) 352.000 -4.09%
654.roms_s (max) (percentage) 1.210 -4.72%
657.xz_s 36.000 -
657.xz_s (avg) 36.000 -
657.xz_s (avg) (percentage) 1.550 -
657.xz_s (max) 30.000 -6.25%
657.xz_s (max) (percentage) 1.310 -3.68%
Geometric Mean 12.480 5.34%