Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=ad59259604f008e20490f9c82cf287d5a601a66c (unchanged)
git_gcc https://gcc.gnu.org/git/gcc.git (405c99c17210a58df1adddd237219e773e689f17) (+ 1 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=c3d1dac96bdd10250aa37bb367d5ef8334a093a1 (unchanged)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/73eab0e90b4becff0564c5964867c8eef41388bf (unchanged)
regression GNU-1486
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-cpu2017fast--gnu-aarch64-master-Os-build/295/
Filter

gnu-aarch64-master-Os test results

Run Order Start Time Duration
Current 0295 (basepoints/gcc-15-06657-g405c99c1721) 2025-01-09T07:00:36 0:00:00
Previous 0294 (basepoints/gcc-15-06656-g4f4722b0722) 2025-01-08T10:04:07 0:00:00
Baseline 0001 (4-changed-components) 2023-02-27T01:05:11 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 15 5
Performance Improvements 83 28
Added Tests 0 111
Unchanged Tests 844 798
Total Tests 942

Performance Regressions - Code Size Δ Previous Current σ Δ (B) σ (B)
649.fotonik3d_s 2.68% 249592.000 256284.000 - -5.82% -
657.xz_s 2.57% 159527.000 163623.000 - 2.40% -
607.cactuBSSN_s 2.12% 2635327.000 2691103.000 - 1.85% -
621.wrf_s 1.42% 12019213.000 12190485.000 - -1.96% -
511.povray_r 1.16% 699078.000 707186.000 - -0.65% -

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
649.fotonik3d_s 5.63% 10732.000 11336.000 - 6.85% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
605.mcf_s (unexplained diff vs previous) 1414.29% 7.000 106.000 - 0.00% -
605.mcf_s (unexplained diff vs previous) (percentage) 1370.00% 0.100 1.470 - 0.00% -
620.omnetpp_s (unexplained diff vs previous) (percentage) 137.31% 1.340 3.180 - 0.00% -
620.omnetpp_s (unexplained diff vs previous) 130.00% 60.000 138.000 - 0.00% -
649.fotonik3d_s 5.41% 222.000 234.000 - 0.00% -
649.fotonik3d_s (avg) 5.41% 222.000 234.000 - 0.00% -
649.fotonik3d_s (max) 2.37% 506.000 518.000 - 0.00% -
526.blender_r 1.54% 65.000 66.000 - 0.00% -
526.blender_r (avg) 1.54% 65.000 66.000 - 0.00% -

Performance Improvements - Code Size Δ Previous Current σ Δ (B) σ (B)
603.bwaves_s -8.51% 47966.000 43886.000 - -6.54% -
508.namd_r -1.92% 437148.000 428756.000 - -2.68% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
619.lbm_s -13.83% 34685.000 29887.000 - -18.13% -
654.roms_s -3.44% 35835.000 34604.000 - -6.37% -
620.omnetpp_s -3.08% 4474.000 4336.000 - -4.05% -
657.xz_s -2.94% 2551.000 2476.000 - -9.24% -
603.bwaves_s -2.58% 9478.000 9233.000 - -17.02% -
602.gcc_s -2.08% 5048.000 4943.000 - -3.40% -
648.exchange2_s -2.04% 3382.000 3313.000 - -2.21% -
600.perlbench_s -1.99% 2306.000 2260.000 - -5.60% -
638.imagick_s -1.82% 6043.000 5933.000 - -2.39% -
627.cam4_s -1.65% 182.000 179.000 - 0.00% -
607.cactuBSSN_s -1.58% 5124.000 5043.000 - -2.55% -
510.parest_r -1.52% 6729.000 6627.000 - -1.92% -
605.mcf_s -1.44% 7339.000 7233.000 - -1.01% -
511.povray_r -1.21% 496.000 490.000 - -7.37% -
631.deepsjeng_s -1.19% 4527.000 4473.000 - -0.04% -
621.wrf_s -1.13% 12196.000 12058.000 - -4.91% -
625.x264_s -1.09% 3957.000 3914.000 - -3.64% -
641.leela_s -1.08% 5190.000 5134.000 - -1.10% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
619.lbm_s (max) -17.04% 5140.000 4264.000 - 0.00% -
526.blender_r (max) -15.38% 26.000 22.000 - 0.00% -
511.povray_r (max) -14.29% 7.000 6.000 - 0.00% -
526.blender_r (max) (percentage) -14.29% 0.210 0.180 - 0.00% -
619.lbm_s -13.83% 3551.000 3060.000 - 0.00% -
619.lbm_s (avg) -13.83% 3551.000 3060.000 - 0.00% -
654.roms_s (max) -13.77% 501.000 432.000 - 0.00% -
654.roms_s (max) (percentage) -10.71% 1.400 1.250 - 0.00% -
657.xz_s (max) -8.33% 24.000 22.000 - 0.00% -
648.exchange2_s (max) -7.89% 38.000 35.000 - 0.00% -
625.x264_s (max) (percentage) -7.69% 0.390 0.360 - 0.00% -
644.nab_s (max) -7.55% 106.000 98.000 - 0.00% -
644.nab_s (max) (percentage) -7.14% 0.840 0.780 - 0.00% -
648.exchange2_s (max) (percentage) -7.02% 1.140 1.060 - 0.00% -
625.x264_s (max) -6.67% 15.000 14.000 - 0.00% -
508.namd_r (max) (percentage) -6.38% 0.470 0.440 - 0.00% -
508.namd_r (max) -6.25% 16.000 15.000 - 0.00% -
657.xz_s (max) (percentage) -6.12% 0.980 0.920 - 0.00% -
603.bwaves_s (max) -5.90% 390.000 367.000 - 0.00% -
631.deepsjeng_s (max) -5.17% 58.000 55.000 - 0.00% -
638.imagick_s (max) -5.17% 116.000 110.000 - 0.00% -
600.perlbench_s (max) -5.00% 60.000 57.000 - 0.00% -
605.mcf_s (max) -4.85% 227.000 216.000 - 0.00% -
641.leela_s (max) (percentage) -4.65% 0.430 0.410 - 0.00% -
641.leela_s (max) -4.55% 22.000 21.000 - 0.00% -
607.cactuBSSN_s (max) -4.52% 199.000 190.000 - 0.00% -
510.parest_r (max) -4.41% 68.000 65.000 - 0.00% -
657.xz_s -4.17% 48.000 46.000 - 0.00% -
657.xz_s (avg) -4.17% 48.000 46.000 - 0.00% -
619.lbm_s (max) (percentage) -3.71% 14.820 14.270 - 0.00% -
605.mcf_s (max) (percentage) -3.55% 3.100 2.990 - 0.00% -
654.roms_s -3.48% 892.000 861.000 - 0.00% -
654.roms_s (avg) -3.48% 892.000 861.000 - 0.00% -
600.perlbench_s (max) (percentage) -3.41% 2.640 2.550 - 0.00% -
603.bwaves_s (max) (percentage) -3.40% 4.120 3.980 - 0.00% -
628.pop2_s (max) -3.35% 269.000 260.000 - 0.00% -
649.fotonik3d_s (max) (percentage) -3.18% 4.720 4.570 - 0.00% -
628.pop2_s (max) (percentage) -3.17% 1.890 1.830 - 0.00% -
638.imagick_s (max) (percentage) -3.11% 1.930 1.870 - 0.00% -
631.deepsjeng_s (max) (percentage) -3.10% 1.290 1.250 - 0.00% -
607.cactuBSSN_s (max) (percentage) -3.08% 3.900 3.780 - 0.00% -
600.perlbench_s -3.03% 33.000 32.000 - 0.00% -
600.perlbench_s (avg) -3.03% 33.000 32.000 - 0.00% -
510.parest_r (max) (percentage) -2.94% 1.020 0.990 - 0.00% -
631.deepsjeng_s -2.94% 34.000 33.000 - 0.00% -
631.deepsjeng_s (avg) -2.94% 34.000 33.000 - 0.00% -
511.povray_r (max) (percentage) -2.80% 1.430 1.390 - 0.00% -
603.bwaves_s -2.61% 268.000 261.000 - 0.00% -
603.bwaves_s (avg) -2.61% 268.000 261.000 - 0.00% -
620.omnetpp_s -2.27% 88.000 86.000 - 0.00% -
620.omnetpp_s (avg) -2.27% 88.000 86.000 - 0.00% -
620.omnetpp_s (max) -2.21% 136.000 133.000 - 0.00% -
607.cactuBSSN_s -1.71% 175.000 172.000 - 0.00% -
607.cactuBSSN_s (avg) -1.71% 175.000 172.000 - 0.00% -
644.nab_s -1.61% 62.000 61.000 - 0.00% -
644.nab_s (avg) -1.61% 62.000 61.000 - 0.00% -
638.imagick_s -1.56% 64.000 63.000 - 0.00% -
638.imagick_s (avg) -1.56% 64.000 63.000 - 0.00% -
510.parest_r -1.41% 71.000 70.000 - 0.00% -
510.parest_r (avg) -1.41% 71.000 70.000 - 0.00% -
621.wrf_s (max) -1.14% 351.000 347.000 - 0.00% -
621.wrf_s -1.07% 654.000 647.000 - 0.00% -
621.wrf_s (avg) -1.07% 654.000 647.000 - 0.00% -

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
657.xz_s 2.40% 159783.000 163623.000 - 2.57% -
607.cactuBSSN_s 1.85% 2642286.000 2691103.000 - 2.12% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
649.fotonik3d_s 6.85% 10609.000 11336.000 - 5.63% -
623.xalancbmk_s 2.44% 5248.000 5376.000 - 0.92% -
644.nab_s 1.75% 12363.000 12579.000 - -0.66% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
603.bwaves_s -6.54% 46959.000 43886.000 - -8.51% -
649.fotonik3d_s -5.82% 272124.000 256284.000 - 2.68% -
641.leela_s -2.96% 110234.000 106968.000 - -0.00% -
508.namd_r -2.68% 440571.000 428756.000 - -1.92% -
654.roms_s -2.50% 589234.000 574481.000 - 0.48% -
621.wrf_s -1.96% 12434038.000 12190485.000 - 1.42% -
648.exchange2_s -1.52% 52869.000 52065.000 - 0.44% -
625.x264_s -1.15% 361788.000 357631.000 - 0.04% -
644.nab_s -1.13% 145027.000 143391.000 - 0.01% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
619.lbm_s -18.13% 36505.000 29887.000 - -13.83% -
603.bwaves_s -17.02% 11127.000 9233.000 - -2.58% -
657.xz_s -9.24% 2728.000 2476.000 - -2.94% -
511.povray_r -7.37% 529.000 490.000 - -1.21% -
654.roms_s -6.37% 36958.000 34604.000 - -3.44% -
600.perlbench_s -5.60% 2394.000 2260.000 - -1.99% -
621.wrf_s -4.91% 12680.000 12058.000 - -1.13% -
620.omnetpp_s -4.05% 4519.000 4336.000 - -3.08% -
625.x264_s -3.64% 4062.000 3914.000 - -1.09% -
526.blender_r -3.54% 13182.000 12716.000 - 0.36% -
602.gcc_s -3.40% 5117.000 4943.000 - -2.08% -
508.namd_r -2.93% 3520.000 3417.000 - -0.99% -
607.cactuBSSN_s -2.55% 5175.000 5043.000 - -1.58% -
638.imagick_s -2.39% 6078.000 5933.000 - -1.82% -
648.exchange2_s -2.21% 3388.000 3313.000 - -2.04% -
628.pop2_s -1.98% 14534.000 14246.000 - -0.24% -
510.parest_r -1.92% 6757.000 6627.000 - -1.52% -
641.leela_s -1.10% 5191.000 5134.000 - -1.08% -
605.mcf_s -1.01% 7307.000 7233.000 - -1.44% -

Added Tests - Execution
627.cam4_s

Added Tests - sample variability
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
600.perlbench_s
600.perlbench_s (avg)
600.perlbench_s (avg) (percentage)
600.perlbench_s (max)
600.perlbench_s (max) (percentage)
603.bwaves_s
603.bwaves_s (avg)
603.bwaves_s (avg) (percentage)
603.bwaves_s (max)
603.bwaves_s (max) (percentage)
605.mcf_s
605.mcf_s (avg)
605.mcf_s (avg) (percentage)
605.mcf_s (max)
605.mcf_s (max) (percentage)
607.cactuBSSN_s
607.cactuBSSN_s (avg)
607.cactuBSSN_s (avg) (percentage)
607.cactuBSSN_s (max)
607.cactuBSSN_s (max) (percentage)
619.lbm_s
619.lbm_s (avg)
619.lbm_s (avg) (percentage)
619.lbm_s (max)
619.lbm_s (max) (percentage)
620.omnetpp_s
620.omnetpp_s (avg)
620.omnetpp_s (avg) (percentage)
620.omnetpp_s (max)
620.omnetpp_s (max) (percentage)
621.wrf_s
621.wrf_s (avg)
621.wrf_s (avg) (percentage)
621.wrf_s (max)
621.wrf_s (max) (percentage)
623.xalancbmk_s
623.xalancbmk_s (avg)
623.xalancbmk_s (avg) (percentage)
623.xalancbmk_s (max)
623.xalancbmk_s (max) (percentage)
625.x264_s
625.x264_s (avg)
625.x264_s (avg) (percentage)
625.x264_s (max)
625.x264_s (max) (percentage)
628.pop2_s
628.pop2_s (avg)
628.pop2_s (avg) (percentage)
628.pop2_s (max)
628.pop2_s (max) (percentage)
631.deepsjeng_s
631.deepsjeng_s (avg)
631.deepsjeng_s (avg) (percentage)
631.deepsjeng_s (max)
631.deepsjeng_s (max) (percentage)
638.imagick_s
638.imagick_s (avg)
638.imagick_s (avg) (percentage)
638.imagick_s (max)
638.imagick_s (max) (percentage)
641.leela_s
641.leela_s (avg)
641.leela_s (avg) (percentage)
641.leela_s (max)
641.leela_s (max) (percentage)
644.nab_s
644.nab_s (avg)
644.nab_s (avg) (percentage)
644.nab_s (max)
644.nab_s (max) (percentage)
648.exchange2_s
648.exchange2_s (avg)
648.exchange2_s (avg) (percentage)
648.exchange2_s (max)
648.exchange2_s (max) (percentage)
649.fotonik3d_s
649.fotonik3d_s (avg)
649.fotonik3d_s (avg) (percentage)
649.fotonik3d_s (max)
649.fotonik3d_s (max) (percentage)
654.roms_s
654.roms_s (avg)
654.roms_s (avg) (percentage)
654.roms_s (max)
654.roms_s (max) (percentage)
657.xz_s
657.xz_s (avg)
657.xz_s (avg) (percentage)
657.xz_s (max)
657.xz_s (max) (percentage)


Report Time: 0.35s
Name Current %
508.namd_r 3417.000 -
510.parest_r 6627.000 -1.52%
511.povray_r 490.000 -1.21%
526.blender_r 12716.000 -
600.perlbench_s 2260.000 -1.99%
602.gcc_s 4943.000 -2.08%
603.bwaves_s 9233.000 -2.58%
605.mcf_s 7233.000 -1.44%
607.cactuBSSN_s 5043.000 -1.58%
619.lbm_s 29887.000 -13.83%
620.omnetpp_s 4336.000 -3.08%
621.wrf_s 12058.000 -1.13%
623.xalancbmk_s 5376.000 -
625.x264_s 3914.000 -1.09%
627.cam4_s 179.000 -1.65%
628.pop2_s 14246.000 -
631.deepsjeng_s 4473.000 -1.19%
638.imagick_s 5933.000 -1.82%
641.leela_s 5134.000 -1.08%
644.nab_s 12579.000 -
648.exchange2_s 3313.000 -2.04%
649.fotonik3d_s 11336.000 5.63%
654.roms_s 34604.000 -3.44%
657.xz_s 2476.000 -2.94%
Geometric Mean 5303.735 -1.74%
Name Current %
508.namd_r 428756.000 -1.92%
510.parest_r 5211866.000 -
511.povray_r 707186.000 1.16%
526.blender_r 8268875.000 -
600.perlbench_s 1808373.000 -
602.gcc_s 7291984.000 -
603.bwaves_s 43886.000 -8.51%
605.mcf_s 17652.000 -
607.cactuBSSN_s 2691103.000 2.12%
619.lbm_s 14937.000 -
620.omnetpp_s 1578214.000 -
621.wrf_s 12190485.000 1.42%
623.xalancbmk_s 3522456.000 -
625.x264_s 357631.000 -
628.pop2_s 24702932.000 -
631.deepsjeng_s 68422.000 -
638.imagick_s 1490926.000 -
641.leela_s 106968.000 -
644.nab_s 143391.000 -
648.exchange2_s 52065.000 -
649.fotonik3d_s 256284.000 2.68%
654.roms_s 574481.000 -
657.xz_s 163623.000 2.57%
Geometric Mean 594153.073 -
Name Current %
508.namd_r 24.000 -
508.namd_r (avg) 24.000 -
508.namd_r (avg) (percentage) 0.720 -
508.namd_r (max) 15.000 -6.25%
508.namd_r (max) (percentage) 0.440 -6.38%
510.parest_r 70.000 -1.41%
510.parest_r (avg) 70.000 -1.41%
510.parest_r (avg) (percentage) 1.060 -
510.parest_r (max) 65.000 -4.41%
510.parest_r (max) (percentage) 0.990 -2.94%
511.povray_r 4.000 -
511.povray_r (avg) 4.000 -
511.povray_r (avg) (percentage) 0.940 -
511.povray_r (max) 6.000 -14.29%
511.povray_r (max) (percentage) 1.390 -2.80%
526.blender_r 66.000 1.54%
526.blender_r (avg) 66.000 1.54%
526.blender_r (avg) (percentage) 0.520 -
526.blender_r (max) 22.000 -15.38%
526.blender_r (max) (percentage) 0.180 -14.29%
600.perlbench_s 32.000 -3.03%
600.perlbench_s (avg) 32.000 -3.03%
600.perlbench_s (avg) (percentage) 1.440 -
600.perlbench_s (max) 57.000 -5.00%
600.perlbench_s (max) (percentage) 2.550 -3.41%
603.bwaves_s 261.000 -2.61%
603.bwaves_s (avg) 261.000 -2.61%
603.bwaves_s (avg) (percentage) 2.830 -
603.bwaves_s (max) 367.000 -5.90%
603.bwaves_s (max) (percentage) 3.980 -3.40%
605.mcf_s 101.000 -
605.mcf_s (avg) 101.000 -
605.mcf_s (avg) (percentage) 1.400 -
605.mcf_s (max) 216.000 -4.85%
605.mcf_s (max) (percentage) 2.990 -3.55%
605.mcf_s (unexplained diff vs previous) 106.000 1414.29%
605.mcf_s (unexplained diff vs previous) (percentage) 1.470 1370.00%
607.cactuBSSN_s 172.000 -1.71%
607.cactuBSSN_s (avg) 172.000 -1.71%
607.cactuBSSN_s (avg) (percentage) 3.430 -
607.cactuBSSN_s (max) 190.000 -4.52%
607.cactuBSSN_s (max) (percentage) 3.780 -3.08%
619.lbm_s 3060.000 -13.83%
619.lbm_s (avg) 3060.000 -13.83%
619.lbm_s (avg) (percentage) 10.240 -
619.lbm_s (max) 4264.000 -17.04%
619.lbm_s (max) (percentage) 14.270 -3.71%
620.omnetpp_s 86.000 -2.27%
620.omnetpp_s (avg) 86.000 -2.27%
620.omnetpp_s (avg) (percentage) 1.990 -
620.omnetpp_s (max) 133.000 -2.21%
620.omnetpp_s (max) (percentage) 3.080 -
620.omnetpp_s (unexplained diff vs previous) 138.000 130.00%
620.omnetpp_s (unexplained diff vs previous) (percentage) 3.180 137.31%
621.wrf_s 647.000 -1.07%
621.wrf_s (avg) 647.000 -1.07%
621.wrf_s (avg) (percentage) 5.370 -
621.wrf_s (max) 347.000 -1.14%
621.wrf_s (max) (percentage) 2.880 -
623.xalancbmk_s 74.000 -
623.xalancbmk_s (avg) 74.000 -
623.xalancbmk_s (avg) (percentage) 1.390 -
623.xalancbmk_s (max) 132.000 -
623.xalancbmk_s (max) (percentage) 2.460 -
625.x264_s 26.000 -
625.x264_s (avg) 26.000 -
625.x264_s (avg) (percentage) 0.680 -
625.x264_s (max) 14.000 -6.67%
625.x264_s (max) (percentage) 0.360 -7.69%
628.pop2_s 108.000 -
628.pop2_s (avg) 108.000 -
628.pop2_s (avg) (percentage) 0.760 -
628.pop2_s (max) 260.000 -3.35%
628.pop2_s (max) (percentage) 1.830 -3.17%
631.deepsjeng_s 33.000 -2.94%
631.deepsjeng_s (avg) 33.000 -2.94%
631.deepsjeng_s (avg) (percentage) 0.760 -
631.deepsjeng_s (max) 55.000 -5.17%
631.deepsjeng_s (max) (percentage) 1.250 -3.10%
638.imagick_s 63.000 -1.56%
638.imagick_s (avg) 63.000 -1.56%
638.imagick_s (avg) (percentage) 1.070 -
638.imagick_s (max) 110.000 -5.17%
638.imagick_s (max) (percentage) 1.870 -3.11%
641.leela_s 26.000 -
641.leela_s (avg) 26.000 -
641.leela_s (avg) (percentage) 0.510 -
641.leela_s (max) 21.000 -4.55%
641.leela_s (max) (percentage) 0.410 -4.65%
644.nab_s 61.000 -1.61%
644.nab_s (avg) 61.000 -1.61%
644.nab_s (avg) (percentage) 0.490 -
644.nab_s (max) 98.000 -7.55%
644.nab_s (max) (percentage) 0.780 -7.14%
648.exchange2_s 14.000 -
648.exchange2_s (avg) 14.000 -
648.exchange2_s (avg) (percentage) 0.430 -
648.exchange2_s (max) 35.000 -7.89%
648.exchange2_s (max) (percentage) 1.060 -7.02%
649.fotonik3d_s 234.000 5.41%
649.fotonik3d_s (avg) 234.000 5.41%
649.fotonik3d_s (avg) (percentage) 2.070 -
649.fotonik3d_s (max) 518.000 2.37%
649.fotonik3d_s (max) (percentage) 4.570 -3.18%
654.roms_s 861.000 -3.48%
654.roms_s (avg) 861.000 -3.48%
654.roms_s (avg) (percentage) 2.490 -
654.roms_s (max) 432.000 -13.77%
654.roms_s (max) (percentage) 1.250 -10.71%
657.xz_s 46.000 -4.17%
657.xz_s (avg) 46.000 -4.17%
657.xz_s (avg) (percentage) 1.890 -
657.xz_s (max) 22.000 -8.33%
657.xz_s (max) (percentage) 0.920 -6.12%
Geometric Mean 16.530 3.48%