Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=b6d8d612d30dcdfc8ba8edfb15b4cd1753b0b8a2 (+ 183 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/9890f377013cf1e4f5b9fab8a7287a5380dade1f (+ 325 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=084fb31bc2c5f95ae0b9e6df4d3cf0ff43471ede (+ 38 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=781419a9bed0586a8ee9c4761e4d961e3f6059aa (+ 442 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-cpu2017fast--gnu-aarch64-master-Os-build/65/
Filter

gnu-aarch64-master-Os test results

Run Order Start Time Duration
Current 0065 (4-changed-components) 2023-07-23T23:24:23 0:00:00
Previous 0062 (4-changed-components) 2023-07-04T18:06:18 0:00:00
Baseline 0001 (4-changed-components) 2023-02-27T01:05:11 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 11 2
Performance Improvements 35 15
Added Tests 4 110
Unchanged Tests 892 815
Total Tests 942

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
619.lbm_s 16.60% 30630.000 35716.000 - -2.16% -
607.cactuBSSN_s 2.84% 5044.000 5187.000 - 0.23% -
657.xz_s 1.55% 2512.000 2551.000 - -6.49% -
600.perlbench_s 1.46% 2258.000 2291.000 - -4.30% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
619.lbm_s (max) 426.00% 1127.000 5928.000 - 0.00% -
619.lbm_s (max) (percentage) 351.09% 3.680 16.600 - 0.00% -
619.lbm_s 32.98% 1810.000 2407.000 - 0.00% -
619.lbm_s (avg) 32.98% 1810.000 2407.000 - 0.00% -
619.lbm_s (avg) (percentage) 14.04% 5.910 6.740 - 0.00% -
607.cactuBSSN_s 3.00% 100.000 103.000 - 0.00% -
607.cactuBSSN_s (avg) 3.00% 100.000 103.000 - 0.00% -

Performance Improvements - Code Size Δ Previous Current σ Δ (B) σ (B)
511.povray_r -1.15% 714574.000 706366.000 - -0.76% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
620.omnetpp_s (max) -10.84% 83.000 74.000 - 0.00% -
620.omnetpp_s (max) (percentage) -10.16% 1.870 1.680 - 0.00% -
641.leela_s (max) -6.25% 16.000 15.000 - 0.00% -
648.exchange2_s (max) -5.88% 34.000 32.000 - 0.00% -
605.mcf_s (avg) (percentage) -5.41% 1.480 1.400 - 0.00% -
508.namd_r (max) -5.26% 19.000 18.000 - 0.00% -
657.xz_s (max) -5.00% 20.000 19.000 - 0.00% -
605.mcf_s -4.63% 108.000 103.000 - 0.00% -
605.mcf_s (avg) -4.63% 108.000 103.000 - 0.00% -
623.xalancbmk_s (max) (percentage) -4.55% 0.220 0.210 - 0.00% -
526.blender_r (max) (percentage) -4.42% 1.130 1.080 - 0.00% -
605.mcf_s (max) -4.35% 46.000 44.000 - 0.00% -
511.povray_r (max) (percentage) -4.35% 2.070 1.980 - 0.00% -
510.parest_r (max) -4.17% 24.000 23.000 - 0.00% -
526.blender_r (max) -4.17% 144.000 138.000 - 0.00% -
648.exchange2_s (max) (percentage) -4.04% 0.990 0.950 - 0.00% -
508.namd_r (max) (percentage) -3.57% 0.560 0.540 - 0.00% -
641.leela_s (max) (percentage) -3.23% 0.310 0.300 - 0.00% -
605.mcf_s (max) (percentage) -3.17% 0.630 0.610 - 0.00% -
644.nab_s (max) (percentage) -3.13% 0.320 0.310 - 0.00% -
510.parest_r (max) (percentage) -2.78% 0.360 0.350 - 0.00% -
657.xz_s (max) (percentage) -2.50% 0.800 0.780 - 0.00% -
644.nab_s (max) -2.50% 40.000 39.000 - 0.00% -
607.cactuBSSN_s (max) (percentage) -2.22% 2.700 2.640 - 0.00% -
638.imagick_s (max) (percentage) -1.89% 0.530 0.520 - 0.00% -
654.roms_s (max) (percentage) -1.79% 4.460 4.380 - 0.00% -
628.pop2_s (max) (percentage) -1.61% 0.620 0.610 - 0.00% -
600.perlbench_s (max) (percentage) -1.60% 1.870 1.840 - 0.00% -
654.roms_s (max) -1.57% 1596.000 1571.000 - 0.00% -
603.bwaves_s (max) (percentage) -1.56% 3.850 3.790 - 0.00% -
620.omnetpp_s -1.49% 67.000 66.000 - 0.00% -
620.omnetpp_s (avg) -1.49% 67.000 66.000 - 0.00% -
628.pop2_s (max) -1.15% 87.000 86.000 - 0.00% -
649.fotonik3d_s (max) (percentage) -1.02% 1.970 1.950 - 0.00% -

Added Tests - sample variability
605.mcf_s (unexplained diff vs previous)
605.mcf_s (unexplained diff vs previous) (percentage)
619.lbm_s (unexplained diff vs previous)
619.lbm_s (unexplained diff vs previous) (percentage)

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
644.nab_s 1.89% 12363.000 12597.000 - -0.01% -
648.exchange2_s 1.53% 3388.000 3440.000 - 0.12% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
511.povray_r -9.45% 529.000 479.000 - 0.84% -
657.xz_s -6.49% 2728.000 2551.000 - 1.55% -
603.bwaves_s -5.03% 11127.000 10567.000 - 0.47% -
600.perlbench_s -4.30% 2394.000 2291.000 - 1.46% -
621.wrf_s -3.68% 12680.000 12214.000 - 0.44% -
649.fotonik3d_s -3.06% 10609.000 10284.000 - -0.11% -
654.roms_s -2.94% 36958.000 35873.000 - 0.22% -
526.blender_r -2.90% 13182.000 12800.000 - -0.01% -
628.pop2_s -2.40% 14534.000 14185.000 - 0.42% -
619.lbm_s -2.16% 36505.000 35716.000 - 16.60% -
638.imagick_s -1.33% 6078.000 5997.000 - 0.65% -
620.omnetpp_s -1.26% 4519.000 4462.000 - -0.34% -
625.x264_s -1.23% 4062.000 4012.000 - 0.80% -
602.gcc_s -1.06% 5117.000 5063.000 - 0.56% -
631.deepsjeng_s -1.03% 4475.000 4429.000 - 0.80% -

Added Tests - sample variability
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
600.perlbench_s
600.perlbench_s (avg)
600.perlbench_s (avg) (percentage)
600.perlbench_s (max)
600.perlbench_s (max) (percentage)
603.bwaves_s
603.bwaves_s (avg)
603.bwaves_s (avg) (percentage)
603.bwaves_s (max)
603.bwaves_s (max) (percentage)
605.mcf_s
605.mcf_s (avg)
605.mcf_s (avg) (percentage)
605.mcf_s (max)
605.mcf_s (max) (percentage)
607.cactuBSSN_s
607.cactuBSSN_s (avg)
607.cactuBSSN_s (avg) (percentage)
607.cactuBSSN_s (max)
607.cactuBSSN_s (max) (percentage)
619.lbm_s
619.lbm_s (avg)
619.lbm_s (avg) (percentage)
619.lbm_s (max)
619.lbm_s (max) (percentage)
620.omnetpp_s
620.omnetpp_s (avg)
620.omnetpp_s (avg) (percentage)
620.omnetpp_s (max)
620.omnetpp_s (max) (percentage)
621.wrf_s
621.wrf_s (avg)
621.wrf_s (avg) (percentage)
621.wrf_s (max)
621.wrf_s (max) (percentage)
623.xalancbmk_s
623.xalancbmk_s (avg)
623.xalancbmk_s (avg) (percentage)
623.xalancbmk_s (max)
623.xalancbmk_s (max) (percentage)
625.x264_s
625.x264_s (avg)
625.x264_s (avg) (percentage)
625.x264_s (max)
625.x264_s (max) (percentage)
628.pop2_s
628.pop2_s (avg)
628.pop2_s (avg) (percentage)
628.pop2_s (max)
628.pop2_s (max) (percentage)
631.deepsjeng_s
631.deepsjeng_s (avg)
631.deepsjeng_s (avg) (percentage)
631.deepsjeng_s (max)
631.deepsjeng_s (max) (percentage)
638.imagick_s
638.imagick_s (avg)
638.imagick_s (avg) (percentage)
638.imagick_s (max)
638.imagick_s (max) (percentage)
641.leela_s
641.leela_s (avg)
641.leela_s (avg) (percentage)
641.leela_s (max)
641.leela_s (max) (percentage)
644.nab_s
644.nab_s (avg)
644.nab_s (avg) (percentage)
644.nab_s (max)
644.nab_s (max) (percentage)
648.exchange2_s
648.exchange2_s (avg)
648.exchange2_s (avg) (percentage)
648.exchange2_s (max)
648.exchange2_s (max) (percentage)
649.fotonik3d_s
649.fotonik3d_s (avg)
649.fotonik3d_s (avg) (percentage)
649.fotonik3d_s (max)
649.fotonik3d_s (max) (percentage)
654.roms_s
654.roms_s (avg)
654.roms_s (avg) (percentage)
654.roms_s (max)
654.roms_s (max) (percentage)
657.xz_s
657.xz_s (avg)
657.xz_s (avg) (percentage)
657.xz_s (max)
657.xz_s (max) (percentage)


Report Time: 0.33s
Name Current %
508.namd_r 3492.000 -
510.parest_r 6716.000 -
511.povray_r 479.000 -
526.blender_r 12800.000 -
600.perlbench_s 2291.000 1.46%
602.gcc_s 5063.000 -
603.bwaves_s 10567.000 -
605.mcf_s 7372.000 -
607.cactuBSSN_s 5187.000 2.84%
619.lbm_s 35716.000 16.60%
620.omnetpp_s 4462.000 -
621.wrf_s 12214.000 -
623.xalancbmk_s 5264.000 -
625.x264_s 4012.000 -
628.pop2_s 14185.000 -
631.deepsjeng_s 4429.000 -
638.imagick_s 5997.000 -
641.leela_s 5216.000 -
644.nab_s 12597.000 -
648.exchange2_s 3440.000 -
649.fotonik3d_s 10284.000 -
654.roms_s 35873.000 -
657.xz_s 2551.000 1.55%
Geometric Mean 6275.817 1.29%
Name Current %
508.namd_r 440488.000 -
510.parest_r 5246042.000 -
511.povray_r 706366.000 -1.15%
526.blender_r 8325138.000 -
600.perlbench_s 1814175.000 -
602.gcc_s 7345832.000 -
603.bwaves_s 46727.000 -
605.mcf_s 17744.000 -
607.cactuBSSN_s 2650715.000 -
619.lbm_s 15045.000 -
620.omnetpp_s 1589133.000 -
621.wrf_s 12412985.000 -
623.xalancbmk_s 3537747.000 -
625.x264_s 361527.000 -
628.pop2_s 24744383.000 -
631.deepsjeng_s 69050.000 -
638.imagick_s 1493756.000 -
641.leela_s 109602.000 -
644.nab_s 144979.000 -
648.exchange2_s 52781.000 -
649.fotonik3d_s 271044.000 -
654.roms_s 583917.000 -
657.xz_s 160283.000 -
Geometric Mean 600992.334 -
Name Current %
508.namd_r 17.000 -
508.namd_r (avg) 17.000 -
508.namd_r (avg) (percentage) 0.500 -
508.namd_r (max) 18.000 -5.26%
508.namd_r (max) (percentage) 0.540 -3.57%
510.parest_r 47.000 -
510.parest_r (avg) 47.000 -
510.parest_r (avg) (percentage) 0.710 -
510.parest_r (max) 23.000 -4.17%
510.parest_r (max) (percentage) 0.350 -2.78%
511.povray_r 3.000 -
511.povray_r (avg) 3.000 -
511.povray_r (avg) (percentage) 0.810 -
511.povray_r (max) 9.000 -
511.povray_r (max) (percentage) 1.980 -4.35%
526.blender_r 84.000 -
526.blender_r (avg) 84.000 -
526.blender_r (avg) (percentage) 0.660 -
526.blender_r (max) 138.000 -4.17%
526.blender_r (max) (percentage) 1.080 -4.42%
600.perlbench_s 24.000 -
600.perlbench_s (avg) 24.000 -
600.perlbench_s (avg) (percentage) 1.070 -
600.perlbench_s (max) 42.000 -
600.perlbench_s (max) (percentage) 1.840 -1.60%
603.bwaves_s 309.000 -
603.bwaves_s (avg) 309.000 -
603.bwaves_s (avg) (percentage) 2.930 -
603.bwaves_s (max) 400.000 -
603.bwaves_s (max) (percentage) 3.790 -1.56%
605.mcf_s 103.000 -4.63%
605.mcf_s (avg) 103.000 -4.63%
605.mcf_s (avg) (percentage) 1.400 -5.41%
605.mcf_s (max) 44.000 -4.35%
605.mcf_s (max) (percentage) 0.610 -3.17%
605.mcf_s (unexplained diff vs previous) 45.000 -
605.mcf_s (unexplained diff vs previous) (percentage) 0.610 -
607.cactuBSSN_s 103.000 3.00%
607.cactuBSSN_s (avg) 103.000 3.00%
607.cactuBSSN_s (avg) (percentage) 1.990 -
607.cactuBSSN_s (max) 136.000 -
607.cactuBSSN_s (max) (percentage) 2.640 -2.22%
619.lbm_s 2407.000 32.98%
619.lbm_s (avg) 2407.000 32.98%
619.lbm_s (avg) (percentage) 6.740 14.04%
619.lbm_s (max) 5928.000 426.00%
619.lbm_s (max) (percentage) 16.600 351.09%
619.lbm_s (unexplained diff vs previous) 5086.000 -
619.lbm_s (unexplained diff vs previous) (percentage) 14.240 -
620.omnetpp_s 66.000 -1.49%
620.omnetpp_s (avg) 66.000 -1.49%
620.omnetpp_s (avg) (percentage) 1.500 -
620.omnetpp_s (max) 74.000 -10.84%
620.omnetpp_s (max) (percentage) 1.680 -10.16%
621.wrf_s 655.000 -
621.wrf_s (avg) 655.000 -
621.wrf_s (avg) (percentage) 5.370 -
621.wrf_s (max) 372.000 -
621.wrf_s (max) (percentage) 3.050 -
623.xalancbmk_s 11.000 -
623.xalancbmk_s (avg) 11.000 -
623.xalancbmk_s (avg) (percentage) 0.220 -
623.xalancbmk_s (max) 11.000 -
623.xalancbmk_s (max) (percentage) 0.210 -4.55%
625.x264_s 16.000 -
625.x264_s (avg) 16.000 -
625.x264_s (avg) (percentage) 0.410 -
625.x264_s (max) 18.000 -
625.x264_s (max) (percentage) 0.460 -
628.pop2_s 106.000 -
628.pop2_s (avg) 106.000 -
628.pop2_s (avg) (percentage) 0.750 -
628.pop2_s (max) 86.000 -1.15%
628.pop2_s (max) (percentage) 0.610 -1.61%
631.deepsjeng_s 17.000 -
631.deepsjeng_s (avg) 17.000 -
631.deepsjeng_s (avg) (percentage) 0.400 -
631.deepsjeng_s (max) 12.000 -
631.deepsjeng_s (max) (percentage) 0.290 -
638.imagick_s 47.000 -
638.imagick_s (avg) 47.000 -
638.imagick_s (avg) (percentage) 0.790 -
638.imagick_s (max) 31.000 -
638.imagick_s (max) (percentage) 0.520 -1.89%
641.leela_s 22.000 -
641.leela_s (avg) 22.000 -
641.leela_s (avg) (percentage) 0.440 -
641.leela_s (max) 15.000 -6.25%
641.leela_s (max) (percentage) 0.300 -3.23%
644.nab_s 68.000 -
644.nab_s (avg) 68.000 -
644.nab_s (avg) (percentage) 0.540 -
644.nab_s (max) 39.000 -2.50%
644.nab_s (max) (percentage) 0.310 -3.13%
648.exchange2_s 16.000 -
648.exchange2_s (avg) 16.000 -
648.exchange2_s (avg) (percentage) 0.480 -
648.exchange2_s (max) 32.000 -5.88%
648.exchange2_s (max) (percentage) 0.950 -4.04%
649.fotonik3d_s 171.000 -
649.fotonik3d_s (avg) 171.000 -
649.fotonik3d_s (avg) (percentage) 1.670 -
649.fotonik3d_s (max) 200.000 -
649.fotonik3d_s (max) (percentage) 1.950 -1.02%
654.roms_s 982.000 -
654.roms_s (avg) 982.000 -
654.roms_s (avg) (percentage) 2.740 -
654.roms_s (max) 1571.000 -1.57%
654.roms_s (max) (percentage) 4.380 -1.79%
657.xz_s 41.000 -
657.xz_s (avg) 41.000 -
657.xz_s (avg) (percentage) 1.640 -
657.xz_s (max) 19.000 -5.00%
657.xz_s (max) (percentage) 0.780 -2.50%
Geometric Mean 12.695 6.53%