Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=07d8d4bd2ad213281be502d6e56c19e0269b8967 (+ 420 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/f5fb9ff2396fd41fdd2e6d35a412e936d2d42f75 (+ 976 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=14126ff059e98e9236633741fd323a1116299872 (+ 123 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=44ec516fcb54477932225f71261c39cad7f532af (+ 17836 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-cpu2017fast--gnu-aarch64-master-Os-build/62/
Filter

gnu-aarch64-master-Os test results

Run Order Start Time Duration
Current 0062 (4-changed-components) 2023-07-04T18:06:18 0:00:00
Previous 0040 (4-changed-components) 2023-06-10T21:53:16 0:00:00
Baseline 0001 (4-changed-components) 2023-02-27T01:05:11 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 18 2
Performance Improvements 44 17
Added Tests 0 110
Unchanged Tests 892 825
Total Tests 954

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
620.omnetpp_s 1.87% 4395.000 4477.000 - -0.93% -
603.bwaves_s 1.37% 10376.000 10518.000 - -5.47% -
607.cactuBSSN_s 1.12% 4988.000 5044.000 - -2.53% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
620.omnetpp_s (unexplained diff vs previous) 164.52% 31.000 82.000 - 0.00% -
620.omnetpp_s (unexplained diff vs previous) (percentage) 157.75% 0.710 1.830 - 0.00% -
620.omnetpp_s (max) 62.75% 51.000 83.000 - 0.00% -
620.omnetpp_s (max) (percentage) 58.47% 1.180 1.870 - 0.00% -
620.omnetpp_s 4.69% 64.000 67.000 - 0.00% -
620.omnetpp_s (avg) 4.69% 64.000 67.000 - 0.00% -
638.imagick_s 2.17% 46.000 47.000 - 0.00% -
638.imagick_s (avg) 2.17% 46.000 47.000 - 0.00% -
620.omnetpp_s (avg) (percentage) 2.04% 1.470 1.500 - 0.00% -
644.nab_s 1.49% 67.000 68.000 - 0.00% -
644.nab_s (avg) 1.49% 67.000 68.000 - 0.00% -
603.bwaves_s 1.32% 304.000 308.000 - 0.00% -
603.bwaves_s (avg) 1.32% 304.000 308.000 - 0.00% -
607.cactuBSSN_s 1.01% 99.000 100.000 - 0.00% -
607.cactuBSSN_s (avg) 1.01% 99.000 100.000 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
511.povray_r -10.04% 528.000 475.000 - -10.21% -
623.xalancbmk_s -4.55% 5476.000 5227.000 - -0.40% -
526.blender_r -2.70% 13156.000 12801.000 - -2.89% -
621.wrf_s -2.10% 12421.000 12160.000 - -4.10% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
511.povray_r -25.00% 4.000 3.000 - 0.00% -
511.povray_r (avg) -25.00% 4.000 3.000 - 0.00% -
511.povray_r (max) -18.18% 11.000 9.000 - 0.00% -
605.mcf_s (max) (percentage) -8.70% 0.690 0.630 - 0.00% -
644.nab_s (max) (percentage) -8.57% 0.350 0.320 - 0.00% -
623.xalancbmk_s -8.33% 12.000 11.000 - 0.00% -
623.xalancbmk_s (avg) -8.33% 12.000 11.000 - 0.00% -
623.xalancbmk_s (max) -8.33% 12.000 11.000 - 0.00% -
605.mcf_s (max) -8.00% 50.000 46.000 - 0.00% -
510.parest_r (max) (percentage) -7.69% 0.390 0.360 - 0.00% -
510.parest_r (max) -7.69% 26.000 24.000 - 0.00% -
526.blender_r (max) -7.69% 156.000 144.000 - 0.00% -
631.deepsjeng_s (max) -7.69% 13.000 12.000 - 0.00% -
644.nab_s (max) -6.98% 43.000 40.000 - 0.00% -
625.x264_s (max) -5.26% 19.000 18.000 - 0.00% -
508.namd_r (max) (percentage) -5.08% 0.590 0.560 - 0.00% -
526.blender_r (max) (percentage) -5.04% 1.190 1.130 - 0.00% -
508.namd_r (max) -5.00% 20.000 19.000 - 0.00% -
648.exchange2_s (max) (percentage) -4.81% 1.040 0.990 - 0.00% -
511.povray_r (max) (percentage) -4.61% 2.170 2.070 - 0.00% -
625.x264_s (max) (percentage) -4.08% 0.490 0.470 - 0.00% -
631.deepsjeng_s (max) (percentage) -3.33% 0.300 0.290 - 0.00% -
628.pop2_s (max) -3.33% 90.000 87.000 - 0.00% -
628.pop2_s (max) (percentage) -3.13% 0.640 0.620 - 0.00% -
638.imagick_s (max) -3.12% 32.000 31.000 - 0.00% -
648.exchange2_s (max) -2.86% 35.000 34.000 - 0.00% -
657.xz_s (max) (percentage) -2.44% 0.820 0.800 - 0.00% -
654.roms_s (max) -2.39% 1635.000 1596.000 - 0.00% -
526.blender_r -2.33% 86.000 84.000 - 0.00% -
526.blender_r (avg) -2.33% 86.000 84.000 - 0.00% -
621.wrf_s -2.25% 667.000 652.000 - 0.00% -
621.wrf_s (avg) -2.25% 667.000 652.000 - 0.00% -
654.roms_s (max) (percentage) -2.19% 4.560 4.460 - 0.00% -
607.cactuBSSN_s (max) (percentage) -2.17% 2.760 2.700 - 0.00% -
621.wrf_s (max) -2.11% 380.000 372.000 - 0.00% -
603.bwaves_s (max) (percentage) -2.04% 3.930 3.850 - 0.00% -
638.imagick_s (max) (percentage) -1.85% 0.540 0.530 - 0.00% -
649.fotonik3d_s (max) -1.46% 205.000 202.000 - 0.00% -
600.perlbench_s (max) (percentage) -1.06% 1.890 1.870 - 0.00% -
649.fotonik3d_s (max) (percentage) -1.01% 1.990 1.970 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
644.nab_s 1.90% 12363.000 12598.000 - 0.91% -
648.exchange2_s 1.42% 3388.000 3436.000 - 0.59% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
619.lbm_s -16.09% 36505.000 30630.000 - 0.23% -
511.povray_r -10.21% 529.000 475.000 - -10.04% -
657.xz_s -7.92% 2728.000 2512.000 - -0.04% -
600.perlbench_s -5.68% 2394.000 2258.000 - -0.66% -
603.bwaves_s -5.47% 11127.000 10518.000 - 1.37% -
621.wrf_s -4.10% 12680.000 12160.000 - -2.10% -
654.roms_s -3.14% 36958.000 35796.000 - -0.19% -
649.fotonik3d_s -2.96% 10609.000 10295.000 - -0.40% -
526.blender_r -2.89% 13182.000 12801.000 - -2.70% -
628.pop2_s -2.81% 14534.000 14126.000 - 0.37% -
607.cactuBSSN_s -2.53% 5175.000 5044.000 - 1.12% -
625.x264_s -2.02% 4062.000 3980.000 - 0.08% -
638.imagick_s -1.97% 6078.000 5958.000 - 0.24% -
631.deepsjeng_s -1.81% 4475.000 4394.000 - 0.34% -
508.namd_r -1.68% 3520.000 3461.000 - 0.00% -
602.gcc_s -1.60% 5117.000 5035.000 - 0.32% -
510.parest_r -1.24% 6757.000 6673.000 - -0.01% -

Added Tests - sample variability
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
600.perlbench_s
600.perlbench_s (avg)
600.perlbench_s (avg) (percentage)
600.perlbench_s (max)
600.perlbench_s (max) (percentage)
603.bwaves_s
603.bwaves_s (avg)
603.bwaves_s (avg) (percentage)
603.bwaves_s (max)
603.bwaves_s (max) (percentage)
605.mcf_s
605.mcf_s (avg)
605.mcf_s (avg) (percentage)
605.mcf_s (max)
605.mcf_s (max) (percentage)
607.cactuBSSN_s
607.cactuBSSN_s (avg)
607.cactuBSSN_s (avg) (percentage)
607.cactuBSSN_s (max)
607.cactuBSSN_s (max) (percentage)
619.lbm_s
619.lbm_s (avg)
619.lbm_s (avg) (percentage)
619.lbm_s (max)
619.lbm_s (max) (percentage)
620.omnetpp_s
620.omnetpp_s (avg)
620.omnetpp_s (avg) (percentage)
620.omnetpp_s (max)
620.omnetpp_s (max) (percentage)
621.wrf_s
621.wrf_s (avg)
621.wrf_s (avg) (percentage)
621.wrf_s (max)
621.wrf_s (max) (percentage)
623.xalancbmk_s
623.xalancbmk_s (avg)
623.xalancbmk_s (avg) (percentage)
623.xalancbmk_s (max)
623.xalancbmk_s (max) (percentage)
625.x264_s
625.x264_s (avg)
625.x264_s (avg) (percentage)
625.x264_s (max)
625.x264_s (max) (percentage)
628.pop2_s
628.pop2_s (avg)
628.pop2_s (avg) (percentage)
628.pop2_s (max)
628.pop2_s (max) (percentage)
631.deepsjeng_s
631.deepsjeng_s (avg)
631.deepsjeng_s (avg) (percentage)
631.deepsjeng_s (max)
631.deepsjeng_s (max) (percentage)
638.imagick_s
638.imagick_s (avg)
638.imagick_s (avg) (percentage)
638.imagick_s (max)
638.imagick_s (max) (percentage)
641.leela_s
641.leela_s (avg)
641.leela_s (avg) (percentage)
641.leela_s (max)
641.leela_s (max) (percentage)
644.nab_s
644.nab_s (avg)
644.nab_s (avg) (percentage)
644.nab_s (max)
644.nab_s (max) (percentage)
648.exchange2_s
648.exchange2_s (avg)
648.exchange2_s (avg) (percentage)
648.exchange2_s (max)
648.exchange2_s (max) (percentage)
649.fotonik3d_s
649.fotonik3d_s (avg)
649.fotonik3d_s (avg) (percentage)
649.fotonik3d_s (max)
649.fotonik3d_s (max) (percentage)
654.roms_s
654.roms_s (avg)
654.roms_s (avg) (percentage)
654.roms_s (max)
654.roms_s (max) (percentage)
657.xz_s
657.xz_s (avg)
657.xz_s (avg) (percentage)
657.xz_s (max)
657.xz_s (max) (percentage)


Report Time: 0.36s
Name Current %
508.namd_r 3461.000 -
510.parest_r 6673.000 -
511.povray_r 475.000 -10.04%
526.blender_r 12801.000 -2.70%
600.perlbench_s 2258.000 -
602.gcc_s 5035.000 -
603.bwaves_s 10518.000 1.37%
605.mcf_s 7327.000 -
607.cactuBSSN_s 5044.000 1.12%
619.lbm_s 30630.000 -
620.omnetpp_s 4477.000 1.87%
621.wrf_s 12160.000 -2.10%
623.xalancbmk_s 5227.000 -4.55%
625.x264_s 3980.000 -
628.pop2_s 14126.000 -
631.deepsjeng_s 4394.000 -
638.imagick_s 5958.000 -
641.leela_s 5188.000 -
644.nab_s 12598.000 -
648.exchange2_s 3436.000 -
649.fotonik3d_s 10295.000 -
654.roms_s 35796.000 -
657.xz_s 2512.000 -
Geometric Mean 6196.170 -
Name Current %
508.namd_r 440484.000 -
510.parest_r 5249358.000 -
511.povray_r 714574.000 -
526.blender_r 8325154.000 -
600.perlbench_s 1831087.000 -
602.gcc_s 7319884.000 -
603.bwaves_s 46807.000 -
605.mcf_s 17744.000 -
607.cactuBSSN_s 2643091.000 -
619.lbm_s 15045.000 -
620.omnetpp_s 1585037.000 -
621.wrf_s 12423581.000 -
623.xalancbmk_s 3537835.000 -
625.x264_s 361635.000 -
628.pop2_s 24733071.000 -
631.deepsjeng_s 69074.000 -
638.imagick_s 1493784.000 -
641.leela_s 109602.000 -
644.nab_s 144995.000 -
648.exchange2_s 52861.000 -
649.fotonik3d_s 271180.000 -
654.roms_s 588381.000 -
657.xz_s 160291.000 -
Geometric Mean 601647.137 -
Name Current %
508.namd_r 17.000 -
508.namd_r (avg) 17.000 -
508.namd_r (avg) (percentage) 0.500 -
508.namd_r (max) 19.000 -5.00%
508.namd_r (max) (percentage) 0.560 -5.08%
510.parest_r 47.000 -
510.parest_r (avg) 47.000 -
510.parest_r (avg) (percentage) 0.710 -
510.parest_r (max) 24.000 -7.69%
510.parest_r (max) (percentage) 0.360 -7.69%
511.povray_r 3.000 -25.00%
511.povray_r (avg) 3.000 -25.00%
511.povray_r (avg) (percentage) 0.810 -
511.povray_r (max) 9.000 -18.18%
511.povray_r (max) (percentage) 2.070 -4.61%
526.blender_r 84.000 -2.33%
526.blender_r (avg) 84.000 -2.33%
526.blender_r (avg) (percentage) 0.660 -
526.blender_r (max) 144.000 -7.69%
526.blender_r (max) (percentage) 1.130 -5.04%
600.perlbench_s 24.000 -
600.perlbench_s (avg) 24.000 -
600.perlbench_s (avg) (percentage) 1.070 -
600.perlbench_s (max) 42.000 -
600.perlbench_s (max) (percentage) 1.870 -1.06%
603.bwaves_s 308.000 1.32%
603.bwaves_s (avg) 308.000 1.32%
603.bwaves_s (avg) (percentage) 2.930 -
603.bwaves_s (max) 404.000 -
603.bwaves_s (max) (percentage) 3.850 -2.04%
605.mcf_s 108.000 -
605.mcf_s (avg) 108.000 -
605.mcf_s (avg) (percentage) 1.480 -
605.mcf_s (max) 46.000 -8.00%
605.mcf_s (max) (percentage) 0.630 -8.70%
607.cactuBSSN_s 100.000 1.01%
607.cactuBSSN_s (avg) 100.000 1.01%
607.cactuBSSN_s (avg) (percentage) 1.990 -
607.cactuBSSN_s (max) 136.000 -
607.cactuBSSN_s (max) (percentage) 2.700 -2.17%
619.lbm_s 1810.000 -
619.lbm_s (avg) 1810.000 -
619.lbm_s (avg) (percentage) 5.910 -
619.lbm_s (max) 1127.000 -
619.lbm_s (max) (percentage) 3.680 -
620.omnetpp_s 67.000 4.69%
620.omnetpp_s (avg) 67.000 4.69%
620.omnetpp_s (avg) (percentage) 1.500 2.04%
620.omnetpp_s (max) 83.000 62.75%
620.omnetpp_s (max) (percentage) 1.870 58.47%
620.omnetpp_s (unexplained diff vs previous) 82.000 164.52%
620.omnetpp_s (unexplained diff vs previous) (percentage) 1.830 157.75%
621.wrf_s 652.000 -2.25%
621.wrf_s (avg) 652.000 -2.25%
621.wrf_s (avg) (percentage) 5.370 -
621.wrf_s (max) 372.000 -2.11%
621.wrf_s (max) (percentage) 3.060 -
623.xalancbmk_s 11.000 -8.33%
623.xalancbmk_s (avg) 11.000 -8.33%
623.xalancbmk_s (avg) (percentage) 0.220 -
623.xalancbmk_s (max) 11.000 -8.33%
623.xalancbmk_s (max) (percentage) 0.220 -
625.x264_s 16.000 -
625.x264_s (avg) 16.000 -
625.x264_s (avg) (percentage) 0.410 -
625.x264_s (max) 18.000 -5.26%
625.x264_s (max) (percentage) 0.470 -4.08%
628.pop2_s 105.000 -
628.pop2_s (avg) 105.000 -
628.pop2_s (avg) (percentage) 0.750 -
628.pop2_s (max) 87.000 -3.33%
628.pop2_s (max) (percentage) 0.620 -3.13%
631.deepsjeng_s 17.000 -
631.deepsjeng_s (avg) 17.000 -
631.deepsjeng_s (avg) (percentage) 0.400 -
631.deepsjeng_s (max) 12.000 -7.69%
631.deepsjeng_s (max) (percentage) 0.290 -3.33%
638.imagick_s 47.000 2.17%
638.imagick_s (avg) 47.000 2.17%
638.imagick_s (avg) (percentage) 0.790 -
638.imagick_s (max) 31.000 -3.12%
638.imagick_s (max) (percentage) 0.530 -1.85%
641.leela_s 22.000 -
641.leela_s (avg) 22.000 -
641.leela_s (avg) (percentage) 0.440 -
641.leela_s (max) 16.000 -
641.leela_s (max) (percentage) 0.310 -
644.nab_s 68.000 1.49%
644.nab_s (avg) 68.000 1.49%
644.nab_s (avg) (percentage) 0.540 -
644.nab_s (max) 40.000 -6.98%
644.nab_s (max) (percentage) 0.320 -8.57%
648.exchange2_s 16.000 -
648.exchange2_s (avg) 16.000 -
648.exchange2_s (avg) (percentage) 0.480 -
648.exchange2_s (max) 34.000 -2.86%
648.exchange2_s (max) (percentage) 0.990 -4.81%
649.fotonik3d_s 171.000 -
649.fotonik3d_s (avg) 171.000 -
649.fotonik3d_s (avg) (percentage) 1.670 -
649.fotonik3d_s (max) 202.000 -1.46%
649.fotonik3d_s (max) (percentage) 1.970 -1.01%
654.roms_s 980.000 -
654.roms_s (avg) 980.000 -
654.roms_s (avg) (percentage) 2.740 -
654.roms_s (max) 1596.000 -2.39%
654.roms_s (max) (percentage) 4.460 -2.19%
657.xz_s 41.000 -
657.xz_s (avg) 41.000 -
657.xz_s (avg) (percentage) 1.640 -
657.xz_s (max) 20.000 -
657.xz_s (max) (percentage) 0.800 -2.44%
Geometric Mean 11.922 -