Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=cd51849c90e8fd13779bec69f5d4c7aadf03a532 (+ 16 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/4b51c7c9131280edd1c97053e2b07a33ec0b5501 (unchanged)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=2e0c0ff95ca0e3122eb5b906ee26a31f284ce5ab (unchanged)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=288a2f83ed42ce91cf92c2b08dad298a3da0cd9a (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-cpu2017fast--gnu-aarch64-master-O2-build/106/
Filter

gnu-aarch64-master-O2 test results

Run Order Start Time Duration
Current 0106 (binutils-2_41-release-01227-gcd51849c90e) 2023-11-23T22:34:30 0:00:00
Previous 0103 (2-changed-components) 2023-11-20T13:50:45 0:00:00
Baseline 0001 (4-changed-components) 2023-03-26T18:17:00 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 48 15
Performance Improvements 3 1
Added Tests 1 108
Unchanged Tests 842 770
Total Tests 894

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
619.lbm_s 18.57% 28368.000 33637.000 - 18.39% -
607.cactuBSSN_s 5.92% 4714.000 4993.000 - 5.16% -
603.bwaves_s 5.59% 8949.000 9449.000 - 5.98% -
621.wrf_s 3.63% 9150.000 9482.000 - 3.98% -
654.roms_s 3.43% 27536.000 28481.000 - 3.99% -
649.fotonik3d_s 3.06% 9790.000 10090.000 - 2.82% -
605.mcf_s 2.40% 6779.000 6942.000 - 0.73% -
511.povray_r 2.15% 419.000 428.000 - 0.71% -
628.pop2_s 1.98% 10691.000 10903.000 - 2.46% -
657.xz_s 1.52% 2230.000 2264.000 - 1.62% -
602.gcc_s 1.51% 4298.000 4363.000 - 1.30% -
625.x264_s 1.43% 2582.000 2619.000 - 0.00% -
638.imagick_s 1.20% 3342.000 3382.000 - 1.08% -
510.parest_r 1.19% 5711.000 5779.000 - 2.52% -
600.perlbench_s 1.12% 2060.000 2083.000 - 1.21% -
526.blender_r 1.07% 9999.000 10106.000 - 0.53% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
619.lbm_s 18.59% 1259.000 1493.000 - 0.00% -
619.lbm_s (avg) 18.59% 1259.000 1493.000 - 0.00% -
619.lbm_s (max) 17.65% 85.000 100.000 - 0.00% -
511.povray_r (max) 11.11% 9.000 10.000 - 0.00% -
607.cactuBSSN_s (max) 5.96% 151.000 160.000 - 0.00% -
607.cactuBSSN_s 5.83% 103.000 109.000 - 0.00% -
607.cactuBSSN_s (avg) 5.83% 103.000 109.000 - 0.00% -
603.bwaves_s (max) 5.62% 89.000 94.000 - 0.00% -
603.bwaves_s 5.26% 114.000 120.000 - 0.00% -
603.bwaves_s (avg) 5.26% 114.000 120.000 - 0.00% -
600.perlbench_s 4.76% 21.000 22.000 - 0.00% -
600.perlbench_s (avg) 4.76% 21.000 22.000 - 0.00% -
625.x264_s (max) 3.70% 27.000 28.000 - 0.00% -
654.roms_s 3.59% 195.000 202.000 - 0.00% -
654.roms_s (avg) 3.59% 195.000 202.000 - 0.00% -
654.roms_s (max) 3.25% 154.000 159.000 - 0.00% -
605.mcf_s 2.94% 68.000 70.000 - 0.00% -
605.mcf_s (avg) 2.94% 68.000 70.000 - 0.00% -
649.fotonik3d_s (max) 2.94% 170.000 175.000 - 0.00% -
605.mcf_s (max) 2.86% 105.000 108.000 - 0.00% -
657.xz_s (max) 2.56% 39.000 40.000 - 0.00% -
649.fotonik3d_s 2.30% 87.000 89.000 - 0.00% -
649.fotonik3d_s (avg) 2.30% 87.000 89.000 - 0.00% -
620.omnetpp_s 2.27% 44.000 45.000 - 0.00% -
620.omnetpp_s (avg) 2.27% 44.000 45.000 - 0.00% -
628.pop2_s (max) 2.16% 231.000 236.000 - 0.00% -
628.pop2_s 1.83% 109.000 111.000 - 0.00% -
628.pop2_s (avg) 1.83% 109.000 111.000 - 0.00% -
526.blender_r (max) 1.22% 82.000 83.000 - 0.00% -
526.blender_r 1.18% 85.000 86.000 - 0.00% -
526.blender_r (avg) 1.18% 85.000 86.000 - 0.00% -
620.omnetpp_s (max) 1.09% 92.000 93.000 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
627.cam4_s -2.65% 151.000 147.000 - 0.00% -
648.exchange2_s -1.12% 2227.000 2202.000 - 0.14% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
508.namd_r (max) -7.14% 14.000 13.000 - 0.00% -

Added Tests - Score
nb_execution_successful

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
619.lbm_s 18.39% 28412.000 33637.000 - 18.57% -
603.bwaves_s 5.98% 8916.000 9449.000 - 5.59% -
607.cactuBSSN_s 5.16% 4748.000 4993.000 - 5.92% -
654.roms_s 3.99% 27387.000 28481.000 - 3.43% -
621.wrf_s 3.98% 9119.000 9482.000 - 3.63% -
649.fotonik3d_s 2.82% 9813.000 10090.000 - 3.06% -
510.parest_r 2.52% 5637.000 5779.000 - 1.19% -
628.pop2_s 2.46% 10641.000 10903.000 - 1.98% -
657.xz_s 1.62% 2228.000 2264.000 - 1.52% -
620.omnetpp_s 1.44% 4163.000 4223.000 - 0.88% -
602.gcc_s 1.30% 4307.000 4363.000 - 1.51% -
600.perlbench_s 1.21% 2058.000 2083.000 - 1.12% -
638.imagick_s 1.08% 3346.000 3382.000 - 1.20% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -95.83% 24.000 1.000 - 0.00% -
nb_total_tests -95.83% 24.000 1.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
641.leela_s -1.49% 4906.000 4833.000 - 0.98% -

Added Tests - Execution
625.x264_s
627.cam4_s

Added Tests - sample variability
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
600.perlbench_s
600.perlbench_s (avg)
600.perlbench_s (avg) (percentage)
600.perlbench_s (max)
600.perlbench_s (max) (percentage)
603.bwaves_s
603.bwaves_s (avg)
603.bwaves_s (avg) (percentage)
603.bwaves_s (max)
603.bwaves_s (max) (percentage)
605.mcf_s
605.mcf_s (avg)
605.mcf_s (avg) (percentage)
605.mcf_s (max)
605.mcf_s (max) (percentage)
607.cactuBSSN_s
607.cactuBSSN_s (avg)
607.cactuBSSN_s (avg) (percentage)
607.cactuBSSN_s (max)
607.cactuBSSN_s (max) (percentage)
619.lbm_s
619.lbm_s (avg)
619.lbm_s (avg) (percentage)
619.lbm_s (max)
619.lbm_s (max) (percentage)
620.omnetpp_s
620.omnetpp_s (avg)
620.omnetpp_s (avg) (percentage)
620.omnetpp_s (max)
620.omnetpp_s (max) (percentage)
623.xalancbmk_s
623.xalancbmk_s (avg)
623.xalancbmk_s (avg) (percentage)
623.xalancbmk_s (max)
623.xalancbmk_s (max) (percentage)
625.x264_s
625.x264_s (avg)
625.x264_s (avg) (percentage)
625.x264_s (max)
625.x264_s (max) (percentage)
628.pop2_s
628.pop2_s (avg)
628.pop2_s (avg) (percentage)
628.pop2_s (max)
628.pop2_s (max) (percentage)
631.deepsjeng_s
631.deepsjeng_s (avg)
631.deepsjeng_s (avg) (percentage)
631.deepsjeng_s (max)
631.deepsjeng_s (max) (percentage)
638.imagick_s
638.imagick_s (avg)
638.imagick_s (avg) (percentage)
638.imagick_s (max)
638.imagick_s (max) (percentage)
641.leela_s
641.leela_s (avg)
641.leela_s (avg) (percentage)
641.leela_s (max)
641.leela_s (max) (percentage)
644.nab_s
644.nab_s (avg)
644.nab_s (avg) (percentage)
644.nab_s (max)
644.nab_s (max) (percentage)
648.exchange2_s
648.exchange2_s (avg)
648.exchange2_s (avg) (percentage)
648.exchange2_s (max)
648.exchange2_s (max) (percentage)
649.fotonik3d_s
649.fotonik3d_s (avg)
649.fotonik3d_s (avg) (percentage)
649.fotonik3d_s (max)
649.fotonik3d_s (max) (percentage)
654.roms_s
654.roms_s (avg)
654.roms_s (avg) (percentage)
654.roms_s (max)
654.roms_s (max) (percentage)
657.xz_s
657.xz_s (avg)
657.xz_s (avg) (percentage)
657.xz_s (max)
657.xz_s (max) (percentage)

Added Tests - Score
nb_execution_successful


Report Time: 0.34s
Name Current %
508.namd_r 2410.000 -
510.parest_r 5779.000 1.19%
511.povray_r 428.000 2.15%
526.blender_r 10106.000 1.07%
600.perlbench_s 2083.000 1.12%
602.gcc_s 4363.000 1.51%
603.bwaves_s 9449.000 5.59%
605.mcf_s 6942.000 2.40%
607.cactuBSSN_s 4993.000 5.92%
619.lbm_s 33637.000 18.57%
620.omnetpp_s 4223.000 -
621.wrf_s 9482.000 3.63%
623.xalancbmk_s 3774.000 -
625.x264_s 2619.000 1.43%
627.cam4_s 147.000 -2.65%
628.pop2_s 10903.000 1.98%
631.deepsjeng_s 3820.000 -
638.imagick_s 3382.000 1.20%
641.leela_s 4833.000 -
644.nab_s 10469.000 -
648.exchange2_s 2202.000 -1.12%
649.fotonik3d_s 10090.000 3.06%
654.roms_s 28481.000 3.43%
657.xz_s 2264.000 1.52%
Geometric Mean 4447.267 2.21%
Name Current %
508.namd_r 8.000 -
508.namd_r (avg) 8.000 -
508.namd_r (avg) (percentage) 0.370 -
508.namd_r (max) 13.000 -7.14%
508.namd_r (max) (percentage) 0.580 -
510.parest_r 43.000 -
510.parest_r (avg) 43.000 -
510.parest_r (avg) (percentage) 0.760 -
510.parest_r (max) 29.000 -
510.parest_r (max) (percentage) 0.510 -
511.povray_r 4.000 -
511.povray_r (avg) 4.000 -
511.povray_r (avg) (percentage) 1.020 -
511.povray_r (max) 10.000 11.11%
511.povray_r (max) (percentage) 2.360 -
526.blender_r 86.000 1.18%
526.blender_r (avg) 86.000 1.18%
526.blender_r (avg) (percentage) 0.860 -
526.blender_r (max) 83.000 1.22%
526.blender_r (max) (percentage) 0.830 -
600.perlbench_s 22.000 4.76%
600.perlbench_s (avg) 22.000 4.76%
600.perlbench_s (avg) (percentage) 1.060 -
600.perlbench_s (max) 24.000 -
600.perlbench_s (max) (percentage) 1.200 -
603.bwaves_s 120.000 5.26%
603.bwaves_s (avg) 120.000 5.26%
603.bwaves_s (avg) (percentage) 1.280 -
603.bwaves_s (max) 94.000 5.62%
603.bwaves_s (max) (percentage) 1.000 -
605.mcf_s 70.000 2.94%
605.mcf_s (avg) 70.000 2.94%
605.mcf_s (avg) (percentage) 1.010 -
605.mcf_s (max) 108.000 2.86%
605.mcf_s (max) (percentage) 1.560 -
607.cactuBSSN_s 109.000 5.83%
607.cactuBSSN_s (avg) 109.000 5.83%
607.cactuBSSN_s (avg) (percentage) 2.200 -
607.cactuBSSN_s (max) 160.000 5.96%
607.cactuBSSN_s (max) (percentage) 3.210 -
619.lbm_s 1493.000 18.59%
619.lbm_s (avg) 1493.000 18.59%
619.lbm_s (avg) (percentage) 4.440 -
619.lbm_s (max) 100.000 17.65%
619.lbm_s (max) (percentage) 0.300 -
620.omnetpp_s 45.000 2.27%
620.omnetpp_s (avg) 45.000 2.27%
620.omnetpp_s (avg) (percentage) 1.070 -
620.omnetpp_s (max) 93.000 1.09%
620.omnetpp_s (max) (percentage) 2.220 -
623.xalancbmk_s 22.000 -
623.xalancbmk_s (avg) 22.000 -
623.xalancbmk_s (avg) (percentage) 0.600 -
623.xalancbmk_s (max) 47.000 -
623.xalancbmk_s (max) (percentage) 1.260 -
625.x264_s 17.000 -
625.x264_s (avg) 17.000 -
625.x264_s (avg) (percentage) 0.680 -
625.x264_s (max) 28.000 3.70%
625.x264_s (max) (percentage) 1.080 -
628.pop2_s 111.000 1.83%
628.pop2_s (avg) 111.000 1.83%
628.pop2_s (avg) (percentage) 1.020 -
628.pop2_s (max) 236.000 2.16%
628.pop2_s (max) (percentage) 2.170 -
631.deepsjeng_s 18.000 -
631.deepsjeng_s (avg) 18.000 -
631.deepsjeng_s (avg) (percentage) 0.480 -
631.deepsjeng_s (max) 36.000 -
631.deepsjeng_s (max) (percentage) 0.960 -
638.imagick_s 17.000 -
638.imagick_s (avg) 17.000 -
638.imagick_s (avg) (percentage) 0.510 -
638.imagick_s (max) 34.000 -
638.imagick_s (max) (percentage) 1.030 -
641.leela_s 21.000 -
641.leela_s (avg) 21.000 -
641.leela_s (avg) (percentage) 0.440 -
641.leela_s (max) 19.000 -
641.leela_s (max) (percentage) 0.400 -
644.nab_s 58.000 -
644.nab_s (avg) 58.000 -
644.nab_s (avg) (percentage) 0.560 -
644.nab_s (max) 68.000 -
644.nab_s (max) (percentage) 0.650 -
648.exchange2_s 16.000 -
648.exchange2_s (avg) 16.000 -
648.exchange2_s (avg) (percentage) 0.730 -
648.exchange2_s (max) 33.000 -
648.exchange2_s (max) (percentage) 1.520 -
649.fotonik3d_s 89.000 2.30%
649.fotonik3d_s (avg) 89.000 2.30%
649.fotonik3d_s (avg) (percentage) 0.890 -
649.fotonik3d_s (max) 175.000 2.94%
649.fotonik3d_s (max) (percentage) 1.740 -
654.roms_s 202.000 3.59%
654.roms_s (avg) 202.000 3.59%
654.roms_s (avg) (percentage) 0.710 -
654.roms_s (max) 159.000 3.25%
654.roms_s (max) (percentage) 0.560 -
657.xz_s 16.000 -
657.xz_s (avg) 16.000 -
657.xz_s (avg) (percentage) 0.740 -
657.xz_s (max) 40.000 2.56%
657.xz_s (max) (percentage) 1.780 -
Geometric Mean 9.692 1.37%