Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=d6ac292e5fecde8fe92f79e83c69d80766f57976 (+ 48 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/1bcb7fe60544bba8b88028f9ffa062336d399664 (+ 114 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=dae3cf4134d476a4b4ef86fd7012231d6436c15e (+ 10 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=288a2f83ed42ce91cf92c2b08dad298a3da0cd9a (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-cpu2017fast--gnu-aarch64-master-O2-build/100/
Filter

gnu-aarch64-master-O2 test results

Run Order Start Time Duration
Current 0100 (3-changed-components) 2023-11-14T09:03:21 0:00:00
Previous 0099 (3-changed-components) 2023-11-11T10:12:51 0:00:00
Baseline 0001 (4-changed-components) 2023-03-26T18:17:00 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 10 4
Performance Improvements 4 6
Added Tests 2 108
Unchanged Tests 890 788
Total Tests 906

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
628.pop2_s 1.17% 10597.000 10721.000 - 0.75% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
510.parest_r (max) 3.57% 28.000 29.000 - 0.00% -
623.xalancbmk_s (max) 2.17% 46.000 47.000 - 0.00% -
644.nab_s (max) 1.49% 67.000 68.000 - 0.00% -
628.pop2_s (max) 1.31% 229.000 232.000 - 0.00% -
526.blender_r (max) 1.22% 82.000 83.000 - 0.00% -
526.blender_r 1.18% 85.000 86.000 - 0.00% -
526.blender_r (avg) 1.18% 85.000 86.000 - 0.00% -

Performance Regressions - Score Δ Previous Current σ Δ (B) σ (B)
nb_compile_successful -95.83% 24.000 1.000 - -95.83% -
nb_total_tests -95.83% 24.000 1.000 - -95.83% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
605.mcf_s -1.23% 6825.000 6741.000 - -2.19% -
621.wrf_s -1.13% 9215.000 9111.000 - -0.09% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
508.namd_r (max) -7.14% 14.000 13.000 - 0.00% -
625.x264_s (max) -3.57% 28.000 27.000 - 0.00% -

Added Tests - Execution
627.cam4_s

Added Tests - Score
nb_execution_successful

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
648.exchange2_s 1.50% 2199.000 2232.000 - 0.72% -
510.parest_r 1.15% 5637.000 5702.000 - 0.35% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -95.83% 24.000 1.000 - -95.83% -
nb_total_tests -95.83% 24.000 1.000 - -95.83% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
605.mcf_s -2.19% 6892.000 6741.000 - -1.23% -
641.leela_s -2.06% 4906.000 4805.000 - 0.48% -
620.omnetpp_s -1.95% 4163.000 4082.000 - -0.15% -
511.povray_r -1.88% 425.000 417.000 - 0.72% -
623.xalancbmk_s -1.60% 3804.000 3743.000 - 0.70% -
631.deepsjeng_s -1.56% 3847.000 3787.000 - -0.08% -

Added Tests - Execution
625.x264_s
627.cam4_s

Added Tests - sample variability
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
600.perlbench_s
600.perlbench_s (avg)
600.perlbench_s (avg) (percentage)
600.perlbench_s (max)
600.perlbench_s (max) (percentage)
603.bwaves_s
603.bwaves_s (avg)
603.bwaves_s (avg) (percentage)
603.bwaves_s (max)
603.bwaves_s (max) (percentage)
605.mcf_s
605.mcf_s (avg)
605.mcf_s (avg) (percentage)
605.mcf_s (max)
605.mcf_s (max) (percentage)
607.cactuBSSN_s
607.cactuBSSN_s (avg)
607.cactuBSSN_s (avg) (percentage)
607.cactuBSSN_s (max)
607.cactuBSSN_s (max) (percentage)
619.lbm_s
619.lbm_s (avg)
619.lbm_s (avg) (percentage)
619.lbm_s (max)
619.lbm_s (max) (percentage)
620.omnetpp_s
620.omnetpp_s (avg)
620.omnetpp_s (avg) (percentage)
620.omnetpp_s (max)
620.omnetpp_s (max) (percentage)
623.xalancbmk_s
623.xalancbmk_s (avg)
623.xalancbmk_s (avg) (percentage)
623.xalancbmk_s (max)
623.xalancbmk_s (max) (percentage)
625.x264_s
625.x264_s (avg)
625.x264_s (avg) (percentage)
625.x264_s (max)
625.x264_s (max) (percentage)
628.pop2_s
628.pop2_s (avg)
628.pop2_s (avg) (percentage)
628.pop2_s (max)
628.pop2_s (max) (percentage)
631.deepsjeng_s
631.deepsjeng_s (avg)
631.deepsjeng_s (avg) (percentage)
631.deepsjeng_s (max)
631.deepsjeng_s (max) (percentage)
638.imagick_s
638.imagick_s (avg)
638.imagick_s (avg) (percentage)
638.imagick_s (max)
638.imagick_s (max) (percentage)
641.leela_s
641.leela_s (avg)
641.leela_s (avg) (percentage)
641.leela_s (max)
641.leela_s (max) (percentage)
644.nab_s
644.nab_s (avg)
644.nab_s (avg) (percentage)
644.nab_s (max)
644.nab_s (max) (percentage)
648.exchange2_s
648.exchange2_s (avg)
648.exchange2_s (avg) (percentage)
648.exchange2_s (max)
648.exchange2_s (max) (percentage)
649.fotonik3d_s
649.fotonik3d_s (avg)
649.fotonik3d_s (avg) (percentage)
649.fotonik3d_s (max)
649.fotonik3d_s (max) (percentage)
654.roms_s
654.roms_s (avg)
654.roms_s (avg) (percentage)
654.roms_s (max)
654.roms_s (max) (percentage)
657.xz_s
657.xz_s (avg)
657.xz_s (avg) (percentage)
657.xz_s (max)
657.xz_s (max) (percentage)

Added Tests - Score
nb_execution_successful


Report Time: 0.35s
Name Current %
508.namd_r 2403.000 -
510.parest_r 5702.000 -
511.povray_r 417.000 -
526.blender_r 10013.000 -
600.perlbench_s 2063.000 -
602.gcc_s 4302.000 -
603.bwaves_s 8970.000 -
605.mcf_s 6741.000 -1.23%
607.cactuBSSN_s 4741.000 -
619.lbm_s 28346.000 -
620.omnetpp_s 4082.000 -
621.wrf_s 9111.000 -1.13%
623.xalancbmk_s 3743.000 -
625.x264_s 2574.000 -
627.cam4_s 152.000 -
628.pop2_s 10721.000 1.17%
631.deepsjeng_s 3787.000 -
638.imagick_s 3326.000 -
641.leela_s 4805.000 -
644.nab_s 10496.000 -
648.exchange2_s 2232.000 -
649.fotonik3d_s 9802.000 -
654.roms_s 27427.000 -
657.xz_s 2222.000 -
Geometric Mean 4344.161 -13.51%
Name Current %
nb_compile_successful 1.000 -95.83%
nb_execution_successful 0.000 -
nb_total_tests 1.000 -95.83%
Geometric Mean 0.046 -99.81%
Name Current %
508.namd_r 8.000 -
508.namd_r (avg) 8.000 -
508.namd_r (avg) (percentage) 0.370 -
508.namd_r (max) 13.000 -7.14%
508.namd_r (max) (percentage) 0.580 -
510.parest_r 43.000 -
510.parest_r (avg) 43.000 -
510.parest_r (avg) (percentage) 0.760 -
510.parest_r (max) 29.000 3.57%
510.parest_r (max) (percentage) 0.510 -
511.povray_r 4.000 -
511.povray_r (avg) 4.000 -
511.povray_r (avg) (percentage) 1.020 -
511.povray_r (max) 9.000 -
511.povray_r (max) (percentage) 2.360 -
526.blender_r 86.000 1.18%
526.blender_r (avg) 86.000 1.18%
526.blender_r (avg) (percentage) 0.860 -
526.blender_r (max) 83.000 1.22%
526.blender_r (max) (percentage) 0.830 -
600.perlbench_s 21.000 -
600.perlbench_s (avg) 21.000 -
600.perlbench_s (avg) (percentage) 1.060 -
600.perlbench_s (max) 24.000 -
600.perlbench_s (max) (percentage) 1.200 -
603.bwaves_s 114.000 -
603.bwaves_s (avg) 114.000 -
603.bwaves_s (avg) (percentage) 1.280 -
603.bwaves_s (max) 89.000 -
603.bwaves_s (max) (percentage) 1.000 -
605.mcf_s 68.000 -
605.mcf_s (avg) 68.000 -
605.mcf_s (avg) (percentage) 1.010 -
605.mcf_s (max) 105.000 -
605.mcf_s (max) (percentage) 1.560 -
607.cactuBSSN_s 104.000 -
607.cactuBSSN_s (avg) 104.000 -
607.cactuBSSN_s (avg) (percentage) 2.200 -
607.cactuBSSN_s (max) 152.000 -
607.cactuBSSN_s (max) (percentage) 3.210 -
619.lbm_s 1258.000 -
619.lbm_s (avg) 1258.000 -
619.lbm_s (avg) (percentage) 4.440 -
619.lbm_s (max) 85.000 -
619.lbm_s (max) (percentage) 0.300 -
620.omnetpp_s 43.000 -
620.omnetpp_s (avg) 43.000 -
620.omnetpp_s (avg) (percentage) 1.070 -
620.omnetpp_s (max) 90.000 -
620.omnetpp_s (max) (percentage) 2.220 -
623.xalancbmk_s 22.000 -
623.xalancbmk_s (avg) 22.000 -
623.xalancbmk_s (avg) (percentage) 0.600 -
623.xalancbmk_s (max) 47.000 2.17%
623.xalancbmk_s (max) (percentage) 1.260 -
625.x264_s 17.000 -
625.x264_s (avg) 17.000 -
625.x264_s (avg) (percentage) 0.680 -
625.x264_s (max) 27.000 -3.57%
625.x264_s (max) (percentage) 1.080 -
628.pop2_s 109.000 -
628.pop2_s (avg) 109.000 -
628.pop2_s (avg) (percentage) 1.020 -
628.pop2_s (max) 232.000 1.31%
628.pop2_s (max) (percentage) 2.170 -
631.deepsjeng_s 18.000 -
631.deepsjeng_s (avg) 18.000 -
631.deepsjeng_s (avg) (percentage) 0.480 -
631.deepsjeng_s (max) 36.000 -
631.deepsjeng_s (max) (percentage) 0.960 -
638.imagick_s 16.000 -
638.imagick_s (avg) 16.000 -
638.imagick_s (avg) (percentage) 0.510 -
638.imagick_s (max) 34.000 -
638.imagick_s (max) (percentage) 1.030 -
641.leela_s 21.000 -
641.leela_s (avg) 21.000 -
641.leela_s (avg) (percentage) 0.440 -
641.leela_s (max) 19.000 -
641.leela_s (max) (percentage) 0.400 -
644.nab_s 58.000 -
644.nab_s (avg) 58.000 -
644.nab_s (avg) (percentage) 0.560 -
644.nab_s (max) 68.000 1.49%
644.nab_s (max) (percentage) 0.650 -
648.exchange2_s 16.000 -
648.exchange2_s (avg) 16.000 -
648.exchange2_s (avg) (percentage) 0.730 -
648.exchange2_s (max) 33.000 -
648.exchange2_s (max) (percentage) 1.520 -
649.fotonik3d_s 87.000 -
649.fotonik3d_s (avg) 87.000 -
649.fotonik3d_s (avg) (percentage) 0.890 -
649.fotonik3d_s (max) 170.000 -
649.fotonik3d_s (max) (percentage) 1.740 -
654.roms_s 194.000 -
654.roms_s (avg) 194.000 -
654.roms_s (avg) (percentage) 0.710 -
654.roms_s (max) 153.000 -
654.roms_s (max) (percentage) 0.560 -
657.xz_s 16.000 -
657.xz_s (avg) 16.000 -
657.xz_s (avg) (percentage) 0.740 -
657.xz_s (max) 39.000 -
657.xz_s (max) (percentage) 1.780 -
Geometric Mean 9.542 -