Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=eef4ff9b707d738322a5dca82a6a9b0aad76a26e (+ 179 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/fbfe43daec6443978df65530dc5f7f3f8a4e6f9e (+ 476 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=b3bee76c5f59498b9c189608f0a3132e2013fa1a (+ 27 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=288a2f83ed42ce91cf92c2b08dad298a3da0cd9a (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-cpu2017fast--gnu-aarch64-master-Os_LTO-build/124/
Filter

gnu-aarch64-master-Os_LTO test results

Run Order Start Time Duration
Current 0124 (3-changed-components) 2023-12-02T05:57:35 0:00:00
Previous 0122 (3-changed-components) 2023-11-24T11:38:24 0:00:00
Baseline 0105 (4-changed-components) 2023-10-18T06:40:59 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 23 14
Performance Improvements 16 2
Added Tests 17 90
Unchanged Tests 862 812
Total Tests 918

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
619.lbm_s 12.08% 33050.000 37042.000 - 21.63% -
657.xz_s 5.26% 2511.000 2643.000 - 7.00% -
600.perlbench_s 3.89% 2261.000 2349.000 - 5.34% -
638.imagick_s 2.22% 5982.000 6115.000 - 2.88% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
619.lbm_s 12.08% 3708.000 4156.000 - 0.00% -
619.lbm_s (avg) 12.08% 3708.000 4156.000 - 0.00% -
619.lbm_s (max) 12.07% 6471.000 7252.000 - 0.00% -
638.imagick_s 6.25% 16.000 17.000 - 0.00% -
638.imagick_s (avg) 6.25% 16.000 17.000 - 0.00% -
657.xz_s 5.56% 36.000 38.000 - 0.00% -
657.xz_s (avg) 5.56% 36.000 38.000 - 0.00% -
657.xz_s (max) 4.88% 41.000 43.000 - 0.00% -
600.perlbench_s 4.00% 25.000 26.000 - 0.00% -
600.perlbench_s (avg) 4.00% 25.000 26.000 - 0.00% -
600.perlbench_s (max) 3.45% 29.000 30.000 - 0.00% -
638.imagick_s (max) 2.04% 49.000 50.000 - 0.00% -
631.deepsjeng_s (max) 1.82% 55.000 56.000 - 0.00% -
510.parest_r (max) 1.20% 83.000 84.000 - 0.00% -
628.pop2_s (max) 1.19% 168.000 170.000 - 0.00% -
510.parest_r 1.14% 88.000 89.000 - 0.00% -
510.parest_r (avg) 1.14% 88.000 89.000 - 0.00% -
628.pop2_s 1.08% 93.000 94.000 - 0.00% -
628.pop2_s (avg) 1.08% 93.000 94.000 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
623.xalancbmk_s -2.68% 4769.000 4641.000 - -1.82% -
526.blender_r -2.64% 13166.000 12818.000 - -1.37% -
605.mcf_s -1.48% 7302.000 7194.000 - 0.26% -
620.omnetpp_s -1.47% 4484.000 4418.000 - 0.36% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
526.blender_r (max) -4.00% 50.000 48.000 - 0.00% -
623.xalancbmk_s (max) -3.45% 29.000 28.000 - 0.00% -
526.blender_r -1.92% 52.000 51.000 - 0.00% -
526.blender_r (avg) -1.92% 52.000 51.000 - 0.00% -
620.omnetpp_s -1.64% 61.000 60.000 - 0.00% -
620.omnetpp_s (avg) -1.64% 61.000 60.000 - 0.00% -
620.omnetpp_s (max) -1.45% 69.000 68.000 - 0.00% -
605.mcf_s -1.15% 87.000 86.000 - 0.00% -
605.mcf_s (avg) -1.15% 87.000 86.000 - 0.00% -
605.mcf_s (max) -1.06% 94.000 93.000 - 0.00% -

Performance Improvements - Score Δ Previous Current σ Δ (B) σ (B)
nb_compile_successful 1600.00% 1.000 17.000 - -29.17% -
nb_total_tests 1600.00% 1.000 17.000 - -29.17% -

Added Tests - Code Size
508.namd_r
510.parest_r
511.povray_r
526.blender_r
600.perlbench_s
602.gcc_s
605.mcf_s
619.lbm_s
620.omnetpp_s
623.xalancbmk_s
625.x264_s
628.pop2_s
631.deepsjeng_s
638.imagick_s
641.leela_s
644.nab_s
657.xz_s

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
619.lbm_s 21.63% 30454.000 37042.000 - 12.08% -
657.xz_s 7.00% 2470.000 2643.000 - 5.26% -
600.perlbench_s 5.34% 2230.000 2349.000 - 3.89% -
638.imagick_s 2.88% 5944.000 6115.000 - 2.22% -
628.pop2_s 2.84% 14154.000 14556.000 - 0.90% -
508.namd_r 2.41% 3451.000 3534.000 - 0.60% -
631.deepsjeng_s 1.76% 4214.000 4288.000 - 0.35% -
511.povray_r 1.52% 527.000 535.000 - 0.00% -
644.nab_s 1.19% 12577.000 12727.000 - 0.40% -
602.gcc_s 1.14% 5085.000 5143.000 - 0.14% -
510.parest_r 1.06% 6674.000 6745.000 - 0.39% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -29.17% 24.000 17.000 - 1600.00% -
nb_total_tests -29.17% 24.000 17.000 - 1600.00% -
nb_execution_successful -26.09% 23.000 17.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
623.xalancbmk_s -1.82% 4727.000 4641.000 - -2.68% -
526.blender_r -1.37% 12996.000 12818.000 - -2.64% -

Added Tests - sample variability
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
600.perlbench_s
600.perlbench_s (avg)
600.perlbench_s (avg) (percentage)
600.perlbench_s (max)
600.perlbench_s (max) (percentage)
603.bwaves_s (avg) (percentage)
603.bwaves_s (max) (percentage)
605.mcf_s
605.mcf_s (avg)
605.mcf_s (avg) (percentage)
605.mcf_s (max)
605.mcf_s (max) (percentage)
607.cactuBSSN_s (avg) (percentage)
607.cactuBSSN_s (max) (percentage)
619.lbm_s
619.lbm_s (avg)
619.lbm_s (avg) (percentage)
619.lbm_s (max)
619.lbm_s (max) (percentage)
620.omnetpp_s
620.omnetpp_s (avg)
620.omnetpp_s (avg) (percentage)
620.omnetpp_s (max)
620.omnetpp_s (max) (percentage)
623.xalancbmk_s
623.xalancbmk_s (avg)
623.xalancbmk_s (avg) (percentage)
623.xalancbmk_s (max)
623.xalancbmk_s (max) (percentage)
625.x264_s
625.x264_s (avg)
625.x264_s (avg) (percentage)
625.x264_s (max)
625.x264_s (max) (percentage)
628.pop2_s
628.pop2_s (avg)
628.pop2_s (avg) (percentage)
628.pop2_s (max)
628.pop2_s (max) (percentage)
631.deepsjeng_s
631.deepsjeng_s (avg)
631.deepsjeng_s (avg) (percentage)
631.deepsjeng_s (max)
631.deepsjeng_s (max) (percentage)
638.imagick_s
638.imagick_s (avg)
638.imagick_s (avg) (percentage)
638.imagick_s (max)
638.imagick_s (max) (percentage)
641.leela_s
641.leela_s (avg)
641.leela_s (avg) (percentage)
641.leela_s (max)
641.leela_s (max) (percentage)
644.nab_s
644.nab_s (avg)
644.nab_s (avg) (percentage)
644.nab_s (max)
644.nab_s (max) (percentage)
648.exchange2_s (avg) (percentage)
648.exchange2_s (max) (percentage)
649.fotonik3d_s (avg) (percentage)
649.fotonik3d_s (max) (percentage)
654.roms_s (avg) (percentage)
654.roms_s (max) (percentage)
657.xz_s
657.xz_s (avg)
657.xz_s (avg) (percentage)
657.xz_s (max)
657.xz_s (max) (percentage)


Report Time: 0.34s
Name Current %
508.namd_r 3534.000 -
510.parest_r 6745.000 -
511.povray_r 535.000 -
526.blender_r 12818.000 -2.64%
600.perlbench_s 2349.000 3.89%
602.gcc_s 5143.000 -
605.mcf_s 7194.000 -1.48%
619.lbm_s 37042.000 12.08%
620.omnetpp_s 4418.000 -1.47%
623.xalancbmk_s 4641.000 -2.68%
625.x264_s 3980.000 -
628.pop2_s 14556.000 -
631.deepsjeng_s 4288.000 -
638.imagick_s 6115.000 2.22%
641.leela_s 4448.000 -
644.nab_s 12727.000 -
657.xz_s 2643.000 5.26%
Geometric Mean 5355.491 1.01%
Name Current %
508.namd_r 431413.000 -
510.parest_r 1120260.000 -
511.povray_r 660382.000 -
526.blender_r 7181124.000 -
600.perlbench_s 1711657.000 -
602.gcc_s 6582383.000 -
605.mcf_s 13738.000 -
619.lbm_s 11936.000 -
620.omnetpp_s 1307095.000 -
623.xalancbmk_s 2571606.000 -
625.x264_s 349259.000 -
628.pop2_s 2569229.000 -
631.deepsjeng_s 57291.000 -
638.imagick_s 964903.000 -
641.leela_s 60101.000 -
644.nab_s 76748.000 -
657.xz_s 104202.000 -
Geometric Mean 416341.154 -
Name Current %
nb_compile_successful 17.000 1600.00%
nb_execution_successful 17.000 -
nb_total_tests 17.000 1600.00%
Geometric Mean 17.000 36602.02%
Name Current %
508.namd_r 15.000 -
508.namd_r (avg) 15.000 -
508.namd_r (avg) (percentage) 0.450 -
508.namd_r (max) 23.000 -
508.namd_r (max) (percentage) 0.660 -
510.parest_r 89.000 1.14%
510.parest_r (avg) 89.000 1.14%
510.parest_r (avg) (percentage) 1.320 -
510.parest_r (max) 84.000 1.20%
510.parest_r (max) (percentage) 1.250 -
511.povray_r 3.000 -
511.povray_r (avg) 3.000 -
511.povray_r (avg) (percentage) 0.650 -
511.povray_r (max) 4.000 -
511.povray_r (max) (percentage) 0.850 -
526.blender_r 51.000 -1.92%
526.blender_r (avg) 51.000 -1.92%
526.blender_r (avg) (percentage) 0.400 -
526.blender_r (max) 48.000 -4.00%
526.blender_r (max) (percentage) 0.380 -
600.perlbench_s 26.000 4.00%
600.perlbench_s (avg) 26.000 4.00%
600.perlbench_s (avg) (percentage) 1.140 -
600.perlbench_s (max) 30.000 3.45%
600.perlbench_s (max) (percentage) 1.310 -
603.bwaves_s (avg) (percentage) 2.860 -
603.bwaves_s (max) (percentage) 5.040 -
605.mcf_s 86.000 -1.15%
605.mcf_s (avg) 86.000 -1.15%
605.mcf_s (avg) (percentage) 1.200 -
605.mcf_s (max) 93.000 -1.06%
605.mcf_s (max) (percentage) 1.300 -
607.cactuBSSN_s (avg) (percentage) 1.830 -
607.cactuBSSN_s (max) (percentage) 2.620 -
619.lbm_s 4156.000 12.08%
619.lbm_s (avg) 4156.000 12.08%
619.lbm_s (avg) (percentage) 11.220 -
619.lbm_s (max) 7252.000 12.07%
619.lbm_s (max) (percentage) 19.580 -
620.omnetpp_s 60.000 -1.64%
620.omnetpp_s (avg) 60.000 -1.64%
620.omnetpp_s (avg) (percentage) 1.380 -
620.omnetpp_s (max) 68.000 -1.45%
620.omnetpp_s (max) (percentage) 1.560 -
623.xalancbmk_s 20.000 -
623.xalancbmk_s (avg) 20.000 -
623.xalancbmk_s (avg) (percentage) 0.440 -
623.xalancbmk_s (max) 28.000 -3.45%
623.xalancbmk_s (max) (percentage) 0.610 -
625.x264_s 23.000 -
625.x264_s (avg) 23.000 -
625.x264_s (avg) (percentage) 0.580 -
625.x264_s (max) 33.000 -
625.x264_s (max) (percentage) 0.850 -
628.pop2_s 94.000 1.08%
628.pop2_s (avg) 94.000 1.08%
628.pop2_s (avg) (percentage) 0.650 -
628.pop2_s (max) 170.000 1.19%
628.pop2_s (max) (percentage) 1.170 -
631.deepsjeng_s 31.000 -
631.deepsjeng_s (avg) 31.000 -
631.deepsjeng_s (avg) (percentage) 0.740 -
631.deepsjeng_s (max) 56.000 1.82%
631.deepsjeng_s (max) (percentage) 1.310 -
638.imagick_s 17.000 6.25%
638.imagick_s (avg) 17.000 6.25%
638.imagick_s (avg) (percentage) 0.280 -
638.imagick_s (max) 50.000 2.04%
638.imagick_s (max) (percentage) 0.830 -
641.leela_s 11.000 -
641.leela_s (avg) 11.000 -
641.leela_s (avg) (percentage) 0.250 -
641.leela_s (max) 15.000 -
641.leela_s (max) (percentage) 0.350 -
644.nab_s 31.000 -
644.nab_s (avg) 31.000 -
644.nab_s (avg) (percentage) 0.250 -
644.nab_s (max) 41.000 -
644.nab_s (max) (percentage) 0.330 -
648.exchange2_s (avg) (percentage) 0.620 -
648.exchange2_s (max) (percentage) 1.100 -
649.fotonik3d_s (avg) (percentage) 1.530 -
649.fotonik3d_s (max) (percentage) 1.770 -
654.roms_s (avg) (percentage) 8.810 -
654.roms_s (max) (percentage) 11.090 -
657.xz_s 38.000 5.56%
657.xz_s (avg) 38.000 5.56%
657.xz_s (avg) (percentage) 1.440 -
657.xz_s (max) 43.000 4.88%
657.xz_s (max) (percentage) 1.640 -
Geometric Mean 7.978 -