Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=cd51849c90e8fd13779bec69f5d4c7aadf03a532 (+ 5 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/f723f72061a7c76fbd6d44adbfff8cb3ed7391d5 (+ 50 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=78ca44da0160a0b442f0ca1f253e3360f044b2ec (+ 3 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=288a2f83ed42ce91cf92c2b08dad298a3da0cd9a (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-cpu2017fast--gnu-aarch64-master-Os_LTO-build/122/
Filter

gnu-aarch64-master-Os_LTO test results

Run Order Start Time Duration
Current 0122 (3-changed-components) 2023-11-24T11:38:24 0:00:00
Previous 0121 (3-changed-components) 2023-11-21T08:22:14 0:00:00
Baseline 0105 (4-changed-components) 2023-10-18T06:40:59 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 5 16
Performance Improvements 30 0
Added Tests 1 107
Unchanged Tests 882 795
Total Tests 918

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
654.roms_s 5.52% 34267.000 36157.000 - 6.68% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
654.roms_s 5.53% 3018.000 3185.000 - 0.00% -
654.roms_s (avg) 5.53% 3018.000 3185.000 - 0.00% -
654.roms_s (max) 5.50% 3800.000 4009.000 - 0.00% -
526.blender_r (max) 2.04% 49.000 50.000 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
619.lbm_s -12.66% 37839.000 33050.000 - 8.52% -
627.cam4_s -6.00% 200.000 188.000 - 0.00% -
607.cactuBSSN_s -2.70% 5256.000 5114.000 - 0.71% -
603.bwaves_s -2.51% 10658.000 10391.000 - -0.43% -
602.gcc_s -2.12% 5247.000 5136.000 - 1.00% -
638.imagick_s -1.11% 6049.000 5982.000 - 0.64% -
649.fotonik3d_s -1.04% 10565.000 10455.000 - 2.11% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
619.lbm_s -12.65% 4245.000 3708.000 - 0.00% -
619.lbm_s (avg) -12.65% 4245.000 3708.000 - 0.00% -
619.lbm_s (max) -12.65% 7408.000 6471.000 - 0.00% -
623.xalancbmk_s -4.76% 21.000 20.000 - 0.00% -
623.xalancbmk_s (avg) -4.76% 21.000 20.000 - 0.00% -
607.cactuBSSN_s -3.12% 96.000 93.000 - 0.00% -
607.cactuBSSN_s (avg) -3.12% 96.000 93.000 - 0.00% -
625.x264_s (max) -2.94% 34.000 33.000 - 0.00% -
607.cactuBSSN_s (max) -2.92% 137.000 133.000 - 0.00% -
603.bwaves_s (max) -2.61% 537.000 523.000 - 0.00% -
603.bwaves_s -2.30% 304.000 297.000 - 0.00% -
603.bwaves_s (avg) -2.30% 304.000 297.000 - 0.00% -
638.imagick_s (max) -2.00% 50.000 49.000 - 0.00% -
631.deepsjeng_s (max) -1.79% 56.000 55.000 - 0.00% -
649.fotonik3d_s -1.24% 161.000 159.000 - 0.00% -
649.fotonik3d_s (avg) -1.24% 161.000 159.000 - 0.00% -
510.parest_r (max) -1.19% 84.000 83.000 - 0.00% -
605.mcf_s -1.14% 88.000 87.000 - 0.00% -
605.mcf_s (avg) -1.14% 88.000 87.000 - 0.00% -
510.parest_r -1.12% 89.000 88.000 - 0.00% -
510.parest_r (avg) -1.12% 89.000 88.000 - 0.00% -
649.fotonik3d_s (max) -1.07% 187.000 185.000 - 0.00% -
605.mcf_s (max) -1.05% 95.000 94.000 - 0.00% -

Added Tests - Score
nb_execution_successful

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
619.lbm_s 8.52% 30454.000 33050.000 - -12.66% -
654.roms_s 6.68% 33893.000 36157.000 - 5.52% -
649.fotonik3d_s 2.11% 10239.000 10455.000 - -1.04% -
628.pop2_s 1.92% 14154.000 14426.000 - 0.30% -
620.omnetpp_s 1.86% 4402.000 4484.000 - -0.07% -
508.namd_r 1.80% 3451.000 3513.000 - -0.17% -
605.mcf_s 1.77% 7175.000 7302.000 - -0.60% -
657.xz_s 1.66% 2470.000 2511.000 - -0.91% -
511.povray_r 1.52% 527.000 535.000 - -0.56% -
631.deepsjeng_s 1.40% 4214.000 4273.000 - -0.67% -
600.perlbench_s 1.39% 2230.000 2261.000 - -0.70% -
526.blender_r 1.31% 12996.000 13166.000 - 0.23% -
625.x264_s 1.04% 3949.000 3990.000 - -0.72% -
602.gcc_s 1.00% 5085.000 5136.000 - -2.12% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -95.83% 24.000 1.000 - 0.00% -
nb_total_tests -95.83% 24.000 1.000 - 0.00% -

Added Tests - Execution
627.cam4_s

Added Tests - sample variability
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
600.perlbench_s
600.perlbench_s (avg)
600.perlbench_s (avg) (percentage)
600.perlbench_s (max)
600.perlbench_s (max) (percentage)
603.bwaves_s
603.bwaves_s (avg)
603.bwaves_s (avg) (percentage)
603.bwaves_s (max)
603.bwaves_s (max) (percentage)
605.mcf_s
605.mcf_s (avg)
605.mcf_s (avg) (percentage)
605.mcf_s (max)
605.mcf_s (max) (percentage)
607.cactuBSSN_s
607.cactuBSSN_s (avg)
607.cactuBSSN_s (avg) (percentage)
607.cactuBSSN_s (max)
607.cactuBSSN_s (max) (percentage)
619.lbm_s
619.lbm_s (avg)
619.lbm_s (avg) (percentage)
619.lbm_s (max)
619.lbm_s (max) (percentage)
620.omnetpp_s
620.omnetpp_s (avg)
620.omnetpp_s (avg) (percentage)
620.omnetpp_s (max)
620.omnetpp_s (max) (percentage)
623.xalancbmk_s
623.xalancbmk_s (avg)
623.xalancbmk_s (avg) (percentage)
623.xalancbmk_s (max)
623.xalancbmk_s (max) (percentage)
625.x264_s
625.x264_s (avg)
625.x264_s (avg) (percentage)
625.x264_s (max)
625.x264_s (max) (percentage)
628.pop2_s
628.pop2_s (avg)
628.pop2_s (avg) (percentage)
628.pop2_s (max)
628.pop2_s (max) (percentage)
631.deepsjeng_s
631.deepsjeng_s (avg)
631.deepsjeng_s (avg) (percentage)
631.deepsjeng_s (max)
631.deepsjeng_s (max) (percentage)
638.imagick_s
638.imagick_s (avg)
638.imagick_s (avg) (percentage)
638.imagick_s (max)
638.imagick_s (max) (percentage)
641.leela_s
641.leela_s (avg)
641.leela_s (avg) (percentage)
641.leela_s (max)
641.leela_s (max) (percentage)
644.nab_s
644.nab_s (avg)
644.nab_s (avg) (percentage)
644.nab_s (max)
644.nab_s (max) (percentage)
648.exchange2_s
648.exchange2_s (avg)
648.exchange2_s (avg) (percentage)
648.exchange2_s (max)
648.exchange2_s (max) (percentage)
649.fotonik3d_s
649.fotonik3d_s (avg)
649.fotonik3d_s (avg) (percentage)
649.fotonik3d_s (max)
649.fotonik3d_s (max) (percentage)
654.roms_s
654.roms_s (avg)
654.roms_s (avg) (percentage)
654.roms_s (max)
654.roms_s (max) (percentage)
657.xz_s
657.xz_s (avg)
657.xz_s (avg) (percentage)
657.xz_s (max)
657.xz_s (max) (percentage)

Added Tests - Score
nb_execution_successful


Report Time: 0.36s
Name Current %
508.namd_r 3513.000 -
510.parest_r 6719.000 -
511.povray_r 535.000 -
526.blender_r 13166.000 -
600.perlbench_s 2261.000 -
602.gcc_s 5136.000 -2.12%
603.bwaves_s 10391.000 -2.51%
605.mcf_s 7302.000 -
607.cactuBSSN_s 5114.000 -2.70%
619.lbm_s 33050.000 -12.66%
620.omnetpp_s 4484.000 -
621.wrf_s 12563.000 -
623.xalancbmk_s 4769.000 -
625.x264_s 3990.000 -
627.cam4_s 188.000 -6.00%
628.pop2_s 14426.000 -
631.deepsjeng_s 4273.000 -
638.imagick_s 5982.000 -1.11%
641.leela_s 4429.000 -
644.nab_s 12676.000 -
648.exchange2_s 3446.000 -
649.fotonik3d_s 10455.000 -1.04%
654.roms_s 36157.000 5.52%
657.xz_s 2511.000 -
Geometric Mean 5374.831 -1.19%
Name Current %
508.namd_r 15.000 -
508.namd_r (avg) 15.000 -
508.namd_r (avg) (percentage) 0.450 -
508.namd_r (max) 23.000 -
508.namd_r (max) (percentage) 0.660 -
510.parest_r 88.000 -1.12%
510.parest_r (avg) 88.000 -1.12%
510.parest_r (avg) (percentage) 1.320 -
510.parest_r (max) 83.000 -1.19%
510.parest_r (max) (percentage) 1.250 -
511.povray_r 3.000 -
511.povray_r (avg) 3.000 -
511.povray_r (avg) (percentage) 0.650 -
511.povray_r (max) 4.000 -
511.povray_r (max) (percentage) 0.850 -
526.blender_r 52.000 -
526.blender_r (avg) 52.000 -
526.blender_r (avg) (percentage) 0.400 -
526.blender_r (max) 50.000 2.04%
526.blender_r (max) (percentage) 0.380 -
600.perlbench_s 25.000 -
600.perlbench_s (avg) 25.000 -
600.perlbench_s (avg) (percentage) 1.140 -
600.perlbench_s (max) 29.000 -
600.perlbench_s (max) (percentage) 1.310 -
603.bwaves_s 297.000 -2.30%
603.bwaves_s (avg) 297.000 -2.30%
603.bwaves_s (avg) (percentage) 2.860 -
603.bwaves_s (max) 523.000 -2.61%
603.bwaves_s (max) (percentage) 5.040 -
605.mcf_s 87.000 -1.14%
605.mcf_s (avg) 87.000 -1.14%
605.mcf_s (avg) (percentage) 1.200 -
605.mcf_s (max) 94.000 -1.05%
605.mcf_s (max) (percentage) 1.300 -
607.cactuBSSN_s 93.000 -3.12%
607.cactuBSSN_s (avg) 93.000 -3.12%
607.cactuBSSN_s (avg) (percentage) 1.830 -
607.cactuBSSN_s (max) 133.000 -2.92%
607.cactuBSSN_s (max) (percentage) 2.620 -
619.lbm_s 3708.000 -12.65%
619.lbm_s (avg) 3708.000 -12.65%
619.lbm_s (avg) (percentage) 11.220 -
619.lbm_s (max) 6471.000 -12.65%
619.lbm_s (max) (percentage) 19.580 -
620.omnetpp_s 61.000 -
620.omnetpp_s (avg) 61.000 -
620.omnetpp_s (avg) (percentage) 1.380 -
620.omnetpp_s (max) 69.000 -
620.omnetpp_s (max) (percentage) 1.560 -
623.xalancbmk_s 20.000 -4.76%
623.xalancbmk_s (avg) 20.000 -4.76%
623.xalancbmk_s (avg) (percentage) 0.440 -
623.xalancbmk_s (max) 29.000 -
623.xalancbmk_s (max) (percentage) 0.610 -
625.x264_s 23.000 -
625.x264_s (avg) 23.000 -
625.x264_s (avg) (percentage) 0.580 -
625.x264_s (max) 33.000 -2.94%
625.x264_s (max) (percentage) 0.850 -
628.pop2_s 93.000 -
628.pop2_s (avg) 93.000 -
628.pop2_s (avg) (percentage) 0.650 -
628.pop2_s (max) 168.000 -
628.pop2_s (max) (percentage) 1.170 -
631.deepsjeng_s 31.000 -
631.deepsjeng_s (avg) 31.000 -
631.deepsjeng_s (avg) (percentage) 0.740 -
631.deepsjeng_s (max) 55.000 -1.79%
631.deepsjeng_s (max) (percentage) 1.310 -
638.imagick_s 16.000 -
638.imagick_s (avg) 16.000 -
638.imagick_s (avg) (percentage) 0.280 -
638.imagick_s (max) 49.000 -2.00%
638.imagick_s (max) (percentage) 0.830 -
641.leela_s 11.000 -
641.leela_s (avg) 11.000 -
641.leela_s (avg) (percentage) 0.250 -
641.leela_s (max) 15.000 -
641.leela_s (max) (percentage) 0.350 -
644.nab_s 31.000 -
644.nab_s (avg) 31.000 -
644.nab_s (avg) (percentage) 0.250 -
644.nab_s (max) 41.000 -
644.nab_s (max) (percentage) 0.330 -
648.exchange2_s 21.000 -
648.exchange2_s (avg) 21.000 -
648.exchange2_s (avg) (percentage) 0.620 -
648.exchange2_s (max) 37.000 -
648.exchange2_s (max) (percentage) 1.100 -
649.fotonik3d_s 159.000 -1.24%
649.fotonik3d_s (avg) 159.000 -1.24%
649.fotonik3d_s (avg) (percentage) 1.530 -
649.fotonik3d_s (max) 185.000 -1.07%
649.fotonik3d_s (max) (percentage) 1.770 -
654.roms_s 3185.000 5.53%
654.roms_s (avg) 3185.000 5.53%
654.roms_s (avg) (percentage) 8.810 -
654.roms_s (max) 4009.000 5.50%
654.roms_s (max) (percentage) 11.090 -
657.xz_s 36.000 -
657.xz_s (avg) 36.000 -
657.xz_s (avg) (percentage) 1.440 -
657.xz_s (max) 41.000 -
657.xz_s (max) (percentage) 1.640 -
Geometric Mean 12.758 -