Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=5a6c54baa43e310447f2070e51a5ec395f188905 (+ 11 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/7bf1de918608e2d0b5a3ad0923040acb1819d9a5 (+ 68 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=dd858522bf36ae16496ea01ff8b65e16b4e5c22b (+ 12 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=288a2f83ed42ce91cf92c2b08dad298a3da0cd9a (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-cpu2017fast--gnu-aarch64-master-Os-build/116/
Filter

gnu-aarch64-master-Os test results

Run Order Start Time Duration
Current 0116 (3-changed-components) 2023-11-18T07:07:43 0:00:00
Previous 0115 (3-changed-components) 2023-11-15T11:10:16 0:00:00
Baseline 0001 (4-changed-components) 2023-02-27T01:05:11 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 0 5
Performance Improvements 30 15
Added Tests 1 112
Unchanged Tests 911 810
Total Tests 942

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
603.bwaves_s -8.56% 11334.000 10364.000 - -6.86% -
619.lbm_s -7.92% 34881.000 32117.000 - -12.02% -
649.fotonik3d_s -2.11% 10498.000 10277.000 - -3.13% -
620.omnetpp_s -1.80% 4501.000 4420.000 - -2.19% -
621.wrf_s -1.24% 12512.000 12357.000 - -2.55% -
657.xz_s -1.21% 2564.000 2533.000 - -7.15% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
603.bwaves_s -8.68% 334.000 305.000 - 0.00% -
603.bwaves_s (avg) -8.68% 334.000 305.000 - 0.00% -
603.bwaves_s (max) -8.54% 843.000 771.000 - 0.00% -
619.lbm_s (max) -7.94% 4032.000 3712.000 - 0.00% -
619.lbm_s -7.92% 3282.000 3022.000 - 0.00% -
619.lbm_s (avg) -7.92% 3282.000 3022.000 - 0.00% -
657.xz_s -2.63% 38.000 37.000 - 0.00% -
657.xz_s (avg) -2.63% 38.000 37.000 - 0.00% -
649.fotonik3d_s (max) -2.25% 178.000 174.000 - 0.00% -
510.parest_r -2.22% 45.000 44.000 - 0.00% -
510.parest_r (avg) -2.22% 45.000 44.000 - 0.00% -
510.parest_r (max) -2.04% 49.000 48.000 - 0.00% -
657.xz_s (max) -1.96% 51.000 50.000 - 0.00% -
638.imagick_s -1.89% 53.000 52.000 - 0.00% -
638.imagick_s (avg) -1.89% 53.000 52.000 - 0.00% -
649.fotonik3d_s -1.88% 160.000 157.000 - 0.00% -
649.fotonik3d_s (avg) -1.88% 160.000 157.000 - 0.00% -
620.omnetpp_s -1.72% 58.000 57.000 - 0.00% -
620.omnetpp_s (avg) -1.72% 58.000 57.000 - 0.00% -
638.imagick_s (max) -1.69% 59.000 58.000 - 0.00% -
620.omnetpp_s (max) -1.52% 66.000 65.000 - 0.00% -
621.wrf_s -1.19% 671.000 663.000 - 0.00% -
621.wrf_s (avg) -1.19% 671.000 663.000 - 0.00% -
621.wrf_s (max) -1.08% 371.000 367.000 - 0.00% -

Added Tests - Score
nb_execution_successful

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
654.roms_s 3.91% 36958.000 38402.000 - 0.52% -
648.exchange2_s 3.16% 3388.000 3495.000 - 0.75% -
644.nab_s 1.23% 12363.000 12515.000 - -0.61% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -95.83% 24.000 1.000 - 0.00% -
nb_total_tests -95.83% 24.000 1.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
619.lbm_s -12.02% 36505.000 32117.000 - -7.92% -
511.povray_r -9.45% 529.000 479.000 - -0.42% -
657.xz_s -7.15% 2728.000 2533.000 - -1.21% -
603.bwaves_s -6.86% 11127.000 10364.000 - -8.56% -
600.perlbench_s -4.89% 2394.000 2277.000 - 0.18% -
649.fotonik3d_s -3.13% 10609.000 10277.000 - -2.11% -
621.wrf_s -2.55% 12680.000 12357.000 - -1.24% -
602.gcc_s -2.40% 5117.000 4994.000 - -0.83% -
628.pop2_s -2.36% 14534.000 14191.000 - -0.98% -
620.omnetpp_s -2.19% 4519.000 4420.000 - -1.80% -
625.x264_s -1.99% 4062.000 3981.000 - -0.57% -
638.imagick_s -1.84% 6078.000 5966.000 - -0.95% -
631.deepsjeng_s -1.72% 4475.000 4398.000 - -0.48% -
526.blender_r -1.46% 13182.000 12990.000 - 0.71% -
508.namd_r -1.34% 3520.000 3473.000 - -0.34% -

Added Tests - Execution
627.cam4_s

Added Tests - sample variability
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
600.perlbench_s
600.perlbench_s (avg)
600.perlbench_s (avg) (percentage)
600.perlbench_s (max)
600.perlbench_s (max) (percentage)
603.bwaves_s
603.bwaves_s (avg)
603.bwaves_s (avg) (percentage)
603.bwaves_s (max)
603.bwaves_s (max) (percentage)
605.mcf_s
605.mcf_s (avg)
605.mcf_s (avg) (percentage)
605.mcf_s (max)
605.mcf_s (max) (percentage)
607.cactuBSSN_s
607.cactuBSSN_s (avg)
607.cactuBSSN_s (avg) (percentage)
607.cactuBSSN_s (max)
607.cactuBSSN_s (max) (percentage)
619.lbm_s
619.lbm_s (avg)
619.lbm_s (avg) (percentage)
619.lbm_s (max)
619.lbm_s (max) (percentage)
620.omnetpp_s
620.omnetpp_s (avg)
620.omnetpp_s (avg) (percentage)
620.omnetpp_s (max)
620.omnetpp_s (max) (percentage)
621.wrf_s
621.wrf_s (avg)
621.wrf_s (avg) (percentage)
621.wrf_s (max)
621.wrf_s (max) (percentage)
623.xalancbmk_s
623.xalancbmk_s (avg)
623.xalancbmk_s (avg) (percentage)
623.xalancbmk_s (max)
623.xalancbmk_s (max) (percentage)
625.x264_s
625.x264_s (avg)
625.x264_s (avg) (percentage)
625.x264_s (max)
625.x264_s (max) (percentage)
628.pop2_s
628.pop2_s (avg)
628.pop2_s (avg) (percentage)
628.pop2_s (max)
628.pop2_s (max) (percentage)
631.deepsjeng_s
631.deepsjeng_s (avg)
631.deepsjeng_s (avg) (percentage)
631.deepsjeng_s (max)
631.deepsjeng_s (max) (percentage)
638.imagick_s
638.imagick_s (avg)
638.imagick_s (avg) (percentage)
638.imagick_s (max)
638.imagick_s (max) (percentage)
641.leela_s
641.leela_s (avg)
641.leela_s (avg) (percentage)
641.leela_s (max)
641.leela_s (max) (percentage)
644.nab_s
644.nab_s (avg)
644.nab_s (avg) (percentage)
644.nab_s (max)
644.nab_s (max) (percentage)
648.exchange2_s
648.exchange2_s (avg)
648.exchange2_s (avg) (percentage)
648.exchange2_s (max)
648.exchange2_s (max) (percentage)
649.fotonik3d_s
649.fotonik3d_s (avg)
649.fotonik3d_s (avg) (percentage)
649.fotonik3d_s (max)
649.fotonik3d_s (max) (percentage)
654.roms_s
654.roms_s (avg)
654.roms_s (avg) (percentage)
654.roms_s (max)
654.roms_s (max) (percentage)
657.xz_s
657.xz_s (avg)
657.xz_s (avg) (percentage)
657.xz_s (max)
657.xz_s (max) (percentage)

Added Tests - Score
nb_execution_successful


Report Time: 0.34s
Name Current %
508.namd_r 3473.000 -
510.parest_r 6702.000 -
511.povray_r 479.000 -
526.blender_r 12990.000 -
600.perlbench_s 2277.000 -
602.gcc_s 4994.000 -
603.bwaves_s 10364.000 -8.56%
605.mcf_s 7338.000 -
607.cactuBSSN_s 5164.000 -
619.lbm_s 32117.000 -7.92%
620.omnetpp_s 4420.000 -1.80%
621.wrf_s 12357.000 -1.24%
623.xalancbmk_s 5272.000 -
625.x264_s 3981.000 -
627.cam4_s 173.000 -
628.pop2_s 14191.000 -
631.deepsjeng_s 4398.000 -
638.imagick_s 5966.000 -
641.leela_s 5218.000 -
644.nab_s 12515.000 -
648.exchange2_s 3495.000 -
649.fotonik3d_s 10277.000 -2.11%
654.roms_s 38402.000 -
657.xz_s 2533.000 -1.21%
Geometric Mean 5382.713 -1.10%
Name Current %
508.namd_r 18.000 -
508.namd_r (avg) 18.000 -
508.namd_r (avg) (percentage) 0.520 -
508.namd_r (max) 16.000 -
508.namd_r (max) (percentage) 0.470 -
510.parest_r 44.000 -2.22%
510.parest_r (avg) 44.000 -2.22%
510.parest_r (avg) (percentage) 0.670 -
510.parest_r (max) 48.000 -2.04%
510.parest_r (max) (percentage) 0.730 -
511.povray_r 4.000 -
511.povray_r (avg) 4.000 -
511.povray_r (avg) (percentage) 0.970 -
511.povray_r (max) 10.000 -
511.povray_r (max) (percentage) 2.120 -
526.blender_r 68.000 -
526.blender_r (avg) 68.000 -
526.blender_r (avg) (percentage) 0.530 -
526.blender_r (max) 46.000 -
526.blender_r (max) (percentage) 0.360 -
600.perlbench_s 33.000 -
600.perlbench_s (avg) 33.000 -
600.perlbench_s (avg) (percentage) 1.470 -
600.perlbench_s (max) 95.000 -
600.perlbench_s (max) (percentage) 4.210 -
603.bwaves_s 305.000 -8.68%
603.bwaves_s (avg) 305.000 -8.68%
603.bwaves_s (avg) (percentage) 2.950 -
603.bwaves_s (max) 771.000 -8.54%
603.bwaves_s (max) (percentage) 7.440 -
605.mcf_s 77.000 -
605.mcf_s (avg) 77.000 -
605.mcf_s (avg) (percentage) 1.050 -
605.mcf_s (max) 65.000 -
605.mcf_s (max) (percentage) 0.890 -
607.cactuBSSN_s 147.000 -
607.cactuBSSN_s (avg) 147.000 -
607.cactuBSSN_s (avg) (percentage) 2.860 -
607.cactuBSSN_s (max) 228.000 -
607.cactuBSSN_s (max) (percentage) 4.430 -
619.lbm_s 3022.000 -7.92%
619.lbm_s (avg) 3022.000 -7.92%
619.lbm_s (avg) (percentage) 9.410 -
619.lbm_s (max) 3712.000 -7.94%
619.lbm_s (max) (percentage) 11.560 -
620.omnetpp_s 57.000 -1.72%
620.omnetpp_s (avg) 57.000 -1.72%
620.omnetpp_s (avg) (percentage) 1.300 -
620.omnetpp_s (max) 65.000 -1.52%
620.omnetpp_s (max) (percentage) 1.480 -
621.wrf_s 663.000 -1.19%
621.wrf_s (avg) 663.000 -1.19%
621.wrf_s (avg) (percentage) 5.370 -
621.wrf_s (max) 367.000 -1.08%
621.wrf_s (max) (percentage) 2.970 -
623.xalancbmk_s 26.000 -
623.xalancbmk_s (avg) 26.000 -
623.xalancbmk_s (avg) (percentage) 0.500 -
623.xalancbmk_s (max) 42.000 -
623.xalancbmk_s (max) (percentage) 0.810 -
625.x264_s 19.000 -
625.x264_s (avg) 19.000 -
625.x264_s (avg) (percentage) 0.490 -
625.x264_s (max) 22.000 -
625.x264_s (max) (percentage) 0.560 -
628.pop2_s 105.000 -
628.pop2_s (avg) 105.000 -
628.pop2_s (avg) (percentage) 0.740 -
628.pop2_s (max) 127.000 -
628.pop2_s (max) (percentage) 0.900 -
631.deepsjeng_s 26.000 -
631.deepsjeng_s (avg) 26.000 -
631.deepsjeng_s (avg) (percentage) 0.600 -
631.deepsjeng_s (max) 43.000 -
631.deepsjeng_s (max) (percentage) 0.980 -
638.imagick_s 52.000 -1.89%
638.imagick_s (avg) 52.000 -1.89%
638.imagick_s (avg) (percentage) 0.880 -
638.imagick_s (max) 58.000 -1.69%
638.imagick_s (max) (percentage) 0.980 -
641.leela_s 20.000 -
641.leela_s (avg) 20.000 -
641.leela_s (avg) (percentage) 0.390 -
641.leela_s (max) 23.000 -
641.leela_s (max) (percentage) 0.450 -
644.nab_s 60.000 -
644.nab_s (avg) 60.000 -
644.nab_s (avg) (percentage) 0.480 -
644.nab_s (max) 47.000 -
644.nab_s (max) (percentage) 0.380 -
648.exchange2_s 18.000 -
648.exchange2_s (avg) 18.000 -
648.exchange2_s (avg) (percentage) 0.530 -
648.exchange2_s (max) 32.000 -
648.exchange2_s (max) (percentage) 0.940 -
649.fotonik3d_s 157.000 -1.88%
649.fotonik3d_s (avg) 157.000 -1.88%
649.fotonik3d_s (avg) (percentage) 1.530 -
649.fotonik3d_s (max) 174.000 -2.25%
649.fotonik3d_s (max) (percentage) 1.700 -
654.roms_s 1075.000 -
654.roms_s (avg) 1075.000 -
654.roms_s (avg) (percentage) 2.800 -
654.roms_s (max) 2995.000 -
654.roms_s (max) (percentage) 7.800 -
657.xz_s 37.000 -2.63%
657.xz_s (avg) 37.000 -2.63%
657.xz_s (avg) (percentage) 1.490 -
657.xz_s (max) 50.000 -1.96%
657.xz_s (max) (percentage) 1.990 -
Geometric Mean 14.639 -