Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=c2dbc2929e87557f8bc030f6f010d67b19f99f12 (+ 34 commits)
git_gcc https://gcc.gnu.org/git/gcc.git (dfb9f6e0ed358706ade9a007f8723c4e9ef538fc) (unchanged)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=a9944a52c967ce76a5894c30d0274b824df43c7a (+ 21 commits)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/e28a7fb32e05d3f388ec508ac5312dd10b10e2f7 (+ 149 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-cpu2017fast--gnu-aarch64-master-Os-build/271/
Filter

gnu-aarch64-master-Os test results

Run Order Start Time Duration
Current 0271 (3-changed-components) 2024-12-07T05:51:31 0:00:00
Previous 0271 (3-changed-components) 2024-12-07T05:51:31 0:00:00
Baseline 0001 (4-changed-components) 2023-02-27T01:05:11 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 0 2
Performance Improvements 0 29
Added Tests 2 113
Unchanged Tests 940 798
Total Tests 942

Added Tests - sample variability
511.povray_r (unexplained diff vs previous)
511.povray_r (unexplained diff vs previous) (percentage)

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
654.roms_s 3.79% 36958.000 38360.000 - 0.00% -
644.nab_s 2.18% 12363.000 12633.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
649.fotonik3d_s -8.28% 272124.000 249584.000 - 0.00% -
603.bwaves_s -6.53% 46959.000 43894.000 - 0.00% -
621.wrf_s -3.15% 12434038.000 12042481.000 - 0.00% -
641.leela_s -2.80% 110234.000 107142.000 - 0.00% -
648.exchange2_s -1.95% 52869.000 51837.000 - 0.00% -
654.roms_s -1.58% 589234.000 579901.000 - 0.00% -
511.povray_r -1.21% 711805.000 703222.000 - 0.00% -
625.x264_s -1.19% 361788.000 357475.000 - 0.00% -
644.nab_s -1.15% 145027.000 143359.000 - 0.00% -
526.blender_r -1.10% 8337633.000 8245675.000 - 0.00% -
600.perlbench_s -1.06% 1823714.000 1804445.000 - 0.00% -
638.imagick_s -1.03% 1502506.000 1487006.000 - 0.00% -
619.lbm_s -1.01% 15041.000 14889.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
603.bwaves_s -13.42% 11127.000 9634.000 - 0.00% -
619.lbm_s -11.11% 36505.000 32448.000 - 0.00% -
657.xz_s -9.27% 2728.000 2475.000 - 0.00% -
511.povray_r -6.99% 529.000 492.000 - 0.00% -
600.perlbench_s -6.02% 2394.000 2250.000 - 0.00% -
621.wrf_s -5.62% 12680.000 11968.000 - 0.00% -
526.blender_r -4.86% 13182.000 12542.000 - 0.00% -
602.gcc_s -3.36% 5117.000 4945.000 - 0.00% -
625.x264_s -3.25% 4062.000 3930.000 - 0.00% -
607.cactuBSSN_s -3.11% 5175.000 5014.000 - 0.00% -
628.pop2_s -2.17% 14534.000 14219.000 - 0.00% -
638.imagick_s -1.89% 6078.000 5963.000 - 0.00% -
649.fotonik3d_s -1.88% 10609.000 10410.000 - 0.00% -
508.namd_r -1.85% 3520.000 3455.000 - 0.00% -
510.parest_r -1.32% 6757.000 6668.000 - 0.00% -
620.omnetpp_s -1.28% 4519.000 4461.000 - 0.00% -

Added Tests - Execution
627.cam4_s

Added Tests - sample variability
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
511.povray_r (unexplained diff vs previous)
511.povray_r (unexplained diff vs previous) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
600.perlbench_s
600.perlbench_s (avg)
600.perlbench_s (avg) (percentage)
600.perlbench_s (max)
600.perlbench_s (max) (percentage)
603.bwaves_s
603.bwaves_s (avg)
603.bwaves_s (avg) (percentage)
603.bwaves_s (max)
603.bwaves_s (max) (percentage)
605.mcf_s
605.mcf_s (avg)
605.mcf_s (avg) (percentage)
605.mcf_s (max)
605.mcf_s (max) (percentage)
607.cactuBSSN_s
607.cactuBSSN_s (avg)
607.cactuBSSN_s (avg) (percentage)
607.cactuBSSN_s (max)
607.cactuBSSN_s (max) (percentage)
619.lbm_s
619.lbm_s (avg)
619.lbm_s (avg) (percentage)
619.lbm_s (max)
619.lbm_s (max) (percentage)
620.omnetpp_s
620.omnetpp_s (avg)
620.omnetpp_s (avg) (percentage)
620.omnetpp_s (max)
620.omnetpp_s (max) (percentage)
621.wrf_s
621.wrf_s (avg)
621.wrf_s (avg) (percentage)
621.wrf_s (max)
621.wrf_s (max) (percentage)
623.xalancbmk_s
623.xalancbmk_s (avg)
623.xalancbmk_s (avg) (percentage)
623.xalancbmk_s (max)
623.xalancbmk_s (max) (percentage)
625.x264_s
625.x264_s (avg)
625.x264_s (avg) (percentage)
625.x264_s (max)
625.x264_s (max) (percentage)
628.pop2_s
628.pop2_s (avg)
628.pop2_s (avg) (percentage)
628.pop2_s (max)
628.pop2_s (max) (percentage)
631.deepsjeng_s
631.deepsjeng_s (avg)
631.deepsjeng_s (avg) (percentage)
631.deepsjeng_s (max)
631.deepsjeng_s (max) (percentage)
638.imagick_s
638.imagick_s (avg)
638.imagick_s (avg) (percentage)
638.imagick_s (max)
638.imagick_s (max) (percentage)
641.leela_s
641.leela_s (avg)
641.leela_s (avg) (percentage)
641.leela_s (max)
641.leela_s (max) (percentage)
644.nab_s
644.nab_s (avg)
644.nab_s (avg) (percentage)
644.nab_s (max)
644.nab_s (max) (percentage)
648.exchange2_s
648.exchange2_s (avg)
648.exchange2_s (avg) (percentage)
648.exchange2_s (max)
648.exchange2_s (max) (percentage)
649.fotonik3d_s
649.fotonik3d_s (avg)
649.fotonik3d_s (avg) (percentage)
649.fotonik3d_s (max)
649.fotonik3d_s (max) (percentage)
654.roms_s
654.roms_s (avg)
654.roms_s (avg) (percentage)
654.roms_s (max)
654.roms_s (max) (percentage)
657.xz_s
657.xz_s (avg)
657.xz_s (avg) (percentage)
657.xz_s (max)
657.xz_s (max) (percentage)


Report Time: 0.35s
Name Current %
508.namd_r 3455.000 -
510.parest_r 6668.000 -
511.povray_r 492.000 -
526.blender_r 12542.000 -
600.perlbench_s 2250.000 -
602.gcc_s 4945.000 -
603.bwaves_s 9634.000 -
605.mcf_s 7279.000 -
607.cactuBSSN_s 5014.000 -
619.lbm_s 32448.000 -
620.omnetpp_s 4461.000 -
621.wrf_s 11968.000 -
623.xalancbmk_s 5233.000 -
625.x264_s 3930.000 -
627.cam4_s 173.000 -
628.pop2_s 14219.000 -
631.deepsjeng_s 4464.000 -
638.imagick_s 5963.000 -
641.leela_s 5195.000 -
644.nab_s 12633.000 -
648.exchange2_s 3418.000 -
649.fotonik3d_s 10410.000 -
654.roms_s 38360.000 -
657.xz_s 2475.000 -
Geometric Mean 5338.901 -
Name Current %
508.namd_r 437124.000 -
510.parest_r 5215048.000 -
511.povray_r 703222.000 -
526.blender_r 8245675.000 -
600.perlbench_s 1804445.000 -
602.gcc_s 7290792.000 -
603.bwaves_s 43894.000 -
605.mcf_s 17652.000 -
607.cactuBSSN_s 2631415.000 -
619.lbm_s 14889.000 -
620.omnetpp_s 1578741.000 -
621.wrf_s 12042481.000 -
623.xalancbmk_s 3525172.000 -
625.x264_s 357475.000 -
628.pop2_s 24693812.000 -
631.deepsjeng_s 68470.000 -
638.imagick_s 1487006.000 -
641.leela_s 107142.000 -
644.nab_s 143359.000 -
648.exchange2_s 51837.000 -
649.fotonik3d_s 249584.000 -
654.roms_s 579901.000 -
657.xz_s 159575.000 -
Geometric Mean 592211.545 -
Name Current %
508.namd_r 26.000 -
508.namd_r (avg) 26.000 -
508.namd_r (avg) (percentage) 0.760 -
508.namd_r (max) 47.000 -
508.namd_r (max) (percentage) 1.370 -
508.namd_r (unexplained diff vs previous) 48.000 -
508.namd_r (unexplained diff vs previous) (percentage) 1.390 -
510.parest_r 76.000 -
510.parest_r (avg) 76.000 -
510.parest_r (avg) (percentage) 1.140 -
510.parest_r (max) 71.000 -
510.parest_r (max) (percentage) 1.070 -
510.parest_r (unexplained diff vs previous) 72.000 -
510.parest_r (unexplained diff vs previous) (percentage) 1.080 -
511.povray_r 4.000 -
511.povray_r (avg) 4.000 -
511.povray_r (avg) (percentage) 0.970 -
511.povray_r (max) 7.000 -
511.povray_r (max) (percentage) 1.480 -
511.povray_r (unexplained diff vs previous) 0.000 -
511.povray_r (unexplained diff vs previous) (percentage) 0.000 -
526.blender_r 70.000 -
526.blender_r (avg) 70.000 -
526.blender_r (avg) (percentage) 0.560 -
526.blender_r (max) 205.000 -
526.blender_r (max) (percentage) 1.640 -
526.blender_r (unexplained diff vs previous) 209.000 -
526.blender_r (unexplained diff vs previous) (percentage) 1.670 -
600.perlbench_s 33.000 -
600.perlbench_s (avg) 33.000 -
600.perlbench_s (avg) (percentage) 1.510 -
600.perlbench_s (max) 47.000 -
600.perlbench_s (max) (percentage) 2.090 -
600.perlbench_s (unexplained diff vs previous) 48.000 -
600.perlbench_s (unexplained diff vs previous) (percentage) 2.130 -
603.bwaves_s 278.000 -
603.bwaves_s (avg) 278.000 -
603.bwaves_s (avg) (percentage) 2.890 -
603.bwaves_s (max) 328.000 -
603.bwaves_s (max) (percentage) 3.410 -
603.bwaves_s (unexplained diff vs previous) 73.000 -
603.bwaves_s (unexplained diff vs previous) (percentage) 0.760 -
605.mcf_s 104.000 -
605.mcf_s (avg) 104.000 -
605.mcf_s (avg) (percentage) 1.430 -
605.mcf_s (max) 173.000 -
605.mcf_s (max) (percentage) 2.390 -
605.mcf_s (unexplained diff vs previous) 178.000 -
605.mcf_s (unexplained diff vs previous) (percentage) 2.450 -
607.cactuBSSN_s 180.000 -
607.cactuBSSN_s (avg) 180.000 -
607.cactuBSSN_s (avg) (percentage) 3.600 -
607.cactuBSSN_s (max) 283.000 -
607.cactuBSSN_s (max) (percentage) 5.660 -
607.cactuBSSN_s (unexplained diff vs previous) 301.000 -
607.cactuBSSN_s (unexplained diff vs previous) (percentage) 6.000 -
619.lbm_s 3481.000 -
619.lbm_s (avg) 3481.000 -
619.lbm_s (avg) (percentage) 10.730 -
619.lbm_s (max) 3611.000 -
619.lbm_s (max) (percentage) 11.130 -
619.lbm_s (unexplained diff vs previous) 4064.000 -
619.lbm_s (unexplained diff vs previous) (percentage) 12.520 -
620.omnetpp_s 89.000 -
620.omnetpp_s (avg) 89.000 -
620.omnetpp_s (avg) (percentage) 2.010 -
620.omnetpp_s (max) 141.000 -
620.omnetpp_s (max) (percentage) 3.170 -
620.omnetpp_s (unexplained diff vs previous) 146.000 -
620.omnetpp_s (unexplained diff vs previous) (percentage) 3.270 -
621.wrf_s 642.000 -
621.wrf_s (avg) 642.000 -
621.wrf_s (avg) (percentage) 5.370 -
621.wrf_s (max) 344.000 -
621.wrf_s (max) (percentage) 2.880 -
623.xalancbmk_s 72.000 -
623.xalancbmk_s (avg) 72.000 -
623.xalancbmk_s (avg) (percentage) 1.390 -
623.xalancbmk_s (max) 131.000 -
623.xalancbmk_s (max) (percentage) 2.520 -
625.x264_s 27.000 -
625.x264_s (avg) 27.000 -
625.x264_s (avg) (percentage) 0.710 -
625.x264_s (max) 44.000 -
625.x264_s (max) (percentage) 1.130 -
625.x264_s (unexplained diff vs previous) 45.000 -
625.x264_s (unexplained diff vs previous) (percentage) 1.150 -
628.pop2_s 106.000 -
628.pop2_s (avg) 106.000 -
628.pop2_s (avg) (percentage) 0.750 -
628.pop2_s (max) 207.000 -
628.pop2_s (max) (percentage) 1.460 -
628.pop2_s (unexplained diff vs previous) 173.000 -
628.pop2_s (unexplained diff vs previous) (percentage) 1.220 -
631.deepsjeng_s 34.000 -
631.deepsjeng_s (avg) 34.000 -
631.deepsjeng_s (avg) (percentage) 0.780 -
631.deepsjeng_s (max) 58.000 -
631.deepsjeng_s (max) (percentage) 1.300 -
631.deepsjeng_s (unexplained diff vs previous) 59.000 -
631.deepsjeng_s (unexplained diff vs previous) (percentage) 1.320 -
638.imagick_s 69.000 -
638.imagick_s (avg) 69.000 -
638.imagick_s (avg) (percentage) 1.160 -
638.imagick_s (max) 91.000 -
638.imagick_s (max) (percentage) 1.540 -
638.imagick_s (unexplained diff vs previous) 93.000 -
638.imagick_s (unexplained diff vs previous) (percentage) 1.560 -
641.leela_s 28.000 -
641.leela_s (avg) 28.000 -
641.leela_s (avg) (percentage) 0.550 -
641.leela_s (max) 37.000 -
641.leela_s (max) (percentage) 0.730 -
641.leela_s (unexplained diff vs previous) 38.000 -
641.leela_s (unexplained diff vs previous) (percentage) 0.730 -
644.nab_s 58.000 -
644.nab_s (avg) 58.000 -
644.nab_s (avg) (percentage) 0.460 -
644.nab_s (max) 83.000 -
644.nab_s (max) (percentage) 0.660 -
644.nab_s (unexplained diff vs previous) 28.000 -
644.nab_s (unexplained diff vs previous) (percentage) 0.220 -
648.exchange2_s 14.000 -
648.exchange2_s (avg) 14.000 -
648.exchange2_s (avg) (percentage) 0.420 -
648.exchange2_s (max) 34.000 -
648.exchange2_s (max) (percentage) 1.000 -
648.exchange2_s (unexplained diff vs previous) 34.000 -
648.exchange2_s (unexplained diff vs previous) (percentage) 0.990 -
649.fotonik3d_s 220.000 -
649.fotonik3d_s (avg) 220.000 -
649.fotonik3d_s (avg) (percentage) 2.120 -
649.fotonik3d_s (max) 426.000 -
649.fotonik3d_s (max) (percentage) 4.100 -
649.fotonik3d_s (unexplained diff vs previous) 445.000 -
649.fotonik3d_s (unexplained diff vs previous) (percentage) 4.270 -
654.roms_s 978.000 -
654.roms_s (avg) 978.000 -
654.roms_s (avg) (percentage) 2.550 -
654.roms_s (max) 2432.000 -
654.roms_s (max) (percentage) 6.340 -
654.roms_s (unexplained diff vs previous) 2288.000 -
654.roms_s (unexplained diff vs previous) (percentage) 5.960 -
657.xz_s 48.000 -
657.xz_s (avg) 48.000 -
657.xz_s (avg) (percentage) 1.950 -
657.xz_s (max) 92.000 -
657.xz_s (max) (percentage) 3.730 -
657.xz_s (unexplained diff vs previous) 96.000 -
657.xz_s (unexplained diff vs previous) (percentage) 3.880 -
Geometric Mean 15.485 -14.91%