Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=49cc32b732a2979b0b6d8ef4c0454e71b704ac4f (+ 9 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/3dfc28dbbd21b1d708aa40064380ef4c42c994d7 (unchanged)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=9fc639f654dc004736836613be703e6bed0c36a8 (unchanged)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/0c5b83b8e0d8ab9a82cb0bdbcc46a1e0ded4345e (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-cpu2017fast--gnu-aarch64-master-O2-build/213/
Filter

gnu-aarch64-master-O2 test results

Run Order Start Time Duration
Current 0213 (binutils-2_41-release-03697-g49cc32b732a) 2024-07-04T15:25:00 0:00:00
Previous 0213 (binutils-2_41-release-03697-g49cc32b732a) 2024-07-04T15:25:00 0:00:00
Baseline 0001 (4-changed-components) 2023-03-26T18:17:00 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 0 16
Performance Improvements 0 9
Added Tests 0 109
Unchanged Tests 906 772
Total Tests 906

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
510.parest_r 4.26% 7623044.000 7947747.000 - 0.00% -
508.namd_r 3.01% 627398.000 646264.000 - 0.00% -
648.exchange2_s 2.54% 60374.000 61910.000 - 0.00% -
641.leela_s 2.05% 147936.000 150971.000 - 0.00% -
649.fotonik3d_s 1.96% 308847.000 314907.000 - 0.00% -
603.bwaves_s 1.59% 49143.000 49923.000 - 0.00% -
619.lbm_s 1.30% 16006.000 16214.000 - 0.00% -
600.perlbench_s 1.03% 2120214.000 2142039.000 - 0.00% -
631.deepsjeng_s 1.01% 80966.000 81782.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
648.exchange2_s 8.87% 2199.000 2394.000 - 0.00% -
508.namd_r 2.76% 2427.000 2494.000 - 0.00% -
619.lbm_s 2.59% 28412.000 29149.000 - 0.00% -
654.roms_s 2.33% 27387.000 28025.000 - 0.00% -
510.parest_r 1.76% 5637.000 5736.000 - 0.00% -
607.cactuBSSN_s 1.45% 4748.000 4817.000 - 0.00% -
644.nab_s 1.30% 10468.000 10604.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
605.mcf_s -4.41% 6892.000 6588.000 - 0.00% -
641.leela_s -3.57% 4906.000 4731.000 - 0.00% -
628.pop2_s -2.23% 10641.000 10404.000 - 0.00% -
649.fotonik3d_s -1.67% 9813.000 9649.000 - 0.00% -
623.xalancbmk_s -1.55% 3804.000 3745.000 - 0.00% -
620.omnetpp_s -1.39% 4163.000 4105.000 - 0.00% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_execution_successful 109.09% 22.000 46.000 - 0.00% -
nb_total_tests 108.33% 24.000 50.000 - 0.00% -
nb_compile_successful 91.67% 24.000 46.000 - 0.00% -

Added Tests - Code Size
625.x264_s

Added Tests - Execution
625.x264_s

Added Tests - sample variability
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
600.perlbench_s
600.perlbench_s (avg)
600.perlbench_s (avg) (percentage)
600.perlbench_s (max)
600.perlbench_s (max) (percentage)
603.bwaves_s
603.bwaves_s (avg)
603.bwaves_s (avg) (percentage)
603.bwaves_s (max)
603.bwaves_s (max) (percentage)
605.mcf_s
605.mcf_s (avg)
605.mcf_s (avg) (percentage)
605.mcf_s (max)
605.mcf_s (max) (percentage)
607.cactuBSSN_s
607.cactuBSSN_s (avg)
607.cactuBSSN_s (avg) (percentage)
607.cactuBSSN_s (max)
607.cactuBSSN_s (max) (percentage)
619.lbm_s
619.lbm_s (avg)
619.lbm_s (avg) (percentage)
619.lbm_s (max)
619.lbm_s (max) (percentage)
620.omnetpp_s
620.omnetpp_s (avg)
620.omnetpp_s (avg) (percentage)
620.omnetpp_s (max)
620.omnetpp_s (max) (percentage)
623.xalancbmk_s
623.xalancbmk_s (avg)
623.xalancbmk_s (avg) (percentage)
623.xalancbmk_s (max)
623.xalancbmk_s (max) (percentage)
625.x264_s
625.x264_s (avg)
625.x264_s (avg) (percentage)
625.x264_s (max)
625.x264_s (max) (percentage)
625.x264_s (unexplained diff vs previous)
625.x264_s (unexplained diff vs previous) (percentage)
628.pop2_s
628.pop2_s (avg)
628.pop2_s (avg) (percentage)
628.pop2_s (max)
628.pop2_s (max) (percentage)
631.deepsjeng_s
631.deepsjeng_s (avg)
631.deepsjeng_s (avg) (percentage)
631.deepsjeng_s (max)
631.deepsjeng_s (max) (percentage)
638.imagick_s
638.imagick_s (avg)
638.imagick_s (avg) (percentage)
638.imagick_s (max)
638.imagick_s (max) (percentage)
641.leela_s
641.leela_s (avg)
641.leela_s (avg) (percentage)
641.leela_s (max)
641.leela_s (max) (percentage)
644.nab_s
644.nab_s (avg)
644.nab_s (avg) (percentage)
644.nab_s (max)
644.nab_s (max) (percentage)
648.exchange2_s
648.exchange2_s (avg)
648.exchange2_s (avg) (percentage)
648.exchange2_s (max)
648.exchange2_s (max) (percentage)
649.fotonik3d_s
649.fotonik3d_s (avg)
649.fotonik3d_s (avg) (percentage)
649.fotonik3d_s (max)
649.fotonik3d_s (max) (percentage)
654.roms_s
654.roms_s (avg)
654.roms_s (avg) (percentage)
654.roms_s (max)
654.roms_s (max) (percentage)
657.xz_s
657.xz_s (avg)
657.xz_s (avg) (percentage)
657.xz_s (max)
657.xz_s (max) (percentage)


Report Time: 0.35s
Name Current %
508.namd_r 2494.000 -
510.parest_r 5736.000 -
511.povray_r 426.000 -
526.blender_r 10073.000 -
600.perlbench_s 2078.000 -
602.gcc_s 4281.000 -
603.bwaves_s 9005.000 -
605.mcf_s 6588.000 -
607.cactuBSSN_s 4817.000 -
619.lbm_s 29149.000 -
620.omnetpp_s 4105.000 -
621.wrf_s 9208.000 -
623.xalancbmk_s 3745.000 -
625.x264_s 2594.000 -
628.pop2_s 10404.000 -
631.deepsjeng_s 3855.000 -
638.imagick_s 3334.000 -
641.leela_s 4731.000 -
644.nab_s 10604.000 -
648.exchange2_s 2394.000 -
649.fotonik3d_s 9649.000 -
654.roms_s 28025.000 -
657.xz_s 2209.000 -
Geometric Mean 5064.714 -
Name Current %
508.namd_r 646264.000 -
510.parest_r 7947747.000 -
511.povray_r 845136.000 -
526.blender_r 9839307.000 -
600.perlbench_s 2142039.000 -
602.gcc_s 9132051.000 -
603.bwaves_s 49923.000 -
605.mcf_s 21245.000 -
607.cactuBSSN_s 3239478.000 -
619.lbm_s 16214.000 -
620.omnetpp_s 2020192.000 -
621.wrf_s 17182157.000 -
623.xalancbmk_s 4506240.000 -
625.x264_s 445806.000 -
628.pop2_s 25506696.000 -
631.deepsjeng_s 81782.000 -
638.imagick_s 1872858.000 -
641.leela_s 150971.000 -
644.nab_s 176419.000 -
648.exchange2_s 61910.000 -
649.fotonik3d_s 314907.000 -
654.roms_s 684776.000 -
657.xz_s 192155.000 -
Geometric Mean 735963.401 -
Name Current %
508.namd_r 20.000 -
508.namd_r (avg) 20.000 -
508.namd_r (avg) (percentage) 0.840 -
508.namd_r (max) 26.000 -
508.namd_r (max) (percentage) 1.080 -
508.namd_r (unexplained diff vs previous) 7.000 -
508.namd_r (unexplained diff vs previous) (percentage) 0.280 -
510.parest_r 80.000 -
510.parest_r (avg) 80.000 -
510.parest_r (avg) (percentage) 1.400 -
510.parest_r (max) 138.000 -
510.parest_r (max) (percentage) 2.420 -
510.parest_r (unexplained diff vs previous) 46.000 -
510.parest_r (unexplained diff vs previous) (percentage) 0.800 -
511.povray_r 4.000 -
511.povray_r (avg) 4.000 -
511.povray_r (avg) (percentage) 0.970 -
511.povray_r (max) 3.000 -
511.povray_r (max) (percentage) 0.830 -
511.povray_r (unexplained diff vs previous) 3.000 -
511.povray_r (unexplained diff vs previous) (percentage) 0.700 -
526.blender_r 84.000 -
526.blender_r (avg) 84.000 -
526.blender_r (avg) (percentage) 0.840 -
526.blender_r (max) 96.000 -
526.blender_r (max) (percentage) 0.960 -
526.blender_r (unexplained diff vs previous) 69.000 -
526.blender_r (unexplained diff vs previous) (percentage) 0.680 -
600.perlbench_s 29.000 -
600.perlbench_s (avg) 29.000 -
600.perlbench_s (avg) (percentage) 1.400 -
600.perlbench_s (max) 48.000 -
600.perlbench_s (max) (percentage) 2.320 -
600.perlbench_s (unexplained diff vs previous) 31.000 -
600.perlbench_s (unexplained diff vs previous) (percentage) 1.490 -
603.bwaves_s 215.000 -
603.bwaves_s (avg) 215.000 -
603.bwaves_s (avg) (percentage) 2.390 -
603.bwaves_s (max) 370.000 -
603.bwaves_s (max) (percentage) 4.110 -
603.bwaves_s (unexplained diff vs previous) 336.000 -
603.bwaves_s (unexplained diff vs previous) (percentage) 3.730 -
605.mcf_s 101.000 -
605.mcf_s (avg) 101.000 -
605.mcf_s (avg) (percentage) 1.540 -
605.mcf_s (max) 154.000 -
605.mcf_s (max) (percentage) 2.340 -
605.mcf_s (unexplained diff vs previous) 55.000 -
605.mcf_s (unexplained diff vs previous) (percentage) 0.830 -
607.cactuBSSN_s 147.000 -
607.cactuBSSN_s (avg) 147.000 -
607.cactuBSSN_s (avg) (percentage) 3.070 -
607.cactuBSSN_s (max) 259.000 -
607.cactuBSSN_s (max) (percentage) 5.380 -
607.cactuBSSN_s (unexplained diff vs previous) 8.000 -
607.cactuBSSN_s (unexplained diff vs previous) (percentage) 0.170 -
619.lbm_s 2116.000 -
619.lbm_s (avg) 2116.000 -
619.lbm_s (avg) (percentage) 7.260 -
619.lbm_s (max) 4354.000 -
619.lbm_s (max) (percentage) 14.940 -
619.lbm_s (unexplained diff vs previous) 314.000 -
619.lbm_s (unexplained diff vs previous) (percentage) 1.080 -
620.omnetpp_s 70.000 -
620.omnetpp_s (avg) 70.000 -
620.omnetpp_s (avg) (percentage) 1.720 -
620.omnetpp_s (max) 123.000 -
620.omnetpp_s (max) (percentage) 3.020 -
620.omnetpp_s (unexplained diff vs previous) 24.000 -
620.omnetpp_s (unexplained diff vs previous) (percentage) 0.580 -
623.xalancbmk_s 31.000 -
623.xalancbmk_s (avg) 31.000 -
623.xalancbmk_s (avg) (percentage) 0.840 -
623.xalancbmk_s (max) 55.000 -
623.xalancbmk_s (max) (percentage) 1.470 -
623.xalancbmk_s (unexplained diff vs previous) 25.000 -
623.xalancbmk_s (unexplained diff vs previous) (percentage) 0.670 -
625.x264_s 29.000 -
625.x264_s (avg) 29.000 -
625.x264_s (avg) (percentage) 1.130 -
625.x264_s (max) 63.000 -
625.x264_s (max) (percentage) 2.430 -
625.x264_s (unexplained diff vs previous) 5.000 -
625.x264_s (unexplained diff vs previous) (percentage) 0.190 -
628.pop2_s 87.000 -
628.pop2_s (avg) 87.000 -
628.pop2_s (avg) (percentage) 0.840 -
628.pop2_s (max) 271.000 -
628.pop2_s (max) (percentage) 2.610 -
631.deepsjeng_s 33.000 -
631.deepsjeng_s (avg) 33.000 -
631.deepsjeng_s (avg) (percentage) 0.860 -
631.deepsjeng_s (max) 53.000 -
631.deepsjeng_s (max) (percentage) 1.390 -
631.deepsjeng_s (unexplained diff vs previous) 14.000 -
631.deepsjeng_s (unexplained diff vs previous) (percentage) 0.360 -
638.imagick_s 35.000 -
638.imagick_s (avg) 35.000 -
638.imagick_s (avg) (percentage) 1.070 -
638.imagick_s (max) 64.000 -
638.imagick_s (max) (percentage) 1.920 -
638.imagick_s (unexplained diff vs previous) 10.000 -
638.imagick_s (unexplained diff vs previous) (percentage) 0.300 -
641.leela_s 26.000 -
641.leela_s (avg) 26.000 -
641.leela_s (avg) (percentage) 0.560 -
641.leela_s (max) 58.000 -
641.leela_s (max) (percentage) 1.240 -
641.leela_s (unexplained diff vs previous) 26.000 -
641.leela_s (unexplained diff vs previous) (percentage) 0.550 -
644.nab_s 57.000 -
644.nab_s (avg) 57.000 -
644.nab_s (avg) (percentage) 0.540 -
644.nab_s (max) 40.000 -
644.nab_s (max) (percentage) 0.380 -
644.nab_s (unexplained diff vs previous) 38.000 -
644.nab_s (unexplained diff vs previous) (percentage) 0.360 -
648.exchange2_s 13.000 -
648.exchange2_s (avg) 13.000 -
648.exchange2_s (avg) (percentage) 0.550 -
648.exchange2_s (max) 39.000 -
648.exchange2_s (max) (percentage) 1.660 -
648.exchange2_s (unexplained diff vs previous) 39.000 -
648.exchange2_s (unexplained diff vs previous) (percentage) 1.630 -
649.fotonik3d_s 165.000 -
649.fotonik3d_s (avg) 165.000 -
649.fotonik3d_s (avg) (percentage) 1.720 -
649.fotonik3d_s (max) 312.000 -
649.fotonik3d_s (max) (percentage) 3.240 -
649.fotonik3d_s (unexplained diff vs previous) 119.000 -
649.fotonik3d_s (unexplained diff vs previous) (percentage) 1.230 -
654.roms_s 549.000 -
654.roms_s (avg) 549.000 -
654.roms_s (avg) (percentage) 1.960 -
654.roms_s (max) 588.000 -
654.roms_s (max) (percentage) 2.100 -
654.roms_s (unexplained diff vs previous) 8.000 -
654.roms_s (unexplained diff vs previous) (percentage) 0.030 -
657.xz_s 29.000 -
657.xz_s (avg) 29.000 -
657.xz_s (avg) (percentage) 1.330 -
657.xz_s (max) 65.000 -
657.xz_s (max) (percentage) 2.970 -
657.xz_s (unexplained diff vs previous) 6.000 -
657.xz_s (unexplained diff vs previous) (percentage) 0.270 -
Geometric Mean 10.515 -