Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=c411ee988375f8e7069c8ab408a7835a261d80d5 (unchanged)
git_gcc https://github.com/gcc-mirror/gcc/commit/db41057a94fe6cd556b3beedc0f5088ea485f950 (+ 43 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=9e1f4aef865ddeffeb4b5f6578fefab606783120 (unchanged)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=f13102b78850c48082dca7202b8402d9dd6745b5 (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-cpu2017fast--gnu-aarch64-master-O2-build/150/
Filter

gnu-aarch64-master-O2 test results

Run Order Start Time Duration
Current 0150 (basepoints/gcc-14-09691-gdb41057a94f) 2024-04-01T14:07:27 0:00:00
Previous 0150 (basepoints/gcc-14-09691-gdb41057a94f) 2024-04-01T14:07:27 0:00:00
Baseline 0001 (4-changed-components) 2023-03-26T18:17:00 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 0 16
Performance Improvements 0 6
Added Tests 0 111
Unchanged Tests 918 785
Total Tests 918

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
508.namd_r 5.60% 627398.000 662544.000 - 0.00% -
510.parest_r 4.45% 7623044.000 7962647.000 - 0.00% -
649.fotonik3d_s 2.69% 308847.000 317149.000 - 0.00% -
648.exchange2_s 2.59% 60374.000 61938.000 - 0.00% -
603.bwaves_s 2.52% 49143.000 50379.000 - 0.00% -
641.leela_s 1.49% 147936.000 150145.000 - 0.00% -
619.lbm_s 1.30% 16006.000 16214.000 - 0.00% -
605.mcf_s 1.23% 21065.000 21325.000 - 0.00% -
631.deepsjeng_s 1.17% 80966.000 81910.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
654.roms_s 2.88% 27387.000 28176.000 - 0.00% -
619.lbm_s 2.62% 28412.000 29156.000 - 0.00% -
508.namd_r 2.47% 2427.000 2487.000 - 0.00% -
603.bwaves_s 2.11% 8916.000 9104.000 - 0.00% -
648.exchange2_s 1.96% 2199.000 2242.000 - 0.00% -
510.parest_r 1.72% 5637.000 5734.000 - 0.00% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -4.17% 24.000 23.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
605.mcf_s -4.99% 6892.000 6548.000 - 0.00% -
641.leela_s -3.28% 4906.000 4745.000 - 0.00% -
623.xalancbmk_s -2.13% 3804.000 3723.000 - 0.00% -
602.gcc_s -1.21% 4307.000 4255.000 - 0.00% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_execution_successful 4.55% 22.000 23.000 - 0.00% -
nb_total_tests 4.17% 24.000 25.000 - 0.00% -

Added Tests - Code Size
625.x264_s

Added Tests - Execution
625.x264_s

Added Tests - sample variability
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
600.perlbench_s
600.perlbench_s (avg)
600.perlbench_s (avg) (percentage)
600.perlbench_s (max)
600.perlbench_s (max) (percentage)
603.bwaves_s
603.bwaves_s (avg)
603.bwaves_s (avg) (percentage)
603.bwaves_s (max)
603.bwaves_s (max) (percentage)
605.mcf_s
605.mcf_s (avg)
605.mcf_s (avg) (percentage)
605.mcf_s (max)
605.mcf_s (max) (percentage)
607.cactuBSSN_s
607.cactuBSSN_s (avg)
607.cactuBSSN_s (avg) (percentage)
607.cactuBSSN_s (max)
607.cactuBSSN_s (max) (percentage)
619.lbm_s
619.lbm_s (avg)
619.lbm_s (avg) (percentage)
619.lbm_s (max)
619.lbm_s (max) (percentage)
620.omnetpp_s
620.omnetpp_s (avg)
620.omnetpp_s (avg) (percentage)
620.omnetpp_s (max)
620.omnetpp_s (max) (percentage)
623.xalancbmk_s
623.xalancbmk_s (avg)
623.xalancbmk_s (avg) (percentage)
623.xalancbmk_s (max)
623.xalancbmk_s (max) (percentage)
625.x264_s
625.x264_s (avg)
625.x264_s (avg) (percentage)
625.x264_s (max)
625.x264_s (max) (percentage)
625.x264_s (unexplained diff vs previous)
625.x264_s (unexplained diff vs previous) (percentage)
628.pop2_s
628.pop2_s (avg)
628.pop2_s (avg) (percentage)
628.pop2_s (max)
628.pop2_s (max) (percentage)
628.pop2_s (unexplained diff vs previous)
628.pop2_s (unexplained diff vs previous) (percentage)
631.deepsjeng_s
631.deepsjeng_s (avg)
631.deepsjeng_s (avg) (percentage)
631.deepsjeng_s (max)
631.deepsjeng_s (max) (percentage)
638.imagick_s
638.imagick_s (avg)
638.imagick_s (avg) (percentage)
638.imagick_s (max)
638.imagick_s (max) (percentage)
641.leela_s
641.leela_s (avg)
641.leela_s (avg) (percentage)
641.leela_s (max)
641.leela_s (max) (percentage)
644.nab_s
644.nab_s (avg)
644.nab_s (avg) (percentage)
644.nab_s (max)
644.nab_s (max) (percentage)
648.exchange2_s
648.exchange2_s (avg)
648.exchange2_s (avg) (percentage)
648.exchange2_s (max)
648.exchange2_s (max) (percentage)
649.fotonik3d_s
649.fotonik3d_s (avg)
649.fotonik3d_s (avg) (percentage)
649.fotonik3d_s (max)
649.fotonik3d_s (max) (percentage)
654.roms_s
654.roms_s (avg)
654.roms_s (avg) (percentage)
654.roms_s (max)
654.roms_s (max) (percentage)
657.xz_s
657.xz_s (avg)
657.xz_s (avg) (percentage)
657.xz_s (max)
657.xz_s (max) (percentage)


Report Time: 0.33s
Name Current %
508.namd_r 2487.000 -
510.parest_r 5734.000 -
511.povray_r 423.000 -
526.blender_r 10056.000 -
600.perlbench_s 2070.000 -
602.gcc_s 4255.000 -
603.bwaves_s 9104.000 -
605.mcf_s 6548.000 -
607.cactuBSSN_s 4740.000 -
619.lbm_s 29156.000 -
620.omnetpp_s 4148.000 -
621.wrf_s 9209.000 -
623.xalancbmk_s 3723.000 -
625.x264_s 2599.000 -
628.pop2_s 10659.000 -
631.deepsjeng_s 3818.000 -
638.imagick_s 3333.000 -
641.leela_s 4745.000 -
644.nab_s 10449.000 -
648.exchange2_s 2242.000 -
649.fotonik3d_s 9716.000 -
654.roms_s 28176.000 -
657.xz_s 2214.000 -
Geometric Mean 5048.253 -
Name Current %
508.namd_r 662544.000 -
510.parest_r 7962647.000 -
511.povray_r 846528.000 -
526.blender_r 9846306.000 -
600.perlbench_s 2138463.000 -
602.gcc_s 9134843.000 -
603.bwaves_s 50379.000 -
605.mcf_s 21325.000 -
607.cactuBSSN_s 3226442.000 -
619.lbm_s 16214.000 -
620.omnetpp_s 2022828.000 -
621.wrf_s 17143001.000 -
623.xalancbmk_s 4504511.000 -
625.x264_s 446062.000 -
628.pop2_s 25486304.000 -
631.deepsjeng_s 81910.000 -
638.imagick_s 1872018.000 -
641.leela_s 150145.000 -
644.nab_s 176667.000 -
648.exchange2_s 61938.000 -
649.fotonik3d_s 317149.000 -
654.roms_s 686626.000 -
657.xz_s 192035.000 -
Geometric Mean 737296.669 -
Name Current %
508.namd_r 20.000 -
508.namd_r (avg) 20.000 -
508.namd_r (avg) (percentage) 0.830 -
508.namd_r (max) 41.000 -
508.namd_r (max) (percentage) 1.680 -
508.namd_r (unexplained diff vs previous) 41.000 -
508.namd_r (unexplained diff vs previous) (percentage) 1.650 -
510.parest_r 84.000 -
510.parest_r (avg) 84.000 -
510.parest_r (avg) (percentage) 1.470 -
510.parest_r (max) 168.000 -
510.parest_r (max) (percentage) 2.940 -
510.parest_r (unexplained diff vs previous) 3.000 -
510.parest_r (unexplained diff vs previous) (percentage) 0.050 -
511.povray_r 4.000 -
511.povray_r (avg) 4.000 -
511.povray_r (avg) (percentage) 1.010 -
511.povray_r (max) 5.000 -
511.povray_r (max) (percentage) 1.360 -
511.povray_r (unexplained diff vs previous) 2.000 -
511.povray_r (unexplained diff vs previous) (percentage) 0.470 -
526.blender_r 92.000 -
526.blender_r (avg) 92.000 -
526.blender_r (avg) (percentage) 0.920 -
526.blender_r (max) 48.000 -
526.blender_r (max) (percentage) 0.480 -
526.blender_r (unexplained diff vs previous) 46.000 -
526.blender_r (unexplained diff vs previous) (percentage) 0.460 -
600.perlbench_s 31.000 -
600.perlbench_s (avg) 31.000 -
600.perlbench_s (avg) (percentage) 1.500 -
600.perlbench_s (max) 56.000 -
600.perlbench_s (max) (percentage) 2.720 -
600.perlbench_s (unexplained diff vs previous) 17.000 -
600.perlbench_s (unexplained diff vs previous) (percentage) 0.820 -
603.bwaves_s 271.000 -
603.bwaves_s (avg) 271.000 -
603.bwaves_s (avg) (percentage) 2.980 -
603.bwaves_s (max) 985.000 -
603.bwaves_s (max) (percentage) 10.820 -
603.bwaves_s (unexplained diff vs previous) 135.000 -
603.bwaves_s (unexplained diff vs previous) (percentage) 1.480 -
605.mcf_s 119.000 -
605.mcf_s (avg) 119.000 -
605.mcf_s (avg) (percentage) 1.820 -
605.mcf_s (max) 441.000 -
605.mcf_s (max) (percentage) 6.750 -
605.mcf_s (unexplained diff vs previous) 59.000 -
605.mcf_s (unexplained diff vs previous) (percentage) 0.900 -
607.cactuBSSN_s 157.000 -
607.cactuBSSN_s (avg) 157.000 -
607.cactuBSSN_s (avg) (percentage) 3.320 -
607.cactuBSSN_s (max) 218.000 -
607.cactuBSSN_s (max) (percentage) 4.600 -
607.cactuBSSN_s (unexplained diff vs previous) 73.000 -
607.cactuBSSN_s (unexplained diff vs previous) (percentage) 1.540 -
619.lbm_s 2236.000 -
619.lbm_s (avg) 2236.000 -
619.lbm_s (avg) (percentage) 7.670 -
619.lbm_s (max) 3067.000 -
619.lbm_s (max) (percentage) 10.520 -
619.lbm_s (unexplained diff vs previous) 20.000 -
619.lbm_s (unexplained diff vs previous) (percentage) 0.070 -
620.omnetpp_s 90.000 -
620.omnetpp_s (avg) 90.000 -
620.omnetpp_s (avg) (percentage) 2.170 -
620.omnetpp_s (max) 59.000 -
620.omnetpp_s (max) (percentage) 1.440 -
620.omnetpp_s (unexplained diff vs previous) 20.000 -
620.omnetpp_s (unexplained diff vs previous) (percentage) 0.480 -
623.xalancbmk_s 32.000 -
623.xalancbmk_s (avg) 32.000 -
623.xalancbmk_s (avg) (percentage) 0.880 -
623.xalancbmk_s (max) 31.000 -
623.xalancbmk_s (max) (percentage) 0.850 -
623.xalancbmk_s (unexplained diff vs previous) 26.000 -
623.xalancbmk_s (unexplained diff vs previous) (percentage) 0.700 -
625.x264_s 27.000 -
625.x264_s (avg) 27.000 -
625.x264_s (avg) (percentage) 1.050 -
625.x264_s (max) 67.000 -
625.x264_s (max) (percentage) 2.580 -
625.x264_s (unexplained diff vs previous) 9.000 -
625.x264_s (unexplained diff vs previous) (percentage) 0.350 -
628.pop2_s 92.000 -
628.pop2_s (avg) 92.000 -
628.pop2_s (avg) (percentage) 0.870 -
628.pop2_s (max) 95.000 -
628.pop2_s (max) (percentage) 0.900 -
628.pop2_s (unexplained diff vs previous) 29.000 -
628.pop2_s (unexplained diff vs previous) (percentage) 0.270 -
631.deepsjeng_s 30.000 -
631.deepsjeng_s (avg) 30.000 -
631.deepsjeng_s (avg) (percentage) 0.810 -
631.deepsjeng_s (max) 33.000 -
631.deepsjeng_s (max) (percentage) 0.870 -
631.deepsjeng_s (unexplained diff vs previous) 4.000 -
631.deepsjeng_s (unexplained diff vs previous) (percentage) 0.100 -
638.imagick_s 44.000 -
638.imagick_s (avg) 44.000 -
638.imagick_s (avg) (percentage) 1.340 -
638.imagick_s (max) 114.000 -
638.imagick_s (max) (percentage) 3.450 -
638.imagick_s (unexplained diff vs previous) 1.000 -
638.imagick_s (unexplained diff vs previous) (percentage) 0.030 -
641.leela_s 28.000 -
641.leela_s (avg) 28.000 -
641.leela_s (avg) (percentage) 0.610 -
641.leela_s (max) 40.000 -
641.leela_s (max) (percentage) 0.850 -
641.leela_s (unexplained diff vs previous) 40.000 -
641.leela_s (unexplained diff vs previous) (percentage) 0.840 -
644.nab_s 70.000 -
644.nab_s (avg) 70.000 -
644.nab_s (avg) (percentage) 0.670 -
644.nab_s (max) 117.000 -
644.nab_s (max) (percentage) 1.120 -
644.nab_s (unexplained diff vs previous) 118.000 -
644.nab_s (unexplained diff vs previous) (percentage) 1.130 -
648.exchange2_s 16.000 -
648.exchange2_s (avg) 16.000 -
648.exchange2_s (avg) (percentage) 0.720 -
648.exchange2_s (max) 31.000 -
648.exchange2_s (max) (percentage) 1.410 -
648.exchange2_s (unexplained diff vs previous) 32.000 -
648.exchange2_s (unexplained diff vs previous) (percentage) 1.430 -
649.fotonik3d_s 176.000 -
649.fotonik3d_s (avg) 176.000 -
649.fotonik3d_s (avg) (percentage) 1.820 -
649.fotonik3d_s (max) 359.000 -
649.fotonik3d_s (max) (percentage) 3.700 -
649.fotonik3d_s (unexplained diff vs previous) 58.000 -
649.fotonik3d_s (unexplained diff vs previous) (percentage) 0.600 -
654.roms_s 670.000 -
654.roms_s (avg) 670.000 -
654.roms_s (avg) (percentage) 2.380 -
654.roms_s (max) 1067.000 -
654.roms_s (max) (percentage) 3.790 -
654.roms_s (unexplained diff vs previous) 32.000 -
654.roms_s (unexplained diff vs previous) (percentage) 0.110 -
657.xz_s 33.000 -
657.xz_s (avg) 33.000 -
657.xz_s (avg) (percentage) 1.520 -
657.xz_s (max) 35.000 -
657.xz_s (max) (percentage) 1.600 -
657.xz_s (unexplained diff vs previous) 8.000 -
657.xz_s (unexplained diff vs previous) (percentage) 0.360 -
Geometric Mean 10.197 -