Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=75d277b1f506dcfbedfee3bef078dfe2b484958b (+ 41 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/bf2b5231312e1cea45732cb8df6ffa2b2c9115b6 (+ 47 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=59974938fe1f4add843f5325f78e2a7ccd8db853 (+ 1 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=0640bfe1fb73d1ba2bb89af661284d371133db44 (+ 319 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-cpu2017fast--gnu-aarch64-master-O2-build/155/
Filter

gnu-aarch64-master-O2 test results

Run Order Start Time Duration
Current 0155 (4-changed-components) 2024-04-12T16:00:35 0:00:00
Previous 0155 (4-changed-components) 2024-04-12T16:00:35 0:00:00
Baseline 0001 (4-changed-components) 2023-03-26T18:17:00 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 0 18
Performance Improvements 0 4
Added Tests 2 111
Unchanged Tests 916 785
Total Tests 918

Added Tests - sample variability
625.x264_s (unexplained diff vs previous)
625.x264_s (unexplained diff vs previous) (percentage)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
508.namd_r 5.60% 627398.000 662544.000 - 0.00% -
510.parest_r 4.46% 7623044.000 7962679.000 - 0.00% -
649.fotonik3d_s 2.68% 308847.000 317117.000 - 0.00% -
648.exchange2_s 2.59% 60374.000 61938.000 - 0.00% -
603.bwaves_s 2.52% 49143.000 50379.000 - 0.00% -
641.leela_s 1.49% 147936.000 150145.000 - 0.00% -
619.lbm_s 1.30% 16006.000 16214.000 - 0.00% -
605.mcf_s 1.23% 21065.000 21325.000 - 0.00% -
631.deepsjeng_s 1.17% 80966.000 81910.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
648.exchange2_s 4.46% 2199.000 2297.000 - 0.00% -
619.lbm_s 3.74% 28412.000 29475.000 - 0.00% -
654.roms_s 3.41% 27387.000 28321.000 - 0.00% -
603.bwaves_s 3.17% 8916.000 9199.000 - 0.00% -
508.namd_r 2.39% 2427.000 2485.000 - 0.00% -
510.parest_r 2.18% 5637.000 5760.000 - 0.00% -
607.cactuBSSN_s 2.00% 4748.000 4843.000 - 0.00% -
628.pop2_s 1.28% 10641.000 10777.000 - 0.00% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -8.33% 24.000 22.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
605.mcf_s -5.86% 6892.000 6488.000 - 0.00% -
641.leela_s -3.79% 4906.000 4720.000 - 0.00% -
623.xalancbmk_s -2.47% 3804.000 3710.000 - 0.00% -
511.povray_r -1.88% 425.000 417.000 - 0.00% -

Added Tests - Code Size
625.x264_s

Added Tests - Execution
625.x264_s

Added Tests - sample variability
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
600.perlbench_s
600.perlbench_s (avg)
600.perlbench_s (avg) (percentage)
600.perlbench_s (max)
600.perlbench_s (max) (percentage)
603.bwaves_s
603.bwaves_s (avg)
603.bwaves_s (avg) (percentage)
603.bwaves_s (max)
603.bwaves_s (max) (percentage)
605.mcf_s
605.mcf_s (avg)
605.mcf_s (avg) (percentage)
605.mcf_s (max)
605.mcf_s (max) (percentage)
607.cactuBSSN_s
607.cactuBSSN_s (avg)
607.cactuBSSN_s (avg) (percentage)
607.cactuBSSN_s (max)
607.cactuBSSN_s (max) (percentage)
619.lbm_s
619.lbm_s (avg)
619.lbm_s (avg) (percentage)
619.lbm_s (max)
619.lbm_s (max) (percentage)
620.omnetpp_s
620.omnetpp_s (avg)
620.omnetpp_s (avg) (percentage)
620.omnetpp_s (max)
620.omnetpp_s (max) (percentage)
623.xalancbmk_s
623.xalancbmk_s (avg)
623.xalancbmk_s (avg) (percentage)
623.xalancbmk_s (max)
623.xalancbmk_s (max) (percentage)
625.x264_s
625.x264_s (avg)
625.x264_s (avg) (percentage)
625.x264_s (max)
625.x264_s (max) (percentage)
625.x264_s (unexplained diff vs previous)
625.x264_s (unexplained diff vs previous) (percentage)
628.pop2_s
628.pop2_s (avg)
628.pop2_s (avg) (percentage)
628.pop2_s (max)
628.pop2_s (max) (percentage)
628.pop2_s (unexplained diff vs previous)
628.pop2_s (unexplained diff vs previous) (percentage)
631.deepsjeng_s
631.deepsjeng_s (avg)
631.deepsjeng_s (avg) (percentage)
631.deepsjeng_s (max)
631.deepsjeng_s (max) (percentage)
638.imagick_s
638.imagick_s (avg)
638.imagick_s (avg) (percentage)
638.imagick_s (max)
638.imagick_s (max) (percentage)
641.leela_s
641.leela_s (avg)
641.leela_s (avg) (percentage)
641.leela_s (max)
641.leela_s (max) (percentage)
644.nab_s
644.nab_s (avg)
644.nab_s (avg) (percentage)
644.nab_s (max)
644.nab_s (max) (percentage)
648.exchange2_s
648.exchange2_s (avg)
648.exchange2_s (avg) (percentage)
648.exchange2_s (max)
648.exchange2_s (max) (percentage)
649.fotonik3d_s
649.fotonik3d_s (avg)
649.fotonik3d_s (avg) (percentage)
649.fotonik3d_s (max)
649.fotonik3d_s (max) (percentage)
654.roms_s
654.roms_s (avg)
654.roms_s (avg) (percentage)
654.roms_s (max)
654.roms_s (max) (percentage)
657.xz_s
657.xz_s (avg)
657.xz_s (avg) (percentage)
657.xz_s (max)
657.xz_s (max) (percentage)


Report Time: 0.33s
Name Current %
508.namd_r 2485.000 -
510.parest_r 5760.000 -
511.povray_r 417.000 -
526.blender_r 10135.000 -
600.perlbench_s 2069.000 -
602.gcc_s 4299.000 -
603.bwaves_s 9199.000 -
605.mcf_s 6488.000 -
607.cactuBSSN_s 4843.000 -
619.lbm_s 29475.000 -
620.omnetpp_s 4160.000 -
623.xalancbmk_s 3710.000 -
625.x264_s 2603.000 -
628.pop2_s 10777.000 -
631.deepsjeng_s 3837.000 -
638.imagick_s 3338.000 -
641.leela_s 4720.000 -
644.nab_s 10563.000 -
648.exchange2_s 2297.000 -
649.fotonik3d_s 9757.000 -
654.roms_s 28321.000 -
657.xz_s 2217.000 -
Geometric Mean 4934.451 -
Name Current %
508.namd_r 662544.000 -
510.parest_r 7962679.000 -
511.povray_r 846528.000 -
526.blender_r 9846306.000 -
600.perlbench_s 2138463.000 -
602.gcc_s 9134843.000 -
603.bwaves_s 50379.000 -
605.mcf_s 21325.000 -
607.cactuBSSN_s 3226442.000 -
619.lbm_s 16214.000 -
620.omnetpp_s 2022828.000 -
623.xalancbmk_s 4504511.000 -
625.x264_s 446062.000 -
628.pop2_s 25498560.000 -
631.deepsjeng_s 81910.000 -
638.imagick_s 1872018.000 -
641.leela_s 150145.000 -
644.nab_s 176667.000 -
648.exchange2_s 61938.000 -
649.fotonik3d_s 317117.000 -
654.roms_s 686594.000 -
657.xz_s 192035.000 -
Geometric Mean 639054.375 -
Name Current %
508.namd_r 20.000 -
508.namd_r (avg) 20.000 -
508.namd_r (avg) (percentage) 0.830 -
508.namd_r (max) 34.000 -
508.namd_r (max) (percentage) 1.400 -
508.namd_r (unexplained diff vs previous) 19.000 -
508.namd_r (unexplained diff vs previous) (percentage) 0.760 -
510.parest_r 80.000 -
510.parest_r (avg) 80.000 -
510.parest_r (avg) (percentage) 1.390 -
510.parest_r (max) 158.000 -
510.parest_r (max) (percentage) 2.760 -
510.parest_r (unexplained diff vs previous) 61.000 -
510.parest_r (unexplained diff vs previous) (percentage) 1.060 -
511.povray_r 4.000 -
511.povray_r (avg) 4.000 -
511.povray_r (avg) (percentage) 1.000 -
511.povray_r (max) 5.000 -
511.povray_r (max) (percentage) 1.240 -
511.povray_r (unexplained diff vs previous) 1.000 -
511.povray_r (unexplained diff vs previous) (percentage) 0.240 -
526.blender_r 91.000 -
526.blender_r (avg) 91.000 -
526.blender_r (avg) (percentage) 0.900 -
526.blender_r (max) 123.000 -
526.blender_r (max) (percentage) 1.220 -
526.blender_r (unexplained diff vs previous) 122.000 -
526.blender_r (unexplained diff vs previous) (percentage) 1.200 -
600.perlbench_s 29.000 -
600.perlbench_s (avg) 29.000 -
600.perlbench_s (avg) (percentage) 1.440 -
600.perlbench_s (max) 28.000 -
600.perlbench_s (max) (percentage) 1.390 -
600.perlbench_s (unexplained diff vs previous) 19.000 -
600.perlbench_s (unexplained diff vs previous) (percentage) 0.920 -
603.bwaves_s 257.000 -
603.bwaves_s (avg) 257.000 -
603.bwaves_s (avg) (percentage) 2.800 -
603.bwaves_s (max) 172.000 -
603.bwaves_s (max) (percentage) 1.880 -
603.bwaves_s (unexplained diff vs previous) 48.000 -
603.bwaves_s (unexplained diff vs previous) (percentage) 0.520 -
605.mcf_s 110.000 -
605.mcf_s (avg) 110.000 -
605.mcf_s (avg) (percentage) 1.710 -
605.mcf_s (max) 48.000 -
605.mcf_s (max) (percentage) 0.740 -
605.mcf_s (unexplained diff vs previous) 40.000 -
605.mcf_s (unexplained diff vs previous) (percentage) 0.620 -
607.cactuBSSN_s 152.000 -
607.cactuBSSN_s (avg) 152.000 -
607.cactuBSSN_s (avg) (percentage) 3.150 -
607.cactuBSSN_s (max) 126.000 -
607.cactuBSSN_s (max) (percentage) 2.610 -
607.cactuBSSN_s (unexplained diff vs previous) 26.000 -
607.cactuBSSN_s (unexplained diff vs previous) (percentage) 0.540 -
619.lbm_s 2119.000 -
619.lbm_s (avg) 2119.000 -
619.lbm_s (avg) (percentage) 7.190 -
619.lbm_s (max) 274.000 -
619.lbm_s (max) (percentage) 0.930 -
619.lbm_s (unexplained diff vs previous) 8.000 -
619.lbm_s (unexplained diff vs previous) (percentage) 0.030 -
620.omnetpp_s 86.000 -
620.omnetpp_s (avg) 86.000 -
620.omnetpp_s (avg) (percentage) 2.070 -
620.omnetpp_s (max) 24.000 -
620.omnetpp_s (max) (percentage) 0.580 -
620.omnetpp_s (unexplained diff vs previous) 24.000 -
620.omnetpp_s (unexplained diff vs previous) (percentage) 0.580 -
623.xalancbmk_s 30.000 -
623.xalancbmk_s (avg) 30.000 -
623.xalancbmk_s (avg) (percentage) 0.820 -
623.xalancbmk_s (max) 21.000 -
623.xalancbmk_s (max) (percentage) 0.580 -
623.xalancbmk_s (unexplained diff vs previous) 6.000 -
623.xalancbmk_s (unexplained diff vs previous) (percentage) 0.160 -
625.x264_s 24.000 -
625.x264_s (avg) 24.000 -
625.x264_s (avg) (percentage) 0.950 -
625.x264_s (max) 7.000 -
625.x264_s (max) (percentage) 0.280 -
625.x264_s (unexplained diff vs previous) 0.000 -
625.x264_s (unexplained diff vs previous) (percentage) 0.000 -
628.pop2_s 79.000 -
628.pop2_s (avg) 79.000 -
628.pop2_s (avg) (percentage) 0.740 -
628.pop2_s (max) 94.000 -
628.pop2_s (max) (percentage) 0.880 -
628.pop2_s (unexplained diff vs previous) 1.000 -
628.pop2_s (unexplained diff vs previous) (percentage) 0.010 -
631.deepsjeng_s 30.000 -
631.deepsjeng_s (avg) 30.000 -
631.deepsjeng_s (avg) (percentage) 0.790 -
631.deepsjeng_s (max) 33.000 -
631.deepsjeng_s (max) (percentage) 0.870 -
631.deepsjeng_s (unexplained diff vs previous) 12.000 -
631.deepsjeng_s (unexplained diff vs previous) (percentage) 0.310 -
638.imagick_s 40.000 -
638.imagick_s (avg) 40.000 -
638.imagick_s (avg) (percentage) 1.200 -
638.imagick_s (max) 108.000 -
638.imagick_s (max) (percentage) 3.240 -
638.imagick_s (unexplained diff vs previous) 4.000 -
638.imagick_s (unexplained diff vs previous) (percentage) 0.120 -
641.leela_s 26.000 -
641.leela_s (avg) 26.000 -
641.leela_s (avg) (percentage) 0.570 -
641.leela_s (max) 33.000 -
641.leela_s (max) (percentage) 0.710 -
641.leela_s (unexplained diff vs previous) 5.000 -
641.leela_s (unexplained diff vs previous) (percentage) 0.110 -
644.nab_s 68.000 -
644.nab_s (avg) 68.000 -
644.nab_s (avg) (percentage) 0.650 -
644.nab_s (max) 95.000 -
644.nab_s (max) (percentage) 0.900 -
644.nab_s (unexplained diff vs previous) 25.000 -
644.nab_s (unexplained diff vs previous) (percentage) 0.240 -
648.exchange2_s 17.000 -
648.exchange2_s (avg) 17.000 -
648.exchange2_s (avg) (percentage) 0.760 -
648.exchange2_s (max) 33.000 -
648.exchange2_s (max) (percentage) 1.460 -
648.exchange2_s (unexplained diff vs previous) 33.000 -
648.exchange2_s (unexplained diff vs previous) (percentage) 1.440 -
649.fotonik3d_s 169.000 -
649.fotonik3d_s (avg) 169.000 -
649.fotonik3d_s (avg) (percentage) 1.740 -
649.fotonik3d_s (max) 46.000 -
649.fotonik3d_s (max) (percentage) 0.480 -
649.fotonik3d_s (unexplained diff vs previous) 14.000 -
649.fotonik3d_s (unexplained diff vs previous) (percentage) 0.140 -
654.roms_s 637.000 -
654.roms_s (avg) 637.000 -
654.roms_s (avg) (percentage) 2.250 -
654.roms_s (max) 25.000 -
654.roms_s (max) (percentage) 0.090 -
654.roms_s (unexplained diff vs previous) 19.000 -
654.roms_s (unexplained diff vs previous) (percentage) 0.070 -
657.xz_s 31.000 -
657.xz_s (avg) 31.000 -
657.xz_s (avg) (percentage) 1.410 -
657.xz_s (max) 35.000 -
657.xz_s (max) (percentage) 1.600 -
657.xz_s (unexplained diff vs previous) 5.000 -
657.xz_s (unexplained diff vs previous) (percentage) 0.230 -
Geometric Mean 6.176 -14.11%