Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=cf5f570bd002fac5bc820d220d5cf8584cbaed6d (+ 45 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/04d8a47608dcae7f61805e3566e3a1571b574405 (+ 169 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=d1dcb565a1fb5829f9476a1438c30eccc4027d04 (+ 20 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=288a2f83ed42ce91cf92c2b08dad298a3da0cd9a (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-cpu2017fast--gnu-aarch64-master-Os_LTO-build/116/
View Options
Report
Filter

gnu-aarch64-master-Os_LTO test results

Run Order Start Time Duration
Current 0116 (3-changed-components) 2023-11-02T23:50:07 0:00:00
Previous 0116 (3-changed-components) 2023-11-02T23:50:07 0:00:00
Baseline 0105 (4-changed-components) 2023-10-18T06:40:59 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 0 17
Added Tests 0 105
Unchanged Tests 918 796
Total Tests 918

Run-Over-Baseline Changes Detail

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
619.lbm_s 21.61% 30454.000 37034.000 - 0.00% -
654.roms_s 12.29% 33893.000 38057.000 - 0.00% -
607.cactuBSSN_s 3.58% 5078.000 5260.000 - 0.00% -
600.perlbench_s 2.69% 2230.000 2290.000 - 0.00% -
620.omnetpp_s 2.48% 4402.000 4511.000 - 0.00% -
602.gcc_s 2.18% 5085.000 5196.000 - 0.00% -
649.fotonik3d_s 1.92% 10239.000 10436.000 - 0.00% -
628.pop2_s 1.92% 14154.000 14426.000 - 0.00% -
605.mcf_s 1.83% 7175.000 7306.000 - 0.00% -
511.povray_r 1.71% 527.000 536.000 - 0.00% -
657.xz_s 1.70% 2470.000 2512.000 - 0.00% -
638.imagick_s 1.56% 5944.000 6037.000 - 0.00% -
631.deepsjeng_s 1.45% 4214.000 4275.000 - 0.00% -
510.parest_r 1.39% 6674.000 6767.000 - 0.00% -
508.namd_r 1.39% 3451.000 3499.000 - 0.00% -
603.bwaves_s 1.26% 10436.000 10568.000 - 0.00% -
625.x264_s 1.04% 3949.000 3990.000 - 0.00% -

Added Tests - sample variability
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
600.perlbench_s
600.perlbench_s (avg)
600.perlbench_s (avg) (percentage)
600.perlbench_s (max)
600.perlbench_s (max) (percentage)
603.bwaves_s
603.bwaves_s (avg)
603.bwaves_s (avg) (percentage)
603.bwaves_s (max)
603.bwaves_s (max) (percentage)
605.mcf_s
605.mcf_s (avg)
605.mcf_s (avg) (percentage)
605.mcf_s (max)
605.mcf_s (max) (percentage)
607.cactuBSSN_s
607.cactuBSSN_s (avg)
607.cactuBSSN_s (avg) (percentage)
607.cactuBSSN_s (max)
607.cactuBSSN_s (max) (percentage)
619.lbm_s
619.lbm_s (avg)
619.lbm_s (avg) (percentage)
619.lbm_s (max)
619.lbm_s (max) (percentage)
620.omnetpp_s
620.omnetpp_s (avg)
620.omnetpp_s (avg) (percentage)
620.omnetpp_s (max)
620.omnetpp_s (max) (percentage)
623.xalancbmk_s
623.xalancbmk_s (avg)
623.xalancbmk_s (avg) (percentage)
623.xalancbmk_s (max)
623.xalancbmk_s (max) (percentage)
625.x264_s
625.x264_s (avg)
625.x264_s (avg) (percentage)
625.x264_s (max)
625.x264_s (max) (percentage)
628.pop2_s
628.pop2_s (avg)
628.pop2_s (avg) (percentage)
628.pop2_s (max)
628.pop2_s (max) (percentage)
631.deepsjeng_s
631.deepsjeng_s (avg)
631.deepsjeng_s (avg) (percentage)
631.deepsjeng_s (max)
631.deepsjeng_s (max) (percentage)
638.imagick_s
638.imagick_s (avg)
638.imagick_s (avg) (percentage)
638.imagick_s (max)
638.imagick_s (max) (percentage)
641.leela_s
641.leela_s (avg)
641.leela_s (avg) (percentage)
641.leela_s (max)
641.leela_s (max) (percentage)
644.nab_s
644.nab_s (avg)
644.nab_s (avg) (percentage)
644.nab_s (max)
644.nab_s (max) (percentage)
648.exchange2_s
648.exchange2_s (avg)
648.exchange2_s (avg) (percentage)
648.exchange2_s (max)
648.exchange2_s (max) (percentage)
649.fotonik3d_s
649.fotonik3d_s (avg)
649.fotonik3d_s (avg) (percentage)
649.fotonik3d_s (max)
649.fotonik3d_s (max) (percentage)
654.roms_s
654.roms_s (avg)
654.roms_s (avg) (percentage)
654.roms_s (max)
654.roms_s (max) (percentage)
657.xz_s
657.xz_s (avg)
657.xz_s (avg) (percentage)
657.xz_s (max)
657.xz_s (max) (percentage)

Report Time: 0.33s
Execution (seconds)
Name Current %
508.namd_r 3499.000 -
510.parest_r 6767.000 -
511.povray_r 536.000 -
526.blender_r 13089.000 -
600.perlbench_s 2290.000 -
602.gcc_s 5196.000 -
603.bwaves_s 10568.000 -
605.mcf_s 7306.000 -
607.cactuBSSN_s 5260.000 -
619.lbm_s 37034.000 -
620.omnetpp_s 4511.000 -
621.wrf_s 12605.000 -
623.xalancbmk_s 4740.000 -
625.x264_s 3990.000 -
628.pop2_s 14426.000 -
631.deepsjeng_s 4275.000 -
638.imagick_s 6037.000 -
641.leela_s 4477.000 -
644.nab_s 12628.000 -
648.exchange2_s 3468.000 -
649.fotonik3d_s 10436.000 -
654.roms_s 38057.000 -
657.xz_s 2512.000 -
Geometric Mean 6288.784 -
Code Size (bytes)
Name Current %
508.namd_r 435553.000 -
510.parest_r 1118600.000 -
511.povray_r 654805.000 -
526.blender_r 7179695.000 -
600.perlbench_s 1708265.000 -
602.gcc_s 6573811.000 -
603.bwaves_s 44430.000 -
605.mcf_s 13738.000 -
607.cactuBSSN_s 2176070.000 -
619.lbm_s 12072.000 -
620.omnetpp_s 1296408.000 -
621.wrf_s 9448032.000 -
623.xalancbmk_s 2560694.000 -
625.x264_s 348895.000 -
628.pop2_s 2554449.000 -
631.deepsjeng_s 57107.000 -
638.imagick_s 965595.000 -
641.leela_s 60280.000 -
644.nab_s 76756.000 -
648.exchange2_s 52629.000 -
649.fotonik3d_s 248887.000 -
654.roms_s 445813.000 -
657.xz_s 104070.000 -
Geometric Mean 416546.758 -
sample variability
Name Current %
508.namd_r 18.000 -
508.namd_r (avg) 18.000 -
508.namd_r (avg) (percentage) 0.540 -
508.namd_r (max) 23.000 -
508.namd_r (max) (percentage) 0.680 -
510.parest_r 88.000 -
510.parest_r (avg) 88.000 -
510.parest_r (avg) (percentage) 1.310 -
510.parest_r (max) 88.000 -
510.parest_r (max) (percentage) 1.310 -
511.povray_r 3.000 -
511.povray_r (avg) 3.000 -
511.povray_r (avg) (percentage) 0.590 -
511.povray_r (max) 5.000 -
511.povray_r (max) (percentage) 0.940 -
511.povray_r (unexplained diff vs previous) 5.000 -
511.povray_r (unexplained diff vs previous) (percentage) 0.930 -
526.blender_r 52.000 -
526.blender_r (avg) 52.000 -
526.blender_r (avg) (percentage) 0.400 -
526.blender_r (max) 49.000 -
526.blender_r (max) (percentage) 0.380 -
600.perlbench_s 26.000 -
600.perlbench_s (avg) 26.000 -
600.perlbench_s (avg) (percentage) 1.140 -
600.perlbench_s (max) 31.000 -
600.perlbench_s (max) (percentage) 1.390 -
603.bwaves_s 319.000 -
603.bwaves_s (avg) 319.000 -
603.bwaves_s (avg) (percentage) 3.020 -
603.bwaves_s (max) 591.000 -
603.bwaves_s (max) (percentage) 5.600 -
603.bwaves_s (unexplained diff vs previous) 159.000 -
603.bwaves_s (unexplained diff vs previous) (percentage) 1.500 -
605.mcf_s 101.000 -
605.mcf_s (avg) 101.000 -
605.mcf_s (avg) (percentage) 1.390 -
605.mcf_s (max) 105.000 -
605.mcf_s (max) (percentage) 1.440 -
605.mcf_s (unexplained diff vs previous) 104.000 -
605.mcf_s (unexplained diff vs previous) (percentage) 1.420 -
607.cactuBSSN_s 121.000 -
607.cactuBSSN_s (avg) 121.000 -
607.cactuBSSN_s (avg) (percentage) 2.310 -
607.cactuBSSN_s (max) 143.000 -
607.cactuBSSN_s (max) (percentage) 2.730 -
607.cactuBSSN_s (unexplained diff vs previous) 82.000 -
607.cactuBSSN_s (unexplained diff vs previous) (percentage) 1.560 -
619.lbm_s 5836.000 -
619.lbm_s (avg) 5836.000 -
619.lbm_s (avg) (percentage) 15.760 -
619.lbm_s (max) 8054.000 -
619.lbm_s (max) (percentage) 21.750 -
619.lbm_s (unexplained diff vs previous) 6617.000 -
619.lbm_s (unexplained diff vs previous) (percentage) 17.870 -
620.omnetpp_s 69.000 -
620.omnetpp_s (avg) 69.000 -
620.omnetpp_s (avg) (percentage) 1.530 -
620.omnetpp_s (max) 120.000 -
620.omnetpp_s (max) (percentage) 2.670 -
620.omnetpp_s (unexplained diff vs previous) 83.000 -
620.omnetpp_s (unexplained diff vs previous) (percentage) 1.840 -
623.xalancbmk_s 20.000 -
623.xalancbmk_s (avg) 20.000 -
623.xalancbmk_s (avg) (percentage) 0.440 -
623.xalancbmk_s (max) 29.000 -
623.xalancbmk_s (max) (percentage) 0.630 -
625.x264_s 24.000 -
625.x264_s (avg) 24.000 -
625.x264_s (avg) (percentage) 0.620 -
625.x264_s (max) 37.000 -
625.x264_s (max) (percentage) 0.940 -
625.x264_s (unexplained diff vs previous) 37.000 -
625.x264_s (unexplained diff vs previous) (percentage) 0.930 -
628.pop2_s 93.000 -
628.pop2_s (avg) 93.000 -
628.pop2_s (avg) (percentage) 0.650 -
628.pop2_s (max) 181.000 -
628.pop2_s (max) (percentage) 1.260 -
628.pop2_s (unexplained diff vs previous) 179.000 -
628.pop2_s (unexplained diff vs previous) (percentage) 1.240 -
631.deepsjeng_s 47.000 -
631.deepsjeng_s (avg) 47.000 -
631.deepsjeng_s (avg) (percentage) 1.110 -
631.deepsjeng_s (max) 67.000 -
631.deepsjeng_s (max) (percentage) 1.570 -
631.deepsjeng_s (unexplained diff vs previous) 66.000 -
631.deepsjeng_s (unexplained diff vs previous) (percentage) 1.540 -
638.imagick_s 22.000 -
638.imagick_s (avg) 22.000 -
638.imagick_s (avg) (percentage) 0.370 -
638.imagick_s (max) 51.000 -
638.imagick_s (max) (percentage) 0.850 -
641.leela_s 16.000 -
641.leela_s (avg) 16.000 -
641.leela_s (avg) (percentage) 0.370 -
641.leela_s (max) 16.000 -
641.leela_s (max) (percentage) 0.360 -
644.nab_s 26.000 -
644.nab_s (avg) 26.000 -
644.nab_s (avg) (percentage) 0.210 -
644.nab_s (max) 40.000 -
644.nab_s (max) (percentage) 0.320 -
648.exchange2_s 12.000 -
648.exchange2_s (avg) 12.000 -
648.exchange2_s (avg) (percentage) 0.360 -
648.exchange2_s (max) 18.000 -
648.exchange2_s (max) (percentage) 0.540 -
648.exchange2_s (unexplained diff vs previous) 19.000 -
648.exchange2_s (unexplained diff vs previous) (percentage) 0.550 -
649.fotonik3d_s 145.000 -
649.fotonik3d_s (avg) 145.000 -
649.fotonik3d_s (avg) (percentage) 1.390 -
649.fotonik3d_s (max) 184.000 -
649.fotonik3d_s (max) (percentage) 1.770 -
649.fotonik3d_s (unexplained diff vs previous) 169.000 -
649.fotonik3d_s (unexplained diff vs previous) (percentage) 1.620 -
654.roms_s 3352.000 -
654.roms_s (avg) 3352.000 -
654.roms_s (avg) (percentage) 8.810 -
654.roms_s (max) 4544.000 -
654.roms_s (max) (percentage) 11.940 -
654.roms_s (unexplained diff vs previous) 4058.000 -
654.roms_s (unexplained diff vs previous) (percentage) 10.660 -
657.xz_s 35.000 -
657.xz_s (avg) 35.000 -
657.xz_s (avg) (percentage) 1.420 -
657.xz_s (max) 45.000 -
657.xz_s (max) (percentage) 1.820 -
657.xz_s (unexplained diff vs previous) 45.000 -
657.xz_s (unexplained diff vs previous) (percentage) 1.790 -
Geometric Mean 13.859 -