Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=447d06696999be437b0e3c1a1f26e050ad91b952 (+ 65 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/15b83b69ca99d97643075776ba94f2dd1f05b46e (+ 56 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=4c721f24fc190d1dc935eb0bab283de7cf13182e (+ 4 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=8a1c87c391aa0de11900231e2c208b6516a6921c (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_vect-cpu2017fast--gnu-aarch64-master-O3_LTO-build/2/
Filter

gnu-aarch64-master-O3_LTO test results

Run Order Start Time Duration
Current 0002 (3-changed-components) 2023-03-06T20:22:24 0:00:00
Previous 0001 (4-changed-components) 2023-03-05T09:27:13 0:00:00
No Baseline Run


Tests Summary

Status Group #
Performance Regressions 17
Added Tests 110
Unchanged Tests 827
Total Tests 954

Performance Regressions - Execution Δ Previous Current σ
619.lbm_s 17.06% 29971.000 35083.000 -
620.omnetpp_s 5.41% 3937.000 4150.000 -
649.fotonik3d_s 4.85% 10088.000 10577.000 -
657.xz_s 4.83% 2319.000 2431.000 -
510.parest_r 4.26% 5428.000 5659.000 -
625.x264_s 4.18% 1626.000 1694.000 -
511.povray_r 3.75% 373.000 387.000 -
628.pop2_s 3.28% 10109.000 10441.000 -
600.perlbench_s 2.79% 2152.000 2212.000 -
654.roms_s 2.69% 24034.000 24680.000 -
605.mcf_s 2.64% 6394.000 6563.000 -
602.gcc_s 2.40% 4126.000 4225.000 -
638.imagick_s 1.90% 3368.000 3432.000 -
621.wrf_s 1.88% 6687.000 6813.000 -
631.deepsjeng_s 1.58% 3425.000 3479.000 -
508.namd_r 1.41% 2408.000 2442.000 -
607.cactuBSSN_s 1.17% 4798.000 4854.000 -

Added Tests - sample variability
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
600.perlbench_s
600.perlbench_s (avg)
600.perlbench_s (avg) (percentage)
600.perlbench_s (max)
600.perlbench_s (max) (percentage)
603.bwaves_s
603.bwaves_s (avg)
603.bwaves_s (avg) (percentage)
603.bwaves_s (max)
603.bwaves_s (max) (percentage)
605.mcf_s
605.mcf_s (avg)
605.mcf_s (avg) (percentage)
605.mcf_s (max)
605.mcf_s (max) (percentage)
607.cactuBSSN_s
607.cactuBSSN_s (avg)
607.cactuBSSN_s (avg) (percentage)
607.cactuBSSN_s (max)
607.cactuBSSN_s (max) (percentage)
619.lbm_s
619.lbm_s (avg)
619.lbm_s (avg) (percentage)
619.lbm_s (max)
619.lbm_s (max) (percentage)
620.omnetpp_s
620.omnetpp_s (avg)
620.omnetpp_s (avg) (percentage)
620.omnetpp_s (max)
620.omnetpp_s (max) (percentage)
621.wrf_s
621.wrf_s (avg)
621.wrf_s (avg) (percentage)
621.wrf_s (max)
621.wrf_s (max) (percentage)
623.xalancbmk_s
623.xalancbmk_s (avg)
623.xalancbmk_s (avg) (percentage)
623.xalancbmk_s (max)
623.xalancbmk_s (max) (percentage)
625.x264_s
625.x264_s (avg)
625.x264_s (avg) (percentage)
625.x264_s (max)
625.x264_s (max) (percentage)
628.pop2_s
628.pop2_s (avg)
628.pop2_s (avg) (percentage)
628.pop2_s (max)
628.pop2_s (max) (percentage)
631.deepsjeng_s
631.deepsjeng_s (avg)
631.deepsjeng_s (avg) (percentage)
631.deepsjeng_s (max)
631.deepsjeng_s (max) (percentage)
638.imagick_s
638.imagick_s (avg)
638.imagick_s (avg) (percentage)
638.imagick_s (max)
638.imagick_s (max) (percentage)
641.leela_s
641.leela_s (avg)
641.leela_s (avg) (percentage)
641.leela_s (max)
641.leela_s (max) (percentage)
644.nab_s
644.nab_s (avg)
644.nab_s (avg) (percentage)
644.nab_s (max)
644.nab_s (max) (percentage)
648.exchange2_s
648.exchange2_s (avg)
648.exchange2_s (avg) (percentage)
648.exchange2_s (max)
648.exchange2_s (max) (percentage)
649.fotonik3d_s
649.fotonik3d_s (avg)
649.fotonik3d_s (avg) (percentage)
649.fotonik3d_s (max)
649.fotonik3d_s (max) (percentage)
654.roms_s
654.roms_s (avg)
654.roms_s (avg) (percentage)
654.roms_s (max)
654.roms_s (max) (percentage)
657.xz_s
657.xz_s (avg)
657.xz_s (avg) (percentage)
657.xz_s (max)
657.xz_s (max) (percentage)


Report Time: 0.21s
Name Current %
508.namd_r 2442.000 1.41%
510.parest_r 5659.000 4.26%
511.povray_r 387.000 3.75%
526.blender_r 9986.000 -
600.perlbench_s 2212.000 2.79%
602.gcc_s 4225.000 2.40%
603.bwaves_s 8983.000 -
605.mcf_s 6563.000 2.64%
607.cactuBSSN_s 4854.000 1.17%
619.lbm_s 35083.000 17.06%
620.omnetpp_s 4150.000 5.41%
621.wrf_s 6813.000 1.88%
623.xalancbmk_s 3415.000 -
625.x264_s 1694.000 4.18%
628.pop2_s 10441.000 3.28%
631.deepsjeng_s 3479.000 1.58%
638.imagick_s 3432.000 1.90%
641.leela_s 3632.000 -
644.nab_s 10265.000 -
648.exchange2_s 1435.000 -
649.fotonik3d_s 10577.000 4.85%
654.roms_s 24680.000 2.69%
657.xz_s 2431.000 4.83%
Geometric Mean 4738.720 2.93%
Name Current %
508.namd_r 707624.000 -
510.parest_r 1733486.000 -
511.povray_r 1093239.000 -
526.blender_r 11474556.000 -
600.perlbench_s 2649560.000 -
602.gcc_s 10139438.000 -
603.bwaves_s 52595.000 -
605.mcf_s 23365.000 -
607.cactuBSSN_s 3684442.000 -
619.lbm_s 13445.000 -
620.omnetpp_s 1922167.000 -
621.wrf_s 15658855.000 -
623.xalancbmk_s 3748643.000 -
625.x264_s 646275.000 -
628.pop2_s 3413948.000 -
631.deepsjeng_s 84996.000 -
638.imagick_s 1700122.000 -
641.leela_s 108742.000 -
644.nab_s 105482.000 -
648.exchange2_s 164878.000 -
649.fotonik3d_s 343226.000 -
654.roms_s 863494.000 -
657.xz_s 150385.000 -
Geometric Mean 662187.650 -
Name Current %
508.namd_r 34.000 -
508.namd_r (avg) 34.000 -
508.namd_r (avg) (percentage) 1.410 -
508.namd_r (max) 34.000 -
508.namd_r (max) (percentage) 1.410 -
508.namd_r (unexplained diff vs previous) 34.000 -
508.namd_r (unexplained diff vs previous) (percentage) 1.390 -
510.parest_r 241.000 -
510.parest_r (avg) 241.000 -
510.parest_r (avg) (percentage) 4.260 -
510.parest_r (max) 241.000 -
510.parest_r (max) (percentage) 4.260 -
510.parest_r (unexplained diff vs previous) 231.000 -
510.parest_r (unexplained diff vs previous) (percentage) 4.080 -
511.povray_r 14.000 -
511.povray_r (avg) 14.000 -
511.povray_r (avg) (percentage) 3.750 -
511.povray_r (max) 14.000 -
511.povray_r (max) (percentage) 3.750 -
511.povray_r (unexplained diff vs previous) 14.000 -
511.povray_r (unexplained diff vs previous) (percentage) 3.620 -
526.blender_r 35.000 -
526.blender_r (avg) 35.000 -
526.blender_r (avg) (percentage) 0.360 -
526.blender_r (max) 35.000 -
526.blender_r (max) (percentage) 0.360 -
526.blender_r (unexplained diff vs previous) 36.000 -
526.blender_r (unexplained diff vs previous) (percentage) 0.360 -
600.perlbench_s 61.000 -
600.perlbench_s (avg) 61.000 -
600.perlbench_s (avg) (percentage) 2.790 -
600.perlbench_s (max) 61.000 -
600.perlbench_s (max) (percentage) 2.790 -
600.perlbench_s (unexplained diff vs previous) 60.000 -
600.perlbench_s (unexplained diff vs previous) (percentage) 2.710 -
603.bwaves_s 37.000 -
603.bwaves_s (avg) 37.000 -
603.bwaves_s (avg) (percentage) 0.420 -
603.bwaves_s (max) 37.000 -
603.bwaves_s (max) (percentage) 0.420 -
603.bwaves_s (unexplained diff vs previous) 38.000 -
603.bwaves_s (unexplained diff vs previous) (percentage) 0.420 -
605.mcf_s 173.000 -
605.mcf_s (avg) 173.000 -
605.mcf_s (avg) (percentage) 2.640 -
605.mcf_s (max) 173.000 -
605.mcf_s (max) (percentage) 2.640 -
605.mcf_s (unexplained diff vs previous) 169.000 -
605.mcf_s (unexplained diff vs previous) (percentage) 2.580 -
607.cactuBSSN_s 56.000 -
607.cactuBSSN_s (avg) 56.000 -
607.cactuBSSN_s (avg) (percentage) 1.170 -
607.cactuBSSN_s (max) 56.000 -
607.cactuBSSN_s (max) (percentage) 1.170 -
607.cactuBSSN_s (unexplained diff vs previous) 56.000 -
607.cactuBSSN_s (unexplained diff vs previous) (percentage) 1.150 -
619.lbm_s 5985.000 -
619.lbm_s (avg) 5985.000 -
619.lbm_s (avg) (percentage) 17.060 -
619.lbm_s (max) 5985.000 -
619.lbm_s (max) (percentage) 17.060 -
619.lbm_s (unexplained diff vs previous) 5112.000 -
619.lbm_s (unexplained diff vs previous) (percentage) 14.570 -
620.omnetpp_s 224.000 -
620.omnetpp_s (avg) 224.000 -
620.omnetpp_s (avg) (percentage) 5.410 -
620.omnetpp_s (max) 224.000 -
620.omnetpp_s (max) (percentage) 5.410 -
620.omnetpp_s (unexplained diff vs previous) 213.000 -
620.omnetpp_s (unexplained diff vs previous) (percentage) 5.130 -
621.wrf_s 128.000 -
621.wrf_s (avg) 128.000 -
621.wrf_s (avg) (percentage) 1.880 -
621.wrf_s (max) 128.000 -
621.wrf_s (max) (percentage) 1.880 -
621.wrf_s (unexplained diff vs previous) 126.000 -
621.wrf_s (unexplained diff vs previous) (percentage) 1.850 -
623.xalancbmk_s 7.000 -
623.xalancbmk_s (avg) 7.000 -
623.xalancbmk_s (avg) (percentage) 0.230 -
623.xalancbmk_s (max) 7.000 -
623.xalancbmk_s (max) (percentage) 0.230 -
623.xalancbmk_s (unexplained diff vs previous) 8.000 -
623.xalancbmk_s (unexplained diff vs previous) (percentage) 0.230 -
625.x264_s 70.000 -
625.x264_s (avg) 70.000 -
625.x264_s (avg) (percentage) 4.180 -
625.x264_s (max) 70.000 -
625.x264_s (max) (percentage) 4.180 -
625.x264_s (unexplained diff vs previous) 68.000 -
625.x264_s (unexplained diff vs previous) (percentage) 4.010 -
628.pop2_s 342.000 -
628.pop2_s (avg) 342.000 -
628.pop2_s (avg) (percentage) 3.280 -
628.pop2_s (max) 342.000 -
628.pop2_s (max) (percentage) 3.280 -
628.pop2_s (unexplained diff vs previous) 332.000 -
628.pop2_s (unexplained diff vs previous) (percentage) 3.180 -
631.deepsjeng_s 54.000 -
631.deepsjeng_s (avg) 54.000 -
631.deepsjeng_s (avg) (percentage) 1.580 -
631.deepsjeng_s (max) 54.000 -
631.deepsjeng_s (max) (percentage) 1.580 -
631.deepsjeng_s (unexplained diff vs previous) 54.000 -
631.deepsjeng_s (unexplained diff vs previous) (percentage) 1.550 -
638.imagick_s 65.000 -
638.imagick_s (avg) 65.000 -
638.imagick_s (avg) (percentage) 1.900 -
638.imagick_s (max) 65.000 -
638.imagick_s (max) (percentage) 1.900 -
638.imagick_s (unexplained diff vs previous) 64.000 -
638.imagick_s (unexplained diff vs previous) (percentage) 1.860 -
641.leela_s 27.000 -
641.leela_s (avg) 27.000 -
641.leela_s (avg) (percentage) 0.750 -
641.leela_s (max) 27.000 -
641.leela_s (max) (percentage) 0.750 -
641.leela_s (unexplained diff vs previous) 27.000 -
641.leela_s (unexplained diff vs previous) (percentage) 0.740 -
644.nab_s 71.000 -
644.nab_s (avg) 71.000 -
644.nab_s (avg) (percentage) 0.700 -
644.nab_s (max) 71.000 -
644.nab_s (max) (percentage) 0.700 -
644.nab_s (unexplained diff vs previous) 71.000 -
644.nab_s (unexplained diff vs previous) (percentage) 0.690 -
648.exchange2_s 13.000 -
648.exchange2_s (avg) 13.000 -
648.exchange2_s (avg) (percentage) 0.910 -
648.exchange2_s (max) 13.000 -
648.exchange2_s (max) (percentage) 0.910 -
648.exchange2_s (unexplained diff vs previous) 13.000 -
648.exchange2_s (unexplained diff vs previous) (percentage) 0.910 -
649.fotonik3d_s 512.000 -
649.fotonik3d_s (avg) 512.000 -
649.fotonik3d_s (avg) (percentage) 4.850 -
649.fotonik3d_s (max) 512.000 -
649.fotonik3d_s (max) (percentage) 4.850 -
649.fotonik3d_s (unexplained diff vs previous) 489.000 -
649.fotonik3d_s (unexplained diff vs previous) (percentage) 4.620 -
654.roms_s 663.000 -
654.roms_s (avg) 663.000 -
654.roms_s (avg) (percentage) 2.690 -
654.roms_s (max) 663.000 -
654.roms_s (max) (percentage) 2.690 -
654.roms_s (unexplained diff vs previous) 646.000 -
654.roms_s (unexplained diff vs previous) (percentage) 2.620 -
657.xz_s 117.000 -
657.xz_s (avg) 117.000 -
657.xz_s (avg) (percentage) 4.830 -
657.xz_s (max) 117.000 -
657.xz_s (max) (percentage) 4.830 -
657.xz_s (unexplained diff vs previous) 112.000 -
657.xz_s (unexplained diff vs previous) (percentage) 4.610 -
Geometric Mean 17.090 -9700298438760911077376.00%