Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/6d1c6ecbdc4e94cafd51ade0331d7112161a4cf3 (+ 65 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-cpu2017fast--llvm-aarch64-master-Os_LTO-build/74/
Filter

llvm-aarch64-master-Os_LTO test results

Run Order Start Time Duration
Current 0074 (llvmorg-18-init-06128-g6d1c6ecbdc4e) 2023-09-17T11:23:52 0:00:00
Previous 0074 (llvmorg-18-init-06128-g6d1c6ecbdc4e) 2023-09-17T11:23:52 0:00:00
Baseline 0001 (llvmorg-17-init-03361-gd77f96a9e0c8) 2023-02-27T23:41:40 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 0 10
Performance Improvements 0 8
Added Tests 0 75
Unchanged Tests 702 609
Total Tests 702

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
657.xz_s 10.84% 2287.000 2535.000 - 0.00% -
600.perlbench_s 5.27% 2298.000 2419.000 - 0.00% -
638.imagick_s 4.42% 3258.000 3402.000 - 0.00% -
508.namd_r 3.64% 2445.000 2534.000 - 0.00% -
526.blender_r 3.53% 8579.000 8882.000 - 0.00% -
620.omnetpp_s 3.20% 3747.000 3867.000 - 0.00% -
625.x264_s 3.16% 2662.000 2746.000 - 0.00% -
602.gcc_s 2.78% 4203.000 4320.000 - 0.00% -
641.leela_s 2.41% 3990.000 4086.000 - 0.00% -
605.mcf_s 1.90% 6202.000 6320.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
619.lbm_s -4.84% 13938.000 13263.000 - 0.00% -
631.deepsjeng_s -4.52% 60687.000 57943.000 - 0.00% -
605.mcf_s -2.79% 15336.000 14908.000 - 0.00% -
511.povray_r -2.22% 740092.000 723685.000 - 0.00% -
644.nab_s -1.60% 84129.000 82782.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
511.povray_r -8.41% 452.000 414.000 - 0.00% -
623.xalancbmk_s -4.03% 3621.000 3475.000 - 0.00% -
631.deepsjeng_s -1.89% 3596.000 3528.000 - 0.00% -

Added Tests - sample variability
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
600.perlbench_s
600.perlbench_s (avg)
600.perlbench_s (avg) (percentage)
600.perlbench_s (max)
600.perlbench_s (max) (percentage)
605.mcf_s
605.mcf_s (avg)
605.mcf_s (avg) (percentage)
605.mcf_s (max)
605.mcf_s (max) (percentage)
619.lbm_s
619.lbm_s (avg)
619.lbm_s (avg) (percentage)
619.lbm_s (max)
619.lbm_s (max) (percentage)
620.omnetpp_s
620.omnetpp_s (avg)
620.omnetpp_s (avg) (percentage)
620.omnetpp_s (max)
620.omnetpp_s (max) (percentage)
623.xalancbmk_s
623.xalancbmk_s (avg)
623.xalancbmk_s (avg) (percentage)
623.xalancbmk_s (max)
623.xalancbmk_s (max) (percentage)
625.x264_s
625.x264_s (avg)
625.x264_s (avg) (percentage)
625.x264_s (max)
625.x264_s (max) (percentage)
631.deepsjeng_s
631.deepsjeng_s (avg)
631.deepsjeng_s (avg) (percentage)
631.deepsjeng_s (max)
631.deepsjeng_s (max) (percentage)
638.imagick_s
638.imagick_s (avg)
638.imagick_s (avg) (percentage)
638.imagick_s (max)
638.imagick_s (max) (percentage)
641.leela_s
641.leela_s (avg)
641.leela_s (avg) (percentage)
641.leela_s (max)
641.leela_s (max) (percentage)
644.nab_s
644.nab_s (avg)
644.nab_s (avg) (percentage)
644.nab_s (max)
644.nab_s (max) (percentage)
657.xz_s
657.xz_s (avg)
657.xz_s (avg) (percentage)
657.xz_s (max)
657.xz_s (max) (percentage)


Report Time: 0.33s
Name Current %
508.namd_r 2534.000 -
510.parest_r 5632.000 -
511.povray_r 414.000 -
526.blender_r 8882.000 -
600.perlbench_s 2419.000 -
602.gcc_s 4320.000 -
605.mcf_s 6320.000 -
619.lbm_s 31263.000 -
620.omnetpp_s 3867.000 -
623.xalancbmk_s 3475.000 -
625.x264_s 2746.000 -
631.deepsjeng_s 3528.000 -
638.imagick_s 3402.000 -
641.leela_s 4086.000 -
644.nab_s 11184.000 -
657.xz_s 2535.000 -
Geometric Mean 4065.026 -
Name Current %
508.namd_r 379716.000 -
510.parest_r 1477123.000 -
511.povray_r 723685.000 -
526.blender_r 11510604.000 -
600.perlbench_s 1870236.000 -
602.gcc_s 7982018.000 -
605.mcf_s 14908.000 -
619.lbm_s 13263.000 -
620.omnetpp_s 1652842.000 -
623.xalancbmk_s 3227951.000 -
625.x264_s 407813.000 -
631.deepsjeng_s 57943.000 -
638.imagick_s 1167722.000 -
641.leela_s 71114.000 -
644.nab_s 82782.000 -
657.xz_s 110935.000 -
Geometric Mean 429197.375 -
Name Current %
508.namd_r 76.000 -
508.namd_r (avg) 76.000 -
508.namd_r (avg) (percentage) 3.030 -
508.namd_r (max) 223.000 -
508.namd_r (max) (percentage) 8.820 -
510.parest_r 328.000 -
510.parest_r (avg) 328.000 -
510.parest_r (avg) (percentage) 5.830 -
510.parest_r (max) 867.000 -
510.parest_r (max) (percentage) 15.410 -
511.povray_r 2.000 -
511.povray_r (avg) 2.000 -
511.povray_r (avg) (percentage) 0.590 -
511.povray_r (max) 5.000 -
511.povray_r (max) (percentage) 1.410 -
526.blender_r 78.000 -
526.blender_r (avg) 78.000 -
526.blender_r (avg) (percentage) 0.880 -
526.blender_r (max) 63.000 -
526.blender_r (max) (percentage) 0.720 -
600.perlbench_s 116.000 -
600.perlbench_s (avg) 116.000 -
600.perlbench_s (avg) (percentage) 4.800 -
600.perlbench_s (max) 337.000 -
600.perlbench_s (max) (percentage) 13.960 -
605.mcf_s 270.000 -
605.mcf_s (avg) 270.000 -
605.mcf_s (avg) (percentage) 4.280 -
605.mcf_s (max) 786.000 -
605.mcf_s (max) (percentage) 12.450 -
619.lbm_s 4948.000 -
619.lbm_s (avg) 4948.000 -
619.lbm_s (avg) (percentage) 15.830 -
619.lbm_s (max) 8675.000 -
619.lbm_s (max) (percentage) 27.750 -
620.omnetpp_s 259.000 -
620.omnetpp_s (avg) 259.000 -
620.omnetpp_s (avg) (percentage) 6.720 -
620.omnetpp_s (max) 657.000 -
620.omnetpp_s (max) (percentage) 17.010 -
623.xalancbmk_s 111.000 -
623.xalancbmk_s (avg) 111.000 -
623.xalancbmk_s (avg) (percentage) 3.200 -
623.xalancbmk_s (max) 230.000 -
623.xalancbmk_s (max) (percentage) 6.620 -
625.x264_s 114.000 -
625.x264_s (avg) 114.000 -
625.x264_s (avg) (percentage) 4.180 -
625.x264_s (max) 298.000 -
625.x264_s (max) (percentage) 10.880 -
625.x264_s (unexplained diff vs previous) 257.000 -
625.x264_s (unexplained diff vs previous) (percentage) 9.360 -
631.deepsjeng_s 196.000 -
631.deepsjeng_s (avg) 196.000 -
631.deepsjeng_s (avg) (percentage) 5.570 -
631.deepsjeng_s (max) 388.000 -
631.deepsjeng_s (max) (percentage) 11.020 -
638.imagick_s 225.000 -
638.imagick_s (avg) 225.000 -
638.imagick_s (avg) (percentage) 6.640 -
638.imagick_s (max) 779.000 -
638.imagick_s (max) (percentage) 22.910 -
641.leela_s 105.000 -
641.leela_s (avg) 105.000 -
641.leela_s (avg) (percentage) 2.590 -
641.leela_s (max) 259.000 -
641.leela_s (max) (percentage) 6.340 -
644.nab_s 140.000 -
644.nab_s (avg) 140.000 -
644.nab_s (avg) (percentage) 1.260 -
644.nab_s (max) 409.000 -
644.nab_s (max) (percentage) 3.660 -
657.xz_s 262.000 -
657.xz_s (avg) 262.000 -
657.xz_s (avg) (percentage) 10.350 -
657.xz_s (max) 873.000 -
657.xz_s (max) (percentage) 34.460 -
Geometric Mean 47.949 -