Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/6d1c6ecbdc4e94cafd51ade0331d7112161a4cf3 (+ 1487 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-cpu2017fast--llvm-aarch64-master-Oz_LTO-build/61/
Filter

llvm-aarch64-master-Oz_LTO test results

Run Order Start Time Duration
Current 0061 (llvmorg-18-init-06128-g6d1c6ecbdc4e) 2023-09-04T08:34:57 0:00:00
Previous 0061 (llvmorg-18-init-06128-g6d1c6ecbdc4e) 2023-09-04T08:34:57 0:00:00
Baseline 0001 (llvmorg-17-init-03810-g04a9c62554cf) 2023-03-03T19:15:36 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 0 8
Performance Improvements 0 9
Added Tests 0 78
Unchanged Tests 630 535
Total Tests 630

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
619.lbm_s 16.44% 42973.000 50039.000 - 0.00% -
605.mcf_s 11.99% 6382.000 7147.000 - 0.00% -
508.namd_r 5.55% 2703.000 2853.000 - 0.00% -
638.imagick_s 5.30% 3414.000 3595.000 - 0.00% -
657.xz_s 3.60% 2947.000 3053.000 - 0.00% -
625.x264_s 3.13% 4915.000 5069.000 - 0.00% -
526.blender_r 3.07% 10331.000 10648.000 - 0.00% -
602.gcc_s 2.08% 6427.000 6561.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
631.deepsjeng_s -4.39% 59343.000 56739.000 - 0.00% -
619.lbm_s -3.36% 13782.000 13319.000 - 0.00% -
511.povray_r -2.31% 692391.000 676368.000 - 0.00% -
644.nab_s -2.09% 82210.000 80491.000 - 0.00% -
605.mcf_s -1.73% 14136.000 13892.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
511.povray_r -3.01% 532.000 516.000 - 0.00% -
631.deepsjeng_s -2.61% 4516.000 4398.000 - 0.00% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_execution_successful 33.33% 12.000 16.000 - 0.00% -
nb_compile_successful 14.29% 14.000 16.000 - 0.00% -

Added Tests - Code Size
510.parest_r
620.omnetpp_s
623.xalancbmk_s
641.leela_s

Added Tests - Execution
510.parest_r
620.omnetpp_s
623.xalancbmk_s
641.leela_s

Added Tests - sample variability
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
600.perlbench_s
600.perlbench_s (avg)
600.perlbench_s (avg) (percentage)
600.perlbench_s (max)
600.perlbench_s (max) (percentage)
605.mcf_s
605.mcf_s (avg)
605.mcf_s (avg) (percentage)
605.mcf_s (max)
605.mcf_s (max) (percentage)
619.lbm_s
619.lbm_s (avg)
619.lbm_s (avg) (percentage)
619.lbm_s (max)
619.lbm_s (max) (percentage)
620.omnetpp_s
620.omnetpp_s (avg)
620.omnetpp_s (avg) (percentage)
620.omnetpp_s (max)
620.omnetpp_s (max) (percentage)
625.x264_s
625.x264_s (avg)
625.x264_s (avg) (percentage)
625.x264_s (max)
625.x264_s (max) (percentage)
631.deepsjeng_s
631.deepsjeng_s (avg)
631.deepsjeng_s (avg) (percentage)
631.deepsjeng_s (max)
631.deepsjeng_s (max) (percentage)
638.imagick_s
638.imagick_s (avg)
638.imagick_s (avg) (percentage)
638.imagick_s (max)
638.imagick_s (max) (percentage)
641.leela_s
641.leela_s (avg)
641.leela_s (avg) (percentage)
641.leela_s (max)
641.leela_s (max) (percentage)
644.nab_s
644.nab_s (avg)
644.nab_s (avg) (percentage)
644.nab_s (max)
644.nab_s (max) (percentage)
657.xz_s
657.xz_s (avg)
657.xz_s (avg) (percentage)
657.xz_s (max)
657.xz_s (max) (percentage)


Report Time: 0.22s
Name Current %
508.namd_r 2853.000 -
510.parest_r 6760.000 -
511.povray_r 516.000 -
526.blender_r 10648.000 -
600.perlbench_s 3545.000 -
602.gcc_s 6561.000 -
605.mcf_s 7147.000 -
619.lbm_s 50039.000 -
620.omnetpp_s 5062.000 -
623.xalancbmk_s 7095.000 -
625.x264_s 5069.000 -
631.deepsjeng_s 4398.000 -
638.imagick_s 3595.000 -
641.leela_s 4798.000 -
644.nab_s 11618.000 -
657.xz_s 3053.000 -
Geometric Mean 5335.847 -
Name Current %
508.namd_r 324606.000 -
510.parest_r 1205110.000 -
511.povray_r 676368.000 -
526.blender_r 10476256.000 -
600.perlbench_s 1723908.000 -
602.gcc_s 6604450.000 -
605.mcf_s 13892.000 -
619.lbm_s 13319.000 -
620.omnetpp_s 1394005.000 -
623.xalancbmk_s 2711169.000 -
625.x264_s 361137.000 -
631.deepsjeng_s 56739.000 -
638.imagick_s 952358.000 -
641.leela_s 63065.000 -
644.nab_s 80491.000 -
657.xz_s 106595.000 -
Geometric Mean 385001.952 -
Name Current %
508.namd_r 37.000 -
508.namd_r (avg) 37.000 -
508.namd_r (avg) (percentage) 1.330 -
508.namd_r (max) 101.000 -
508.namd_r (max) (percentage) 3.560 -
510.parest_r 23.000 -
510.parest_r (avg) 23.000 -
510.parest_r (avg) (percentage) 0.350 -
510.parest_r (max) 39.000 -
510.parest_r (max) (percentage) 0.590 -
511.povray_r 10.000 -
511.povray_r (avg) 10.000 -
511.povray_r (avg) (percentage) 2.050 -
511.povray_r (max) 10.000 -
511.povray_r (max) (percentage) 2.000 -
526.blender_r 60.000 -
526.blender_r (avg) 60.000 -
526.blender_r (avg) (percentage) 0.570 -
526.blender_r (max) 33.000 -
526.blender_r (max) (percentage) 0.310 -
600.perlbench_s 140.000 -
600.perlbench_s (avg) 140.000 -
600.perlbench_s (avg) (percentage) 3.970 -
600.perlbench_s (max) 213.000 -
600.perlbench_s (max) (percentage) 6.030 -
605.mcf_s 193.000 -
605.mcf_s (avg) 193.000 -
605.mcf_s (avg) (percentage) 2.710 -
605.mcf_s (max) 535.000 -
605.mcf_s (max) (percentage) 7.490 -
619.lbm_s 3627.000 -
619.lbm_s (avg) 3627.000 -
619.lbm_s (avg) (percentage) 7.250 -
619.lbm_s (max) 3557.000 -
619.lbm_s (max) (percentage) 7.110 -
620.omnetpp_s 59.000 -
620.omnetpp_s (avg) 59.000 -
620.omnetpp_s (avg) (percentage) 1.180 -
620.omnetpp_s (max) 87.000 -
620.omnetpp_s (max) (percentage) 1.720 -
625.x264_s 44.000 -
625.x264_s (avg) 44.000 -
625.x264_s (avg) (percentage) 0.870 -
625.x264_s (max) 73.000 -
625.x264_s (max) (percentage) 1.450 -
631.deepsjeng_s 44.000 -
631.deepsjeng_s (avg) 44.000 -
631.deepsjeng_s (avg) (percentage) 1.020 -
631.deepsjeng_s (max) 92.000 -
631.deepsjeng_s (max) (percentage) 2.100 -
638.imagick_s 65.000 -
638.imagick_s (avg) 65.000 -
638.imagick_s (avg) (percentage) 1.810 -
638.imagick_s (max) 113.000 -
638.imagick_s (max) (percentage) 3.170 -
641.leela_s 29.000 -
641.leela_s (avg) 29.000 -
641.leela_s (avg) (percentage) 0.620 -
641.leela_s (max) 34.000 -
641.leela_s (max) (percentage) 0.720 -
644.nab_s 115.000 -
644.nab_s (avg) 115.000 -
644.nab_s (avg) (percentage) 0.990 -
644.nab_s (max) 134.000 -
644.nab_s (max) (percentage) 1.160 -
657.xz_s 134.000 -
657.xz_s (avg) 134.000 -
657.xz_s (avg) (percentage) 4.390 -
657.xz_s (max) 278.000 -
657.xz_s (max) (percentage) 9.120 -
Geometric Mean 18.164 -