Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/6da4ecdf9285225ccc8fa4441b7e9f65e8f4f49c (+ 615 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-cpu2017fast--llvm-aarch64-master-Os_LTO-build/92/
Filter

llvm-aarch64-master-Os_LTO test results

Run Order Start Time Duration
Current 0092 (llvmorg-18-init-12112-g6da4ecdf9285) 2023-11-14T00:13:19 0:00:00
Previous 0091 (llvmorg-18-init-11497-ga533b76468ac) 2023-11-09T17:11:25 0:00:00
Baseline 0001 (llvmorg-17-init-03361-gd77f96a9e0c8) 2023-02-27T23:41:40 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 19 8
Performance Improvements 8 5
Added Tests 2 77
Unchanged Tests 673 612
Total Tests 702

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
600.perlbench_s 4.54% 2270.000 2373.000 - 3.26% -
638.imagick_s 4.46% 3072.000 3209.000 - -1.50% -
511.povray_r 2.65% 415.000 426.000 - -5.75% -
644.nab_s 2.08% 11217.000 11450.000 - 3.07% -
508.namd_r 1.79% 2509.000 2554.000 - 4.46% -
602.gcc_s 1.39% 4167.000 4225.000 - 0.52% -
641.leela_s 1.09% 4043.000 4087.000 - 2.43% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
511.povray_r (max) 14.29% 7.000 8.000 - 0.00% -
600.perlbench_s (max) 4.52% 310.000 324.000 - 0.00% -
638.imagick_s (max) 4.43% 406.000 424.000 - 0.00% -
638.imagick_s 4.35% 207.000 216.000 - 0.00% -
638.imagick_s (avg) 4.35% 207.000 216.000 - 0.00% -
600.perlbench_s 3.91% 128.000 133.000 - 0.00% -
600.perlbench_s (avg) 3.91% 128.000 133.000 - 0.00% -
508.namd_r (max) 2.14% 187.000 191.000 - 0.00% -
644.nab_s 1.90% 158.000 161.000 - 0.00% -
644.nab_s (avg) 1.90% 158.000 161.000 - 0.00% -
644.nab_s (max) 1.88% 160.000 163.000 - 0.00% -

Performance Regressions - Score Δ Previous Current σ Δ (B) σ (B)
nb_total_tests -33.33% 24.000 16.000 - -33.33% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
619.lbm_s -4.03% 31467.000 30198.000 - -2.78% -
526.blender_r -1.25% 9041.000 8928.000 - 4.07% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
619.lbm_s (max) -4.04% 17914.000 17191.000 - 0.00% -
619.lbm_s -4.03% 6856.000 6580.000 - 0.00% -
619.lbm_s (avg) -4.03% 6856.000 6580.000 - 0.00% -
526.blender_r -1.36% 220.000 217.000 - 0.00% -
526.blender_r (avg) -1.36% 220.000 217.000 - 0.00% -
526.blender_r (max) -1.26% 398.000 393.000 - 0.00% -

Added Tests - Score
nb_compile_successful
nb_execution_successful

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
508.namd_r 4.46% 2445.000 2554.000 - 1.79% -
526.blender_r 4.07% 8579.000 8928.000 - -1.25% -
600.perlbench_s 3.26% 2298.000 2373.000 - 4.54% -
644.nab_s 3.07% 11109.000 11450.000 - 2.08% -
641.leela_s 2.43% 3990.000 4087.000 - 1.09% -
620.omnetpp_s 1.49% 3747.000 3803.000 - 0.66% -
625.x264_s 1.09% 2662.000 2691.000 - 0.37% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests -33.33% 24.000 16.000 - -33.33% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
511.povray_r -5.75% 452.000 426.000 - 2.65% -
631.deepsjeng_s -3.00% 3596.000 3488.000 - 0.43% -
619.lbm_s -2.78% 31060.000 30198.000 - -4.03% -
623.xalancbmk_s -1.52% 3621.000 3566.000 - -0.42% -
638.imagick_s -1.50% 3258.000 3209.000 - 4.46% -

Added Tests - sample variability
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
600.perlbench_s
600.perlbench_s (avg)
600.perlbench_s (avg) (percentage)
600.perlbench_s (max)
600.perlbench_s (max) (percentage)
605.mcf_s
605.mcf_s (avg)
605.mcf_s (avg) (percentage)
605.mcf_s (max)
605.mcf_s (max) (percentage)
619.lbm_s
619.lbm_s (avg)
619.lbm_s (avg) (percentage)
619.lbm_s (max)
619.lbm_s (max) (percentage)
620.omnetpp_s
620.omnetpp_s (avg)
620.omnetpp_s (avg) (percentage)
620.omnetpp_s (max)
620.omnetpp_s (max) (percentage)
623.xalancbmk_s
623.xalancbmk_s (avg)
623.xalancbmk_s (avg) (percentage)
623.xalancbmk_s (max)
623.xalancbmk_s (max) (percentage)
625.x264_s
625.x264_s (avg)
625.x264_s (avg) (percentage)
625.x264_s (max)
625.x264_s (max) (percentage)
631.deepsjeng_s
631.deepsjeng_s (avg)
631.deepsjeng_s (avg) (percentage)
631.deepsjeng_s (max)
631.deepsjeng_s (max) (percentage)
638.imagick_s
638.imagick_s (avg)
638.imagick_s (avg) (percentage)
638.imagick_s (max)
638.imagick_s (max) (percentage)
641.leela_s
641.leela_s (avg)
641.leela_s (avg) (percentage)
641.leela_s (max)
641.leela_s (max) (percentage)
644.nab_s
644.nab_s (avg)
644.nab_s (avg) (percentage)
644.nab_s (max)
644.nab_s (max) (percentage)
657.xz_s
657.xz_s (avg)
657.xz_s (avg) (percentage)
657.xz_s (max)
657.xz_s (max) (percentage)

Added Tests - Score
nb_compile_successful
nb_execution_successful


Report Time: 0.22s
Name Current %
508.namd_r 2554.000 1.79%
510.parest_r 5600.000 -
511.povray_r 426.000 2.65%
526.blender_r 8928.000 -1.25%
600.perlbench_s 2373.000 4.54%
602.gcc_s 4225.000 1.39%
605.mcf_s 6212.000 -
619.lbm_s 30198.000 -4.03%
620.omnetpp_s 3803.000 -
623.xalancbmk_s 3566.000 -
625.x264_s 2691.000 -
631.deepsjeng_s 3488.000 -
638.imagick_s 3209.000 4.46%
641.leela_s 4087.000 1.09%
644.nab_s 11450.000 2.08%
657.xz_s 2295.000 -
Geometric Mean 4011.014 -
Name Current %
nb_compile_successful 0.000 -
nb_execution_successful 0.000 -
nb_total_tests 16.000 -33.33%
Geometric Mean 0.005 -99.98%
Name Current %
508.namd_r 103.000 -
508.namd_r (avg) 103.000 -
508.namd_r (avg) (percentage) 4.070 -
508.namd_r (max) 191.000 2.14%
508.namd_r (max) (percentage) 7.490 -
510.parest_r 402.000 -
510.parest_r (avg) 402.000 -
510.parest_r (avg) (percentage) 7.180 -
510.parest_r (max) 769.000 -
510.parest_r (max) (percentage) 13.740 -
511.povray_r 2.000 -
511.povray_r (avg) 2.000 -
511.povray_r (avg) (percentage) 0.670 -
511.povray_r (max) 8.000 14.29%
511.povray_r (max) (percentage) 1.890 -
526.blender_r 217.000 -1.36%
526.blender_r (avg) 217.000 -1.36%
526.blender_r (avg) (percentage) 2.440 -
526.blender_r (max) 393.000 -1.26%
526.blender_r (max) (percentage) 4.410 -
600.perlbench_s 133.000 3.91%
600.perlbench_s (avg) 133.000 3.91%
600.perlbench_s (avg) (percentage) 5.640 -
600.perlbench_s (max) 324.000 4.52%
600.perlbench_s (max) (percentage) 13.660 -
605.mcf_s 306.000 -
605.mcf_s (avg) 306.000 -
605.mcf_s (avg) (percentage) 4.940 -
605.mcf_s (max) 610.000 -
605.mcf_s (max) (percentage) 9.820 -
619.lbm_s 6580.000 -4.03%
619.lbm_s (avg) 6580.000 -4.03%
619.lbm_s (avg) (percentage) 21.790 -
619.lbm_s (max) 17191.000 -4.04%
619.lbm_s (max) (percentage) 56.930 -
620.omnetpp_s 294.000 -
620.omnetpp_s (avg) 294.000 -
620.omnetpp_s (avg) (percentage) 7.750 -
620.omnetpp_s (max) 602.000 -
620.omnetpp_s (max) (percentage) 15.830 -
623.xalancbmk_s 109.000 -
623.xalancbmk_s (avg) 109.000 -
623.xalancbmk_s (avg) (percentage) 3.080 -
623.xalancbmk_s (max) 174.000 -
623.xalancbmk_s (max) (percentage) 4.900 -
625.x264_s 130.000 -
625.x264_s (avg) 130.000 -
625.x264_s (avg) (percentage) 4.860 -
625.x264_s (max) 258.000 -
625.x264_s (max) (percentage) 9.600 -
631.deepsjeng_s 171.000 -
631.deepsjeng_s (avg) 171.000 -
631.deepsjeng_s (avg) (percentage) 4.910 -
631.deepsjeng_s (max) 206.000 -
631.deepsjeng_s (max) (percentage) 5.920 -
638.imagick_s 216.000 4.35%
638.imagick_s (avg) 216.000 4.35%
638.imagick_s (avg) (percentage) 6.740 -
638.imagick_s (max) 424.000 4.43%
638.imagick_s (max) (percentage) 13.230 -
641.leela_s 114.000 -
641.leela_s (avg) 114.000 -
641.leela_s (avg) (percentage) 2.800 -
641.leela_s (max) 223.000 -
641.leela_s (max) (percentage) 5.470 -
644.nab_s 161.000 1.90%
644.nab_s (avg) 161.000 1.90%
644.nab_s (avg) (percentage) 1.410 -
644.nab_s (max) 163.000 1.88%
644.nab_s (max) (percentage) 1.430 -
657.xz_s 236.000 -
657.xz_s (avg) 236.000 -
657.xz_s (avg) (percentage) 10.310 -
657.xz_s (max) 590.000 -
657.xz_s (max) (percentage) 25.750 -
Geometric Mean 51.610 -