Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/f280d3b705de7f94ef9756e3ef2842b415a7c038 (+ 300 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-cpu2017fast--llvm-aarch64-master-Os_LTO-build/301/
Filter

llvm-aarch64-master-Os_LTO test results

Run Order Start Time Duration
Current 0301 (llvmorg-21-init-16260-gf280d3b705de) 2025-06-18T22:07:17 0:00:00
Previous 0301 (llvmorg-21-init-16260-gf280d3b705de) 2025-06-18T22:07:17 0:00:00
Baseline 0001 (llvmorg-17-init-03361-gd77f96a9e0c8) 2023-02-27T23:41:40 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 0 13
Performance Improvements 0 11
Added Tests 0 82
Unchanged Tests 750 644
Total Tests 750

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
619.lbm_s 37.54% 31060.000 42719.000 - 0.00% -
657.xz_s 11.67% 2287.000 2554.000 - 0.00% -
620.omnetpp_s 10.68% 3747.000 4147.000 - 0.00% -
508.namd_r 8.14% 2445.000 2644.000 - 0.00% -
605.mcf_s 7.09% 6202.000 6642.000 - 0.00% -
510.parest_r 6.82% 5587.000 5968.000 - 0.00% -
625.x264_s 6.69% 2662.000 2840.000 - 0.00% -
526.blender_r 6.57% 8579.000 9143.000 - 0.00% -
602.gcc_s 6.02% 4203.000 4456.000 - 0.00% -
644.nab_s 2.57% 11109.000 11395.000 - 0.00% -
641.leela_s 2.18% 3990.000 4077.000 - 0.00% -
623.xalancbmk_s 1.19% 3621.000 3664.000 - 0.00% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_execution_successful -6.25% 16.000 15.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
631.deepsjeng_s -6.05% 60687.000 57018.000 - 0.00% -
641.leela_s -4.05% 71474.000 68581.000 - 0.00% -
605.mcf_s -3.29% 15336.000 14832.000 - 0.00% -
619.lbm_s -2.87% 13938.000 13538.000 - 0.00% -
508.namd_r -2.14% 376399.000 368332.000 - 0.00% -
644.nab_s -2.08% 84129.000 82375.000 - 0.00% -
638.imagick_s -1.91% 1169552.000 1147266.000 - 0.00% -
511.povray_r -1.26% 740092.000 730762.000 - 0.00% -
657.xz_s -1.03% 111043.000 109895.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
511.povray_r -7.30% 452.000 419.000 - 0.00% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 33.33% 24.000 32.000 - 0.00% -

Added Tests - sample variability
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
600.perlbench_s (avg) (percentage)
600.perlbench_s (max) (percentage)
603.bwaves_s (avg) (percentage)
603.bwaves_s (max) (percentage)
605.mcf_s
605.mcf_s (avg)
605.mcf_s (avg) (percentage)
605.mcf_s (max)
605.mcf_s (max) (percentage)
619.lbm_s
619.lbm_s (avg)
619.lbm_s (avg) (percentage)
619.lbm_s (max)
619.lbm_s (max) (percentage)
620.omnetpp_s
620.omnetpp_s (avg)
620.omnetpp_s (avg) (percentage)
620.omnetpp_s (max)
620.omnetpp_s (max) (percentage)
623.xalancbmk_s
623.xalancbmk_s (avg)
623.xalancbmk_s (avg) (percentage)
623.xalancbmk_s (max)
623.xalancbmk_s (max) (percentage)
625.x264_s
625.x264_s (avg)
625.x264_s (avg) (percentage)
625.x264_s (max)
625.x264_s (max) (percentage)
628.pop2_s (avg) (percentage)
628.pop2_s (max) (percentage)
631.deepsjeng_s
631.deepsjeng_s (avg)
631.deepsjeng_s (avg) (percentage)
631.deepsjeng_s (max)
631.deepsjeng_s (max) (percentage)
638.imagick_s
638.imagick_s (avg)
638.imagick_s (avg) (percentage)
638.imagick_s (max)
638.imagick_s (max) (percentage)
641.leela_s
641.leela_s (avg)
641.leela_s (avg) (percentage)
641.leela_s (max)
641.leela_s (max) (percentage)
644.nab_s
644.nab_s (avg)
644.nab_s (avg) (percentage)
644.nab_s (max)
644.nab_s (max) (percentage)
648.exchange2_s (avg) (percentage)
648.exchange2_s (max) (percentage)
649.fotonik3d_s (avg) (percentage)
649.fotonik3d_s (max) (percentage)
654.roms_s (avg) (percentage)
654.roms_s (max) (percentage)
657.xz_s
657.xz_s (avg)
657.xz_s (avg) (percentage)
657.xz_s (max)
657.xz_s (max) (percentage)


Report Time: 0.34s
Name Current %
508.namd_r 2644.000 -
510.parest_r 5968.000 -
511.povray_r 419.000 -
526.blender_r 9143.000 -
602.gcc_s 4456.000 -
605.mcf_s 6642.000 -
619.lbm_s 42719.000 -
620.omnetpp_s 4147.000 -
623.xalancbmk_s 3664.000 -
625.x264_s 2840.000 -
631.deepsjeng_s 3619.000 -
638.imagick_s 3260.000 -
641.leela_s 4077.000 -
644.nab_s 11395.000 -
657.xz_s 2554.000 -
Geometric Mean 4408.490 -
Name Current %
508.namd_r 368332.000 -
510.parest_r 1474233.000 -
511.povray_r 730762.000 -
526.blender_r 11500957.000 -
602.gcc_s 7888515.000 -
605.mcf_s 14832.000 -
619.lbm_s 13538.000 -
620.omnetpp_s 1662257.000 -
623.xalancbmk_s 3230407.000 -
625.x264_s 405375.000 -
631.deepsjeng_s 57018.000 -
638.imagick_s 1147266.000 -
641.leela_s 68581.000 -
644.nab_s 82375.000 -
657.xz_s 109895.000 -
Geometric Mean 386398.451 -
Name Current %
508.namd_r 31.000 -
508.namd_r (avg) 31.000 -
508.namd_r (avg) (percentage) 1.190 -
508.namd_r (max) 137.000 -
508.namd_r (max) (percentage) 5.210 -
508.namd_r (unexplained diff vs previous) 131.000 -
508.namd_r (unexplained diff vs previous) (percentage) 4.950 -
510.parest_r 79.000 -
510.parest_r (avg) 79.000 -
510.parest_r (avg) (percentage) 1.340 -
510.parest_r (max) 312.000 -
510.parest_r (max) (percentage) 5.240 -
511.povray_r 4.000 -
511.povray_r (avg) 4.000 -
511.povray_r (avg) (percentage) 1.140 -
511.povray_r (max) 6.000 -
511.povray_r (max) (percentage) 1.520 -
511.povray_r (unexplained diff vs previous) 3.000 -
511.povray_r (unexplained diff vs previous) (percentage) 0.720 -
526.blender_r 51.000 -
526.blender_r (avg) 51.000 -
526.blender_r (avg) (percentage) 0.560 -
526.blender_r (max) 69.000 -
526.blender_r (max) (percentage) 0.760 -
600.perlbench_s (avg) (percentage) 1.290 -
600.perlbench_s (max) (percentage) 0.990 -
603.bwaves_s (avg) (percentage) 2.310 -
603.bwaves_s (max) (percentage) 1.110 -
605.mcf_s 110.000 -
605.mcf_s (avg) 110.000 -
605.mcf_s (avg) (percentage) 1.670 -
605.mcf_s (max) 415.000 -
605.mcf_s (max) (percentage) 6.250 -
605.mcf_s (unexplained diff vs previous) 391.000 -
605.mcf_s (unexplained diff vs previous) (percentage) 5.890 -
619.lbm_s 3840.000 -
619.lbm_s (avg) 3840.000 -
619.lbm_s (avg) (percentage) 8.990 -
619.lbm_s (max) 16506.000 -
619.lbm_s (max) (percentage) 38.640 -
619.lbm_s (unexplained diff vs previous) 11905.000 -
619.lbm_s (unexplained diff vs previous) (percentage) 27.870 -
620.omnetpp_s 111.000 -
620.omnetpp_s (avg) 111.000 -
620.omnetpp_s (avg) (percentage) 2.700 -
620.omnetpp_s (max) 425.000 -
620.omnetpp_s (max) (percentage) 10.260 -
620.omnetpp_s (unexplained diff vs previous) 386.000 -
620.omnetpp_s (unexplained diff vs previous) (percentage) 9.310 -
623.xalancbmk_s 44.000 -
623.xalancbmk_s (avg) 44.000 -
623.xalancbmk_s (avg) (percentage) 1.210 -
623.xalancbmk_s (max) 84.000 -
623.xalancbmk_s (max) (percentage) 2.300 -
623.xalancbmk_s (unexplained diff vs previous) 73.000 -
623.xalancbmk_s (unexplained diff vs previous) (percentage) 1.990 -
625.x264_s 39.000 -
625.x264_s (avg) 39.000 -
625.x264_s (avg) (percentage) 1.400 -
625.x264_s (max) 188.000 -
625.x264_s (max) (percentage) 6.650 -
625.x264_s (unexplained diff vs previous) 177.000 -
625.x264_s (unexplained diff vs previous) (percentage) 6.230 -
628.pop2_s (avg) (percentage) 0.400 -
628.pop2_s (max) (percentage) 0.520 -
631.deepsjeng_s 41.000 -
631.deepsjeng_s (avg) 41.000 -
631.deepsjeng_s (avg) (percentage) 1.160 -
631.deepsjeng_s (max) 192.000 -
631.deepsjeng_s (max) (percentage) 5.330 -
631.deepsjeng_s (unexplained diff vs previous) 183.000 -
631.deepsjeng_s (unexplained diff vs previous) (percentage) 5.060 -
638.imagick_s 55.000 -
638.imagick_s (avg) 55.000 -
638.imagick_s (avg) (percentage) 1.700 -
638.imagick_s (max) 104.000 -
638.imagick_s (max) (percentage) 3.220 -
638.imagick_s (unexplained diff vs previous) 69.000 -
638.imagick_s (unexplained diff vs previous) (percentage) 2.120 -
641.leela_s 29.000 -
641.leela_s (avg) 29.000 -
641.leela_s (avg) (percentage) 0.730 -
641.leela_s (max) 90.000 -
641.leela_s (max) (percentage) 2.230 -
641.leela_s (unexplained diff vs previous) 89.000 -
641.leela_s (unexplained diff vs previous) (percentage) 2.180 -
644.nab_s 87.000 -
644.nab_s (avg) 87.000 -
644.nab_s (avg) (percentage) 0.770 -
644.nab_s (max) 149.000 -
644.nab_s (max) (percentage) 1.310 -
644.nab_s (unexplained diff vs previous) 141.000 -
644.nab_s (unexplained diff vs previous) (percentage) 1.240 -
648.exchange2_s (avg) (percentage) 0.310 -
648.exchange2_s (max) (percentage) 0.540 -
649.fotonik3d_s (avg) (percentage) 3.320 -
649.fotonik3d_s (max) (percentage) 1.250 -
654.roms_s (avg) (percentage) 2.310 -
654.roms_s (max) (percentage) 1.780 -
657.xz_s 49.000 -
657.xz_s (avg) 49.000 -
657.xz_s (avg) (percentage) 1.920 -
657.xz_s (max) 332.000 -
657.xz_s (max) (percentage) 13.010 -
657.xz_s (unexplained diff vs previous) 294.000 -
657.xz_s (unexplained diff vs previous) (percentage) 11.510 -
Geometric Mean 15.881 -