Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/7881ac95d7f1edf3e49f39a5e5e0386401138489 (+ 487 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-cpu2017fast--llvm-aarch64-master-Oz_LTO-build/290/
Filter

llvm-aarch64-master-Oz_LTO test results

Run Order Start Time Duration
Current 0290 (llvmorg-20-init-17990-g7881ac95d7f1) 2025-01-13T09:40:35 0:00:00
Previous 0290 (llvmorg-20-init-17990-g7881ac95d7f1) 2025-01-13T09:40:35 0:00:00
Baseline 0001 (llvmorg-17-init-03810-g04a9c62554cf) 2023-03-03T19:15:36 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 0 2
Performance Improvements 0 22
Added Tests 0 123
Unchanged Tests 798 651
Total Tests 798

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
526.blender_r 9.36% 10331.000 11298.000 - 0.00% -
605.mcf_s 4.90% 6382.000 6695.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
631.deepsjeng_s -5.77% 59343.000 55919.000 - 0.00% -
602.gcc_s -3.44% 6613082.000 6385466.000 - 0.00% -
644.nab_s -2.97% 82210.000 79771.000 - 0.00% -
511.povray_r -2.90% 692391.000 672305.000 - 0.00% -
605.mcf_s -2.80% 14136.000 13740.000 - 0.00% -
638.imagick_s -2.58% 957572.000 932830.000 - 0.00% -
657.xz_s -2.48% 107659.000 104991.000 - 0.00% -
600.perlbench_s -2.46% 1727039.000 1684479.000 - 0.00% -
526.blender_r -2.22% 10533211.000 10298997.000 - 0.00% -
625.x264_s -1.27% 362800.000 358176.000 - 0.00% -
508.namd_r -1.21% 326657.000 322701.000 - 0.00% -
619.lbm_s -1.10% 13782.000 13630.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
619.lbm_s -33.05% 42973.000 28772.000 - 0.00% -
657.xz_s -21.68% 2947.000 2308.000 - 0.00% -
600.perlbench_s -7.09% 3527.000 3277.000 - 0.00% -
638.imagick_s -7.06% 3414.000 3173.000 - 0.00% -
631.deepsjeng_s -5.80% 4516.000 4254.000 - 0.00% -
511.povray_r -1.88% 532.000 522.000 - 0.00% -
644.nab_s -1.02% 11514.000 11396.000 - 0.00% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_execution_successful 83.33% 12.000 22.000 - 0.00% -
nb_compile_successful 57.14% 14.000 22.000 - 0.00% -
nb_total_tests 8.33% 24.000 26.000 - 0.00% -

Added Tests - Code Size
510.parest_r
603.bwaves_s
620.omnetpp_s
621.wrf_s
623.xalancbmk_s
628.pop2_s
641.leela_s
648.exchange2_s
649.fotonik3d_s
654.roms_s

Added Tests - Execution
510.parest_r
603.bwaves_s
620.omnetpp_s
621.wrf_s
623.xalancbmk_s
628.pop2_s
641.leela_s
648.exchange2_s
649.fotonik3d_s
654.roms_s

Added Tests - sample variability
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
510.parest_r (unexplained diff vs previous)
510.parest_r (unexplained diff vs previous) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
600.perlbench_s
600.perlbench_s (avg)
600.perlbench_s (avg) (percentage)
600.perlbench_s (max)
600.perlbench_s (max) (percentage)
603.bwaves_s
603.bwaves_s (avg)
603.bwaves_s (avg) (percentage)
603.bwaves_s (max)
603.bwaves_s (max) (percentage)
603.bwaves_s (unexplained diff vs previous)
603.bwaves_s (unexplained diff vs previous) (percentage)
605.mcf_s
605.mcf_s (avg)
605.mcf_s (avg) (percentage)
605.mcf_s (max)
605.mcf_s (max) (percentage)
619.lbm_s
619.lbm_s (avg)
619.lbm_s (avg) (percentage)
619.lbm_s (max)
619.lbm_s (max) (percentage)
620.omnetpp_s
620.omnetpp_s (avg)
620.omnetpp_s (avg) (percentage)
620.omnetpp_s (max)
620.omnetpp_s (max) (percentage)
620.omnetpp_s (unexplained diff vs previous)
620.omnetpp_s (unexplained diff vs previous) (percentage)
625.x264_s
625.x264_s (avg)
625.x264_s (avg) (percentage)
625.x264_s (max)
625.x264_s (max) (percentage)
628.pop2_s
628.pop2_s (avg)
628.pop2_s (avg) (percentage)
628.pop2_s (max)
628.pop2_s (max) (percentage)
631.deepsjeng_s
631.deepsjeng_s (avg)
631.deepsjeng_s (avg) (percentage)
631.deepsjeng_s (max)
631.deepsjeng_s (max) (percentage)
638.imagick_s
638.imagick_s (avg)
638.imagick_s (avg) (percentage)
638.imagick_s (max)
638.imagick_s (max) (percentage)
641.leela_s
641.leela_s (avg)
641.leela_s (avg) (percentage)
641.leela_s (max)
641.leela_s (max) (percentage)
641.leela_s (unexplained diff vs previous)
641.leela_s (unexplained diff vs previous) (percentage)
644.nab_s
644.nab_s (avg)
644.nab_s (avg) (percentage)
644.nab_s (max)
644.nab_s (max) (percentage)
648.exchange2_s
648.exchange2_s (avg)
648.exchange2_s (avg) (percentage)
648.exchange2_s (max)
648.exchange2_s (max) (percentage)
649.fotonik3d_s
649.fotonik3d_s (avg)
649.fotonik3d_s (avg) (percentage)
649.fotonik3d_s (max)
649.fotonik3d_s (max) (percentage)
654.roms_s
654.roms_s (avg)
654.roms_s (avg) (percentage)
654.roms_s (max)
654.roms_s (max) (percentage)
657.xz_s
657.xz_s (avg)
657.xz_s (avg) (percentage)
657.xz_s (max)
657.xz_s (max) (percentage)


Report Time: 0.32s
Name Current %
508.namd_r 2709.000 -
510.parest_r 6188.000 -
511.povray_r 522.000 -
526.blender_r 11298.000 -
600.perlbench_s 3277.000 -
602.gcc_s 6373.000 -
603.bwaves_s 9269.000 -
605.mcf_s 6695.000 -
619.lbm_s 28772.000 -
620.omnetpp_s 4391.000 -
621.wrf_s 7908.000 -
623.xalancbmk_s 7532.000 -
625.x264_s 4941.000 -
628.pop2_s 17868.000 -
631.deepsjeng_s 4254.000 -
638.imagick_s 3173.000 -
641.leela_s 4626.000 -
644.nab_s 11396.000 -
648.exchange2_s 35924.000 -
649.fotonik3d_s 12294.000 -
654.roms_s 38268.000 -
657.xz_s 2308.000 -
Geometric Mean 6841.559 -
Name Current %
508.namd_r 322701.000 -
510.parest_r 1195153.000 -
511.povray_r 672305.000 -
526.blender_r 10298997.000 -
600.perlbench_s 1684479.000 -
602.gcc_s 6385466.000 -
603.bwaves_s 751742.000 -
605.mcf_s 13740.000 -
619.lbm_s 13630.000 -
620.omnetpp_s 1365249.000 -
621.wrf_s 17515412.000 -
623.xalancbmk_s 2619143.000 -
625.x264_s 358176.000 -
628.pop2_s 9459125.000 -
631.deepsjeng_s 55919.000 -
638.imagick_s 932830.000 -
641.leela_s 62996.000 -
644.nab_s 79771.000 -
648.exchange2_s 3179786.000 -
649.fotonik3d_s 3756074.000 -
654.roms_s 3404361.000 -
657.xz_s 104991.000 -
Geometric Mean 729180.667 -
Name Current %
508.namd_r 10.000 -
508.namd_r (avg) 10.000 -
508.namd_r (avg) (percentage) 0.390 -
508.namd_r (max) 11.000 -
508.namd_r (max) (percentage) 0.410 -
508.namd_r (unexplained diff vs previous) 11.000 -
508.namd_r (unexplained diff vs previous) (percentage) 0.410 -
510.parest_r 24.000 -
510.parest_r (avg) 24.000 -
510.parest_r (avg) (percentage) 0.390 -
510.parest_r (max) 22.000 -
510.parest_r (max) (percentage) 0.360 -
510.parest_r (unexplained diff vs previous) 8.000 -
510.parest_r (unexplained diff vs previous) (percentage) 0.130 -
511.povray_r 3.000 -
511.povray_r (avg) 3.000 -
511.povray_r (avg) (percentage) 0.720 -
511.povray_r (max) 4.000 -
511.povray_r (max) (percentage) 0.770 -
511.povray_r (unexplained diff vs previous) 3.000 -
511.povray_r (unexplained diff vs previous) (percentage) 0.570 -
526.blender_r 38.000 -
526.blender_r (avg) 38.000 -
526.blender_r (avg) (percentage) 0.340 -
526.blender_r (max) 39.000 -
526.blender_r (max) (percentage) 0.350 -
600.perlbench_s 23.000 -
600.perlbench_s (avg) 23.000 -
600.perlbench_s (avg) (percentage) 0.710 -
600.perlbench_s (max) 31.000 -
600.perlbench_s (max) (percentage) 0.950 -
600.perlbench_s (unexplained diff vs previous) 24.000 -
600.perlbench_s (unexplained diff vs previous) (percentage) 0.730 -
603.bwaves_s 191.000 -
603.bwaves_s (avg) 191.000 -
603.bwaves_s (avg) (percentage) 2.070 -
603.bwaves_s (max) 50.000 -
603.bwaves_s (max) (percentage) 0.550 -
603.bwaves_s (unexplained diff vs previous) 41.000 -
603.bwaves_s (unexplained diff vs previous) (percentage) 0.440 -
605.mcf_s 55.000 -
605.mcf_s (avg) 55.000 -
605.mcf_s (avg) (percentage) 0.830 -
605.mcf_s (max) 34.000 -
605.mcf_s (max) (percentage) 0.520 -
605.mcf_s (unexplained diff vs previous) 3.000 -
605.mcf_s (unexplained diff vs previous) (percentage) 0.040 -
619.lbm_s 1280.000 -
619.lbm_s (avg) 1280.000 -
619.lbm_s (avg) (percentage) 4.450 -
619.lbm_s (max) 359.000 -
619.lbm_s (max) (percentage) 1.250 -
619.lbm_s (unexplained diff vs previous) 355.000 -
619.lbm_s (unexplained diff vs previous) (percentage) 1.230 -
620.omnetpp_s 47.000 -
620.omnetpp_s (avg) 47.000 -
620.omnetpp_s (avg) (percentage) 1.090 -
620.omnetpp_s (max) 71.000 -
620.omnetpp_s (max) (percentage) 1.630 -
620.omnetpp_s (unexplained diff vs previous) 39.000 -
620.omnetpp_s (unexplained diff vs previous) (percentage) 0.890 -
625.x264_s 11.000 -
625.x264_s (avg) 11.000 -
625.x264_s (avg) (percentage) 0.230 -
625.x264_s (max) 9.000 -
625.x264_s (max) (percentage) 0.190 -
625.x264_s (unexplained diff vs previous) 9.000 -
625.x264_s (unexplained diff vs previous) (percentage) 0.180 -
628.pop2_s 132.000 -
628.pop2_s (avg) 132.000 -
628.pop2_s (avg) (percentage) 0.740 -
628.pop2_s (max) 135.000 -
628.pop2_s (max) (percentage) 0.760 -
631.deepsjeng_s 16.000 -
631.deepsjeng_s (avg) 16.000 -
631.deepsjeng_s (avg) (percentage) 0.380 -
631.deepsjeng_s (max) 14.000 -
631.deepsjeng_s (max) (percentage) 0.330 -
631.deepsjeng_s (unexplained diff vs previous) 14.000 -
631.deepsjeng_s (unexplained diff vs previous) (percentage) 0.330 -
638.imagick_s 38.000 -
638.imagick_s (avg) 38.000 -
638.imagick_s (avg) (percentage) 1.200 -
638.imagick_s (max) 76.000 -
638.imagick_s (max) (percentage) 2.400 -
638.imagick_s (unexplained diff vs previous) 60.000 -
638.imagick_s (unexplained diff vs previous) (percentage) 1.890 -
641.leela_s 14.000 -
641.leela_s (avg) 14.000 -
641.leela_s (avg) (percentage) 0.310 -
641.leela_s (max) 13.000 -
641.leela_s (max) (percentage) 0.290 -
641.leela_s (unexplained diff vs previous) 2.000 -
641.leela_s (unexplained diff vs previous) (percentage) 0.040 -
644.nab_s 77.000 -
644.nab_s (avg) 77.000 -
644.nab_s (avg) (percentage) 0.680 -
644.nab_s (max) 76.000 -
644.nab_s (max) (percentage) 0.670 -
644.nab_s (unexplained diff vs previous) 76.000 -
644.nab_s (unexplained diff vs previous) (percentage) 0.670 -
648.exchange2_s 136.000 -
648.exchange2_s (avg) 136.000 -
648.exchange2_s (avg) (percentage) 0.380 -
648.exchange2_s (max) 204.000 -
648.exchange2_s (max) (percentage) 0.570 -
649.fotonik3d_s 208.000 -
649.fotonik3d_s (avg) 208.000 -
649.fotonik3d_s (avg) (percentage) 1.700 -
649.fotonik3d_s (max) 438.000 -
649.fotonik3d_s (max) (percentage) 3.570 -
654.roms_s 631.000 -
654.roms_s (avg) 631.000 -
654.roms_s (avg) (percentage) 1.650 -
654.roms_s (max) 1369.000 -
654.roms_s (max) (percentage) 3.580 -
657.xz_s 31.000 -
657.xz_s (avg) 31.000 -
657.xz_s (avg) (percentage) 1.350 -
657.xz_s (max) 25.000 -
657.xz_s (max) (percentage) 1.090 -
657.xz_s (unexplained diff vs previous) 9.000 -
657.xz_s (unexplained diff vs previous) (percentage) 0.390 -
Geometric Mean 6.877 -