Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/bd5b77529f07d21c27cf14009845e319e454867d (+ 169 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-cpu2017fast--llvm-aarch64-master-Os_LTO-build/165/
Filter

llvm-aarch64-master-Os_LTO test results

Run Order Start Time Duration
Current 0165 (llvmorg-19-init-15523-gbd5b77529f07) 2024-06-24T08:57:02 0:00:00
Previous 0165 (llvmorg-19-init-15523-gbd5b77529f07) 2024-06-24T08:57:02 0:00:00
Baseline 0001 (llvmorg-17-init-03361-gd77f96a9e0c8) 2023-02-27T23:41:40 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 0 9
Performance Improvements 0 13
Added Tests 0 111
Unchanged Tests 822 689
Total Tests 822

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
620.omnetpp_s 1.90% 1650838.000 1682282.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
619.lbm_s 6.57% 31060.000 33102.000 - 0.00% -
526.blender_r 4.73% 8579.000 8985.000 - 0.00% -
605.mcf_s 4.50% 6202.000 6481.000 - 0.00% -
641.leela_s 4.04% 3990.000 4151.000 - 0.00% -
508.namd_r 3.56% 2445.000 2532.000 - 0.00% -
510.parest_r 3.06% 5587.000 5758.000 - 0.00% -
620.omnetpp_s 2.86% 3747.000 3854.000 - 0.00% -
644.nab_s 2.01% 11109.000 11332.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
631.deepsjeng_s -5.10% 60687.000 57591.000 - 0.00% -
619.lbm_s -3.10% 13938.000 13506.000 - 0.00% -
605.mcf_s -2.24% 15336.000 14992.000 - 0.00% -
644.nab_s -1.47% 84129.000 82893.000 - 0.00% -
638.imagick_s -1.23% 1169552.000 1155156.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
511.povray_r -7.96% 452.000 416.000 - 0.00% -
638.imagick_s -5.31% 3258.000 3085.000 - 0.00% -
631.deepsjeng_s -3.98% 3596.000 3453.000 - 0.00% -
657.xz_s -3.19% 2287.000 2214.000 - 0.00% -
600.perlbench_s -1.91% 2298.000 2254.000 - 0.00% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful 175.00% 16.000 44.000 - 0.00% -
nb_execution_successful 162.50% 16.000 42.000 - 0.00% -
nb_total_tests 116.67% 24.000 52.000 - 0.00% -

Added Tests - Code Size
603.bwaves_s
621.wrf_s
628.pop2_s
648.exchange2_s
649.fotonik3d_s
654.roms_s

Added Tests - Execution
603.bwaves_s
621.wrf_s
627.cam4_s
628.pop2_s
648.exchange2_s
649.fotonik3d_s
654.roms_s

Added Tests - sample variability
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
600.perlbench_s
600.perlbench_s (avg)
600.perlbench_s (avg) (percentage)
600.perlbench_s (max)
600.perlbench_s (max) (percentage)
603.bwaves_s
603.bwaves_s (avg)
603.bwaves_s (avg) (percentage)
603.bwaves_s (max)
603.bwaves_s (max) (percentage)
603.bwaves_s (unexplained diff vs previous)
603.bwaves_s (unexplained diff vs previous) (percentage)
605.mcf_s
605.mcf_s (avg)
605.mcf_s (avg) (percentage)
605.mcf_s (max)
605.mcf_s (max) (percentage)
619.lbm_s
619.lbm_s (avg)
619.lbm_s (avg) (percentage)
619.lbm_s (max)
619.lbm_s (max) (percentage)
620.omnetpp_s
620.omnetpp_s (avg)
620.omnetpp_s (avg) (percentage)
620.omnetpp_s (max)
620.omnetpp_s (max) (percentage)
623.xalancbmk_s (avg) (percentage)
623.xalancbmk_s (max) (percentage)
625.x264_s
625.x264_s (avg)
625.x264_s (avg) (percentage)
625.x264_s (max)
625.x264_s (max) (percentage)
631.deepsjeng_s
631.deepsjeng_s (avg)
631.deepsjeng_s (avg) (percentage)
631.deepsjeng_s (max)
631.deepsjeng_s (max) (percentage)
638.imagick_s
638.imagick_s (avg)
638.imagick_s (avg) (percentage)
638.imagick_s (max)
638.imagick_s (max) (percentage)
641.leela_s
641.leela_s (avg)
641.leela_s (avg) (percentage)
641.leela_s (max)
641.leela_s (max) (percentage)
644.nab_s
644.nab_s (avg)
644.nab_s (avg) (percentage)
644.nab_s (max)
644.nab_s (max) (percentage)
648.exchange2_s
648.exchange2_s (avg)
648.exchange2_s (avg) (percentage)
648.exchange2_s (max)
648.exchange2_s (max) (percentage)
648.exchange2_s (unexplained diff vs previous)
648.exchange2_s (unexplained diff vs previous) (percentage)
649.fotonik3d_s
649.fotonik3d_s (avg)
649.fotonik3d_s (avg) (percentage)
649.fotonik3d_s (max)
649.fotonik3d_s (max) (percentage)
649.fotonik3d_s (unexplained diff vs previous)
649.fotonik3d_s (unexplained diff vs previous) (percentage)
654.roms_s
654.roms_s (avg)
654.roms_s (avg) (percentage)
654.roms_s (max)
654.roms_s (max) (percentage)
657.xz_s
657.xz_s (avg)
657.xz_s (avg) (percentage)
657.xz_s (max)
657.xz_s (max) (percentage)


Report Time: 0.35s
Name Current %
508.namd_r 2532.000 -
510.parest_r 5758.000 -
511.povray_r 416.000 -
526.blender_r 8985.000 -
600.perlbench_s 2254.000 -
602.gcc_s 4188.000 -
603.bwaves_s 9711.000 -
605.mcf_s 6481.000 -
619.lbm_s 33102.000 -
620.omnetpp_s 3854.000 -
621.wrf_s 7914.000 -
625.x264_s 2683.000 -
627.cam4_s 442.000 -
628.pop2_s 18064.000 -
631.deepsjeng_s 3453.000 -
638.imagick_s 3085.000 -
641.leela_s 4151.000 -
644.nab_s 11332.000 -
648.exchange2_s 35229.000 -
649.fotonik3d_s 12741.000 -
654.roms_s 40843.000 -
657.xz_s 2214.000 -
Geometric Mean 5423.154 -
Name Current %
508.namd_r 378205.000 -
510.parest_r 1489830.000 -
511.povray_r 734746.000 -
526.blender_r 11488657.000 -
600.perlbench_s 1861987.000 -
602.gcc_s 7926354.000 -
603.bwaves_s 869843.000 -
605.mcf_s 14992.000 -
619.lbm_s 13506.000 -
620.omnetpp_s 1682282.000 -
621.wrf_s 18046957.000 -
625.x264_s 408244.000 -
628.pop2_s 8425728.000 -
631.deepsjeng_s 57591.000 -
638.imagick_s 1155156.000 -
641.leela_s 71640.000 -
644.nab_s 82893.000 -
648.exchange2_s 2674036.000 -
649.fotonik3d_s 3135140.000 -
654.roms_s 3009055.000 -
657.xz_s 110587.000 -
Geometric Mean 731877.386 -
Name Current %
508.namd_r 48.000 -
508.namd_r (avg) 48.000 -
508.namd_r (avg) (percentage) 1.920 -
508.namd_r (max) 14.000 -
508.namd_r (max) (percentage) 0.560 -
508.namd_r (unexplained diff vs previous) 4.000 -
508.namd_r (unexplained diff vs previous) (percentage) 0.160 -
510.parest_r 130.000 -
510.parest_r (avg) 130.000 -
510.parest_r (avg) (percentage) 2.270 -
510.parest_r (max) 55.000 -
510.parest_r (max) (percentage) 0.960 -
510.parest_r (unexplained diff vs previous) 13.000 -
510.parest_r (unexplained diff vs previous) (percentage) 0.230 -
511.povray_r 4.000 -
511.povray_r (avg) 4.000 -
511.povray_r (avg) (percentage) 1.060 -
511.povray_r (max) 5.000 -
511.povray_r (max) (percentage) 1.370 -
526.blender_r 73.000 -
526.blender_r (avg) 73.000 -
526.blender_r (avg) (percentage) 0.820 -
526.blender_r (max) 92.000 -
526.blender_r (max) (percentage) 1.030 -
526.blender_r (unexplained diff vs previous) 35.000 -
526.blender_r (unexplained diff vs previous) (percentage) 0.390 -
600.perlbench_s 54.000 -
600.perlbench_s (avg) 54.000 -
600.perlbench_s (avg) (percentage) 2.400 -
600.perlbench_s (max) 42.000 -
600.perlbench_s (max) (percentage) 1.900 -
600.perlbench_s (unexplained diff vs previous) 10.000 -
600.perlbench_s (unexplained diff vs previous) (percentage) 0.440 -
603.bwaves_s 219.000 -
603.bwaves_s (avg) 219.000 -
603.bwaves_s (avg) (percentage) 2.260 -
603.bwaves_s (max) 203.000 -
603.bwaves_s (max) (percentage) 2.100 -
603.bwaves_s (unexplained diff vs previous) 38.000 -
603.bwaves_s (unexplained diff vs previous) (percentage) 0.390 -
605.mcf_s 165.000 -
605.mcf_s (avg) 165.000 -
605.mcf_s (avg) (percentage) 2.550 -
605.mcf_s (max) 91.000 -
605.mcf_s (max) (percentage) 1.410 -
605.mcf_s (unexplained diff vs previous) 72.000 -
605.mcf_s (unexplained diff vs previous) (percentage) 1.110 -
619.lbm_s 4326.000 -
619.lbm_s (avg) 4326.000 -
619.lbm_s (avg) (percentage) 13.070 -
619.lbm_s (max) 3320.000 -
619.lbm_s (max) (percentage) 10.030 -
619.lbm_s (unexplained diff vs previous) 718.000 -
619.lbm_s (unexplained diff vs previous) (percentage) 2.170 -
620.omnetpp_s 168.000 -
620.omnetpp_s (avg) 168.000 -
620.omnetpp_s (avg) (percentage) 4.360 -
620.omnetpp_s (max) 34.000 -
620.omnetpp_s (max) (percentage) 0.890 -
620.omnetpp_s (unexplained diff vs previous) 17.000 -
620.omnetpp_s (unexplained diff vs previous) (percentage) 0.440 -
623.xalancbmk_s (avg) (percentage) 2.270 -
623.xalancbmk_s (max) (percentage) 0.390 -
625.x264_s 65.000 -
625.x264_s (avg) 65.000 -
625.x264_s (avg) (percentage) 2.450 -
625.x264_s (max) 32.000 -
625.x264_s (max) (percentage) 1.220 -
625.x264_s (unexplained diff vs previous) 9.000 -
625.x264_s (unexplained diff vs previous) (percentage) 0.340 -
631.deepsjeng_s 76.000 -
631.deepsjeng_s (avg) 76.000 -
631.deepsjeng_s (avg) (percentage) 2.220 -
631.deepsjeng_s (max) 31.000 -
631.deepsjeng_s (max) (percentage) 0.900 -
631.deepsjeng_s (unexplained diff vs previous) 14.000 -
631.deepsjeng_s (unexplained diff vs previous) (percentage) 0.410 -
638.imagick_s 74.000 -
638.imagick_s (avg) 74.000 -
638.imagick_s (avg) (percentage) 2.420 -
638.imagick_s (max) 51.000 -
638.imagick_s (max) (percentage) 1.680 -
638.imagick_s (unexplained diff vs previous) 14.000 -
638.imagick_s (unexplained diff vs previous) (percentage) 0.450 -
641.leela_s 55.000 -
641.leela_s (avg) 55.000 -
641.leela_s (avg) (percentage) 1.330 -
641.leela_s (max) 21.000 -
641.leela_s (max) (percentage) 0.510 -
641.leela_s (unexplained diff vs previous) 21.000 -
641.leela_s (unexplained diff vs previous) (percentage) 0.510 -
644.nab_s 103.000 -
644.nab_s (avg) 103.000 -
644.nab_s (avg) (percentage) 0.910 -
644.nab_s (max) 103.000 -
644.nab_s (max) (percentage) 0.910 -
644.nab_s (unexplained diff vs previous) 40.000 -
644.nab_s (unexplained diff vs previous) (percentage) 0.350 -
648.exchange2_s 126.000 -
648.exchange2_s (avg) 126.000 -
648.exchange2_s (avg) (percentage) 0.360 -
648.exchange2_s (max) 225.000 -
648.exchange2_s (max) (percentage) 0.640 -
648.exchange2_s (unexplained diff vs previous) 157.000 -
648.exchange2_s (unexplained diff vs previous) (percentage) 0.450 -
649.fotonik3d_s 154.000 -
649.fotonik3d_s (avg) 154.000 -
649.fotonik3d_s (avg) (percentage) 1.210 -
649.fotonik3d_s (max) 152.000 -
649.fotonik3d_s (max) (percentage) 1.200 -
649.fotonik3d_s (unexplained diff vs previous) 148.000 -
649.fotonik3d_s (unexplained diff vs previous) (percentage) 1.160 -
654.roms_s 1033.000 -
654.roms_s (avg) 1033.000 -
654.roms_s (avg) (percentage) 2.530 -
654.roms_s (max) 4696.000 -
654.roms_s (max) (percentage) 11.500 -
657.xz_s 97.000 -
657.xz_s (avg) 97.000 -
657.xz_s (avg) (percentage) 4.400 -
657.xz_s (max) 65.000 -
657.xz_s (max) (percentage) 2.970 -
657.xz_s (unexplained diff vs previous) 10.000 -
657.xz_s (unexplained diff vs previous) (percentage) 0.450 -
Geometric Mean 12.263 -