Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/c053ec95f7e66ff212c8a867426cc7275a4dace6 (+ 215 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-cpu2017fast--llvm-aarch64-master-Os-build/154/
Filter

llvm-aarch64-master-Os test results

Run Order Start Time Duration
Current 0154 (llvmorg-19-init-15311-gc053ec95f7e6) 2024-06-20T14:02:26 0:00:00
Previous 0154 (llvmorg-19-init-15311-gc053ec95f7e6) 2024-06-20T14:02:26 0:00:00
Baseline 0126 (llvmorg-19-init-07229-g315c88c5fbdb) 2024-04-03T17:19:06 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 0 5
Performance Improvements 0 3
Added Tests 0 156
Unchanged Tests 834 670
Total Tests 834

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
510.parest_r 1.40% 6923482.000 7020534.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
510.parest_r 24.34% 4576.000 5690.000 - 0.00% -
526.blender_r 5.55% 8685.000 9167.000 - 0.00% -
511.povray_r 1.85% 433.000 441.000 - 0.00% -
508.namd_r 1.23% 2439.000 2469.000 - 0.00% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_execution_successful 900.00% 4.000 40.000 - 0.00% -
nb_total_tests 108.33% 24.000 50.000 - 0.00% -
nb_compile_successful 90.91% 22.000 42.000 - 0.00% -

Added Tests - Code Size
600.perlbench_s
602.gcc_s
603.bwaves_s
605.mcf_s
619.lbm_s
620.omnetpp_s
625.x264_s
628.pop2_s
631.deepsjeng_s
638.imagick_s
641.leela_s
644.nab_s
648.exchange2_s
649.fotonik3d_s
654.roms_s
657.xz_s

Added Tests - Execution
600.perlbench_s
602.gcc_s
603.bwaves_s
605.mcf_s
619.lbm_s
620.omnetpp_s
625.x264_s
627.cam4_s
628.pop2_s
631.deepsjeng_s
638.imagick_s
641.leela_s
644.nab_s
648.exchange2_s
649.fotonik3d_s
654.roms_s
657.xz_s

Added Tests - sample variability
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
600.perlbench_s
600.perlbench_s (avg)
600.perlbench_s (avg) (percentage)
600.perlbench_s (max)
600.perlbench_s (max) (percentage)
603.bwaves_s
603.bwaves_s (avg)
603.bwaves_s (avg) (percentage)
603.bwaves_s (max)
603.bwaves_s (max) (percentage)
603.bwaves_s (unexplained diff vs previous)
603.bwaves_s (unexplained diff vs previous) (percentage)
605.mcf_s
605.mcf_s (avg)
605.mcf_s (avg) (percentage)
605.mcf_s (max)
605.mcf_s (max) (percentage)
605.mcf_s (unexplained diff vs previous)
605.mcf_s (unexplained diff vs previous) (percentage)
619.lbm_s
619.lbm_s (avg)
619.lbm_s (avg) (percentage)
619.lbm_s (max)
619.lbm_s (max) (percentage)
619.lbm_s (unexplained diff vs previous)
619.lbm_s (unexplained diff vs previous) (percentage)
620.omnetpp_s
620.omnetpp_s (avg)
620.omnetpp_s (avg) (percentage)
620.omnetpp_s (max)
620.omnetpp_s (max) (percentage)
620.omnetpp_s (unexplained diff vs previous)
620.omnetpp_s (unexplained diff vs previous) (percentage)
625.x264_s
625.x264_s (avg)
625.x264_s (avg) (percentage)
625.x264_s (max)
625.x264_s (max) (percentage)
625.x264_s (unexplained diff vs previous)
625.x264_s (unexplained diff vs previous) (percentage)
628.pop2_s
628.pop2_s (avg)
628.pop2_s (avg) (percentage)
628.pop2_s (max)
628.pop2_s (max) (percentage)
628.pop2_s (unexplained diff vs previous)
628.pop2_s (unexplained diff vs previous) (percentage)
631.deepsjeng_s
631.deepsjeng_s (avg)
631.deepsjeng_s (avg) (percentage)
631.deepsjeng_s (max)
631.deepsjeng_s (max) (percentage)
631.deepsjeng_s (unexplained diff vs previous)
631.deepsjeng_s (unexplained diff vs previous) (percentage)
638.imagick_s
638.imagick_s (avg)
638.imagick_s (avg) (percentage)
638.imagick_s (max)
638.imagick_s (max) (percentage)
638.imagick_s (unexplained diff vs previous)
638.imagick_s (unexplained diff vs previous) (percentage)
641.leela_s
641.leela_s (avg)
641.leela_s (avg) (percentage)
641.leela_s (max)
641.leela_s (max) (percentage)
641.leela_s (unexplained diff vs previous)
641.leela_s (unexplained diff vs previous) (percentage)
644.nab_s
644.nab_s (avg)
644.nab_s (avg) (percentage)
644.nab_s (max)
644.nab_s (max) (percentage)
644.nab_s (unexplained diff vs previous)
644.nab_s (unexplained diff vs previous) (percentage)
648.exchange2_s
648.exchange2_s (avg)
648.exchange2_s (avg) (percentage)
648.exchange2_s (max)
648.exchange2_s (max) (percentage)
648.exchange2_s (unexplained diff vs previous)
648.exchange2_s (unexplained diff vs previous) (percentage)
649.fotonik3d_s
649.fotonik3d_s (avg)
649.fotonik3d_s (avg) (percentage)
649.fotonik3d_s (max)
649.fotonik3d_s (max) (percentage)
649.fotonik3d_s (unexplained diff vs previous)
649.fotonik3d_s (unexplained diff vs previous) (percentage)
654.roms_s
654.roms_s (avg)
654.roms_s (avg) (percentage)
654.roms_s (max)
654.roms_s (max) (percentage)
654.roms_s (unexplained diff vs previous)
654.roms_s (unexplained diff vs previous) (percentage)
657.xz_s
657.xz_s (avg)
657.xz_s (avg) (percentage)
657.xz_s (max)
657.xz_s (max) (percentage)
657.xz_s (unexplained diff vs previous)
657.xz_s (unexplained diff vs previous) (percentage)


Report Time: 0.34s
Name Current %
508.namd_r 2469.000 -
510.parest_r 5690.000 -
511.povray_r 441.000 -
526.blender_r 9167.000 -
600.perlbench_s 2387.000 -
602.gcc_s 4229.000 -
603.bwaves_s 36721.000 -
605.mcf_s 6790.000 -
619.lbm_s 30871.000 -
620.omnetpp_s 3924.000 -
625.x264_s 2650.000 -
627.cam4_s 1951.000 -
628.pop2_s 83927.000 -
631.deepsjeng_s 3978.000 -
638.imagick_s 3048.000 -
641.leela_s 5096.000 -
644.nab_s 11865.000 -
648.exchange2_s 53180.000 -
649.fotonik3d_s 40516.000 -
654.roms_s 136115.000 -
657.xz_s 2116.000 -
Geometric Mean 7630.683 -
Name Current %
508.namd_r 481828.000 -
510.parest_r 7020534.000 -
511.povray_r 777256.000 -
526.blender_r 12518237.000 -
600.perlbench_s 1951297.000 -
602.gcc_s 8304407.000 -
603.bwaves_s 909843.000 -
605.mcf_s 19736.000 -
619.lbm_s 17326.000 -
620.omnetpp_s 2000912.000 -
625.x264_s 419860.000 -
628.pop2_s 14766009.000 -
631.deepsjeng_s 73009.000 -
638.imagick_s 1717039.000 -
641.leela_s 126731.000 -
644.nab_s 162980.000 -
648.exchange2_s 2824423.000 -
649.fotonik3d_s 3621199.000 -
654.roms_s 4574670.000 -
657.xz_s 166848.000 -
Geometric Mean 853017.381 -
Name Current %
508.namd_r 13.000 -
508.namd_r (avg) 13.000 -
508.namd_r (avg) (percentage) 0.540 -
508.namd_r (max) 20.000 -
508.namd_r (max) (percentage) 0.840 -
508.namd_r (unexplained diff vs previous) 21.000 -
508.namd_r (unexplained diff vs previous) (percentage) 0.850 -
510.parest_r 73.000 -
510.parest_r (avg) 73.000 -
510.parest_r (avg) (percentage) 1.300 -
510.parest_r (max) 14.000 -
510.parest_r (max) (percentage) 0.260 -
510.parest_r (unexplained diff vs previous) 3.000 -
510.parest_r (unexplained diff vs previous) (percentage) 0.050 -
511.povray_r 4.000 -
511.povray_r (avg) 4.000 -
511.povray_r (avg) (percentage) 0.980 -
511.povray_r (max) 9.000 -
511.povray_r (max) (percentage) 2.080 -
511.povray_r (unexplained diff vs previous) 9.000 -
511.povray_r (unexplained diff vs previous) (percentage) 2.040 -
526.blender_r 18.000 -
526.blender_r (avg) 18.000 -
526.blender_r (avg) (percentage) 0.200 -
526.blender_r (max) 10.000 -
526.blender_r (max) (percentage) 0.110 -
526.blender_r (unexplained diff vs previous) 1.000 -
526.blender_r (unexplained diff vs previous) (percentage) 0.010 -
600.perlbench_s 12.000 -
600.perlbench_s (avg) 12.000 -
600.perlbench_s (avg) (percentage) 0.530 -
600.perlbench_s (max) 16.000 -
600.perlbench_s (max) (percentage) 0.700 -
603.bwaves_s 124.000 -
603.bwaves_s (avg) 124.000 -
603.bwaves_s (avg) (percentage) 0.340 -
603.bwaves_s (max) 205.000 -
603.bwaves_s (max) (percentage) 0.560 -
603.bwaves_s (unexplained diff vs previous) 95.000 -
603.bwaves_s (unexplained diff vs previous) (percentage) 0.260 -
605.mcf_s 25.000 -
605.mcf_s (avg) 25.000 -
605.mcf_s (avg) (percentage) 0.380 -
605.mcf_s (max) 23.000 -
605.mcf_s (max) (percentage) 0.350 -
605.mcf_s (unexplained diff vs previous) 22.000 -
605.mcf_s (unexplained diff vs previous) (percentage) 0.320 -
619.lbm_s 1463.000 -
619.lbm_s (avg) 1463.000 -
619.lbm_s (avg) (percentage) 4.740 -
619.lbm_s (max) 2914.000 -
619.lbm_s (max) (percentage) 9.440 -
619.lbm_s (unexplained diff vs previous) 2664.000 -
619.lbm_s (unexplained diff vs previous) (percentage) 8.630 -
620.omnetpp_s 58.000 -
620.omnetpp_s (avg) 58.000 -
620.omnetpp_s (avg) (percentage) 1.490 -
620.omnetpp_s (max) 132.000 -
620.omnetpp_s (max) (percentage) 3.370 -
620.omnetpp_s (unexplained diff vs previous) 128.000 -
620.omnetpp_s (unexplained diff vs previous) (percentage) 3.260 -
625.x264_s 7.000 -
625.x264_s (avg) 7.000 -
625.x264_s (avg) (percentage) 0.280 -
625.x264_s (max) 10.000 -
625.x264_s (max) (percentage) 0.400 -
625.x264_s (unexplained diff vs previous) 3.000 -
625.x264_s (unexplained diff vs previous) (percentage) 0.110 -
628.pop2_s 92.000 -
628.pop2_s (avg) 92.000 -
628.pop2_s (avg) (percentage) 0.110 -
628.pop2_s (max) 184.000 -
628.pop2_s (max) (percentage) 0.220 -
628.pop2_s (unexplained diff vs previous) 123.000 -
628.pop2_s (unexplained diff vs previous) (percentage) 0.150 -
631.deepsjeng_s 8.000 -
631.deepsjeng_s (avg) 8.000 -
631.deepsjeng_s (avg) (percentage) 0.210 -
631.deepsjeng_s (max) 11.000 -
631.deepsjeng_s (max) (percentage) 0.280 -
631.deepsjeng_s (unexplained diff vs previous) 10.000 -
631.deepsjeng_s (unexplained diff vs previous) (percentage) 0.250 -
638.imagick_s 17.000 -
638.imagick_s (avg) 17.000 -
638.imagick_s (avg) (percentage) 0.570 -
638.imagick_s (max) 15.000 -
638.imagick_s (max) (percentage) 0.520 -
638.imagick_s (unexplained diff vs previous) 13.000 -
638.imagick_s (unexplained diff vs previous) (percentage) 0.430 -
641.leela_s 9.000 -
641.leela_s (avg) 9.000 -
641.leela_s (avg) (percentage) 0.190 -
641.leela_s (max) 15.000 -
641.leela_s (max) (percentage) 0.300 -
641.leela_s (unexplained diff vs previous) 8.000 -
641.leela_s (unexplained diff vs previous) (percentage) 0.160 -
644.nab_s 105.000 -
644.nab_s (avg) 105.000 -
644.nab_s (avg) (percentage) 0.890 -
644.nab_s (max) 116.000 -
644.nab_s (max) (percentage) 0.980 -
644.nab_s (unexplained diff vs previous) 111.000 -
644.nab_s (unexplained diff vs previous) (percentage) 0.940 -
648.exchange2_s 79.000 -
648.exchange2_s (avg) 79.000 -
648.exchange2_s (avg) (percentage) 0.150 -
648.exchange2_s (max) 95.000 -
648.exchange2_s (max) (percentage) 0.180 -
648.exchange2_s (unexplained diff vs previous) 29.000 -
648.exchange2_s (unexplained diff vs previous) (percentage) 0.050 -
649.fotonik3d_s 105.000 -
649.fotonik3d_s (avg) 105.000 -
649.fotonik3d_s (avg) (percentage) 0.260 -
649.fotonik3d_s (max) 247.000 -
649.fotonik3d_s (max) (percentage) 0.610 -
649.fotonik3d_s (unexplained diff vs previous) 246.000 -
649.fotonik3d_s (unexplained diff vs previous) (percentage) 0.610 -
654.roms_s 285.000 -
654.roms_s (avg) 285.000 -
654.roms_s (avg) (percentage) 0.210 -
654.roms_s (max) 571.000 -
654.roms_s (max) (percentage) 0.420 -
654.roms_s (unexplained diff vs previous) 100.000 -
654.roms_s (unexplained diff vs previous) (percentage) 0.070 -
657.xz_s 12.000 -
657.xz_s (avg) 12.000 -
657.xz_s (avg) (percentage) 0.600 -
657.xz_s (max) 18.000 -
657.xz_s (max) (percentage) 0.860 -
657.xz_s (unexplained diff vs previous) 18.000 -
657.xz_s (unexplained diff vs previous) (percentage) 0.850 -
Geometric Mean 5.555 -