Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/05d85ecad707573cde0258cbab579ed764c61e51 (+ 6367 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-cpu2017rate--llvm-aarch64-master-Oz-build/64/
Filter

llvm-aarch64-master-Oz test results

Run Order Start Time Duration
Current 0064 (llvmorg-20-init-02156-g05d85ecad707) 2024-07-13T00:59:33 0:00:00
Previous 0064 (llvmorg-20-init-02156-g05d85ecad707) 2024-07-13T00:59:33 0:00:00
Baseline 0001 (llvmorg-19-init-09624-g6e722bbe30bd) 2024-04-26T20:02:57 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 0 9
Performance Improvements 0 12
Added Tests 0 97
Unchanged Tests 858 740
Total Tests 858

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
525.x264_r 21.24% 20346.000 24668.000 - 0.00% -
505.mcf_r 3.29% 14136.000 14601.000 - 0.00% -
500.perlbench_r 2.14% 19850.000 20274.000 - 0.00% -
557.xz_r 2.01% 12264.000 12511.000 - 0.00% -
531.deepsjeng_r 1.85% 10529.000 10724.000 - 0.00% -
541.leela_r 1.79% 15963.000 16249.000 - 0.00% -
554.roms_r 1.54% 92791.000 94220.000 - 0.00% -
502.gcc_r 1.43% 14007.000 14208.000 - 0.00% -
511.povray_r 1.25% 22748.000 23033.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
503.bwaves_r -9.66% 864441.000 780930.000 - 0.00% -
554.roms_r -6.41% 4583918.000 4290304.000 - 0.00% -
521.wrf_r -5.04% 64214010.000 60979987.000 - 0.00% -
549.fotonik3d_r -3.92% 3508235.000 3370690.000 - 0.00% -
527.cam4_r -3.69% 16744261.000 16126306.000 - 0.00% -
538.imagick_r -1.32% 1281837.000 1264905.000 - 0.00% -
510.parest_r -1.21% 5576479.000 5508899.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
527.cam4_r -2.93% 65888.000 63960.000 - 0.00% -
520.omnetpp_r -2.31% 16437.000 16058.000 - 0.00% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 108.70% 23.000 48.000 - 0.00% -
nb_compile_successful 90.48% 21.000 40.000 - 0.00% -
nb_execution_successful 90.48% 21.000 40.000 - 0.00% -

Added Tests - sample variability
500.perlbench_r
500.perlbench_r (avg)
500.perlbench_r (avg) (percentage)
500.perlbench_r (max)
500.perlbench_r (max) (percentage)
503.bwaves_r
503.bwaves_r (avg)
503.bwaves_r (avg) (percentage)
503.bwaves_r (max)
503.bwaves_r (max) (percentage)
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)
520.omnetpp_r
520.omnetpp_r (avg)
520.omnetpp_r (avg) (percentage)
520.omnetpp_r (max)
520.omnetpp_r (max) (percentage)
521.wrf_r
521.wrf_r (avg)
521.wrf_r (avg) (percentage)
521.wrf_r (max)
521.wrf_r (max) (percentage)
523.xalancbmk_r (avg) (percentage)
523.xalancbmk_r (max) (percentage)
525.x264_r
525.x264_r (avg)
525.x264_r (avg) (percentage)
525.x264_r (max)
525.x264_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
527.cam4_r
527.cam4_r (avg)
527.cam4_r (avg) (percentage)
527.cam4_r (max)
527.cam4_r (max) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
538.imagick_r
538.imagick_r (avg)
538.imagick_r (avg) (percentage)
538.imagick_r (max)
538.imagick_r (max) (percentage)
541.leela_r
541.leela_r (avg)
541.leela_r (avg) (percentage)
541.leela_r (max)
541.leela_r (max) (percentage)
544.nab_r
544.nab_r (avg)
544.nab_r (avg) (percentage)
544.nab_r (max)
544.nab_r (max) (percentage)
549.fotonik3d_r
549.fotonik3d_r (avg)
549.fotonik3d_r (avg) (percentage)
549.fotonik3d_r (max)
549.fotonik3d_r (max) (percentage)
554.roms_r
554.roms_r (avg)
554.roms_r (avg) (percentage)
554.roms_r (max)
554.roms_r (max) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)


Report Time: 0.22s
Name Current %
500.perlbench_r 20274.000 -
502.gcc_r 14208.000 -
503.bwaves_r 159459.000 -
505.mcf_r 14601.000 -
508.namd_r 9675.000 -
510.parest_r 25409.000 -
511.povray_r 23033.000 -
519.lbm_r 18234.000 -
520.omnetpp_r 16058.000 -
521.wrf_r 121059.000 -
525.x264_r 24668.000 -
526.blender_r 13341.000 -
527.cam4_r 63960.000 -
531.deepsjeng_r 10724.000 -
538.imagick_r 14362.000 -
541.leela_r 16249.000 -
544.nab_r 14558.000 -
549.fotonik3d_r 149079.000 -
554.roms_r 94220.000 -
557.xz_r 12511.000 -
Geometric Mean 25878.095 -
Name Current %
500.perlbench_r 1871092.000 -
502.gcc_r 7359517.000 -
503.bwaves_r 780930.000 -
505.mcf_r 17562.000 -
508.namd_r 421445.000 -
510.parest_r 5508899.000 -
511.povray_r 737474.000 -
519.lbm_r 12922.000 -
520.omnetpp_r 1735016.000 -
521.wrf_r 60979987.000 -
525.x264_r 372510.000 -
526.blender_r 12048847.000 -
527.cam4_r 16126306.000 -
531.deepsjeng_r 72435.000 -
538.imagick_r 1264905.000 -
541.leela_r 119072.000 -
544.nab_r 143297.000 -
549.fotonik3d_r 3370690.000 -
554.roms_r 4290304.000 -
557.xz_r 157297.000 -
Geometric Mean 897026.171 -
Name Current %
500.perlbench_r 36.000 -
500.perlbench_r (avg) 36.000 -
500.perlbench_r (avg) (percentage) 0.180 -
500.perlbench_r (max) 46.000 -
500.perlbench_r (max) (percentage) 0.230 -
503.bwaves_r 47.000 -
503.bwaves_r (avg) 47.000 -
503.bwaves_r (avg) (percentage) 0.030 -
503.bwaves_r (max) 79.000 -
503.bwaves_r (max) (percentage) 0.050 -
505.mcf_r 39.000 -
505.mcf_r (avg) 39.000 -
505.mcf_r (avg) (percentage) 0.270 -
505.mcf_r (max) 52.000 -
505.mcf_r (max) (percentage) 0.360 -
508.namd_r 36.000 -
508.namd_r (avg) 36.000 -
508.namd_r (avg) (percentage) 0.380 -
508.namd_r (max) 83.000 -
508.namd_r (max) (percentage) 0.860 -
510.parest_r 22.000 -
510.parest_r (avg) 22.000 -
510.parest_r (avg) (percentage) 0.090 -
510.parest_r (max) 33.000 -
510.parest_r (max) (percentage) 0.130 -
511.povray_r 78.000 -
511.povray_r (avg) 78.000 -
511.povray_r (avg) (percentage) 0.340 -
511.povray_r (max) 179.000 -
511.povray_r (max) (percentage) 0.780 -
519.lbm_r 58.000 -
519.lbm_r (avg) 58.000 -
519.lbm_r (avg) (percentage) 0.320 -
519.lbm_r (max) 98.000 -
519.lbm_r (max) (percentage) 0.540 -
519.lbm_r (unexplained diff vs previous) 57.000 -
519.lbm_r (unexplained diff vs previous) (percentage) 0.310 -
520.omnetpp_r 168.000 -
520.omnetpp_r (avg) 168.000 -
520.omnetpp_r (avg) (percentage) 1.050 -
520.omnetpp_r (max) 509.000 -
520.omnetpp_r (max) (percentage) 3.170 -
520.omnetpp_r (unexplained diff vs previous) 85.000 -
520.omnetpp_r (unexplained diff vs previous) (percentage) 0.530 -
521.wrf_r 217.000 -
521.wrf_r (avg) 217.000 -
521.wrf_r (avg) (percentage) 0.180 -
521.wrf_r (max) 266.000 -
521.wrf_r (max) (percentage) 0.220 -
523.xalancbmk_r (avg) (percentage) 0.030 -
523.xalancbmk_r (max) (percentage) 0.020 -
525.x264_r 91.000 -
525.x264_r (avg) 91.000 -
525.x264_r (avg) (percentage) 0.370 -
525.x264_r (max) 170.000 -
525.x264_r (max) (percentage) 0.690 -
526.blender_r 25.000 -
526.blender_r (avg) 25.000 -
526.blender_r (avg) (percentage) 0.190 -
526.blender_r (max) 25.000 -
526.blender_r (max) (percentage) 0.190 -
527.cam4_r 70.000 -
527.cam4_r (avg) 70.000 -
527.cam4_r (avg) (percentage) 0.110 -
527.cam4_r (max) 147.000 -
527.cam4_r (max) (percentage) 0.230 -
531.deepsjeng_r 189.000 -
531.deepsjeng_r (avg) 189.000 -
531.deepsjeng_r (avg) (percentage) 1.770 -
531.deepsjeng_r (max) 438.000 -
531.deepsjeng_r (max) (percentage) 4.090 -
538.imagick_r 20.000 -
538.imagick_r (avg) 20.000 -
538.imagick_r (avg) (percentage) 0.140 -
538.imagick_r (max) 34.000 -
538.imagick_r (max) (percentage) 0.240 -
541.leela_r 97.000 -
541.leela_r (avg) 97.000 -
541.leela_r (avg) (percentage) 0.600 -
541.leela_r (max) 149.000 -
541.leela_r (max) (percentage) 0.920 -
544.nab_r 27.000 -
544.nab_r (avg) 27.000 -
544.nab_r (avg) (percentage) 0.190 -
544.nab_r (max) 42.000 -
544.nab_r (max) (percentage) 0.290 -
549.fotonik3d_r 596.000 -
549.fotonik3d_r (avg) 596.000 -
549.fotonik3d_r (avg) (percentage) 0.400 -
549.fotonik3d_r (max) 700.000 -
549.fotonik3d_r (max) (percentage) 0.470 -
554.roms_r 122.000 -
554.roms_r (avg) 122.000 -
554.roms_r (avg) (percentage) 0.130 -
554.roms_r (max) 254.000 -
554.roms_r (max) (percentage) 0.270 -
557.xz_r 20.000 -
557.xz_r (avg) 20.000 -
557.xz_r (avg) (percentage) 0.160 -
557.xz_r (max) 25.000 -
557.xz_r (max) (percentage) 0.200 -
Geometric Mean 7.349 -