Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/17a8e245703a375c53c9ee4e3f6ed11b6869d771 (+ 175 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-cpu2017rate--llvm-aarch64-master-O3-build/29/
Filter

llvm-aarch64-master-O3 test results

Run Order Start Time Duration
Current 0029 (llvmorg-17-init-09835-g17a8e245703a) 2023-04-28T12:17:11 0:00:00
Previous 0029 (llvmorg-17-init-09835-g17a8e245703a) 2023-04-28T12:17:11 0:00:00
Baseline 0001 (llvmorg-17-init-03217-ge08cc52cfc23) 2023-02-25T18:19:40 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 0 2
Performance Improvements 0 9
Added Tests 0 118
Unchanged Tests 852 723
Total Tests 852

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
508.namd_r 3.73% 607655.000 630315.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
505.mcf_r 1.20% 13802.000 13968.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
525.x264_r -4.49% 6241.000 5961.000 - 0.00% -
526.blender_r -3.75% 12496.000 12027.000 - 0.00% -
500.perlbench_r -1.79% 16109.000 15821.000 - 0.00% -
520.omnetpp_r -1.60% 14709.000 14473.000 - 0.00% -
544.nab_r -1.21% 14580.000 14403.000 - 0.00% -
519.lbm_r -1.08% 17367.000 17179.000 - 0.00% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 43.75% 16.000 23.000 - 0.00% -
nb_compile_successful 37.50% 16.000 22.000 - 0.00% -
nb_execution_successful 37.50% 16.000 22.000 - 0.00% -

Added Tests - Code Size
503.bwaves_r
507.cactuBSSN_r
521.wrf_r
548.exchange2_r
549.fotonik3d_r
554.roms_r

Added Tests - Execution
503.bwaves_r
507.cactuBSSN_r
521.wrf_r
548.exchange2_r
549.fotonik3d_r
554.roms_r

Added Tests - sample variability
500.perlbench_r
500.perlbench_r (avg)
500.perlbench_r (avg) (percentage)
500.perlbench_r (max)
500.perlbench_r (max) (percentage)
503.bwaves_r
503.bwaves_r (avg)
503.bwaves_r (avg) (percentage)
503.bwaves_r (max)
503.bwaves_r (max) (percentage)
503.bwaves_r (unexplained diff vs previous)
503.bwaves_r (unexplained diff vs previous) (percentage)
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)
520.omnetpp_r
520.omnetpp_r (avg)
520.omnetpp_r (avg) (percentage)
520.omnetpp_r (max)
520.omnetpp_r (max) (percentage)
521.wrf_r
521.wrf_r (avg)
521.wrf_r (avg) (percentage)
521.wrf_r (max)
521.wrf_r (max) (percentage)
523.xalancbmk_r
523.xalancbmk_r (avg)
523.xalancbmk_r (avg) (percentage)
523.xalancbmk_r (max)
523.xalancbmk_r (max) (percentage)
525.x264_r
525.x264_r (avg)
525.x264_r (avg) (percentage)
525.x264_r (max)
525.x264_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
538.imagick_r
538.imagick_r (avg)
538.imagick_r (avg) (percentage)
538.imagick_r (max)
538.imagick_r (max) (percentage)
541.leela_r
541.leela_r (avg)
541.leela_r (avg) (percentage)
541.leela_r (max)
541.leela_r (max) (percentage)
544.nab_r
544.nab_r (avg)
544.nab_r (avg) (percentage)
544.nab_r (max)
544.nab_r (max) (percentage)
548.exchange2_r
548.exchange2_r (avg)
548.exchange2_r (avg) (percentage)
548.exchange2_r (max)
548.exchange2_r (max) (percentage)
548.exchange2_r (unexplained diff vs previous)
548.exchange2_r (unexplained diff vs previous) (percentage)
549.fotonik3d_r
549.fotonik3d_r (avg)
549.fotonik3d_r (avg) (percentage)
549.fotonik3d_r (max)
549.fotonik3d_r (max) (percentage)
549.fotonik3d_r (unexplained diff vs previous)
549.fotonik3d_r (unexplained diff vs previous) (percentage)
554.roms_r
554.roms_r (avg)
554.roms_r (avg) (percentage)
554.roms_r (max)
554.roms_r (max) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)


Report Time: 0.33s
Name Current %
500.perlbench_r 15821.000 -
502.gcc_r 10726.000 -
503.bwaves_r 21258.000 -
505.mcf_r 13968.000 -
507.cactuBSSN_r 11363.000 -
508.namd_r 9614.000 -
510.parest_r 22956.000 -
511.povray_r 21104.000 -
519.lbm_r 17179.000 -
520.omnetpp_r 14473.000 -
521.wrf_r 14633.000 -
523.xalancbmk_r 13647.000 -
525.x264_r 5961.000 -
526.blender_r 12027.000 -
531.deepsjeng_r 8780.000 -
538.imagick_r 13486.000 -
541.leela_r 12811.000 -
544.nab_r 14403.000 -
548.exchange2_r 18522.000 -
549.fotonik3d_r 31352.000 -
554.roms_r 22523.000 -
557.xz_r 11588.000 -
Geometric Mean 14420.235 -
Name Current %
500.perlbench_r 2261755.000 -
502.gcc_r 9704144.000 -
503.bwaves_r 774734.000 -
505.mcf_r 28295.000 -
507.cactuBSSN_r 3810166.000 -
508.namd_r 630315.000 -
510.parest_r 9181149.000 -
511.povray_r 977082.000 -
519.lbm_r 13683.000 -
520.omnetpp_r 2224712.000 -
521.wrf_r 24315772.000 -
523.xalancbmk_r 4851827.000 -
525.x264_r 560586.000 -
526.blender_r 14443294.000 -
531.deepsjeng_r 90810.000 -
538.imagick_r 1804093.000 -
541.leela_r 153807.000 -
544.nab_r 199672.000 -
548.exchange2_r 2578691.000 -
549.fotonik3d_r 1254422.000 -
554.roms_r 3158441.000 -
557.xz_r 192540.000 -
Geometric Mean 1050935.597 -
Name Current %
500.perlbench_r 91.000 -
500.perlbench_r (avg) 91.000 -
500.perlbench_r (avg) (percentage) 0.580 -
500.perlbench_r (max) 151.000 -
500.perlbench_r (max) (percentage) 0.960 -
503.bwaves_r 21.000 -
503.bwaves_r (avg) 21.000 -
503.bwaves_r (avg) (percentage) 0.100 -
503.bwaves_r (max) 31.000 -
503.bwaves_r (max) (percentage) 0.150 -
503.bwaves_r (unexplained diff vs previous) 33.000 -
503.bwaves_r (unexplained diff vs previous) (percentage) 0.160 -
505.mcf_r 114.000 -
505.mcf_r (avg) 114.000 -
505.mcf_r (avg) (percentage) 0.820 -
505.mcf_r (max) 86.000 -
505.mcf_r (max) (percentage) 0.620 -
505.mcf_r (unexplained diff vs previous) 65.000 -
505.mcf_r (unexplained diff vs previous) (percentage) 0.470 -
508.namd_r 41.000 -
508.namd_r (avg) 41.000 -
508.namd_r (avg) (percentage) 0.430 -
508.namd_r (max) 29.000 -
508.namd_r (max) (percentage) 0.310 -
510.parest_r 29.000 -
510.parest_r (avg) 29.000 -
510.parest_r (avg) (percentage) 0.130 -
510.parest_r (max) 50.000 -
510.parest_r (max) (percentage) 0.220 -
510.parest_r (unexplained diff vs previous) 51.000 -
510.parest_r (unexplained diff vs previous) (percentage) 0.220 -
511.povray_r 40.000 -
511.povray_r (avg) 40.000 -
511.povray_r (avg) (percentage) 0.190 -
511.povray_r (max) 50.000 -
511.povray_r (max) (percentage) 0.240 -
519.lbm_r 36.000 -
519.lbm_r (avg) 36.000 -
519.lbm_r (avg) (percentage) 0.210 -
519.lbm_r (max) 15.000 -
519.lbm_r (max) (percentage) 0.090 -
519.lbm_r (unexplained diff vs previous) 16.000 -
519.lbm_r (unexplained diff vs previous) (percentage) 0.090 -
520.omnetpp_r 78.000 -
520.omnetpp_r (avg) 78.000 -
520.omnetpp_r (avg) (percentage) 0.540 -
520.omnetpp_r (max) 114.000 -
520.omnetpp_r (max) (percentage) 0.790 -
521.wrf_r 229.000 -
521.wrf_r (avg) 229.000 -
521.wrf_r (avg) (percentage) 1.570 -
521.wrf_r (max) 520.000 -
521.wrf_r (max) (percentage) 3.560 -
523.xalancbmk_r 28.000 -
523.xalancbmk_r (avg) 28.000 -
523.xalancbmk_r (avg) (percentage) 0.210 -
523.xalancbmk_r (max) 53.000 -
523.xalancbmk_r (max) (percentage) 0.390 -
525.x264_r 11.000 -
525.x264_r (avg) 11.000 -
525.x264_r (avg) (percentage) 0.200 -
525.x264_r (max) 31.000 -
525.x264_r (max) (percentage) 0.530 -
525.x264_r (unexplained diff vs previous) 2.000 -
525.x264_r (unexplained diff vs previous) (percentage) 0.030 -
526.blender_r 49.000 -
526.blender_r (avg) 49.000 -
526.blender_r (avg) (percentage) 0.410 -
526.blender_r (max) 56.000 -
526.blender_r (max) (percentage) 0.470 -
531.deepsjeng_r 46.000 -
531.deepsjeng_r (avg) 46.000 -
531.deepsjeng_r (avg) (percentage) 0.530 -
531.deepsjeng_r (max) 35.000 -
531.deepsjeng_r (max) (percentage) 0.410 -
538.imagick_r 17.000 -
538.imagick_r (avg) 17.000 -
538.imagick_r (avg) (percentage) 0.130 -
538.imagick_r (max) 28.000 -
538.imagick_r (max) (percentage) 0.210 -
541.leela_r 32.000 -
541.leela_r (avg) 32.000 -
541.leela_r (avg) (percentage) 0.250 -
541.leela_r (max) 83.000 -
541.leela_r (max) (percentage) 0.650 -
541.leela_r (unexplained diff vs previous) 84.000 -
541.leela_r (unexplained diff vs previous) (percentage) 0.660 -
544.nab_r 57.000 -
544.nab_r (avg) 57.000 -
544.nab_r (avg) (percentage) 0.400 -
544.nab_r (max) 82.000 -
544.nab_r (max) (percentage) 0.570 -
548.exchange2_r 68.000 -
548.exchange2_r (avg) 68.000 -
548.exchange2_r (avg) (percentage) 0.370 -
548.exchange2_r (max) 88.000 -
548.exchange2_r (max) (percentage) 0.480 -
548.exchange2_r (unexplained diff vs previous) 31.000 -
548.exchange2_r (unexplained diff vs previous) (percentage) 0.170 -
549.fotonik3d_r 219.000 -
549.fotonik3d_r (avg) 219.000 -
549.fotonik3d_r (avg) (percentage) 0.700 -
549.fotonik3d_r (max) 200.000 -
549.fotonik3d_r (max) (percentage) 0.640 -
549.fotonik3d_r (unexplained diff vs previous) 123.000 -
549.fotonik3d_r (unexplained diff vs previous) (percentage) 0.390 -
554.roms_r 18.000 -
554.roms_r (avg) 18.000 -
554.roms_r (avg) (percentage) 0.080 -
554.roms_r (max) 22.000 -
554.roms_r (max) (percentage) 0.100 -
557.xz_r 13.000 -
557.xz_r (avg) 13.000 -
557.xz_r (avg) (percentage) 0.120 -
557.xz_r (max) 12.000 -
557.xz_r (max) (percentage) 0.110 -
Geometric Mean 5.694 -