Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/775451b66a4c726f1c3925f74be8cefcb308e4f8 (+ 1 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-cpu2017rate--llvm-aarch64-master-O3_LTO-build/13/
Filter

llvm-aarch64-master-O3_LTO test results

Run Order Start Time Duration
Current 0013 (llvmorg-17-init-04666-g775451b66a4c) 2023-03-13T00:56:00 0:00:00
Previous 0013 (llvmorg-17-init-04666-g775451b66a4c) 2023-03-13T00:56:00 0:00:00
Baseline 0002 (llvmorg-17-init-03371-gabafc869cb65) 2023-02-28T01:39:50 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 0 2
Performance Improvements 0 5
Added Tests 0 116
Unchanged Tests 840 717
Total Tests 840

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
526.blender_r 2.54% 12169.000 12478.000 - 0.00% -
511.povray_r 1.11% 19555.000 19772.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
557.xz_r -1.12% 11563.000 11434.000 - 0.00% -
502.gcc_r -1.10% 10311.000 10198.000 - 0.00% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 43.75% 16.000 23.000 - 0.00% -
nb_compile_successful 37.50% 16.000 22.000 - 0.00% -
nb_execution_successful 37.50% 16.000 22.000 - 0.00% -

Added Tests - Code Size
503.bwaves_r
507.cactuBSSN_r
521.wrf_r
548.exchange2_r
549.fotonik3d_r
554.roms_r

Added Tests - Execution
503.bwaves_r
507.cactuBSSN_r
521.wrf_r
548.exchange2_r
549.fotonik3d_r
554.roms_r

Added Tests - sample variability
500.perlbench_r
500.perlbench_r (avg)
500.perlbench_r (avg) (percentage)
500.perlbench_r (max)
500.perlbench_r (max) (percentage)
503.bwaves_r
503.bwaves_r (avg)
503.bwaves_r (avg) (percentage)
503.bwaves_r (max)
503.bwaves_r (max) (percentage)
503.bwaves_r (unexplained diff vs previous)
503.bwaves_r (unexplained diff vs previous) (percentage)
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)
520.omnetpp_r
520.omnetpp_r (avg)
520.omnetpp_r (avg) (percentage)
520.omnetpp_r (max)
520.omnetpp_r (max) (percentage)
521.wrf_r
521.wrf_r (avg)
521.wrf_r (avg) (percentage)
521.wrf_r (max)
521.wrf_r (max) (percentage)
523.xalancbmk_r
523.xalancbmk_r (avg)
523.xalancbmk_r (avg) (percentage)
523.xalancbmk_r (max)
523.xalancbmk_r (max) (percentage)
525.x264_r
525.x264_r (avg)
525.x264_r (avg) (percentage)
525.x264_r (max)
525.x264_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
538.imagick_r
538.imagick_r (avg)
538.imagick_r (avg) (percentage)
538.imagick_r (max)
538.imagick_r (max) (percentage)
541.leela_r
541.leela_r (avg)
541.leela_r (avg) (percentage)
541.leela_r (max)
541.leela_r (max) (percentage)
544.nab_r
544.nab_r (avg)
544.nab_r (avg) (percentage)
544.nab_r (max)
544.nab_r (max) (percentage)
548.exchange2_r
548.exchange2_r (avg)
548.exchange2_r (avg) (percentage)
548.exchange2_r (max)
548.exchange2_r (max) (percentage)
549.fotonik3d_r
549.fotonik3d_r (avg)
549.fotonik3d_r (avg) (percentage)
549.fotonik3d_r (max)
549.fotonik3d_r (max) (percentage)
549.fotonik3d_r (unexplained diff vs previous)
549.fotonik3d_r (unexplained diff vs previous) (percentage)
554.roms_r
554.roms_r (avg)
554.roms_r (avg) (percentage)
554.roms_r (max)
554.roms_r (max) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)


Report Time: 0.23s
Name Current %
500.perlbench_r 15238.000 -
502.gcc_r 10198.000 -
503.bwaves_r 21281.000 -
505.mcf_r 12135.000 -
507.cactuBSSN_r 11362.000 -
508.namd_r 9477.000 -
510.parest_r 22650.000 -
511.povray_r 19772.000 -
519.lbm_r 17232.000 -
520.omnetpp_r 13956.000 -
521.wrf_r 14647.000 -
523.xalancbmk_r 13126.000 -
525.x264_r 5770.000 -
526.blender_r 12478.000 -
531.deepsjeng_r 7507.000 -
538.imagick_r 13634.000 -
541.leela_r 11158.000 -
544.nab_r 13275.000 -
548.exchange2_r 18425.000 -
549.fotonik3d_r 33195.000 -
554.roms_r 22928.000 -
557.xz_r 11434.000 -
Geometric Mean 13970.661 -
Name Current %
500.perlbench_r 2572018.000 -
502.gcc_r 10934599.000 -
503.bwaves_r 773135.000 -
505.mcf_r 22855.000 -
507.cactuBSSN_r 3634929.000 -
508.namd_r 471412.000 -
510.parest_r 2023269.000 -
511.povray_r 1147273.000 -
519.lbm_r 11139.000 -
520.omnetpp_r 2060178.000 -
521.wrf_r 16955406.000 -
523.xalancbmk_r 4117218.000 -
525.x264_r 606990.000 -
526.blender_r 16415900.000 -
531.deepsjeng_r 91335.000 -
538.imagick_r 1275756.000 -
541.leela_r 90021.000 -
544.nab_r 88347.000 -
548.exchange2_r 2561111.000 -
549.fotonik3d_r 1198570.000 -
554.roms_r 2784586.000 -
557.xz_r 134084.000 -
Geometric Mean 856966.943 -
Name Current %
500.perlbench_r 181.000 -
500.perlbench_r (avg) 181.000 -
500.perlbench_r (avg) (percentage) 1.190 -
500.perlbench_r (max) 135.000 -
500.perlbench_r (max) (percentage) 0.890 -
503.bwaves_r 14.000 -
503.bwaves_r (avg) 14.000 -
503.bwaves_r (avg) (percentage) 0.070 -
503.bwaves_r (max) 23.000 -
503.bwaves_r (max) (percentage) 0.110 -
503.bwaves_r (unexplained diff vs previous) 15.000 -
503.bwaves_r (unexplained diff vs previous) (percentage) 0.070 -
505.mcf_r 18.000 -
505.mcf_r (avg) 18.000 -
505.mcf_r (avg) (percentage) 0.150 -
505.mcf_r (max) 25.000 -
505.mcf_r (max) (percentage) 0.210 -
505.mcf_r (unexplained diff vs previous) 25.000 -
505.mcf_r (unexplained diff vs previous) (percentage) 0.210 -
508.namd_r 4.000 -
508.namd_r (avg) 4.000 -
508.namd_r (avg) (percentage) 0.050 -
508.namd_r (max) 11.000 -
508.namd_r (max) (percentage) 0.120 -
510.parest_r 43.000 -
510.parest_r (avg) 43.000 -
510.parest_r (avg) (percentage) 0.190 -
510.parest_r (max) 52.000 -
510.parest_r (max) (percentage) 0.230 -
511.povray_r 43.000 -
511.povray_r (avg) 43.000 -
511.povray_r (avg) (percentage) 0.220 -
511.povray_r (max) 39.000 -
511.povray_r (max) (percentage) 0.200 -
519.lbm_r 25.000 -
519.lbm_r (avg) 25.000 -
519.lbm_r (avg) (percentage) 0.150 -
519.lbm_r (max) 55.000 -
519.lbm_r (max) (percentage) 0.320 -
519.lbm_r (unexplained diff vs previous) 4.000 -
519.lbm_r (unexplained diff vs previous) (percentage) 0.020 -
520.omnetpp_r 133.000 -
520.omnetpp_r (avg) 133.000 -
520.omnetpp_r (avg) (percentage) 0.960 -
520.omnetpp_r (max) 108.000 -
520.omnetpp_r (max) (percentage) 0.780 -
521.wrf_r 421.000 -
521.wrf_r (avg) 421.000 -
521.wrf_r (avg) (percentage) 2.880 -
521.wrf_r (max) 342.000 -
521.wrf_r (max) (percentage) 2.340 -
523.xalancbmk_r 11.000 -
523.xalancbmk_r (avg) 11.000 -
523.xalancbmk_r (avg) (percentage) 0.090 -
523.xalancbmk_r (max) 23.000 -
523.xalancbmk_r (max) (percentage) 0.180 -
525.x264_r 8.000 -
525.x264_r (avg) 8.000 -
525.x264_r (avg) (percentage) 0.140 -
525.x264_r (max) 16.000 -
525.x264_r (max) (percentage) 0.290 -
525.x264_r (unexplained diff vs previous) 6.000 -
525.x264_r (unexplained diff vs previous) (percentage) 0.100 -
526.blender_r 43.000 -
526.blender_r (avg) 43.000 -
526.blender_r (avg) (percentage) 0.350 -
526.blender_r (max) 32.000 -
526.blender_r (max) (percentage) 0.260 -
531.deepsjeng_r 37.000 -
531.deepsjeng_r (avg) 37.000 -
531.deepsjeng_r (avg) (percentage) 0.500 -
531.deepsjeng_r (max) 38.000 -
531.deepsjeng_r (max) (percentage) 0.510 -
531.deepsjeng_r (unexplained diff vs previous) 23.000 -
531.deepsjeng_r (unexplained diff vs previous) (percentage) 0.310 -
538.imagick_r 25.000 -
538.imagick_r (avg) 25.000 -
538.imagick_r (avg) (percentage) 0.190 -
538.imagick_r (max) 49.000 -
538.imagick_r (max) (percentage) 0.360 -
541.leela_r 22.000 -
541.leela_r (avg) 22.000 -
541.leela_r (avg) (percentage) 0.200 -
541.leela_r (max) 36.000 -
541.leela_r (max) (percentage) 0.330 -
544.nab_r 29.000 -
544.nab_r (avg) 29.000 -
544.nab_r (avg) (percentage) 0.220 -
544.nab_r (max) 35.000 -
544.nab_r (max) (percentage) 0.270 -
544.nab_r (unexplained diff vs previous) 7.000 -
544.nab_r (unexplained diff vs previous) (percentage) 0.050 -
548.exchange2_r 62.000 -
548.exchange2_r (avg) 62.000 -
548.exchange2_r (avg) (percentage) 0.340 -
548.exchange2_r (max) 51.000 -
548.exchange2_r (max) (percentage) 0.280 -
549.fotonik3d_r 139.000 -
549.fotonik3d_r (avg) 139.000 -
549.fotonik3d_r (avg) (percentage) 0.420 -
549.fotonik3d_r (max) 192.000 -
549.fotonik3d_r (max) (percentage) 0.580 -
549.fotonik3d_r (unexplained diff vs previous) 165.000 -
549.fotonik3d_r (unexplained diff vs previous) (percentage) 0.500 -
554.roms_r 52.000 -
554.roms_r (avg) 52.000 -
554.roms_r (avg) (percentage) 0.230 -
554.roms_r (max) 73.000 -
554.roms_r (max) (percentage) 0.320 -
557.xz_r 12.000 -
557.xz_r (avg) 12.000 -
557.xz_r (avg) (percentage) 0.110 -
557.xz_r (max) 16.000 -
557.xz_r (max) (percentage) 0.140 -
Geometric Mean 4.475 -