Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/a49118a3f452403908abece104e946de8d5d50e1 (+ 266 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_vect-cpu2017rate--llvm-arm-master-O3-build/3/
Filter

llvm-arm-master-O3 test results

Run Order Start Time Duration
Current 0003 (llvmorg-17-init-04816-ga49118a3f452) 2023-03-12T23:59:37 0:00:00
Previous 0002 (llvmorg-17-init-04550-g890e6c871d31) 2023-03-11T10:55:27 0:00:00
No Baseline Run


Tests Summary

Status Group #
Performance Regressions 4
Performance Improvements 2
Added Tests 61
Unchanged Tests 485
Total Tests 552

Performance Regressions - Execution Δ Previous Current σ
505.mcf_r 1.97% 5574.000 5684.000 -
508.namd_r 1.56% 3085.000 3133.000 -
502.gcc_r 1.36% 3837.000 3889.000 -
520.omnetpp_r 1.29% 3651.000 3698.000 -

Performance Improvements - Score Δ Previous Current σ
nb_compile_successful 7.14% 14.000 15.000 -
nb_execution_successful 7.14% 14.000 15.000 -

Added Tests - Code Size
500.perlbench_r

Added Tests - Execution
500.perlbench_r

Added Tests - sample variability
505.mcf_r (max)
505.mcf_r (max) (percentage)
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)
520.omnetpp_r
520.omnetpp_r (avg)
520.omnetpp_r (avg) (percentage)
520.omnetpp_r (max)
520.omnetpp_r (max) (percentage)
523.xalancbmk_r
523.xalancbmk_r (avg)
523.xalancbmk_r (avg) (percentage)
523.xalancbmk_r (max)
523.xalancbmk_r (max) (percentage)
525.x264_r
525.x264_r (avg)
525.x264_r (avg) (percentage)
525.x264_r (max)
525.x264_r (max) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
538.imagick_r
538.imagick_r (avg)
538.imagick_r (avg) (percentage)
538.imagick_r (max)
538.imagick_r (max) (percentage)
541.leela_r
541.leela_r (avg)
541.leela_r (avg) (percentage)
541.leela_r (max)
541.leela_r (max) (percentage)
544.nab_r
544.nab_r (avg)
544.nab_r (avg) (percentage)
544.nab_r (max)
544.nab_r (max) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)


Report Time: 0.22s
Name Current %
500.perlbench_r 2800.000 -
502.gcc_r 3889.000 1.36%
505.mcf_r 5684.000 1.97%
508.namd_r 3133.000 1.56%
511.povray_r 460.000 -
519.lbm_r 3714.000 -
520.omnetpp_r 3698.000 1.29%
523.xalancbmk_r 4093.000 -
525.x264_r 3055.000 -
526.blender_r 10631.000 -
531.deepsjeng_r 5509.000 -
538.imagick_r 3827.000 -
541.leela_r 4725.000 -
544.nab_r 7971.000 -
557.xz_r 2449.000 -
Geometric Mean 3687.307 -1.31%
Name Current %
500.perlbench_r 2128280.000 -
502.gcc_r 8913059.000 -
505.mcf_r 30280.000 -
508.namd_r 627440.000 -
511.povray_r 932849.000 -
519.lbm_r 13236.000 -
520.omnetpp_r 1696973.000 -
523.xalancbmk_r 3958572.000 -
525.x264_r 579269.000 -
526.blender_r 10626421.000 -
531.deepsjeng_r 100276.000 -
538.imagick_r 1789936.000 -
541.leela_r 146749.000 -
544.nab_r 191383.000 -
557.xz_r 184807.000 -
Geometric Mean 560967.365 9.98%
Name Current %
nb_compile_successful 15.000 7.14%
nb_execution_successful 15.000 7.14%
nb_total_tests 15.000 -
Geometric Mean 15.000 4.71%
Name Current %
505.mcf_r (max) 0.000 -
505.mcf_r (max) (percentage) 0.000 -
508.namd_r 48.000 -
508.namd_r (avg) 48.000 -
508.namd_r (avg) (percentage) 1.560 -
508.namd_r (max) 48.000 -
508.namd_r (max) (percentage) 1.560 -
508.namd_r (unexplained diff vs previous) 48.000 -
508.namd_r (unexplained diff vs previous) (percentage) 1.530 -
511.povray_r 1.000 -
511.povray_r (avg) 1.000 -
511.povray_r (avg) (percentage) 0.220 -
511.povray_r (max) 1.000 -
511.povray_r (max) (percentage) 0.220 -
511.povray_r (unexplained diff vs previous) 1.000 -
511.povray_r (unexplained diff vs previous) (percentage) 0.220 -
519.lbm_r 32.000 -
519.lbm_r (avg) 32.000 -
519.lbm_r (avg) (percentage) 0.870 -
519.lbm_r (max) 32.000 -
519.lbm_r (max) (percentage) 0.870 -
519.lbm_r (unexplained diff vs previous) 32.000 -
519.lbm_r (unexplained diff vs previous) (percentage) 0.860 -
520.omnetpp_r 47.000 -
520.omnetpp_r (avg) 47.000 -
520.omnetpp_r (avg) (percentage) 1.290 -
520.omnetpp_r (max) 47.000 -
520.omnetpp_r (max) (percentage) 1.290 -
520.omnetpp_r (unexplained diff vs previous) 47.000 -
520.omnetpp_r (unexplained diff vs previous) (percentage) 1.270 -
523.xalancbmk_r 18.000 -
523.xalancbmk_r (avg) 18.000 -
523.xalancbmk_r (avg) (percentage) 0.440 -
523.xalancbmk_r (max) 18.000 -
523.xalancbmk_r (max) (percentage) 0.440 -
523.xalancbmk_r (unexplained diff vs previous) 18.000 -
523.xalancbmk_r (unexplained diff vs previous) (percentage) 0.440 -
525.x264_r 7.000 -
525.x264_r (avg) 7.000 -
525.x264_r (avg) (percentage) 0.260 -
525.x264_r (max) 7.000 -
525.x264_r (max) (percentage) 0.260 -
525.x264_r (unexplained diff vs previous) 8.000 -
525.x264_r (unexplained diff vs previous) (percentage) 0.260 -
526.blender_r (max) 0.000 -
526.blender_r (max) (percentage) 0.000 -
531.deepsjeng_r 8.000 -
531.deepsjeng_r (avg) 8.000 -
531.deepsjeng_r (avg) (percentage) 0.150 -
531.deepsjeng_r (max) 8.000 -
531.deepsjeng_r (max) (percentage) 0.150 -
531.deepsjeng_r (unexplained diff vs previous) 8.000 -
531.deepsjeng_r (unexplained diff vs previous) (percentage) 0.150 -
538.imagick_r 22.000 -
538.imagick_r (avg) 22.000 -
538.imagick_r (avg) (percentage) 0.580 -
538.imagick_r (max) 22.000 -
538.imagick_r (max) (percentage) 0.580 -
538.imagick_r (unexplained diff vs previous) 22.000 -
538.imagick_r (unexplained diff vs previous) (percentage) 0.570 -
541.leela_r 25.000 -
541.leela_r (avg) 25.000 -
541.leela_r (avg) (percentage) 0.550 -
541.leela_r (max) 25.000 -
541.leela_r (max) (percentage) 0.550 -
541.leela_r (unexplained diff vs previous) 26.000 -
541.leela_r (unexplained diff vs previous) (percentage) 0.550 -
544.nab_r 8.000 -
544.nab_r (avg) 8.000 -
544.nab_r (avg) (percentage) 0.110 -
544.nab_r (max) 8.000 -
544.nab_r (max) (percentage) 0.110 -
544.nab_r (unexplained diff vs previous) 9.000 -
544.nab_r (unexplained diff vs previous) (percentage) 0.110 -
557.xz_r 15.000 -
557.xz_r (avg) 15.000 -
557.xz_r (avg) (percentage) 0.620 -
557.xz_r (max) 15.000 -
557.xz_r (max) (percentage) 0.620 -
557.xz_r (unexplained diff vs previous) 15.000 -
557.xz_r (unexplained diff vs previous) (percentage) 0.610 -
Geometric Mean 1.939 -2384526526506630381568.00%