Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/08b9835072c0b2c50cf3be9d6182bc89f64ae51d (+ 669 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_vect-cpu2017rate--llvm-arm-master-O3_LTO-build/3/
Filter

llvm-arm-master-O3_LTO test results

Run Order Start Time Duration
Current 0003 (llvmorg-17-init-05079-g08b9835072c0) 2023-03-13T03:52:41 0:00:00
Previous 0001 (llvmorg-17-init-04410-g1b5a60511234) 2023-03-10T04:03:31 0:00:00
No Baseline Run


Tests Summary

Status Group #
Performance Regressions 3
Performance Improvements 7
Added Tests 51
Unchanged Tests 473
Total Tests 534

Performance Regressions - Execution Δ Previous Current σ
523.xalancbmk_r 4.40% 3252.000 3395.000 -
500.perlbench_r 3.99% 2281.000 2372.000 -
541.leela_r 2.06% 4023.000 4106.000 -

Performance Improvements - Execution Δ Previous Current σ
519.lbm_r -4.08% 3725.000 3573.000 -
557.xz_r -3.21% 2365.000 2289.000 -
520.omnetpp_r -3.07% 3352.000 3249.000 -
505.mcf_r -3.00% 5296.000 5137.000 -
510.parest_r -2.07% 5901.000 5779.000 -

Performance Improvements - Score Δ Previous Current σ
nb_execution_successful 7.14% 14.000 15.000 -
nb_compile_successful 6.67% 15.000 16.000 -

Added Tests - Code Size
526.blender_r

Added Tests - Execution
526.blender_r

Added Tests - sample variability
500.perlbench_r (max)
500.perlbench_r (max) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)
520.omnetpp_r (max)
520.omnetpp_r (max) (percentage)
523.xalancbmk_r (max)
523.xalancbmk_r (max) (percentage)
525.x264_r
525.x264_r (avg)
525.x264_r (avg) (percentage)
525.x264_r (max)
525.x264_r (max) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
538.imagick_r
538.imagick_r (avg)
538.imagick_r (avg) (percentage)
538.imagick_r (max)
538.imagick_r (max) (percentage)
541.leela_r
541.leela_r (avg)
541.leela_r (avg) (percentage)
541.leela_r (max)
541.leela_r (max) (percentage)
544.nab_r
544.nab_r (avg)
544.nab_r (avg) (percentage)
544.nab_r (max)
544.nab_r (max) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)


Report Time: 0.29s
Name Current %
500.perlbench_r 2372.000 3.99%
505.mcf_r 5137.000 -3.00%
508.namd_r 3090.000 -
510.parest_r 5779.000 -2.07%
511.povray_r 415.000 -
519.lbm_r 3573.000 -4.08%
520.omnetpp_r 3249.000 -3.07%
523.xalancbmk_r 3395.000 4.40%
525.x264_r 3038.000 -
526.blender_r 10543.000 -
531.deepsjeng_r 5324.000 -
538.imagick_r 3789.000 -
541.leela_r 4106.000 2.06%
544.nab_r 7355.000 -
557.xz_r 2289.000 -3.21%
Geometric Mean 3521.691 7.66%
Name Current %
500.perlbench_r 2535093.000 -
505.mcf_r 27672.000 -
508.namd_r 494036.000 -
510.parest_r 1829785.000 -
511.povray_r 1164543.000 -
519.lbm_r 11062.000 -
520.omnetpp_r 1659905.000 -
523.xalancbmk_r 3649170.000 -
525.x264_r 607898.000 -
526.blender_r 13684589.000 -
531.deepsjeng_r 111064.000 -
538.imagick_r 1322391.000 -
541.leela_r 94191.000 -
544.nab_r 86308.000 -
557.xz_r 138479.000 -
Geometric Mean 452404.217 27.48%
Name Current %
nb_compile_successful 16.000 6.67%
nb_execution_successful 15.000 7.14%
nb_total_tests 16.000 -
Geometric Mean 15.659 4.55%
Name Current %
500.perlbench_r (max) 0.000 -
500.perlbench_r (max) (percentage) 0.000 -
505.mcf_r (max) 0.000 -
505.mcf_r (max) (percentage) 0.000 -
508.namd_r 8.000 -
508.namd_r (avg) 8.000 -
508.namd_r (avg) (percentage) 0.260 -
508.namd_r (max) 8.000 -
508.namd_r (max) (percentage) 0.260 -
508.namd_r (unexplained diff vs previous) 8.000 -
508.namd_r (unexplained diff vs previous) (percentage) 0.260 -
510.parest_r (max) 0.000 -
510.parest_r (max) (percentage) 0.000 -
511.povray_r (max) 0.000 -
511.povray_r (max) (percentage) 0.000 -
519.lbm_r 145.000 -
519.lbm_r (avg) 145.000 -
519.lbm_r (avg) (percentage) 4.080 -
519.lbm_r (max) 145.000 -
519.lbm_r (max) (percentage) 4.080 -
519.lbm_r (unexplained diff vs previous) 152.000 -
519.lbm_r (unexplained diff vs previous) (percentage) 4.250 -
520.omnetpp_r (max) 0.000 -
520.omnetpp_r (max) (percentage) 0.000 -
523.xalancbmk_r (max) 0.000 -
523.xalancbmk_r (max) (percentage) 0.000 -
525.x264_r 7.000 -
525.x264_r (avg) 7.000 -
525.x264_r (avg) (percentage) 0.260 -
525.x264_r (max) 7.000 -
525.x264_r (max) (percentage) 0.260 -
525.x264_r (unexplained diff vs previous) 8.000 -
525.x264_r (unexplained diff vs previous) (percentage) 0.260 -
531.deepsjeng_r (max) 0.000 -
531.deepsjeng_r (max) (percentage) 0.000 -
538.imagick_r 32.000 -
538.imagick_r (avg) 32.000 -
538.imagick_r (avg) (percentage) 0.860 -
538.imagick_r (max) 32.000 -
538.imagick_r (max) (percentage) 0.860 -
538.imagick_r (unexplained diff vs previous) 33.000 -
538.imagick_r (unexplained diff vs previous) (percentage) 0.870 -
541.leela_r 84.000 -
541.leela_r (avg) 84.000 -
541.leela_r (avg) (percentage) 2.060 -
541.leela_r (max) 84.000 -
541.leela_r (max) (percentage) 2.060 -
541.leela_r (unexplained diff vs previous) 83.000 -
541.leela_r (unexplained diff vs previous) (percentage) 2.020 -
544.nab_r 62.000 -
544.nab_r (avg) 62.000 -
544.nab_r (avg) (percentage) 0.850 -
544.nab_r (max) 62.000 -
544.nab_r (max) (percentage) 0.850 -
544.nab_r (unexplained diff vs previous) 62.000 -
544.nab_r (unexplained diff vs previous) (percentage) 0.840 -
557.xz_r 73.000 -
557.xz_r (avg) 73.000 -
557.xz_r (avg) (percentage) 3.210 -
557.xz_r (max) 73.000 -
557.xz_r (max) (percentage) 3.210 -
557.xz_r (unexplained diff vs previous) 76.000 -
557.xz_r (unexplained diff vs previous) (percentage) 3.320 -
Geometric Mean 0.656 322856998694220922880.00%