Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/4675a3261e53edef772932debd8a05eb8ccb61b9 (+ 3044 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_vect-cpu2017rate--llvm-arm-master-O3-build/41/
Filter

llvm-arm-master-O3 test results

Run Order Start Time Duration
Current 0041 (llvmorg-17-init-18085-g4675a3261e53) 2023-06-30T02:11:49 0:00:00
Previous 0032 (llvmorg-17-init-15041-g597f04fe97c8) 2023-06-14T19:45:05 0:00:00
Baseline 0002 (llvmorg-17-init-04550-g890e6c871d31) 2023-03-11T10:55:27 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 11 1
Performance Improvements 10 10
Added Tests 0 72
Unchanged Tests 591 529
Total Tests 612

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
523.xalancbmk_r 4.21% 3989.000 4157.000 - 1.12% -
500.perlbench_r 3.09% 2621.000 2702.000 - 0.00% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
500.perlbench_r 7.69% 13.000 14.000 - 0.00% -
500.perlbench_r (avg) 7.69% 13.000 14.000 - 0.00% -
500.perlbench_r (max) 5.56% 18.000 19.000 - 0.00% -
523.xalancbmk_r (max) 5.13% 39.000 41.000 - 0.00% -
523.xalancbmk_r 3.33% 30.000 31.000 - 0.00% -
523.xalancbmk_r (avg) 3.33% 30.000 31.000 - 0.00% -
520.omnetpp_r 2.27% 44.000 45.000 - 0.00% -
520.omnetpp_r (avg) 2.27% 44.000 45.000 - 0.00% -
520.omnetpp_r (max) 1.19% 84.000 85.000 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
525.x264_r -7.12% 3089.000 2869.000 - -5.84% -
505.mcf_r -2.13% 5497.000 5380.000 - -3.48% -
531.deepsjeng_r -1.09% 5500.000 5440.000 - -1.11% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
525.x264_r -9.09% 22.000 20.000 - 0.00% -
525.x264_r (avg) -9.09% 22.000 20.000 - 0.00% -
525.x264_r (max) -8.33% 24.000 22.000 - 0.00% -
531.deepsjeng_r (max) -4.35% 23.000 22.000 - 0.00% -
505.mcf_r -2.63% 38.000 37.000 - 0.00% -
505.mcf_r (avg) -2.63% 38.000 37.000 - 0.00% -
505.mcf_r (max) -1.96% 102.000 100.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
523.xalancbmk_r 1.12% 4111.000 4157.000 - 4.21% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
525.x264_r -5.84% 3047.000 2869.000 - -7.12% -
520.omnetpp_r -5.18% 3651.000 3462.000 - 0.84% -
505.mcf_r -3.48% 5574.000 5380.000 - -2.13% -
519.lbm_r -3.04% 3682.000 3570.000 - 0.39% -
511.povray_r -2.82% 461.000 448.000 - -0.88% -
557.xz_r -1.81% 2434.000 2390.000 - -0.17% -
502.gcc_r -1.22% 3837.000 3790.000 - 0.64% -
531.deepsjeng_r -1.11% 5501.000 5440.000 - -1.09% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful 7.14% 14.000 15.000 - 0.00% -
nb_execution_successful 7.14% 14.000 15.000 - 0.00% -

Added Tests - Code Size
500.perlbench_r

Added Tests - Execution
500.perlbench_r

Added Tests - sample variability
500.perlbench_r
500.perlbench_r (avg)
500.perlbench_r (avg) (percentage)
500.perlbench_r (max)
500.perlbench_r (max) (percentage)
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)
520.omnetpp_r
520.omnetpp_r (avg)
520.omnetpp_r (avg) (percentage)
520.omnetpp_r (max)
520.omnetpp_r (max) (percentage)
523.xalancbmk_r
523.xalancbmk_r (avg)
523.xalancbmk_r (avg) (percentage)
523.xalancbmk_r (max)
523.xalancbmk_r (max) (percentage)
525.x264_r
525.x264_r (avg)
525.x264_r (avg) (percentage)
525.x264_r (max)
525.x264_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
538.imagick_r
538.imagick_r (avg)
538.imagick_r (avg) (percentage)
538.imagick_r (max)
538.imagick_r (max) (percentage)
541.leela_r
541.leela_r (avg)
541.leela_r (avg) (percentage)
541.leela_r (max)
541.leela_r (max) (percentage)
544.nab_r
544.nab_r (avg)
544.nab_r (avg) (percentage)
544.nab_r (max)
544.nab_r (max) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)


Report Time: 0.22s
Name Current %
500.perlbench_r 2702.000 3.09%
502.gcc_r 3790.000 -
505.mcf_r 5380.000 -2.13%
508.namd_r 3105.000 -
511.povray_r 448.000 -
519.lbm_r 3570.000 -
520.omnetpp_r 3462.000 -
523.xalancbmk_r 4157.000 4.21%
525.x264_r 2869.000 -7.12%
526.blender_r 10592.000 -
531.deepsjeng_r 5440.000 -1.09%
538.imagick_r 3776.000 -
541.leela_r 4689.000 -
544.nab_r 7961.000 -
557.xz_r 2390.000 -
Geometric Mean 3598.049 -
Name Current %
500.perlbench_r 2109648.000 -
502.gcc_r 8915715.000 -
505.mcf_r 30240.000 -
508.namd_r 629020.000 -
511.povray_r 931389.000 -
519.lbm_r 13252.000 -
520.omnetpp_r 1705339.000 -
523.xalancbmk_r 3977092.000 -
525.x264_r 575837.000 -
526.blender_r 10631965.000 -
531.deepsjeng_r 100988.000 -
538.imagick_r 1782736.000 -
541.leela_r 146797.000 -
544.nab_r 189915.000 -
557.xz_r 185623.000 -
Geometric Mean 560839.548 -
Name Current %
500.perlbench_r 14.000 7.69%
500.perlbench_r (avg) 14.000 7.69%
500.perlbench_r (avg) (percentage) 0.530 -
500.perlbench_r (max) 19.000 5.56%
500.perlbench_r (max) (percentage) 0.710 -
505.mcf_r 37.000 -2.63%
505.mcf_r (avg) 37.000 -2.63%
505.mcf_r (avg) (percentage) 0.700 -
505.mcf_r (max) 100.000 -1.96%
505.mcf_r (max) (percentage) 1.860 -
508.namd_r 18.000 -
508.namd_r (avg) 18.000 -
508.namd_r (avg) (percentage) 0.590 -
508.namd_r (max) 29.000 -
508.namd_r (max) (percentage) 0.950 -
511.povray_r 4.000 -
511.povray_r (avg) 4.000 -
511.povray_r (avg) (percentage) 0.960 -
511.povray_r (max) 9.000 -
511.povray_r (max) (percentage) 2.070 -
519.lbm_r 12.000 -
519.lbm_r (avg) 12.000 -
519.lbm_r (avg) (percentage) 0.340 -
519.lbm_r (max) 12.000 -
519.lbm_r (max) (percentage) 0.350 -
520.omnetpp_r 45.000 2.27%
520.omnetpp_r (avg) 45.000 2.27%
520.omnetpp_r (avg) (percentage) 1.300 -
520.omnetpp_r (max) 85.000 1.19%
520.omnetpp_r (max) (percentage) 2.470 -
523.xalancbmk_r 31.000 3.33%
523.xalancbmk_r (avg) 31.000 3.33%
523.xalancbmk_r (avg) (percentage) 0.760 -
523.xalancbmk_r (max) 41.000 5.13%
523.xalancbmk_r (max) (percentage) 1.000 -
525.x264_r 20.000 -9.09%
525.x264_r (avg) 20.000 -9.09%
525.x264_r (avg) (percentage) 0.730 -
525.x264_r (max) 22.000 -8.33%
525.x264_r (max) (percentage) 0.790 -
526.blender_r 62.000 -
526.blender_r (avg) 62.000 -
526.blender_r (avg) (percentage) 0.590 -
526.blender_r (max) 79.000 -
526.blender_r (max) (percentage) 0.750 -
531.deepsjeng_r 21.000 -
531.deepsjeng_r (avg) 21.000 -
531.deepsjeng_r (avg) (percentage) 0.390 -
531.deepsjeng_r (max) 22.000 -4.35%
531.deepsjeng_r (max) (percentage) 0.420 -
538.imagick_r 12.000 -
538.imagick_r (avg) 12.000 -
538.imagick_r (avg) (percentage) 0.340 -
538.imagick_r (max) 21.000 -
538.imagick_r (max) (percentage) 0.570 -
541.leela_r 30.000 -
541.leela_r (avg) 30.000 -
541.leela_r (avg) (percentage) 0.650 -
541.leela_r (max) 42.000 -
541.leela_r (max) (percentage) 0.900 -
544.nab_r 24.000 -
544.nab_r (avg) 24.000 -
544.nab_r (avg) (percentage) 0.310 -
544.nab_r (max) 12.000 -
544.nab_r (max) (percentage) 0.160 -
557.xz_r 22.000 -
557.xz_r (avg) 22.000 -
557.xz_r (avg) (percentage) 0.940 -
557.xz_r (max) 32.000 -
557.xz_r (max) (percentage) 1.340 -
Geometric Mean 5.732 -