Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/2f38604c792a6cfc22eedbe76f8ade5a13304f8d (+ 3169 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_vect-cpu2017rate--llvm-arm-master-O3_LTO-build/45/
Filter

llvm-arm-master-O3_LTO test results

Run Order Start Time Duration
Current 0045 (llvmorg-17-init-18114-g2f38604c792a) 2023-06-25T18:11:13 0:00:00
Previous 0035 (llvmorg-17-init-14945-g501405f1d5f0) 2023-06-05T12:01:34 0:00:00
Baseline 0001 (llvmorg-17-init-04410-g1b5a60511234) 2023-03-10T04:03:31 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 4 2
Performance Improvements 17 12
Added Tests 0 77
Unchanged Tests 633 563
Total Tests 654

Performance Regressions - Code Size Δ Previous Current σ Δ (B) σ (B)
531.deepsjeng_r 3.74% 111904.000 116092.000 - 4.53% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
519.lbm_r (max) 4.35% 23.000 24.000 - 0.00% -
508.namd_r (max) 2.38% 42.000 43.000 - 0.00% -
505.mcf_r (max) 1.56% 64.000 65.000 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
525.x264_r -7.92% 3005.000 2767.000 - -9.16% -
523.xalancbmk_r -5.33% 3432.000 3249.000 - -0.09% -
500.perlbench_r -2.16% 2270.000 2221.000 - -2.63% -
541.leela_r -1.69% 4031.000 3963.000 - -1.49% -
520.omnetpp_r -1.05% 3244.000 3210.000 - -4.24% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
525.x264_r -8.70% 46.000 42.000 - 0.00% -
525.x264_r (avg) -8.70% 46.000 42.000 - 0.00% -
525.x264_r (max) -8.24% 85.000 78.000 - 0.00% -
523.xalancbmk_r -4.76% 21.000 20.000 - 0.00% -
523.xalancbmk_r (avg) -4.76% 21.000 20.000 - 0.00% -
523.xalancbmk_r (max) -4.76% 42.000 40.000 - 0.00% -
541.leela_r -3.57% 28.000 27.000 - 0.00% -
541.leela_r (avg) -3.57% 28.000 27.000 - 0.00% -
500.perlbench_r -3.33% 60.000 58.000 - 0.00% -
500.perlbench_r (avg) -3.33% 60.000 58.000 - 0.00% -
500.perlbench_r (max) -2.17% 46.000 45.000 - 0.00% -
520.omnetpp_r (max) -1.35% 74.000 73.000 - 0.00% -

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
531.deepsjeng_r 4.53% 111064.000 116092.000 - 3.74% -
557.xz_r 1.69% 138527.000 140867.000 - -0.25% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
544.nab_r -1.65% 86308.000 84880.000 - -0.66% -
500.perlbench_r -1.10% 2553730.000 2525741.000 - 0.15% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
525.x264_r -9.16% 3046.000 2767.000 - -7.92% -
520.omnetpp_r -4.24% 3352.000 3210.000 - -1.05% -
519.lbm_r -3.22% 3725.000 3605.000 - 0.87% -
505.mcf_r -2.87% 5296.000 5144.000 - 0.80% -
500.perlbench_r -2.63% 2281.000 2221.000 - -2.16% -
510.parest_r -1.85% 5901.000 5792.000 - -0.05% -
541.leela_r -1.49% 4023.000 3963.000 - -1.69% -
557.xz_r -1.23% 2365.000 2336.000 - 0.34% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_execution_successful 7.14% 14.000 15.000 - 0.00% -
nb_compile_successful 6.67% 15.000 16.000 - 0.00% -

Added Tests - Code Size
526.blender_r

Added Tests - Execution
526.blender_r

Added Tests - sample variability
500.perlbench_r
500.perlbench_r (avg)
500.perlbench_r (avg) (percentage)
500.perlbench_r (max)
500.perlbench_r (max) (percentage)
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)
520.omnetpp_r
520.omnetpp_r (avg)
520.omnetpp_r (avg) (percentage)
520.omnetpp_r (max)
520.omnetpp_r (max) (percentage)
523.xalancbmk_r
523.xalancbmk_r (avg)
523.xalancbmk_r (avg) (percentage)
523.xalancbmk_r (max)
523.xalancbmk_r (max) (percentage)
525.x264_r
525.x264_r (avg)
525.x264_r (avg) (percentage)
525.x264_r (max)
525.x264_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
538.imagick_r
538.imagick_r (avg)
538.imagick_r (avg) (percentage)
538.imagick_r (max)
538.imagick_r (max) (percentage)
541.leela_r
541.leela_r (avg)
541.leela_r (avg) (percentage)
541.leela_r (max)
541.leela_r (max) (percentage)
544.nab_r
544.nab_r (avg)
544.nab_r (avg) (percentage)
544.nab_r (max)
544.nab_r (max) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)


Report Time: 0.22s
Name Current %
500.perlbench_r 2221.000 -2.16%
505.mcf_r 5144.000 -
508.namd_r 3098.000 -
510.parest_r 5792.000 -
511.povray_r 417.000 -
519.lbm_r 3605.000 -
520.omnetpp_r 3210.000 -1.05%
523.xalancbmk_r 3249.000 -5.33%
525.x264_r 2767.000 -7.92%
526.blender_r 10506.000 -
531.deepsjeng_r 5318.000 -
538.imagick_r 3798.000 -
541.leela_r 3963.000 -1.69%
544.nab_r 7336.000 -
557.xz_r 2336.000 -
Geometric Mean 3471.502 -1.02%
Name Current %
500.perlbench_r 2525741.000 -
505.mcf_r 27604.000 -
508.namd_r 495268.000 -
510.parest_r 1828781.000 -
511.povray_r 1161239.000 -
519.lbm_r 11090.000 -
520.omnetpp_r 1671047.000 -
523.xalancbmk_r 3643634.000 -
525.x264_r 602914.000 -
526.blender_r 13704689.000 -
531.deepsjeng_r 116092.000 3.74%
538.imagick_r 1322759.000 -
541.leela_r 94003.000 -
544.nab_r 84880.000 -
557.xz_r 140867.000 -
Geometric Mean 453516.981 -
Name Current %
500.perlbench_r 58.000 -3.33%
500.perlbench_r (avg) 58.000 -3.33%
500.perlbench_r (avg) (percentage) 2.650 -
500.perlbench_r (max) 45.000 -2.17%
500.perlbench_r (max) (percentage) 2.030 -
505.mcf_r 40.000 -
505.mcf_r (avg) 40.000 -
505.mcf_r (avg) (percentage) 0.790 -
505.mcf_r (max) 65.000 1.56%
505.mcf_r (max) (percentage) 1.270 -
508.namd_r 15.000 -
508.namd_r (avg) 15.000 -
508.namd_r (avg) (percentage) 0.490 -
508.namd_r (max) 43.000 2.38%
508.namd_r (max) (percentage) 1.390 -
510.parest_r 60.000 -
510.parest_r (avg) 60.000 -
510.parest_r (avg) (percentage) 1.040 -
510.parest_r (max) 321.000 -
510.parest_r (max) (percentage) 5.550 -
511.povray_r 3.000 -
511.povray_r (avg) 3.000 -
511.povray_r (avg) (percentage) 0.770 -
511.povray_r (max) 4.000 -
511.povray_r (max) (percentage) 1.080 -
519.lbm_r 17.000 -
519.lbm_r (avg) 17.000 -
519.lbm_r (avg) (percentage) 0.490 -
519.lbm_r (max) 24.000 4.35%
519.lbm_r (max) (percentage) 0.670 -
520.omnetpp_r 56.000 -
520.omnetpp_r (avg) 56.000 -
520.omnetpp_r (avg) (percentage) 1.750 -
520.omnetpp_r (max) 73.000 -1.35%
520.omnetpp_r (max) (percentage) 2.300 -
523.xalancbmk_r 20.000 -4.76%
523.xalancbmk_r (avg) 20.000 -4.76%
523.xalancbmk_r (avg) (percentage) 0.630 -
523.xalancbmk_r (max) 40.000 -4.76%
523.xalancbmk_r (max) (percentage) 1.250 -
525.x264_r 42.000 -8.70%
525.x264_r (avg) 42.000 -8.70%
525.x264_r (avg) (percentage) 1.540 -
525.x264_r (max) 78.000 -8.24%
525.x264_r (max) (percentage) 2.840 -
526.blender_r 56.000 -
526.blender_r (avg) 56.000 -
526.blender_r (avg) (percentage) 0.540 -
526.blender_r (max) 143.000 -
526.blender_r (max) (percentage) 1.370 -
531.deepsjeng_r 11.000 -
531.deepsjeng_r (avg) 11.000 -
531.deepsjeng_r (avg) (percentage) 0.210 -
531.deepsjeng_r (max) 18.000 -
531.deepsjeng_r (max) (percentage) 0.340 -
538.imagick_r 7.000 -
538.imagick_r (avg) 7.000 -
538.imagick_r (avg) (percentage) 0.200 -
538.imagick_r (max) 15.000 -
538.imagick_r (max) (percentage) 0.420 -
541.leela_r 27.000 -3.57%
541.leela_r (avg) 27.000 -3.57%
541.leela_r (avg) (percentage) 0.700 -
541.leela_r (max) 35.000 -
541.leela_r (max) (percentage) 0.890 -
544.nab_r 33.000 -
544.nab_r (avg) 33.000 -
544.nab_r (avg) (percentage) 0.460 -
544.nab_r (max) 38.000 -
544.nab_r (max) (percentage) 0.530 -
557.xz_r 33.000 -
557.xz_r (avg) 33.000 -
557.xz_r (avg) (percentage) 1.450 -
557.xz_r (max) 23.000 -
557.xz_r (max) (percentage) 1.000 -
Geometric Mean 7.249 -