Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/f061a395ffb78215a23e0f503e8ea121ee3b13ad (+ 20370 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-cpu2017rate--llvm-arm-master-O2_LTO-build/173/
Filter

llvm-arm-master-O2_LTO test results

Run Order Start Time Duration
Current 0173 (llvmorg-19-init-09943-gf061a395ffb7) 2024-01-15T08:10:10 0:00:00
Previous 0168 (llvmorg-18-init-07933-ge13bed4c5f35) 2023-09-30T21:57:19 0:00:00
Baseline 0015 (llvmorg-17-init-07395-g3283a6fb0df3) 2023-04-07T14:40:57 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 1 1
Performance Improvements 27 4
Added Tests 0 86
Unchanged Tests 410 347
Total Tests 438

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
538.imagick_r 1.16% 13825.000 13986.000 - 0.00% -

Performance Improvements - Code Size Δ Previous Current σ Δ (B) σ (B)
505.mcf_r -2.96% 27148.000 26344.000 - 2.17% -
525.x264_r -1.39% 535254.000 527790.000 - 0.00% -
538.imagick_r -1.12% 1269987.000 1255819.000 - 0.00% -
508.namd_r -1.10% 512331.000 506671.000 - 0.00% -
502.gcc_r -1.07% 10285875.000 10175739.000 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
523.xalancbmk_r -3.32% 9271.000 8963.000 - 0.00% -
531.deepsjeng_r -1.64% 12181.000 11981.000 - 0.17% -
525.x264_r -1.21% 9720.000 9602.000 - 0.00% -
541.leela_r -1.00% 9894.000 9795.000 - 0.00% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
531.deepsjeng_r (max) -11.54% 26.000 23.000 - 0.00% -
531.deepsjeng_r (max) (percentage) -9.09% 0.220 0.200 - 0.00% -
525.x264_r (max) -6.67% 30.000 28.000 - 0.00% -
541.leela_r (max) -6.67% 15.000 14.000 - 0.00% -
541.leela_r (max) (percentage) -6.25% 0.160 0.150 - 0.00% -
544.nab_r (max) -6.25% 48.000 45.000 - 0.00% -
505.mcf_r (max) -5.26% 38.000 36.000 - 0.00% -
544.nab_r (max) (percentage) -4.65% 0.430 0.410 - 0.00% -
520.omnetpp_r (max) -3.81% 105.000 101.000 - 0.00% -
511.povray_r (max) (percentage) -3.70% 0.270 0.260 - 0.00% -
520.omnetpp_r (max) (percentage) -3.26% 0.920 0.890 - 0.00% -
525.x264_r (max) (percentage) -3.23% 0.310 0.300 - 0.00% -
525.x264_r -3.23% 31.000 30.000 - 0.00% -
525.x264_r (avg) -3.23% 31.000 30.000 - 0.00% -
505.mcf_r (max) (percentage) -3.13% 0.320 0.310 - 0.00% -
511.povray_r (max) -2.27% 44.000 43.000 - 0.00% -
520.omnetpp_r -1.00% 100.000 99.000 - 0.00% -
520.omnetpp_r (avg) -1.00% 100.000 99.000 - 0.00% -

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
505.mcf_r 2.17% 25784.000 26344.000 - -2.96% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
557.xz_r -3.11% 10041.000 9729.000 - -0.72% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_execution_successful 966.67% 3.000 32.000 - 0.00% -
nb_compile_successful 100.00% 16.000 32.000 - 0.00% -
nb_total_tests 100.00% 16.000 32.000 - 0.00% -

Added Tests - Code Size
500.perlbench_r
502.gcc_r
508.namd_r
510.parest_r
511.povray_r
519.lbm_r
520.omnetpp_r
523.xalancbmk_r
525.x264_r
526.blender_r
538.imagick_r
541.leela_r
544.nab_r

Added Tests - Execution
500.perlbench_r
502.gcc_r
508.namd_r
510.parest_r
511.povray_r
519.lbm_r
520.omnetpp_r
523.xalancbmk_r
525.x264_r
526.blender_r
538.imagick_r
541.leela_r
544.nab_r

Added Tests - sample variability
500.perlbench_r
500.perlbench_r (avg)
500.perlbench_r (avg) (percentage)
500.perlbench_r (max)
500.perlbench_r (max) (percentage)
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)
520.omnetpp_r
520.omnetpp_r (avg)
520.omnetpp_r (avg) (percentage)
520.omnetpp_r (max)
520.omnetpp_r (max) (percentage)
525.x264_r
525.x264_r (avg)
525.x264_r (avg) (percentage)
525.x264_r (max)
525.x264_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
541.leela_r
541.leela_r (avg)
541.leela_r (avg) (percentage)
541.leela_r (max)
541.leela_r (max) (percentage)
544.nab_r
544.nab_r (avg)
544.nab_r (avg) (percentage)
544.nab_r (max)
544.nab_r (max) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)


Report Time: 0.22s
Name Current %
500.perlbench_r 15405.000 -
502.gcc_r 9054.000 -
505.mcf_r 11873.000 -
508.namd_r 9124.000 -
510.parest_r 20717.000 -
511.povray_r 16792.000 -
519.lbm_r 14776.000 -
520.omnetpp_r 11350.000 -
523.xalancbmk_r 8963.000 -3.32%
525.x264_r 9602.000 -1.21%
526.blender_r 10631.000 -
531.deepsjeng_r 11981.000 -1.64%
538.imagick_r 13986.000 1.16%
541.leela_r 9795.000 -1.00%
544.nab_r 11118.000 -
557.xz_r 9729.000 -
Geometric Mean 11809.841 -
Name Current %
500.perlbench_r 2284056.000 -
502.gcc_r 10175739.000 -1.07%
505.mcf_r 26344.000 -2.96%
508.namd_r 506671.000 -1.10%
510.parest_r 1709360.000 -
511.povray_r 1141452.000 -
519.lbm_r 11038.000 -
520.omnetpp_r 1566949.000 -
523.xalancbmk_r 3504961.000 -
525.x264_r 527790.000 -1.39%
526.blender_r 11873266.000 -
531.deepsjeng_r 92131.000 -
538.imagick_r 1255819.000 -1.12%
541.leela_r 86292.000 -
544.nab_r 82184.000 -
557.xz_r 131735.000 -
Geometric Mean 515482.535 -
Name Current %
500.perlbench_r 20.000 -
500.perlbench_r (avg) 20.000 -
500.perlbench_r (avg) (percentage) 0.130 -
500.perlbench_r (max) 18.000 -
500.perlbench_r (max) (percentage) 0.120 -
505.mcf_r 23.000 -
505.mcf_r (avg) 23.000 -
505.mcf_r (avg) (percentage) 0.200 -
505.mcf_r (max) 36.000 -5.26%
505.mcf_r (max) (percentage) 0.310 -3.13%
508.namd_r 9.000 -
508.namd_r (avg) 9.000 -
508.namd_r (avg) (percentage) 0.100 -
508.namd_r (max) 8.000 -
508.namd_r (max) (percentage) 0.090 -
511.povray_r 48.000 -
511.povray_r (avg) 48.000 -
511.povray_r (avg) (percentage) 0.290 -
511.povray_r (max) 43.000 -2.27%
511.povray_r (max) (percentage) 0.260 -3.70%
519.lbm_r 5.000 -
519.lbm_r (avg) 5.000 -
519.lbm_r (avg) (percentage) 0.040 -
519.lbm_r (max) 10.000 -
519.lbm_r (max) (percentage) 0.070 -
520.omnetpp_r 99.000 -1.00%
520.omnetpp_r (avg) 99.000 -1.00%
520.omnetpp_r (avg) (percentage) 0.880 -
520.omnetpp_r (max) 101.000 -3.81%
520.omnetpp_r (max) (percentage) 0.890 -3.26%
525.x264_r 30.000 -3.23%
525.x264_r (avg) 30.000 -3.23%
525.x264_r (avg) (percentage) 0.320 -
525.x264_r (max) 28.000 -6.67%
525.x264_r (max) (percentage) 0.300 -3.23%
526.blender_r 13.000 -
526.blender_r (avg) 13.000 -
526.blender_r (avg) (percentage) 0.130 -
526.blender_r (max) 23.000 -
526.blender_r (max) (percentage) 0.220 -
531.deepsjeng_r 37.000 -
531.deepsjeng_r (avg) 37.000 -
531.deepsjeng_r (avg) (percentage) 0.310 -
531.deepsjeng_r (max) 23.000 -11.54%
531.deepsjeng_r (max) (percentage) 0.200 -9.09%
541.leela_r 16.000 -
541.leela_r (avg) 16.000 -
541.leela_r (avg) (percentage) 0.170 -
541.leela_r (max) 14.000 -6.67%
541.leela_r (max) (percentage) 0.150 -6.25%
544.nab_r 41.000 -
544.nab_r (avg) 41.000 -
544.nab_r (avg) (percentage) 0.370 -
544.nab_r (max) 45.000 -6.25%
544.nab_r (max) (percentage) 0.410 -4.65%
557.xz_r 10.000 -
557.xz_r (avg) 10.000 -
557.xz_r (avg) (percentage) 0.110 -
557.xz_r (max) 13.000 -
557.xz_r (max) (percentage) 0.140 -
Geometric Mean 3.355 -1.44%