Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/6704faf6f8a26c21c71fd0efad6af6a8d6ee52b4 (+ 30379 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-cpu2017rate--llvm-arm-master-O3_LTO-build/139/
Filter

llvm-arm-master-O3_LTO test results

Run Order Start Time Duration
Current 0139 (llvmorg-19-init-08185-g6704faf6f8a2) 2023-11-12T23:16:48 0:00:00
Previous 0045 (llvmorg-17-init-15472-g411deb97cfaf) 2023-06-13T12:21:03 0:00:00
Baseline 0017 (llvmorg-17-init-07925-g40276f78fd4d) 2023-04-13T10:09:36 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 8 2
Performance Improvements 5 4
Added Tests 22 45
Unchanged Tests 223 207
Total Tests 258

Performance Regressions - Code Size Δ Previous Current σ Δ (B) σ (B)
531.deepsjeng_r 4.72% 111920.000 117207.000 - 5.59% -
519.lbm_r 2.17% 11070.000 11310.000 - 0.00% -
508.namd_r 1.86% 494980.000 504199.000 - 0.00% -
505.mcf_r 1.24% 27336.000 27676.000 - 0.03% -

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
519.lbm_r 1525500.00% 1.000 15256.000 - 0.00% -
508.namd_r 916400.00% 1.000 9165.000 - 0.00% -
541.leela_r 481450.00% 2.000 9631.000 - 0.00% -
523.xalancbmk_r 249.84% 2514.000 8795.000 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
531.deepsjeng_r -3.47% 11719.000 11312.000 - -3.13% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
531.deepsjeng_r (max) -3.31% 121.000 117.000 - 0.00% -
531.deepsjeng_r -3.23% 93.000 90.000 - 0.00% -
531.deepsjeng_r (avg) -3.23% 93.000 90.000 - 0.00% -

Performance Improvements - Score Δ Previous Current σ Δ (B) σ (B)
nb_execution_successful 36.36% 11.000 15.000 - 400.00% -

Added Tests - Code Size
500.perlbench_r
510.parest_r
511.povray_r
520.omnetpp_r
525.x264_r
526.blender_r
538.imagick_r
544.nab_r

Added Tests - Execution
500.perlbench_r
502.gcc_r
510.parest_r
511.povray_r
520.omnetpp_r
525.x264_r
526.blender_r
538.imagick_r
544.nab_r

Added Tests - sample variability
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
531.deepsjeng_r 5.59% 111000.000 117207.000 - 4.72% -
557.xz_r 2.01% 138351.000 141127.000 - -0.13% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
531.deepsjeng_r -3.13% 11677.000 11312.000 - -3.47% -
557.xz_r -3.06% 10027.000 9720.000 - -0.16% -
505.mcf_r -1.37% 12001.000 11837.000 - -0.35% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_execution_successful 400.00% 3.000 15.000 - 36.36% -

Added Tests - Code Size
500.perlbench_r
508.namd_r
510.parest_r
511.povray_r
519.lbm_r
520.omnetpp_r
523.xalancbmk_r
525.x264_r
526.blender_r
538.imagick_r
541.leela_r
544.nab_r

Added Tests - Execution
500.perlbench_r
502.gcc_r
508.namd_r
510.parest_r
511.povray_r
519.lbm_r
520.omnetpp_r
523.xalancbmk_r
525.x264_r
526.blender_r
538.imagick_r
541.leela_r
544.nab_r

Added Tests - sample variability
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)


Report Time: 0.20s
Name Current %
500.perlbench_r 14841.000 -
502.gcc_r 55.000 -
505.mcf_r 11837.000 -
508.namd_r 9165.000 916400.00%
510.parest_r 20998.000 -
511.povray_r 16341.000 -
519.lbm_r 15256.000 1525500.00%
520.omnetpp_r 10811.000 -
523.xalancbmk_r 8795.000 249.84%
525.x264_r 9437.000 -
526.blender_r 10632.000 -
531.deepsjeng_r 11312.000 -3.47%
538.imagick_r 16051.000 -
541.leela_r 9631.000 481450.00%
544.nab_r 11100.000 -
557.xz_r 9720.000 -
Geometric Mean 8562.181 4584.39%
Name Current %
500.perlbench_r 2555162.000 -
505.mcf_r 27676.000 1.24%
508.namd_r 504199.000 1.86%
510.parest_r 1856269.000 -
511.povray_r 1197848.000 -
519.lbm_r 11310.000 2.17%
520.omnetpp_r 1627603.000 -
523.xalancbmk_r 3674097.000 -
525.x264_r 594042.000 -
526.blender_r 13728238.000 -
531.deepsjeng_r 117207.000 4.72%
538.imagick_r 1333843.000 -
541.leela_r 93768.000 -
544.nab_r 86112.000 -
557.xz_r 141127.000 -
Geometric Mean 456495.445 238.18%
Name Current %
nb_compile_successful 16.000 -
nb_execution_successful 15.000 36.36%
nb_total_tests 16.000 -
Geometric Mean 15.659 10.89%