Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/0b75a2099041bbd1155d93528bce98254f6f47b2 (+ 262 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-cpu2017rate--llvm-arm-master-Oz_LTO-build/150/
View Options
Report
Filter

llvm-arm-master-Oz_LTO test results

Run Order Start Time Duration
Current 0150 (llvmorg-21-init-13437-g0b75a2099041) 2025-05-21T08:10:12 0:00:00
Previous 0150 (llvmorg-21-init-13437-g0b75a2099041) 2025-05-21T08:10:12 0:00:00
Baseline 0025 (llvmorg-19-init-16254-g1846523bb772) 2024-07-02T11:39:54 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 0 4
Performance Improvements 0 5
Added Tests 0 74
Unchanged Tests 630 547
Total Tests 630

Run-Over-Baseline Changes Detail

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
519.lbm_r 20.16% 12552.000 15082.000 - 0.00% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests -52.94% 34.000 16.000 - 0.00% -
nb_execution_successful -50.00% 30.000 15.000 - 0.00% -
nb_compile_successful -46.67% 30.000 16.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
511.povray_r -2.78% 19998.000 19443.000 - 0.00% -
538.imagick_r -2.76% 14043.000 13656.000 - 0.00% -
520.omnetpp_r -2.61% 13266.000 12920.000 - 0.00% -
531.deepsjeng_r -2.54% 10739.000 10466.000 - 0.00% -
526.blender_r -1.36% 12129.000 11964.000 - 0.00% -

Added Tests - Code Size
523.xalancbmk_r

Added Tests - Execution
523.xalancbmk_r

Added Tests - sample variability
500.perlbench_r (avg) (percentage)
500.perlbench_r (max) (percentage)
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)
520.omnetpp_r
520.omnetpp_r (avg)
520.omnetpp_r (avg) (percentage)
520.omnetpp_r (max)
520.omnetpp_r (max) (percentage)
523.xalancbmk_r
523.xalancbmk_r (avg)
523.xalancbmk_r (avg) (percentage)
523.xalancbmk_r (max)
523.xalancbmk_r (max) (percentage)
525.x264_r
525.x264_r (avg)
525.x264_r (avg) (percentage)
525.x264_r (max)
525.x264_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
538.imagick_r
538.imagick_r (avg)
538.imagick_r (avg) (percentage)
538.imagick_r (max)
538.imagick_r (max) (percentage)
541.leela_r
541.leela_r (avg)
541.leela_r (avg) (percentage)
541.leela_r (max)
541.leela_r (max) (percentage)
544.nab_r
544.nab_r (avg)
544.nab_r (avg) (percentage)
544.nab_r (max)
544.nab_r (max) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)

Report Time: 0.25s
Execution (seconds)
Name Current %
502.gcc_r 9904.000 -
505.mcf_r 13130.000 -
508.namd_r 9959.000 -
510.parest_r 22696.000 -
511.povray_r 19443.000 -
519.lbm_r 15082.000 -
520.omnetpp_r 12920.000 -
523.xalancbmk_r 10871.000 -
525.x264_r 14487.000 -
526.blender_r 11964.000 -
531.deepsjeng_r 10466.000 -
538.imagick_r 13656.000 -
541.leela_r 11913.000 -
544.nab_r 11444.000 -
557.xz_r 10543.000 -
Geometric Mean 12851.914 -
Code Size (bytes)
Name Current %
502.gcc_r 4424213.000 -
505.mcf_r 12337.000 -
508.namd_r 276957.000 -
510.parest_r 747793.000 -
511.povray_r 515240.000 -
519.lbm_r 9288.000 -
520.omnetpp_r 823908.000 -
523.xalancbmk_r 1705176.000 -
525.x264_r 269385.000 -
526.blender_r 5793619.000 -
531.deepsjeng_r 49926.000 -
538.imagick_r 712108.000 -
541.leela_r 43200.000 -
544.nab_r 49197.000 -
557.xz_r 80067.000 -
Geometric Mean 245692.970 -
sample variability
Name Current %
500.perlbench_r (avg) (percentage) 0.470 -
500.perlbench_r (max) (percentage) 0.810 -
505.mcf_r 40.000 -
505.mcf_r (avg) 40.000 -
505.mcf_r (avg) (percentage) 0.310 -
505.mcf_r (max) 47.000 -
505.mcf_r (max) (percentage) 0.360 -
505.mcf_r (unexplained diff vs previous) 34.000 -
505.mcf_r (unexplained diff vs previous) (percentage) 0.260 -
508.namd_r 20.000 -
508.namd_r (avg) 20.000 -
508.namd_r (avg) (percentage) 0.210 -
508.namd_r (max) 33.000 -
508.namd_r (max) (percentage) 0.340 -
508.namd_r (unexplained diff vs previous) 34.000 -
508.namd_r (unexplained diff vs previous) (percentage) 0.340 -
510.parest_r 29.000 -
510.parest_r (avg) 29.000 -
510.parest_r (avg) (percentage) 0.130 -
510.parest_r (max) 49.000 -
510.parest_r (max) (percentage) 0.220 -
510.parest_r (unexplained diff vs previous) 49.000 -
510.parest_r (unexplained diff vs previous) (percentage) 0.220 -
511.povray_r 56.000 -
511.povray_r (avg) 56.000 -
511.povray_r (avg) (percentage) 0.290 -
511.povray_r (max) 73.000 -
511.povray_r (max) (percentage) 0.380 -
511.povray_r (unexplained diff vs previous) 74.000 -
511.povray_r (unexplained diff vs previous) (percentage) 0.380 -
519.lbm_r 27.000 -
519.lbm_r (avg) 27.000 -
519.lbm_r (avg) (percentage) 0.180 -
519.lbm_r (max) 51.000 -
519.lbm_r (max) (percentage) 0.340 -
519.lbm_r (unexplained diff vs previous) 34.000 -
519.lbm_r (unexplained diff vs previous) (percentage) 0.230 -
520.omnetpp_r 94.000 -
520.omnetpp_r (avg) 94.000 -
520.omnetpp_r (avg) (percentage) 0.730 -
520.omnetpp_r (max) 49.000 -
520.omnetpp_r (max) (percentage) 0.380 -
520.omnetpp_r (unexplained diff vs previous) 25.000 -
520.omnetpp_r (unexplained diff vs previous) (percentage) 0.190 -
523.xalancbmk_r 38.000 -
523.xalancbmk_r (avg) 38.000 -
523.xalancbmk_r (avg) (percentage) 0.350 -
523.xalancbmk_r (max) 45.000 -
523.xalancbmk_r (max) (percentage) 0.420 -
525.x264_r 27.000 -
525.x264_r (avg) 27.000 -
525.x264_r (avg) (percentage) 0.190 -
525.x264_r (max) 59.000 -
525.x264_r (max) (percentage) 0.410 -
525.x264_r (unexplained diff vs previous) 6.000 -
525.x264_r (unexplained diff vs previous) (percentage) 0.040 -
526.blender_r 41.000 -
526.blender_r (avg) 41.000 -
526.blender_r (avg) (percentage) 0.350 -
526.blender_r (max) 37.000 -
526.blender_r (max) (percentage) 0.310 -
526.blender_r (unexplained diff vs previous) 7.000 -
526.blender_r (unexplained diff vs previous) (percentage) 0.060 -
531.deepsjeng_r 80.000 -
531.deepsjeng_r (avg) 80.000 -
531.deepsjeng_r (avg) (percentage) 0.770 -
531.deepsjeng_r (max) 233.000 -
531.deepsjeng_r (max) (percentage) 2.230 -
531.deepsjeng_r (unexplained diff vs previous) 60.000 -
531.deepsjeng_r (unexplained diff vs previous) (percentage) 0.570 -
538.imagick_r 45.000 -
538.imagick_r (avg) 45.000 -
538.imagick_r (avg) (percentage) 0.330 -
538.imagick_r (max) 51.000 -
538.imagick_r (max) (percentage) 0.380 -
538.imagick_r (unexplained diff vs previous) 5.000 -
538.imagick_r (unexplained diff vs previous) (percentage) 0.040 -
541.leela_r 27.000 -
541.leela_r (avg) 27.000 -
541.leela_r (avg) (percentage) 0.230 -
541.leela_r (max) 41.000 -
541.leela_r (max) (percentage) 0.350 -
541.leela_r (unexplained diff vs previous) 2.000 -
541.leela_r (unexplained diff vs previous) (percentage) 0.020 -
544.nab_r 44.000 -
544.nab_r (avg) 44.000 -
544.nab_r (avg) (percentage) 0.390 -
544.nab_r (max) 76.000 -
544.nab_r (max) (percentage) 0.670 -
544.nab_r (unexplained diff vs previous) 23.000 -
544.nab_r (unexplained diff vs previous) (percentage) 0.200 -
557.xz_r 17.000 -
557.xz_r (avg) 17.000 -
557.xz_r (avg) (percentage) 0.170 -
557.xz_r (max) 21.000 -
557.xz_r (max) (percentage) 0.200 -
557.xz_r (unexplained diff vs previous) 13.000 -
557.xz_r (unexplained diff vs previous) (percentage) 0.120 -
Geometric Mean 4.085 -