Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/678cdd67b957cb49e7fe2cce2610cd720cbdf130 (+ 423 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-cpu2017rate--llvm-arm-master-Oz-build/254/
View Options
Report
Filter

llvm-arm-master-Oz test results

Run Order Start Time Duration
Current 0254 (llvmorg-21-init-14517-g678cdd67b957) 2025-06-01T03:28:35 0:00:00
Previous 0254 (llvmorg-21-init-14517-g678cdd67b957) 2025-06-01T03:28:35 0:00:00
Baseline 0002 (llvmorg-17-init-04570-g24416d22bb28) 2023-03-12T06:27:23 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 0 3
Performance Improvements 0 8
Added Tests 0 76
Unchanged Tests 630 543
Total Tests 630

Run-Over-Baseline Changes Detail

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
520.omnetpp_r 4.77% 3813.000 3995.000 - 0.00% -
505.mcf_r 4.33% 5634.000 5878.000 - 0.00% -
544.nab_r 3.97% 8092.000 8413.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
538.imagick_r -1.68% 1079012.000 1060867.000 - 0.00% -
511.povray_r -1.41% 551640.000 543867.000 - 0.00% -
505.mcf_r -1.39% 15863.000 15643.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
538.imagick_r -1.38% 4424.000 4363.000 - 0.00% -
523.xalancbmk_r -1.01% 4674.000 4627.000 - 0.00% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful 14.29% 14.000 16.000 - 0.00% -
nb_execution_successful 7.14% 14.000 15.000 - 0.00% -
nb_total_tests 6.67% 15.000 16.000 - 0.00% -

Added Tests - Code Size
510.parest_r

Added Tests - Execution
510.parest_r

Added Tests - sample variability
500.perlbench_r (avg) (percentage)
500.perlbench_r (max) (percentage)
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
510.parest_r (unexplained diff vs previous)
510.parest_r (unexplained diff vs previous) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)
520.omnetpp_r
520.omnetpp_r (avg)
520.omnetpp_r (avg) (percentage)
520.omnetpp_r (max)
520.omnetpp_r (max) (percentage)
523.xalancbmk_r
523.xalancbmk_r (avg)
523.xalancbmk_r (avg) (percentage)
523.xalancbmk_r (max)
523.xalancbmk_r (max) (percentage)
525.x264_r
525.x264_r (avg)
525.x264_r (avg) (percentage)
525.x264_r (max)
525.x264_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
538.imagick_r
538.imagick_r (avg)
538.imagick_r (avg) (percentage)
538.imagick_r (max)
538.imagick_r (max) (percentage)
541.leela_r
541.leela_r (avg)
541.leela_r (avg) (percentage)
541.leela_r (max)
541.leela_r (max) (percentage)
544.nab_r
544.nab_r (avg)
544.nab_r (avg) (percentage)
544.nab_r (max)
544.nab_r (max) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)

Report Time: 0.21s
Execution (seconds)
Name Current %
502.gcc_r 4115.000 -
505.mcf_r 5878.000 -
508.namd_r 3695.000 -
510.parest_r 6650.000 -
511.povray_r 516.000 -
519.lbm_r 3876.000 -
520.omnetpp_r 3995.000 -
523.xalancbmk_r 4627.000 -
525.x264_r 4089.000 -
526.blender_r 13133.000 -
531.deepsjeng_r 5578.000 -
538.imagick_r 4363.000 -
541.leela_r 5349.000 -
544.nab_r 8413.000 -
557.xz_r 2565.000 -
Geometric Mean 4312.172 -
Code Size (bytes)
Name Current %
502.gcc_r 4830527.000 -
505.mcf_r 15643.000 -
508.namd_r 352203.000 -
510.parest_r 3359547.000 -
511.povray_r 543867.000 -
519.lbm_r 11434.000 -
520.omnetpp_r 994337.000 -
523.xalancbmk_r 2259566.000 -
525.x264_r 274596.000 -
526.blender_r 6532585.000 -
531.deepsjeng_r 58967.000 -
538.imagick_r 1060867.000 -
541.leela_r 71987.000 -
544.nab_r 95257.000 -
557.xz_r 115528.000 -
Geometric Mean 343849.468 -
sample variability
Name Current %
500.perlbench_r (avg) (percentage) 0.800 -
500.perlbench_r (max) (percentage) 0.690 -
505.mcf_r 38.000 -
505.mcf_r (avg) 38.000 -
505.mcf_r (avg) (percentage) 0.660 -
505.mcf_r (max) 41.000 -
505.mcf_r (max) (percentage) 0.710 -
505.mcf_r (unexplained diff vs previous) 42.000 -
505.mcf_r (unexplained diff vs previous) (percentage) 0.710 -
508.namd_r 14.000 -
508.namd_r (avg) 14.000 -
508.namd_r (avg) (percentage) 0.380 -
508.namd_r (max) 19.000 -
508.namd_r (max) (percentage) 0.540 -
508.namd_r (unexplained diff vs previous) 5.000 -
508.namd_r (unexplained diff vs previous) (percentage) 0.140 -
510.parest_r 17.000 -
510.parest_r (avg) 17.000 -
510.parest_r (avg) (percentage) 0.270 -
510.parest_r (max) 17.000 -
510.parest_r (max) (percentage) 0.270 -
510.parest_r (unexplained diff vs previous) 18.000 -
510.parest_r (unexplained diff vs previous) (percentage) 0.270 -
511.povray_r 4.000 -
511.povray_r (avg) 4.000 -
511.povray_r (avg) (percentage) 0.950 -
511.povray_r (max) 6.000 -
511.povray_r (max) (percentage) 1.230 -
511.povray_r (unexplained diff vs previous) 2.000 -
511.povray_r (unexplained diff vs previous) (percentage) 0.390 -
519.lbm_r 10.000 -
519.lbm_r (avg) 10.000 -
519.lbm_r (avg) (percentage) 0.260 -
519.lbm_r (max) 10.000 -
519.lbm_r (max) (percentage) 0.260 -
519.lbm_r (unexplained diff vs previous) 10.000 -
519.lbm_r (unexplained diff vs previous) (percentage) 0.260 -
520.omnetpp_r 48.000 -
520.omnetpp_r (avg) 48.000 -
520.omnetpp_r (avg) (percentage) 1.220 -
520.omnetpp_r (max) 151.000 -
520.omnetpp_r (max) (percentage) 3.790 -
520.omnetpp_r (unexplained diff vs previous) 146.000 -
520.omnetpp_r (unexplained diff vs previous) (percentage) 3.650 -
523.xalancbmk_r 26.000 -
523.xalancbmk_r (avg) 26.000 -
523.xalancbmk_r (avg) (percentage) 0.580 -
523.xalancbmk_r (max) 27.000 -
523.xalancbmk_r (max) (percentage) 0.600 -
525.x264_r 16.000 -
525.x264_r (avg) 16.000 -
525.x264_r (avg) (percentage) 0.400 -
525.x264_r (max) 38.000 -
525.x264_r (max) (percentage) 0.940 -
525.x264_r (unexplained diff vs previous) 39.000 -
525.x264_r (unexplained diff vs previous) (percentage) 0.950 -
526.blender_r 52.000 -
526.blender_r (avg) 52.000 -
526.blender_r (avg) (percentage) 0.400 -
526.blender_r (max) 94.000 -
526.blender_r (max) (percentage) 0.720 -
526.blender_r (unexplained diff vs previous) 44.000 -
526.blender_r (unexplained diff vs previous) (percentage) 0.340 -
531.deepsjeng_r 18.000 -
531.deepsjeng_r (avg) 18.000 -
531.deepsjeng_r (avg) (percentage) 0.340 -
531.deepsjeng_r (max) 20.000 -
531.deepsjeng_r (max) (percentage) 0.360 -
531.deepsjeng_r (unexplained diff vs previous) 20.000 -
531.deepsjeng_r (unexplained diff vs previous) (percentage) 0.360 -
538.imagick_r 5.000 -
538.imagick_r (avg) 5.000 -
538.imagick_r (avg) (percentage) 0.130 -
538.imagick_r (max) 6.000 -
538.imagick_r (max) (percentage) 0.140 -
541.leela_r 23.000 -
541.leela_r (avg) 23.000 -
541.leela_r (avg) (percentage) 0.440 -
541.leela_r (max) 39.000 -
541.leela_r (max) (percentage) 0.740 -
541.leela_r (unexplained diff vs previous) 39.000 -
541.leela_r (unexplained diff vs previous) (percentage) 0.730 -
544.nab_r 30.000 -
544.nab_r (avg) 30.000 -
544.nab_r (avg) (percentage) 0.360 -
544.nab_r (max) 30.000 -
544.nab_r (max) (percentage) 0.360 -
544.nab_r (unexplained diff vs previous) 30.000 -
544.nab_r (unexplained diff vs previous) (percentage) 0.360 -
557.xz_r 22.000 -
557.xz_r (avg) 22.000 -
557.xz_r (avg) (percentage) 0.870 -
557.xz_r (max) 28.000 -
557.xz_r (max) (percentage) 1.100 -
557.xz_r (unexplained diff vs previous) 28.000 -
557.xz_r (unexplained diff vs previous) (percentage) 1.090 -
Geometric Mean 4.154 -