Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/196f7c2a4f472074668451c5ecc40e82731940f7 (+ 523 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-cpu2017rate--llvm-arm-master-Os_LTO-build/228/
Filter

llvm-arm-master-Os_LTO test results

Run Order Start Time Duration
Current 0228 (llvmorg-20-init-18969-g196f7c2a4f47) 2025-01-20T06:24:27 0:00:00
Previous 0228 (llvmorg-20-init-18969-g196f7c2a4f47) 2025-01-20T06:24:27 0:00:00
Baseline 0002 (llvmorg-17-init-04569-g6590a372fa3f) 2023-03-11T22:47:53 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 0 3
Performance Improvements 0 11
Added Tests 0 74
Unchanged Tests 630 542
Total Tests 630

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
557.xz_r 2.01% 83255.000 84927.000 - 0.00% -
520.omnetpp_r 1.15% 916467.000 926986.000 - 0.00% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests -6.25% 16.000 15.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
511.povray_r -1.55% 570502.000 561675.000 - 0.00% -
525.x264_r -1.18% 321050.000 317250.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
525.x264_r -7.33% 3166.000 2934.000 - 0.00% -
505.mcf_r -6.79% 5417.000 5049.000 - 0.00% -
511.povray_r -4.55% 462.000 441.000 - 0.00% -
502.gcc_r -4.19% 3600.000 3449.000 - 0.00% -
544.nab_r -3.55% 7531.000 7264.000 - 0.00% -
520.omnetpp_r -3.26% 3283.000 3176.000 - 0.00% -
523.xalancbmk_r -2.14% 3320.000 3249.000 - 0.00% -
541.leela_r -1.28% 4454.000 4397.000 - 0.00% -
557.xz_r -1.07% 2426.000 2400.000 - 0.00% -

Added Tests - Code Size
500.perlbench_r

Added Tests - Execution
500.perlbench_r

Added Tests - sample variability
500.perlbench_r
500.perlbench_r (avg)
500.perlbench_r (avg) (percentage)
500.perlbench_r (max)
500.perlbench_r (max) (percentage)
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r (avg) (percentage)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)
520.omnetpp_r
520.omnetpp_r (avg)
520.omnetpp_r (avg) (percentage)
520.omnetpp_r (max)
520.omnetpp_r (max) (percentage)
523.xalancbmk_r
523.xalancbmk_r (avg)
523.xalancbmk_r (avg) (percentage)
523.xalancbmk_r (max)
523.xalancbmk_r (max) (percentage)
525.x264_r
525.x264_r (avg)
525.x264_r (avg) (percentage)
525.x264_r (max)
525.x264_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
538.imagick_r
538.imagick_r (avg)
538.imagick_r (avg) (percentage)
538.imagick_r (max)
538.imagick_r (max) (percentage)
541.leela_r
541.leela_r (avg)
541.leela_r (avg) (percentage)
541.leela_r (max)
541.leela_r (max) (percentage)
544.nab_r
544.nab_r (avg)
544.nab_r (avg) (percentage)
544.nab_r (max)
544.nab_r (max) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)


Report Time: 0.21s
Name Current %
500.perlbench_r 2117.000 -
502.gcc_r 3449.000 -
505.mcf_r 5049.000 -
508.namd_r 3108.000 -
511.povray_r 441.000 -
519.lbm_r 3628.000 -
520.omnetpp_r 3176.000 -
523.xalancbmk_r 3249.000 -
525.x264_r 2934.000 -
526.blender_r 10969.000 -
531.deepsjeng_r 4809.000 -
538.imagick_r 4055.000 -
541.leela_r 4397.000 -
544.nab_r 7264.000 -
557.xz_r 2400.000 -
Geometric Mean 3393.154 -
Name Current %
500.perlbench_r 1236615.000 -
502.gcc_r 5273108.000 -
505.mcf_r 14722.000 -
508.namd_r 315282.000 -
511.povray_r 561675.000 -
519.lbm_r 9568.000 -
520.omnetpp_r 926986.000 -
523.xalancbmk_r 1963439.000 -
525.x264_r 317250.000 -
526.blender_r 6453531.000 -
531.deepsjeng_r 58380.000 -
538.imagick_r 834745.000 -
541.leela_r 49922.000 -
544.nab_r 52769.000 -
557.xz_r 84927.000 -
Geometric Mean 284887.355 -
Name Current %
500.perlbench_r 45.000 -
500.perlbench_r (avg) 45.000 -
500.perlbench_r (avg) (percentage) 2.160 -
500.perlbench_r (max) 51.000 -
500.perlbench_r (max) (percentage) 2.440 -
505.mcf_r 61.000 -
505.mcf_r (avg) 61.000 -
505.mcf_r (avg) (percentage) 1.210 -
505.mcf_r (max) 266.000 -
505.mcf_r (max) (percentage) 5.280 -
505.mcf_r (unexplained diff vs previous) 1.000 -
505.mcf_r (unexplained diff vs previous) (percentage) 0.020 -
508.namd_r 10.000 -
508.namd_r (avg) 10.000 -
508.namd_r (avg) (percentage) 0.330 -
508.namd_r (max) 9.000 -
508.namd_r (max) (percentage) 0.320 -
508.namd_r (unexplained diff vs previous) 10.000 -
508.namd_r (unexplained diff vs previous) (percentage) 0.320 -
510.parest_r (avg) (percentage) 1.090 -
510.parest_r (max) (percentage) 5.130 -
511.povray_r 4.000 -
511.povray_r (avg) 4.000 -
511.povray_r (avg) (percentage) 0.930 -
511.povray_r (max) 5.000 -
511.povray_r (max) (percentage) 1.160 -
519.lbm_r 14.000 -
519.lbm_r (avg) 14.000 -
519.lbm_r (avg) (percentage) 0.400 -
519.lbm_r (max) 19.000 -
519.lbm_r (max) (percentage) 0.530 -
519.lbm_r (unexplained diff vs previous) 19.000 -
519.lbm_r (unexplained diff vs previous) (percentage) 0.520 -
520.omnetpp_r 40.000 -
520.omnetpp_r (avg) 40.000 -
520.omnetpp_r (avg) (percentage) 1.280 -
520.omnetpp_r (max) 77.000 -
520.omnetpp_r (max) (percentage) 2.450 -
520.omnetpp_r (unexplained diff vs previous) 44.000 -
520.omnetpp_r (unexplained diff vs previous) (percentage) 1.390 -
523.xalancbmk_r 29.000 -
523.xalancbmk_r (avg) 29.000 -
523.xalancbmk_r (avg) (percentage) 0.920 -
523.xalancbmk_r (max) 79.000 -
523.xalancbmk_r (max) (percentage) 2.440 -
525.x264_r 28.000 -
525.x264_r (avg) 28.000 -
525.x264_r (avg) (percentage) 0.970 -
525.x264_r (max) 19.000 -
525.x264_r (max) (percentage) 0.660 -
525.x264_r (unexplained diff vs previous) 1.000 -
525.x264_r (unexplained diff vs previous) (percentage) 0.030 -
526.blender_r 63.000 -
526.blender_r (avg) 63.000 -
526.blender_r (avg) (percentage) 0.580 -
526.blender_r (max) 63.000 -
526.blender_r (max) (percentage) 0.580 -
526.blender_r (unexplained diff vs previous) 14.000 -
526.blender_r (unexplained diff vs previous) (percentage) 0.130 -
531.deepsjeng_r 15.000 -
531.deepsjeng_r (avg) 15.000 -
531.deepsjeng_r (avg) (percentage) 0.330 -
531.deepsjeng_r (max) 28.000 -
531.deepsjeng_r (max) (percentage) 0.590 -
531.deepsjeng_r (unexplained diff vs previous) 19.000 -
531.deepsjeng_r (unexplained diff vs previous) (percentage) 0.400 -
538.imagick_r 8.000 -
538.imagick_r (avg) 8.000 -
538.imagick_r (avg) (percentage) 0.210 -
538.imagick_r (max) 25.000 -
538.imagick_r (max) (percentage) 0.630 -
538.imagick_r (unexplained diff vs previous) 4.000 -
538.imagick_r (unexplained diff vs previous) (percentage) 0.100 -
541.leela_r 27.000 -
541.leela_r (avg) 27.000 -
541.leela_r (avg) (percentage) 0.630 -
541.leela_r (max) 54.000 -
541.leela_r (max) (percentage) 1.230 -
541.leela_r (unexplained diff vs previous) 12.000 -
541.leela_r (unexplained diff vs previous) (percentage) 0.270 -
544.nab_r 29.000 -
544.nab_r (avg) 29.000 -
544.nab_r (avg) (percentage) 0.410 -
544.nab_r (max) 64.000 -
544.nab_r (max) (percentage) 0.890 -
544.nab_r (unexplained diff vs previous) 65.000 -
544.nab_r (unexplained diff vs previous) (percentage) 0.890 -
557.xz_r 31.000 -
557.xz_r (avg) 31.000 -
557.xz_r (avg) (percentage) 1.310 -
557.xz_r (max) 43.000 -
557.xz_r (max) (percentage) 1.800 -
557.xz_r (unexplained diff vs previous) 44.000 -
557.xz_r (unexplained diff vs previous) (percentage) 1.830 -
Geometric Mean 4.788 -