Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/4cfbe55781cb8fb95568c9a8538912f68d2ff681 (+ 1388 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-cpu2017rate--llvm-arm-master-Oz_LTO-build/277/
Filter

llvm-arm-master-Oz_LTO test results

Run Order Start Time Duration
Current 0277 (llvmorg-21-init-12510-g4cfbe55781cb) 2025-05-11T06:46:51 0:00:00
Previous 0273 (llvmorg-21-init-11122-g2040f50a566e) 2025-05-02T14:05:50 0:00:00
Baseline 0002 (llvmorg-17-init-04523-gc3801568ef2b) 2023-03-10T23:13:09 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 9 1
Performance Improvements 51 19
Added Tests 4 74
Unchanged Tests 566 536
Total Tests 630

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
544.nab_r (unexplained diff vs previous) (percentage) 127.27% 0.110 0.250 - 0.00% -
544.nab_r (unexplained diff vs previous) 122.22% 9.000 20.000 - 0.00% -
557.xz_r (unexplained diff vs previous) (percentage) 89.29% 0.280 0.530 - 0.00% -
557.xz_r (unexplained diff vs previous) 85.71% 7.000 13.000 - 0.00% -
508.namd_r (unexplained diff vs previous) (percentage) 5.47% 1.280 1.350 - 0.00% -
508.namd_r (avg) (percentage) 4.65% 0.430 0.450 - 0.00% -
508.namd_r (unexplained diff vs previous) 4.17% 48.000 50.000 - 0.00% -
508.namd_r (max) (percentage) 3.10% 1.290 1.330 - 0.00% -
508.namd_r (max) 2.08% 48.000 49.000 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
502.gcc_r -1.63% 4052.000 3986.000 - 0.73% -
508.namd_r -1.33% 3759.000 3709.000 - 0.87% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
525.x264_r (unexplained diff vs previous) (percentage) -98.11% 1.060 0.020 - 0.00% -
525.x264_r (unexplained diff vs previous) -97.67% 43.000 1.000 - 0.00% -
531.deepsjeng_r (unexplained diff vs previous) -94.12% 34.000 2.000 - 0.00% -
531.deepsjeng_r (unexplained diff vs previous) (percentage) -93.75% 0.640 0.040 - 0.00% -
519.lbm_r (unexplained diff vs previous) (percentage) -88.57% 0.700 0.080 - 0.00% -
519.lbm_r (unexplained diff vs previous) -88.46% 26.000 3.000 - 0.00% -
526.blender_r (max) (percentage) -62.79% 0.860 0.320 - 0.00% -
526.blender_r (max) -62.73% 110.000 41.000 - 0.00% -
538.imagick_r (unexplained diff vs previous) -50.00% 6.000 3.000 - 0.00% -
538.imagick_r (unexplained diff vs previous) (percentage) -50.00% 0.140 0.070 - 0.00% -
531.deepsjeng_r (max) -49.12% 57.000 29.000 - 0.00% -
531.deepsjeng_r (max) (percentage) -48.60% 1.070 0.550 - 0.00% -
505.mcf_r (max) -38.03% 71.000 44.000 - 0.00% -
526.blender_r (unexplained diff vs previous) (percentage) -37.21% 0.430 0.270 - 0.00% -
526.blender_r (unexplained diff vs previous) -36.36% 55.000 35.000 - 0.00% -
505.mcf_r (max) (percentage) -36.29% 1.240 0.790 - 0.00% -
538.imagick_r (max) (percentage) -25.00% 0.160 0.120 - 0.00% -
525.x264_r (max) (percentage) -17.14% 1.050 0.870 - 0.00% -
525.x264_r (max) -16.67% 42.000 35.000 - 0.00% -
538.imagick_r (max) -16.67% 6.000 5.000 - 0.00% -
519.lbm_r (max) -15.38% 26.000 22.000 - 0.00% -
510.parest_r (max) -14.29% 42.000 36.000 - 0.00% -
510.parest_r (unexplained diff vs previous) -14.29% 42.000 36.000 - 0.00% -
523.xalancbmk_r (max) -14.29% 42.000 36.000 - 0.00% -
523.xalancbmk_r (max) (percentage) -14.02% 1.070 0.920 - 0.00% -
519.lbm_r (max) (percentage) -12.68% 0.710 0.620 - 0.00% -
510.parest_r (unexplained diff vs previous) (percentage) -12.50% 0.640 0.560 - 0.00% -
510.parest_r (max) (percentage) -12.31% 0.650 0.570 - 0.00% -
520.omnetpp_r (max) -11.67% 60.000 53.000 - 0.00% -
520.omnetpp_r (max) (percentage) -10.30% 1.650 1.480 - 0.00% -
520.omnetpp_r (unexplained diff vs previous) -10.00% 30.000 27.000 - 0.00% -
520.omnetpp_r (unexplained diff vs previous) (percentage) -9.76% 0.820 0.740 - 0.00% -
557.xz_r (max) -9.52% 21.000 19.000 - 0.00% -
511.povray_r (max) (percentage) -7.10% 1.830 1.700 - 0.00% -
541.leela_r (unexplained diff vs previous) -6.25% 16.000 15.000 - 0.00% -
541.leela_r (unexplained diff vs previous) (percentage) -6.06% 0.330 0.310 - 0.00% -
557.xz_r (max) (percentage) -5.88% 0.850 0.800 - 0.00% -
544.nab_r (max) (percentage) -4.69% 0.640 0.610 - 0.00% -
505.mcf_r (unexplained diff vs previous) -4.26% 47.000 45.000 - 0.00% -
544.nab_r (max) -4.00% 50.000 48.000 - 0.00% -
505.mcf_r (unexplained diff vs previous) (percentage) -3.66% 0.820 0.790 - 0.00% -
511.povray_r (avg) (percentage) -3.12% 0.960 0.930 - 0.00% -
523.xalancbmk_r -3.03% 33.000 32.000 - 0.00% -
523.xalancbmk_r (avg) -3.03% 33.000 32.000 - 0.00% -
523.xalancbmk_r (avg) (percentage) -2.35% 0.850 0.830 - 0.00% -
526.blender_r (avg) (percentage) -1.96% 0.510 0.500 - 0.00% -
525.x264_r (avg) (percentage) -1.69% 0.590 0.580 - 0.00% -
526.blender_r -1.54% 65.000 64.000 - 0.00% -
526.blender_r (avg) -1.54% 65.000 64.000 - 0.00% -

Added Tests - sample variability
511.povray_r (unexplained diff vs previous)
511.povray_r (unexplained diff vs previous) (percentage)
523.xalancbmk_r (unexplained diff vs previous)
523.xalancbmk_r (unexplained diff vs previous) (percentage)

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
520.omnetpp_r 2.70% 3551.000 3647.000 - -0.73% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
510.parest_r -2.40% 752512.000 734486.000 - 0.00% -
541.leela_r -1.72% 43421.000 42676.000 - 0.00% -
511.povray_r -1.66% 521730.000 513093.000 - 0.00% -
544.nab_r -1.37% 49925.000 49241.000 - 0.00% -
557.xz_r -1.20% 80439.000 79475.000 - 0.00% -
520.omnetpp_r -1.20% 825977.000 816099.000 - 0.00% -
502.gcc_r -1.17% 4484801.000 4432120.000 - 0.00% -
531.deepsjeng_r -1.04% 50472.000 49947.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
523.xalancbmk_r -6.78% 4231.000 3944.000 - -0.08% -
557.xz_r -2.52% 2540.000 2476.000 - -0.52% -
538.imagick_r -2.04% 4457.000 4366.000 - 0.07% -
510.parest_r -1.79% 6604.000 6486.000 - -0.55% -
505.mcf_r -1.66% 5780.000 5684.000 - -0.79% -
519.lbm_r -1.57% 3760.000 3701.000 - 0.08% -
541.leela_r -1.52% 4884.000 4810.000 - 0.31% -
531.deepsjeng_r -1.51% 5427.000 5345.000 - -0.04% -
544.nab_r -1.18% 8034.000 7939.000 - 0.25% -
525.x264_r -1.05% 4092.000 4049.000 - 0.02% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful 6.67% 15.000 16.000 - 0.00% -

Added Tests - sample variability
500.perlbench_r (avg) (percentage)
500.perlbench_r (max) (percentage)
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
511.povray_r (unexplained diff vs previous)
511.povray_r (unexplained diff vs previous) (percentage)
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)
520.omnetpp_r
520.omnetpp_r (avg)
520.omnetpp_r (avg) (percentage)
520.omnetpp_r (max)
520.omnetpp_r (max) (percentage)
523.xalancbmk_r
523.xalancbmk_r (avg)
523.xalancbmk_r (avg) (percentage)
523.xalancbmk_r (max)
523.xalancbmk_r (max) (percentage)
525.x264_r
525.x264_r (avg)
525.x264_r (avg) (percentage)
525.x264_r (max)
525.x264_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
538.imagick_r
538.imagick_r (avg)
538.imagick_r (avg) (percentage)
538.imagick_r (max)
538.imagick_r (max) (percentage)
541.leela_r
541.leela_r (avg)
541.leela_r (avg) (percentage)
541.leela_r (max)
541.leela_r (max) (percentage)
544.nab_r
544.nab_r (avg)
544.nab_r (avg) (percentage)
544.nab_r (max)
544.nab_r (max) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)


Report Time: 0.22s
Name Current %
502.gcc_r 3986.000 -1.63%
505.mcf_r 5684.000 -
508.namd_r 3709.000 -1.33%
510.parest_r 6486.000 -
511.povray_r 484.000 -
519.lbm_r 3701.000 -
520.omnetpp_r 3647.000 -
523.xalancbmk_r 3944.000 -
525.x264_r 4049.000 -
526.blender_r 12828.000 -
531.deepsjeng_r 5345.000 -
538.imagick_r 4366.000 -
541.leela_r 4810.000 -
544.nab_r 7939.000 -
557.xz_r 2476.000 -
Geometric Mean 4109.391 -
Name Current %
502.gcc_r 4432120.000 -
505.mcf_r 12341.000 -
508.namd_r 274903.000 -
510.parest_r 734486.000 -
511.povray_r 513093.000 -
519.lbm_r 9280.000 -
520.omnetpp_r 816099.000 -
523.xalancbmk_r 1709250.000 -
525.x264_r 269004.000 -
526.blender_r 5788194.000 -
531.deepsjeng_r 49947.000 -
538.imagick_r 709087.000 -
541.leela_r 42676.000 -
544.nab_r 49241.000 -
557.xz_r 79475.000 -
Geometric Mean 244705.998 -
Name Current %
500.perlbench_r (avg) (percentage) 1.630 -
500.perlbench_r (max) (percentage) 0.730 -
505.mcf_r 60.000 -
505.mcf_r (avg) 60.000 -
505.mcf_r (avg) (percentage) 1.060 -
505.mcf_r (max) 44.000 -38.03%
505.mcf_r (max) (percentage) 0.790 -36.29%
505.mcf_r (unexplained diff vs previous) 45.000 -4.26%
505.mcf_r (unexplained diff vs previous) (percentage) 0.790 -3.66%
508.namd_r 16.000 -
508.namd_r (avg) 16.000 -
508.namd_r (avg) (percentage) 0.450 4.65%
508.namd_r (max) 49.000 2.08%
508.namd_r (max) (percentage) 1.330 3.10%
508.namd_r (unexplained diff vs previous) 50.000 4.17%
508.namd_r (unexplained diff vs previous) (percentage) 1.350 5.47%
510.parest_r 50.000 -
510.parest_r (avg) 50.000 -
510.parest_r (avg) (percentage) 0.780 -
510.parest_r (max) 36.000 -14.29%
510.parest_r (max) (percentage) 0.570 -12.31%
510.parest_r (unexplained diff vs previous) 36.000 -14.29%
510.parest_r (unexplained diff vs previous) (percentage) 0.560 -12.50%
511.povray_r 4.000 -
511.povray_r (avg) 4.000 -
511.povray_r (avg) (percentage) 0.930 -3.12%
511.povray_r (max) 8.000 -
511.povray_r (max) (percentage) 1.700 -7.10%
511.povray_r (unexplained diff vs previous) 0.000 -
511.povray_r (unexplained diff vs previous) (percentage) 0.000 -
519.lbm_r 11.000 -
519.lbm_r (avg) 11.000 -
519.lbm_r (avg) (percentage) 0.310 -
519.lbm_r (max) 22.000 -15.38%
519.lbm_r (max) (percentage) 0.620 -12.68%
519.lbm_r (unexplained diff vs previous) 3.000 -88.46%
519.lbm_r (unexplained diff vs previous) (percentage) 0.080 -88.57%
520.omnetpp_r 40.000 -
520.omnetpp_r (avg) 40.000 -
520.omnetpp_r (avg) (percentage) 1.100 -
520.omnetpp_r (max) 53.000 -11.67%
520.omnetpp_r (max) (percentage) 1.480 -10.30%
520.omnetpp_r (unexplained diff vs previous) 27.000 -10.00%
520.omnetpp_r (unexplained diff vs previous) (percentage) 0.740 -9.76%
523.xalancbmk_r 32.000 -3.03%
523.xalancbmk_r (avg) 32.000 -3.03%
523.xalancbmk_r (avg) (percentage) 0.830 -2.35%
523.xalancbmk_r (max) 36.000 -14.29%
523.xalancbmk_r (max) (percentage) 0.920 -14.02%
523.xalancbmk_r (unexplained diff vs previous) 3.000 -
523.xalancbmk_r (unexplained diff vs previous) (percentage) 0.080 -
525.x264_r 23.000 -
525.x264_r (avg) 23.000 -
525.x264_r (avg) (percentage) 0.580 -1.69%
525.x264_r (max) 35.000 -16.67%
525.x264_r (max) (percentage) 0.870 -17.14%
525.x264_r (unexplained diff vs previous) 1.000 -97.67%
525.x264_r (unexplained diff vs previous) (percentage) 0.020 -98.11%
526.blender_r 64.000 -1.54%
526.blender_r (avg) 64.000 -1.54%
526.blender_r (avg) (percentage) 0.500 -1.96%
526.blender_r (max) 41.000 -62.73%
526.blender_r (max) (percentage) 0.320 -62.79%
526.blender_r (unexplained diff vs previous) 35.000 -36.36%
526.blender_r (unexplained diff vs previous) (percentage) 0.270 -37.21%
531.deepsjeng_r 19.000 -
531.deepsjeng_r (avg) 19.000 -
531.deepsjeng_r (avg) (percentage) 0.360 -
531.deepsjeng_r (max) 29.000 -49.12%
531.deepsjeng_r (max) (percentage) 0.550 -48.60%
531.deepsjeng_r (unexplained diff vs previous) 2.000 -94.12%
531.deepsjeng_r (unexplained diff vs previous) (percentage) 0.040 -93.75%
538.imagick_r 6.000 -
538.imagick_r (avg) 6.000 -
538.imagick_r (avg) (percentage) 0.150 -
538.imagick_r (max) 5.000 -16.67%
538.imagick_r (max) (percentage) 0.120 -25.00%
538.imagick_r (unexplained diff vs previous) 3.000 -50.00%
538.imagick_r (unexplained diff vs previous) (percentage) 0.070 -50.00%
541.leela_r 27.000 -
541.leela_r (avg) 27.000 -
541.leela_r (avg) (percentage) 0.570 -
541.leela_r (max) 33.000 -
541.leela_r (max) (percentage) 0.700 -
541.leela_r (unexplained diff vs previous) 15.000 -6.25%
541.leela_r (unexplained diff vs previous) (percentage) 0.310 -6.06%
544.nab_r 28.000 -
544.nab_r (avg) 28.000 -
544.nab_r (avg) (percentage) 0.360 -
544.nab_r (max) 48.000 -4.00%
544.nab_r (max) (percentage) 0.610 -4.69%
544.nab_r (unexplained diff vs previous) 20.000 122.22%
544.nab_r (unexplained diff vs previous) (percentage) 0.250 127.27%
557.xz_r 31.000 -
557.xz_r (avg) 31.000 -
557.xz_r (avg) (percentage) 1.270 -
557.xz_r (max) 19.000 -9.52%
557.xz_r (max) (percentage) 0.800 -5.88%
557.xz_r (unexplained diff vs previous) 13.000 85.71%
557.xz_r (unexplained diff vs previous) (percentage) 0.530 89.29%
Geometric Mean 3.100 -39.79%