Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/dad64877c811dcce7e2c7ebc216161ecf0733fcf (+ 420 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-cpu2017rate--llvm-arm-master-Oz_LTO-build/287/
Filter

llvm-arm-master-Oz_LTO test results

Run Order Start Time Duration
Current 0287 (llvmorg-21-init-16066-gdad64877c811) 2025-06-16T19:31:26 0:00:00
Previous 0286 (llvmorg-21-init-15646-gac7af53d05b9) 2025-06-13T15:38:06 0:00:00
Baseline 0002 (llvmorg-17-init-04523-gc3801568ef2b) 2023-03-10T23:13:09 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 32 2
Performance Improvements 31 17
Added Tests 3 74
Unchanged Tests 564 537
Total Tests 630

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
525.x264_r 1.43% 4061.000 4119.000 - 0.66% -
505.mcf_r 1.32% 5684.000 5759.000 - -0.36% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
544.nab_r (unexplained diff vs previous) (percentage) 460.00% 0.050 0.280 - 0.00% -
544.nab_r (unexplained diff vs previous) 450.00% 4.000 22.000 - 0.00% -
525.x264_r (unexplained diff vs previous) 286.67% 15.000 58.000 - 0.00% -
525.x264_r (unexplained diff vs previous) (percentage) 281.08% 0.370 1.410 - 0.00% -
519.lbm_r (unexplained diff vs previous) 240.00% 5.000 17.000 - 0.00% -
519.lbm_r (unexplained diff vs previous) (percentage) 228.57% 0.140 0.460 - 0.00% -
538.imagick_r (unexplained diff vs previous) 200.00% 3.000 9.000 - 0.00% -
538.imagick_r (unexplained diff vs previous) (percentage) 200.00% 0.070 0.210 - 0.00% -
510.parest_r (unexplained diff vs previous) 180.00% 5.000 14.000 - 0.00% -
510.parest_r (unexplained diff vs previous) (percentage) 162.50% 0.080 0.210 - 0.00% -
541.leela_r (unexplained diff vs previous) (percentage) 91.46% 0.820 1.570 - 0.00% -
541.leela_r (unexplained diff vs previous) 87.50% 40.000 75.000 - 0.00% -
519.lbm_r (max) 41.67% 12.000 17.000 - 0.00% -
519.lbm_r (max) (percentage) 39.39% 0.330 0.460 - 0.00% -
505.mcf_r (max) 35.71% 56.000 76.000 - 0.00% -
541.leela_r (max) (percentage) 33.62% 1.160 1.550 - 0.00% -
505.mcf_r (max) (percentage) 33.33% 0.990 1.320 - 0.00% -
505.mcf_r (unexplained diff vs previous) 31.58% 57.000 75.000 - 0.00% -
541.leela_r (max) 30.36% 56.000 73.000 - 0.00% -
505.mcf_r (unexplained diff vs previous) (percentage) 30.00% 1.000 1.300 - 0.00% -
538.imagick_r (max) 28.57% 7.000 9.000 - 0.00% -
557.xz_r (unexplained diff vs previous) (percentage) 25.00% 1.000 1.250 - 0.00% -
557.xz_r (unexplained diff vs previous) 24.00% 25.000 31.000 - 0.00% -
538.imagick_r (max) (percentage) 23.53% 0.170 0.210 - 0.00% -
525.x264_r 4.00% 25.000 26.000 - 0.00% -
525.x264_r (avg) 4.00% 25.000 26.000 - 0.00% -
505.mcf_r 1.67% 60.000 61.000 - 0.00% -
505.mcf_r (avg) 1.67% 60.000 61.000 - 0.00% -
541.leela_r (avg) (percentage) 1.61% 0.620 0.630 - 0.00% -
525.x264_r (avg) (percentage) 1.59% 0.630 0.640 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
541.leela_r -1.55% 4849.000 4774.000 - -2.25% -
557.xz_r -1.24% 2505.000 2474.000 - -2.60% -
523.xalancbmk_r -1.02% 4010.000 3969.000 - -6.19% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
511.povray_r (max) (percentage) -84.54% 0.970 0.150 - 0.00% -
508.namd_r (unexplained diff vs previous) -50.00% 20.000 10.000 - 0.00% -
508.namd_r (unexplained diff vs previous) (percentage) -50.00% 0.540 0.270 - 0.00% -
520.omnetpp_r (unexplained diff vs previous) -45.61% 57.000 31.000 - 0.00% -
520.omnetpp_r (unexplained diff vs previous) (percentage) -44.74% 1.520 0.840 - 0.00% -
526.blender_r (max) -43.18% 132.000 75.000 - 0.00% -
526.blender_r (max) (percentage) -42.72% 1.030 0.590 - 0.00% -
508.namd_r (max) -20.00% 20.000 16.000 - 0.00% -
508.namd_r (max) (percentage) -16.67% 0.540 0.450 - 0.00% -
531.deepsjeng_r (max) -10.34% 29.000 26.000 - 0.00% -
531.deepsjeng_r (max) (percentage) -9.09% 0.550 0.500 - 0.00% -
520.omnetpp_r (max) -8.77% 57.000 52.000 - 0.00% -
557.xz_r (max) -8.62% 58.000 53.000 - 0.00% -
520.omnetpp_r (max) (percentage) -8.39% 1.550 1.420 - 0.00% -
557.xz_r (max) (percentage) -6.90% 2.320 2.160 - 0.00% -
544.nab_r (max) (percentage) -6.45% 0.310 0.290 - 0.00% -
525.x264_r (max) (percentage) -6.36% 2.200 2.060 - 0.00% -
525.x264_r (max) -5.62% 89.000 84.000 - 0.00% -
544.nab_r (max) -4.17% 24.000 23.000 - 0.00% -
557.xz_r -3.12% 32.000 31.000 - 0.00% -
557.xz_r (avg) -3.12% 32.000 31.000 - 0.00% -
523.xalancbmk_r (max) -2.94% 34.000 33.000 - 0.00% -
526.blender_r (unexplained diff vs previous) (percentage) -2.38% 0.420 0.410 - 0.00% -
511.povray_r (avg) (percentage) -2.27% 0.880 0.860 - 0.00% -
526.blender_r (unexplained diff vs previous) -1.85% 54.000 53.000 - 0.00% -
526.blender_r -1.47% 68.000 67.000 - 0.00% -
526.blender_r (avg) -1.47% 68.000 67.000 - 0.00% -
510.parest_r (avg) (percentage) -1.33% 0.750 0.740 - 0.00% -

Added Tests - sample variability
511.povray_r (max)
511.povray_r (unexplained diff vs previous)
511.povray_r (unexplained diff vs previous) (percentage)

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
520.omnetpp_r 4.48% 3551.000 3710.000 - -0.83% -
508.namd_r 1.14% 3677.000 3719.000 - 0.27% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
510.parest_r -2.39% 752512.000 734494.000 - 0.00% -
541.leela_r -1.72% 43421.000 42676.000 - 0.00% -
511.povray_r -1.66% 521730.000 513085.000 - 0.00% -
544.nab_r -1.38% 49925.000 49237.000 - 0.00% -
502.gcc_r -1.21% 4484801.000 4430672.000 - -0.00% -
520.omnetpp_r -1.20% 825977.000 816051.000 - 0.00% -
557.xz_r -1.20% 80439.000 79475.000 - 0.00% -
531.deepsjeng_r -1.04% 50472.000 49947.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
523.xalancbmk_r -6.19% 4231.000 3969.000 - -1.02% -
557.xz_r -2.60% 2540.000 2474.000 - -1.24% -
538.imagick_r -2.27% 4457.000 4356.000 - -0.21% -
541.leela_r -2.25% 4884.000 4774.000 - -1.55% -
519.lbm_r -1.68% 3760.000 3697.000 - 0.46% -
502.gcc_r -1.67% 3957.000 3891.000 - -0.87% -
510.parest_r -1.35% 6604.000 6515.000 - 0.22% -
531.deepsjeng_r -1.27% 5427.000 5358.000 - 0.07% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful 6.67% 15.000 16.000 - 0.00% -

Added Tests - sample variability
500.perlbench_r (avg) (percentage)
500.perlbench_r (max) (percentage)
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
511.povray_r (unexplained diff vs previous)
511.povray_r (unexplained diff vs previous) (percentage)
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)
520.omnetpp_r
520.omnetpp_r (avg)
520.omnetpp_r (avg) (percentage)
520.omnetpp_r (max)
520.omnetpp_r (max) (percentage)
523.xalancbmk_r
523.xalancbmk_r (avg)
523.xalancbmk_r (avg) (percentage)
523.xalancbmk_r (max)
523.xalancbmk_r (max) (percentage)
525.x264_r
525.x264_r (avg)
525.x264_r (avg) (percentage)
525.x264_r (max)
525.x264_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
538.imagick_r
538.imagick_r (avg)
538.imagick_r (avg) (percentage)
538.imagick_r (max)
538.imagick_r (max) (percentage)
541.leela_r
541.leela_r (avg)
541.leela_r (avg) (percentage)
541.leela_r (max)
541.leela_r (max) (percentage)
544.nab_r
544.nab_r (avg)
544.nab_r (avg) (percentage)
544.nab_r (max)
544.nab_r (max) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)


Report Time: 0.21s
Name Current %
502.gcc_r 3891.000 -
505.mcf_r 5759.000 1.32%
508.namd_r 3719.000 -
510.parest_r 6515.000 -
511.povray_r 490.000 -
519.lbm_r 3697.000 -
520.omnetpp_r 3710.000 -
523.xalancbmk_r 3969.000 -1.02%
525.x264_r 4119.000 1.43%
526.blender_r 12823.000 -
531.deepsjeng_r 5358.000 -
538.imagick_r 4356.000 -
541.leela_r 4774.000 -1.55%
544.nab_r 7968.000 -
557.xz_r 2474.000 -1.24%
Geometric Mean 4121.198 -
Name Current %
502.gcc_r 4430672.000 -
505.mcf_r 12341.000 -
508.namd_r 274903.000 -
510.parest_r 734494.000 -
511.povray_r 513085.000 -
519.lbm_r 9280.000 -
520.omnetpp_r 816051.000 -
523.xalancbmk_r 1709042.000 -
525.x264_r 268996.000 -
526.blender_r 5787410.000 -
531.deepsjeng_r 49947.000 -
538.imagick_r 709199.000 -
541.leela_r 42676.000 -
544.nab_r 49237.000 -
557.xz_r 79475.000 -
Geometric Mean 244696.203 -
Name Current %
500.perlbench_r (avg) (percentage) 1.630 -
500.perlbench_r (max) (percentage) 0.720 -
505.mcf_r 61.000 1.67%
505.mcf_r (avg) 61.000 1.67%
505.mcf_r (avg) (percentage) 1.060 -
505.mcf_r (max) 76.000 35.71%
505.mcf_r (max) (percentage) 1.320 33.33%
505.mcf_r (unexplained diff vs previous) 75.000 31.58%
505.mcf_r (unexplained diff vs previous) (percentage) 1.300 30.00%
508.namd_r 15.000 -
508.namd_r (avg) 15.000 -
508.namd_r (avg) (percentage) 0.430 -
508.namd_r (max) 16.000 -20.00%
508.namd_r (max) (percentage) 0.450 -16.67%
508.namd_r (unexplained diff vs previous) 10.000 -50.00%
508.namd_r (unexplained diff vs previous) (percentage) 0.270 -50.00%
510.parest_r 48.000 -
510.parest_r (avg) 48.000 -
510.parest_r (avg) (percentage) 0.740 -1.33%
510.parest_r (max) 26.000 -
510.parest_r (max) (percentage) 0.410 -
510.parest_r (unexplained diff vs previous) 14.000 180.00%
510.parest_r (unexplained diff vs previous) (percentage) 0.210 162.50%
511.povray_r 4.000 -
511.povray_r (avg) 4.000 -
511.povray_r (avg) (percentage) 0.860 -2.27%
511.povray_r (max) 0.000 -
511.povray_r (max) (percentage) 0.150 -84.54%
511.povray_r (unexplained diff vs previous) 0.000 -
511.povray_r (unexplained diff vs previous) (percentage) 0.000 -
519.lbm_r 11.000 -
519.lbm_r (avg) 11.000 -
519.lbm_r (avg) (percentage) 0.300 -
519.lbm_r (max) 17.000 41.67%
519.lbm_r (max) (percentage) 0.460 39.39%
519.lbm_r (unexplained diff vs previous) 17.000 240.00%
519.lbm_r (unexplained diff vs previous) (percentage) 0.460 228.57%
520.omnetpp_r 41.000 -
520.omnetpp_r (avg) 41.000 -
520.omnetpp_r (avg) (percentage) 1.110 -
520.omnetpp_r (max) 52.000 -8.77%
520.omnetpp_r (max) (percentage) 1.420 -8.39%
520.omnetpp_r (unexplained diff vs previous) 31.000 -45.61%
520.omnetpp_r (unexplained diff vs previous) (percentage) 0.840 -44.74%
523.xalancbmk_r 31.000 -
523.xalancbmk_r (avg) 31.000 -
523.xalancbmk_r (avg) (percentage) 0.790 -
523.xalancbmk_r (max) 33.000 -2.94%
523.xalancbmk_r (max) (percentage) 0.850 -
525.x264_r 26.000 4.00%
525.x264_r (avg) 26.000 4.00%
525.x264_r (avg) (percentage) 0.640 1.59%
525.x264_r (max) 84.000 -5.62%
525.x264_r (max) (percentage) 2.060 -6.36%
525.x264_r (unexplained diff vs previous) 58.000 286.67%
525.x264_r (unexplained diff vs previous) (percentage) 1.410 281.08%
526.blender_r 67.000 -1.47%
526.blender_r (avg) 67.000 -1.47%
526.blender_r (avg) (percentage) 0.530 -
526.blender_r (max) 75.000 -43.18%
526.blender_r (max) (percentage) 0.590 -42.72%
526.blender_r (unexplained diff vs previous) 53.000 -1.85%
526.blender_r (unexplained diff vs previous) (percentage) 0.410 -2.38%
531.deepsjeng_r 20.000 -
531.deepsjeng_r (avg) 20.000 -
531.deepsjeng_r (avg) (percentage) 0.380 -
531.deepsjeng_r (max) 26.000 -10.34%
531.deepsjeng_r (max) (percentage) 0.500 -9.09%
531.deepsjeng_r (unexplained diff vs previous) 4.000 -
531.deepsjeng_r (unexplained diff vs previous) (percentage) 0.070 -
538.imagick_r 6.000 -
538.imagick_r (avg) 6.000 -
538.imagick_r (avg) (percentage) 0.150 -
538.imagick_r (max) 9.000 28.57%
538.imagick_r (max) (percentage) 0.210 23.53%
538.imagick_r (unexplained diff vs previous) 9.000 200.00%
538.imagick_r (unexplained diff vs previous) (percentage) 0.210 200.00%
541.leela_r 30.000 -
541.leela_r (avg) 30.000 -
541.leela_r (avg) (percentage) 0.630 1.61%
541.leela_r (max) 73.000 30.36%
541.leela_r (max) (percentage) 1.550 33.62%
541.leela_r (unexplained diff vs previous) 75.000 87.50%
541.leela_r (unexplained diff vs previous) (percentage) 1.570 91.46%
544.nab_r 27.000 -
544.nab_r (avg) 27.000 -
544.nab_r (avg) (percentage) 0.350 -
544.nab_r (max) 23.000 -4.17%
544.nab_r (max) (percentage) 0.290 -6.45%
544.nab_r (unexplained diff vs previous) 22.000 450.00%
544.nab_r (unexplained diff vs previous) (percentage) 0.280 460.00%
557.xz_r 31.000 -3.12%
557.xz_r (avg) 31.000 -3.12%
557.xz_r (avg) (percentage) 1.290 -
557.xz_r (max) 53.000 -8.62%
557.xz_r (max) (percentage) 2.160 -6.90%
557.xz_r (unexplained diff vs previous) 31.000 24.00%
557.xz_r (unexplained diff vs previous) (percentage) 1.250 25.00%
Geometric Mean 3.475 -19.77%