Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/b7d0c9b9d8e2b5c5d6677e368e3cdaf438df294e (+ 726 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_vect-cpu2017rate--llvm-arm-master-O3_LTO-build/279/
Filter

llvm-arm-master-O3_LTO test results

Run Order Start Time Duration
Current 0279 (llvmorg-21-init-16261-gb7d0c9b9d8e2) 2025-06-18T08:41:00 0:00:00
Previous 0278 (no-change) 2025-06-14T15:26:00 0:00:00
Baseline 0001 (llvmorg-17-init-04410-g1b5a60511234) 2023-03-10T04:03:31 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 60 6
Performance Improvements 19 16
Added Tests 0 81
Unchanged Tests 575 551
Total Tests 654

Performance Regressions - Code Size Δ Previous Current σ Δ (B) σ (B)
500.perlbench_r 5.02% 2518326.000 2644866.000 - 3.57% -

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
520.omnetpp_r 3.43% 3408.000 3525.000 - 5.16% -
541.leela_r 2.05% 3906.000 3986.000 - -0.92% -
523.xalancbmk_r 1.81% 3308.000 3368.000 - 3.57% -
525.x264_r 1.57% 2732.000 2775.000 - -8.90% -
557.xz_r 1.33% 2261.000 2291.000 - -3.13% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
526.blender_r (unexplained diff vs previous) 9100.00% 1.000 92.000 - 0.00% -
526.blender_r (unexplained diff vs previous) (percentage) 8600.00% 0.010 0.870 - 0.00% -
544.nab_r (unexplained diff vs previous) 400.00% 7.000 35.000 - 0.00% -
557.xz_r (unexplained diff vs previous) 400.00% 6.000 30.000 - 0.00% -
520.omnetpp_r (unexplained diff vs previous) 387.50% 24.000 117.000 - 0.00% -
557.xz_r (unexplained diff vs previous) (percentage) 385.19% 0.270 1.310 - 0.00% -
544.nab_r (unexplained diff vs previous) (percentage) 380.00% 0.100 0.480 - 0.00% -
520.omnetpp_r (unexplained diff vs previous) (percentage) 374.29% 0.700 3.320 - 0.00% -
541.leela_r (max) 252.17% 23.000 81.000 - 0.00% -
519.lbm_r (unexplained diff vs previous) 250.00% 2.000 7.000 - 0.00% -
541.leela_r (max) (percentage) 236.07% 0.610 2.050 - 0.00% -
541.leela_r (unexplained diff vs previous) 233.33% 24.000 80.000 - 0.00% -
541.leela_r (unexplained diff vs previous) (percentage) 229.51% 0.610 2.010 - 0.00% -
519.lbm_r (unexplained diff vs previous) (percentage) 216.67% 0.060 0.190 - 0.00% -
520.omnetpp_r (max) 130.77% 52.000 120.000 - 0.00% -
520.omnetpp_r (max) (percentage) 124.18% 1.530 3.430 - 0.00% -
538.imagick_r (unexplained diff vs previous) (percentage) 120.00% 0.050 0.110 - 0.00% -
538.imagick_r (unexplained diff vs previous) 100.00% 2.000 4.000 - 0.00% -
508.namd_r (unexplained diff vs previous) (percentage) 73.47% 0.490 0.850 - 0.00% -
508.namd_r (unexplained diff vs previous) 73.33% 15.000 26.000 - 0.00% -
508.namd_r (max) 66.67% 15.000 25.000 - 0.00% -
508.namd_r (max) (percentage) 66.67% 0.510 0.850 - 0.00% -
531.deepsjeng_r (unexplained diff vs previous) (percentage) 55.56% 0.360 0.560 - 0.00% -
531.deepsjeng_r (unexplained diff vs previous) 52.63% 19.000 29.000 - 0.00% -
505.mcf_r (unexplained diff vs previous) (percentage) 40.00% 0.100 0.140 - 0.00% -
505.mcf_r (unexplained diff vs previous) 40.00% 5.000 7.000 - 0.00% -
544.nab_r (max) 40.00% 25.000 35.000 - 0.00% -
544.nab_r (max) (percentage) 37.14% 0.350 0.480 - 0.00% -
531.deepsjeng_r (max) (percentage) 25.00% 0.440 0.550 - 0.00% -
531.deepsjeng_r (max) 21.74% 23.000 28.000 - 0.00% -
500.perlbench_r (unexplained diff vs previous) (percentage) 14.04% 2.850 3.250 - 0.00% -
500.perlbench_r (max) (percentage) 13.72% 2.770 3.150 - 0.00% -
557.xz_r (max) 11.11% 27.000 30.000 - 0.00% -
500.perlbench_r (unexplained diff vs previous) 10.61% 66.000 73.000 - 0.00% -
500.perlbench_r (max) 9.38% 64.000 70.000 - 0.00% -
557.xz_r (max) (percentage) 9.02% 1.220 1.330 - 0.00% -
541.leela_r 8.33% 24.000 26.000 - 0.00% -
541.leela_r (avg) 8.33% 24.000 26.000 - 0.00% -
520.omnetpp_r 7.89% 38.000 41.000 - 0.00% -
520.omnetpp_r (avg) 7.89% 38.000 41.000 - 0.00% -
508.namd_r 7.69% 13.000 14.000 - 0.00% -
508.namd_r (avg) 7.69% 13.000 14.000 - 0.00% -
526.blender_r (max) (percentage) 3.61% 0.830 0.860 - 0.00% -
557.xz_r 3.57% 28.000 29.000 - 0.00% -
557.xz_r (avg) 3.57% 28.000 29.000 - 0.00% -
526.blender_r (max) 3.41% 88.000 91.000 - 0.00% -
541.leela_r (avg) (percentage) 3.13% 0.640 0.660 - 0.00% -
523.xalancbmk_r 3.03% 33.000 34.000 - 0.00% -
523.xalancbmk_r (avg) 3.03% 33.000 34.000 - 0.00% -
525.x264_r 2.70% 37.000 38.000 - 0.00% -
525.x264_r (avg) 2.70% 37.000 38.000 - 0.00% -
520.omnetpp_r (avg) (percentage) 2.63% 1.140 1.170 - 0.00% -
500.perlbench_r (avg) (percentage) 2.53% 1.580 1.620 - 0.00% -
508.namd_r (avg) (percentage) 2.22% 0.450 0.460 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
500.perlbench_r -3.15% 2319.000 2246.000 - -1.53% -
511.povray_r -1.67% 418.000 411.000 - -0.72% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
525.x264_r (unexplained diff vs previous) (percentage) -62.56% 4.140 1.550 - 0.00% -
525.x264_r (unexplained diff vs previous) -61.95% 113.000 43.000 - 0.00% -
525.x264_r (max) (percentage) -24.94% 3.970 2.980 - 0.00% -
525.x264_r (max) -24.07% 108.000 82.000 - 0.00% -
510.parest_r (max) -12.50% 8.000 7.000 - 0.00% -
505.mcf_r (max) (percentage) -8.57% 1.050 0.960 - 0.00% -
538.imagick_r (max) (percentage) -7.69% 0.130 0.120 - 0.00% -
505.mcf_r (max) -7.55% 53.000 49.000 - 0.00% -
519.lbm_r (max) (percentage) -7.41% 0.270 0.250 - 0.00% -
510.parest_r (max) (percentage) -7.14% 0.140 0.130 - 0.00% -
531.deepsjeng_r -4.17% 24.000 23.000 - 0.00% -
531.deepsjeng_r (avg) -4.17% 24.000 23.000 - 0.00% -
523.xalancbmk_r (max) (percentage) -2.38% 0.420 0.410 - 0.00% -
526.blender_r -1.89% 53.000 52.000 - 0.00% -
526.blender_r (avg) -1.89% 53.000 52.000 - 0.00% -
511.povray_r (max) (percentage) -1.54% 0.650 0.640 - 0.00% -
505.mcf_r (avg) (percentage) -1.35% 0.740 0.730 - 0.00% -

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
531.deepsjeng_r 6.42% 111064.000 118193.000 - 0.00% -
500.perlbench_r 3.57% 2553730.000 2644866.000 - 5.02% -
519.lbm_r 3.07% 11062.000 11402.000 - 0.00% -
557.xz_r 1.10% 138527.000 140055.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
520.omnetpp_r 5.16% 3352.000 3525.000 - 3.43% -
523.xalancbmk_r 3.57% 3252.000 3368.000 - 1.81% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
505.mcf_r -4.76% 27652.000 26336.000 - 0.00% -
520.omnetpp_r -3.98% 1659089.000 1593032.000 - -0.00% -
525.x264_r -3.79% 607706.000 584661.000 - 0.06% -
511.povray_r -2.33% 1171095.000 1143835.000 - -0.02% -
544.nab_r -1.50% 86308.000 85016.000 - 0.00% -
523.xalancbmk_r -1.23% 3658946.000 3613874.000 - -0.01% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
525.x264_r -8.90% 3046.000 2775.000 - 1.57% -
519.lbm_r -3.36% 3725.000 3600.000 - 0.19% -
557.xz_r -3.13% 2365.000 2291.000 - 1.33% -
505.mcf_r -3.08% 5296.000 5133.000 - 0.14% -
531.deepsjeng_r -2.76% 5354.000 5206.000 - -0.55% -
510.parest_r -1.73% 5901.000 5799.000 - 0.38% -
508.namd_r -1.68% 3098.000 3046.000 - -0.85% -
500.perlbench_r -1.53% 2281.000 2246.000 - -3.15% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_execution_successful 14.29% 14.000 16.000 - 0.00% -
nb_compile_successful 6.67% 15.000 16.000 - 0.00% -

Added Tests - Code Size
502.gcc_r
526.blender_r

Added Tests - Execution
502.gcc_r
526.blender_r

Added Tests - sample variability
500.perlbench_r
500.perlbench_r (avg)
500.perlbench_r (avg) (percentage)
500.perlbench_r (max)
500.perlbench_r (max) (percentage)
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)
520.omnetpp_r
520.omnetpp_r (avg)
520.omnetpp_r (avg) (percentage)
520.omnetpp_r (max)
520.omnetpp_r (max) (percentage)
523.xalancbmk_r
523.xalancbmk_r (avg)
523.xalancbmk_r (avg) (percentage)
523.xalancbmk_r (max)
523.xalancbmk_r (max) (percentage)
525.x264_r
525.x264_r (avg)
525.x264_r (avg) (percentage)
525.x264_r (max)
525.x264_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
526.blender_r (unexplained diff vs previous)
526.blender_r (unexplained diff vs previous) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
538.imagick_r
538.imagick_r (avg)
538.imagick_r (avg) (percentage)
538.imagick_r (max)
538.imagick_r (max) (percentage)
541.leela_r
541.leela_r (avg)
541.leela_r (avg) (percentage)
541.leela_r (max)
541.leela_r (max) (percentage)
544.nab_r
544.nab_r (avg)
544.nab_r (avg) (percentage)
544.nab_r (max)
544.nab_r (max) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)


Report Time: 0.23s
Name Current %
500.perlbench_r 2246.000 -3.15%
502.gcc_r 3530.000 -
505.mcf_r 5133.000 -
508.namd_r 3046.000 -
510.parest_r 5799.000 -
511.povray_r 411.000 -1.67%
519.lbm_r 3600.000 -
520.omnetpp_r 3525.000 3.43%
523.xalancbmk_r 3368.000 1.81%
525.x264_r 2775.000 1.57%
526.blender_r 10596.000 -
531.deepsjeng_r 5206.000 -
538.imagick_r 3799.000 -
541.leela_r 3986.000 2.05%
544.nab_r 7295.000 -
557.xz_r 2291.000 1.33%
Geometric Mean 3492.147 -
Name Current %
500.perlbench_r 2644866.000 5.02%
502.gcc_r 10592038.000 -
505.mcf_r 26336.000 -
508.namd_r 495718.000 -
510.parest_r 1841859.000 -
511.povray_r 1143835.000 -
519.lbm_r 11402.000 -
520.omnetpp_r 1593032.000 -
523.xalancbmk_r 3613874.000 -
525.x264_r 584661.000 -
526.blender_r 13638087.000 -
531.deepsjeng_r 118193.000 -
538.imagick_r 1321948.000 -
541.leela_r 93461.000 -
544.nab_r 85016.000 -
557.xz_r 140055.000 -
Geometric Mean 550004.464 -
Name Current %
500.perlbench_r 36.000 -
500.perlbench_r (avg) 36.000 -
500.perlbench_r (avg) (percentage) 1.620 2.53%
500.perlbench_r (max) 70.000 9.38%
500.perlbench_r (max) (percentage) 3.150 13.72%
500.perlbench_r (unexplained diff vs previous) 73.000 10.61%
500.perlbench_r (unexplained diff vs previous) (percentage) 3.250 14.04%
505.mcf_r 37.000 -
505.mcf_r (avg) 37.000 -
505.mcf_r (avg) (percentage) 0.730 -1.35%
505.mcf_r (max) 49.000 -7.55%
505.mcf_r (max) (percentage) 0.960 -8.57%
505.mcf_r (unexplained diff vs previous) 7.000 40.00%
505.mcf_r (unexplained diff vs previous) (percentage) 0.140 40.00%
508.namd_r 14.000 7.69%
508.namd_r (avg) 14.000 7.69%
508.namd_r (avg) (percentage) 0.460 2.22%
508.namd_r (max) 25.000 66.67%
508.namd_r (max) (percentage) 0.850 66.67%
508.namd_r (unexplained diff vs previous) 26.000 73.33%
508.namd_r (unexplained diff vs previous) (percentage) 0.850 73.47%
510.parest_r 99.000 -
510.parest_r (avg) 99.000 -
510.parest_r (avg) (percentage) 1.720 -
510.parest_r (max) 7.000 -12.50%
510.parest_r (max) (percentage) 0.130 -7.14%
511.povray_r 3.000 -
511.povray_r (avg) 3.000 -
511.povray_r (avg) (percentage) 0.920 -
511.povray_r (max) 2.000 -
511.povray_r (max) (percentage) 0.640 -1.54%
519.lbm_r 12.000 -
519.lbm_r (avg) 12.000 -
519.lbm_r (avg) (percentage) 0.360 -
519.lbm_r (max) 9.000 -
519.lbm_r (max) (percentage) 0.250 -7.41%
519.lbm_r (unexplained diff vs previous) 7.000 250.00%
519.lbm_r (unexplained diff vs previous) (percentage) 0.190 216.67%
520.omnetpp_r 41.000 7.89%
520.omnetpp_r (avg) 41.000 7.89%
520.omnetpp_r (avg) (percentage) 1.170 2.63%
520.omnetpp_r (max) 120.000 130.77%
520.omnetpp_r (max) (percentage) 3.430 124.18%
520.omnetpp_r (unexplained diff vs previous) 117.000 387.50%
520.omnetpp_r (unexplained diff vs previous) (percentage) 3.320 374.29%
523.xalancbmk_r 34.000 3.03%
523.xalancbmk_r (avg) 34.000 3.03%
523.xalancbmk_r (avg) (percentage) 1.020 -
523.xalancbmk_r (max) 13.000 -
523.xalancbmk_r (max) (percentage) 0.410 -2.38%
525.x264_r 38.000 2.70%
525.x264_r (avg) 38.000 2.70%
525.x264_r (avg) (percentage) 1.370 -
525.x264_r (max) 82.000 -24.07%
525.x264_r (max) (percentage) 2.980 -24.94%
525.x264_r (unexplained diff vs previous) 43.000 -61.95%
525.x264_r (unexplained diff vs previous) (percentage) 1.550 -62.56%
526.blender_r 52.000 -1.89%
526.blender_r (avg) 52.000 -1.89%
526.blender_r (avg) (percentage) 0.500 -
526.blender_r (max) 91.000 3.41%
526.blender_r (max) (percentage) 0.860 3.61%
526.blender_r (unexplained diff vs previous) 92.000 9100.00%
526.blender_r (unexplained diff vs previous) (percentage) 0.870 8600.00%
531.deepsjeng_r 23.000 -4.17%
531.deepsjeng_r (avg) 23.000 -4.17%
531.deepsjeng_r (avg) (percentage) 0.460 -
531.deepsjeng_r (max) 28.000 21.74%
531.deepsjeng_r (max) (percentage) 0.550 25.00%
531.deepsjeng_r (unexplained diff vs previous) 29.000 52.63%
531.deepsjeng_r (unexplained diff vs previous) (percentage) 0.560 55.56%
538.imagick_r 7.000 -
538.imagick_r (avg) 7.000 -
538.imagick_r (avg) (percentage) 0.210 -
538.imagick_r (max) 4.000 -
538.imagick_r (max) (percentage) 0.120 -7.69%
538.imagick_r (unexplained diff vs previous) 4.000 100.00%
538.imagick_r (unexplained diff vs previous) (percentage) 0.110 120.00%
541.leela_r 26.000 8.33%
541.leela_r (avg) 26.000 8.33%
541.leela_r (avg) (percentage) 0.660 3.13%
541.leela_r (max) 81.000 252.17%
541.leela_r (max) (percentage) 2.050 236.07%
541.leela_r (unexplained diff vs previous) 80.000 233.33%
541.leela_r (unexplained diff vs previous) (percentage) 2.010 229.51%
544.nab_r 32.000 -
544.nab_r (avg) 32.000 -
544.nab_r (avg) (percentage) 0.450 -
544.nab_r (max) 35.000 40.00%
544.nab_r (max) (percentage) 0.480 37.14%
544.nab_r (unexplained diff vs previous) 35.000 400.00%
544.nab_r (unexplained diff vs previous) (percentage) 0.480 380.00%
557.xz_r 29.000 3.57%
557.xz_r (avg) 29.000 3.57%
557.xz_r (avg) (percentage) 1.280 -
557.xz_r (max) 30.000 11.11%
557.xz_r (max) (percentage) 1.330 9.02%
557.xz_r (unexplained diff vs previous) 30.000 400.00%
557.xz_r (unexplained diff vs previous) (percentage) 1.310 385.19%
Geometric Mean 5.723 37.95%