Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/3531cc1cc777af5ea198c17c62f7324779b707e4 (+ 793 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-cpu2017rate--llvm-arm-master-Oz_LTO-build/152/
Filter

llvm-arm-master-Oz_LTO test results

Run Order Start Time Duration
Current 0152 (llvmorg-21-init-14230-g3531cc1cc777) 2025-05-28T05:22:24 0:00:00
Previous 0150 (llvmorg-21-init-13437-g0b75a2099041) 2025-05-21T08:10:12 0:00:00
Baseline 0025 (llvmorg-19-init-16254-g1846523bb772) 2024-07-02T11:39:54 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 26 4
Performance Improvements 44 6
Added Tests 0 74
Unchanged Tests 560 546
Total Tests 630

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
523.xalancbmk_r 1.65% 10871.000 11050.000 - 0.00% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
541.leela_r (unexplained diff vs previous) 850.00% 2.000 19.000 - 0.00% -
541.leela_r (unexplained diff vs previous) (percentage) 700.00% 0.020 0.160 - 0.00% -
520.omnetpp_r (unexplained diff vs previous) (percentage) 242.11% 0.190 0.650 - 0.00% -
520.omnetpp_r (unexplained diff vs previous) 240.00% 25.000 85.000 - 0.00% -
525.x264_r (unexplained diff vs previous) (percentage) 200.00% 0.040 0.120 - 0.00% -
525.x264_r (unexplained diff vs previous) 183.33% 6.000 17.000 - 0.00% -
557.xz_r (unexplained diff vs previous) (percentage) 116.67% 0.120 0.260 - 0.00% -
557.xz_r (unexplained diff vs previous) 107.69% 13.000 27.000 - 0.00% -
520.omnetpp_r (max) (percentage) 73.68% 0.380 0.660 - 0.00% -
520.omnetpp_r (max) 73.47% 49.000 85.000 - 0.00% -
557.xz_r (max) (percentage) 30.00% 0.200 0.260 - 0.00% -
557.xz_r (max) 28.57% 21.000 27.000 - 0.00% -
544.nab_r (unexplained diff vs previous) (percentage) 25.00% 0.200 0.250 - 0.00% -
544.nab_r (unexplained diff vs previous) 21.74% 23.000 28.000 - 0.00% -
508.namd_r (max) 9.09% 33.000 36.000 - 0.00% -
508.namd_r (unexplained diff vs previous) 8.82% 34.000 37.000 - 0.00% -
508.namd_r (max) (percentage) 8.82% 0.340 0.370 - 0.00% -
508.namd_r (unexplained diff vs previous) (percentage) 8.82% 0.340 0.370 - 0.00% -
557.xz_r 5.88% 17.000 18.000 - 0.00% -
557.xz_r (avg) 5.88% 17.000 18.000 - 0.00% -
508.namd_r 5.00% 20.000 21.000 - 0.00% -
508.namd_r (avg) 5.00% 20.000 21.000 - 0.00% -
508.namd_r (avg) (percentage) 4.76% 0.210 0.220 - 0.00% -
505.mcf_r (unexplained diff vs previous) (percentage) 3.85% 0.260 0.270 - 0.00% -
505.mcf_r (unexplained diff vs previous) 2.94% 34.000 35.000 - 0.00% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
526.blender_r (unexplained diff vs previous) -71.43% 7.000 2.000 - 0.00% -
526.blender_r (unexplained diff vs previous) (percentage) -66.67% 0.060 0.020 - 0.00% -
531.deepsjeng_r (unexplained diff vs previous) (percentage) -47.37% 0.570 0.300 - 0.00% -
531.deepsjeng_r (unexplained diff vs previous) -46.67% 60.000 32.000 - 0.00% -
519.lbm_r (max) -45.10% 51.000 28.000 - 0.00% -
519.lbm_r (max) (percentage) -44.12% 0.340 0.190 - 0.00% -
519.lbm_r (unexplained diff vs previous) (percentage) -30.43% 0.230 0.160 - 0.00% -
519.lbm_r (unexplained diff vs previous) -29.41% 34.000 24.000 - 0.00% -
505.mcf_r (max) -12.77% 47.000 41.000 - 0.00% -
505.mcf_r (max) (percentage) -11.11% 0.360 0.320 - 0.00% -
538.imagick_r (max) (percentage) -10.53% 0.380 0.340 - 0.00% -
538.imagick_r (max) -9.80% 51.000 46.000 - 0.00% -
510.parest_r (max) (percentage) -9.09% 0.220 0.200 - 0.00% -
510.parest_r (max) -8.16% 49.000 45.000 - 0.00% -
526.blender_r (max) -8.11% 37.000 34.000 - 0.00% -
511.povray_r (max) (percentage) -7.89% 0.380 0.350 - 0.00% -
544.nab_r (max) -7.89% 76.000 70.000 - 0.00% -
544.nab_r (max) (percentage) -7.46% 0.670 0.620 - 0.00% -
511.povray_r (max) -6.85% 73.000 68.000 - 0.00% -
526.blender_r (max) (percentage) -6.45% 0.310 0.290 - 0.00% -
526.blender_r (avg) (percentage) -5.71% 0.350 0.330 - 0.00% -
541.leela_r (max) (percentage) -5.71% 0.350 0.330 - 0.00% -
525.x264_r (max) -5.08% 59.000 56.000 - 0.00% -
531.deepsjeng_r (max) (percentage) -4.93% 2.230 2.120 - 0.00% -
526.blender_r -4.88% 41.000 39.000 - 0.00% -
526.blender_r (avg) -4.88% 41.000 39.000 - 0.00% -
541.leela_r (max) -4.88% 41.000 39.000 - 0.00% -
525.x264_r (max) (percentage) -4.88% 0.410 0.390 - 0.00% -
523.xalancbmk_r (max) (percentage) -4.76% 0.420 0.400 - 0.00% -
531.deepsjeng_r (max) -4.72% 233.000 222.000 - 0.00% -
541.leela_r (avg) (percentage) -4.35% 0.230 0.220 - 0.00% -
531.deepsjeng_r (avg) (percentage) -3.90% 0.770 0.740 - 0.00% -
531.deepsjeng_r -3.75% 80.000 77.000 - 0.00% -
531.deepsjeng_r (avg) -3.75% 80.000 77.000 - 0.00% -
541.leela_r -3.70% 27.000 26.000 - 0.00% -
541.leela_r (avg) -3.70% 27.000 26.000 - 0.00% -
544.nab_r (avg) (percentage) -2.56% 0.390 0.380 - 0.00% -
544.nab_r -2.27% 44.000 43.000 - 0.00% -
544.nab_r (avg) -2.27% 44.000 43.000 - 0.00% -
523.xalancbmk_r (max) -2.22% 45.000 44.000 - 0.00% -
520.omnetpp_r (avg) (percentage) -1.37% 0.730 0.720 - 0.00% -
500.perlbench_r (max) (percentage) -1.23% 0.810 0.800 - 0.00% -
520.omnetpp_r -1.06% 94.000 93.000 - 0.00% -
520.omnetpp_r (avg) -1.06% 94.000 93.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
519.lbm_r 20.35% 12552.000 15106.000 - 0.16% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests -52.94% 34.000 16.000 - 0.00% -
nb_execution_successful -50.00% 30.000 15.000 - 0.00% -
nb_compile_successful -46.67% 30.000 16.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
511.povray_r -2.79% 19998.000 19440.000 - -0.02% -
538.imagick_r -2.54% 14043.000 13686.000 - 0.22% -
531.deepsjeng_r -2.24% 10739.000 10498.000 - 0.31% -
520.omnetpp_r -1.97% 13266.000 13005.000 - 0.66% -
526.blender_r -1.34% 12129.000 11966.000 - 0.02% -
502.gcc_r -1.11% 9947.000 9837.000 - -0.68% -

Added Tests - Code Size
523.xalancbmk_r

Added Tests - Execution
523.xalancbmk_r

Added Tests - sample variability
500.perlbench_r (avg) (percentage)
500.perlbench_r (max) (percentage)
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)
520.omnetpp_r
520.omnetpp_r (avg)
520.omnetpp_r (avg) (percentage)
520.omnetpp_r (max)
520.omnetpp_r (max) (percentage)
523.xalancbmk_r
523.xalancbmk_r (avg)
523.xalancbmk_r (avg) (percentage)
523.xalancbmk_r (max)
523.xalancbmk_r (max) (percentage)
525.x264_r
525.x264_r (avg)
525.x264_r (avg) (percentage)
525.x264_r (max)
525.x264_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
538.imagick_r
538.imagick_r (avg)
538.imagick_r (avg) (percentage)
538.imagick_r (max)
538.imagick_r (max) (percentage)
541.leela_r
541.leela_r (avg)
541.leela_r (avg) (percentage)
541.leela_r (max)
541.leela_r (max) (percentage)
544.nab_r
544.nab_r (avg)
544.nab_r (avg) (percentage)
544.nab_r (max)
544.nab_r (max) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)


Report Time: 0.22s
Name Current %
502.gcc_r 9837.000 -
505.mcf_r 13095.000 -
508.namd_r 9922.000 -
510.parest_r 22692.000 -
511.povray_r 19440.000 -
519.lbm_r 15106.000 -
520.omnetpp_r 13005.000 -
523.xalancbmk_r 11050.000 1.65%
525.x264_r 14504.000 -
526.blender_r 11966.000 -
531.deepsjeng_r 10498.000 -
538.imagick_r 13686.000 -
541.leela_r 11932.000 -
544.nab_r 11416.000 -
557.xz_r 10516.000 -
Geometric Mean 12864.031 -
Name Current %
502.gcc_r 4423189.000 -
505.mcf_r 12337.000 -
508.namd_r 276957.000 -
510.parest_r 747793.000 -
511.povray_r 515248.000 -
519.lbm_r 9288.000 -
520.omnetpp_r 823868.000 -
523.xalancbmk_r 1705144.000 -
525.x264_r 269385.000 -
526.blender_r 5793371.000 -
531.deepsjeng_r 49926.000 -
538.imagick_r 712156.000 -
541.leela_r 43200.000 -
544.nab_r 49197.000 -
557.xz_r 80059.000 -
Geometric Mean 245687.097 -
Name Current %
500.perlbench_r (avg) (percentage) 0.470 -
500.perlbench_r (max) (percentage) 0.800 -1.23%
505.mcf_r 40.000 -
505.mcf_r (avg) 40.000 -
505.mcf_r (avg) (percentage) 0.310 -
505.mcf_r (max) 41.000 -12.77%
505.mcf_r (max) (percentage) 0.320 -11.11%
505.mcf_r (unexplained diff vs previous) 35.000 2.94%
505.mcf_r (unexplained diff vs previous) (percentage) 0.270 3.85%
508.namd_r 21.000 5.00%
508.namd_r (avg) 21.000 5.00%
508.namd_r (avg) (percentage) 0.220 4.76%
508.namd_r (max) 36.000 9.09%
508.namd_r (max) (percentage) 0.370 8.82%
508.namd_r (unexplained diff vs previous) 37.000 8.82%
508.namd_r (unexplained diff vs previous) (percentage) 0.370 8.82%
510.parest_r 29.000 -
510.parest_r (avg) 29.000 -
510.parest_r (avg) (percentage) 0.130 -
510.parest_r (max) 45.000 -8.16%
510.parest_r (max) (percentage) 0.200 -9.09%
511.povray_r 56.000 -
511.povray_r (avg) 56.000 -
511.povray_r (avg) (percentage) 0.290 -
511.povray_r (max) 68.000 -6.85%
511.povray_r (max) (percentage) 0.350 -7.89%
519.lbm_r 27.000 -
519.lbm_r (avg) 27.000 -
519.lbm_r (avg) (percentage) 0.180 -
519.lbm_r (max) 28.000 -45.10%
519.lbm_r (max) (percentage) 0.190 -44.12%
519.lbm_r (unexplained diff vs previous) 24.000 -29.41%
519.lbm_r (unexplained diff vs previous) (percentage) 0.160 -30.43%
520.omnetpp_r 93.000 -1.06%
520.omnetpp_r (avg) 93.000 -1.06%
520.omnetpp_r (avg) (percentage) 0.720 -1.37%
520.omnetpp_r (max) 85.000 73.47%
520.omnetpp_r (max) (percentage) 0.660 73.68%
520.omnetpp_r (unexplained diff vs previous) 85.000 240.00%
520.omnetpp_r (unexplained diff vs previous) (percentage) 0.650 242.11%
523.xalancbmk_r 38.000 -
523.xalancbmk_r (avg) 38.000 -
523.xalancbmk_r (avg) (percentage) 0.350 -
523.xalancbmk_r (max) 44.000 -2.22%
523.xalancbmk_r (max) (percentage) 0.400 -4.76%
525.x264_r 27.000 -
525.x264_r (avg) 27.000 -
525.x264_r (avg) (percentage) 0.190 -
525.x264_r (max) 56.000 -5.08%
525.x264_r (max) (percentage) 0.390 -4.88%
525.x264_r (unexplained diff vs previous) 17.000 183.33%
525.x264_r (unexplained diff vs previous) (percentage) 0.120 200.00%
526.blender_r 39.000 -4.88%
526.blender_r (avg) 39.000 -4.88%
526.blender_r (avg) (percentage) 0.330 -5.71%
526.blender_r (max) 34.000 -8.11%
526.blender_r (max) (percentage) 0.290 -6.45%
526.blender_r (unexplained diff vs previous) 2.000 -71.43%
526.blender_r (unexplained diff vs previous) (percentage) 0.020 -66.67%
531.deepsjeng_r 77.000 -3.75%
531.deepsjeng_r (avg) 77.000 -3.75%
531.deepsjeng_r (avg) (percentage) 0.740 -3.90%
531.deepsjeng_r (max) 222.000 -4.72%
531.deepsjeng_r (max) (percentage) 2.120 -4.93%
531.deepsjeng_r (unexplained diff vs previous) 32.000 -46.67%
531.deepsjeng_r (unexplained diff vs previous) (percentage) 0.300 -47.37%
538.imagick_r 45.000 -
538.imagick_r (avg) 45.000 -
538.imagick_r (avg) (percentage) 0.330 -
538.imagick_r (max) 46.000 -9.80%
538.imagick_r (max) (percentage) 0.340 -10.53%
541.leela_r 26.000 -3.70%
541.leela_r (avg) 26.000 -3.70%
541.leela_r (avg) (percentage) 0.220 -4.35%
541.leela_r (max) 39.000 -4.88%
541.leela_r (max) (percentage) 0.330 -5.71%
541.leela_r (unexplained diff vs previous) 19.000 850.00%
541.leela_r (unexplained diff vs previous) (percentage) 0.160 700.00%
544.nab_r 43.000 -2.27%
544.nab_r (avg) 43.000 -2.27%
544.nab_r (avg) (percentage) 0.380 -2.56%
544.nab_r (max) 70.000 -7.89%
544.nab_r (max) (percentage) 0.620 -7.46%
544.nab_r (unexplained diff vs previous) 28.000 21.74%
544.nab_r (unexplained diff vs previous) (percentage) 0.250 25.00%
557.xz_r 18.000 5.88%
557.xz_r (avg) 18.000 5.88%
557.xz_r (avg) (percentage) 0.180 -
557.xz_r (max) 27.000 28.57%
557.xz_r (max) (percentage) 0.260 30.00%
557.xz_r (unexplained diff vs previous) 27.000 107.69%
557.xz_r (unexplained diff vs previous) (percentage) 0.260 116.67%
Geometric Mean 4.553 6.35%