Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/eb467a088bd9c5f2755cbc6152195670bf45ae0e (+ 7475 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-cpu2017rate--llvm-arm-master-Oz_LTO-build/147/
Filter

llvm-arm-master-Oz_LTO test results

Run Order Start Time Duration
Current 0147 (llvmorg-21-init-12400-geb467a088bd9) 2025-04-15T04:06:45 0:00:00
Previous 0141 (no-change) 2025-03-12T06:08:32 0:00:00
Baseline 0025 (llvmorg-19-init-16254-g1846523bb772) 2024-07-02T11:39:54 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 18 4
Performance Improvements 28 5
Added Tests 0 74
Unchanged Tests 596 559
Total Tests 642

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
557.xz_r (max) 500.00% 5.000 30.000 - 0.00% -
557.xz_r (unexplained diff vs previous) 500.00% 5.000 30.000 - 0.00% -
557.xz_r (max) (percentage) 480.00% 0.050 0.290 - 0.00% -
557.xz_r (unexplained diff vs previous) (percentage) 460.00% 0.050 0.280 - 0.00% -
525.x264_r (unexplained diff vs previous) (percentage) 358.33% 0.120 0.550 - 0.00% -
525.x264_r (unexplained diff vs previous) 344.44% 18.000 80.000 - 0.00% -
525.x264_r (max) (percentage) 44.74% 0.380 0.550 - 0.00% -
525.x264_r (max) 43.64% 55.000 79.000 - 0.00% -
520.omnetpp_r (unexplained diff vs previous) (percentage) 18.81% 1.010 1.200 - 0.00% -
520.omnetpp_r (unexplained diff vs previous) 18.18% 132.000 156.000 - 0.00% -
520.omnetpp_r (max) (percentage) 16.67% 1.020 1.190 - 0.00% -
520.omnetpp_r (max) 15.79% 133.000 154.000 - 0.00% -
525.x264_r 7.41% 27.000 29.000 - 0.00% -
525.x264_r (avg) 7.41% 27.000 29.000 - 0.00% -
525.x264_r (avg) (percentage) 5.26% 0.190 0.200 - 0.00% -
541.leela_r 3.33% 30.000 31.000 - 0.00% -
541.leela_r (avg) 3.33% 30.000 31.000 - 0.00% -
520.omnetpp_r (avg) (percentage) 1.30% 0.770 0.780 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
531.deepsjeng_r -1.60% 10612.000 10442.000 - -2.77% -
520.omnetpp_r -1.19% 13132.000 12976.000 - -2.19% -
526.blender_r -1.04% 12040.000 11915.000 - -1.76% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
505.mcf_r (unexplained diff vs previous) (percentage) -33.33% 0.450 0.300 - 0.00% -
505.mcf_r (unexplained diff vs previous) -32.20% 59.000 40.000 - 0.00% -
505.mcf_r (max) -25.42% 59.000 44.000 - 0.00% -
505.mcf_r (max) (percentage) -24.44% 0.450 0.340 - 0.00% -
510.parest_r (max) -13.89% 36.000 31.000 - 0.00% -
510.parest_r (max) (percentage) -12.50% 0.160 0.140 - 0.00% -
544.nab_r (max) (percentage) -7.41% 0.270 0.250 - 0.00% -
544.nab_r (max) -6.67% 30.000 28.000 - 0.00% -
519.lbm_r (max) (percentage) -6.25% 0.480 0.450 - 0.00% -
511.povray_r (max) -5.95% 84.000 79.000 - 0.00% -
541.leela_r (max) (percentage) -5.77% 0.520 0.490 - 0.00% -
519.lbm_r (max) -5.56% 72.000 68.000 - 0.00% -
526.blender_r (max) -5.00% 60.000 57.000 - 0.00% -
541.leela_r (max) -4.92% 61.000 58.000 - 0.00% -
511.povray_r (max) (percentage) -4.65% 0.430 0.410 - 0.00% -
531.deepsjeng_r (max) -4.60% 87.000 83.000 - 0.00% -
526.blender_r (max) (percentage) -4.00% 0.500 0.480 - 0.00% -
538.imagick_r (max) -3.33% 90.000 87.000 - 0.00% -
538.imagick_r (max) (percentage) -3.03% 0.660 0.640 - 0.00% -
531.deepsjeng_r (max) (percentage) -2.44% 0.820 0.800 - 0.00% -
523.xalancbmk_r (max) (percentage) -1.59% 0.630 0.620 - 0.00% -
531.deepsjeng_r -1.56% 64.000 63.000 - 0.00% -
531.deepsjeng_r (avg) -1.56% 64.000 63.000 - 0.00% -
523.xalancbmk_r (max) -1.45% 69.000 68.000 - 0.00% -
500.perlbench_r (max) (percentage) -1.18% 0.850 0.840 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
519.lbm_r 20.51% 12552.000 15127.000 - 0.46% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests -52.94% 34.000 16.000 - 0.00% -
nb_execution_successful -50.00% 30.000 15.000 - 0.00% -
nb_compile_successful -46.67% 30.000 16.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
531.deepsjeng_r -2.77% 10739.000 10442.000 - -1.60% -
538.imagick_r -2.66% 14043.000 13670.000 - -0.76% -
511.povray_r -2.62% 19998.000 19475.000 - -0.85% -
520.omnetpp_r -2.19% 13266.000 12976.000 - -1.19% -
526.blender_r -1.76% 12129.000 11915.000 - -1.04% -

Added Tests - Code Size
523.xalancbmk_r

Added Tests - Execution
523.xalancbmk_r

Added Tests - sample variability
500.perlbench_r (avg) (percentage)
500.perlbench_r (max) (percentage)
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)
520.omnetpp_r
520.omnetpp_r (avg)
520.omnetpp_r (avg) (percentage)
520.omnetpp_r (max)
520.omnetpp_r (max) (percentage)
523.xalancbmk_r
523.xalancbmk_r (avg)
523.xalancbmk_r (avg) (percentage)
523.xalancbmk_r (max)
523.xalancbmk_r (max) (percentage)
525.x264_r
525.x264_r (avg)
525.x264_r (avg) (percentage)
525.x264_r (max)
525.x264_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
538.imagick_r
538.imagick_r (avg)
538.imagick_r (avg) (percentage)
538.imagick_r (max)
538.imagick_r (max) (percentage)
541.leela_r
541.leela_r (avg)
541.leela_r (avg) (percentage)
541.leela_r (max)
541.leela_r (max) (percentage)
544.nab_r
544.nab_r (avg)
544.nab_r (avg) (percentage)
544.nab_r (max)
544.nab_r (max) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)


Report Time: 0.21s
Name Current %
502.gcc_r 9882.000 -
505.mcf_r 13127.000 -
508.namd_r 9917.000 -
510.parest_r 22676.000 -
511.povray_r 19475.000 -
519.lbm_r 15127.000 -
520.omnetpp_r 12976.000 -1.19%
523.xalancbmk_r 10973.000 -
525.x264_r 14504.000 -
526.blender_r 11915.000 -1.04%
531.deepsjeng_r 10442.000 -1.60%
538.imagick_r 13670.000 -
541.leela_r 11938.000 -
544.nab_r 11417.000 -
557.xz_r 10532.000 -
Geometric Mean 12856.383 -
Name Current %
502.gcc_r 4424213.000 -
505.mcf_r 12337.000 -
508.namd_r 276957.000 -
510.parest_r 747793.000 -
511.povray_r 515240.000 -
519.lbm_r 9288.000 -
520.omnetpp_r 823908.000 -
523.xalancbmk_r 1705376.000 -
525.x264_r 269385.000 -
526.blender_r 5794171.000 -
531.deepsjeng_r 49926.000 -
538.imagick_r 712108.000 -
541.leela_r 43200.000 -
544.nab_r 49197.000 -
557.xz_r 80067.000 -
Geometric Mean 245696.452 -
Name Current %
500.perlbench_r (avg) (percentage) 0.470 -
500.perlbench_r (max) (percentage) 0.840 -1.18%
505.mcf_r 40.000 -
505.mcf_r (avg) 40.000 -
505.mcf_r (avg) (percentage) 0.310 -
505.mcf_r (max) 44.000 -25.42%
505.mcf_r (max) (percentage) 0.340 -24.44%
505.mcf_r (unexplained diff vs previous) 40.000 -32.20%
505.mcf_r (unexplained diff vs previous) (percentage) 0.300 -33.33%
508.namd_r 21.000 -
508.namd_r (avg) 21.000 -
508.namd_r (avg) (percentage) 0.220 -
508.namd_r (max) 7.000 -
508.namd_r (max) (percentage) 0.080 -
510.parest_r 27.000 -
510.parest_r (avg) 27.000 -
510.parest_r (avg) (percentage) 0.120 -
510.parest_r (max) 31.000 -13.89%
510.parest_r (max) (percentage) 0.140 -12.50%
511.povray_r 54.000 -
511.povray_r (avg) 54.000 -
511.povray_r (avg) (percentage) 0.280 -
511.povray_r (max) 79.000 -5.95%
511.povray_r (max) (percentage) 0.410 -4.65%
519.lbm_r 28.000 -
519.lbm_r (avg) 28.000 -
519.lbm_r (avg) (percentage) 0.190 -
519.lbm_r (max) 68.000 -5.56%
519.lbm_r (max) (percentage) 0.450 -6.25%
520.omnetpp_r 101.000 -
520.omnetpp_r (avg) 101.000 -
520.omnetpp_r (avg) (percentage) 0.780 1.30%
520.omnetpp_r (max) 154.000 15.79%
520.omnetpp_r (max) (percentage) 1.190 16.67%
520.omnetpp_r (unexplained diff vs previous) 156.000 18.18%
520.omnetpp_r (unexplained diff vs previous) (percentage) 1.200 18.81%
523.xalancbmk_r 36.000 -
523.xalancbmk_r (avg) 36.000 -
523.xalancbmk_r (avg) (percentage) 0.330 -
523.xalancbmk_r (max) 68.000 -1.45%
523.xalancbmk_r (max) (percentage) 0.620 -1.59%
525.x264_r 29.000 7.41%
525.x264_r (avg) 29.000 7.41%
525.x264_r (avg) (percentage) 0.200 5.26%
525.x264_r (max) 79.000 43.64%
525.x264_r (max) (percentage) 0.550 44.74%
525.x264_r (unexplained diff vs previous) 80.000 344.44%
525.x264_r (unexplained diff vs previous) (percentage) 0.550 358.33%
526.blender_r 45.000 -
526.blender_r (avg) 45.000 -
526.blender_r (avg) (percentage) 0.380 -
526.blender_r (max) 57.000 -5.00%
526.blender_r (max) (percentage) 0.480 -4.00%
531.deepsjeng_r 63.000 -1.56%
531.deepsjeng_r (avg) 63.000 -1.56%
531.deepsjeng_r (avg) (percentage) 0.610 -
531.deepsjeng_r (max) 83.000 -4.60%
531.deepsjeng_r (max) (percentage) 0.800 -2.44%
538.imagick_r 45.000 -
538.imagick_r (avg) 45.000 -
538.imagick_r (avg) (percentage) 0.330 -
538.imagick_r (max) 87.000 -3.33%
538.imagick_r (max) (percentage) 0.640 -3.03%
541.leela_r 31.000 3.33%
541.leela_r (avg) 31.000 3.33%
541.leela_r (avg) (percentage) 0.260 -
541.leela_r (max) 58.000 -4.92%
541.leela_r (max) (percentage) 0.490 -5.77%
544.nab_r 42.000 -
544.nab_r (avg) 42.000 -
544.nab_r (avg) (percentage) 0.370 -
544.nab_r (max) 28.000 -6.67%
544.nab_r (max) (percentage) 0.250 -7.41%
557.xz_r 18.000 -
557.xz_r (avg) 18.000 -
557.xz_r (avg) (percentage) 0.180 -
557.xz_r (max) 30.000 500.00%
557.xz_r (max) (percentage) 0.290 480.00%
557.xz_r (unexplained diff vs previous) 30.000 500.00%
557.xz_r (unexplained diff vs previous) (percentage) 0.280 460.00%
Geometric Mean 5.686 12.30%