Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/d4c7d0be1f5235555393313bb1f8e46c97f76766 (+ 2466 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-cpu2017rate--llvm-arm-master-Os_LTO-build/156/
Filter

llvm-arm-master-Os_LTO test results

Run Order Start Time Duration
Current 0156 (llvmorg-21-init-15446-gd4c7d0be1f52) 2025-05-30T22:04:58 0:00:00
Previous 0155 (no-change) 2025-05-16T17:57:44 0:00:00
Baseline 0003 (llvmorg-19-init-10108-gcd132dcbeb0f) 2024-05-02T07:22:59 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 28 8
Performance Improvements 34 6
Added Tests 0 79
Unchanged Tests 604 573
Total Tests 666

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
520.omnetpp_r 1.20% 11703.000 11844.000 - 5.05% -
526.blender_r 1.04% 11192.000 11308.000 - 4.37% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
508.namd_r (unexplained diff vs previous) (percentage) 2150.00% 0.020 0.450 - 0.00% -
508.namd_r (unexplained diff vs previous) 1950.00% 2.000 41.000 - 0.00% -
544.nab_r (unexplained diff vs previous) 1133.33% 3.000 37.000 - 0.00% -
544.nab_r (unexplained diff vs previous) (percentage) 1000.00% 0.030 0.330 - 0.00% -
520.omnetpp_r (unexplained diff vs previous) 403.57% 28.000 141.000 - 0.00% -
520.omnetpp_r (unexplained diff vs previous) (percentage) 395.83% 0.240 1.190 - 0.00% -
505.mcf_r (unexplained diff vs previous) (percentage) 312.50% 0.080 0.330 - 0.00% -
505.mcf_r (unexplained diff vs previous) 309.09% 11.000 45.000 - 0.00% -
508.namd_r (max) 192.86% 14.000 41.000 - 0.00% -
525.x264_r (unexplained diff vs previous) (percentage) 183.33% 0.060 0.170 - 0.00% -
508.namd_r (max) (percentage) 181.25% 0.160 0.450 - 0.00% -
525.x264_r (unexplained diff vs previous) 171.43% 7.000 19.000 - 0.00% -
544.nab_r (max) 85.00% 20.000 37.000 - 0.00% -
544.nab_r (max) (percentage) 83.33% 0.180 0.330 - 0.00% -
525.x264_r (max) 72.73% 11.000 19.000 - 0.00% -
525.x264_r (max) (percentage) 70.00% 0.100 0.170 - 0.00% -
505.mcf_r (max) 55.17% 29.000 45.000 - 0.00% -
505.mcf_r (max) (percentage) 54.55% 0.220 0.340 - 0.00% -
541.leela_r (unexplained diff vs previous) 54.55% 11.000 17.000 - 0.00% -
541.leela_r (unexplained diff vs previous) (percentage) 50.00% 0.100 0.150 - 0.00% -
531.deepsjeng_r (unexplained diff vs previous) 26.76% 71.000 90.000 - 0.00% -
531.deepsjeng_r (unexplained diff vs previous) (percentage) 25.97% 0.770 0.970 - 0.00% -
526.blender_r 1.89% 53.000 54.000 - 0.00% -
526.blender_r (avg) 1.89% 53.000 54.000 - 0.00% -
531.deepsjeng_r 1.03% 97.000 98.000 - 0.00% -
531.deepsjeng_r (avg) 1.03% 97.000 98.000 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
502.gcc_r -1.00% 9063.000 8972.000 - 0.16% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
519.lbm_r (unexplained diff vs previous) (percentage) -80.00% 0.050 0.010 - 0.00% -
519.lbm_r (unexplained diff vs previous) -71.43% 7.000 2.000 - 0.00% -
557.xz_r (unexplained diff vs previous) -50.00% 6.000 3.000 - 0.00% -
557.xz_r (unexplained diff vs previous) (percentage) -50.00% 0.060 0.030 - 0.00% -
557.xz_r (max) -42.11% 19.000 11.000 - 0.00% -
557.xz_r (max) (percentage) -42.11% 0.190 0.110 - 0.00% -
541.leela_r (max) -14.29% 28.000 24.000 - 0.00% -
541.leela_r (max) (percentage) -12.00% 0.250 0.220 - 0.00% -
526.blender_r (max) (percentage) -11.02% 1.180 1.050 - 0.00% -
526.blender_r (max) -10.61% 132.000 118.000 - 0.00% -
510.parest_r (max) (percentage) -10.00% 0.300 0.270 - 0.00% -
510.parest_r (max) -9.68% 62.000 56.000 - 0.00% -
519.lbm_r (avg) (percentage) -6.25% 0.160 0.150 - 0.00% -
557.xz_r (avg) (percentage) -5.88% 0.170 0.160 - 0.00% -
557.xz_r -5.88% 17.000 16.000 - 0.00% -
557.xz_r (avg) -5.88% 17.000 16.000 - 0.00% -
520.omnetpp_r (max) (percentage) -5.84% 1.540 1.450 - 0.00% -
520.omnetpp_r (max) -5.00% 180.000 171.000 - 0.00% -
519.lbm_r (max) (percentage) -4.55% 0.220 0.210 - 0.00% -
519.lbm_r -4.17% 24.000 23.000 - 0.00% -
519.lbm_r (avg) -4.17% 24.000 23.000 - 0.00% -
531.deepsjeng_r (max) (percentage) -4.10% 1.950 1.870 - 0.00% -
511.povray_r (max) -3.03% 165.000 160.000 - 0.00% -
519.lbm_r (max) -3.03% 33.000 32.000 - 0.00% -
531.deepsjeng_r (max) -2.79% 179.000 174.000 - 0.00% -
502.gcc_r (max) -2.63% 38.000 37.000 - 0.00% -
502.gcc_r (max) (percentage) -2.33% 0.430 0.420 - 0.00% -
511.povray_r (max) (percentage) -2.08% 0.960 0.940 - 0.00% -
523.xalancbmk_r (max) (percentage) -1.82% 0.550 0.540 - 0.00% -
538.imagick_r (max) -1.82% 55.000 54.000 - 0.00% -
523.xalancbmk_r (max) -1.79% 56.000 55.000 - 0.00% -
511.povray_r -1.49% 67.000 66.000 - 0.00% -
511.povray_r (avg) -1.49% 67.000 66.000 - 0.00% -

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
531.deepsjeng_r 3.32% 57556.000 59468.000 - 0.00% -
510.parest_r 1.23% 970810.000 982774.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
520.omnetpp_r 5.05% 11275.000 11844.000 - 1.20% -
526.blender_r 4.37% 10835.000 11308.000 - 1.04% -
519.lbm_r 3.88% 14766.000 15339.000 - 0.01% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests -52.94% 34.000 16.000 - 0.00% -
nb_execution_successful -50.00% 30.000 15.000 - 0.00% -
nb_compile_successful -46.67% 30.000 16.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
505.mcf_r -4.66% 15106.000 14402.000 - 0.00% -
508.namd_r -2.87% 323621.000 314341.000 - 0.00% -
525.x264_r -1.35% 322466.000 318122.000 - 0.09% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
525.x264_r -9.87% 12417.000 11191.000 - 0.17% -
508.namd_r -2.41% 9423.000 9196.000 - 0.45% -
511.povray_r -1.64% 17346.000 17061.000 - -0.89% -

Added Tests - Code Size
523.xalancbmk_r

Added Tests - Execution
523.xalancbmk_r

Added Tests - sample variability
500.perlbench_r (avg) (percentage)
500.perlbench_r (max) (percentage)
502.gcc_r
502.gcc_r (avg)
502.gcc_r (avg) (percentage)
502.gcc_r (max)
502.gcc_r (max) (percentage)
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)
520.omnetpp_r
520.omnetpp_r (avg)
520.omnetpp_r (avg) (percentage)
520.omnetpp_r (max)
520.omnetpp_r (max) (percentage)
523.xalancbmk_r
523.xalancbmk_r (avg)
523.xalancbmk_r (avg) (percentage)
523.xalancbmk_r (max)
523.xalancbmk_r (max) (percentage)
525.x264_r
525.x264_r (avg)
525.x264_r (avg) (percentage)
525.x264_r (max)
525.x264_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
538.imagick_r
538.imagick_r (avg)
538.imagick_r (avg) (percentage)
538.imagick_r (max)
538.imagick_r (max) (percentage)
541.leela_r
541.leela_r (avg)
541.leela_r (avg) (percentage)
541.leela_r (max)
541.leela_r (max) (percentage)
544.nab_r
544.nab_r (avg)
544.nab_r (avg) (percentage)
544.nab_r (max)
544.nab_r (max) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)


Report Time: 0.22s
Name Current %
502.gcc_r 8972.000 -1.00%
505.mcf_r 13442.000 -
508.namd_r 9196.000 -
510.parest_r 20867.000 -
511.povray_r 17061.000 -
519.lbm_r 15339.000 -
520.omnetpp_r 11844.000 1.20%
523.xalancbmk_r 10301.000 -
525.x264_r 11191.000 -
526.blender_r 11308.000 1.04%
531.deepsjeng_r 9310.000 -
538.imagick_r 13684.000 -
541.leela_r 11289.000 -
544.nab_r 11270.000 -
557.xz_r 10115.000 -
Geometric Mean 11996.013 -
Name Current %
502.gcc_r 5252044.000 -
505.mcf_r 14402.000 -
508.namd_r 314341.000 -
510.parest_r 982774.000 -
511.povray_r 564960.000 -
519.lbm_r 9568.000 -
520.omnetpp_r 924486.000 -
523.xalancbmk_r 1962342.000 -
525.x264_r 318122.000 -
526.blender_r 6446024.000 -
531.deepsjeng_r 59468.000 -
538.imagick_r 840525.000 -
541.leela_r 49994.000 -
544.nab_r 52465.000 -
557.xz_r 83935.000 -
Geometric Mean 280266.593 -
Name Current %
500.perlbench_r (avg) (percentage) 0.520 -
500.perlbench_r (max) (percentage) 0.510 -
502.gcc_r 32.000 -
502.gcc_r (avg) 32.000 -
502.gcc_r (avg) (percentage) 0.360 -
502.gcc_r (max) 37.000 -2.63%
502.gcc_r (max) (percentage) 0.420 -2.33%
505.mcf_r 36.000 -
505.mcf_r (avg) 36.000 -
505.mcf_r (avg) (percentage) 0.270 -
505.mcf_r (max) 45.000 55.17%
505.mcf_r (max) (percentage) 0.340 54.55%
505.mcf_r (unexplained diff vs previous) 45.000 309.09%
505.mcf_r (unexplained diff vs previous) (percentage) 0.330 312.50%
508.namd_r 24.000 -
508.namd_r (avg) 24.000 -
508.namd_r (avg) (percentage) 0.270 -
508.namd_r (max) 41.000 192.86%
508.namd_r (max) (percentage) 0.450 181.25%
508.namd_r (unexplained diff vs previous) 41.000 1950.00%
508.namd_r (unexplained diff vs previous) (percentage) 0.450 2150.00%
510.parest_r 31.000 -
510.parest_r (avg) 31.000 -
510.parest_r (avg) (percentage) 0.150 -
510.parest_r (max) 56.000 -9.68%
510.parest_r (max) (percentage) 0.270 -10.00%
511.povray_r 66.000 -1.49%
511.povray_r (avg) 66.000 -1.49%
511.povray_r (avg) (percentage) 0.390 -
511.povray_r (max) 160.000 -3.03%
511.povray_r (max) (percentage) 0.940 -2.08%
519.lbm_r 23.000 -4.17%
519.lbm_r (avg) 23.000 -4.17%
519.lbm_r (avg) (percentage) 0.150 -6.25%
519.lbm_r (max) 32.000 -3.03%
519.lbm_r (max) (percentage) 0.210 -4.55%
519.lbm_r (unexplained diff vs previous) 2.000 -71.43%
519.lbm_r (unexplained diff vs previous) (percentage) 0.010 -80.00%
520.omnetpp_r 127.000 -
520.omnetpp_r (avg) 127.000 -
520.omnetpp_r (avg) (percentage) 1.080 -
520.omnetpp_r (max) 171.000 -5.00%
520.omnetpp_r (max) (percentage) 1.450 -5.84%
520.omnetpp_r (unexplained diff vs previous) 141.000 403.57%
520.omnetpp_r (unexplained diff vs previous) (percentage) 1.190 395.83%
523.xalancbmk_r 42.000 -
523.xalancbmk_r (avg) 42.000 -
523.xalancbmk_r (avg) (percentage) 0.410 -
523.xalancbmk_r (max) 55.000 -1.79%
523.xalancbmk_r (max) (percentage) 0.540 -1.82%
525.x264_r 23.000 -
525.x264_r (avg) 23.000 -
525.x264_r (avg) (percentage) 0.210 -
525.x264_r (max) 19.000 72.73%
525.x264_r (max) (percentage) 0.170 70.00%
525.x264_r (unexplained diff vs previous) 19.000 171.43%
525.x264_r (unexplained diff vs previous) (percentage) 0.170 183.33%
526.blender_r 54.000 1.89%
526.blender_r (avg) 54.000 1.89%
526.blender_r (avg) (percentage) 0.480 -
526.blender_r (max) 118.000 -10.61%
526.blender_r (max) (percentage) 1.050 -11.02%
531.deepsjeng_r 98.000 1.03%
531.deepsjeng_r (avg) 98.000 1.03%
531.deepsjeng_r (avg) (percentage) 1.060 -
531.deepsjeng_r (max) 174.000 -2.79%
531.deepsjeng_r (max) (percentage) 1.870 -4.10%
531.deepsjeng_r (unexplained diff vs previous) 90.000 26.76%
531.deepsjeng_r (unexplained diff vs previous) (percentage) 0.970 25.97%
538.imagick_r 35.000 -
538.imagick_r (avg) 35.000 -
538.imagick_r (avg) (percentage) 0.260 -
538.imagick_r (max) 54.000 -1.82%
538.imagick_r (max) (percentage) 0.400 -
541.leela_r 23.000 -
541.leela_r (avg) 23.000 -
541.leela_r (avg) (percentage) 0.210 -
541.leela_r (max) 24.000 -14.29%
541.leela_r (max) (percentage) 0.220 -12.00%
541.leela_r (unexplained diff vs previous) 17.000 54.55%
541.leela_r (unexplained diff vs previous) (percentage) 0.150 50.00%
544.nab_r 32.000 -
544.nab_r (avg) 32.000 -
544.nab_r (avg) (percentage) 0.290 -
544.nab_r (max) 37.000 85.00%
544.nab_r (max) (percentage) 0.330 83.33%
544.nab_r (unexplained diff vs previous) 37.000 1133.33%
544.nab_r (unexplained diff vs previous) (percentage) 0.330 1000.00%
557.xz_r 16.000 -5.88%
557.xz_r (avg) 16.000 -5.88%
557.xz_r (avg) (percentage) 0.160 -5.88%
557.xz_r (max) 11.000 -42.11%
557.xz_r (max) (percentage) 0.110 -42.11%
557.xz_r (unexplained diff vs previous) 3.000 -50.00%
557.xz_r (unexplained diff vs previous) (percentage) 0.030 -50.00%
Geometric Mean 4.816 22.05%