Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/b17bd73e620b0040b04e368ebe4d963add4bbaf1 (+ 421 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-cpu2017rate--llvm-arm-master-O2_LTO-build/283/
Filter

llvm-arm-master-O2_LTO test results

Run Order Start Time Duration
Current 0283 (llvmorg-21-init-08114-gb17bd73e620b) 2025-04-05T20:11:52 0:00:00
Previous 0271 (llvmorg-21-init-03488-g37374fbcd33c) 2025-02-25T19:54:26 0:00:00
Baseline 0015 (llvmorg-17-init-07395-g3283a6fb0df3) 2023-04-07T14:40:57 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 31 2
Performance Improvements 52 3
Added Tests 0 124
Unchanged Tests 583 537
Total Tests 666

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
511.povray_r (unexplained diff vs previous) (percentage) 1900.00% 0.010 0.200 - 0.00% -
511.povray_r (unexplained diff vs previous) 1650.00% 2.000 35.000 - 0.00% -
508.namd_r (unexplained diff vs previous) (percentage) 300.00% 0.020 0.080 - 0.00% -
544.nab_r (unexplained diff vs previous) (percentage) 282.61% 0.230 0.880 - 0.00% -
544.nab_r (unexplained diff vs previous) 280.77% 26.000 99.000 - 0.00% -
508.namd_r (unexplained diff vs previous) 250.00% 2.000 7.000 - 0.00% -
519.lbm_r (unexplained diff vs previous) 157.14% 7.000 18.000 - 0.00% -
519.lbm_r (unexplained diff vs previous) (percentage) 140.00% 0.050 0.120 - 0.00% -
531.deepsjeng_r (unexplained diff vs previous) (percentage) 62.50% 0.080 0.130 - 0.00% -
538.imagick_r (unexplained diff vs previous) 62.50% 32.000 52.000 - 0.00% -
531.deepsjeng_r (unexplained diff vs previous) 60.00% 10.000 16.000 - 0.00% -
538.imagick_r (unexplained diff vs previous) (percentage) 58.33% 0.240 0.380 - 0.00% -
523.xalancbmk_r (max) 53.57% 28.000 43.000 - 0.00% -
523.xalancbmk_r (max) (percentage) 53.12% 0.320 0.490 - 0.00% -
544.nab_r (max) 29.87% 77.000 100.000 - 0.00% -
544.nab_r (max) (percentage) 28.99% 0.690 0.890 - 0.00% -
500.perlbench_r (max) (percentage) 15.38% 1.040 1.200 - 0.00% -
523.xalancbmk_r 13.64% 22.000 25.000 - 0.00% -
523.xalancbmk_r (avg) 13.64% 22.000 25.000 - 0.00% -
523.xalancbmk_r (avg) (percentage) 11.54% 0.260 0.290 - 0.00% -
500.perlbench_r (max) 11.04% 163.000 181.000 - 0.00% -
500.perlbench_r (avg) (percentage) 9.37% 0.640 0.700 - 0.00% -
500.perlbench_r 5.00% 100.000 105.000 - 0.00% -
500.perlbench_r (avg) 5.00% 100.000 105.000 - 0.00% -
520.omnetpp_r (max) 4.92% 183.000 192.000 - 0.00% -
520.omnetpp_r (unexplained diff vs previous) 4.81% 187.000 196.000 - 0.00% -
520.omnetpp_r (max) (percentage) 4.76% 1.680 1.760 - 0.00% -
520.omnetpp_r (unexplained diff vs previous) (percentage) 4.68% 1.710 1.790 - 0.00% -
544.nab_r (avg) (percentage) 2.78% 0.360 0.370 - 0.00% -
544.nab_r 2.50% 40.000 41.000 - 0.00% -
544.nab_r (avg) 2.50% 40.000 41.000 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
500.perlbench_r -3.77% 15694.000 15103.000 - 0.00% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
505.mcf_r (unexplained diff vs previous) -98.99% 99.000 1.000 - 0.00% -
505.mcf_r (unexplained diff vs previous) (percentage) -98.82% 0.850 0.010 - 0.00% -
526.blender_r (max) -74.29% 35.000 9.000 - 0.00% -
526.blender_r (max) (percentage) -72.73% 0.330 0.090 - 0.00% -
526.blender_r (unexplained diff vs previous) (percentage) -72.73% 0.330 0.090 - 0.00% -
508.namd_r (max) -72.41% 29.000 8.000 - 0.00% -
525.x264_r (unexplained diff vs previous) (percentage) -72.22% 0.360 0.100 - 0.00% -
525.x264_r (unexplained diff vs previous) -71.43% 35.000 10.000 - 0.00% -
526.blender_r (unexplained diff vs previous) -71.43% 35.000 10.000 - 0.00% -
508.namd_r (max) (percentage) -69.70% 0.330 0.100 - 0.00% -
557.xz_r (unexplained diff vs previous) -66.67% 3.000 1.000 - 0.00% -
557.xz_r (unexplained diff vs previous) (percentage) -66.67% 0.030 0.010 - 0.00% -
505.mcf_r (max) (percentage) -58.33% 0.840 0.350 - 0.00% -
505.mcf_r (max) -58.16% 98.000 41.000 - 0.00% -
541.leela_r (max) -57.69% 26.000 11.000 - 0.00% -
541.leela_r (max) (percentage) -57.14% 0.280 0.120 - 0.00% -
525.x264_r (max) -50.98% 51.000 25.000 - 0.00% -
525.x264_r (max) (percentage) -50.94% 0.530 0.260 - 0.00% -
519.lbm_r (max) -50.00% 38.000 19.000 - 0.00% -
519.lbm_r (max) (percentage) -50.00% 0.260 0.130 - 0.00% -
510.parest_r (max) -41.94% 31.000 18.000 - 0.00% -
510.parest_r (max) (percentage) -40.00% 0.150 0.090 - 0.00% -
511.povray_r (max) (percentage) -38.96% 0.770 0.470 - 0.00% -
511.povray_r (max) -38.93% 131.000 80.000 - 0.00% -
531.deepsjeng_r (max) -16.67% 102.000 85.000 - 0.00% -
531.deepsjeng_r (max) (percentage) -16.47% 0.850 0.710 - 0.00% -
526.blender_r -12.12% 33.000 29.000 - 0.00% -
526.blender_r (avg) -12.12% 33.000 29.000 - 0.00% -
557.xz_r -10.00% 10.000 9.000 - 0.00% -
557.xz_r (avg) -10.00% 10.000 9.000 - 0.00% -
526.blender_r (avg) (percentage) -9.68% 0.310 0.280 - 0.00% -
510.parest_r -8.33% 24.000 22.000 - 0.00% -
510.parest_r (avg) -8.33% 24.000 22.000 - 0.00% -
538.imagick_r (max) -8.20% 61.000 56.000 - 0.00% -
538.imagick_r (max) (percentage) -6.67% 0.450 0.420 - 0.00% -
502.gcc_r -6.67% 30.000 28.000 - 0.00% -
502.gcc_r (avg) -6.67% 30.000 28.000 - 0.00% -
508.namd_r -6.25% 16.000 15.000 - 0.00% -
508.namd_r (avg) -6.25% 16.000 15.000 - 0.00% -
531.deepsjeng_r -6.12% 49.000 46.000 - 0.00% -
531.deepsjeng_r (avg) -6.12% 49.000 46.000 - 0.00% -
502.gcc_r (avg) (percentage) -5.88% 0.340 0.320 - 0.00% -
502.gcc_r (max) -5.88% 34.000 32.000 - 0.00% -
502.gcc_r (max) (percentage) -5.26% 0.380 0.360 - 0.00% -
531.deepsjeng_r (avg) (percentage) -4.88% 0.410 0.390 - 0.00% -
541.leela_r (avg) (percentage) -4.35% 0.230 0.220 - 0.00% -
525.x264_r -4.17% 24.000 23.000 - 0.00% -
525.x264_r (avg) -4.17% 24.000 23.000 - 0.00% -
525.x264_r (avg) (percentage) -4.00% 0.250 0.240 - 0.00% -
538.imagick_r -2.38% 42.000 41.000 - 0.00% -
538.imagick_r (avg) -2.38% 42.000 41.000 - 0.00% -

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
505.mcf_r 3.20% 25784.000 26608.000 - 0.00% -
531.deepsjeng_r 1.68% 91336.000 92871.000 - 0.10% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
557.xz_r -3.17% 10041.000 9723.000 - 0.03% -
505.mcf_r -1.71% 11920.000 11716.000 - 0.18% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_execution_successful 433.33% 3.000 16.000 - 0.00% -

Added Tests - Code Size
500.perlbench_r
502.gcc_r
508.namd_r
510.parest_r
511.povray_r
519.lbm_r
520.omnetpp_r
523.xalancbmk_r
525.x264_r
526.blender_r
538.imagick_r
541.leela_r
544.nab_r

Added Tests - Execution
500.perlbench_r
502.gcc_r
508.namd_r
510.parest_r
511.povray_r
519.lbm_r
520.omnetpp_r
523.xalancbmk_r
525.x264_r
526.blender_r
538.imagick_r
541.leela_r
544.nab_r

Added Tests - sample variability
500.perlbench_r
500.perlbench_r (avg)
500.perlbench_r (avg) (percentage)
500.perlbench_r (max)
500.perlbench_r (max) (percentage)
502.gcc_r
502.gcc_r (avg)
502.gcc_r (avg) (percentage)
502.gcc_r (max)
502.gcc_r (max) (percentage)
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
508.namd_r (unexplained diff vs previous)
508.namd_r (unexplained diff vs previous) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
511.povray_r (unexplained diff vs previous)
511.povray_r (unexplained diff vs previous) (percentage)
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)
519.lbm_r (unexplained diff vs previous)
519.lbm_r (unexplained diff vs previous) (percentage)
520.omnetpp_r
520.omnetpp_r (avg)
520.omnetpp_r (avg) (percentage)
520.omnetpp_r (max)
520.omnetpp_r (max) (percentage)
520.omnetpp_r (unexplained diff vs previous)
520.omnetpp_r (unexplained diff vs previous) (percentage)
523.xalancbmk_r
523.xalancbmk_r (avg)
523.xalancbmk_r (avg) (percentage)
523.xalancbmk_r (max)
523.xalancbmk_r (max) (percentage)
525.x264_r
525.x264_r (avg)
525.x264_r (avg) (percentage)
525.x264_r (max)
525.x264_r (max) (percentage)
525.x264_r (unexplained diff vs previous)
525.x264_r (unexplained diff vs previous) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
526.blender_r (unexplained diff vs previous)
526.blender_r (unexplained diff vs previous) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
538.imagick_r
538.imagick_r (avg)
538.imagick_r (avg) (percentage)
538.imagick_r (max)
538.imagick_r (max) (percentage)
538.imagick_r (unexplained diff vs previous)
538.imagick_r (unexplained diff vs previous) (percentage)
541.leela_r
541.leela_r (avg)
541.leela_r (avg) (percentage)
541.leela_r (max)
541.leela_r (max) (percentage)
541.leela_r (unexplained diff vs previous)
541.leela_r (unexplained diff vs previous) (percentage)
544.nab_r
544.nab_r (avg)
544.nab_r (avg) (percentage)
544.nab_r (max)
544.nab_r (max) (percentage)
544.nab_r (unexplained diff vs previous)
544.nab_r (unexplained diff vs previous) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)


Report Time: 0.23s
Name Current %
500.perlbench_r 15103.000 -3.77%
502.gcc_r 8979.000 -
505.mcf_r 11716.000 -
508.namd_r 8914.000 -
510.parest_r 20661.000 -
511.povray_r 17091.000 -
519.lbm_r 14850.000 -
520.omnetpp_r 10933.000 -
523.xalancbmk_r 8888.000 -
525.x264_r 9643.000 -
526.blender_r 10693.000 -
531.deepsjeng_r 11982.000 -
538.imagick_r 13546.000 -
541.leela_r 9595.000 -
544.nab_r 11254.000 -
557.xz_r 9723.000 -
Geometric Mean 11720.496 -
Name Current %
500.perlbench_r 2285608.000 -
502.gcc_r 10050343.000 -
505.mcf_r 26608.000 -
508.namd_r 517207.000 -
510.parest_r 1742152.000 -
511.povray_r 1125261.000 -
519.lbm_r 11246.000 -
520.omnetpp_r 1571453.000 -
523.xalancbmk_r 3515676.000 -
525.x264_r 527970.000 -
526.blender_r 11872380.000 -
531.deepsjeng_r 92871.000 -
538.imagick_r 1252441.000 -
541.leela_r 87694.000 -
544.nab_r 81940.000 -
557.xz_r 131619.000 -
Geometric Mean 517612.475 -
Name Current %
500.perlbench_r 105.000 5.00%
500.perlbench_r (avg) 105.000 5.00%
500.perlbench_r (avg) (percentage) 0.700 9.37%
500.perlbench_r (max) 181.000 11.04%
500.perlbench_r (max) (percentage) 1.200 15.38%
502.gcc_r 28.000 -6.67%
502.gcc_r (avg) 28.000 -6.67%
502.gcc_r (avg) (percentage) 0.320 -5.88%
502.gcc_r (max) 32.000 -5.88%
502.gcc_r (max) (percentage) 0.360 -5.26%
505.mcf_r 28.000 -
505.mcf_r (avg) 28.000 -
505.mcf_r (avg) (percentage) 0.240 -
505.mcf_r (max) 41.000 -58.16%
505.mcf_r (max) (percentage) 0.350 -58.33%
505.mcf_r (unexplained diff vs previous) 1.000 -98.99%
505.mcf_r (unexplained diff vs previous) (percentage) 0.010 -98.82%
508.namd_r 15.000 -6.25%
508.namd_r (avg) 15.000 -6.25%
508.namd_r (avg) (percentage) 0.170 -
508.namd_r (max) 8.000 -72.41%
508.namd_r (max) (percentage) 0.100 -69.70%
508.namd_r (unexplained diff vs previous) 7.000 250.00%
508.namd_r (unexplained diff vs previous) (percentage) 0.080 300.00%
510.parest_r 22.000 -8.33%
510.parest_r (avg) 22.000 -8.33%
510.parest_r (avg) (percentage) 0.110 -
510.parest_r (max) 18.000 -41.94%
510.parest_r (max) (percentage) 0.090 -40.00%
511.povray_r 68.000 -
511.povray_r (avg) 68.000 -
511.povray_r (avg) (percentage) 0.400 -
511.povray_r (max) 80.000 -38.93%
511.povray_r (max) (percentage) 0.470 -38.96%
511.povray_r (unexplained diff vs previous) 35.000 1650.00%
511.povray_r (unexplained diff vs previous) (percentage) 0.200 1900.00%
519.lbm_r 17.000 -
519.lbm_r (avg) 17.000 -
519.lbm_r (avg) (percentage) 0.120 -
519.lbm_r (max) 19.000 -50.00%
519.lbm_r (max) (percentage) 0.130 -50.00%
519.lbm_r (unexplained diff vs previous) 18.000 157.14%
519.lbm_r (unexplained diff vs previous) (percentage) 0.120 140.00%
520.omnetpp_r 129.000 -
520.omnetpp_r (avg) 129.000 -
520.omnetpp_r (avg) (percentage) 1.180 -
520.omnetpp_r (max) 192.000 4.92%
520.omnetpp_r (max) (percentage) 1.760 4.76%
520.omnetpp_r (unexplained diff vs previous) 196.000 4.81%
520.omnetpp_r (unexplained diff vs previous) (percentage) 1.790 4.68%
523.xalancbmk_r 25.000 13.64%
523.xalancbmk_r (avg) 25.000 13.64%
523.xalancbmk_r (avg) (percentage) 0.290 11.54%
523.xalancbmk_r (max) 43.000 53.57%
523.xalancbmk_r (max) (percentage) 0.490 53.12%
525.x264_r 23.000 -4.17%
525.x264_r (avg) 23.000 -4.17%
525.x264_r (avg) (percentage) 0.240 -4.00%
525.x264_r (max) 25.000 -50.98%
525.x264_r (max) (percentage) 0.260 -50.94%
525.x264_r (unexplained diff vs previous) 10.000 -71.43%
525.x264_r (unexplained diff vs previous) (percentage) 0.100 -72.22%
526.blender_r 29.000 -12.12%
526.blender_r (avg) 29.000 -12.12%
526.blender_r (avg) (percentage) 0.280 -9.68%
526.blender_r (max) 9.000 -74.29%
526.blender_r (max) (percentage) 0.090 -72.73%
526.blender_r (unexplained diff vs previous) 10.000 -71.43%
526.blender_r (unexplained diff vs previous) (percentage) 0.090 -72.73%
531.deepsjeng_r 46.000 -6.12%
531.deepsjeng_r (avg) 46.000 -6.12%
531.deepsjeng_r (avg) (percentage) 0.390 -4.88%
531.deepsjeng_r (max) 85.000 -16.67%
531.deepsjeng_r (max) (percentage) 0.710 -16.47%
531.deepsjeng_r (unexplained diff vs previous) 16.000 60.00%
531.deepsjeng_r (unexplained diff vs previous) (percentage) 0.130 62.50%
538.imagick_r 41.000 -2.38%
538.imagick_r (avg) 41.000 -2.38%
538.imagick_r (avg) (percentage) 0.310 -
538.imagick_r (max) 56.000 -8.20%
538.imagick_r (max) (percentage) 0.420 -6.67%
538.imagick_r (unexplained diff vs previous) 52.000 62.50%
538.imagick_r (unexplained diff vs previous) (percentage) 0.380 58.33%
541.leela_r 21.000 -
541.leela_r (avg) 21.000 -
541.leela_r (avg) (percentage) 0.220 -4.35%
541.leela_r (max) 11.000 -57.69%
541.leela_r (max) (percentage) 0.120 -57.14%
541.leela_r (unexplained diff vs previous) 12.000 -
541.leela_r (unexplained diff vs previous) (percentage) 0.130 -
544.nab_r 41.000 2.50%
544.nab_r (avg) 41.000 2.50%
544.nab_r (avg) (percentage) 0.370 2.78%
544.nab_r (max) 100.000 29.87%
544.nab_r (max) (percentage) 0.890 28.99%
544.nab_r (unexplained diff vs previous) 99.000 280.77%
544.nab_r (unexplained diff vs previous) (percentage) 0.880 282.61%
557.xz_r 9.000 -10.00%
557.xz_r (avg) 9.000 -10.00%
557.xz_r (avg) (percentage) 0.100 -
557.xz_r (max) 7.000 -
557.xz_r (max) (percentage) 0.080 -
557.xz_r (unexplained diff vs previous) 1.000 -66.67%
557.xz_r (unexplained diff vs previous) (percentage) 0.010 -66.67%
Geometric Mean 3.644 4.03%