Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/0931874b219cfdae38fcf24d33c8efa001697d5a (+ 1374 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-cpu2017rate--llvm-arm-master-O2-build/309/
Filter

llvm-arm-master-O2 test results

Run Order Start Time Duration
Current 0309 (llvmorg-21-init-12610-g0931874b219c) 2025-05-12T08:01:35 0:00:00
Previous 0306 (llvmorg-21-init-11236-gb0bf48d44e55) 2025-05-03T22:19:38 0:00:00
Baseline 0013 (llvmorg-17-init-07454-g7a1044c6affe) 2023-04-08T11:09:44 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 26 2
Performance Improvements 46 4
Added Tests 2 128
Unchanged Tests 604 544
Total Tests 678

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
538.imagick_r (unexplained diff vs previous) (percentage) 700.00% 0.060 0.480 - 0.00% -
538.imagick_r (unexplained diff vs previous) 655.56% 9.000 68.000 - 0.00% -
508.namd_r (unexplained diff vs previous) (percentage) 300.00% 0.030 0.120 - 0.00% -
525.x264_r (unexplained diff vs previous) (percentage) 290.91% 0.110 0.430 - 0.00% -
525.x264_r (unexplained diff vs previous) 281.82% 11.000 42.000 - 0.00% -
508.namd_r (unexplained diff vs previous) 266.67% 3.000 11.000 - 0.00% -
505.mcf_r (unexplained diff vs previous) 115.79% 19.000 41.000 - 0.00% -
520.omnetpp_r (unexplained diff vs previous) (percentage) 115.00% 0.400 0.860 - 0.00% -
520.omnetpp_r (unexplained diff vs previous) 110.42% 48.000 101.000 - 0.00% -
557.xz_r (unexplained diff vs previous) (percentage) 108.33% 0.120 0.250 - 0.00% -
557.xz_r (unexplained diff vs previous) 108.33% 12.000 25.000 - 0.00% -
505.mcf_r (unexplained diff vs previous) (percentage) 107.14% 0.140 0.290 - 0.00% -
557.xz_r (max) 47.06% 17.000 25.000 - 0.00% -
557.xz_r (max) (percentage) 47.06% 0.170 0.250 - 0.00% -
544.nab_r (unexplained diff vs previous) 37.50% 8.000 11.000 - 0.00% -
544.nab_r (unexplained diff vs previous) (percentage) 28.57% 0.070 0.090 - 0.00% -
525.x264_r (max) 23.53% 34.000 42.000 - 0.00% -
525.x264_r (max) (percentage) 22.86% 0.350 0.430 - 0.00% -
531.deepsjeng_r (unexplained diff vs previous) 18.52% 54.000 64.000 - 0.00% -
531.deepsjeng_r (unexplained diff vs previous) (percentage) 16.98% 0.530 0.620 - 0.00% -
538.imagick_r (max) (percentage) 6.67% 0.450 0.480 - 0.00% -
538.imagick_r 6.25% 32.000 34.000 - 0.00% -
538.imagick_r (avg) 6.25% 32.000 34.000 - 0.00% -
538.imagick_r (max) 6.25% 64.000 68.000 - 0.00% -
525.x264_r 5.26% 19.000 20.000 - 0.00% -
525.x264_r (avg) 5.26% 19.000 20.000 - 0.00% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
526.blender_r (unexplained diff vs previous) -83.87% 31.000 5.000 - 0.00% -
526.blender_r (unexplained diff vs previous) (percentage) -82.76% 0.290 0.050 - 0.00% -
519.lbm_r (unexplained diff vs previous) -72.73% 11.000 3.000 - 0.00% -
519.lbm_r (unexplained diff vs previous) (percentage) -71.43% 0.070 0.020 - 0.00% -
523.xalancbmk_r (unexplained diff vs previous) -65.38% 26.000 9.000 - 0.00% -
523.xalancbmk_r (unexplained diff vs previous) (percentage) -64.29% 0.280 0.100 - 0.00% -
541.leela_r (unexplained diff vs previous) -50.00% 2.000 1.000 - 0.00% -
541.leela_r (unexplained diff vs previous) (percentage) -50.00% 0.020 0.010 - 0.00% -
510.parest_r (unexplained diff vs previous) -39.29% 28.000 17.000 - 0.00% -
510.parest_r (unexplained diff vs previous) (percentage) -38.46% 0.130 0.080 - 0.00% -
519.lbm_r (max) -20.00% 10.000 8.000 - 0.00% -
519.lbm_r (max) (percentage) -14.29% 0.070 0.060 - 0.00% -
510.parest_r (max) -8.77% 57.000 52.000 - 0.00% -
510.parest_r (max) (percentage) -7.41% 0.270 0.250 - 0.00% -
520.omnetpp_r (max) -7.39% 203.000 188.000 - 0.00% -
508.namd_r (max) -7.14% 28.000 26.000 - 0.00% -
520.omnetpp_r (max) (percentage) -6.98% 1.720 1.600 - 0.00% -
526.blender_r (max) (percentage) -6.90% 0.290 0.270 - 0.00% -
502.gcc_r (max) -6.56% 61.000 57.000 - 0.00% -
526.blender_r (max) -6.45% 31.000 29.000 - 0.00% -
508.namd_r (max) (percentage) -6.25% 0.320 0.300 - 0.00% -
502.gcc_r (max) (percentage) -6.15% 0.650 0.610 - 0.00% -
511.povray_r (max) (percentage) -5.76% 1.910 1.800 - 0.00% -
511.povray_r (max) -5.46% 348.000 329.000 - 0.00% -
500.perlbench_r (max) (percentage) -5.07% 1.380 1.310 - 0.00% -
500.perlbench_r (max) -5.05% 218.000 207.000 - 0.00% -
531.deepsjeng_r (max) (percentage) -4.85% 1.030 0.980 - 0.00% -
531.deepsjeng_r (max) -4.76% 105.000 100.000 - 0.00% -
523.xalancbmk_r (max) (percentage) -4.41% 0.680 0.650 - 0.00% -
544.nab_r -4.35% 46.000 44.000 - 0.00% -
544.nab_r (avg) -4.35% 46.000 44.000 - 0.00% -
500.perlbench_r -4.10% 122.000 117.000 - 0.00% -
500.perlbench_r (avg) -4.10% 122.000 117.000 - 0.00% -
500.perlbench_r (avg) (percentage) -3.90% 0.770 0.740 - 0.00% -
505.mcf_r (max) (percentage) -3.33% 0.300 0.290 - 0.00% -
526.blender_r (avg) (percentage) -3.23% 0.310 0.300 - 0.00% -
523.xalancbmk_r -3.23% 31.000 30.000 - 0.00% -
523.xalancbmk_r (avg) -3.23% 31.000 30.000 - 0.00% -
523.xalancbmk_r (max) -3.17% 63.000 61.000 - 0.00% -
526.blender_r -3.03% 33.000 32.000 - 0.00% -
526.blender_r (avg) -3.03% 33.000 32.000 - 0.00% -
544.nab_r (max) -3.03% 99.000 96.000 - 0.00% -
523.xalancbmk_r (avg) (percentage) -2.94% 0.340 0.330 - 0.00% -
544.nab_r (avg) (percentage) -2.56% 0.390 0.380 - 0.00% -
505.mcf_r (max) -2.44% 41.000 40.000 - 0.00% -
544.nab_r (max) (percentage) -2.38% 0.840 0.820 - 0.00% -

Added Tests - sample variability
500.perlbench_r (unexplained diff vs previous)
500.perlbench_r (unexplained diff vs previous) (percentage)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
505.mcf_r 7.18% 29232.000 31332.000 - 0.00% -
531.deepsjeng_r 2.14% 91600.000 93560.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
557.xz_r -3.77% 10456.000 10062.000 - -0.25% -
531.deepsjeng_r -2.57% 10547.000 10276.000 - 0.63% -
505.mcf_r -1.19% 14075.000 13908.000 - -0.29% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_execution_successful 433.33% 3.000 16.000 - 0.00% -

Added Tests - Code Size
500.perlbench_r
502.gcc_r
508.namd_r
510.parest_r
511.povray_r
519.lbm_r
520.omnetpp_r
523.xalancbmk_r
525.x264_r
526.blender_r
538.imagick_r
541.leela_r
544.nab_r

Added Tests - Execution
500.perlbench_r
502.gcc_r
508.namd_r
510.parest_r
511.povray_r
519.lbm_r
520.omnetpp_r
523.xalancbmk_r
525.x264_r
526.blender_r
538.imagick_r
541.leela_r
544.nab_r

Added Tests - sample variability
500.perlbench_r
500.perlbench_r (avg)
500.perlbench_r (avg) (percentage)
500.perlbench_r (max)
500.perlbench_r (max) (percentage)
500.perlbench_r (unexplained diff vs previous)
500.perlbench_r (unexplained diff vs previous) (percentage)
502.gcc_r
502.gcc_r (avg)
502.gcc_r (avg) (percentage)
502.gcc_r (max)
502.gcc_r (max) (percentage)
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
508.namd_r (unexplained diff vs previous)
508.namd_r (unexplained diff vs previous) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
510.parest_r (unexplained diff vs previous)
510.parest_r (unexplained diff vs previous) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)
519.lbm_r (unexplained diff vs previous)
519.lbm_r (unexplained diff vs previous) (percentage)
520.omnetpp_r
520.omnetpp_r (avg)
520.omnetpp_r (avg) (percentage)
520.omnetpp_r (max)
520.omnetpp_r (max) (percentage)
520.omnetpp_r (unexplained diff vs previous)
520.omnetpp_r (unexplained diff vs previous) (percentage)
523.xalancbmk_r
523.xalancbmk_r (avg)
523.xalancbmk_r (avg) (percentage)
523.xalancbmk_r (max)
523.xalancbmk_r (max) (percentage)
523.xalancbmk_r (unexplained diff vs previous)
523.xalancbmk_r (unexplained diff vs previous) (percentage)
525.x264_r
525.x264_r (avg)
525.x264_r (avg) (percentage)
525.x264_r (max)
525.x264_r (max) (percentage)
525.x264_r (unexplained diff vs previous)
525.x264_r (unexplained diff vs previous) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
526.blender_r (unexplained diff vs previous)
526.blender_r (unexplained diff vs previous) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
538.imagick_r
538.imagick_r (avg)
538.imagick_r (avg) (percentage)
538.imagick_r (max)
538.imagick_r (max) (percentage)
538.imagick_r (unexplained diff vs previous)
538.imagick_r (unexplained diff vs previous) (percentage)
541.leela_r
541.leela_r (avg)
541.leela_r (avg) (percentage)
541.leela_r (max)
541.leela_r (max) (percentage)
541.leela_r (unexplained diff vs previous)
541.leela_r (unexplained diff vs previous) (percentage)
544.nab_r
544.nab_r (avg)
544.nab_r (avg) (percentage)
544.nab_r (max)
544.nab_r (max) (percentage)
544.nab_r (unexplained diff vs previous)
544.nab_r (unexplained diff vs previous) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)


Report Time: 0.22s
Name Current %
500.perlbench_r 15861.000 -
502.gcc_r 9433.000 -
505.mcf_r 13908.000 -
508.namd_r 8946.000 -
510.parest_r 21142.000 -
511.povray_r 18299.000 -
519.lbm_r 14888.000 -
520.omnetpp_r 11756.000 -
523.xalancbmk_r 9387.000 -
525.x264_r 9797.000 -
526.blender_r 10794.000 -
531.deepsjeng_r 10276.000 -
538.imagick_r 14229.000 -
541.leela_r 11884.000 -
544.nab_r 11796.000 -
557.xz_r 10062.000 -
Geometric Mean 12252.730 -
Name Current %
500.perlbench_r 2041983.000 -
502.gcc_r 8675663.000 -
505.mcf_r 31332.000 -
508.namd_r 656639.000 -
510.parest_r 7526054.000 -
511.povray_r 909843.000 -
519.lbm_r 13096.000 -
520.omnetpp_r 1708949.000 -
523.xalancbmk_r 3957502.000 -
525.x264_r 514369.000 -
526.blender_r 10117472.000 -
531.deepsjeng_r 93560.000 -
538.imagick_r 1755204.000 -
541.leela_r 138807.000 -
544.nab_r 192703.000 -
557.xz_r 178295.000 -
Geometric Mean 645161.576 -
Name Current %
500.perlbench_r 117.000 -4.10%
500.perlbench_r (avg) 117.000 -4.10%
500.perlbench_r (avg) (percentage) 0.740 -3.90%
500.perlbench_r (max) 207.000 -5.05%
500.perlbench_r (max) (percentage) 1.310 -5.07%
500.perlbench_r (unexplained diff vs previous) 1.000 -
500.perlbench_r (unexplained diff vs previous) (percentage) 0.010 -
502.gcc_r 35.000 -
502.gcc_r (avg) 35.000 -
502.gcc_r (avg) (percentage) 0.380 -
502.gcc_r (max) 57.000 -6.56%
502.gcc_r (max) (percentage) 0.610 -6.15%
505.mcf_r 34.000 -
505.mcf_r (avg) 34.000 -
505.mcf_r (avg) (percentage) 0.250 -
505.mcf_r (max) 40.000 -2.44%
505.mcf_r (max) (percentage) 0.290 -3.33%
505.mcf_r (unexplained diff vs previous) 41.000 115.79%
505.mcf_r (unexplained diff vs previous) (percentage) 0.290 107.14%
508.namd_r 18.000 -
508.namd_r (avg) 18.000 -
508.namd_r (avg) (percentage) 0.210 -
508.namd_r (max) 26.000 -7.14%
508.namd_r (max) (percentage) 0.300 -6.25%
508.namd_r (unexplained diff vs previous) 11.000 266.67%
508.namd_r (unexplained diff vs previous) (percentage) 0.120 300.00%
510.parest_r 27.000 -
510.parest_r (avg) 27.000 -
510.parest_r (avg) (percentage) 0.130 -
510.parest_r (max) 52.000 -8.77%
510.parest_r (max) (percentage) 0.250 -7.41%
510.parest_r (unexplained diff vs previous) 17.000 -39.29%
510.parest_r (unexplained diff vs previous) (percentage) 0.080 -38.46%
511.povray_r 113.000 -
511.povray_r (avg) 113.000 -
511.povray_r (avg) (percentage) 0.620 -
511.povray_r (max) 329.000 -5.46%
511.povray_r (max) (percentage) 1.800 -5.76%
519.lbm_r 23.000 -
519.lbm_r (avg) 23.000 -
519.lbm_r (avg) (percentage) 0.160 -
519.lbm_r (max) 8.000 -20.00%
519.lbm_r (max) (percentage) 0.060 -14.29%
519.lbm_r (unexplained diff vs previous) 3.000 -72.73%
519.lbm_r (unexplained diff vs previous) (percentage) 0.020 -71.43%
520.omnetpp_r 101.000 -
520.omnetpp_r (avg) 101.000 -
520.omnetpp_r (avg) (percentage) 0.860 -
520.omnetpp_r (max) 188.000 -7.39%
520.omnetpp_r (max) (percentage) 1.600 -6.98%
520.omnetpp_r (unexplained diff vs previous) 101.000 110.42%
520.omnetpp_r (unexplained diff vs previous) (percentage) 0.860 115.00%
523.xalancbmk_r 30.000 -3.23%
523.xalancbmk_r (avg) 30.000 -3.23%
523.xalancbmk_r (avg) (percentage) 0.330 -2.94%
523.xalancbmk_r (max) 61.000 -3.17%
523.xalancbmk_r (max) (percentage) 0.650 -4.41%
523.xalancbmk_r (unexplained diff vs previous) 9.000 -65.38%
523.xalancbmk_r (unexplained diff vs previous) (percentage) 0.100 -64.29%
525.x264_r 20.000 5.26%
525.x264_r (avg) 20.000 5.26%
525.x264_r (avg) (percentage) 0.210 -
525.x264_r (max) 42.000 23.53%
525.x264_r (max) (percentage) 0.430 22.86%
525.x264_r (unexplained diff vs previous) 42.000 281.82%
525.x264_r (unexplained diff vs previous) (percentage) 0.430 290.91%
526.blender_r 32.000 -3.03%
526.blender_r (avg) 32.000 -3.03%
526.blender_r (avg) (percentage) 0.300 -3.23%
526.blender_r (max) 29.000 -6.45%
526.blender_r (max) (percentage) 0.270 -6.90%
526.blender_r (unexplained diff vs previous) 5.000 -83.87%
526.blender_r (unexplained diff vs previous) (percentage) 0.050 -82.76%
531.deepsjeng_r 55.000 -
531.deepsjeng_r (avg) 55.000 -
531.deepsjeng_r (avg) (percentage) 0.540 -
531.deepsjeng_r (max) 100.000 -4.76%
531.deepsjeng_r (max) (percentage) 0.980 -4.85%
531.deepsjeng_r (unexplained diff vs previous) 64.000 18.52%
531.deepsjeng_r (unexplained diff vs previous) (percentage) 0.620 16.98%
538.imagick_r 34.000 6.25%
538.imagick_r (avg) 34.000 6.25%
538.imagick_r (avg) (percentage) 0.240 -
538.imagick_r (max) 68.000 6.25%
538.imagick_r (max) (percentage) 0.480 6.67%
538.imagick_r (unexplained diff vs previous) 68.000 655.56%
538.imagick_r (unexplained diff vs previous) (percentage) 0.480 700.00%
541.leela_r 30.000 -
541.leela_r (avg) 30.000 -
541.leela_r (avg) (percentage) 0.260 -
541.leela_r (max) 10.000 -
541.leela_r (max) (percentage) 0.090 -
541.leela_r (unexplained diff vs previous) 1.000 -50.00%
541.leela_r (unexplained diff vs previous) (percentage) 0.010 -50.00%
544.nab_r 44.000 -4.35%
544.nab_r (avg) 44.000 -4.35%
544.nab_r (avg) (percentage) 0.380 -2.56%
544.nab_r (max) 96.000 -3.03%
544.nab_r (max) (percentage) 0.820 -2.38%
544.nab_r (unexplained diff vs previous) 11.000 37.50%
544.nab_r (unexplained diff vs previous) (percentage) 0.090 28.57%
557.xz_r 17.000 -
557.xz_r (avg) 17.000 -
557.xz_r (avg) (percentage) 0.170 -
557.xz_r (max) 25.000 47.06%
557.xz_r (max) (percentage) 0.250 47.06%
557.xz_r (unexplained diff vs previous) 25.000 108.33%
557.xz_r (unexplained diff vs previous) (percentage) 0.250 108.33%
Geometric Mean 4.140 -3.32%