Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/087d83e0c6d94c1ad6a68b089950d05185d0e043 (+ 2635 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-cpu2017rate--llvm-arm-master-O2-build/318/
Filter

llvm-arm-master-O2 test results

Run Order Start Time Duration
Current 0318 (llvmorg-21-init-15709-g087d83e0c6d9) 2025-06-03T18:38:45 0:00:00
Previous 0316 (no-change) 2025-05-21T00:56:38 0:00:00
Baseline 0013 (llvmorg-17-init-07454-g7a1044c6affe) 2023-04-08T11:09:44 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 26 2
Performance Improvements 27 3
Added Tests 0 116
Unchanged Tests 625 557
Total Tests 678

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
531.deepsjeng_r 1.07% 10202.000 10311.000 - -2.24% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
531.deepsjeng_r (unexplained diff vs previous) 541.18% 17.000 109.000 - 0.00% -
531.deepsjeng_r (unexplained diff vs previous) (percentage) 523.53% 0.170 1.060 - 0.00% -
525.x264_r (unexplained diff vs previous) (percentage) 344.44% 0.090 0.400 - 0.00% -
525.x264_r (unexplained diff vs previous) 333.33% 9.000 39.000 - 0.00% -
531.deepsjeng_r (max) 115.69% 51.000 110.000 - 0.00% -
519.lbm_r (unexplained diff vs previous) 114.29% 7.000 15.000 - 0.00% -
531.deepsjeng_r (max) (percentage) 114.00% 0.500 1.070 - 0.00% -
519.lbm_r (unexplained diff vs previous) (percentage) 100.00% 0.050 0.100 - 0.00% -
526.blender_r (max) 78.95% 38.000 68.000 - 0.00% -
526.blender_r (max) (percentage) 77.78% 0.360 0.640 - 0.00% -
526.blender_r (unexplained diff vs previous) (percentage) 77.78% 0.360 0.640 - 0.00% -
526.blender_r (unexplained diff vs previous) 76.92% 39.000 69.000 - 0.00% -
520.omnetpp_r (unexplained diff vs previous) (percentage) 20.55% 1.460 1.760 - 0.00% -
520.omnetpp_r (unexplained diff vs previous) 18.39% 174.000 206.000 - 0.00% -
525.x264_r (max) 18.18% 33.000 39.000 - 0.00% -
525.x264_r (max) (percentage) 17.65% 0.340 0.400 - 0.00% -
557.xz_r 5.88% 17.000 18.000 - 0.00% -
557.xz_r (avg) 5.88% 17.000 18.000 - 0.00% -
526.blender_r (avg) (percentage) 3.33% 0.300 0.310 - 0.00% -
526.blender_r 3.12% 32.000 33.000 - 0.00% -
526.blender_r (avg) 3.12% 32.000 33.000 - 0.00% -
531.deepsjeng_r (avg) (percentage) 1.89% 0.530 0.540 - 0.00% -
531.deepsjeng_r 1.85% 54.000 55.000 - 0.00% -
531.deepsjeng_r (avg) 1.85% 54.000 55.000 - 0.00% -
520.omnetpp_r (avg) (percentage) 1.11% 0.900 0.910 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
520.omnetpp_r -1.73% 11878.000 11672.000 - 0.00% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
505.mcf_r (unexplained diff vs previous) -66.13% 62.000 21.000 - 0.00% -
505.mcf_r (unexplained diff vs previous) (percentage) -65.91% 0.440 0.150 - 0.00% -
505.mcf_r (max) (percentage) -24.44% 0.450 0.340 - 0.00% -
505.mcf_r (max) -24.19% 62.000 47.000 - 0.00% -
520.omnetpp_r (max) -9.96% 261.000 235.000 - 0.00% -
520.omnetpp_r (max) (percentage) -8.18% 2.200 2.020 - 0.00% -
538.imagick_r (max) -6.67% 45.000 42.000 - 0.00% -
538.imagick_r (max) (percentage) -6.25% 0.320 0.300 - 0.00% -
557.xz_r (max) (percentage) -6.25% 0.320 0.300 - 0.00% -
557.xz_r (unexplained diff vs previous) (percentage) -6.25% 0.320 0.300 - 0.00% -
557.xz_r (max) -6.25% 32.000 30.000 - 0.00% -
557.xz_r (unexplained diff vs previous) -6.25% 32.000 30.000 - 0.00% -
510.parest_r (max) (percentage) -5.26% 0.190 0.180 - 0.00% -
510.parest_r (max) -5.00% 40.000 38.000 - 0.00% -
541.leela_r (max) -4.76% 21.000 20.000 - 0.00% -
511.povray_r (max) -4.11% 219.000 210.000 - 0.00% -
511.povray_r (max) (percentage) -3.36% 1.190 1.150 - 0.00% -
523.xalancbmk_r (max) -3.33% 60.000 58.000 - 0.00% -
523.xalancbmk_r (max) (percentage) -3.23% 0.620 0.600 - 0.00% -
523.xalancbmk_r -3.03% 33.000 32.000 - 0.00% -
523.xalancbmk_r (avg) -3.03% 33.000 32.000 - 0.00% -
500.perlbench_r (max) (percentage) -2.93% 2.390 2.320 - 0.00% -
500.perlbench_r (max) -2.84% 387.000 376.000 - 0.00% -
502.gcc_r (max) -2.56% 39.000 38.000 - 0.00% -
502.gcc_r (max) (percentage) -2.38% 0.420 0.410 - 0.00% -
544.nab_r (max) -1.54% 65.000 64.000 - 0.00% -

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
505.mcf_r 7.18% 29232.000 31332.000 - 0.00% -
531.deepsjeng_r 2.14% 91600.000 93560.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
557.xz_r -3.80% 10456.000 10059.000 - -0.30% -
531.deepsjeng_r -2.24% 10547.000 10311.000 - 1.07% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_execution_successful 433.33% 3.000 16.000 - 0.00% -

Added Tests - Code Size
500.perlbench_r
502.gcc_r
508.namd_r
510.parest_r
511.povray_r
519.lbm_r
520.omnetpp_r
523.xalancbmk_r
525.x264_r
526.blender_r
538.imagick_r
541.leela_r
544.nab_r

Added Tests - Execution
500.perlbench_r
502.gcc_r
508.namd_r
510.parest_r
511.povray_r
519.lbm_r
520.omnetpp_r
523.xalancbmk_r
525.x264_r
526.blender_r
538.imagick_r
541.leela_r
544.nab_r

Added Tests - sample variability
500.perlbench_r
500.perlbench_r (avg)
500.perlbench_r (avg) (percentage)
500.perlbench_r (max)
500.perlbench_r (max) (percentage)
502.gcc_r
502.gcc_r (avg)
502.gcc_r (avg) (percentage)
502.gcc_r (max)
502.gcc_r (max) (percentage)
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
508.namd_r (unexplained diff vs previous)
508.namd_r (unexplained diff vs previous) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)
519.lbm_r (unexplained diff vs previous)
519.lbm_r (unexplained diff vs previous) (percentage)
520.omnetpp_r
520.omnetpp_r (avg)
520.omnetpp_r (avg) (percentage)
520.omnetpp_r (max)
520.omnetpp_r (max) (percentage)
520.omnetpp_r (unexplained diff vs previous)
520.omnetpp_r (unexplained diff vs previous) (percentage)
523.xalancbmk_r
523.xalancbmk_r (avg)
523.xalancbmk_r (avg) (percentage)
523.xalancbmk_r (max)
523.xalancbmk_r (max) (percentage)
525.x264_r
525.x264_r (avg)
525.x264_r (avg) (percentage)
525.x264_r (max)
525.x264_r (max) (percentage)
525.x264_r (unexplained diff vs previous)
525.x264_r (unexplained diff vs previous) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
526.blender_r (unexplained diff vs previous)
526.blender_r (unexplained diff vs previous) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
538.imagick_r
538.imagick_r (avg)
538.imagick_r (avg) (percentage)
538.imagick_r (max)
538.imagick_r (max) (percentage)
541.leela_r
541.leela_r (avg)
541.leela_r (avg) (percentage)
541.leela_r (max)
541.leela_r (max) (percentage)
544.nab_r
544.nab_r (avg)
544.nab_r (avg) (percentage)
544.nab_r (max)
544.nab_r (max) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)


Report Time: 0.21s
Name Current %
500.perlbench_r 16207.000 -
502.gcc_r 9422.000 -
505.mcf_r 13936.000 -
508.namd_r 8963.000 -
510.parest_r 21352.000 -
511.povray_r 18326.000 -
519.lbm_r 14884.000 -
520.omnetpp_r 11672.000 -1.73%
523.xalancbmk_r 9702.000 -
525.x264_r 9764.000 -
526.blender_r 10733.000 -
531.deepsjeng_r 10311.000 1.07%
538.imagick_r 14273.000 -
541.leela_r 11834.000 -
544.nab_r 11781.000 -
557.xz_r 10059.000 -
Geometric Mean 12293.313 -
Name Current %
500.perlbench_r 2042655.000 -
502.gcc_r 8675103.000 -
505.mcf_r 31332.000 -
508.namd_r 656639.000 -
510.parest_r 7525094.000 -
511.povray_r 909707.000 -
519.lbm_r 13096.000 -
520.omnetpp_r 1708869.000 -
523.xalancbmk_r 3963254.000 -
525.x264_r 514785.000 -
526.blender_r 10119984.000 -
531.deepsjeng_r 93560.000 -
538.imagick_r 1755852.000 -
541.leela_r 138927.000 -
544.nab_r 192687.000 -
557.xz_r 178295.000 -
Geometric Mean 645306.751 -
Name Current %
500.perlbench_r 131.000 -
500.perlbench_r (avg) 131.000 -
500.perlbench_r (avg) (percentage) 0.810 -
500.perlbench_r (max) 376.000 -2.84%
500.perlbench_r (max) (percentage) 2.320 -2.93%
502.gcc_r 34.000 -
502.gcc_r (avg) 34.000 -
502.gcc_r (avg) (percentage) 0.370 -
502.gcc_r (max) 38.000 -2.56%
502.gcc_r (max) (percentage) 0.410 -2.38%
505.mcf_r 34.000 -
505.mcf_r (avg) 34.000 -
505.mcf_r (avg) (percentage) 0.250 -
505.mcf_r (max) 47.000 -24.19%
505.mcf_r (max) (percentage) 0.340 -24.44%
505.mcf_r (unexplained diff vs previous) 21.000 -66.13%
505.mcf_r (unexplained diff vs previous) (percentage) 0.150 -65.91%
508.namd_r 17.000 -
508.namd_r (avg) 17.000 -
508.namd_r (avg) (percentage) 0.200 -
508.namd_r (max) 18.000 -
508.namd_r (max) (percentage) 0.210 -
508.namd_r (unexplained diff vs previous) 9.000 -
508.namd_r (unexplained diff vs previous) (percentage) 0.100 -
510.parest_r 29.000 -
510.parest_r (avg) 29.000 -
510.parest_r (avg) (percentage) 0.140 -
510.parest_r (max) 38.000 -5.00%
510.parest_r (max) (percentage) 0.180 -5.26%
511.povray_r 113.000 -
511.povray_r (avg) 113.000 -
511.povray_r (avg) (percentage) 0.620 -
511.povray_r (max) 210.000 -4.11%
511.povray_r (max) (percentage) 1.150 -3.36%
519.lbm_r 22.000 -
519.lbm_r (avg) 22.000 -
519.lbm_r (avg) (percentage) 0.150 -
519.lbm_r (max) 14.000 -
519.lbm_r (max) (percentage) 0.100 -
519.lbm_r (unexplained diff vs previous) 15.000 114.29%
519.lbm_r (unexplained diff vs previous) (percentage) 0.100 100.00%
520.omnetpp_r 106.000 -
520.omnetpp_r (avg) 106.000 -
520.omnetpp_r (avg) (percentage) 0.910 1.11%
520.omnetpp_r (max) 235.000 -9.96%
520.omnetpp_r (max) (percentage) 2.020 -8.18%
520.omnetpp_r (unexplained diff vs previous) 206.000 18.39%
520.omnetpp_r (unexplained diff vs previous) (percentage) 1.760 20.55%
523.xalancbmk_r 32.000 -3.03%
523.xalancbmk_r (avg) 32.000 -3.03%
523.xalancbmk_r (avg) (percentage) 0.340 -
523.xalancbmk_r (max) 58.000 -3.33%
523.xalancbmk_r (max) (percentage) 0.600 -3.23%
525.x264_r 19.000 -
525.x264_r (avg) 19.000 -
525.x264_r (avg) (percentage) 0.200 -
525.x264_r (max) 39.000 18.18%
525.x264_r (max) (percentage) 0.400 17.65%
525.x264_r (unexplained diff vs previous) 39.000 333.33%
525.x264_r (unexplained diff vs previous) (percentage) 0.400 344.44%
526.blender_r 33.000 3.12%
526.blender_r (avg) 33.000 3.12%
526.blender_r (avg) (percentage) 0.310 3.33%
526.blender_r (max) 68.000 78.95%
526.blender_r (max) (percentage) 0.640 77.78%
526.blender_r (unexplained diff vs previous) 69.000 76.92%
526.blender_r (unexplained diff vs previous) (percentage) 0.640 77.78%
531.deepsjeng_r 55.000 1.85%
531.deepsjeng_r (avg) 55.000 1.85%
531.deepsjeng_r (avg) (percentage) 0.540 1.89%
531.deepsjeng_r (max) 110.000 115.69%
531.deepsjeng_r (max) (percentage) 1.070 114.00%
531.deepsjeng_r (unexplained diff vs previous) 109.000 541.18%
531.deepsjeng_r (unexplained diff vs previous) (percentage) 1.060 523.53%
538.imagick_r 34.000 -
538.imagick_r (avg) 34.000 -
538.imagick_r (avg) (percentage) 0.240 -
538.imagick_r (max) 42.000 -6.67%
538.imagick_r (max) (percentage) 0.300 -6.25%
541.leela_r 29.000 -
541.leela_r (avg) 29.000 -
541.leela_r (avg) (percentage) 0.250 -
541.leela_r (max) 20.000 -4.76%
541.leela_r (max) (percentage) 0.170 -
544.nab_r 43.000 -
544.nab_r (avg) 43.000 -
544.nab_r (avg) (percentage) 0.370 -
544.nab_r (max) 64.000 -1.54%
544.nab_r (max) (percentage) 0.550 -
557.xz_r 18.000 5.88%
557.xz_r (avg) 18.000 5.88%
557.xz_r (avg) (percentage) 0.180 -
557.xz_r (max) 30.000 -6.25%
557.xz_r (max) (percentage) 0.300 -6.25%
557.xz_r (unexplained diff vs previous) 30.000 -6.25%
557.xz_r (unexplained diff vs previous) (percentage) 0.300 -6.25%
Geometric Mean 5.889 9.94%