Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/da61b0ddc5dcc8f1ac64eaddabdbfec5aa23f22b (+ 434 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_vect-cpu2017rate--llvm-arm-master-O3-build/219/
Filter

llvm-arm-master-O3 test results

Run Order Start Time Duration
Current 0219 (llvmorg-21-init-03971-gda61b0ddc5dc) 2025-03-02T06:22:48 0:00:00
Previous 0218 (llvmorg-21-init-03537-gd403f33886a3) 2025-02-26T15:02:57 0:00:00
Baseline 0002 (llvmorg-17-init-04550-g890e6c871d31) 2023-03-11T10:55:27 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 24 6
Performance Improvements 34 12
Added Tests 2 71
Unchanged Tests 540 511
Total Tests 600

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
505.mcf_r 1.80% 5623.000 5724.000 - 2.69% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
519.lbm_r (unexplained diff vs previous) 1150.00% 2.000 25.000 - 0.00% -
519.lbm_r (unexplained diff vs previous) (percentage) 1066.67% 0.060 0.700 - 0.00% -
519.lbm_r (max) (percentage) 141.38% 0.290 0.700 - 0.00% -
519.lbm_r (max) 140.00% 10.000 24.000 - 0.00% -
541.leela_r (unexplained diff vs previous) (percentage) 64.71% 0.170 0.280 - 0.00% -
541.leela_r (unexplained diff vs previous) 62.50% 8.000 13.000 - 0.00% -
505.mcf_r (max) 56.06% 66.000 103.000 - 0.00% -
557.xz_r (max) 55.56% 9.000 14.000 - 0.00% -
557.xz_r (unexplained diff vs previous) 55.56% 9.000 14.000 - 0.00% -
557.xz_r (unexplained diff vs previous) (percentage) 55.26% 0.380 0.590 - 0.00% -
505.mcf_r (max) (percentage) 51.26% 1.190 1.800 - 0.00% -
505.mcf_r (unexplained diff vs previous) 48.53% 68.000 101.000 - 0.00% -
557.xz_r (max) (percentage) 46.34% 0.410 0.600 - 0.00% -
505.mcf_r (unexplained diff vs previous) (percentage) 45.45% 1.210 1.760 - 0.00% -
520.omnetpp_r (unexplained diff vs previous) (percentage) 26.02% 1.960 2.470 - 0.00% -
520.omnetpp_r (unexplained diff vs previous) 23.19% 69.000 85.000 - 0.00% -
520.omnetpp_r (max) (percentage) 17.56% 2.050 2.410 - 0.00% -
520.omnetpp_r (max) 13.89% 72.000 82.000 - 0.00% -
505.mcf_r 5.26% 38.000 40.000 - 0.00% -
505.mcf_r (avg) 5.26% 38.000 40.000 - 0.00% -
505.mcf_r (avg) (percentage) 2.90% 0.690 0.710 - 0.00% -
511.povray_r (unexplained diff vs previous) (percentage) 1.54% 1.300 1.320 - 0.00% -
511.povray_r (avg) (percentage) 1.04% 0.960 0.970 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
520.omnetpp_r -2.41% 3521.000 3436.000 - -5.89% -
511.povray_r -1.30% 460.000 454.000 - -1.52% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
508.namd_r (unexplained diff vs previous) (percentage) -70.00% 0.100 0.030 - 0.00% -
508.namd_r (unexplained diff vs previous) -66.67% 3.000 1.000 - 0.00% -
525.x264_r (unexplained diff vs previous) -60.00% 10.000 4.000 - 0.00% -
531.deepsjeng_r (unexplained diff vs previous) -58.82% 17.000 7.000 - 0.00% -
525.x264_r (unexplained diff vs previous) (percentage) -58.33% 0.360 0.150 - 0.00% -
531.deepsjeng_r (unexplained diff vs previous) (percentage) -58.06% 0.310 0.130 - 0.00% -
538.imagick_r (unexplained diff vs previous) -40.00% 5.000 3.000 - 0.00% -
538.imagick_r (unexplained diff vs previous) (percentage) -38.46% 0.130 0.080 - 0.00% -
526.blender_r (unexplained diff vs previous) (percentage) -31.48% 0.540 0.370 - 0.00% -
526.blender_r (unexplained diff vs previous) -31.03% 58.000 40.000 - 0.00% -
544.nab_r (unexplained diff vs previous) -27.27% 33.000 24.000 - 0.00% -
544.nab_r (unexplained diff vs previous) (percentage) -26.19% 0.420 0.310 - 0.00% -
526.blender_r (max) -19.35% 62.000 50.000 - 0.00% -
526.blender_r (max) (percentage) -18.97% 0.580 0.470 - 0.00% -
500.perlbench_r (max) (percentage) -12.59% 1.350 1.180 - 0.00% -
500.perlbench_r (max) -11.11% 36.000 32.000 - 0.00% -
538.imagick_r (max) (percentage) -7.69% 0.130 0.120 - 0.00% -
525.x264_r (max) -7.14% 14.000 13.000 - 0.00% -
525.x264_r (max) (percentage) -5.77% 0.520 0.490 - 0.00% -
541.leela_r (max) -4.76% 21.000 20.000 - 0.00% -
544.nab_r (max) (percentage) -4.55% 0.880 0.840 - 0.00% -
544.nab_r (max) -4.41% 68.000 65.000 - 0.00% -
541.leela_r (max) (percentage) -4.35% 0.460 0.440 - 0.00% -
511.povray_r (max) (percentage) -4.00% 3.250 3.120 - 0.00% -
531.deepsjeng_r (max) (percentage) -2.63% 0.380 0.370 - 0.00% -
508.namd_r (avg) (percentage) -2.56% 0.390 0.380 - 0.00% -
520.omnetpp_r -2.38% 42.000 41.000 - 0.00% -
520.omnetpp_r (avg) -2.38% 42.000 41.000 - 0.00% -
526.blender_r -2.17% 46.000 45.000 - 0.00% -
526.blender_r (avg) -2.17% 46.000 45.000 - 0.00% -
525.x264_r (avg) (percentage) -1.72% 0.580 0.570 - 0.00% -
500.perlbench_r (avg) (percentage) -1.32% 0.760 0.750 - 0.00% -

Added Tests - sample variability
500.perlbench_r (unexplained diff vs previous)
500.perlbench_r (unexplained diff vs previous) (percentage)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
541.leela_r 1.92% 146749.000 149563.000 - 0.00% -
531.deepsjeng_r 1.21% 100276.000 101488.000 - 0.00% -
520.omnetpp_r 1.12% 1696973.000 1715986.000 - 0.00% -
519.lbm_r 1.06% 13236.000 13376.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
505.mcf_r 2.69% 5574.000 5724.000 - 1.80% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests -6.67% 15.000 14.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
525.x264_r -2.13% 579285.000 566945.000 - 0.00% -
505.mcf_r -2.04% 30344.000 29724.000 - 0.00% -
508.namd_r -1.13% 627440.000 620344.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
525.x264_r -9.65% 3047.000 2753.000 - 0.15% -
520.omnetpp_r -5.89% 3651.000 3436.000 - -2.41% -
519.lbm_r -3.53% 3682.000 3552.000 - -0.70% -
557.xz_r -3.00% 2434.000 2361.000 - 0.60% -
502.gcc_r -3.00% 3837.000 3722.000 - 0.59% -
508.namd_r -2.20% 3085.000 3017.000 - -0.03% -
544.nab_r -2.12% 7962.000 7793.000 - -0.31% -
511.povray_r -1.52% 461.000 454.000 - -1.30% -
541.leela_r -1.38% 4699.000 4634.000 - 0.28% -

Added Tests - Code Size
500.perlbench_r

Added Tests - Execution
500.perlbench_r

Added Tests - sample variability
500.perlbench_r
500.perlbench_r (avg)
500.perlbench_r (avg) (percentage)
500.perlbench_r (max)
500.perlbench_r (max) (percentage)
500.perlbench_r (unexplained diff vs previous)
500.perlbench_r (unexplained diff vs previous) (percentage)
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)
520.omnetpp_r
520.omnetpp_r (avg)
520.omnetpp_r (avg) (percentage)
520.omnetpp_r (max)
520.omnetpp_r (max) (percentage)
523.xalancbmk_r (avg) (percentage)
523.xalancbmk_r (max) (percentage)
525.x264_r
525.x264_r (avg)
525.x264_r (avg) (percentage)
525.x264_r (max)
525.x264_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
538.imagick_r
538.imagick_r (avg)
538.imagick_r (avg) (percentage)
538.imagick_r (max)
538.imagick_r (max) (percentage)
541.leela_r
541.leela_r (avg)
541.leela_r (avg) (percentage)
541.leela_r (max)
541.leela_r (max) (percentage)
544.nab_r
544.nab_r (avg)
544.nab_r (avg) (percentage)
544.nab_r (max)
544.nab_r (max) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)


Report Time: 0.24s
Name Current %
500.perlbench_r 2715.000 -
502.gcc_r 3722.000 -
505.mcf_r 5724.000 1.80%
508.namd_r 3017.000 -
511.povray_r 454.000 -1.30%
519.lbm_r 3552.000 -
520.omnetpp_r 3436.000 -2.41%
525.x264_r 2753.000 -
526.blender_r 10668.000 -
531.deepsjeng_r 5491.000 -
538.imagick_r 3781.000 -
541.leela_r 4634.000 -
544.nab_r 7793.000 -
557.xz_r 2361.000 -
Geometric Mean 3548.897 -
Name Current %
500.perlbench_r 2104448.000 -
502.gcc_r 8877879.000 -
505.mcf_r 29724.000 -
508.namd_r 620344.000 -
511.povray_r 933314.000 -
519.lbm_r 13376.000 -
520.omnetpp_r 1715986.000 -
525.x264_r 566945.000 -
526.blender_r 10611155.000 -
531.deepsjeng_r 101488.000 -
538.imagick_r 1790580.000 -
541.leela_r 149563.000 -
544.nab_r 190035.000 -
557.xz_r 186147.000 -
Geometric Mean 487390.662 -
Name Current %
500.perlbench_r 20.000 -
500.perlbench_r (avg) 20.000 -
500.perlbench_r (avg) (percentage) 0.750 -1.32%
500.perlbench_r (max) 32.000 -11.11%
500.perlbench_r (max) (percentage) 1.180 -12.59%
500.perlbench_r (unexplained diff vs previous) 7.000 -
500.perlbench_r (unexplained diff vs previous) (percentage) 0.260 -
505.mcf_r 40.000 5.26%
505.mcf_r (avg) 40.000 5.26%
505.mcf_r (avg) (percentage) 0.710 2.90%
505.mcf_r (max) 103.000 56.06%
505.mcf_r (max) (percentage) 1.800 51.26%
505.mcf_r (unexplained diff vs previous) 101.000 48.53%
505.mcf_r (unexplained diff vs previous) (percentage) 1.760 45.45%
508.namd_r 11.000 -
508.namd_r (avg) 11.000 -
508.namd_r (avg) (percentage) 0.380 -2.56%
508.namd_r (max) 6.000 -
508.namd_r (max) (percentage) 0.200 -
508.namd_r (unexplained diff vs previous) 1.000 -66.67%
508.namd_r (unexplained diff vs previous) (percentage) 0.030 -70.00%
511.povray_r 4.000 -
511.povray_r (avg) 4.000 -
511.povray_r (avg) (percentage) 0.970 1.04%
511.povray_r (max) 14.000 -
511.povray_r (max) (percentage) 3.120 -4.00%
511.povray_r (unexplained diff vs previous) 6.000 -
511.povray_r (unexplained diff vs previous) (percentage) 1.320 1.54%
519.lbm_r 11.000 -
519.lbm_r (avg) 11.000 -
519.lbm_r (avg) (percentage) 0.320 -
519.lbm_r (max) 24.000 140.00%
519.lbm_r (max) (percentage) 0.700 141.38%
519.lbm_r (unexplained diff vs previous) 25.000 1150.00%
519.lbm_r (unexplained diff vs previous) (percentage) 0.700 1066.67%
520.omnetpp_r 41.000 -2.38%
520.omnetpp_r (avg) 41.000 -2.38%
520.omnetpp_r (avg) (percentage) 1.210 -
520.omnetpp_r (max) 82.000 13.89%
520.omnetpp_r (max) (percentage) 2.410 17.56%
520.omnetpp_r (unexplained diff vs previous) 85.000 23.19%
520.omnetpp_r (unexplained diff vs previous) (percentage) 2.470 26.02%
523.xalancbmk_r (avg) (percentage) 0.960 -
523.xalancbmk_r (max) (percentage) 1.120 -
525.x264_r 15.000 -
525.x264_r (avg) 15.000 -
525.x264_r (avg) (percentage) 0.570 -1.72%
525.x264_r (max) 13.000 -7.14%
525.x264_r (max) (percentage) 0.490 -5.77%
525.x264_r (unexplained diff vs previous) 4.000 -60.00%
525.x264_r (unexplained diff vs previous) (percentage) 0.150 -58.33%
526.blender_r 45.000 -2.17%
526.blender_r (avg) 45.000 -2.17%
526.blender_r (avg) (percentage) 0.430 -
526.blender_r (max) 50.000 -19.35%
526.blender_r (max) (percentage) 0.470 -18.97%
526.blender_r (unexplained diff vs previous) 40.000 -31.03%
526.blender_r (unexplained diff vs previous) (percentage) 0.370 -31.48%
531.deepsjeng_r 15.000 -
531.deepsjeng_r (avg) 15.000 -
531.deepsjeng_r (avg) (percentage) 0.290 -
531.deepsjeng_r (max) 20.000 -
531.deepsjeng_r (max) (percentage) 0.370 -2.63%
531.deepsjeng_r (unexplained diff vs previous) 7.000 -58.82%
531.deepsjeng_r (unexplained diff vs previous) (percentage) 0.130 -58.06%
538.imagick_r 6.000 -
538.imagick_r (avg) 6.000 -
538.imagick_r (avg) (percentage) 0.180 -
538.imagick_r (max) 4.000 -
538.imagick_r (max) (percentage) 0.120 -7.69%
538.imagick_r (unexplained diff vs previous) 3.000 -40.00%
538.imagick_r (unexplained diff vs previous) (percentage) 0.080 -38.46%
541.leela_r 15.000 -
541.leela_r (avg) 15.000 -
541.leela_r (avg) (percentage) 0.340 -
541.leela_r (max) 20.000 -4.76%
541.leela_r (max) (percentage) 0.440 -4.35%
541.leela_r (unexplained diff vs previous) 13.000 62.50%
541.leela_r (unexplained diff vs previous) (percentage) 0.280 64.71%
544.nab_r 32.000 -
544.nab_r (avg) 32.000 -
544.nab_r (avg) (percentage) 0.420 -
544.nab_r (max) 65.000 -4.41%
544.nab_r (max) (percentage) 0.840 -4.55%
544.nab_r (unexplained diff vs previous) 24.000 -27.27%
544.nab_r (unexplained diff vs previous) (percentage) 0.310 -26.19%
557.xz_r 15.000 -
557.xz_r (avg) 15.000 -
557.xz_r (avg) (percentage) 0.640 -
557.xz_r (max) 14.000 55.56%
557.xz_r (max) (percentage) 0.600 46.34%
557.xz_r (unexplained diff vs previous) 14.000 55.56%
557.xz_r (unexplained diff vs previous) (percentage) 0.590 55.26%
Geometric Mean 3.550 -