Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/fb8ce45a037f0b2eb6e9c3eaffe139c6b6b5481c (+ 216 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_vect-cpu2017rate--llvm-arm-master-O3-build/62/
Filter

llvm-arm-master-O3 test results

Run Order Start Time Duration
Current 0062 (llvmorg-18-init-06904-gfb8ce45a037f) 2023-09-23T05:18:34 0:00:00
Previous 0061 (llvmorg-18-init-06688-gd437e68b5b5a) 2023-09-19T21:30:50 0:00:00
Baseline 0002 (llvmorg-17-init-04550-g890e6c871d31) 2023-03-11T10:55:27 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 22 1
Performance Improvements 30 9
Added Tests 0 69
Unchanged Tests 536 509
Total Tests 588

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
541.leela_r (unexplained diff vs previous) (percentage) 325.00% 0.040 0.170 - 0.00% -
541.leela_r (unexplained diff vs previous) 300.00% 2.000 8.000 - 0.00% -
544.nab_r (unexplained diff vs previous) (percentage) 209.09% 0.110 0.340 - 0.00% -
544.nab_r (unexplained diff vs previous) 200.00% 9.000 27.000 - 0.00% -
508.namd_r (unexplained diff vs previous) (percentage) 107.69% 0.130 0.270 - 0.00% -
525.x264_r (max) 107.69% 13.000 27.000 - 0.00% -
525.x264_r (unexplained diff vs previous) 107.69% 13.000 27.000 - 0.00% -
525.x264_r (unexplained diff vs previous) (percentage) 106.52% 0.460 0.950 - 0.00% -
508.namd_r (unexplained diff vs previous) 100.00% 4.000 8.000 - 0.00% -
519.lbm_r (unexplained diff vs previous) 100.00% 6.000 12.000 - 0.00% -
519.lbm_r (unexplained diff vs previous) (percentage) 100.00% 0.170 0.340 - 0.00% -
525.x264_r (max) (percentage) 95.92% 0.490 0.960 - 0.00% -
544.nab_r (max) 73.33% 15.000 26.000 - 0.00% -
544.nab_r (max) (percentage) 70.00% 0.200 0.340 - 0.00% -
519.lbm_r (max) 50.00% 8.000 12.000 - 0.00% -
519.lbm_r (max) (percentage) 47.83% 0.230 0.340 - 0.00% -
520.omnetpp_r (unexplained diff vs previous) (percentage) 22.50% 0.400 0.490 - 0.00% -
520.omnetpp_r (unexplained diff vs previous) 21.43% 14.000 17.000 - 0.00% -
525.x264_r 5.88% 17.000 18.000 - 0.00% -
525.x264_r (avg) 5.88% 17.000 18.000 - 0.00% -
525.x264_r (avg) (percentage) 3.23% 0.620 0.640 - 0.00% -
505.mcf_r (avg) (percentage) 1.59% 0.630 0.640 - 0.00% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
531.deepsjeng_r (unexplained diff vs previous) -92.31% 13.000 1.000 - 0.00% -
531.deepsjeng_r (unexplained diff vs previous) (percentage) -91.67% 0.240 0.020 - 0.00% -
505.mcf_r (unexplained diff vs previous) -21.82% 55.000 43.000 - 0.00% -
505.mcf_r (unexplained diff vs previous) (percentage) -20.79% 1.010 0.800 - 0.00% -
505.mcf_r (max) -18.18% 55.000 45.000 - 0.00% -
505.mcf_r (max) (percentage) -16.67% 1.020 0.850 - 0.00% -
531.deepsjeng_r -10.53% 19.000 17.000 - 0.00% -
531.deepsjeng_r (avg) -10.53% 19.000 17.000 - 0.00% -
541.leela_r (avg) (percentage) -10.20% 0.490 0.440 - 0.00% -
557.xz_r (max) -10.00% 10.000 9.000 - 0.00% -
541.leela_r -9.09% 22.000 20.000 - 0.00% -
541.leela_r (avg) -9.09% 22.000 20.000 - 0.00% -
531.deepsjeng_r (avg) (percentage) -8.57% 0.350 0.320 - 0.00% -
508.namd_r (max) -7.14% 14.000 13.000 - 0.00% -
531.deepsjeng_r (max) -6.67% 15.000 14.000 - 0.00% -
508.namd_r -6.25% 16.000 15.000 - 0.00% -
508.namd_r (avg) -6.25% 16.000 15.000 - 0.00% -
508.namd_r (avg) (percentage) -5.66% 0.530 0.500 - 0.00% -
557.xz_r (max) (percentage) -4.65% 0.430 0.410 - 0.00% -
508.namd_r (max) (percentage) -4.17% 0.480 0.460 - 0.00% -
531.deepsjeng_r (max) (percentage) -3.57% 0.280 0.270 - 0.00% -
520.omnetpp_r (avg) (percentage) -2.91% 1.030 1.000 - 0.00% -
541.leela_r (max) -2.78% 36.000 35.000 - 0.00% -
520.omnetpp_r (max) (percentage) -2.00% 0.500 0.490 - 0.00% -
511.povray_r (max) (percentage) -1.85% 0.540 0.530 - 0.00% -
538.imagick_r (max) (percentage) -1.82% 0.550 0.540 - 0.00% -
500.perlbench_r (max) (percentage) -1.72% 0.580 0.570 - 0.00% -
526.blender_r (max) -1.37% 73.000 72.000 - 0.00% -
541.leela_r (max) (percentage) -1.30% 0.770 0.760 - 0.00% -
523.xalancbmk_r (max) (percentage) -1.11% 0.900 0.890 - 0.00% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests -6.67% 15.000 14.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
525.x264_r -7.09% 3047.000 2831.000 - 0.96% -
520.omnetpp_r -4.08% 3651.000 3502.000 - 0.49% -
519.lbm_r -3.69% 3682.000 3546.000 - -0.34% -
557.xz_r -3.33% 2434.000 2353.000 - -0.38% -
505.mcf_r -3.25% 5574.000 5393.000 - -0.79% -
511.povray_r -2.60% 461.000 449.000 - 0.00% -
502.gcc_r -2.53% 3837.000 3740.000 - 0.29% -
508.namd_r -2.30% 3085.000 3014.000 - -0.26% -
531.deepsjeng_r -1.24% 5501.000 5433.000 - 0.02% -

Added Tests - Code Size
500.perlbench_r

Added Tests - Execution
500.perlbench_r

Added Tests - sample variability
500.perlbench_r
500.perlbench_r (avg)
500.perlbench_r (avg) (percentage)
500.perlbench_r (max)
500.perlbench_r (max) (percentage)
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)
520.omnetpp_r
520.omnetpp_r (avg)
520.omnetpp_r (avg) (percentage)
520.omnetpp_r (max)
520.omnetpp_r (max) (percentage)
523.xalancbmk_r (avg) (percentage)
523.xalancbmk_r (max) (percentage)
525.x264_r
525.x264_r (avg)
525.x264_r (avg) (percentage)
525.x264_r (max)
525.x264_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
538.imagick_r
538.imagick_r (avg)
538.imagick_r (avg) (percentage)
538.imagick_r (max)
538.imagick_r (max) (percentage)
541.leela_r
541.leela_r (avg)
541.leela_r (avg) (percentage)
541.leela_r (max)
541.leela_r (max) (percentage)
544.nab_r
544.nab_r (avg)
544.nab_r (avg) (percentage)
544.nab_r (max)
544.nab_r (max) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)


Report Time: 0.22s
Name Current %
500.perlbench_r 2642.000 -
502.gcc_r 3740.000 -
505.mcf_r 5393.000 -
508.namd_r 3014.000 -
511.povray_r 449.000 -
519.lbm_r 3546.000 -
520.omnetpp_r 3502.000 -
525.x264_r 2831.000 -
526.blender_r 10593.000 -
531.deepsjeng_r 5433.000 -
538.imagick_r 3770.000 -
541.leela_r 4673.000 -
544.nab_r 7933.000 -
557.xz_r 2353.000 -
Geometric Mean 3537.107 -
Name Current %
500.perlbench_r 2115568.000 -
502.gcc_r 8923131.000 -
505.mcf_r 30144.000 -
508.namd_r 626620.000 -
511.povray_r 932521.000 -
519.lbm_r 13292.000 -
520.omnetpp_r 1698583.000 -
525.x264_r 576141.000 -
526.blender_r 10637005.000 -
531.deepsjeng_r 101096.000 -
538.imagick_r 1790576.000 -
541.leela_r 146765.000 -
544.nab_r 190431.000 -
557.xz_r 186347.000 -
Geometric Mean 487949.040 -
Name Current %
500.perlbench_r 10.000 -
500.perlbench_r (avg) 10.000 -
500.perlbench_r (avg) (percentage) 0.410 -
500.perlbench_r (max) 15.000 -
500.perlbench_r (max) (percentage) 0.570 -1.72%
505.mcf_r 34.000 -
505.mcf_r (avg) 34.000 -
505.mcf_r (avg) (percentage) 0.640 1.59%
505.mcf_r (max) 45.000 -18.18%
505.mcf_r (max) (percentage) 0.850 -16.67%
505.mcf_r (unexplained diff vs previous) 43.000 -21.82%
505.mcf_r (unexplained diff vs previous) (percentage) 0.800 -20.79%
508.namd_r 15.000 -6.25%
508.namd_r (avg) 15.000 -6.25%
508.namd_r (avg) (percentage) 0.500 -5.66%
508.namd_r (max) 13.000 -7.14%
508.namd_r (max) (percentage) 0.460 -4.17%
508.namd_r (unexplained diff vs previous) 8.000 100.00%
508.namd_r (unexplained diff vs previous) (percentage) 0.270 107.69%
511.povray_r 3.000 -
511.povray_r (avg) 3.000 -
511.povray_r (avg) (percentage) 0.790 -
511.povray_r (max) 2.000 -
511.povray_r (max) (percentage) 0.530 -1.85%
519.lbm_r 11.000 -
519.lbm_r (avg) 11.000 -
519.lbm_r (avg) (percentage) 0.320 -
519.lbm_r (max) 12.000 50.00%
519.lbm_r (max) (percentage) 0.340 47.83%
519.lbm_r (unexplained diff vs previous) 12.000 100.00%
519.lbm_r (unexplained diff vs previous) (percentage) 0.340 100.00%
520.omnetpp_r 35.000 -
520.omnetpp_r (avg) 35.000 -
520.omnetpp_r (avg) (percentage) 1.000 -2.91%
520.omnetpp_r (max) 17.000 -
520.omnetpp_r (max) (percentage) 0.490 -2.00%
520.omnetpp_r (unexplained diff vs previous) 17.000 21.43%
520.omnetpp_r (unexplained diff vs previous) (percentage) 0.490 22.50%
523.xalancbmk_r (avg) (percentage) 0.760 -
523.xalancbmk_r (max) (percentage) 0.890 -1.11%
525.x264_r 18.000 5.88%
525.x264_r (avg) 18.000 5.88%
525.x264_r (avg) (percentage) 0.640 3.23%
525.x264_r (max) 27.000 107.69%
525.x264_r (max) (percentage) 0.960 95.92%
525.x264_r (unexplained diff vs previous) 27.000 107.69%
525.x264_r (unexplained diff vs previous) (percentage) 0.950 106.52%
526.blender_r 45.000 -
526.blender_r (avg) 45.000 -
526.blender_r (avg) (percentage) 0.430 -
526.blender_r (max) 72.000 -1.37%
526.blender_r (max) (percentage) 0.680 -
531.deepsjeng_r 17.000 -10.53%
531.deepsjeng_r (avg) 17.000 -10.53%
531.deepsjeng_r (avg) (percentage) 0.320 -8.57%
531.deepsjeng_r (max) 14.000 -6.67%
531.deepsjeng_r (max) (percentage) 0.270 -3.57%
531.deepsjeng_r (unexplained diff vs previous) 1.000 -92.31%
531.deepsjeng_r (unexplained diff vs previous) (percentage) 0.020 -91.67%
538.imagick_r 12.000 -
538.imagick_r (avg) 12.000 -
538.imagick_r (avg) (percentage) 0.330 -
538.imagick_r (max) 20.000 -
538.imagick_r (max) (percentage) 0.540 -1.82%
541.leela_r 20.000 -9.09%
541.leela_r (avg) 20.000 -9.09%
541.leela_r (avg) (percentage) 0.440 -10.20%
541.leela_r (max) 35.000 -2.78%
541.leela_r (max) (percentage) 0.760 -1.30%
541.leela_r (unexplained diff vs previous) 8.000 300.00%
541.leela_r (unexplained diff vs previous) (percentage) 0.170 325.00%
544.nab_r 21.000 -
544.nab_r (avg) 21.000 -
544.nab_r (avg) (percentage) 0.270 -
544.nab_r (max) 26.000 73.33%
544.nab_r (max) (percentage) 0.340 70.00%
544.nab_r (unexplained diff vs previous) 27.000 200.00%
544.nab_r (unexplained diff vs previous) (percentage) 0.340 209.09%
557.xz_r 16.000 -
557.xz_r (avg) 16.000 -
557.xz_r (avg) (percentage) 0.700 -
557.xz_r (max) 9.000 -10.00%
557.xz_r (max) (percentage) 0.410 -4.65%
Geometric Mean 3.397 7.36%