Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/642e84f0012b6e3a0e4f187bad5ee1775c3d623a (+ 827 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_vect-cpu2017rate--llvm-arm-master-O3-build/209/
Filter

llvm-arm-master-O3 test results

Run Order Start Time Duration
Current 0209 (llvmorg-21-init-00459-g642e84f0012b) 2025-01-28T02:32:03 0:00:00
Previous 0208 (llvmorg-20-init-19137-g81d38da65e33) 2025-01-22T17:38:58 0:00:00
Baseline 0002 (llvmorg-17-init-04550-g890e6c871d31) 2023-03-11T10:55:27 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 7 7
Performance Improvements 24 11
Added Tests 0 69
Unchanged Tests 569 513
Total Tests 600

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
525.x264_r 1.53% 2752.000 2794.000 - -8.30% -
557.xz_r 1.44% 2353.000 2387.000 - -1.93% -
500.perlbench_r 1.10% 2630.000 2659.000 - 0.00% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
531.deepsjeng_r (unexplained diff vs previous) 100.00% 1.000 2.000 - 0.00% -
531.deepsjeng_r (unexplained diff vs previous) (percentage) 100.00% 0.020 0.040 - 0.00% -
505.mcf_r 2.70% 37.000 38.000 - 0.00% -
505.mcf_r (avg) 2.70% 37.000 38.000 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
502.gcc_r -1.10% 3738.000 3697.000 - -3.65% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
511.povray_r (max) -12.50% 8.000 7.000 - 0.00% -
520.omnetpp_r (max) (percentage) -11.63% 0.430 0.380 - 0.00% -
557.xz_r (max) -10.53% 19.000 17.000 - 0.00% -
525.x264_r (max) -10.00% 20.000 18.000 - 0.00% -
557.xz_r (max) (percentage) -9.88% 0.810 0.730 - 0.00% -
525.x264_r (max) (percentage) -9.59% 0.730 0.660 - 0.00% -
544.nab_r (max) (percentage) -9.09% 0.550 0.500 - 0.00% -
541.leela_r (max) (percentage) -8.65% 1.040 0.950 - 0.00% -
541.leela_r (max) -8.33% 48.000 44.000 - 0.00% -
520.omnetpp_r (max) -7.14% 14.000 13.000 - 0.00% -
544.nab_r (max) -7.14% 42.000 39.000 - 0.00% -
531.deepsjeng_r (max) (percentage) -6.67% 0.600 0.560 - 0.00% -
531.deepsjeng_r (max) -6.25% 32.000 30.000 - 0.00% -
505.mcf_r (max) (percentage) -5.77% 1.040 0.980 - 0.00% -
526.blender_r (max) (percentage) -5.71% 1.050 0.990 - 0.00% -
519.lbm_r (max) (percentage) -5.66% 0.530 0.500 - 0.00% -
519.lbm_r (max) -5.56% 18.000 17.000 - 0.00% -
526.blender_r (max) -5.36% 112.000 106.000 - 0.00% -
508.namd_r (max) (percentage) -5.26% 0.190 0.180 - 0.00% -
505.mcf_r (max) -5.17% 58.000 55.000 - 0.00% -
511.povray_r (max) (percentage) -4.49% 1.780 1.700 - 0.00% -
500.perlbench_r (max) (percentage) -3.49% 0.860 0.830 - 0.00% -
519.lbm_r (avg) (percentage) -3.03% 0.330 0.320 - 0.00% -

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
541.leela_r 1.96% 146749.000 149631.000 - 0.00% -
531.deepsjeng_r 1.24% 100276.000 101520.000 - 0.00% -
520.omnetpp_r 1.15% 1696973.000 1716454.000 - -0.05% -
519.lbm_r 1.06% 13236.000 13376.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
505.mcf_r 1.81% 5574.000 5675.000 - 0.09% -
526.blender_r 1.19% 10587.000 10713.000 - -0.07% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests -6.67% 15.000 14.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
505.mcf_r -2.10% 30344.000 29708.000 - 0.00% -
525.x264_r -2.02% 579285.000 567601.000 - 0.00% -
508.namd_r -1.17% 627440.000 620104.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
525.x264_r -8.30% 3047.000 2794.000 - 1.53% -
520.omnetpp_r -4.35% 3651.000 3492.000 - 0.46% -
502.gcc_r -3.65% 3837.000 3697.000 - -1.10% -
519.lbm_r -2.82% 3682.000 3578.000 - -0.03% -
508.namd_r -2.11% 3085.000 3020.000 - -0.10% -
544.nab_r -2.03% 7962.000 7800.000 - -0.14% -
557.xz_r -1.93% 2434.000 2387.000 - 1.44% -
511.povray_r -1.08% 461.000 456.000 - -0.44% -

Added Tests - Code Size
500.perlbench_r

Added Tests - Execution
500.perlbench_r

Added Tests - sample variability
500.perlbench_r
500.perlbench_r (avg)
500.perlbench_r (avg) (percentage)
500.perlbench_r (max)
500.perlbench_r (max) (percentage)
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)
520.omnetpp_r
520.omnetpp_r (avg)
520.omnetpp_r (avg) (percentage)
520.omnetpp_r (max)
520.omnetpp_r (max) (percentage)
523.xalancbmk_r (avg) (percentage)
523.xalancbmk_r (max) (percentage)
525.x264_r
525.x264_r (avg)
525.x264_r (avg) (percentage)
525.x264_r (max)
525.x264_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
538.imagick_r
538.imagick_r (avg)
538.imagick_r (avg) (percentage)
538.imagick_r (max)
538.imagick_r (max) (percentage)
541.leela_r
541.leela_r (avg)
541.leela_r (avg) (percentage)
541.leela_r (max)
541.leela_r (max) (percentage)
544.nab_r
544.nab_r (avg)
544.nab_r (avg) (percentage)
544.nab_r (max)
544.nab_r (max) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)


Report Time: 0.29s
Name Current %
500.perlbench_r 2659.000 1.10%
502.gcc_r 3697.000 -1.10%
505.mcf_r 5675.000 -
508.namd_r 3020.000 -
511.povray_r 456.000 -
519.lbm_r 3578.000 -
520.omnetpp_r 3492.000 -
525.x264_r 2794.000 1.53%
526.blender_r 10713.000 -
531.deepsjeng_r 5486.000 -
538.imagick_r 3786.000 -
541.leela_r 4653.000 -
544.nab_r 7800.000 -
557.xz_r 2387.000 1.44%
Geometric Mean 3556.006 -
Name Current %
500.perlbench_r 2106336.000 -
502.gcc_r 8879415.000 -
505.mcf_r 29708.000 -
508.namd_r 620104.000 -
511.povray_r 933182.000 -
519.lbm_r 13376.000 -
520.omnetpp_r 1716454.000 -
525.x264_r 567601.000 -
526.blender_r 10614691.000 -
531.deepsjeng_r 101520.000 -
538.imagick_r 1790692.000 -
541.leela_r 149631.000 -
544.nab_r 190087.000 -
557.xz_r 186051.000 -
Geometric Mean 487472.666 -
Name Current %
500.perlbench_r 19.000 -
500.perlbench_r (avg) 19.000 -
500.perlbench_r (avg) (percentage) 0.730 -
500.perlbench_r (max) 22.000 -
500.perlbench_r (max) (percentage) 0.830 -3.49%
505.mcf_r 38.000 2.70%
505.mcf_r (avg) 38.000 2.70%
505.mcf_r (avg) (percentage) 0.670 -
505.mcf_r (max) 55.000 -5.17%
505.mcf_r (max) (percentage) 0.980 -5.77%
508.namd_r 12.000 -
508.namd_r (avg) 12.000 -
508.namd_r (avg) (percentage) 0.410 -
508.namd_r (max) 5.000 -
508.namd_r (max) (percentage) 0.180 -5.26%
511.povray_r 3.000 -
511.povray_r (avg) 3.000 -
511.povray_r (avg) (percentage) 0.850 -
511.povray_r (max) 7.000 -12.50%
511.povray_r (max) (percentage) 1.700 -4.49%
519.lbm_r 11.000 -
519.lbm_r (avg) 11.000 -
519.lbm_r (avg) (percentage) 0.320 -3.03%
519.lbm_r (max) 17.000 -5.56%
519.lbm_r (max) (percentage) 0.500 -5.66%
519.lbm_r (unexplained diff vs previous) 1.000 -
519.lbm_r (unexplained diff vs previous) (percentage) 0.030 -
520.omnetpp_r 41.000 -
520.omnetpp_r (avg) 41.000 -
520.omnetpp_r (avg) (percentage) 1.200 -
520.omnetpp_r (max) 13.000 -7.14%
520.omnetpp_r (max) (percentage) 0.380 -11.63%
523.xalancbmk_r (avg) (percentage) 0.960 -
523.xalancbmk_r (max) (percentage) 1.130 -
525.x264_r 15.000 -
525.x264_r (avg) 15.000 -
525.x264_r (avg) (percentage) 0.570 -
525.x264_r (max) 18.000 -10.00%
525.x264_r (max) (percentage) 0.660 -9.59%
526.blender_r 46.000 -
526.blender_r (avg) 46.000 -
526.blender_r (avg) (percentage) 0.430 -
526.blender_r (max) 106.000 -5.36%
526.blender_r (max) (percentage) 0.990 -5.71%
531.deepsjeng_r 15.000 -
531.deepsjeng_r (avg) 15.000 -
531.deepsjeng_r (avg) (percentage) 0.280 -
531.deepsjeng_r (max) 30.000 -6.25%
531.deepsjeng_r (max) (percentage) 0.560 -6.67%
531.deepsjeng_r (unexplained diff vs previous) 2.000 100.00%
531.deepsjeng_r (unexplained diff vs previous) (percentage) 0.040 100.00%
538.imagick_r 7.000 -
538.imagick_r (avg) 7.000 -
538.imagick_r (avg) (percentage) 0.190 -
538.imagick_r (max) 6.000 -
538.imagick_r (max) (percentage) 0.180 -
541.leela_r 15.000 -
541.leela_r (avg) 15.000 -
541.leela_r (avg) (percentage) 0.330 -
541.leela_r (max) 44.000 -8.33%
541.leela_r (max) (percentage) 0.950 -8.65%
544.nab_r 33.000 -
544.nab_r (avg) 33.000 -
544.nab_r (avg) (percentage) 0.430 -
544.nab_r (max) 39.000 -7.14%
544.nab_r (max) (percentage) 0.500 -9.09%
557.xz_r 15.000 -
557.xz_r (avg) 15.000 -
557.xz_r (avg) (percentage) 0.660 -
557.xz_r (max) 17.000 -10.53%
557.xz_r (max) (percentage) 0.730 -9.88%
Geometric Mean 3.534 22.85%