Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/360f82f3703fa57de42a2f998b172551f294e11a (+ 279 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-cpu2017rate--llvm-arm-master-Oz_LTO-build/53/
Filter

llvm-arm-master-Oz_LTO test results

Run Order Start Time Duration
Current 0053 (llvmorg-20-init-04538-g360f82f3703f) 2024-09-01T16:38:02 0:00:00
Previous 0052 (llvmorg-20-init-04259-g6f682c26b04f) 2024-08-29T22:27:18 0:00:00
Baseline 0025 (llvmorg-19-init-16254-g1846523bb772) 2024-07-02T11:39:54 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 22 0
Performance Improvements 30 4
Added Tests 0 74
Unchanged Tests 578 552
Total Tests 630

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
557.xz_r (unexplained diff vs previous) 700.00% 2.000 16.000 0.000 0.00% 0.000
557.xz_r (unexplained diff vs previous) (percentage) 650.00% 0.020 0.150 0.000 0.00% 0.000
525.x264_r (max) (percentage) 69.70% 0.660 1.120 - 0.00% -
525.x264_r (unexplained diff vs previous) (percentage) 68.66% 0.670 1.130 0.000 0.00% 0.000
525.x264_r (max) 68.04% 97.000 163.000 - 0.00% -
525.x264_r (unexplained diff vs previous) 67.68% 99.000 166.000 0.000 0.00% 0.000
519.lbm_r (unexplained diff vs previous) (percentage) 46.67% 0.150 0.220 0.000 0.00% 0.000
519.lbm_r (unexplained diff vs previous) 42.11% 19.000 27.000 0.000 0.00% 0.000
525.x264_r 33.33% 39.000 52.000 - 0.00% -
525.x264_r (avg) 33.33% 39.000 52.000 - 0.00% -
525.x264_r (avg) (percentage) 33.33% 0.270 0.360 - 0.00% -
520.omnetpp_r (unexplained diff vs previous) (percentage) 22.41% 0.580 0.710 0.000 0.00% 0.000
520.omnetpp_r (unexplained diff vs previous) 21.05% 76.000 92.000 0.000 0.00% 0.000
557.xz_r (max) 15.38% 13.000 15.000 - 0.00% -
557.xz_r (max) (percentage) 15.38% 0.130 0.150 - 0.00% -
557.xz_r 10.00% 10.000 11.000 - 0.00% -
557.xz_r (avg) 10.00% 10.000 11.000 - 0.00% -
526.blender_r (max) 3.57% 28.000 29.000 - 0.00% -
526.blender_r 2.94% 34.000 35.000 - 0.00% -
526.blender_r (avg) 2.94% 34.000 35.000 - 0.00% -
541.leela_r 2.78% 36.000 37.000 - 0.00% -
541.leela_r (avg) 2.78% 36.000 37.000 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
511.povray_r -1.97% 20380.000 19979.000 - -0.10% -
538.imagick_r -1.44% 14041.000 13839.000 - -1.45% -
531.deepsjeng_r -1.38% 10689.000 10541.000 - -1.84% -
523.xalancbmk_r -1.18% 11134.000 11003.000 - 0.00% -
500.perlbench_r -1.15% 14804.000 14634.000 - -2.05% -
525.x264_r -1.12% 14794.000 14628.000 - 0.63% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
505.mcf_r (max) (percentage) -10.53% 0.380 0.340 - 0.00% -
505.mcf_r (max) -10.20% 49.000 44.000 - 0.00% -
511.povray_r (max) -6.45% 93.000 87.000 - 0.00% -
531.deepsjeng_r (max) -5.98% 184.000 173.000 - 0.00% -
538.imagick_r (max) -5.94% 101.000 95.000 - 0.00% -
531.deepsjeng_r (max) (percentage) -4.62% 1.730 1.650 - 0.00% -
511.povray_r (max) (percentage) -4.35% 0.460 0.440 - 0.00% -
538.imagick_r (max) (percentage) -4.17% 0.720 0.690 - 0.00% -
544.nab_r (max) -4.11% 73.000 70.000 - 0.00% -
520.omnetpp_r -3.74% 107.000 103.000 - 0.00% -
520.omnetpp_r (avg) -3.74% 107.000 103.000 - 0.00% -
541.leela_r (max) -3.57% 56.000 54.000 - 0.00% -
544.nab_r (max) (percentage) -3.13% 0.640 0.620 - 0.00% -
520.omnetpp_r (max) -3.06% 229.000 222.000 - 0.00% -
519.lbm_r (max) (percentage) -3.03% 0.330 0.320 - 0.00% -
500.perlbench_r (max) -2.70% 111.000 108.000 - 0.00% -
519.lbm_r (max) -2.44% 41.000 40.000 - 0.00% -
520.omnetpp_r (avg) (percentage) -2.44% 0.820 0.800 - 0.00% -
520.omnetpp_r (max) (percentage) -2.27% 1.760 1.720 - 0.00% -
511.povray_r -2.25% 89.000 87.000 - 0.00% -
511.povray_r (avg) -2.25% 89.000 87.000 - 0.00% -
500.perlbench_r (max) (percentage) -1.33% 0.750 0.740 - 0.00% -
500.perlbench_r -1.11% 90.000 89.000 - 0.00% -
500.perlbench_r (avg) -1.11% 90.000 89.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
520.omnetpp_r -2.33% 13266.000 12957.000 - -0.71% -
500.perlbench_r -2.05% 14941.000 14634.000 - -1.15% -
531.deepsjeng_r -1.84% 10739.000 10541.000 - -1.38% -
538.imagick_r -1.45% 14043.000 13839.000 - -1.44% -

Added Tests - Code Size
523.xalancbmk_r

Added Tests - Execution
523.xalancbmk_r

Added Tests - sample variability
500.perlbench_r
500.perlbench_r (avg)
500.perlbench_r (avg) (percentage)
500.perlbench_r (max)
500.perlbench_r (max) (percentage)
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r (avg) (percentage)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)
520.omnetpp_r
520.omnetpp_r (avg)
520.omnetpp_r (avg) (percentage)
520.omnetpp_r (max)
520.omnetpp_r (max) (percentage)
523.xalancbmk_r
523.xalancbmk_r (avg)
523.xalancbmk_r (avg) (percentage)
523.xalancbmk_r (max)
523.xalancbmk_r (max) (percentage)
525.x264_r
525.x264_r (avg)
525.x264_r (avg) (percentage)
525.x264_r (max)
525.x264_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
538.imagick_r
538.imagick_r (avg)
538.imagick_r (avg) (percentage)
538.imagick_r (max)
538.imagick_r (max) (percentage)
541.leela_r
541.leela_r (avg)
541.leela_r (avg) (percentage)
541.leela_r (max)
541.leela_r (max) (percentage)
544.nab_r
544.nab_r (avg)
544.nab_r (avg) (percentage)
544.nab_r (max)
544.nab_r (max) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)


Report Time: 0.22s
Name Current %
500.perlbench_r 14634.000 -1.15%
502.gcc_r 9858.000 -
505.mcf_r 13155.000 -
508.namd_r 9933.000 -
511.povray_r 19979.000 -1.97%
519.lbm_r 12548.000 -
520.omnetpp_r 12957.000 -
523.xalancbmk_r 11003.000 -1.18%
525.x264_r 14628.000 -1.12%
526.blender_r 12143.000 -
531.deepsjeng_r 10541.000 -1.38%
538.imagick_r 13839.000 -1.44%
541.leela_r 11947.000 -
544.nab_r 11410.000 -
557.xz_r 10531.000 -
Geometric Mean 12395.572 -
Name Current %
500.perlbench_r 1112822.000 -
502.gcc_r 4432353.000 -
505.mcf_r 12421.000 -
508.namd_r 276257.000 -
511.povray_r 515496.000 -
519.lbm_r 9312.000 -
520.omnetpp_r 825828.000 -
523.xalancbmk_r 1707876.000 -
525.x264_r 270269.000 -
526.blender_r 5801930.000 -
531.deepsjeng_r 49890.000 -
538.imagick_r 712610.000 -
541.leela_r 43343.000 -
544.nab_r 49365.000 -
557.xz_r 80627.000 -
Geometric Mean 252820.988 -
Name Current %
500.perlbench_r 89.000 -1.11%
500.perlbench_r (avg) 89.000 -1.11%
500.perlbench_r (avg) (percentage) 0.610 -
500.perlbench_r (max) 108.000 -2.70%
500.perlbench_r (max) (percentage) 0.740 -1.33%
505.mcf_r 36.000 -
505.mcf_r (avg) 36.000 -
505.mcf_r (avg) (percentage) 0.280 -
505.mcf_r (max) 44.000 -10.20%
505.mcf_r (max) (percentage) 0.340 -10.53%
508.namd_r 14.000 -
508.namd_r (avg) 14.000 -
508.namd_r (avg) (percentage) 0.150 -
508.namd_r (max) 15.000 -
508.namd_r (max) (percentage) 0.160 -
510.parest_r (avg) (percentage) 0.050 -
510.parest_r (max) (percentage) 0.090 -
511.povray_r 87.000 -2.25%
511.povray_r (avg) 87.000 -2.25%
511.povray_r (avg) (percentage) 0.440 -
511.povray_r (max) 87.000 -6.45%
511.povray_r (max) (percentage) 0.440 -4.35%
519.lbm_r 25.000 -
519.lbm_r (avg) 25.000 -
519.lbm_r (avg) (percentage) 0.200 -
519.lbm_r (max) 40.000 -2.44%
519.lbm_r (max) (percentage) 0.320 -3.03%
519.lbm_r (unexplained diff vs previous) 27.000 42.11%
519.lbm_r (unexplained diff vs previous) (percentage) 0.220 46.67%
520.omnetpp_r 103.000 -3.74%
520.omnetpp_r (avg) 103.000 -3.74%
520.omnetpp_r (avg) (percentage) 0.800 -2.44%
520.omnetpp_r (max) 222.000 -3.06%
520.omnetpp_r (max) (percentage) 1.720 -2.27%
520.omnetpp_r (unexplained diff vs previous) 92.000 21.05%
520.omnetpp_r (unexplained diff vs previous) (percentage) 0.710 22.41%
523.xalancbmk_r 25.000 -
523.xalancbmk_r (avg) 25.000 -
523.xalancbmk_r (avg) (percentage) 0.230 -
523.xalancbmk_r (max) 24.000 -
523.xalancbmk_r (max) (percentage) 0.220 -
525.x264_r 52.000 33.33%
525.x264_r (avg) 52.000 33.33%
525.x264_r (avg) (percentage) 0.360 33.33%
525.x264_r (max) 163.000 68.04%
525.x264_r (max) (percentage) 1.120 69.70%
525.x264_r (unexplained diff vs previous) 166.000 67.68%
525.x264_r (unexplained diff vs previous) (percentage) 1.130 68.66%
526.blender_r 35.000 2.94%
526.blender_r (avg) 35.000 2.94%
526.blender_r (avg) (percentage) 0.290 -
526.blender_r (max) 29.000 3.57%
526.blender_r (max) (percentage) 0.240 -
531.deepsjeng_r 117.000 -
531.deepsjeng_r (avg) 117.000 -
531.deepsjeng_r (avg) (percentage) 1.110 -
531.deepsjeng_r (max) 173.000 -5.98%
531.deepsjeng_r (max) (percentage) 1.650 -4.62%
538.imagick_r 40.000 -
538.imagick_r (avg) 40.000 -
538.imagick_r (avg) (percentage) 0.290 -
538.imagick_r (max) 95.000 -5.94%
538.imagick_r (max) (percentage) 0.690 -4.17%
541.leela_r 37.000 2.78%
541.leela_r (avg) 37.000 2.78%
541.leela_r (avg) (percentage) 0.310 -
541.leela_r (max) 54.000 -3.57%
541.leela_r (max) (percentage) 0.460 -
544.nab_r 59.000 -
544.nab_r (avg) 59.000 -
544.nab_r (avg) (percentage) 0.520 -
544.nab_r (max) 70.000 -4.11%
544.nab_r (max) (percentage) 0.620 -3.13%
557.xz_r 11.000 10.00%
557.xz_r (avg) 11.000 10.00%
557.xz_r (avg) (percentage) 0.110 -
557.xz_r (max) 15.000 15.38%
557.xz_r (max) (percentage) 0.150 15.38%
557.xz_r (unexplained diff vs previous) 16.000 700.00%
557.xz_r (unexplained diff vs previous) (percentage) 0.150 650.00%
Geometric Mean 5.944 10.35%