Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/83cad6805d144d941bdda99d71a6df2cf113a76d (+ 5 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-cpu2017rate--llvm-arm-master-Oz-build/103/
View Options
Report
Filter

llvm-arm-master-Oz test results

Run Order Start Time Duration
Current 0103 (llvmorg-21-init-00417-g83cad6805d14) 2025-01-22T16:57:48 0:00:00
Previous 0103 (llvmorg-21-init-00417-g83cad6805d14) 2025-01-22T16:57:48 0:00:00
Baseline 0048 (llvmorg-20-init-07118-ge13cbaca6925) 2024-09-26T13:06:14 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 0 7
Performance Improvements 0 1
Added Tests 2 77
Unchanged Tests 652 569
Total Tests 654

Run-Over-Run Changes Detail

Added Tests - sample variability
510.parest_r (unexplained diff vs previous)
510.parest_r (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
531.deepsjeng_r 4.37% 10717.000 11185.000 - 0.00% -
519.lbm_r 2.38% 15493.000 15862.000 - 0.00% -
544.nab_r 1.33% 11828.000 11985.000 - 0.00% -
511.povray_r 1.04% 20217.000 20427.000 - 0.00% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -50.00% 32.000 16.000 - 0.00% -
nb_execution_successful -50.00% 32.000 16.000 - 0.00% -
nb_total_tests -50.00% 32.000 16.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
500.perlbench_r -9.35% 20289.000 18391.000 - 0.00% -

Added Tests - sample variability
500.perlbench_r
500.perlbench_r (avg)
500.perlbench_r (avg) (percentage)
500.perlbench_r (max)
500.perlbench_r (max) (percentage)
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
510.parest_r (unexplained diff vs previous)
510.parest_r (unexplained diff vs previous) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)
520.omnetpp_r
520.omnetpp_r (avg)
520.omnetpp_r (avg) (percentage)
520.omnetpp_r (max)
520.omnetpp_r (max) (percentage)
523.xalancbmk_r
523.xalancbmk_r (avg)
523.xalancbmk_r (avg) (percentage)
523.xalancbmk_r (max)
523.xalancbmk_r (max) (percentage)
525.x264_r
525.x264_r (avg)
525.x264_r (avg) (percentage)
525.x264_r (max)
525.x264_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
538.imagick_r
538.imagick_r (avg)
538.imagick_r (avg) (percentage)
538.imagick_r (max)
538.imagick_r (max) (percentage)
541.leela_r
541.leela_r (avg)
541.leela_r (avg) (percentage)
541.leela_r (max)
541.leela_r (max) (percentage)
544.nab_r
544.nab_r (avg)
544.nab_r (avg) (percentage)
544.nab_r (max)
544.nab_r (max) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)

Report Time: 0.25s
Execution (seconds)
Name Current %
500.perlbench_r 18391.000 -
502.gcc_r 10273.000 -
505.mcf_r 13680.000 -
508.namd_r 9868.000 -
510.parest_r 23166.000 -
511.povray_r 20427.000 -
519.lbm_r 15862.000 -
520.omnetpp_r 13956.000 -
523.xalancbmk_r 11288.000 -
525.x264_r 14524.000 -
526.blender_r 11854.000 -
531.deepsjeng_r 11185.000 -
538.imagick_r 14029.000 -
541.leela_r 13426.000 -
544.nab_r 11985.000 -
557.xz_r 10583.000 -
Geometric Mean 13610.953 -
Code Size (bytes)
Name Current %
500.perlbench_r 1216369.000 -
502.gcc_r 4821684.000 -
505.mcf_r 15643.000 -
508.namd_r 353135.000 -
510.parest_r 3368743.000 -
511.povray_r 545742.000 -
519.lbm_r 11482.000 -
520.omnetpp_r 999541.000 -
523.xalancbmk_r 2254310.000 -
525.x264_r 274865.000 -
526.blender_r 6541040.000 -
531.deepsjeng_r 58734.000 -
538.imagick_r 1068800.000 -
541.leela_r 72306.000 -
544.nab_r 95005.000 -
557.xz_r 115952.000 -
Geometric Mean 372689.969 -
sample variability
Name Current %
500.perlbench_r 303.000 -
500.perlbench_r (avg) 303.000 -
500.perlbench_r (avg) (percentage) 1.650 -
500.perlbench_r (max) 531.000 -
500.perlbench_r (max) (percentage) 2.890 -
500.perlbench_r (unexplained diff vs previous) 37.000 -
500.perlbench_r (unexplained diff vs previous) (percentage) 0.200 -
505.mcf_r 43.000 -
505.mcf_r (avg) 43.000 -
505.mcf_r (avg) (percentage) 0.320 -
505.mcf_r (max) 45.000 -
505.mcf_r (max) (percentage) 0.330 -
505.mcf_r (unexplained diff vs previous) 45.000 -
505.mcf_r (unexplained diff vs previous) (percentage) 0.330 -
508.namd_r 45.000 -
508.namd_r (avg) 45.000 -
508.namd_r (avg) (percentage) 0.460 -
508.namd_r (max) 48.000 -
508.namd_r (max) (percentage) 0.490 -
508.namd_r (unexplained diff vs previous) 24.000 -
508.namd_r (unexplained diff vs previous) (percentage) 0.240 -
510.parest_r 13.000 -
510.parest_r (avg) 13.000 -
510.parest_r (avg) (percentage) 0.060 -
510.parest_r (max) 27.000 -
510.parest_r (max) (percentage) 0.120 -
510.parest_r (unexplained diff vs previous) 0.000 -
510.parest_r (unexplained diff vs previous) (percentage) 0.000 -
511.povray_r 77.000 -
511.povray_r (avg) 77.000 -
511.povray_r (avg) (percentage) 0.380 -
511.povray_r (max) 120.000 -
511.povray_r (max) (percentage) 0.590 -
511.povray_r (unexplained diff vs previous) 52.000 -
511.povray_r (unexplained diff vs previous) (percentage) 0.250 -
519.lbm_r 72.000 -
519.lbm_r (avg) 72.000 -
519.lbm_r (avg) (percentage) 0.460 -
519.lbm_r (max) 369.000 -
519.lbm_r (max) (percentage) 2.330 -
519.lbm_r (unexplained diff vs previous) 57.000 -
519.lbm_r (unexplained diff vs previous) (percentage) 0.360 -
520.omnetpp_r 115.000 -
520.omnetpp_r (avg) 115.000 -
520.omnetpp_r (avg) (percentage) 0.830 -
520.omnetpp_r (max) 189.000 -
520.omnetpp_r (max) (percentage) 1.360 -
520.omnetpp_r (unexplained diff vs previous) 41.000 -
520.omnetpp_r (unexplained diff vs previous) (percentage) 0.290 -
523.xalancbmk_r 71.000 -
523.xalancbmk_r (avg) 71.000 -
523.xalancbmk_r (avg) (percentage) 0.630 -
523.xalancbmk_r (max) 63.000 -
523.xalancbmk_r (max) (percentage) 0.560 -
523.xalancbmk_r (unexplained diff vs previous) 7.000 -
523.xalancbmk_r (unexplained diff vs previous) (percentage) 0.060 -
525.x264_r 33.000 -
525.x264_r (avg) 33.000 -
525.x264_r (avg) (percentage) 0.230 -
525.x264_r (max) 103.000 -
525.x264_r (max) (percentage) 0.710 -
525.x264_r (unexplained diff vs previous) 38.000 -
525.x264_r (unexplained diff vs previous) (percentage) 0.260 -
526.blender_r 47.000 -
526.blender_r (avg) 47.000 -
526.blender_r (avg) (percentage) 0.400 -
526.blender_r (max) 68.000 -
526.blender_r (max) (percentage) 0.580 -
526.blender_r (unexplained diff vs previous) 65.000 -
526.blender_r (unexplained diff vs previous) (percentage) 0.550 -
531.deepsjeng_r 107.000 -
531.deepsjeng_r (avg) 107.000 -
531.deepsjeng_r (avg) (percentage) 0.960 -
531.deepsjeng_r (max) 193.000 -
531.deepsjeng_r (max) (percentage) 1.730 -
531.deepsjeng_r (unexplained diff vs previous) 56.000 -
531.deepsjeng_r (unexplained diff vs previous) (percentage) 0.500 -
538.imagick_r 35.000 -
538.imagick_r (avg) 35.000 -
538.imagick_r (avg) (percentage) 0.250 -
538.imagick_r (max) 65.000 -
538.imagick_r (max) (percentage) 0.470 -
538.imagick_r (unexplained diff vs previous) 10.000 -
538.imagick_r (unexplained diff vs previous) (percentage) 0.070 -
541.leela_r 32.000 -
541.leela_r (avg) 32.000 -
541.leela_r (avg) (percentage) 0.240 -
541.leela_r (max) 57.000 -
541.leela_r (max) (percentage) 0.430 -
541.leela_r (unexplained diff vs previous) 10.000 -
541.leela_r (unexplained diff vs previous) (percentage) 0.070 -
544.nab_r 35.000 -
544.nab_r (avg) 35.000 -
544.nab_r (avg) (percentage) 0.300 -
544.nab_r (max) 32.000 -
544.nab_r (max) (percentage) 0.270 -
544.nab_r (unexplained diff vs previous) 32.000 -
544.nab_r (unexplained diff vs previous) (percentage) 0.270 -
557.xz_r 15.000 -
557.xz_r (avg) 15.000 -
557.xz_r (avg) (percentage) 0.150 -
557.xz_r (max) 23.000 -
557.xz_r (max) (percentage) 0.220 -
557.xz_r (unexplained diff vs previous) 4.000 -
557.xz_r (unexplained diff vs previous) (percentage) 0.040 -
Geometric Mean 4.828 -18.89%