Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/84580a02e0f0d3a43efc73dacd6bf5a18cf628cc (+ 346 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-cpu2017rate--llvm-arm-master-Os-build/47/
View Options
Report
Filter

llvm-arm-master-Os test results

Run Order Start Time Duration
Current 0047 (llvmorg-20-init-04256-g84580a02e0f0) 2024-08-29T18:05:41 0:00:00
Previous 0047 (llvmorg-20-init-04256-g84580a02e0f0) 2024-08-29T18:05:41 0:00:00
Baseline 0001 (llvmorg-19-init-09395-gb9f2c16b50f6) 2024-04-24T23:25:45 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 0 7
Performance Improvements 0 5
Added Tests 0 77
Unchanged Tests 678 589
Total Tests 678

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
505.mcf_r 6.95% 17430.000 18642.000 - 0.00% -
541.leela_r 1.94% 80535.000 82097.000 - 0.00% -
508.namd_r 1.83% 396465.000 403729.000 - 0.00% -
520.omnetpp_r 1.12% 1089114.000 1101302.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
520.omnetpp_r 3.94% 11704.000 12165.000 - 0.00% -
505.mcf_r 2.98% 13516.000 13919.000 - 0.00% -
544.nab_r 1.08% 11830.000 11958.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
525.x264_r -9.97% 12553.000 11301.000 - 0.00% -
519.lbm_r -1.05% 14818.000 14663.000 - 0.00% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 112.50% 16.000 34.000 - 0.00% -
nb_compile_successful 87.50% 16.000 30.000 - 0.00% -
nb_execution_successful 87.50% 16.000 30.000 - 0.00% -

Added Tests - sample variability
500.perlbench_r
500.perlbench_r (avg)
500.perlbench_r (avg) (percentage)
500.perlbench_r (max)
500.perlbench_r (max) (percentage)
502.gcc_r
502.gcc_r (avg)
502.gcc_r (avg) (percentage)
502.gcc_r (max)
502.gcc_r (max) (percentage)
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r (avg) (percentage)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)
520.omnetpp_r
520.omnetpp_r (avg)
520.omnetpp_r (avg) (percentage)
520.omnetpp_r (max)
520.omnetpp_r (max) (percentage)
523.xalancbmk_r
523.xalancbmk_r (avg)
523.xalancbmk_r (avg) (percentage)
523.xalancbmk_r (max)
523.xalancbmk_r (max) (percentage)
525.x264_r
525.x264_r (avg)
525.x264_r (avg) (percentage)
525.x264_r (max)
525.x264_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
538.imagick_r
538.imagick_r (avg)
538.imagick_r (avg) (percentage)
538.imagick_r (max)
538.imagick_r (max) (percentage)
541.leela_r
541.leela_r (avg)
541.leela_r (avg) (percentage)
541.leela_r (max)
541.leela_r (max) (percentage)
544.nab_r
544.nab_r (avg)
544.nab_r (avg) (percentage)
544.nab_r (max)
544.nab_r (max) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)

Report Time: 0.33s
Execution (seconds)
Name Current %
500.perlbench_r 15647.000 -
502.gcc_r 9375.000 -
505.mcf_r 13919.000 -
508.namd_r 9425.000 -
511.povray_r 17611.000 -
519.lbm_r 14663.000 -
520.omnetpp_r 12165.000 -
523.xalancbmk_r 10191.000 -
525.x264_r 11301.000 -
526.blender_r 11283.000 -
531.deepsjeng_r 9701.000 -
538.imagick_r 13763.000 -
541.leela_r 12758.000 -
544.nab_r 11958.000 -
557.xz_r 10210.000 -
Geometric Mean 12046.966 -
Code Size (bytes)
Name Current %
500.perlbench_r 1276125.000 -
502.gcc_r 5342180.000 -
505.mcf_r 18642.000 -
508.namd_r 403729.000 -
511.povray_r 584838.000 -
519.lbm_r 11418.000 -
520.omnetpp_r 1101302.000 -
523.xalancbmk_r 2469108.000 -
525.x264_r 325865.000 -
526.blender_r 6895804.000 -
531.deepsjeng_r 61752.000 -
538.imagick_r 1254908.000 -
541.leela_r 82097.000 -
544.nab_r 104681.000 -
557.xz_r 121896.000 -
Geometric Mean 353744.013 -
sample variability
Name Current %
500.perlbench_r 70.000 -
500.perlbench_r (avg) 70.000 -
500.perlbench_r (avg) (percentage) 0.450 -
500.perlbench_r (max) 82.000 -
500.perlbench_r (max) (percentage) 0.530 -
502.gcc_r 35.000 -
502.gcc_r (avg) 35.000 -
502.gcc_r (avg) (percentage) 0.380 -
502.gcc_r (max) 37.000 -
502.gcc_r (max) (percentage) 0.400 -
502.gcc_r (unexplained diff vs previous) 9.000 -
502.gcc_r (unexplained diff vs previous) (percentage) 0.100 -
505.mcf_r 43.000 -
505.mcf_r (avg) 43.000 -
505.mcf_r (avg) (percentage) 0.310 -
505.mcf_r (max) 90.000 -
505.mcf_r (max) (percentage) 0.650 -
505.mcf_r (unexplained diff vs previous) 91.000 -
505.mcf_r (unexplained diff vs previous) (percentage) 0.650 -
508.namd_r 52.000 -
508.namd_r (avg) 52.000 -
508.namd_r (avg) (percentage) 0.560 -
508.namd_r (max) 76.000 -
508.namd_r (max) (percentage) 0.810 -
508.namd_r (unexplained diff vs previous) 58.000 -
508.namd_r (unexplained diff vs previous) (percentage) 0.620 -
510.parest_r (avg) (percentage) 0.090 -
510.parest_r (max) (percentage) 0.110 -
511.povray_r 68.000 -
511.povray_r (avg) 68.000 -
511.povray_r (avg) (percentage) 0.390 -
511.povray_r (max) 109.000 -
511.povray_r (max) (percentage) 0.620 -
511.povray_r (unexplained diff vs previous) 109.000 -
511.povray_r (unexplained diff vs previous) (percentage) 0.620 -
519.lbm_r 80.000 -
519.lbm_r (avg) 80.000 -
519.lbm_r (avg) (percentage) 0.550 -
519.lbm_r (max) 315.000 -
519.lbm_r (max) (percentage) 2.150 -
519.lbm_r (unexplained diff vs previous) 322.000 -
519.lbm_r (unexplained diff vs previous) (percentage) 2.200 -
520.omnetpp_r 82.000 -
520.omnetpp_r (avg) 82.000 -
520.omnetpp_r (avg) (percentage) 0.680 -
520.omnetpp_r (max) 218.000 -
520.omnetpp_r (max) (percentage) 1.800 -
520.omnetpp_r (unexplained diff vs previous) 215.000 -
520.omnetpp_r (unexplained diff vs previous) (percentage) 1.770 -
523.xalancbmk_r 43.000 -
523.xalancbmk_r (avg) 43.000 -
523.xalancbmk_r (avg) (percentage) 0.430 -
523.xalancbmk_r (max) 45.000 -
523.xalancbmk_r (max) (percentage) 0.450 -
523.xalancbmk_r (unexplained diff vs previous) 40.000 -
523.xalancbmk_r (unexplained diff vs previous) (percentage) 0.390 -
525.x264_r 20.000 -
525.x264_r (avg) 20.000 -
525.x264_r (avg) (percentage) 0.180 -
525.x264_r (max) 39.000 -
525.x264_r (max) (percentage) 0.350 -
525.x264_r (unexplained diff vs previous) 31.000 -
525.x264_r (unexplained diff vs previous) (percentage) 0.270 -
526.blender_r 92.000 -
526.blender_r (avg) 92.000 -
526.blender_r (avg) (percentage) 0.820 -
526.blender_r (max) 240.000 -
526.blender_r (max) (percentage) 2.130 -
526.blender_r (unexplained diff vs previous) 245.000 -
526.blender_r (unexplained diff vs previous) (percentage) 2.170 -
531.deepsjeng_r 63.000 -
531.deepsjeng_r (avg) 63.000 -
531.deepsjeng_r (avg) (percentage) 0.650 -
531.deepsjeng_r (max) 67.000 -
531.deepsjeng_r (max) (percentage) 0.700 -
531.deepsjeng_r (unexplained diff vs previous) 67.000 -
531.deepsjeng_r (unexplained diff vs previous) (percentage) 0.690 -
538.imagick_r 56.000 -
538.imagick_r (avg) 56.000 -
538.imagick_r (avg) (percentage) 0.410 -
538.imagick_r (max) 97.000 -
538.imagick_r (max) (percentage) 0.710 -
538.imagick_r (unexplained diff vs previous) 8.000 -
538.imagick_r (unexplained diff vs previous) (percentage) 0.060 -
541.leela_r 43.000 -
541.leela_r (avg) 43.000 -
541.leela_r (avg) (percentage) 0.340 -
541.leela_r (max) 79.000 -
541.leela_r (max) (percentage) 0.620 -
541.leela_r (unexplained diff vs previous) 40.000 -
541.leela_r (unexplained diff vs previous) (percentage) 0.310 -
544.nab_r 49.000 -
544.nab_r (avg) 49.000 -
544.nab_r (avg) (percentage) 0.410 -
544.nab_r (max) 49.000 -
544.nab_r (max) (percentage) 0.410 -
544.nab_r (unexplained diff vs previous) 37.000 -
544.nab_r (unexplained diff vs previous) (percentage) 0.310 -
557.xz_r 16.000 -
557.xz_r (avg) 16.000 -
557.xz_r (avg) (percentage) 0.160 -
557.xz_r (max) 19.000 -
557.xz_r (max) (percentage) 0.190 -
557.xz_r (unexplained diff vs previous) 8.000 -
557.xz_r (unexplained diff vs previous) (percentage) 0.080 -
Geometric Mean 6.806 -