Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/de37c06f01772e02465ccc9f538894c76d89a7a1 (+ 673 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-cpu2017rate--llvm-arm-master-Os_LTO-build/12/
View Options
Report
Filter

llvm-arm-master-Os_LTO test results

Run Order Start Time Duration
Current 0012 (llvmorg-19-init-13071-gde37c06f0177) 2024-05-28T00:57:03 0:00:00
Previous 0012 (llvmorg-19-init-13071-gde37c06f0177) 2024-05-28T00:57:03 0:00:00
Baseline 0003 (llvmorg-19-init-10108-gcd132dcbeb0f) 2024-05-02T07:22:59 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 0 4
Performance Improvements 0 1
Added Tests 2 77
Unchanged Tests 652 572
Total Tests 654

Run-Over-Run Changes Detail

Added Tests - sample variability
510.parest_r (unexplained diff vs previous)
510.parest_r (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
541.leela_r 1.34% 49644.000 50310.000 - 0.00% -
510.parest_r 1.33% 970810.000 983686.000 - 0.00% -
520.omnetpp_r 1.03% 916978.000 926398.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
511.povray_r 1.34% 17346.000 17578.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
520.omnetpp_r -1.72% 11275.000 11081.000 - 0.00% -

Added Tests - sample variability
500.perlbench_r
500.perlbench_r (avg)
500.perlbench_r (avg) (percentage)
500.perlbench_r (max)
500.perlbench_r (max) (percentage)
502.gcc_r
502.gcc_r (avg)
502.gcc_r (avg) (percentage)
502.gcc_r (max)
502.gcc_r (max) (percentage)
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
510.parest_r (unexplained diff vs previous)
510.parest_r (unexplained diff vs previous) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)
520.omnetpp_r
520.omnetpp_r (avg)
520.omnetpp_r (avg) (percentage)
520.omnetpp_r (max)
520.omnetpp_r (max) (percentage)
525.x264_r
525.x264_r (avg)
525.x264_r (avg) (percentage)
525.x264_r (max)
525.x264_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
538.imagick_r
538.imagick_r (avg)
538.imagick_r (avg) (percentage)
538.imagick_r (max)
538.imagick_r (max) (percentage)
541.leela_r
541.leela_r (avg)
541.leela_r (avg) (percentage)
541.leela_r (max)
541.leela_r (max) (percentage)
544.nab_r
544.nab_r (avg)
544.nab_r (avg) (percentage)
544.nab_r (max)
544.nab_r (max) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)

Report Time: 0.22s
Execution (seconds)
Name Current %
500.perlbench_r 14109.000 -
502.gcc_r 8928.000 -
505.mcf_r 13438.000 -
508.namd_r 9514.000 -
510.parest_r 20917.000 -
511.povray_r 17578.000 -
519.lbm_r 14762.000 -
520.omnetpp_r 11081.000 -
525.x264_r 12470.000 -
526.blender_r 10909.000 -
531.deepsjeng_r 9244.000 -
538.imagick_r 13781.000 -
541.leela_r 11322.000 -
544.nab_r 11212.000 -
557.xz_r 10111.000 -
Geometric Mean 12271.253 -
Code Size (bytes)
Name Current %
500.perlbench_r 1239078.000 -
502.gcc_r 5264440.000 -
505.mcf_r 15106.000 -
508.namd_r 323541.000 -
510.parest_r 983686.000 -
511.povray_r 564824.000 -
519.lbm_r 9496.000 -
520.omnetpp_r 926398.000 -
525.x264_r 322410.000 -
526.blender_r 6451824.000 -
531.deepsjeng_r 57556.000 -
538.imagick_r 838760.000 -
541.leela_r 50310.000 -
544.nab_r 52869.000 -
557.xz_r 84259.000 -
Geometric Mean 273104.323 -
sample variability
Name Current %
500.perlbench_r 94.000 -
500.perlbench_r (avg) 94.000 -
500.perlbench_r (avg) (percentage) 0.670 -
500.perlbench_r (max) 119.000 -
500.perlbench_r (max) (percentage) 0.850 -
500.perlbench_r (unexplained diff vs previous) 6.000 -
500.perlbench_r (unexplained diff vs previous) (percentage) 0.040 -
502.gcc_r 7.000 -
502.gcc_r (avg) 7.000 -
502.gcc_r (avg) (percentage) 0.080 -
502.gcc_r (max) 6.000 -
502.gcc_r (max) (percentage) 0.070 -
505.mcf_r 52.000 -
505.mcf_r (avg) 52.000 -
505.mcf_r (avg) (percentage) 0.390 -
505.mcf_r (max) 49.000 -
505.mcf_r (max) (percentage) 0.370 -
505.mcf_r (unexplained diff vs previous) 45.000 -
505.mcf_r (unexplained diff vs previous) (percentage) 0.330 -
508.namd_r 39.000 -
508.namd_r (avg) 39.000 -
508.namd_r (avg) (percentage) 0.420 -
508.namd_r (max) 62.000 -
508.namd_r (max) (percentage) 0.660 -
508.namd_r (unexplained diff vs previous) 62.000 -
508.namd_r (unexplained diff vs previous) (percentage) 0.650 -
510.parest_r 12.000 -
510.parest_r (avg) 12.000 -
510.parest_r (avg) (percentage) 0.060 -
510.parest_r (max) 27.000 -
510.parest_r (max) (percentage) 0.130 -
510.parest_r (unexplained diff vs previous) 0.000 -
510.parest_r (unexplained diff vs previous) (percentage) 0.000 -
511.povray_r 61.000 -
511.povray_r (avg) 61.000 -
511.povray_r (avg) (percentage) 0.350 -
511.povray_r (max) 110.000 -
511.povray_r (max) (percentage) 0.630 -
519.lbm_r 17.000 -
519.lbm_r (avg) 17.000 -
519.lbm_r (avg) (percentage) 0.120 -
519.lbm_r (max) 25.000 -
519.lbm_r (max) (percentage) 0.170 -
519.lbm_r (unexplained diff vs previous) 12.000 -
519.lbm_r (unexplained diff vs previous) (percentage) 0.080 -
520.omnetpp_r 109.000 -
520.omnetpp_r (avg) 109.000 -
520.omnetpp_r (avg) (percentage) 0.990 -
520.omnetpp_r (max) 175.000 -
520.omnetpp_r (max) (percentage) 1.580 -
520.omnetpp_r (unexplained diff vs previous) 66.000 -
520.omnetpp_r (unexplained diff vs previous) (percentage) 0.600 -
525.x264_r 23.000 -
525.x264_r (avg) 23.000 -
525.x264_r (avg) (percentage) 0.190 -
525.x264_r (max) 36.000 -
525.x264_r (max) (percentage) 0.290 -
525.x264_r (unexplained diff vs previous) 14.000 -
525.x264_r (unexplained diff vs previous) (percentage) 0.110 -
526.blender_r 22.000 -
526.blender_r (avg) 22.000 -
526.blender_r (avg) (percentage) 0.210 -
526.blender_r (max) 40.000 -
526.blender_r (max) (percentage) 0.370 -
526.blender_r (unexplained diff vs previous) 13.000 -
526.blender_r (unexplained diff vs previous) (percentage) 0.120 -
531.deepsjeng_r 119.000 -
531.deepsjeng_r (avg) 119.000 -
531.deepsjeng_r (avg) (percentage) 1.290 -
531.deepsjeng_r (max) 185.000 -
531.deepsjeng_r (max) (percentage) 2.010 -
531.deepsjeng_r (unexplained diff vs previous) 63.000 -
531.deepsjeng_r (unexplained diff vs previous) (percentage) 0.680 -
538.imagick_r 49.000 -
538.imagick_r (avg) 49.000 -
538.imagick_r (avg) (percentage) 0.360 -
538.imagick_r (max) 74.000 -
538.imagick_r (max) (percentage) 0.540 -
538.imagick_r (unexplained diff vs previous) 50.000 -
538.imagick_r (unexplained diff vs previous) (percentage) 0.360 -
541.leela_r 12.000 -
541.leela_r (avg) 12.000 -
541.leela_r (avg) (percentage) 0.110 -
541.leela_r (max) 20.000 -
541.leela_r (max) (percentage) 0.180 -
541.leela_r (unexplained diff vs previous) 20.000 -
541.leela_r (unexplained diff vs previous) (percentage) 0.180 -
544.nab_r 34.000 -
544.nab_r (avg) 34.000 -
544.nab_r (avg) (percentage) 0.310 -
544.nab_r (max) 63.000 -
544.nab_r (max) (percentage) 0.570 -
544.nab_r (unexplained diff vs previous) 18.000 -
544.nab_r (unexplained diff vs previous) (percentage) 0.160 -
557.xz_r 12.000 -
557.xz_r (avg) 12.000 -
557.xz_r (avg) (percentage) 0.120 -
557.xz_r (max) 21.000 -
557.xz_r (max) (percentage) 0.210 -
557.xz_r (unexplained diff vs previous) 21.000 -
557.xz_r (unexplained diff vs previous) (percentage) 0.210 -
Geometric Mean 3.568 -19.09%