Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/6d1c6ecbdc4e94cafd51ade0331d7112161a4cf3 (+ 200 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-cpu2017rate--llvm-arm-master-Os_LTO-build/60/
Filter

llvm-arm-master-Os_LTO test results

Run Order Start Time Duration
Current 0060 (llvmorg-18-init-06128-g6d1c6ecbdc4e) 2023-09-16T05:42:26 0:00:00
Previous 0002 (llvmorg-17-init-04569-g6590a372fa3f) 2023-03-11T22:47:53 0:00:00
No Baseline Run


Tests Summary

Status Group #
Performance Regressions 1
Performance Improvements 10
Added Tests 79
Unchanged Tests 564
Total Tests 654

Performance Regressions - Execution Δ Previous Current σ
523.xalancbmk_r 2.23% 3320.000 3394.000 -

Performance Improvements - Code Size Δ Previous Current σ
531.deepsjeng_r -3.43% 58953.000 56929.000 -
511.povray_r -2.52% 570502.000 556119.000 -
544.nab_r -1.75% 53061.000 52130.000 -
519.lbm_r -1.47% 9484.000 9345.000 -

Performance Improvements - Execution Δ Previous Current σ
511.povray_r -4.11% 462.000 443.000 -
544.nab_r -3.63% 7531.000 7258.000 -
502.gcc_r -1.97% 3600.000 3529.000 -
520.omnetpp_r -1.22% 3283.000 3243.000 -

Performance Improvements - Score Δ Previous Current σ
nb_compile_successful 6.67% 15.000 16.000 -
nb_execution_successful 6.67% 15.000 16.000 -

Added Tests - Code Size
500.perlbench_r

Added Tests - Execution
500.perlbench_r

Added Tests - sample variability
500.perlbench_r
500.perlbench_r (avg)
500.perlbench_r (avg) (percentage)
500.perlbench_r (max)
500.perlbench_r (max) (percentage)
500.perlbench_r (unexplained diff vs previous)
500.perlbench_r (unexplained diff vs previous) (percentage)
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)
520.omnetpp_r
520.omnetpp_r (avg)
520.omnetpp_r (avg) (percentage)
520.omnetpp_r (max)
520.omnetpp_r (max) (percentage)
523.xalancbmk_r
523.xalancbmk_r (avg)
523.xalancbmk_r (avg) (percentage)
523.xalancbmk_r (max)
523.xalancbmk_r (max) (percentage)
525.x264_r
525.x264_r (avg)
525.x264_r (avg) (percentage)
525.x264_r (max)
525.x264_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
538.imagick_r
538.imagick_r (avg)
538.imagick_r (avg) (percentage)
538.imagick_r (max)
538.imagick_r (max) (percentage)
541.leela_r
541.leela_r (avg)
541.leela_r (avg) (percentage)
541.leela_r (max)
541.leela_r (max) (percentage)
544.nab_r
544.nab_r (avg)
544.nab_r (avg) (percentage)
544.nab_r (max)
544.nab_r (max) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)


Report Time: 0.25s
Name Current %
500.perlbench_r 2154.000 -
502.gcc_r 3529.000 -1.97%
505.mcf_r 5458.000 -
508.namd_r 3087.000 -
510.parest_r 5798.000 -
511.povray_r 443.000 -4.11%
519.lbm_r 3640.000 -
520.omnetpp_r 3243.000 -1.22%
523.xalancbmk_r 3394.000 2.23%
525.x264_r 3171.000 -
526.blender_r 11058.000 -
531.deepsjeng_r 4862.000 -
538.imagick_r 4086.000 -
541.leela_r 4477.000 -
544.nab_r 7258.000 -3.63%
557.xz_r 2427.000 -
Geometric Mean 3578.785 -3.76%
Name Current %
500.perlbench_r 1242556.000 -
502.gcc_r 5322904.000 -
505.mcf_r 14630.000 -
508.namd_r 315251.000 -
510.parest_r 979439.000 -
511.povray_r 556119.000 -2.52%
519.lbm_r 9345.000 -1.47%
520.omnetpp_r 917351.000 -
523.xalancbmk_r 1963332.000 -
525.x264_r 321059.000 -
526.blender_r 6445843.000 -
531.deepsjeng_r 56929.000 -3.43%
538.imagick_r 838738.000 -
541.leela_r 50192.000 -
544.nab_r 52130.000 -1.75%
557.xz_r 83951.000 -
Geometric Mean 306513.410 9.01%
Name Current %
nb_compile_successful 16.000 6.67%
nb_execution_successful 16.000 6.67%
nb_total_tests 16.000 -
Geometric Mean 16.000 4.40%
Name Current %
500.perlbench_r 21.000 -
500.perlbench_r (avg) 21.000 -
500.perlbench_r (avg) (percentage) 1.000 -
500.perlbench_r (max) 23.000 -
500.perlbench_r (max) (percentage) 1.100 -
500.perlbench_r (unexplained diff vs previous) 10.000 -
500.perlbench_r (unexplained diff vs previous) (percentage) 0.460 -
505.mcf_r 52.000 -
505.mcf_r (avg) 52.000 -
505.mcf_r (avg) (percentage) 0.960 -
505.mcf_r (max) 45.000 -
505.mcf_r (max) (percentage) 0.840 -
505.mcf_r (unexplained diff vs previous) 10.000 -
505.mcf_r (unexplained diff vs previous) (percentage) 0.180 -
508.namd_r 7.000 -
508.namd_r (avg) 7.000 -
508.namd_r (avg) (percentage) 0.240 -
508.namd_r (max) 6.000 -
508.namd_r (max) (percentage) 0.220 -
508.namd_r (unexplained diff vs previous) 5.000 -
508.namd_r (unexplained diff vs previous) (percentage) 0.160 -
510.parest_r 91.000 -
510.parest_r (avg) 91.000 -
510.parest_r (avg) (percentage) 1.570 -
510.parest_r (max) 285.000 -
510.parest_r (max) (percentage) 4.930 -
511.povray_r 9.000 -
511.povray_r (avg) 9.000 -
511.povray_r (avg) (percentage) 2.190 -
511.povray_r (max) 15.000 -
511.povray_r (max) (percentage) 3.490 -
519.lbm_r 13.000 -
519.lbm_r (avg) 13.000 -
519.lbm_r (avg) (percentage) 0.360 -
519.lbm_r (max) 27.000 -
519.lbm_r (max) (percentage) 0.750 -
519.lbm_r (unexplained diff vs previous) 27.000 -
519.lbm_r (unexplained diff vs previous) (percentage) 0.740 -
520.omnetpp_r 37.000 -
520.omnetpp_r (avg) 37.000 -
520.omnetpp_r (avg) (percentage) 1.160 -
520.omnetpp_r (max) 67.000 -
520.omnetpp_r (max) (percentage) 2.080 -
520.omnetpp_r (unexplained diff vs previous) 29.000 -
520.omnetpp_r (unexplained diff vs previous) (percentage) 0.890 -
523.xalancbmk_r 26.000 -
523.xalancbmk_r (avg) 26.000 -
523.xalancbmk_r (avg) (percentage) 0.780 -
523.xalancbmk_r (max) 35.000 -
523.xalancbmk_r (max) (percentage) 1.060 -
523.xalancbmk_r (unexplained diff vs previous) 33.000 -
523.xalancbmk_r (unexplained diff vs previous) (percentage) 0.970 -
525.x264_r 26.000 -
525.x264_r (avg) 26.000 -
525.x264_r (avg) (percentage) 0.820 -
525.x264_r (max) 43.000 -
525.x264_r (max) (percentage) 1.370 -
525.x264_r (unexplained diff vs previous) 40.000 -
525.x264_r (unexplained diff vs previous) (percentage) 1.260 -
526.blender_r 60.000 -
526.blender_r (avg) 60.000 -
526.blender_r (avg) (percentage) 0.550 -
526.blender_r (max) 79.000 -
526.blender_r (max) (percentage) 0.720 -
526.blender_r (unexplained diff vs previous) 29.000 -
526.blender_r (unexplained diff vs previous) (percentage) 0.260 -
531.deepsjeng_r 26.000 -
531.deepsjeng_r (avg) 26.000 -
531.deepsjeng_r (avg) (percentage) 0.540 -
531.deepsjeng_r (max) 22.000 -
531.deepsjeng_r (max) (percentage) 0.470 -
538.imagick_r 8.000 -
538.imagick_r (avg) 8.000 -
538.imagick_r (avg) (percentage) 0.220 -
538.imagick_r (max) 11.000 -
538.imagick_r (max) (percentage) 0.280 -
538.imagick_r (unexplained diff vs previous) 3.000 -
538.imagick_r (unexplained diff vs previous) (percentage) 0.070 -
541.leela_r 16.000 -
541.leela_r (avg) 16.000 -
541.leela_r (avg) (percentage) 0.360 -
541.leela_r (max) 26.000 -
541.leela_r (max) (percentage) 0.590 -
541.leela_r (unexplained diff vs previous) 12.000 -
541.leela_r (unexplained diff vs previous) (percentage) 0.270 -
544.nab_r 25.000 -
544.nab_r (avg) 25.000 -
544.nab_r (avg) (percentage) 0.350 -
544.nab_r (max) 31.000 -
544.nab_r (max) (percentage) 0.430 -
544.nab_r (unexplained diff vs previous) 16.000 -
544.nab_r (unexplained diff vs previous) (percentage) 0.220 -
557.xz_r 30.000 -
557.xz_r (avg) 30.000 -
557.xz_r (avg) (percentage) 1.270 -
557.xz_r (max) 27.000 -
557.xz_r (max) (percentage) 1.120 -
557.xz_r (unexplained diff vs previous) 27.000 -
557.xz_r (unexplained diff vs previous) (percentage) 1.110 -
Geometric Mean 5.047 -6206423642040228118528.00%