Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/e13cbaca6925629165e3cced90b33777f0fe09fe
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-cpu2017rate--llvm-arm-master-Oz-build/48/
Filter

llvm-arm-master-Oz test results

Run Order Start Time Duration
Current 0048 (llvmorg-20-init-07118-ge13cbaca6925) 2024-09-26T13:06:14 0:00:00
Previous 0051 (llvmorg-20-init-08079-g9e862ae3219b) 2024-10-02T09:08:22 0:00:00
Baseline 0048 (llvmorg-20-init-07118-ge13cbaca6925) 2024-09-26T13:06:14 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 1 0
Performance Improvements 4 0
Added Tests 30 30
Unchanged Tests 619 624
Total Tests 654

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
500.perlbench_r 7.77% 18826.000 20289.000 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
523.xalancbmk_r -1.03% 11452.000 11334.000 - 0.00% -

Performance Improvements - Score Δ Previous Current σ Δ (B) σ (B)
nb_compile_successful 100.00% 16.000 32.000 - 0.00% -
nb_execution_successful 100.00% 16.000 32.000 - 0.00% -
nb_total_tests 100.00% 16.000 32.000 - 0.00% -

Added Tests - sample variability
500.perlbench_r (unexplained diff vs previous)
500.perlbench_r (unexplained diff vs previous) (percentage)
505.mcf_r (unexplained diff vs previous)
505.mcf_r (unexplained diff vs previous) (percentage)
508.namd_r (unexplained diff vs previous)
508.namd_r (unexplained diff vs previous) (percentage)
510.parest_r (unexplained diff vs previous)
510.parest_r (unexplained diff vs previous) (percentage)
511.povray_r (unexplained diff vs previous)
511.povray_r (unexplained diff vs previous) (percentage)
519.lbm_r (unexplained diff vs previous)
519.lbm_r (unexplained diff vs previous) (percentage)
520.omnetpp_r (unexplained diff vs previous)
520.omnetpp_r (unexplained diff vs previous) (percentage)
523.xalancbmk_r (unexplained diff vs previous)
523.xalancbmk_r (unexplained diff vs previous) (percentage)
525.x264_r (unexplained diff vs previous)
525.x264_r (unexplained diff vs previous) (percentage)
526.blender_r (unexplained diff vs previous)
526.blender_r (unexplained diff vs previous) (percentage)
531.deepsjeng_r (unexplained diff vs previous)
531.deepsjeng_r (unexplained diff vs previous) (percentage)
538.imagick_r (unexplained diff vs previous)
538.imagick_r (unexplained diff vs previous) (percentage)
541.leela_r (unexplained diff vs previous)
541.leela_r (unexplained diff vs previous) (percentage)
544.nab_r (unexplained diff vs previous)
544.nab_r (unexplained diff vs previous) (percentage)
557.xz_r (unexplained diff vs previous)
557.xz_r (unexplained diff vs previous) (percentage)

Added Tests - sample variability
500.perlbench_r (unexplained diff vs previous)
500.perlbench_r (unexplained diff vs previous) (percentage)
505.mcf_r (unexplained diff vs previous)
505.mcf_r (unexplained diff vs previous) (percentage)
508.namd_r (unexplained diff vs previous)
508.namd_r (unexplained diff vs previous) (percentage)
510.parest_r (unexplained diff vs previous)
510.parest_r (unexplained diff vs previous) (percentage)
511.povray_r (unexplained diff vs previous)
511.povray_r (unexplained diff vs previous) (percentage)
519.lbm_r (unexplained diff vs previous)
519.lbm_r (unexplained diff vs previous) (percentage)
520.omnetpp_r (unexplained diff vs previous)
520.omnetpp_r (unexplained diff vs previous) (percentage)
523.xalancbmk_r (unexplained diff vs previous)
523.xalancbmk_r (unexplained diff vs previous) (percentage)
525.x264_r (unexplained diff vs previous)
525.x264_r (unexplained diff vs previous) (percentage)
526.blender_r (unexplained diff vs previous)
526.blender_r (unexplained diff vs previous) (percentage)
531.deepsjeng_r (unexplained diff vs previous)
531.deepsjeng_r (unexplained diff vs previous) (percentage)
538.imagick_r (unexplained diff vs previous)
538.imagick_r (unexplained diff vs previous) (percentage)
541.leela_r (unexplained diff vs previous)
541.leela_r (unexplained diff vs previous) (percentage)
544.nab_r (unexplained diff vs previous)
544.nab_r (unexplained diff vs previous) (percentage)
557.xz_r (unexplained diff vs previous)
557.xz_r (unexplained diff vs previous) (percentage)


Report Time: 0.21s
Name Current %
500.perlbench_r 20289.000 7.77%
502.gcc_r 10256.000 -
505.mcf_r 13688.000 -
508.namd_r 9951.000 -
510.parest_r 23166.000 -
511.povray_r 20217.000 -
519.lbm_r 15493.000 -
520.omnetpp_r 13979.000 -
523.xalancbmk_r 11334.000 -1.03%
525.x264_r 14519.000 -
526.blender_r 11945.000 -
531.deepsjeng_r 10717.000 -
538.imagick_r 14079.000 -
541.leela_r 13320.000 -
544.nab_r 11828.000 -
557.xz_r 10685.000 -
Geometric Mean 13639.874 -
Name Current %
500.perlbench_r 1218321.000 -
502.gcc_r 4826588.000 -
505.mcf_r 15755.000 -
508.namd_r 353615.000 -
510.parest_r 3364939.000 -
511.povray_r 546154.000 -
519.lbm_r 11490.000 -
520.omnetpp_r 1001277.000 -
523.xalancbmk_r 2255374.000 -
525.x264_r 276001.000 -
526.blender_r 6550784.000 -
531.deepsjeng_r 58830.000 -
538.imagick_r 1068312.000 -
541.leela_r 72398.000 -
544.nab_r 95133.000 -
557.xz_r 116440.000 -
Geometric Mean 373325.208 -
Name Current %
nb_compile_successful 32.000 100.00%
nb_execution_successful 32.000 100.00%
nb_total_tests 32.000 100.00%
Geometric Mean 32.000 100.00%
Name Current %
500.perlbench_r (unexplained diff vs previous) 0.000 -
500.perlbench_r (unexplained diff vs previous) (percentage) 0.000 -
505.mcf_r (unexplained diff vs previous) 0.000 -
505.mcf_r (unexplained diff vs previous) (percentage) 0.000 -
508.namd_r (unexplained diff vs previous) 0.000 -
508.namd_r (unexplained diff vs previous) (percentage) 0.000 -
510.parest_r (unexplained diff vs previous) 0.000 -
510.parest_r (unexplained diff vs previous) (percentage) 0.000 -
511.povray_r (unexplained diff vs previous) 0.000 -
511.povray_r (unexplained diff vs previous) (percentage) 0.000 -
519.lbm_r (unexplained diff vs previous) 0.000 -
519.lbm_r (unexplained diff vs previous) (percentage) 0.000 -
520.omnetpp_r (unexplained diff vs previous) 0.000 -
520.omnetpp_r (unexplained diff vs previous) (percentage) 0.000 -
523.xalancbmk_r (unexplained diff vs previous) 0.000 -
523.xalancbmk_r (unexplained diff vs previous) (percentage) 0.000 -
525.x264_r (unexplained diff vs previous) 0.000 -
525.x264_r (unexplained diff vs previous) (percentage) 0.000 -
526.blender_r (unexplained diff vs previous) 0.000 -
526.blender_r (unexplained diff vs previous) (percentage) 0.000 -
531.deepsjeng_r (unexplained diff vs previous) 0.000 -
531.deepsjeng_r (unexplained diff vs previous) (percentage) 0.000 -
538.imagick_r (unexplained diff vs previous) 0.000 -
538.imagick_r (unexplained diff vs previous) (percentage) 0.000 -
541.leela_r (unexplained diff vs previous) 0.000 -
541.leela_r (unexplained diff vs previous) (percentage) 0.000 -
544.nab_r (unexplained diff vs previous) 0.000 -
544.nab_r (unexplained diff vs previous) (percentage) 0.000 -
557.xz_r (unexplained diff vs previous) 0.000 -
557.xz_r (unexplained diff vs previous) (percentage) 0.000 -
Geometric Mean 0.000 -