Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/71b38063b282937640e05ab219c2baa6ed7d4ac7 (+ 523 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-cpu2017rate--llvm-aarch64-master-O3_LTO-build/5/
Filter

llvm-aarch64-master-O3_LTO test results

Run Order Start Time Duration
Current 0005 (llvmorg-17-init-04015-g71b38063b282) 2023-03-03T19:39:06 0:00:00
Previous 0003 (llvmorg-17-init-03492-gc1c29eb9f7be) 2023-02-28T13:40:58 0:00:00
Baseline 0002 (llvmorg-17-init-03371-gabafc869cb65) 2023-02-28T01:39:50 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 14 1
Performance Improvements 28 1
Added Tests 14 54
Unchanged Tests 514 514
Total Tests 570

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
525.x264_r (max) 400.00% 1.000 5.000 - 0.00% -
525.x264_r 300.00% 1.000 4.000 - 0.00% -
525.x264_r (avg) 300.00% 1.000 4.000 - 0.00% -
525.x264_r (max) (percentage) 233.33% 0.030 0.100 - 0.00% -
525.x264_r (unexplained diff vs previous) (percentage) 233.33% 0.030 0.100 - 0.00% -
525.x264_r (unexplained diff vs previous) 200.00% 2.000 6.000 - 0.00% -
525.x264_r (avg) (percentage) 166.67% 0.030 0.080 - 0.00% -
508.namd_r (max) 90.00% 10.000 19.000 - 0.00% -
508.namd_r (unexplained diff vs previous) 90.00% 10.000 19.000 - 0.00% -
508.namd_r (max) (percentage) 81.82% 0.110 0.200 - 0.00% -
508.namd_r (unexplained diff vs previous) (percentage) 81.82% 0.110 0.200 - 0.00% -
508.namd_r 60.00% 10.000 16.000 - 0.00% -
508.namd_r (avg) 60.00% 10.000 16.000 - 0.00% -
508.namd_r (avg) (percentage) 54.55% 0.110 0.170 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
500.perlbench_r -3.22% 15389.000 14894.000 - -2.29% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
519.lbm_r (unexplained diff vs previous) -89.36% 47.000 5.000 - 0.00% -
519.lbm_r (unexplained diff vs previous) (percentage) -88.89% 0.270 0.030 - 0.00% -
557.xz_r (unexplained diff vs previous) (percentage) -82.61% 0.230 0.040 - 0.00% -
557.xz_r (unexplained diff vs previous) -81.48% 27.000 5.000 - 0.00% -
519.lbm_r -60.87% 46.000 18.000 - 0.00% -
519.lbm_r (avg) -60.87% 46.000 18.000 - 0.00% -
519.lbm_r (avg) (percentage) -59.26% 0.270 0.110 - 0.00% -
557.xz_r -57.69% 26.000 11.000 - 0.00% -
557.xz_r (avg) -57.69% 26.000 11.000 - 0.00% -
557.xz_r (avg) (percentage) -56.52% 0.230 0.100 - 0.00% -
505.mcf_r (unexplained diff vs previous) -52.94% 17.000 8.000 - 0.00% -
505.mcf_r (unexplained diff vs previous) (percentage) -50.00% 0.140 0.070 - 0.00% -
505.mcf_r -37.50% 16.000 10.000 - 0.00% -
505.mcf_r (avg) -37.50% 16.000 10.000 - 0.00% -
505.mcf_r (avg) (percentage) -35.71% 0.140 0.090 - 0.00% -
557.xz_r (max) -26.92% 26.000 19.000 - 0.00% -
519.lbm_r (max) -26.09% 46.000 34.000 - 0.00% -
557.xz_r (max) (percentage) -26.09% 0.230 0.170 - 0.00% -
519.lbm_r (max) (percentage) -25.93% 0.270 0.200 - 0.00% -
531.deepsjeng_r (max) (percentage) -25.00% 0.160 0.120 - 0.00% -
531.deepsjeng_r (max) -25.00% 12.000 9.000 - 0.00% -
541.leela_r (max) (percentage) -25.00% 0.440 0.330 - 0.00% -
541.leela_r (max) -24.49% 49.000 37.000 - 0.00% -
511.povray_r (max) (percentage) -23.08% 0.260 0.200 - 0.00% -
511.povray_r (max) -22.00% 50.000 39.000 - 0.00% -
505.mcf_r (max) (percentage) -21.43% 0.140 0.110 - 0.00% -
505.mcf_r (max) -18.75% 16.000 13.000 - 0.00% -

Added Tests - sample variability
500.perlbench_r (max)
500.perlbench_r (max) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
520.omnetpp_r (max)
520.omnetpp_r (max) (percentage)
523.xalancbmk_r (max)
523.xalancbmk_r (max) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
538.imagick_r (max)
538.imagick_r (max) (percentage)
544.nab_r (max)
544.nab_r (max) (percentage)

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
520.omnetpp_r 1.03% 13922.000 14065.000 - 0.63% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
500.perlbench_r -2.29% 15243.000 14894.000 - -3.22% -

Added Tests - sample variability
500.perlbench_r (max)
500.perlbench_r (max) (percentage)
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)
520.omnetpp_r (max)
520.omnetpp_r (max) (percentage)
523.xalancbmk_r (max)
523.xalancbmk_r (max) (percentage)
525.x264_r
525.x264_r (avg)
525.x264_r (avg) (percentage)
525.x264_r (max)
525.x264_r (max) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
538.imagick_r (max)
538.imagick_r (max) (percentage)
541.leela_r
541.leela_r (avg)
541.leela_r (avg) (percentage)
541.leela_r (max)
541.leela_r (max) (percentage)
544.nab_r (max)
544.nab_r (max) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)


Report Time: 0.22s
Name Current %
500.perlbench_r 14894.000 -3.22%
502.gcc_r 10280.000 -
505.mcf_r 12067.000 -
508.namd_r 9520.000 -
510.parest_r 22712.000 -
511.povray_r 19527.000 -
519.lbm_r 17211.000 -
520.omnetpp_r 14065.000 -
523.xalancbmk_r 13060.000 -
525.x264_r 5765.000 -
526.blender_r 12125.000 -
531.deepsjeng_r 7541.000 -
538.imagick_r 13537.000 -
541.leela_r 11257.000 -
544.nab_r 13311.000 -
557.xz_r 11541.000 -
Geometric Mean 12379.643 -
Name Current %
500.perlbench_r 2572830.000 -
502.gcc_r 10928599.000 -
505.mcf_r 22867.000 -
508.namd_r 471172.000 -
510.parest_r 2023581.000 -
511.povray_r 1146685.000 -
519.lbm_r 11091.000 -
520.omnetpp_r 2060238.000 -
523.xalancbmk_r 4116578.000 -
525.x264_r 607270.000 -
526.blender_r 16413420.000 -
531.deepsjeng_r 91335.000 -
538.imagick_r 1275924.000 -
541.leela_r 90045.000 -
544.nab_r 88347.000 -
557.xz_r 134996.000 -
Geometric Mean 555613.824 -
Name Current %
500.perlbench_r (max) 0.000 -
500.perlbench_r (max) (percentage) 0.000 -
505.mcf_r 10.000 -37.50%
505.mcf_r (avg) 10.000 -37.50%
505.mcf_r (avg) (percentage) 0.090 -35.71%
505.mcf_r (max) 13.000 -18.75%
505.mcf_r (max) (percentage) 0.110 -21.43%
505.mcf_r (unexplained diff vs previous) 8.000 -52.94%
505.mcf_r (unexplained diff vs previous) (percentage) 0.070 -50.00%
508.namd_r 16.000 60.00%
508.namd_r (avg) 16.000 60.00%
508.namd_r (avg) (percentage) 0.170 54.55%
508.namd_r (max) 19.000 90.00%
508.namd_r (max) (percentage) 0.200 81.82%
508.namd_r (unexplained diff vs previous) 19.000 90.00%
508.namd_r (unexplained diff vs previous) (percentage) 0.200 81.82%
510.parest_r (max) 0.000 -
510.parest_r (max) (percentage) 0.000 -
511.povray_r 50.000 -
511.povray_r (avg) 50.000 -
511.povray_r (avg) (percentage) 0.260 -
511.povray_r (max) 39.000 -22.00%
511.povray_r (max) (percentage) 0.200 -23.08%
519.lbm_r 18.000 -60.87%
519.lbm_r (avg) 18.000 -60.87%
519.lbm_r (avg) (percentage) 0.110 -59.26%
519.lbm_r (max) 34.000 -26.09%
519.lbm_r (max) (percentage) 0.200 -25.93%
519.lbm_r (unexplained diff vs previous) 5.000 -89.36%
519.lbm_r (unexplained diff vs previous) (percentage) 0.030 -88.89%
520.omnetpp_r (max) 0.000 -
520.omnetpp_r (max) (percentage) 0.000 -
523.xalancbmk_r (max) 0.000 -
523.xalancbmk_r (max) (percentage) 0.000 -
525.x264_r 4.000 300.00%
525.x264_r (avg) 4.000 300.00%
525.x264_r (avg) (percentage) 0.080 166.67%
525.x264_r (max) 5.000 400.00%
525.x264_r (max) (percentage) 0.100 233.33%
525.x264_r (unexplained diff vs previous) 6.000 200.00%
525.x264_r (unexplained diff vs previous) (percentage) 0.100 233.33%
526.blender_r (max) 0.000 -
526.blender_r (max) (percentage) 0.000 -
531.deepsjeng_r 12.000 -
531.deepsjeng_r (avg) 12.000 -
531.deepsjeng_r (avg) (percentage) 0.160 -
531.deepsjeng_r (max) 9.000 -25.00%
531.deepsjeng_r (max) (percentage) 0.120 -25.00%
538.imagick_r (max) 0.000 -
538.imagick_r (max) (percentage) 0.000 -
541.leela_r 49.000 -
541.leela_r (avg) 49.000 -
541.leela_r (avg) (percentage) 0.440 -
541.leela_r (max) 37.000 -24.49%
541.leela_r (max) (percentage) 0.330 -25.00%
544.nab_r (max) 0.000 -
544.nab_r (max) (percentage) 0.000 -
557.xz_r 11.000 -57.69%
557.xz_r (avg) 11.000 -57.69%
557.xz_r (avg) (percentage) 0.100 -56.52%
557.xz_r (max) 19.000 -26.92%
557.xz_r (max) (percentage) 0.170 -26.09%
557.xz_r (unexplained diff vs previous) 5.000 -81.48%
557.xz_r (unexplained diff vs previous) (percentage) 0.040 -82.61%
Geometric Mean 0.228 -89.95%