Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/911e0d038d6aaef953c8813c0ee7888fd0234970 (+ 120 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-cpu2017rate--llvm-aarch64-master-O3-build/3/
Filter

llvm-aarch64-master-O3 test results

Run Order Start Time Duration
Current 0003 (llvmorg-17-init-03570-g911e0d038d6a) 2023-02-28T12:19:19 0:00:00
Previous 0002 (llvmorg-17-init-03450-g4668dd8c4ab1) 2023-02-27T06:17:19 0:00:00
Baseline 0001 (llvmorg-17-init-03217-ge08cc52cfc23) 2023-02-25T18:19:40 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 14 0
Performance Improvements 32 2
Added Tests 9 69
Unchanged Tests 575 559
Total Tests 630

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
520.omnetpp_r (max) (percentage) 441.46% 0.410 2.220 - 0.00% -
520.omnetpp_r (unexplained diff vs previous) (percentage) 440.48% 0.420 2.270 - 0.00% -
520.omnetpp_r (unexplained diff vs previous) 432.79% 61.000 325.000 - 0.00% -
520.omnetpp_r (max) 428.33% 60.000 317.000 - 0.00% -
520.omnetpp_r (avg) (percentage) 295.12% 0.410 1.620 - 0.00% -
520.omnetpp_r 286.67% 60.000 232.000 - 0.00% -
520.omnetpp_r (avg) 286.67% 60.000 232.000 - 0.00% -
505.mcf_r (max) 144.90% 49.000 120.000 - 0.00% -
505.mcf_r (max) (percentage) 141.67% 0.360 0.870 - 0.00% -
505.mcf_r (unexplained diff vs previous) (percentage) 138.89% 0.360 0.860 - 0.00% -
505.mcf_r (unexplained diff vs previous) 138.00% 50.000 119.000 - 0.00% -
505.mcf_r 97.96% 49.000 97.000 - 0.00% -
505.mcf_r (avg) 97.96% 49.000 97.000 - 0.00% -
505.mcf_r (avg) (percentage) 94.44% 0.360 0.700 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
526.blender_r -4.19% 12473.000 11951.000 - -4.36% -
520.omnetpp_r -2.22% 14648.000 14323.000 - -2.62% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
525.x264_r (unexplained diff vs previous) (percentage) -83.08% 0.650 0.110 - 0.00% -
525.x264_r (unexplained diff vs previous) -82.50% 40.000 7.000 - 0.00% -
525.x264_r -56.41% 39.000 17.000 - 0.00% -
525.x264_r (avg) -56.41% 39.000 17.000 - 0.00% -
525.x264_r (avg) (percentage) -54.69% 0.640 0.290 - 0.00% -
519.lbm_r (unexplained diff vs previous) -52.26% 155.000 74.000 - 0.00% -
519.lbm_r (unexplained diff vs previous) (percentage) -52.22% 0.900 0.430 - 0.00% -
519.lbm_r (avg) (percentage) -34.83% 0.890 0.580 - 0.00% -
519.lbm_r -34.64% 153.000 100.000 - 0.00% -
519.lbm_r (avg) -34.64% 153.000 100.000 - 0.00% -
526.blender_r (max) -27.27% 22.000 16.000 - 0.00% -
510.parest_r (max) (percentage) -26.67% 0.300 0.220 - 0.00% -
510.parest_r (max) -26.47% 68.000 50.000 - 0.00% -
523.xalancbmk_r (max) -26.36% 129.000 95.000 - 0.00% -
525.x264_r (max) -25.64% 39.000 29.000 - 0.00% -
523.xalancbmk_r (max) (percentage) -25.53% 0.940 0.700 - 0.00% -
525.x264_r (max) (percentage) -25.00% 0.640 0.480 - 0.00% -
511.povray_r (max) (percentage) -25.00% 0.120 0.090 - 0.00% -
541.leela_r (max) -25.00% 16.000 12.000 - 0.00% -
531.deepsjeng_r (max) (percentage) -25.00% 0.440 0.330 - 0.00% -
519.lbm_r (max) -24.84% 153.000 115.000 - 0.00% -
519.lbm_r (max) (percentage) -24.72% 0.890 0.670 - 0.00% -
511.povray_r (max) -24.00% 25.000 19.000 - 0.00% -
531.deepsjeng_r (max) -23.68% 38.000 29.000 - 0.00% -
544.nab_r (max) -23.08% 13.000 10.000 - 0.00% -
541.leela_r (max) (percentage) -23.08% 0.130 0.100 - 0.00% -
526.blender_r (max) (percentage) -22.22% 0.180 0.140 - 0.00% -
544.nab_r (max) (percentage) -22.22% 0.090 0.070 - 0.00% -
526.blender_r -4.55% 22.000 21.000 - 0.00% -
526.blender_r (avg) -4.55% 22.000 21.000 - 0.00% -

Added Tests - sample variability
500.perlbench_r (max)
500.perlbench_r (max) (percentage)
538.imagick_r (max)
538.imagick_r (max) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (unexplained diff vs previous)
557.xz_r (unexplained diff vs previous) (percentage)

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
526.blender_r -4.36% 12496.000 11951.000 - -4.19% -
520.omnetpp_r -2.62% 14709.000 14323.000 - -2.22% -

Added Tests - sample variability
500.perlbench_r (max)
500.perlbench_r (max) (percentage)
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)
520.omnetpp_r
520.omnetpp_r (avg)
520.omnetpp_r (avg) (percentage)
520.omnetpp_r (max)
520.omnetpp_r (max) (percentage)
523.xalancbmk_r
523.xalancbmk_r (avg)
523.xalancbmk_r (avg) (percentage)
523.xalancbmk_r (max)
523.xalancbmk_r (max) (percentage)
525.x264_r
525.x264_r (avg)
525.x264_r (avg) (percentage)
525.x264_r (max)
525.x264_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
538.imagick_r (max)
538.imagick_r (max) (percentage)
541.leela_r
541.leela_r (avg)
541.leela_r (avg) (percentage)
541.leela_r (max)
541.leela_r (max) (percentage)
544.nab_r
544.nab_r (avg)
544.nab_r (avg) (percentage)
544.nab_r (max)
544.nab_r (max) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)


Report Time: 0.21s
Name Current %
500.perlbench_r 16232.000 -
502.gcc_r 10782.000 -
505.mcf_r 13871.000 -
508.namd_r 9701.000 -
510.parest_r 22868.000 -
511.povray_r 21274.000 -
519.lbm_r 17286.000 -
520.omnetpp_r 14323.000 -2.22%
523.xalancbmk_r 13704.000 -
525.x264_r 6194.000 -
526.blender_r 11951.000 -4.19%
531.deepsjeng_r 8822.000 -
538.imagick_r 13509.000 -
541.leela_r 12794.000 -
544.nab_r 14565.000 -
557.xz_r 11661.000 -
Geometric Mean 13092.323 -
Name Current %
500.perlbench_r 2263443.000 -
502.gcc_r 9686764.000 -
505.mcf_r 28331.000 -
508.namd_r 607655.000 -
510.parest_r 9174001.000 -
511.povray_r 975554.000 -
519.lbm_r 13787.000 -
520.omnetpp_r 2221248.000 -
523.xalancbmk_r 4852887.000 -
525.x264_r 561794.000 -
526.blender_r 14427234.000 -
531.deepsjeng_r 90890.000 -
538.imagick_r 1803237.000 -
541.leela_r 153915.000 -
544.nab_r 199920.000 -
557.xz_r 192580.000 -
Geometric Mean 707622.061 -
Name Current %
500.perlbench_r (max) 0.000 -
500.perlbench_r (max) (percentage) 0.000 -
505.mcf_r 97.000 97.96%
505.mcf_r (avg) 97.000 97.96%
505.mcf_r (avg) (percentage) 0.700 94.44%
505.mcf_r (max) 120.000 144.90%
505.mcf_r (max) (percentage) 0.870 141.67%
505.mcf_r (unexplained diff vs previous) 119.000 138.00%
505.mcf_r (unexplained diff vs previous) (percentage) 0.860 138.89%
508.namd_r 29.000 -
508.namd_r (avg) 29.000 -
508.namd_r (avg) (percentage) 0.300 -
508.namd_r (max) 29.000 -
508.namd_r (max) (percentage) 0.300 -
508.namd_r (unexplained diff vs previous) 29.000 -
508.namd_r (unexplained diff vs previous) (percentage) 0.300 -
510.parest_r 68.000 -
510.parest_r (avg) 68.000 -
510.parest_r (avg) (percentage) 0.300 -
510.parest_r (max) 50.000 -26.47%
510.parest_r (max) (percentage) 0.220 -26.67%
511.povray_r 25.000 -
511.povray_r (avg) 25.000 -
511.povray_r (avg) (percentage) 0.120 -
511.povray_r (max) 19.000 -24.00%
511.povray_r (max) (percentage) 0.090 -25.00%
519.lbm_r 100.000 -34.64%
519.lbm_r (avg) 100.000 -34.64%
519.lbm_r (avg) (percentage) 0.580 -34.83%
519.lbm_r (max) 115.000 -24.84%
519.lbm_r (max) (percentage) 0.670 -24.72%
519.lbm_r (unexplained diff vs previous) 74.000 -52.26%
519.lbm_r (unexplained diff vs previous) (percentage) 0.430 -52.22%
520.omnetpp_r 232.000 286.67%
520.omnetpp_r (avg) 232.000 286.67%
520.omnetpp_r (avg) (percentage) 1.620 295.12%
520.omnetpp_r (max) 317.000 428.33%
520.omnetpp_r (max) (percentage) 2.220 441.46%
520.omnetpp_r (unexplained diff vs previous) 325.000 432.79%
520.omnetpp_r (unexplained diff vs previous) (percentage) 2.270 440.48%
523.xalancbmk_r 128.000 -
523.xalancbmk_r (avg) 128.000 -
523.xalancbmk_r (avg) (percentage) 0.940 -
523.xalancbmk_r (max) 95.000 -26.36%
523.xalancbmk_r (max) (percentage) 0.700 -25.53%
525.x264_r 17.000 -56.41%
525.x264_r (avg) 17.000 -56.41%
525.x264_r (avg) (percentage) 0.290 -54.69%
525.x264_r (max) 29.000 -25.64%
525.x264_r (max) (percentage) 0.480 -25.00%
525.x264_r (unexplained diff vs previous) 7.000 -82.50%
525.x264_r (unexplained diff vs previous) (percentage) 0.110 -83.08%
526.blender_r 21.000 -4.55%
526.blender_r (avg) 21.000 -4.55%
526.blender_r (avg) (percentage) 0.180 -
526.blender_r (max) 16.000 -27.27%
526.blender_r (max) (percentage) 0.140 -22.22%
531.deepsjeng_r 38.000 -
531.deepsjeng_r (avg) 38.000 -
531.deepsjeng_r (avg) (percentage) 0.440 -
531.deepsjeng_r (max) 29.000 -23.68%
531.deepsjeng_r (max) (percentage) 0.330 -25.00%
538.imagick_r (max) 0.000 -
538.imagick_r (max) (percentage) 0.000 -
541.leela_r 16.000 -
541.leela_r (avg) 16.000 -
541.leela_r (avg) (percentage) 0.130 -
541.leela_r (max) 12.000 -25.00%
541.leela_r (max) (percentage) 0.100 -23.08%
544.nab_r 13.000 -
544.nab_r (avg) 13.000 -
544.nab_r (avg) (percentage) 0.090 -
544.nab_r (max) 10.000 -23.08%
544.nab_r (max) (percentage) 0.070 -22.22%
557.xz_r 25.000 -
557.xz_r (avg) 25.000 -
557.xz_r (avg) (percentage) 0.220 -
557.xz_r (max) 25.000 -
557.xz_r (max) (percentage) 0.220 -
557.xz_r (unexplained diff vs previous) 26.000 -
557.xz_r (unexplained diff vs previous) (percentage) 0.220 -
Geometric Mean 3.253 -22.43%