Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/5b386b864c7619897c51a1da97d78f1cf6f3eff6 (+ 1 commits)
regression LLVM-880
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-cpu2017rate--llvm-aarch64-master-O2-build/28/
Filter

llvm-aarch64-master-O2 test results

Run Order Start Time Duration
Current 0028 (llvmorg-17-init-08119-g5b386b864c76) 2023-04-14T07:26:57 0:00:00
Previous 0027 (llvmorg-17-init-08118-g0b911a3dc34a) 2023-04-13T21:53:13 0:00:00
No Baseline Run


Tests Summary

Status Group #
Performance Regressions 36
Performance Improvements 56
Added Tests 2
Unchanged Tests 782
Total Tests 876

Performance Regressions - Execution Δ Previous Current σ
544.nab_r 3.55% 14316.000 14824.000 -

Performance Regressions - sample variability Δ Previous Current σ
549.fotonik3d_r (unexplained diff vs previous) (percentage) 208.00% 0.250 0.770 -
549.fotonik3d_r (unexplained diff vs previous) 205.06% 79.000 241.000 -
520.omnetpp_r (unexplained diff vs previous) 164.58% 48.000 127.000 -
520.omnetpp_r (unexplained diff vs previous) (percentage) 163.64% 0.330 0.870 -
519.lbm_r (unexplained diff vs previous) 100.00% 24.000 48.000 -
548.exchange2_r (unexplained diff vs previous) 100.00% 3.000 6.000 -
519.lbm_r (unexplained diff vs previous) (percentage) 92.86% 0.140 0.270 -
519.lbm_r (max) 62.07% 29.000 47.000 -
519.lbm_r (max) (percentage) 58.82% 0.170 0.270 -
510.parest_r (unexplained diff vs previous) 50.00% 4.000 6.000 -
525.x264_r (unexplained diff vs previous) 36.36% 11.000 15.000 -
525.x264_r (max) (percentage) 33.33% 0.150 0.200 -
525.x264_r (unexplained diff vs previous) (percentage) 33.33% 0.150 0.200 -
523.xalancbmk_r (avg) (percentage) 29.17% 0.240 0.310 -
523.xalancbmk_r 27.27% 33.000 42.000 -
523.xalancbmk_r (avg) 27.27% 33.000 42.000 -
525.x264_r (max) 27.27% 11.000 14.000 -
523.xalancbmk_r (unexplained diff vs previous) 26.92% 52.000 66.000 -
523.xalancbmk_r (max) (percentage) 26.32% 0.380 0.480 -
523.xalancbmk_r (unexplained diff vs previous) (percentage) 26.32% 0.380 0.480 -
523.xalancbmk_r (max) 25.00% 52.000 65.000 -
525.x264_r 16.67% 6.000 7.000 -
525.x264_r (avg) 16.67% 6.000 7.000 -
505.mcf_r (unexplained diff vs previous) (percentage) 16.18% 0.680 0.790 -
505.mcf_r (unexplained diff vs previous) 15.62% 96.000 111.000 -
505.mcf_r (max) (percentage) 14.71% 0.680 0.780 -
505.mcf_r (max) 13.54% 96.000 109.000 -
525.x264_r (avg) (percentage) 11.11% 0.090 0.100 -
505.mcf_r (avg) (percentage) 9.62% 0.520 0.570 -
505.mcf_r 9.59% 73.000 80.000 -
505.mcf_r (avg) 9.59% 73.000 80.000 -
519.lbm_r 6.90% 29.000 31.000 -
519.lbm_r (avg) 6.90% 29.000 31.000 -
544.nab_r 2.44% 41.000 42.000 -
544.nab_r (avg) 2.44% 41.000 42.000 -

Performance Improvements - Execution Δ Previous Current σ
526.blender_r -3.00% 12432.000 12059.000 -

Performance Improvements - sample variability Δ Previous Current σ
508.namd_r (unexplained diff vs previous) (percentage) -94.55% 1.100 0.060 -
508.namd_r (unexplained diff vs previous) -94.29% 105.000 6.000 -
554.roms_r (unexplained diff vs previous) (percentage) -60.00% 0.050 0.020 -
554.roms_r (unexplained diff vs previous) -58.33% 12.000 5.000 -
554.roms_r (avg) (percentage) -33.33% 0.060 0.040 -
554.roms_r -30.77% 13.000 9.000 -
554.roms_r (avg) -30.77% 13.000 9.000 -
503.bwaves_r (unexplained diff vs previous) (percentage) -28.57% 0.070 0.050 -
503.bwaves_r (unexplained diff vs previous) -28.57% 14.000 10.000 -
541.leela_r (avg) (percentage) -20.45% 0.440 0.350 -
541.leela_r -20.34% 59.000 47.000 -
541.leela_r (avg) -20.34% 59.000 47.000 -
548.exchange2_r (avg) (percentage) -20.00% 0.150 0.120 -
548.exchange2_r -18.52% 27.000 22.000 -
548.exchange2_r (avg) -18.52% 27.000 22.000 -
508.namd_r -16.39% 61.000 51.000 -
508.namd_r (avg) -16.39% 61.000 51.000 -
508.namd_r (avg) (percentage) -15.62% 0.640 0.540 -
503.bwaves_r (avg) (percentage) -10.00% 0.100 0.090 -
503.bwaves_r -9.52% 21.000 19.000 -
503.bwaves_r (avg) -9.52% 21.000 19.000 -
520.omnetpp_r (max) -7.65% 366.000 338.000 -
520.omnetpp_r (max) (percentage) -6.80% 2.500 2.330 -
510.parest_r -5.88% 34.000 32.000 -
510.parest_r (avg) -5.88% 34.000 32.000 -
541.leela_r (max) (percentage) -5.45% 0.550 0.520 -
541.leela_r (max) -5.41% 74.000 70.000 -
510.parest_r (max) (percentage) -5.26% 0.190 0.180 -
557.xz_r (max) (percentage) -5.26% 0.190 0.180 -
526.blender_r -4.88% 41.000 39.000 -
526.blender_r (avg) -4.88% 41.000 39.000 -
557.xz_r (max) -4.76% 21.000 20.000 -
510.parest_r (max) -4.65% 43.000 41.000 -
508.namd_r (max) -4.63% 108.000 103.000 -
526.blender_r (max) -4.55% 44.000 42.000 -
531.deepsjeng_r (max) -4.48% 67.000 64.000 -
508.namd_r (max) (percentage) -4.42% 1.130 1.080 -
511.povray_r (max) -4.24% 118.000 113.000 -
531.deepsjeng_r (max) (percentage) -3.90% 0.770 0.740 -
544.nab_r (max) (percentage) -3.85% 0.260 0.250 -
511.povray_r (max) (percentage) -3.64% 0.550 0.530 -
538.imagick_r (max) -3.45% 58.000 56.000 -
500.perlbench_r (max) -3.29% 213.000 206.000 -
500.perlbench_r (max) (percentage) -3.01% 1.330 1.290 -
526.blender_r (max) (percentage) -2.78% 0.360 0.350 -
531.deepsjeng_r -2.78% 36.000 35.000 -
531.deepsjeng_r (avg) -2.78% 36.000 35.000 -
538.imagick_r (max) (percentage) -2.38% 0.420 0.410 -
549.fotonik3d_r (max) -2.37% 379.000 370.000 -
521.wrf_r (max) -1.83% 109.000 107.000 -
549.fotonik3d_r (max) (percentage) -1.65% 1.210 1.190 -
520.omnetpp_r -1.49% 134.000 132.000 -
520.omnetpp_r (avg) -1.49% 134.000 132.000 -
521.wrf_r (max) (percentage) -1.35% 0.740 0.730 -
520.omnetpp_r (avg) (percentage) -1.09% 0.920 0.910 -

Added Tests - sample variability
541.leela_r (unexplained diff vs previous)
541.leela_r (unexplained diff vs previous) (percentage)


Report Time: 0.21s
Name Current %
500.perlbench_r 16044.000 -
502.gcc_r 10999.000 -
503.bwaves_r 21145.000 -
505.mcf_r 14037.000 -
507.cactuBSSN_r 11304.000 -
508.namd_r 9569.000 -
510.parest_r 22910.000 -
511.povray_r 21488.000 -
519.lbm_r 17574.000 -
520.omnetpp_r 14535.000 -
521.wrf_r 14709.000 -
523.xalancbmk_r 13746.000 -
525.x264_r 7475.000 -
526.blender_r 12059.000 -3.00%
531.deepsjeng_r 8738.000 -
538.imagick_r 13877.000 -
541.leela_r 13571.000 -
544.nab_r 14824.000 3.55%
548.exchange2_r 18636.000 -
549.fotonik3d_r 31121.000 -
554.roms_r 22932.000 -
557.xz_r 11572.000 -
Geometric Mean 14710.767 -
Name Current %
500.perlbench_r 2152623.000 -
502.gcc_r 8922444.000 -
503.bwaves_r 775742.000 -
505.mcf_r 27211.000 -
507.cactuBSSN_r 3707734.000 -
508.namd_r 624815.000 -
510.parest_r 8614540.000 -
511.povray_r 910770.000 -
519.lbm_r 13451.000 -
520.omnetpp_r 2149635.000 -
521.wrf_r 23893820.000 -
523.xalancbmk_r 4725475.000 -
525.x264_r 499598.000 -
526.blender_r 13664014.000 -
531.deepsjeng_r 81010.000 -
538.imagick_r 1701525.000 -
541.leela_r 144739.000 -
544.nab_r 191484.000 -
548.exchange2_r 2555603.000 -
549.fotonik3d_r 1256502.000 -
554.roms_r 3060081.000 -
557.xz_r 177252.000 -
Geometric Mean 1004041.800 -
Name Current %
500.perlbench_r 146.000 -
500.perlbench_r (avg) 146.000 -
500.perlbench_r (avg) (percentage) 0.910 -
500.perlbench_r (max) 206.000 -3.29%
500.perlbench_r (max) (percentage) 1.290 -3.01%
503.bwaves_r 19.000 -9.52%
503.bwaves_r (avg) 19.000 -9.52%
503.bwaves_r (avg) (percentage) 0.090 -10.00%
503.bwaves_r (max) 19.000 -
503.bwaves_r (max) (percentage) 0.090 -
503.bwaves_r (unexplained diff vs previous) 10.000 -28.57%
503.bwaves_r (unexplained diff vs previous) (percentage) 0.050 -28.57%
505.mcf_r 80.000 9.59%
505.mcf_r (avg) 80.000 9.59%
505.mcf_r (avg) (percentage) 0.570 9.62%
505.mcf_r (max) 109.000 13.54%
505.mcf_r (max) (percentage) 0.780 14.71%
505.mcf_r (unexplained diff vs previous) 111.000 15.62%
505.mcf_r (unexplained diff vs previous) (percentage) 0.790 16.18%
508.namd_r 51.000 -16.39%
508.namd_r (avg) 51.000 -16.39%
508.namd_r (avg) (percentage) 0.540 -15.62%
508.namd_r (max) 103.000 -4.63%
508.namd_r (max) (percentage) 1.080 -4.42%
508.namd_r (unexplained diff vs previous) 6.000 -94.29%
508.namd_r (unexplained diff vs previous) (percentage) 0.060 -94.55%
510.parest_r 32.000 -5.88%
510.parest_r (avg) 32.000 -5.88%
510.parest_r (avg) (percentage) 0.140 -
510.parest_r (max) 41.000 -4.65%
510.parest_r (max) (percentage) 0.180 -5.26%
510.parest_r (unexplained diff vs previous) 6.000 50.00%
510.parest_r (unexplained diff vs previous) (percentage) 0.030 -
511.povray_r 77.000 -
511.povray_r (avg) 77.000 -
511.povray_r (avg) (percentage) 0.360 -
511.povray_r (max) 113.000 -4.24%
511.povray_r (max) (percentage) 0.530 -3.64%
519.lbm_r 31.000 6.90%
519.lbm_r (avg) 31.000 6.90%
519.lbm_r (avg) (percentage) 0.180 -
519.lbm_r (max) 47.000 62.07%
519.lbm_r (max) (percentage) 0.270 58.82%
519.lbm_r (unexplained diff vs previous) 48.000 100.00%
519.lbm_r (unexplained diff vs previous) (percentage) 0.270 92.86%
520.omnetpp_r 132.000 -1.49%
520.omnetpp_r (avg) 132.000 -1.49%
520.omnetpp_r (avg) (percentage) 0.910 -1.09%
520.omnetpp_r (max) 338.000 -7.65%
520.omnetpp_r (max) (percentage) 2.330 -6.80%
520.omnetpp_r (unexplained diff vs previous) 127.000 164.58%
520.omnetpp_r (unexplained diff vs previous) (percentage) 0.870 163.64%
521.wrf_r 114.000 -
521.wrf_r (avg) 114.000 -
521.wrf_r (avg) (percentage) 0.780 -
521.wrf_r (max) 107.000 -1.83%
521.wrf_r (max) (percentage) 0.730 -1.35%
523.xalancbmk_r 42.000 27.27%
523.xalancbmk_r (avg) 42.000 27.27%
523.xalancbmk_r (avg) (percentage) 0.310 29.17%
523.xalancbmk_r (max) 65.000 25.00%
523.xalancbmk_r (max) (percentage) 0.480 26.32%
523.xalancbmk_r (unexplained diff vs previous) 66.000 26.92%
523.xalancbmk_r (unexplained diff vs previous) (percentage) 0.480 26.32%
525.x264_r 7.000 16.67%
525.x264_r (avg) 7.000 16.67%
525.x264_r (avg) (percentage) 0.100 11.11%
525.x264_r (max) 14.000 27.27%
525.x264_r (max) (percentage) 0.200 33.33%
525.x264_r (unexplained diff vs previous) 15.000 36.36%
525.x264_r (unexplained diff vs previous) (percentage) 0.200 33.33%
526.blender_r 39.000 -4.88%
526.blender_r (avg) 39.000 -4.88%
526.blender_r (avg) (percentage) 0.330 -
526.blender_r (max) 42.000 -4.55%
526.blender_r (max) (percentage) 0.350 -2.78%
531.deepsjeng_r 35.000 -2.78%
531.deepsjeng_r (avg) 35.000 -2.78%
531.deepsjeng_r (avg) (percentage) 0.410 -
531.deepsjeng_r (max) 64.000 -4.48%
531.deepsjeng_r (max) (percentage) 0.740 -3.90%
538.imagick_r 41.000 -
538.imagick_r (avg) 41.000 -
538.imagick_r (avg) (percentage) 0.300 -
538.imagick_r (max) 56.000 -3.45%
538.imagick_r (max) (percentage) 0.410 -2.38%
541.leela_r 47.000 -20.34%
541.leela_r (avg) 47.000 -20.34%
541.leela_r (avg) (percentage) 0.350 -20.45%
541.leela_r (max) 70.000 -5.41%
541.leela_r (max) (percentage) 0.520 -5.45%
541.leela_r (unexplained diff vs previous) 0.000 -
541.leela_r (unexplained diff vs previous) (percentage) 0.000 -
544.nab_r 42.000 2.44%
544.nab_r (avg) 42.000 2.44%
544.nab_r (avg) (percentage) 0.290 -
544.nab_r (max) 37.000 -
544.nab_r (max) (percentage) 0.250 -3.85%
548.exchange2_r 22.000 -18.52%
548.exchange2_r (avg) 22.000 -18.52%
548.exchange2_r (avg) (percentage) 0.120 -20.00%
548.exchange2_r (max) 40.000 -
548.exchange2_r (max) (percentage) 0.220 -
548.exchange2_r (unexplained diff vs previous) 6.000 100.00%
548.exchange2_r (unexplained diff vs previous) (percentage) 0.030 -
549.fotonik3d_r 242.000 -
549.fotonik3d_r (avg) 242.000 -
549.fotonik3d_r (avg) (percentage) 0.780 -
549.fotonik3d_r (max) 370.000 -2.37%
549.fotonik3d_r (max) (percentage) 1.190 -1.65%
549.fotonik3d_r (unexplained diff vs previous) 241.000 205.06%
549.fotonik3d_r (unexplained diff vs previous) (percentage) 0.770 208.00%
554.roms_r 9.000 -30.77%
554.roms_r (avg) 9.000 -30.77%
554.roms_r (avg) (percentage) 0.040 -33.33%
554.roms_r (max) 16.000 -
554.roms_r (max) (percentage) 0.070 -
554.roms_r (unexplained diff vs previous) 5.000 -58.33%
554.roms_r (unexplained diff vs previous) (percentage) 0.020 -60.00%
557.xz_r 11.000 -
557.xz_r (avg) 11.000 -
557.xz_r (avg) (percentage) 0.100 -
557.xz_r (max) 20.000 -4.76%
557.xz_r (max) (percentage) 0.180 -5.26%
Geometric Mean 4.397 -16.29%