Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/51eeea67c67cb3e622730ee1fa8c9b939268429b (+ 221 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-cpu2017rate--llvm-aarch64-master-O2-build/41/
View Options
Report
Filter

llvm-aarch64-master-O2 test results

Run Order Start Time Duration
Current 0041 (llvmorg-17-init-10624-g51eeea67c67c) 2023-05-06T13:49:34 0:00:00
Previous 0041 (llvmorg-17-init-10624-g51eeea67c67c) 2023-05-06T13:49:34 0:00:00
Baseline 0027 (llvmorg-17-init-08118-g0b911a3dc34a) 2023-04-13T21:53:13 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 0 59
Performance Improvements 0 58
Unchanged Tests 876 759
Total Tests 876

Run-Over-Baseline Changes Detail

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
525.x264_r 2.11% 7490.000 7648.000 - 0.00% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
548.exchange2_r (unexplained diff vs previous) 2166.67% 3.000 68.000 - 0.00% -
548.exchange2_r (unexplained diff vs previous) (percentage) 1750.00% 0.020 0.370 - 0.00% -
520.omnetpp_r (unexplained diff vs previous) (percentage) 506.06% 0.330 2.000 - 0.00% -
520.omnetpp_r (unexplained diff vs previous) 497.92% 48.000 287.000 - 0.00% -
554.roms_r (max) (percentage) 257.14% 0.070 0.250 - 0.00% -
554.roms_r (max) 256.25% 16.000 57.000 - 0.00% -
521.wrf_r (max) (percentage) 250.00% 0.740 2.590 - 0.00% -
521.wrf_r (max) 243.12% 109.000 374.000 - 0.00% -
525.x264_r 233.33% 6.000 20.000 - 0.00% -
525.x264_r (avg) 233.33% 6.000 20.000 - 0.00% -
525.x264_r (avg) (percentage) 200.00% 0.090 0.270 - 0.00% -
519.lbm_r (max) 120.69% 29.000 64.000 - 0.00% -
519.lbm_r (max) (percentage) 117.65% 0.170 0.370 - 0.00% -
544.nab_r (max) 81.08% 37.000 67.000 - 0.00% -
544.nab_r (max) (percentage) 80.77% 0.260 0.470 - 0.00% -
557.xz_r (max) 71.43% 21.000 36.000 - 0.00% -
548.exchange2_r (max) 70.00% 40.000 68.000 - 0.00% -
554.roms_r 69.23% 13.000 22.000 - 0.00% -
554.roms_r (avg) 69.23% 13.000 22.000 - 0.00% -
557.xz_r (max) (percentage) 68.42% 0.190 0.320 - 0.00% -
548.exchange2_r (max) (percentage) 68.18% 0.220 0.370 - 0.00% -
554.roms_r (avg) (percentage) 66.67% 0.060 0.100 - 0.00% -
500.perlbench_r (max) (percentage) 63.91% 1.330 2.180 - 0.00% -
557.xz_r 63.64% 11.000 18.000 - 0.00% -
557.xz_r (avg) 63.64% 11.000 18.000 - 0.00% -
500.perlbench_r (max) 62.44% 213.000 346.000 - 0.00% -
521.wrf_r (avg) (percentage) 60.26% 0.780 1.250 - 0.00% -
557.xz_r (avg) (percentage) 60.00% 0.100 0.160 - 0.00% -
521.wrf_r 56.52% 115.000 180.000 - 0.00% -
521.wrf_r (avg) 56.52% 115.000 180.000 - 0.00% -
510.parest_r (max) (percentage) 42.11% 0.190 0.270 - 0.00% -
510.parest_r (max) 41.86% 43.000 61.000 - 0.00% -
525.x264_r (max) 27.27% 11.000 14.000 - 0.00% -
525.x264_r (max) (percentage) 26.67% 0.150 0.190 - 0.00% -
519.lbm_r 24.14% 29.000 36.000 - 0.00% -
519.lbm_r (avg) 24.14% 29.000 36.000 - 0.00% -
519.lbm_r (avg) (percentage) 23.53% 0.170 0.210 - 0.00% -
500.perlbench_r (avg) (percentage) 18.68% 0.910 1.080 - 0.00% -
531.deepsjeng_r (max) 17.91% 67.000 79.000 - 0.00% -
544.nab_r (avg) (percentage) 17.24% 0.290 0.340 - 0.00% -
500.perlbench_r 17.12% 146.000 171.000 - 0.00% -
500.perlbench_r (avg) 17.12% 146.000 171.000 - 0.00% -
531.deepsjeng_r (unexplained diff vs previous) (percentage) 17.11% 0.760 0.890 - 0.00% -
531.deepsjeng_r (avg) (percentage) 17.07% 0.410 0.480 - 0.00% -
544.nab_r 17.07% 41.000 48.000 - 0.00% -
544.nab_r (avg) 17.07% 41.000 48.000 - 0.00% -
531.deepsjeng_r (max) (percentage) 16.88% 0.770 0.900 - 0.00% -
531.deepsjeng_r 16.67% 36.000 42.000 - 0.00% -
531.deepsjeng_r (avg) 16.67% 36.000 42.000 - 0.00% -
531.deepsjeng_r (unexplained diff vs previous) 16.42% 67.000 78.000 - 0.00% -
511.povray_r (avg) (percentage) 13.89% 0.360 0.410 - 0.00% -
511.povray_r 10.39% 77.000 85.000 - 0.00% -
511.povray_r (avg) 10.39% 77.000 85.000 - 0.00% -
520.omnetpp_r (avg) (percentage) 8.70% 0.920 1.000 - 0.00% -
520.omnetpp_r 6.72% 134.000 143.000 - 0.00% -
520.omnetpp_r (avg) 6.72% 134.000 143.000 - 0.00% -
523.xalancbmk_r (max) (percentage) 5.26% 0.380 0.400 - 0.00% -
523.xalancbmk_r (max) 3.85% 52.000 54.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
511.povray_r -3.74% 21547.000 20742.000 - 0.00% -
526.blender_r -2.20% 12432.000 12158.000 - 0.00% -
521.wrf_r -2.03% 14746.000 14446.000 - 0.00% -
520.omnetpp_r -2.01% 14662.000 14367.000 - 0.00% -
523.xalancbmk_r -1.96% 13812.000 13541.000 - 0.00% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
508.namd_r (unexplained diff vs previous) (percentage) -99.09% 1.100 0.010 - 0.00% -
508.namd_r (unexplained diff vs previous) -99.05% 105.000 1.000 - 0.00% -
503.bwaves_r (unexplained diff vs previous) (percentage) -85.71% 0.070 0.010 - 0.00% -
503.bwaves_r (unexplained diff vs previous) -78.57% 14.000 3.000 - 0.00% -
549.fotonik3d_r (max) -63.06% 379.000 140.000 - 0.00% -
549.fotonik3d_r (max) (percentage) -62.81% 1.210 0.450 - 0.00% -
508.namd_r (max) -52.78% 108.000 51.000 - 0.00% -
508.namd_r (max) (percentage) -52.21% 1.130 0.540 - 0.00% -
508.namd_r -50.82% 61.000 30.000 - 0.00% -
508.namd_r (avg) -50.82% 61.000 30.000 - 0.00% -
508.namd_r (avg) (percentage) -50.00% 0.640 0.320 - 0.00% -
503.bwaves_r -42.86% 21.000 12.000 - 0.00% -
503.bwaves_r (avg) -42.86% 21.000 12.000 - 0.00% -
503.bwaves_r (avg) (percentage) -40.00% 0.100 0.060 - 0.00% -
525.x264_r (unexplained diff vs previous) (percentage) -33.33% 0.150 0.100 - 0.00% -
549.fotonik3d_r -32.38% 244.000 165.000 - 0.00% -
549.fotonik3d_r (avg) -32.38% 244.000 165.000 - 0.00% -
549.fotonik3d_r (avg) (percentage) -32.05% 0.780 0.530 - 0.00% -
526.blender_r -29.27% 41.000 29.000 - 0.00% -
526.blender_r (avg) -29.27% 41.000 29.000 - 0.00% -
526.blender_r (avg) (percentage) -27.27% 0.330 0.240 - 0.00% -
525.x264_r (unexplained diff vs previous) -27.27% 11.000 8.000 - 0.00% -
538.imagick_r -26.83% 41.000 30.000 - 0.00% -
538.imagick_r (avg) -26.83% 41.000 30.000 - 0.00% -
538.imagick_r (avg) (percentage) -26.67% 0.300 0.220 - 0.00% -
520.omnetpp_r (max) -23.22% 366.000 281.000 - 0.00% -
520.omnetpp_r (max) (percentage) -21.60% 2.500 1.960 - 0.00% -
541.leela_r (avg) (percentage) -20.45% 0.440 0.350 - 0.00% -
541.leela_r -20.34% 59.000 47.000 - 0.00% -
541.leela_r (avg) -20.34% 59.000 47.000 - 0.00% -
526.blender_r (max) -18.18% 44.000 36.000 - 0.00% -
538.imagick_r (max) -17.24% 58.000 48.000 - 0.00% -
538.imagick_r (max) (percentage) -16.67% 0.420 0.350 - 0.00% -
526.blender_r (max) (percentage) -16.67% 0.360 0.300 - 0.00% -
505.mcf_r -16.44% 73.000 61.000 - 0.00% -
505.mcf_r (avg) -16.44% 73.000 61.000 - 0.00% -
503.bwaves_r (max) -15.79% 19.000 16.000 - 0.00% -
505.mcf_r (avg) (percentage) -15.38% 0.520 0.440 - 0.00% -
523.xalancbmk_r -15.15% 33.000 28.000 - 0.00% -
523.xalancbmk_r (avg) -15.15% 33.000 28.000 - 0.00% -
505.mcf_r (max) -12.50% 96.000 84.000 - 0.00% -
523.xalancbmk_r (avg) (percentage) -12.50% 0.240 0.210 - 0.00% -
505.mcf_r (max) (percentage) -11.76% 0.680 0.600 - 0.00% -
519.lbm_r (unexplained diff vs previous) -8.33% 24.000 22.000 - 0.00% -
511.povray_r (max) -7.63% 118.000 109.000 - 0.00% -
519.lbm_r (unexplained diff vs previous) (percentage) -7.14% 0.140 0.130 - 0.00% -
510.parest_r -5.88% 34.000 32.000 - 0.00% -
510.parest_r (avg) -5.88% 34.000 32.000 - 0.00% -
541.leela_r (max) -4.05% 74.000 71.000 - 0.00% -
548.exchange2_r -3.70% 27.000 26.000 - 0.00% -
548.exchange2_r (avg) -3.70% 27.000 26.000 - 0.00% -
511.povray_r (max) (percentage) -3.64% 0.550 0.530 - 0.00% -
541.leela_r (max) (percentage) -3.64% 0.550 0.530 - 0.00% -

Report Time: 0.33s
Execution (seconds)
Name Current %
500.perlbench_r 15891.000 -
502.gcc_r 10972.000 -
503.bwaves_r 21150.000 -
505.mcf_r 14032.000 -
507.cactuBSSN_r 11264.000 -
508.namd_r 9534.000 -
510.parest_r 22904.000 -
511.povray_r 20742.000 -
519.lbm_r 17511.000 -
520.omnetpp_r 14367.000 -
521.wrf_r 14446.000 -
523.xalancbmk_r 13541.000 -
525.x264_r 7648.000 -
526.blender_r 12158.000 -
531.deepsjeng_r 8790.000 -
538.imagick_r 13870.000 -
541.leela_r 13549.000 -
544.nab_r 14346.000 -
548.exchange2_r 18583.000 -
549.fotonik3d_r 31150.000 -
554.roms_r 22900.000 -
557.xz_r 11551.000 -
Geometric Mean 14639.863 -
Code Size (bytes)
Name Current %
500.perlbench_r 2153007.000 -
502.gcc_r 8929996.000 -
503.bwaves_r 775742.000 -
505.mcf_r 27207.000 -
507.cactuBSSN_r 3678110.000 -
508.namd_r 621699.000 -
510.parest_r 8616500.000 -
511.povray_r 915374.000 -
519.lbm_r 13351.000 -
520.omnetpp_r 2152407.000 -
521.wrf_r 23892476.000 -
523.xalancbmk_r 4725467.000 -
525.x264_r 500010.000 -
526.blender_r 13663082.000 -
531.deepsjeng_r 81110.000 -
538.imagick_r 1701661.000 -
541.leela_r 144755.000 -
544.nab_r 191016.000 -
548.exchange2_r 2555411.000 -
549.fotonik3d_r 1256542.000 -
554.roms_r 3060161.000 -
557.xz_r 177388.000 -
Geometric Mean 1003465.890 -
sample variability
Name Current %
500.perlbench_r 171.000 -
500.perlbench_r (avg) 171.000 -
500.perlbench_r (avg) (percentage) 1.080 -
500.perlbench_r (max) 346.000 -
500.perlbench_r (max) (percentage) 2.180 -
503.bwaves_r 12.000 -
503.bwaves_r (avg) 12.000 -
503.bwaves_r (avg) (percentage) 0.060 -
503.bwaves_r (max) 16.000 -
503.bwaves_r (max) (percentage) 0.080 -
503.bwaves_r (unexplained diff vs previous) 3.000 -
503.bwaves_r (unexplained diff vs previous) (percentage) 0.010 -
505.mcf_r 61.000 -
505.mcf_r (avg) 61.000 -
505.mcf_r (avg) (percentage) 0.440 -
505.mcf_r (max) 84.000 -
505.mcf_r (max) (percentage) 0.600 -
508.namd_r 30.000 -
508.namd_r (avg) 30.000 -
508.namd_r (avg) (percentage) 0.320 -
508.namd_r (max) 51.000 -
508.namd_r (max) (percentage) 0.540 -
508.namd_r (unexplained diff vs previous) 1.000 -
508.namd_r (unexplained diff vs previous) (percentage) 0.010 -
510.parest_r 32.000 -
510.parest_r (avg) 32.000 -
510.parest_r (avg) (percentage) 0.140 -
510.parest_r (max) 61.000 -
510.parest_r (max) (percentage) 0.270 -
511.povray_r 85.000 -
511.povray_r (avg) 85.000 -
511.povray_r (avg) (percentage) 0.410 -
511.povray_r (max) 109.000 -
511.povray_r (max) (percentage) 0.530 -
519.lbm_r 36.000 -
519.lbm_r (avg) 36.000 -
519.lbm_r (avg) (percentage) 0.210 -
519.lbm_r (max) 64.000 -
519.lbm_r (max) (percentage) 0.370 -
519.lbm_r (unexplained diff vs previous) 22.000 -
519.lbm_r (unexplained diff vs previous) (percentage) 0.130 -
520.omnetpp_r 143.000 -
520.omnetpp_r (avg) 143.000 -
520.omnetpp_r (avg) (percentage) 1.000 -
520.omnetpp_r (max) 281.000 -
520.omnetpp_r (max) (percentage) 1.960 -
520.omnetpp_r (unexplained diff vs previous) 287.000 -
520.omnetpp_r (unexplained diff vs previous) (percentage) 2.000 -
521.wrf_r 180.000 -
521.wrf_r (avg) 180.000 -
521.wrf_r (avg) (percentage) 1.250 -
521.wrf_r (max) 374.000 -
521.wrf_r (max) (percentage) 2.590 -
523.xalancbmk_r 28.000 -
523.xalancbmk_r (avg) 28.000 -
523.xalancbmk_r (avg) (percentage) 0.210 -
523.xalancbmk_r (max) 54.000 -
523.xalancbmk_r (max) (percentage) 0.400 -
525.x264_r 20.000 -
525.x264_r (avg) 20.000 -
525.x264_r (avg) (percentage) 0.270 -
525.x264_r (max) 14.000 -
525.x264_r (max) (percentage) 0.190 -
525.x264_r (unexplained diff vs previous) 8.000 -
525.x264_r (unexplained diff vs previous) (percentage) 0.100 -
526.blender_r 29.000 -
526.blender_r (avg) 29.000 -
526.blender_r (avg) (percentage) 0.240 -
526.blender_r (max) 36.000 -
526.blender_r (max) (percentage) 0.300 -
531.deepsjeng_r 42.000 -
531.deepsjeng_r (avg) 42.000 -
531.deepsjeng_r (avg) (percentage) 0.480 -
531.deepsjeng_r (max) 79.000 -
531.deepsjeng_r (max) (percentage) 0.900 -
531.deepsjeng_r (unexplained diff vs previous) 78.000 -
531.deepsjeng_r (unexplained diff vs previous) (percentage) 0.890 -
538.imagick_r 30.000 -
538.imagick_r (avg) 30.000 -
538.imagick_r (avg) (percentage) 0.220 -
538.imagick_r (max) 48.000 -
538.imagick_r (max) (percentage) 0.350 -
541.leela_r 47.000 -
541.leela_r (avg) 47.000 -
541.leela_r (avg) (percentage) 0.350 -
541.leela_r (max) 71.000 -
541.leela_r (max) (percentage) 0.530 -
544.nab_r 48.000 -
544.nab_r (avg) 48.000 -
544.nab_r (avg) (percentage) 0.340 -
544.nab_r (max) 67.000 -
544.nab_r (max) (percentage) 0.470 -
548.exchange2_r 26.000 -
548.exchange2_r (avg) 26.000 -
548.exchange2_r (avg) (percentage) 0.140 -
548.exchange2_r (max) 68.000 -
548.exchange2_r (max) (percentage) 0.370 -
548.exchange2_r (unexplained diff vs previous) 68.000 -
548.exchange2_r (unexplained diff vs previous) (percentage) 0.370 -
549.fotonik3d_r 165.000 -
549.fotonik3d_r (avg) 165.000 -
549.fotonik3d_r (avg) (percentage) 0.530 -
549.fotonik3d_r (max) 140.000 -
549.fotonik3d_r (max) (percentage) 0.450 -
554.roms_r 22.000 -
554.roms_r (avg) 22.000 -
554.roms_r (avg) (percentage) 0.100 -
554.roms_r (max) 57.000 -
554.roms_r (max) (percentage) 0.250 -
557.xz_r 18.000 -
557.xz_r (avg) 18.000 -
557.xz_r (avg) (percentage) 0.160 -
557.xz_r (max) 36.000 -
557.xz_r (max) (percentage) 0.320 -
Geometric Mean 5.987 -