Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/9ebe6e28cdbe97f6c03209b87e91be6b55a8026a (+ 1814 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-cpu2017rate--llvm-aarch64-master-O2-build/132/
View Options
Report
Filter

llvm-aarch64-master-O2 test results

Run Order Start Time Duration
Current 0132 (llvmorg-18-init-12562-g9ebe6e28cdbe) 2023-11-12T13:37:40 0:00:00
Previous 0131 (no-change) 2023-11-01T08:07:29 0:00:00
Baseline 0027 (llvmorg-17-init-08118-g0b911a3dc34a) 2023-04-13T21:53:13 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 4 47
Performance Improvements 23 49
Added Tests 2 7
Unchanged Tests 871 797
Total Tests 900

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
505.mcf_r 3.00% 13855.000 14270.000 - 0.86% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
505.mcf_r 1.85% 54.000 55.000 - -24.66% -
505.mcf_r (avg) 1.85% 54.000 55.000 - -24.66% -
538.imagick_r (max) 1.82% 55.000 56.000 - -3.45% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
519.lbm_r -7.38% 16864.000 15620.000 - -10.88% -
525.x264_r -3.56% 6453.000 6223.000 - -16.92% -
520.omnetpp_r -2.42% 14868.000 14508.000 - -1.05% -
511.povray_r -2.00% 20247.000 19843.000 - -7.91% -
557.xz_r -1.84% 11654.000 11439.000 - -1.01% -
544.nab_r -1.27% 14400.000 14217.000 - -0.69% -
500.perlbench_r -1.07% 16210.000 16037.000 - -0.09% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
525.x264_r (max) -11.11% 9.000 8.000 - -27.27% -
519.lbm_r -7.50% 40.000 37.000 - 27.59% -
519.lbm_r (avg) -7.50% 40.000 37.000 - 27.59% -
519.lbm_r (max) -6.94% 72.000 67.000 - 131.03% -
520.omnetpp_r (max) -2.47% 243.000 237.000 - -35.25% -
511.povray_r -2.41% 83.000 81.000 - 5.19% -
511.povray_r (avg) -2.41% 83.000 81.000 - 5.19% -
520.omnetpp_r -2.33% 172.000 168.000 - 25.37% -
520.omnetpp_r (avg) -2.33% 172.000 168.000 - 25.37% -
544.nab_r -2.33% 43.000 42.000 - 2.44% -
544.nab_r (avg) -2.33% 43.000 42.000 - 2.44% -
544.nab_r (max) -2.13% 47.000 46.000 - 24.32% -
511.povray_r (max) -1.74% 115.000 113.000 - -4.24% -
500.perlbench_r -1.47% 136.000 134.000 - -8.22% -
500.perlbench_r (avg) -1.47% 136.000 134.000 - -8.22% -

Performance Improvements - Score Δ Previous Current σ Δ (B) σ (B)
nb_total_tests 9.09% 11.000 12.000 - -47.83% -

Added Tests - Score
nb_compile_successful
nb_execution_successful

Run-Over-Baseline Changes Detail

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
507.cactuBSSN_r 1.34% 11293.000 11444.000 - 0.12% -
538.imagick_r 1.06% 13884.000 14031.000 - 0.54% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
503.bwaves_r (max) (percentage) 177.78% 0.090 0.250 - 0.00% -
554.roms_r (max) (percentage) 171.43% 0.070 0.190 - 0.00% -
519.lbm_r (max) (percentage) 152.94% 0.170 0.430 - 0.00% -
554.roms_r (avg) (percentage) 150.00% 0.060 0.150 - 0.00% -
525.x264_r (avg) (percentage) 133.33% 0.090 0.210 - 0.00% -
519.lbm_r (max) 131.03% 29.000 67.000 - -6.94% -
526.blender_r (avg) (percentage) 118.18% 0.330 0.720 - 0.00% -
525.x264_r 116.67% 6.000 13.000 - 0.00% -
525.x264_r (avg) 116.67% 6.000 13.000 - 0.00% -
526.blender_r 107.32% 41.000 85.000 - 0.00% -
526.blender_r (avg) 107.32% 41.000 85.000 - 0.00% -
521.wrf_r (max) (percentage) 97.30% 0.740 1.460 - 0.00% -
521.wrf_r (avg) (percentage) 89.74% 0.780 1.480 - 0.00% -
526.blender_r (max) (percentage) 50.00% 0.360 0.540 - 0.00% -
526.blender_r (max) 45.45% 44.000 64.000 - 0.00% -
500.perlbench_r (max) 43.66% 213.000 306.000 - -0.97% -
500.perlbench_r (max) (percentage) 43.61% 1.330 1.910 - 0.00% -
519.lbm_r (avg) (percentage) 41.18% 0.170 0.240 - 0.00% -
519.lbm_r 27.59% 29.000 37.000 - -7.50% -
519.lbm_r (avg) 27.59% 29.000 37.000 - -7.50% -
544.nab_r (max) (percentage) 26.92% 0.260 0.330 - 0.00% -
520.omnetpp_r (avg) (percentage) 26.09% 0.920 1.160 - 0.00% -
520.omnetpp_r 25.37% 134.000 168.000 - -2.33% -
520.omnetpp_r (avg) 25.37% 134.000 168.000 - -2.33% -
544.nab_r (max) 24.32% 37.000 46.000 - -2.13% -
531.deepsjeng_r (avg) (percentage) 19.51% 0.410 0.490 - 0.00% -
548.exchange2_r (max) (percentage) 18.18% 0.220 0.260 - 0.00% -
531.deepsjeng_r 16.67% 36.000 42.000 - 0.00% -
531.deepsjeng_r (avg) 16.67% 36.000 42.000 - 0.00% -
511.povray_r (avg) (percentage) 13.89% 0.360 0.410 - 0.00% -
510.parest_r (avg) (percentage) 13.33% 0.150 0.170 - 0.00% -
510.parest_r 11.76% 34.000 38.000 - 0.00% -
510.parest_r (avg) 11.76% 34.000 38.000 - 0.00% -
557.xz_r 9.09% 11.000 12.000 - 0.00% -
557.xz_r (avg) 9.09% 11.000 12.000 - 0.00% -
548.exchange2_r (avg) (percentage) 6.67% 0.150 0.160 - 0.00% -
541.leela_r (max) (percentage) 5.45% 0.550 0.580 - 0.00% -
511.povray_r 5.19% 77.000 81.000 - -2.41% -
511.povray_r (avg) 5.19% 77.000 81.000 - -2.41% -
541.leela_r (max) 4.05% 74.000 77.000 - 0.00% -
511.povray_r (max) (percentage) 3.64% 0.550 0.570 - 0.00% -
544.nab_r (avg) (percentage) 3.45% 0.290 0.300 - 0.00% -
544.nab_r 2.44% 41.000 42.000 - -2.33% -
544.nab_r (avg) 2.44% 41.000 42.000 - -2.33% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests -47.83% 23.000 12.000 - 9.09% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
525.x264_r -16.92% 7490.000 6223.000 - -3.56% -
519.lbm_r -10.88% 17526.000 15620.000 - -7.38% -
511.povray_r -7.91% 21547.000 19843.000 - -2.00% -
526.blender_r -4.67% 12432.000 11852.000 - -0.70% -
531.deepsjeng_r -2.07% 8789.000 8607.000 - -0.44% -
502.gcc_r -1.61% 11030.000 10852.000 - -0.41% -
523.xalancbmk_r -1.25% 13812.000 13640.000 - -0.42% -
541.leela_r -1.16% 13571.000 13414.000 - 0.56% -
520.omnetpp_r -1.05% 14662.000 14508.000 - -2.42% -
557.xz_r -1.01% 11556.000 11439.000 - -1.84% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
557.xz_r (max) -80.95% 21.000 4.000 - 0.00% -
557.xz_r (max) (percentage) -78.95% 0.190 0.040 - 0.00% -
508.namd_r (max) -78.70% 108.000 23.000 - 0.00% -
508.namd_r (max) (percentage) -77.88% 1.130 0.250 - 0.00% -
505.mcf_r (max) -77.08% 96.000 22.000 - 0.00% -
505.mcf_r (max) (percentage) -76.47% 0.680 0.160 - 0.00% -
549.fotonik3d_r (max) (percentage) -63.64% 1.210 0.440 - 0.00% -
508.namd_r -57.38% 61.000 26.000 - 0.00% -
508.namd_r (avg) -57.38% 61.000 26.000 - 0.00% -
508.namd_r (avg) (percentage) -56.25% 0.640 0.280 - 0.00% -
531.deepsjeng_r (max) -47.76% 67.000 35.000 - 0.00% -
531.deepsjeng_r (max) (percentage) -46.75% 0.770 0.410 - 0.00% -
538.imagick_r (avg) (percentage) -40.00% 0.300 0.180 - 0.00% -
538.imagick_r -39.02% 41.000 25.000 - 0.00% -
538.imagick_r (avg) -39.02% 41.000 25.000 - 0.00% -
549.fotonik3d_r (avg) (percentage) -37.18% 0.780 0.490 - 0.00% -
520.omnetpp_r (max) -35.25% 366.000 237.000 - -2.47% -
520.omnetpp_r (max) (percentage) -34.40% 2.500 1.640 - 0.00% -
510.parest_r (max) -32.56% 43.000 29.000 - 0.00% -
541.leela_r -32.20% 59.000 40.000 - 0.00% -
541.leela_r (avg) -32.20% 59.000 40.000 - 0.00% -
541.leela_r (avg) (percentage) -31.82% 0.440 0.300 - 0.00% -
510.parest_r (max) (percentage) -31.58% 0.190 0.130 - 0.00% -
525.x264_r (max) -27.27% 11.000 8.000 - -11.11% -
505.mcf_r (avg) (percentage) -25.00% 0.520 0.390 - 0.00% -
523.xalancbmk_r (max) -25.00% 52.000 39.000 - 0.00% -
505.mcf_r -24.66% 73.000 55.000 - 1.85% -
505.mcf_r (avg) -24.66% 73.000 55.000 - 1.85% -
523.xalancbmk_r (max) (percentage) -23.68% 0.380 0.290 - 0.00% -
503.bwaves_r (avg) (percentage) -10.00% 0.100 0.090 - 0.00% -
523.xalancbmk_r -9.09% 33.000 30.000 - 0.00% -
523.xalancbmk_r (avg) -9.09% 33.000 30.000 - 0.00% -
523.xalancbmk_r (avg) (percentage) -8.33% 0.240 0.220 - 0.00% -
500.perlbench_r -8.22% 146.000 134.000 - -1.47% -
500.perlbench_r (avg) -8.22% 146.000 134.000 - -1.47% -
500.perlbench_r (avg) (percentage) -7.69% 0.910 0.840 - 0.00% -
538.imagick_r (max) (percentage) -4.76% 0.420 0.400 - 0.00% -
511.povray_r (max) -4.24% 118.000 113.000 - -1.74% -
538.imagick_r (max) -3.45% 58.000 56.000 - 1.82% -

Added Tests - sample variability
507.cactuBSSN_r
507.cactuBSSN_r (avg)
507.cactuBSSN_r (avg) (percentage)
507.cactuBSSN_r (max)
507.cactuBSSN_r (max) (percentage)

Added Tests - Score
nb_compile_successful
nb_execution_successful

Report Time: 0.35s
Execution (seconds)
Name Current %
500.perlbench_r 16037.000 -1.07%
502.gcc_r 10852.000 -
505.mcf_r 14270.000 3.00%
507.cactuBSSN_r 11444.000 -
508.namd_r 9510.000 -
510.parest_r 22869.000 -
511.povray_r 19843.000 -2.00%
519.lbm_r 15620.000 -7.38%
520.omnetpp_r 14508.000 -2.42%
523.xalancbmk_r 13640.000 -
525.x264_r 6223.000 -3.56%
526.blender_r 11852.000 -
531.deepsjeng_r 8607.000 -
538.imagick_r 14031.000 -
541.leela_r 13414.000 -
544.nab_r 14217.000 -1.27%
557.xz_r 11439.000 -1.84%
Geometric Mean 12877.714 -1.09%
Score
Name Current %
nb_compile_successful 0.000 -
nb_execution_successful 0.000 -
nb_total_tests 12.000 9.09%
Geometric Mean 0.005 -99.96%
sample variability
Name Current %
500.perlbench_r 134.000 -1.47%
500.perlbench_r (avg) 134.000 -1.47%
500.perlbench_r (avg) (percentage) 0.840 -
500.perlbench_r (max) 306.000 -
500.perlbench_r (max) (percentage) 1.910 -
503.bwaves_r (avg) (percentage) 0.090 -
503.bwaves_r (max) (percentage) 0.250 -
505.mcf_r 55.000 1.85%
505.mcf_r (avg) 55.000 1.85%
505.mcf_r (avg) (percentage) 0.390 -
505.mcf_r (max) 22.000 -
505.mcf_r (max) (percentage) 0.160 -
507.cactuBSSN_r 1.000 -
507.cactuBSSN_r (avg) 1.000 -
507.cactuBSSN_r (avg) (percentage) 0.010 -
507.cactuBSSN_r (max) 1.000 -
507.cactuBSSN_r (max) (percentage) 0.010 -
508.namd_r 26.000 -
508.namd_r (avg) 26.000 -
508.namd_r (avg) (percentage) 0.280 -
508.namd_r (max) 23.000 -
508.namd_r (max) (percentage) 0.250 -
510.parest_r 38.000 -
510.parest_r (avg) 38.000 -
510.parest_r (avg) (percentage) 0.170 -
510.parest_r (max) 29.000 -
510.parest_r (max) (percentage) 0.130 -
511.povray_r 81.000 -2.41%
511.povray_r (avg) 81.000 -2.41%
511.povray_r (avg) (percentage) 0.410 -
511.povray_r (max) 113.000 -1.74%
511.povray_r (max) (percentage) 0.570 -
519.lbm_r 37.000 -7.50%
519.lbm_r (avg) 37.000 -7.50%
519.lbm_r (avg) (percentage) 0.240 -
519.lbm_r (max) 67.000 -6.94%
519.lbm_r (max) (percentage) 0.430 -
520.omnetpp_r 168.000 -2.33%
520.omnetpp_r (avg) 168.000 -2.33%
520.omnetpp_r (avg) (percentage) 1.160 -
520.omnetpp_r (max) 237.000 -2.47%
520.omnetpp_r (max) (percentage) 1.640 -
521.wrf_r (avg) (percentage) 1.480 -
521.wrf_r (max) (percentage) 1.460 -
523.xalancbmk_r 30.000 -
523.xalancbmk_r (avg) 30.000 -
523.xalancbmk_r (avg) (percentage) 0.220 -
523.xalancbmk_r (max) 39.000 -
523.xalancbmk_r (max) (percentage) 0.290 -
525.x264_r 13.000 -
525.x264_r (avg) 13.000 -
525.x264_r (avg) (percentage) 0.210 -
525.x264_r (max) 8.000 -11.11%
525.x264_r (max) (percentage) 0.140 -
526.blender_r 85.000 -
526.blender_r (avg) 85.000 -
526.blender_r (avg) (percentage) 0.720 -
526.blender_r (max) 64.000 -
526.blender_r (max) (percentage) 0.540 -
531.deepsjeng_r 42.000 -
531.deepsjeng_r (avg) 42.000 -
531.deepsjeng_r (avg) (percentage) 0.490 -
531.deepsjeng_r (max) 35.000 -
531.deepsjeng_r (max) (percentage) 0.410 -
538.imagick_r 25.000 -
538.imagick_r (avg) 25.000 -
538.imagick_r (avg) (percentage) 0.180 -
538.imagick_r (max) 56.000 1.82%
538.imagick_r (max) (percentage) 0.400 -
541.leela_r 40.000 -
541.leela_r (avg) 40.000 -
541.leela_r (avg) (percentage) 0.300 -
541.leela_r (max) 77.000 -
541.leela_r (max) (percentage) 0.580 -
544.nab_r 42.000 -2.33%
544.nab_r (avg) 42.000 -2.33%
544.nab_r (avg) (percentage) 0.300 -
544.nab_r (max) 46.000 -2.13%
544.nab_r (max) (percentage) 0.330 -
548.exchange2_r (avg) (percentage) 0.160 -
548.exchange2_r (max) (percentage) 0.260 -
549.fotonik3d_r (avg) (percentage) 0.490 -
549.fotonik3d_r (max) (percentage) 0.440 -
554.roms_r (avg) (percentage) 0.150 -
554.roms_r (max) (percentage) 0.190 -
557.xz_r 12.000 -
557.xz_r (avg) 12.000 -
557.xz_r (avg) (percentage) 0.110 -
557.xz_r (max) 4.000 -
557.xz_r (max) (percentage) 0.040 -
Geometric Mean 3.625 -