Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/e86740e6003739a41139d94e1643a3207f8fd8f8 (+ 11762 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_vect-cpu2017fast--llvm-aarch64-master-O3-build/310/
Filter

llvm-aarch64-master-O3 test results

Run Order Start Time Duration
Current 0310 (llvmorg-21-init-15670-ge86740e60037) 2025-04-25T17:35:46 0:00:00
Previous 0309 (no-change) 2025-03-04T05:19:47 0:00:00
Baseline 0001 (llvmorg-17-init-03866-g7abf6c2524d0) 2023-03-05T03:58:54 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 13 13
Performance Improvements 37 9
Added Tests 4 90
Unchanged Tests 768 710
Total Tests 822

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
623.xalancbmk_s 4.44% 3870.000 4042.000 - 0.72% -
619.lbm_s 3.28% 30190.000 31181.000 - 2.62% -
657.xz_s 1.13% 2218.000 2243.000 - -0.18% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
620.omnetpp_s (unexplained diff vs previous) 433.33% 3.000 16.000 - 0.00% -
620.omnetpp_s (unexplained diff vs previous) (percentage) 425.00% 0.080 0.420 - 0.00% -
619.lbm_s (max) 19.67% 854.000 1022.000 - 0.00% -
619.lbm_s (max) (percentage) 15.90% 2.830 3.280 - 0.00% -
623.xalancbmk_s 3.70% 27.000 28.000 - 0.00% -
623.xalancbmk_s (avg) 3.70% 27.000 28.000 - 0.00% -
619.lbm_s 2.42% 1817.000 1861.000 - 0.00% -
619.lbm_s (avg) 2.42% 1817.000 1861.000 - 0.00% -
526.blender_r 1.67% 60.000 61.000 - 0.00% -
526.blender_r (avg) 1.67% 60.000 61.000 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
607.cactuBSSN_s -4.94% 4577.000 4351.000 - 4.27% -
638.imagick_s -2.59% 3354.000 3267.000 - 0.83% -
644.nab_s -2.13% 11863.000 11610.000 - -0.91% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
625.x264_s (max) (percentage) -8.33% 0.240 0.220 - 0.00% -
508.namd_r (max) (percentage) -7.32% 0.820 0.760 - 0.00% -
605.mcf_s (max) -6.77% 266.000 248.000 - 0.00% -
631.deepsjeng_s (max) -6.67% 15.000 14.000 - 0.00% -
605.mcf_s (max) (percentage) -6.21% 4.190 3.930 - 0.00% -
607.cactuBSSN_s (max) -6.15% 65.000 61.000 - 0.00% -
623.xalancbmk_s (max) (percentage) -5.56% 1.260 1.190 - 0.00% -
607.cactuBSSN_s -5.13% 78.000 74.000 - 0.00% -
607.cactuBSSN_s (avg) -5.13% 78.000 74.000 - 0.00% -
508.namd_r (max) -5.00% 20.000 19.000 - 0.00% -
638.imagick_s (max) -5.00% 60.000 57.000 - 0.00% -
620.omnetpp_s (max) -4.92% 61.000 58.000 - 0.00% -
603.bwaves_s (max) (percentage) -4.79% 1.880 1.790 - 0.00% -
620.omnetpp_s (max) (percentage) -4.38% 1.600 1.530 - 0.00% -
649.fotonik3d_s (max) (percentage) -4.21% 2.610 2.500 - 0.00% -
644.nab_s (max) -3.97% 126.000 121.000 - 0.00% -
641.leela_s (max) (percentage) -3.30% 0.910 0.880 - 0.00% -
600.perlbench_s (max) (percentage) -3.09% 0.970 0.940 - 0.00% -
641.leela_s (max) -2.78% 36.000 35.000 - 0.00% -
638.imagick_s (max) (percentage) -2.76% 1.810 1.760 - 0.00% -
631.deepsjeng_s (max) (percentage) -2.63% 0.380 0.370 - 0.00% -
510.parest_r (max) (percentage) -2.33% 0.430 0.420 - 0.00% -
638.imagick_s -2.22% 45.000 44.000 - 0.00% -
638.imagick_s (avg) -2.22% 45.000 44.000 - 0.00% -
607.cactuBSSN_s (max) (percentage) -2.08% 1.440 1.410 - 0.00% -
526.blender_r (max) -1.92% 52.000 51.000 - 0.00% -
644.nab_s (max) (percentage) -1.87% 1.070 1.050 - 0.00% -
620.omnetpp_s -1.85% 54.000 53.000 - 0.00% -
620.omnetpp_s (avg) -1.85% 54.000 53.000 - 0.00% -
511.povray_r (max) (percentage) -1.68% 2.970 2.920 - 0.00% -
526.blender_r (max) (percentage) -1.64% 0.610 0.600 - 0.00% -
620.omnetpp_s (avg) (percentage) -1.40% 1.430 1.410 - 0.00% -
644.nab_s -1.23% 81.000 80.000 - 0.00% -
644.nab_s (avg) -1.23% 81.000 80.000 - 0.00% -

Added Tests - sample variability
619.lbm_s (unexplained diff vs previous)
619.lbm_s (unexplained diff vs previous) (percentage)
621.wrf_s (avg) (percentage)
621.wrf_s (max) (percentage)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
508.namd_r 4.65% 607655.000 635935.000 - 0.06% -
510.parest_r 2.92% 9174001.000 9441840.000 - -0.00% -
602.gcc_s 2.85% 9686862.000 9962779.000 - 0.03% -
623.xalancbmk_s 1.29% 4853153.000 4915745.000 - 0.01% -
641.leela_s 1.03% 153985.000 155575.000 - -0.43% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
526.blender_r 5.10% 8183.000 8600.000 - 0.66% -
607.cactuBSSN_s 4.27% 4173.000 4351.000 - -4.94% -
619.lbm_s 2.62% 30384.000 31181.000 - 3.28% -
508.namd_r 2.52% 2460.000 2522.000 - -0.12% -
605.mcf_s 1.67% 6223.000 6327.000 - -0.53% -
510.parest_r 1.08% 5288.000 5345.000 - 0.00% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -19.05% 21.000 17.000 - 0.00% -
nb_execution_successful -15.00% 20.000 17.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
619.lbm_s -1.95% 18491.000 18131.000 - 0.00% -
605.mcf_s -1.56% 28401.000 27957.000 - -0.04% -
625.x264_s -1.32% 561864.000 554423.000 - 0.11% -
607.cactuBSSN_s -1.24% 3910049.000 3861457.000 - 0.74% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
511.povray_r -7.14% 462.000 429.000 - 0.23% -
625.x264_s -4.37% 1463.000 1399.000 - -0.78% -
641.leela_s -2.67% 4115.000 4005.000 - -0.37% -
631.deepsjeng_s -2.06% 4033.000 3950.000 - -0.45% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 29.17% 24.000 31.000 - 0.00% -

Added Tests - sample variability
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
600.perlbench_s
600.perlbench_s (avg)
600.perlbench_s (avg) (percentage)
600.perlbench_s (max)
600.perlbench_s (max) (percentage)
603.bwaves_s (avg) (percentage)
603.bwaves_s (max) (percentage)
605.mcf_s
605.mcf_s (avg)
605.mcf_s (avg) (percentage)
605.mcf_s (max)
605.mcf_s (max) (percentage)
607.cactuBSSN_s
607.cactuBSSN_s (avg)
607.cactuBSSN_s (avg) (percentage)
607.cactuBSSN_s (max)
607.cactuBSSN_s (max) (percentage)
619.lbm_s
619.lbm_s (avg)
619.lbm_s (avg) (percentage)
619.lbm_s (max)
619.lbm_s (max) (percentage)
620.omnetpp_s
620.omnetpp_s (avg)
620.omnetpp_s (avg) (percentage)
620.omnetpp_s (max)
620.omnetpp_s (max) (percentage)
621.wrf_s (avg) (percentage)
621.wrf_s (max) (percentage)
623.xalancbmk_s
623.xalancbmk_s (avg)
623.xalancbmk_s (avg) (percentage)
623.xalancbmk_s (max)
623.xalancbmk_s (max) (percentage)
625.x264_s
625.x264_s (avg)
625.x264_s (avg) (percentage)
625.x264_s (max)
625.x264_s (max) (percentage)
631.deepsjeng_s
631.deepsjeng_s (avg)
631.deepsjeng_s (avg) (percentage)
631.deepsjeng_s (max)
631.deepsjeng_s (max) (percentage)
638.imagick_s
638.imagick_s (avg)
638.imagick_s (avg) (percentage)
638.imagick_s (max)
638.imagick_s (max) (percentage)
641.leela_s
641.leela_s (avg)
641.leela_s (avg) (percentage)
641.leela_s (max)
641.leela_s (max) (percentage)
644.nab_s
644.nab_s (avg)
644.nab_s (avg) (percentage)
644.nab_s (max)
644.nab_s (max) (percentage)
648.exchange2_s (avg) (percentage)
648.exchange2_s (max) (percentage)
649.fotonik3d_s (avg) (percentage)
649.fotonik3d_s (max) (percentage)
654.roms_s (avg) (percentage)
654.roms_s (max) (percentage)
657.xz_s
657.xz_s (avg)
657.xz_s (avg) (percentage)
657.xz_s (max)
657.xz_s (max) (percentage)


Report Time: 0.23s
Name Current %
508.namd_r 2522.000 -
510.parest_r 5345.000 -
511.povray_r 429.000 -
526.blender_r 8600.000 -
600.perlbench_s 2566.000 -
602.gcc_s 4179.000 -
605.mcf_s 6327.000 -
607.cactuBSSN_s 4351.000 -4.94%
619.lbm_s 31181.000 3.28%
620.omnetpp_s 3812.000 -
623.xalancbmk_s 4042.000 4.44%
625.x264_s 1399.000 -
631.deepsjeng_s 3950.000 -
638.imagick_s 3267.000 -2.59%
641.leela_s 4005.000 -
644.nab_s 11610.000 -2.13%
657.xz_s 2243.000 1.13%
Geometric Mean 3939.891 -
Name Current %
508.namd_r 635935.000 -
510.parest_r 9441840.000 -
511.povray_r 972298.000 -
526.blender_r 14407203.000 -
600.perlbench_s 2268458.000 -
602.gcc_s 9962779.000 -
605.mcf_s 27957.000 -
607.cactuBSSN_s 3861457.000 -
619.lbm_s 18131.000 -
620.omnetpp_s 2238867.000 -
623.xalancbmk_s 4915745.000 -
625.x264_s 554423.000 -
631.deepsjeng_s 90620.000 -
638.imagick_s 1905540.000 -
641.leela_s 155575.000 -
644.nab_s 210339.000 -
657.xz_s 193675.000 -
Geometric Mean 804643.256 -
Name Current %
508.namd_r 20.000 -
508.namd_r (avg) 20.000 -
508.namd_r (avg) (percentage) 0.810 -
508.namd_r (max) 19.000 -5.00%
508.namd_r (max) (percentage) 0.760 -7.32%
510.parest_r 49.000 -
510.parest_r (avg) 49.000 -
510.parest_r (avg) (percentage) 0.930 -
510.parest_r (max) 22.000 -
510.parest_r (max) (percentage) 0.420 -2.33%
511.povray_r 5.000 -
511.povray_r (avg) 5.000 -
511.povray_r (avg) (percentage) 1.300 -
511.povray_r (max) 12.000 -
511.povray_r (max) (percentage) 2.920 -1.68%
526.blender_r 61.000 1.67%
526.blender_r (avg) 61.000 1.67%
526.blender_r (avg) (percentage) 0.710 -
526.blender_r (max) 51.000 -1.92%
526.blender_r (max) (percentage) 0.600 -1.64%
600.perlbench_s 35.000 -
600.perlbench_s (avg) 35.000 -
600.perlbench_s (avg) (percentage) 1.370 -
600.perlbench_s (max) 24.000 -
600.perlbench_s (max) (percentage) 0.940 -3.09%
603.bwaves_s (avg) (percentage) 1.860 -
603.bwaves_s (max) (percentage) 1.790 -4.79%
605.mcf_s 106.000 -
605.mcf_s (avg) 106.000 -
605.mcf_s (avg) (percentage) 1.680 -
605.mcf_s (max) 248.000 -6.77%
605.mcf_s (max) (percentage) 3.930 -6.21%
607.cactuBSSN_s 74.000 -5.13%
607.cactuBSSN_s (avg) 74.000 -5.13%
607.cactuBSSN_s (avg) (percentage) 1.710 -
607.cactuBSSN_s (max) 61.000 -6.15%
607.cactuBSSN_s (max) (percentage) 1.410 -2.08%
619.lbm_s 1861.000 2.42%
619.lbm_s (avg) 1861.000 2.42%
619.lbm_s (avg) (percentage) 5.970 -
619.lbm_s (max) 1022.000 19.67%
619.lbm_s (max) (percentage) 3.280 15.90%
619.lbm_s (unexplained diff vs previous) 991.000 -
619.lbm_s (unexplained diff vs previous) (percentage) 3.180 -
620.omnetpp_s 53.000 -1.85%
620.omnetpp_s (avg) 53.000 -1.85%
620.omnetpp_s (avg) (percentage) 1.410 -1.40%
620.omnetpp_s (max) 58.000 -4.92%
620.omnetpp_s (max) (percentage) 1.530 -4.38%
620.omnetpp_s (unexplained diff vs previous) 16.000 433.33%
620.omnetpp_s (unexplained diff vs previous) (percentage) 0.420 425.00%
621.wrf_s (avg) (percentage) 0.000 -
621.wrf_s (max) (percentage) 0.000 -
623.xalancbmk_s 28.000 3.70%
623.xalancbmk_s (avg) 28.000 3.70%
623.xalancbmk_s (avg) (percentage) 0.710 -
623.xalancbmk_s (max) 48.000 -
623.xalancbmk_s (max) (percentage) 1.190 -5.56%
625.x264_s 11.000 -
625.x264_s (avg) 11.000 -
625.x264_s (avg) (percentage) 0.810 -
625.x264_s (max) 3.000 -
625.x264_s (max) (percentage) 0.220 -8.33%
631.deepsjeng_s 19.000 -
631.deepsjeng_s (avg) 19.000 -
631.deepsjeng_s (avg) (percentage) 0.490 -
631.deepsjeng_s (max) 14.000 -6.67%
631.deepsjeng_s (max) (percentage) 0.370 -2.63%
638.imagick_s 44.000 -2.22%
638.imagick_s (avg) 44.000 -2.22%
638.imagick_s (avg) (percentage) 1.360 -
638.imagick_s (max) 57.000 -5.00%
638.imagick_s (max) (percentage) 1.760 -2.76%
641.leela_s 18.000 -
641.leela_s (avg) 18.000 -
641.leela_s (avg) (percentage) 0.470 -
641.leela_s (max) 35.000 -2.78%
641.leela_s (max) (percentage) 0.880 -3.30%
644.nab_s 80.000 -1.23%
644.nab_s (avg) 80.000 -1.23%
644.nab_s (avg) (percentage) 0.690 -
644.nab_s (max) 121.000 -3.97%
644.nab_s (max) (percentage) 1.050 -1.87%
648.exchange2_s (avg) (percentage) 0.260 -
648.exchange2_s (max) (percentage) 0.150 -
649.fotonik3d_s (avg) (percentage) 0.980 -
649.fotonik3d_s (max) (percentage) 2.500 -4.21%
654.roms_s (avg) (percentage) 0.630 -
654.roms_s (max) (percentage) 0.600 -
657.xz_s 42.000 -
657.xz_s (avg) 42.000 -
657.xz_s (avg) (percentage) 1.900 -
657.xz_s (max) 20.000 -
657.xz_s (max) (percentage) 0.910 -
Geometric Mean 6.186 -15.50%