Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/74687180dde07312521db09c6f6454fe9d1e5662 (+ 12264 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_vect-cpu2017fast--llvm-aarch64-master-O3_LTO-build/299/
Filter

llvm-aarch64-master-O3_LTO test results

Run Order Start Time Duration
Current 0299 (llvmorg-21-init-15837-g74687180dde0) 2025-04-24T12:43:46 0:00:00
Previous 0298 (no-change) 2025-02-28T19:48:45 0:00:00
Baseline 0168 (llvmorg-20-init-03909-ge61d6066e267) 2024-08-28T19:50:44 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 7 10
Performance Improvements 41 10
Added Tests 3 87
Unchanged Tests 777 721
Total Tests 828

Performance Regressions - Code Size Δ Previous Current σ Δ (B) σ (B)
600.perlbench_s 4.96% 2562862.000 2689894.000 - 5.10% -

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
511.povray_r 1.46% 410.000 416.000 - 0.24% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
619.lbm_s (max) (percentage) 244.07% 4.720 16.240 - 0.00% -
619.lbm_s (max) 188.21% 1697.000 4891.000 - 0.00% -
619.lbm_s (avg) (percentage) 14.47% 3.110 3.560 - 0.00% -
641.leela_s 5.88% 17.000 18.000 - 0.00% -
641.leela_s (avg) 5.88% 17.000 18.000 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
619.lbm_s -16.24% 35963.000 30122.000 - -4.31% -
623.xalancbmk_s -2.69% 3277.000 3189.000 - -1.39% -
607.cactuBSSN_s -2.56% 4525.000 4409.000 - -2.00% -
602.gcc_s -1.57% 4074.000 4010.000 - -0.59% -
631.deepsjeng_s -1.55% 3548.000 3493.000 - -1.19% -
510.parest_r -1.04% 5403.000 5347.000 - -0.43% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
620.omnetpp_s (unexplained diff vs previous) (percentage) -66.96% 1.150 0.380 - 0.00% -
620.omnetpp_s (unexplained diff vs previous) -66.67% 42.000 14.000 - 0.00% -
620.omnetpp_s (max) (percentage) -7.63% 1.180 1.090 - 0.00% -
620.omnetpp_s (max) -6.98% 43.000 40.000 - 0.00% -
623.xalancbmk_s -6.25% 16.000 15.000 - 0.00% -
623.xalancbmk_s (avg) -6.25% 16.000 15.000 - 0.00% -
510.parest_r (max) (percentage) -5.71% 0.700 0.660 - 0.00% -
631.deepsjeng_s (max) (percentage) -5.66% 0.530 0.500 - 0.00% -
631.deepsjeng_s (max) -5.56% 18.000 17.000 - 0.00% -
605.mcf_s (max) (percentage) -5.45% 0.550 0.520 - 0.00% -
510.parest_r (max) -5.41% 37.000 35.000 - 0.00% -
600.perlbench_s (max) -5.26% 19.000 18.000 - 0.00% -
603.bwaves_s (max) (percentage) -4.81% 2.910 2.770 - 0.00% -
641.leela_s (max) -4.76% 21.000 20.000 - 0.00% -
607.cactuBSSN_s (max) -4.65% 86.000 82.000 - 0.00% -
526.blender_r (max) -4.55% 22.000 21.000 - 0.00% -
625.x264_s (max) (percentage) -4.41% 0.680 0.650 - 0.00% -
511.povray_r (max) (percentage) -4.37% 1.830 1.750 - 0.00% -
657.xz_s (max) (percentage) -4.32% 1.620 1.550 - 0.00% -
619.lbm_s -4.11% 1118.000 1072.000 - 0.00% -
619.lbm_s (avg) -4.11% 1118.000 1072.000 - 0.00% -
648.exchange2_s (max) (percentage) -3.85% 0.260 0.250 - 0.00% -
600.perlbench_s (max) (percentage) -3.57% 0.840 0.810 - 0.00% -
607.cactuBSSN_s -3.41% 88.000 85.000 - 0.00% -
607.cactuBSSN_s (avg) -3.41% 88.000 85.000 - 0.00% -
641.leela_s (max) (percentage) -3.13% 0.640 0.620 - 0.00% -
605.mcf_s (max) -3.12% 32.000 31.000 - 0.00% -
620.omnetpp_s (avg) (percentage) -3.03% 0.990 0.960 - 0.00% -
657.xz_s (max) -2.86% 35.000 34.000 - 0.00% -
620.omnetpp_s -2.78% 36.000 35.000 - 0.00% -
620.omnetpp_s (avg) -2.78% 36.000 35.000 - 0.00% -
607.cactuBSSN_s (max) (percentage) -1.57% 1.910 1.880 - 0.00% -
644.nab_s -1.41% 71.000 70.000 - 0.00% -
644.nab_s (avg) -1.41% 71.000 70.000 - 0.00% -
508.namd_r (max) (percentage) -1.33% 0.750 0.740 - 0.00% -

Added Tests - sample variability
619.lbm_s (unexplained diff vs previous)
619.lbm_s (unexplained diff vs previous) (percentage)
654.roms_s (max) (percentage)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
600.perlbench_s 5.10% 2559255.000 2689894.000 - 4.96% -
508.namd_r 2.58% 483631.000 496127.000 - 0.62% -
625.x264_s 1.57% 598688.000 608111.000 - 0.25% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
638.imagick_s 6.09% 3155.000 3347.000 - 0.24% -
657.xz_s 4.49% 2114.000 2209.000 - 0.64% -
600.perlbench_s 4.04% 2253.000 2344.000 - 0.26% -
625.x264_s 3.95% 1367.000 1421.000 - 0.71% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -63.04% 46.000 17.000 - 0.00% -
nb_execution_successful -61.36% 44.000 17.000 - 0.00% -
nb_total_tests -32.61% 46.000 31.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
631.deepsjeng_s -4.69% 87305.000 83213.000 - -0.11% -
641.leela_s -3.47% 91528.000 88351.000 - 0.31% -
511.povray_r -1.49% 1134131.000 1117192.000 - -0.32% -
602.gcc_s -1.26% 11062009.000 10922666.000 - -0.09% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
619.lbm_s -4.31% 31479.000 30122.000 - -16.24% -
607.cactuBSSN_s -2.00% 4499.000 4409.000 - -2.56% -
623.xalancbmk_s -1.39% 3234.000 3189.000 - -2.69% -
631.deepsjeng_s -1.19% 3535.000 3493.000 - -1.55% -
641.leela_s -1.18% 3379.000 3339.000 - 0.24% -
605.mcf_s -1.04% 6031.000 5968.000 - -0.12% -

Added Tests - sample variability
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
600.perlbench_s
600.perlbench_s (avg)
600.perlbench_s (avg) (percentage)
600.perlbench_s (max)
600.perlbench_s (max) (percentage)
603.bwaves_s (avg) (percentage)
603.bwaves_s (max) (percentage)
605.mcf_s
605.mcf_s (avg)
605.mcf_s (avg) (percentage)
605.mcf_s (max)
605.mcf_s (max) (percentage)
607.cactuBSSN_s
607.cactuBSSN_s (avg)
607.cactuBSSN_s (avg) (percentage)
607.cactuBSSN_s (max)
607.cactuBSSN_s (max) (percentage)
619.lbm_s
619.lbm_s (avg)
619.lbm_s (avg) (percentage)
619.lbm_s (max)
619.lbm_s (max) (percentage)
620.omnetpp_s
620.omnetpp_s (avg)
620.omnetpp_s (avg) (percentage)
620.omnetpp_s (max)
620.omnetpp_s (max) (percentage)
623.xalancbmk_s
623.xalancbmk_s (avg)
623.xalancbmk_s (avg) (percentage)
623.xalancbmk_s (max)
623.xalancbmk_s (max) (percentage)
625.x264_s
625.x264_s (avg)
625.x264_s (avg) (percentage)
625.x264_s (max)
625.x264_s (max) (percentage)
631.deepsjeng_s
631.deepsjeng_s (avg)
631.deepsjeng_s (avg) (percentage)
631.deepsjeng_s (max)
631.deepsjeng_s (max) (percentage)
638.imagick_s
638.imagick_s (avg)
638.imagick_s (avg) (percentage)
638.imagick_s (max)
638.imagick_s (max) (percentage)
641.leela_s
641.leela_s (avg)
641.leela_s (avg) (percentage)
641.leela_s (max)
641.leela_s (max) (percentage)
644.nab_s
644.nab_s (avg)
644.nab_s (avg) (percentage)
644.nab_s (max)
644.nab_s (max) (percentage)
648.exchange2_s (avg) (percentage)
648.exchange2_s (max) (percentage)
649.fotonik3d_s (avg) (percentage)
649.fotonik3d_s (max) (percentage)
654.roms_s (max) (percentage)
657.xz_s
657.xz_s (avg)
657.xz_s (avg) (percentage)
657.xz_s (max)
657.xz_s (max) (percentage)


Report Time: 0.24s
Name Current %
508.namd_r 2533.000 -
510.parest_r 5347.000 -1.04%
511.povray_r 416.000 1.46%
526.blender_r 8425.000 -
600.perlbench_s 2344.000 -
602.gcc_s 4010.000 -1.57%
605.mcf_s 5968.000 -
607.cactuBSSN_s 4409.000 -2.56%
619.lbm_s 30122.000 -16.24%
620.omnetpp_s 3674.000 -
623.xalancbmk_s 3189.000 -2.69%
625.x264_s 1421.000 -
631.deepsjeng_s 3493.000 -1.55%
638.imagick_s 3347.000 -
641.leela_s 3339.000 -
644.nab_s 11235.000 -
657.xz_s 2209.000 -
Geometric Mean 3748.811 -1.41%
Name Current %
508.namd_r 496127.000 -
510.parest_r 2042359.000 -
511.povray_r 1117192.000 -
526.blender_r 16350154.000 -
600.perlbench_s 2689894.000 4.96%
602.gcc_s 10922666.000 -
605.mcf_s 22301.000 -
607.cactuBSSN_s 3572108.000 -
619.lbm_s 14047.000 -
620.omnetpp_s 2000942.000 -
623.xalancbmk_s 4110061.000 -
625.x264_s 608111.000 -
631.deepsjeng_s 83213.000 -
638.imagick_s 1441104.000 -
641.leela_s 88351.000 -
644.nab_s 97602.000 -
657.xz_s 139435.000 -
Geometric Mean 634579.707 -
Name Current %
508.namd_r 12.000 -
508.namd_r (avg) 12.000 -
508.namd_r (avg) (percentage) 0.490 -
508.namd_r (max) 18.000 -
508.namd_r (max) (percentage) 0.740 -1.33%
510.parest_r 26.000 -
510.parest_r (avg) 26.000 -
510.parest_r (avg) (percentage) 0.490 -
510.parest_r (max) 35.000 -5.41%
510.parest_r (max) (percentage) 0.660 -5.71%
511.povray_r 4.000 -
511.povray_r (avg) 4.000 -
511.povray_r (avg) (percentage) 1.120 -
511.povray_r (max) 7.000 -
511.povray_r (max) (percentage) 1.750 -4.37%
526.blender_r 36.000 -
526.blender_r (avg) 36.000 -
526.blender_r (avg) (percentage) 0.430 -
526.blender_r (max) 21.000 -4.55%
526.blender_r (max) (percentage) 0.260 -
600.perlbench_s 18.000 -
600.perlbench_s (avg) 18.000 -
600.perlbench_s (avg) (percentage) 0.780 -
600.perlbench_s (max) 18.000 -5.26%
600.perlbench_s (max) (percentage) 0.810 -3.57%
603.bwaves_s (avg) (percentage) 1.500 -
603.bwaves_s (max) (percentage) 2.770 -4.81%
605.mcf_s 51.000 -
605.mcf_s (avg) 51.000 -
605.mcf_s (avg) (percentage) 0.860 -
605.mcf_s (max) 31.000 -3.12%
605.mcf_s (max) (percentage) 0.520 -5.45%
607.cactuBSSN_s 85.000 -3.41%
607.cactuBSSN_s (avg) 85.000 -3.41%
607.cactuBSSN_s (avg) (percentage) 1.950 -
607.cactuBSSN_s (max) 82.000 -4.65%
607.cactuBSSN_s (max) (percentage) 1.880 -1.57%
619.lbm_s 1072.000 -4.11%
619.lbm_s (avg) 1072.000 -4.11%
619.lbm_s (avg) (percentage) 3.560 14.47%
619.lbm_s (max) 4891.000 188.21%
619.lbm_s (max) (percentage) 16.240 244.07%
619.lbm_s (unexplained diff vs previous) 5841.000 -
619.lbm_s (unexplained diff vs previous) (percentage) 19.390 -
620.omnetpp_s 35.000 -2.78%
620.omnetpp_s (avg) 35.000 -2.78%
620.omnetpp_s (avg) (percentage) 0.960 -3.03%
620.omnetpp_s (max) 40.000 -6.98%
620.omnetpp_s (max) (percentage) 1.090 -7.63%
620.omnetpp_s (unexplained diff vs previous) 14.000 -66.67%
620.omnetpp_s (unexplained diff vs previous) (percentage) 0.380 -66.96%
623.xalancbmk_s 15.000 -6.25%
623.xalancbmk_s (avg) 15.000 -6.25%
623.xalancbmk_s (avg) (percentage) 0.490 -
623.xalancbmk_s (max) 12.000 -
623.xalancbmk_s (max) (percentage) 0.380 -
625.x264_s 6.000 -
625.x264_s (avg) 6.000 -
625.x264_s (avg) (percentage) 0.470 -
625.x264_s (max) 9.000 -
625.x264_s (max) (percentage) 0.650 -4.41%
631.deepsjeng_s 14.000 -
631.deepsjeng_s (avg) 14.000 -
631.deepsjeng_s (avg) (percentage) 0.410 -
631.deepsjeng_s (max) 17.000 -5.56%
631.deepsjeng_s (max) (percentage) 0.500 -5.66%
638.imagick_s 21.000 -
638.imagick_s (avg) 21.000 -
638.imagick_s (avg) (percentage) 0.640 -
638.imagick_s (max) 34.000 -
638.imagick_s (max) (percentage) 1.020 -
641.leela_s 18.000 5.88%
641.leela_s (avg) 18.000 5.88%
641.leela_s (avg) (percentage) 0.540 -
641.leela_s (max) 20.000 -4.76%
641.leela_s (max) (percentage) 0.620 -3.13%
644.nab_s 70.000 -1.41%
644.nab_s (avg) 70.000 -1.41%
644.nab_s (avg) (percentage) 0.630 -
644.nab_s (max) 48.000 -
644.nab_s (max) (percentage) 0.430 -
648.exchange2_s (avg) (percentage) 0.180 -
648.exchange2_s (max) (percentage) 0.250 -3.85%
649.fotonik3d_s (avg) (percentage) 0.820 -
649.fotonik3d_s (max) (percentage) 0.470 -
654.roms_s (max) (percentage) 0.000 -
657.xz_s 17.000 -
657.xz_s (avg) 17.000 -
657.xz_s (avg) (percentage) 0.810 -
657.xz_s (max) 34.000 -2.86%
657.xz_s (max) (percentage) 1.550 -4.32%
Geometric Mean 5.554 -4.22%