Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/07dad4ecba43bcd92453a0cd4c351025126db683 (+ 446 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-cpu2017fast--llvm-aarch64-master-Oz-build/306/
Filter

llvm-aarch64-master-Oz test results

Run Order Start Time Duration
Current 0306 (llvmorg-21-init-15306-g07dad4ecba43) 2025-06-10T01:46:02 0:00:00
Previous 0305 (llvmorg-21-init-14860-geccd81f20ba3) 2025-06-07T00:41:24 0:00:00
Baseline 0140 (llvmorg-19-init-07219-g72e2e4f7dc68) 2024-04-03T16:00:23 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 13 5
Performance Improvements 45 3
Added Tests 0 109
Unchanged Tests 656 597
Total Tests 714

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
638.imagick_s 2.01% 3284.000 3350.000 - 0.00% -
644.nab_s 1.38% 11928.000 12093.000 - 0.00% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
644.nab_s (max) 127.40% 73.000 166.000 - 0.00% -
644.nab_s (unexplained diff vs previous) 122.97% 74.000 165.000 - 0.00% -
644.nab_s (max) (percentage) 122.58% 0.620 1.380 - 0.00% -
644.nab_s (unexplained diff vs previous) (percentage) 119.35% 0.620 1.360 - 0.00% -
657.xz_s (unexplained diff vs previous) 100.00% 2.000 4.000 - 0.00% -
657.xz_s (unexplained diff vs previous) (percentage) 100.00% 0.080 0.160 - 0.00% -
644.nab_s 4.49% 89.000 93.000 - 0.00% -
644.nab_s (avg) 4.49% 89.000 93.000 - 0.00% -
644.nab_s (avg) (percentage) 2.67% 0.750 0.770 - 0.00% -
638.imagick_s 1.79% 56.000 57.000 - 0.00% -
638.imagick_s (avg) 1.79% 56.000 57.000 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
619.lbm_s -1.96% 30575.000 29975.000 - 0.00% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
619.lbm_s (unexplained diff vs previous) -87.05% 4632.000 600.000 - 0.00% -
619.lbm_s (unexplained diff vs previous) (percentage) -86.80% 15.150 2.000 - 0.00% -
511.povray_r (unexplained diff vs previous) -77.78% 9.000 2.000 - 0.00% -
511.povray_r (unexplained diff vs previous) (percentage) -77.60% 1.830 0.410 - 0.00% -
620.omnetpp_s (unexplained diff vs previous) (percentage) -59.05% 1.050 0.430 - 0.00% -
620.omnetpp_s (unexplained diff vs previous) -58.70% 46.000 19.000 - 0.00% -
508.namd_r (unexplained diff vs previous) (percentage) -49.07% 1.080 0.550 - 0.00% -
508.namd_r (unexplained diff vs previous) -48.28% 29.000 15.000 - 0.00% -
620.omnetpp_s (max) -29.06% 117.000 83.000 - 0.00% -
620.omnetpp_s (max) (percentage) -28.46% 2.670 1.910 - 0.00% -
508.namd_r (max) (percentage) -16.81% 1.130 0.940 - 0.00% -
508.namd_r (max) -16.67% 30.000 25.000 - 0.00% -
605.mcf_s (max) (percentage) -12.38% 1.050 0.920 - 0.00% -
605.mcf_s (max) -11.76% 68.000 60.000 - 0.00% -
619.lbm_s (max) -11.72% 4396.000 3881.000 - 0.00% -
511.povray_r (max) -11.11% 9.000 8.000 - 0.00% -
511.povray_r (max) (percentage) -10.16% 1.870 1.680 - 0.00% -
619.lbm_s (max) (percentage) -9.94% 14.380 12.950 - 0.00% -
638.imagick_s (max) (percentage) -6.24% 6.410 6.010 - 0.00% -
641.leela_s (max) (percentage) -5.88% 0.850 0.800 - 0.00% -
625.x264_s (max) (percentage) -5.48% 0.730 0.690 - 0.00% -
641.leela_s (max) -4.55% 44.000 42.000 - 0.00% -
508.namd_r -4.35% 23.000 22.000 - 0.00% -
508.namd_r (avg) -4.35% 23.000 22.000 - 0.00% -
638.imagick_s (max) -4.29% 210.000 201.000 - 0.00% -
631.deepsjeng_s (max) (percentage) -3.91% 1.280 1.230 - 0.00% -
628.pop2_s (max) (percentage) -3.70% 0.270 0.260 - 0.00% -
631.deepsjeng_s (max) -3.57% 56.000 54.000 - 0.00% -
619.lbm_s -3.41% 2519.000 2433.000 - 0.00% -
619.lbm_s (avg) -3.41% 2519.000 2433.000 - 0.00% -
526.blender_r (max) -3.36% 119.000 115.000 - 0.00% -
526.blender_r (max) (percentage) -3.31% 1.210 1.170 - 0.00% -
620.omnetpp_s -2.94% 68.000 66.000 - 0.00% -
620.omnetpp_s (avg) -2.94% 68.000 66.000 - 0.00% -
625.x264_s (max) -2.94% 34.000 33.000 - 0.00% -
657.xz_s (max) (percentage) -2.70% 3.700 3.600 - 0.00% -
511.povray_r (avg) (percentage) -2.68% 1.120 1.090 - 0.00% -
657.xz_s -2.50% 40.000 39.000 - 0.00% -
657.xz_s (avg) -2.50% 40.000 39.000 - 0.00% -
657.xz_s (avg) (percentage) -2.38% 1.680 1.640 - 0.00% -
657.xz_s (max) -2.25% 89.000 87.000 - 0.00% -
619.lbm_s (avg) (percentage) -1.46% 8.240 8.120 - 0.00% -
620.omnetpp_s (avg) (percentage) -1.29% 1.550 1.530 - 0.00% -
508.namd_r (avg) (percentage) -1.16% 0.860 0.850 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
510.parest_r 20.16% 5139.000 6175.000 - 0.15% -
526.blender_r 4.94% 9432.000 9898.000 - 0.26% -
508.namd_r 4.68% 2583.000 2704.000 - 0.56% -
511.povray_r 2.09% 479.000 489.000 - -0.41% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -27.27% 22.000 16.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
508.namd_r -1.52% 423333.000 416918.000 - 0.00% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_execution_successful 275.00% 4.000 15.000 - 0.00% -
nb_total_tests 33.33% 24.000 32.000 - 0.00% -

Added Tests - Code Size
602.gcc_s
605.mcf_s
619.lbm_s
620.omnetpp_s
623.xalancbmk_s
625.x264_s
631.deepsjeng_s
638.imagick_s
641.leela_s
644.nab_s
657.xz_s

Added Tests - Execution
602.gcc_s
605.mcf_s
619.lbm_s
620.omnetpp_s
623.xalancbmk_s
625.x264_s
631.deepsjeng_s
638.imagick_s
641.leela_s
644.nab_s
657.xz_s

Added Tests - sample variability
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
600.perlbench_s (avg) (percentage)
600.perlbench_s (max) (percentage)
603.bwaves_s (avg) (percentage)
603.bwaves_s (max) (percentage)
605.mcf_s
605.mcf_s (avg)
605.mcf_s (avg) (percentage)
605.mcf_s (max)
605.mcf_s (max) (percentage)
619.lbm_s
619.lbm_s (avg)
619.lbm_s (avg) (percentage)
619.lbm_s (max)
619.lbm_s (max) (percentage)
619.lbm_s (unexplained diff vs previous)
619.lbm_s (unexplained diff vs previous) (percentage)
620.omnetpp_s
620.omnetpp_s (avg)
620.omnetpp_s (avg) (percentage)
620.omnetpp_s (max)
620.omnetpp_s (max) (percentage)
620.omnetpp_s (unexplained diff vs previous)
620.omnetpp_s (unexplained diff vs previous) (percentage)
621.wrf_s (avg) (percentage)
621.wrf_s (max) (percentage)
625.x264_s
625.x264_s (avg)
625.x264_s (avg) (percentage)
625.x264_s (max)
625.x264_s (max) (percentage)
628.pop2_s (avg) (percentage)
628.pop2_s (max) (percentage)
631.deepsjeng_s
631.deepsjeng_s (avg)
631.deepsjeng_s (avg) (percentage)
631.deepsjeng_s (max)
631.deepsjeng_s (max) (percentage)
638.imagick_s
638.imagick_s (avg)
638.imagick_s (avg) (percentage)
638.imagick_s (max)
638.imagick_s (max) (percentage)
641.leela_s
641.leela_s (avg)
641.leela_s (avg) (percentage)
641.leela_s (max)
641.leela_s (max) (percentage)
644.nab_s
644.nab_s (avg)
644.nab_s (avg) (percentage)
644.nab_s (max)
644.nab_s (max) (percentage)
644.nab_s (unexplained diff vs previous)
644.nab_s (unexplained diff vs previous) (percentage)
648.exchange2_s (avg) (percentage)
648.exchange2_s (max) (percentage)
649.fotonik3d_s (avg) (percentage)
649.fotonik3d_s (max) (percentage)
654.roms_s (avg) (percentage)
654.roms_s (max) (percentage)
657.xz_s
657.xz_s (avg)
657.xz_s (avg) (percentage)
657.xz_s (max)
657.xz_s (max) (percentage)
657.xz_s (unexplained diff vs previous)
657.xz_s (unexplained diff vs previous) (percentage)


Report Time: 0.23s
Name Current %
508.namd_r 2704.000 -
510.parest_r 6175.000 -
511.povray_r 489.000 -
526.blender_r 9898.000 -
602.gcc_s 5142.000 -
605.mcf_s 6551.000 -
619.lbm_s 29975.000 -1.96%
620.omnetpp_s 4375.000 -
623.xalancbmk_s 5730.000 -
625.x264_s 4783.000 -
631.deepsjeng_s 4451.000 -
638.imagick_s 3350.000 2.01%
641.leela_s 5278.000 -
644.nab_s 12093.000 1.38%
657.xz_s 2434.000 -
Geometric Mean 4901.818 -
Name Current %
508.namd_r 416918.000 -
510.parest_r 5492003.000 -
511.povray_r 735198.000 -
526.blender_r 12057549.000 -
602.gcc_s 7353636.000 -
605.mcf_s 17560.000 -
619.lbm_s 17158.000 -
620.omnetpp_s 1724116.000 -
623.xalancbmk_s 3980121.000 -
625.x264_s 371843.000 -
631.deepsjeng_s 72316.000 -
638.imagick_s 1375312.000 -
641.leela_s 119403.000 -
644.nab_s 153884.000 -
657.xz_s 159716.000 -
Geometric Mean 503110.692 -
Name Current %
508.namd_r 22.000 -4.35%
508.namd_r (avg) 22.000 -4.35%
508.namd_r (avg) (percentage) 0.850 -1.16%
508.namd_r (max) 25.000 -16.67%
508.namd_r (max) (percentage) 0.940 -16.81%
508.namd_r (unexplained diff vs previous) 15.000 -48.28%
508.namd_r (unexplained diff vs previous) (percentage) 0.550 -49.07%
510.parest_r 48.000 -
510.parest_r (avg) 48.000 -
510.parest_r (avg) (percentage) 0.780 -
510.parest_r (max) 70.000 -
510.parest_r (max) (percentage) 1.140 -
511.povray_r 5.000 -
511.povray_r (avg) 5.000 -
511.povray_r (avg) (percentage) 1.090 -2.68%
511.povray_r (max) 8.000 -11.11%
511.povray_r (max) (percentage) 1.680 -10.16%
511.povray_r (unexplained diff vs previous) 2.000 -77.78%
511.povray_r (unexplained diff vs previous) (percentage) 0.410 -77.60%
526.blender_r 57.000 -
526.blender_r (avg) 57.000 -
526.blender_r (avg) (percentage) 0.580 -
526.blender_r (max) 115.000 -3.36%
526.blender_r (max) (percentage) 1.170 -3.31%
600.perlbench_s (avg) (percentage) 1.440 -
600.perlbench_s (max) (percentage) 5.090 -
603.bwaves_s (avg) (percentage) 1.130 -
603.bwaves_s (max) (percentage) 0.540 -
605.mcf_s 57.000 -
605.mcf_s (avg) 57.000 -
605.mcf_s (avg) (percentage) 0.880 -
605.mcf_s (max) 60.000 -11.76%
605.mcf_s (max) (percentage) 0.920 -12.38%
619.lbm_s 2433.000 -3.41%
619.lbm_s (avg) 2433.000 -3.41%
619.lbm_s (avg) (percentage) 8.120 -1.46%
619.lbm_s (max) 3881.000 -11.72%
619.lbm_s (max) (percentage) 12.950 -9.94%
619.lbm_s (unexplained diff vs previous) 600.000 -87.05%
619.lbm_s (unexplained diff vs previous) (percentage) 2.000 -86.80%
620.omnetpp_s 66.000 -2.94%
620.omnetpp_s (avg) 66.000 -2.94%
620.omnetpp_s (avg) (percentage) 1.530 -1.29%
620.omnetpp_s (max) 83.000 -29.06%
620.omnetpp_s (max) (percentage) 1.910 -28.46%
620.omnetpp_s (unexplained diff vs previous) 19.000 -58.70%
620.omnetpp_s (unexplained diff vs previous) (percentage) 0.430 -59.05%
621.wrf_s (avg) (percentage) 0.270 -
621.wrf_s (max) (percentage) 0.200 -
625.x264_s 19.000 -
625.x264_s (avg) 19.000 -
625.x264_s (avg) (percentage) 0.400 -
625.x264_s (max) 33.000 -2.94%
625.x264_s (max) (percentage) 0.690 -5.48%
628.pop2_s (avg) (percentage) 0.260 -
628.pop2_s (max) (percentage) 0.260 -3.70%
631.deepsjeng_s 24.000 -
631.deepsjeng_s (avg) 24.000 -
631.deepsjeng_s (avg) (percentage) 0.550 -
631.deepsjeng_s (max) 54.000 -3.57%
631.deepsjeng_s (max) (percentage) 1.230 -3.91%
638.imagick_s 57.000 1.79%
638.imagick_s (avg) 57.000 1.79%
638.imagick_s (avg) (percentage) 1.710 -
638.imagick_s (max) 201.000 -4.29%
638.imagick_s (max) (percentage) 6.010 -6.24%
641.leela_s 22.000 -
641.leela_s (avg) 22.000 -
641.leela_s (avg) (percentage) 0.430 -
641.leela_s (max) 42.000 -4.55%
641.leela_s (max) (percentage) 0.800 -5.88%
644.nab_s 93.000 4.49%
644.nab_s (avg) 93.000 4.49%
644.nab_s (avg) (percentage) 0.770 2.67%
644.nab_s (max) 166.000 127.40%
644.nab_s (max) (percentage) 1.380 122.58%
644.nab_s (unexplained diff vs previous) 165.000 122.97%
644.nab_s (unexplained diff vs previous) (percentage) 1.360 119.35%
648.exchange2_s (avg) (percentage) 0.230 -
648.exchange2_s (max) (percentage) 0.110 -
649.fotonik3d_s (avg) (percentage) 0.610 -
649.fotonik3d_s (max) (percentage) 3.300 -
654.roms_s (avg) (percentage) 0.270 -
654.roms_s (max) (percentage) 0.170 -
657.xz_s 39.000 -2.50%
657.xz_s (avg) 39.000 -2.50%
657.xz_s (avg) (percentage) 1.640 -2.38%
657.xz_s (max) 87.000 -2.25%
657.xz_s (max) (percentage) 3.600 -2.70%
657.xz_s (unexplained diff vs previous) 4.000 100.00%
657.xz_s (unexplained diff vs previous) (percentage) 0.160 100.00%
Geometric Mean 6.482 -8.56%