Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/5f69d680e2cc94dcb30a7f29e8144725530a6da4 (+ 450 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-cpu2017fast--llvm-aarch64-master-Os_LTO-build/300/
Filter

llvm-aarch64-master-Os_LTO test results

Run Order Start Time Duration
Current 0300 (llvmorg-21-init-15960-g5f69d680e2cc) 2025-06-15T20:55:16 0:00:00
Previous 0299 (llvmorg-21-init-15510-g489dcc9e5233) 2025-06-12T18:19:50 0:00:00
Baseline 0001 (llvmorg-17-init-03361-gd77f96a9e0c8) 2023-02-27T23:41:40 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 6 4
Performance Improvements 52 15
Added Tests 0 82
Unchanged Tests 692 649
Total Tests 750

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
638.imagick_s 1.56% 3142.000 3191.000 - -2.06% -
623.xalancbmk_s 1.27% 3546.000 3591.000 - -0.83% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
623.xalancbmk_s 2.44% 41.000 42.000 - 0.00% -
623.xalancbmk_s (avg) 2.44% 41.000 42.000 - 0.00% -
510.parest_r 1.37% 73.000 74.000 - 0.00% -
510.parest_r (avg) 1.37% 73.000 74.000 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
619.lbm_s -1.72% 31354.000 30814.000 - -0.79% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
619.lbm_s (unexplained diff vs previous) -95.36% 11649.000 540.000 - 0.00% -
619.lbm_s (unexplained diff vs previous) (percentage) -95.29% 37.150 1.750 - 0.00% -
508.namd_r (unexplained diff vs previous) -94.38% 89.000 5.000 - 0.00% -
508.namd_r (unexplained diff vs previous) (percentage) -94.33% 3.530 0.200 - 0.00% -
620.omnetpp_s (unexplained diff vs previous) -93.46% 321.000 21.000 - 0.00% -
620.omnetpp_s (unexplained diff vs previous) (percentage) -93.40% 8.490 0.560 - 0.00% -
625.x264_s (unexplained diff vs previous) (percentage) -88.93% 5.060 0.560 - 0.00% -
625.x264_s (unexplained diff vs previous) -88.81% 134.000 15.000 - 0.00% -
641.leela_s (unexplained diff vs previous) (percentage) -88.04% 2.090 0.250 - 0.00% -
641.leela_s (unexplained diff vs previous) -87.95% 83.000 10.000 - 0.00% -
605.mcf_s (unexplained diff vs previous) (percentage) -87.10% 5.350 0.690 - 0.00% -
605.mcf_s (unexplained diff vs previous) -87.05% 332.000 43.000 - 0.00% -
657.xz_s (unexplained diff vs previous) -77.17% 92.000 21.000 - 0.00% -
657.xz_s (unexplained diff vs previous) (percentage) -76.92% 4.030 0.930 - 0.00% -
641.leela_s (max) -17.28% 81.000 67.000 - 0.00% -
605.mcf_s (max) (percentage) -16.73% 5.080 4.230 - 0.00% -
641.leela_s (max) (percentage) -16.67% 2.040 1.700 - 0.00% -
605.mcf_s (max) -16.19% 315.000 264.000 - 0.00% -
619.lbm_s (max) -12.63% 9625.000 8409.000 - 0.00% -
619.lbm_s (max) (percentage) -11.11% 30.700 27.290 - 0.00% -
657.xz_s (max) -8.33% 96.000 88.000 - 0.00% -
625.x264_s (max) (percentage) -8.30% 4.820 4.420 - 0.00% -
620.omnetpp_s (max) -7.99% 363.000 334.000 - 0.00% -
625.x264_s (max) -7.87% 127.000 117.000 - 0.00% -
620.omnetpp_s (max) (percentage) -7.39% 9.610 8.900 - 0.00% -
657.xz_s (max) (percentage) -7.36% 4.210 3.900 - 0.00% -
508.namd_r (max) (percentage) -6.16% 3.410 3.200 - 0.00% -
508.namd_r (max) -5.88% 85.000 80.000 - 0.00% -
631.deepsjeng_s (max) -5.88% 102.000 96.000 - 0.00% -
631.deepsjeng_s (max) (percentage) -5.69% 2.990 2.820 - 0.00% -
644.nab_s (max) (percentage) -3.92% 1.530 1.470 - 0.00% -
641.leela_s -3.57% 28.000 27.000 - 0.00% -
641.leela_s (avg) -3.57% 28.000 27.000 - 0.00% -
644.nab_s (max) -3.51% 171.000 165.000 - 0.00% -
511.povray_r (max) (percentage) -3.09% 1.620 1.570 - 0.00% -
526.blender_r (max) -2.90% 69.000 67.000 - 0.00% -
619.lbm_s -2.72% 2724.000 2650.000 - 0.00% -
619.lbm_s (avg) -2.72% 2724.000 2650.000 - 0.00% -
657.xz_s -2.56% 39.000 38.000 - 0.00% -
657.xz_s (avg) -2.56% 39.000 38.000 - 0.00% -
628.pop2_s (max) (percentage) -1.89% 0.530 0.520 - 0.00% -
510.parest_r (max) (percentage) -1.84% 5.430 5.330 - 0.00% -
638.imagick_s (max) (percentage) -1.81% 3.860 3.790 - 0.00% -
623.xalancbmk_s (max) (percentage) -1.67% 2.390 2.350 - 0.00% -
641.leela_s (avg) (percentage) -1.41% 0.710 0.700 - 0.00% -
526.blender_r (max) (percentage) -1.28% 0.780 0.770 - 0.00% -
605.mcf_s (avg) (percentage) -1.23% 1.620 1.600 - 0.00% -
619.lbm_s (avg) (percentage) -1.04% 8.690 8.600 - 0.00% -
620.omnetpp_s -1.01% 99.000 98.000 - 0.00% -
620.omnetpp_s (avg) -1.01% 99.000 98.000 - 0.00% -
510.parest_r (max) -1.00% 299.000 296.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
508.namd_r 2.78% 2445.000 2513.000 - -0.20% -
526.blender_r 2.27% 8579.000 8774.000 - -0.89% -
644.nab_s 1.31% 11109.000 11254.000 - 0.38% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_execution_successful -6.25% 16.000 15.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
631.deepsjeng_s -6.05% 60687.000 57018.000 - -0.10% -
641.leela_s -4.05% 71474.000 68581.000 - 0.00% -
605.mcf_s -3.29% 15336.000 14832.000 - 0.00% -
619.lbm_s -2.87% 13938.000 13538.000 - 0.00% -
508.namd_r -2.14% 376399.000 368332.000 - 0.00% -
644.nab_s -2.08% 84129.000 82375.000 - -0.03% -
638.imagick_s -1.91% 1169552.000 1147266.000 - -0.13% -
511.povray_r -1.26% 740092.000 730762.000 - -0.06% -
657.xz_s -1.03% 111043.000 109895.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
511.povray_r -7.96% 452.000 416.000 - -0.48% -
631.deepsjeng_s -4.45% 3596.000 3436.000 - -0.06% -
638.imagick_s -2.06% 3258.000 3191.000 - 1.56% -
657.xz_s -1.18% 2287.000 2260.000 - -0.92% -
602.gcc_s -1.17% 4203.000 4154.000 - -0.07% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 33.33% 24.000 32.000 - 0.00% -

Added Tests - sample variability
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
600.perlbench_s (avg) (percentage)
600.perlbench_s (max) (percentage)
603.bwaves_s (avg) (percentage)
603.bwaves_s (max) (percentage)
605.mcf_s
605.mcf_s (avg)
605.mcf_s (avg) (percentage)
605.mcf_s (max)
605.mcf_s (max) (percentage)
619.lbm_s
619.lbm_s (avg)
619.lbm_s (avg) (percentage)
619.lbm_s (max)
619.lbm_s (max) (percentage)
620.omnetpp_s
620.omnetpp_s (avg)
620.omnetpp_s (avg) (percentage)
620.omnetpp_s (max)
620.omnetpp_s (max) (percentage)
623.xalancbmk_s
623.xalancbmk_s (avg)
623.xalancbmk_s (avg) (percentage)
623.xalancbmk_s (max)
623.xalancbmk_s (max) (percentage)
625.x264_s
625.x264_s (avg)
625.x264_s (avg) (percentage)
625.x264_s (max)
625.x264_s (max) (percentage)
628.pop2_s (avg) (percentage)
628.pop2_s (max) (percentage)
631.deepsjeng_s
631.deepsjeng_s (avg)
631.deepsjeng_s (avg) (percentage)
631.deepsjeng_s (max)
631.deepsjeng_s (max) (percentage)
638.imagick_s
638.imagick_s (avg)
638.imagick_s (avg) (percentage)
638.imagick_s (max)
638.imagick_s (max) (percentage)
641.leela_s
641.leela_s (avg)
641.leela_s (avg) (percentage)
641.leela_s (max)
641.leela_s (max) (percentage)
644.nab_s
644.nab_s (avg)
644.nab_s (avg) (percentage)
644.nab_s (max)
644.nab_s (max) (percentage)
648.exchange2_s (avg) (percentage)
648.exchange2_s (max) (percentage)
649.fotonik3d_s (avg) (percentage)
649.fotonik3d_s (max) (percentage)
654.roms_s (avg) (percentage)
654.roms_s (max) (percentage)
657.xz_s
657.xz_s (avg)
657.xz_s (avg) (percentage)
657.xz_s (max)
657.xz_s (max) (percentage)


Report Time: 0.35s
Name Current %
508.namd_r 2513.000 -
510.parest_r 5565.000 -
511.povray_r 416.000 -
526.blender_r 8774.000 -
602.gcc_s 4154.000 -
605.mcf_s 6251.000 -
619.lbm_s 30814.000 -1.72%
620.omnetpp_s 3761.000 -
623.xalancbmk_s 3591.000 1.27%
625.x264_s 2663.000 -
631.deepsjeng_s 3436.000 -
638.imagick_s 3191.000 1.56%
641.leela_s 3988.000 -
644.nab_s 11254.000 -
657.xz_s 2260.000 -
Geometric Mean 4113.488 -
Name Current %
508.namd_r 368332.000 -
510.parest_r 1474273.000 -
511.povray_r 730762.000 -
526.blender_r 11501189.000 -
602.gcc_s 7888855.000 -
605.mcf_s 14832.000 -
619.lbm_s 13538.000 -
620.omnetpp_s 1664149.000 -
623.xalancbmk_s 3230407.000 -
625.x264_s 405375.000 -
631.deepsjeng_s 57018.000 -
638.imagick_s 1147266.000 -
641.leela_s 68581.000 -
644.nab_s 82375.000 -
657.xz_s 109895.000 -
Geometric Mean 386430.085 -
Name Current %
508.namd_r 28.000 -
508.namd_r (avg) 28.000 -
508.namd_r (avg) (percentage) 1.120 -
508.namd_r (max) 80.000 -5.88%
508.namd_r (max) (percentage) 3.200 -6.16%
508.namd_r (unexplained diff vs previous) 5.000 -94.38%
508.namd_r (unexplained diff vs previous) (percentage) 0.200 -94.33%
510.parest_r 74.000 1.37%
510.parest_r (avg) 74.000 1.37%
510.parest_r (avg) (percentage) 1.340 -
510.parest_r (max) 296.000 -1.00%
510.parest_r (max) (percentage) 5.330 -1.84%
511.povray_r 4.000 -
511.povray_r (avg) 4.000 -
511.povray_r (avg) (percentage) 1.160 -
511.povray_r (max) 6.000 -
511.povray_r (max) (percentage) 1.570 -3.09%
526.blender_r 49.000 -
526.blender_r (avg) 49.000 -
526.blender_r (avg) (percentage) 0.560 -
526.blender_r (max) 67.000 -2.90%
526.blender_r (max) (percentage) 0.770 -1.28%
600.perlbench_s (avg) (percentage) 1.290 -
600.perlbench_s (max) (percentage) 0.990 -
603.bwaves_s (avg) (percentage) 2.310 -
603.bwaves_s (max) (percentage) 1.110 -
605.mcf_s 100.000 -
605.mcf_s (avg) 100.000 -
605.mcf_s (avg) (percentage) 1.600 -1.23%
605.mcf_s (max) 264.000 -16.19%
605.mcf_s (max) (percentage) 4.230 -16.73%
605.mcf_s (unexplained diff vs previous) 43.000 -87.05%
605.mcf_s (unexplained diff vs previous) (percentage) 0.690 -87.10%
619.lbm_s 2650.000 -2.72%
619.lbm_s (avg) 2650.000 -2.72%
619.lbm_s (avg) (percentage) 8.600 -1.04%
619.lbm_s (max) 8409.000 -12.63%
619.lbm_s (max) (percentage) 27.290 -11.11%
619.lbm_s (unexplained diff vs previous) 540.000 -95.36%
619.lbm_s (unexplained diff vs previous) (percentage) 1.750 -95.29%
620.omnetpp_s 98.000 -1.01%
620.omnetpp_s (avg) 98.000 -1.01%
620.omnetpp_s (avg) (percentage) 2.610 -
620.omnetpp_s (max) 334.000 -7.99%
620.omnetpp_s (max) (percentage) 8.900 -7.39%
620.omnetpp_s (unexplained diff vs previous) 21.000 -93.46%
620.omnetpp_s (unexplained diff vs previous) (percentage) 0.560 -93.40%
623.xalancbmk_s 42.000 2.44%
623.xalancbmk_s (avg) 42.000 2.44%
623.xalancbmk_s (avg) (percentage) 1.180 -
623.xalancbmk_s (max) 84.000 -
623.xalancbmk_s (max) (percentage) 2.350 -1.67%
625.x264_s 35.000 -
625.x264_s (avg) 35.000 -
625.x264_s (avg) (percentage) 1.330 -
625.x264_s (max) 117.000 -7.87%
625.x264_s (max) (percentage) 4.420 -8.30%
625.x264_s (unexplained diff vs previous) 15.000 -88.81%
625.x264_s (unexplained diff vs previous) (percentage) 0.560 -88.93%
628.pop2_s (avg) (percentage) 0.400 -
628.pop2_s (max) (percentage) 0.520 -1.89%
631.deepsjeng_s 36.000 -
631.deepsjeng_s (avg) 36.000 -
631.deepsjeng_s (avg) (percentage) 1.070 -
631.deepsjeng_s (max) 96.000 -5.88%
631.deepsjeng_s (max) (percentage) 2.820 -5.69%
638.imagick_s 53.000 -
638.imagick_s (avg) 53.000 -
638.imagick_s (avg) (percentage) 1.690 -
638.imagick_s (max) 120.000 -
638.imagick_s (max) (percentage) 3.790 -1.81%
641.leela_s 27.000 -3.57%
641.leela_s (avg) 27.000 -3.57%
641.leela_s (avg) (percentage) 0.700 -1.41%
641.leela_s (max) 67.000 -17.28%
641.leela_s (max) (percentage) 1.700 -16.67%
641.leela_s (unexplained diff vs previous) 10.000 -87.95%
641.leela_s (unexplained diff vs previous) (percentage) 0.250 -88.04%
644.nab_s 86.000 -
644.nab_s (avg) 86.000 -
644.nab_s (avg) (percentage) 0.770 -
644.nab_s (max) 165.000 -3.51%
644.nab_s (max) (percentage) 1.470 -3.92%
648.exchange2_s (avg) (percentage) 0.310 -
648.exchange2_s (max) (percentage) 0.540 -
649.fotonik3d_s (avg) (percentage) 3.320 -
649.fotonik3d_s (max) (percentage) 1.250 -
654.roms_s (avg) (percentage) 2.310 -
654.roms_s (max) (percentage) 1.790 -
657.xz_s 38.000 -2.56%
657.xz_s (avg) 38.000 -2.56%
657.xz_s (avg) (percentage) 1.710 -
657.xz_s (max) 88.000 -8.33%
657.xz_s (max) (percentage) 3.900 -7.36%
657.xz_s (unexplained diff vs previous) 21.000 -77.17%
657.xz_s (unexplained diff vs previous) (percentage) 0.930 -76.92%
Geometric Mean 10.113 -30.66%