Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/f0ddadf12cc44bb5baa161bef047e1d8e283c839 (+ 614 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-cpu2017fast--llvm-aarch64-master-Oz-build/299/
Filter

llvm-aarch64-master-Oz test results

Run Order Start Time Duration
Current 0299 (llvmorg-21-init-12790-gf0ddadf12cc4) 2025-05-16T18:44:56 0:00:00
Previous 0297 (llvmorg-21-init-12176-gdc9171afc481) 2025-05-11T10:28:47 0:00:00
Baseline 0140 (llvmorg-19-init-07219-g72e2e4f7dc68) 2024-04-03T16:00:23 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 29 5
Performance Improvements 43 3
Added Tests 2 119
Unchanged Tests 640 587
Total Tests 714

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
619.lbm_s 15.52% 29961.000 34611.000 - 0.00% -
510.parest_r 1.17% 6142.000 6214.000 - 20.92% -
623.xalancbmk_s 1.07% 5793.000 5855.000 - 0.00% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
619.lbm_s (unexplained diff vs previous) 2427.17% 184.000 4650.000 - 0.00% -
619.lbm_s (unexplained diff vs previous) (percentage) 2103.28% 0.610 13.440 - 0.00% -
508.namd_r (unexplained diff vs previous) (percentage) 685.71% 0.070 0.550 - 0.00% -
508.namd_r (unexplained diff vs previous) 650.00% 2.000 15.000 - 0.00% -
619.lbm_s (max) 506.21% 886.000 5371.000 - 0.00% -
619.lbm_s (max) (percentage) 424.32% 2.960 15.520 - 0.00% -
641.leela_s (unexplained diff vs previous) 400.00% 1.000 5.000 - 0.00% -
641.leela_s (unexplained diff vs previous) (percentage) 350.00% 0.020 0.090 - 0.00% -
620.omnetpp_s (unexplained diff vs previous) (percentage) 318.75% 0.160 0.670 - 0.00% -
620.omnetpp_s (unexplained diff vs previous) 314.29% 7.000 29.000 - 0.00% -
657.xz_s (unexplained diff vs previous) 200.00% 4.000 12.000 - 0.00% -
657.xz_s (unexplained diff vs previous) (percentage) 188.24% 0.170 0.490 - 0.00% -
510.parest_r (unexplained diff vs previous) 188.00% 25.000 72.000 - 0.00% -
510.parest_r (unexplained diff vs previous) (percentage) 182.93% 0.410 1.160 - 0.00% -
638.imagick_s (unexplained diff vs previous) 88.89% 9.000 17.000 - 0.00% -
638.imagick_s (unexplained diff vs previous) (percentage) 88.89% 0.270 0.510 - 0.00% -
644.nab_s (unexplained diff vs previous) (percentage) 61.36% 0.440 0.710 - 0.00% -
644.nab_s (unexplained diff vs previous) 60.38% 53.000 85.000 - 0.00% -
631.deepsjeng_s (unexplained diff vs previous) (percentage) 23.08% 0.130 0.160 - 0.00% -
619.lbm_s 18.41% 2151.000 2547.000 - 0.00% -
619.lbm_s (avg) 18.41% 2151.000 2547.000 - 0.00% -
631.deepsjeng_s (unexplained diff vs previous) 16.67% 6.000 7.000 - 0.00% -
510.parest_r 4.76% 42.000 44.000 - 0.00% -
510.parest_r (avg) 4.76% 42.000 44.000 - 0.00% -
619.lbm_s (avg) (percentage) 2.51% 7.180 7.360 - 0.00% -
510.parest_r (avg) (percentage) 1.43% 0.700 0.710 - 0.00% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
605.mcf_s (unexplained diff vs previous) -78.26% 23.000 5.000 - 0.00% -
605.mcf_s (unexplained diff vs previous) (percentage) -77.14% 0.350 0.080 - 0.00% -
625.x264_s (max) -48.89% 45.000 23.000 - 0.00% -
625.x264_s (max) (percentage) -48.42% 0.950 0.490 - 0.00% -
638.imagick_s (max) (percentage) -11.01% 2.180 1.940 - 0.00% -
641.leela_s (max) (percentage) -10.81% 0.370 0.330 - 0.00% -
641.leela_s (max) -10.53% 19.000 17.000 - 0.00% -
638.imagick_s (max) -9.72% 72.000 65.000 - 0.00% -
605.mcf_s (max) (percentage) -9.30% 0.860 0.780 - 0.00% -
605.mcf_s (max) -8.93% 56.000 51.000 - 0.00% -
644.nab_s (max) -4.72% 127.000 121.000 - 0.00% -
620.omnetpp_s (max) (percentage) -4.69% 1.920 1.830 - 0.00% -
621.wrf_s (max) (percentage) -4.35% 0.230 0.220 - 0.00% -
508.namd_r -4.35% 23.000 22.000 - 0.00% -
508.namd_r (avg) -4.35% 23.000 22.000 - 0.00% -
508.namd_r (max) (percentage) -3.96% 1.010 0.970 - 0.00% -
644.nab_s (max) (percentage) -3.77% 1.060 1.020 - 0.00% -
508.namd_r (max) -3.70% 27.000 26.000 - 0.00% -
631.deepsjeng_s (max) -3.70% 27.000 26.000 - 0.00% -
620.omnetpp_s (max) -3.66% 82.000 79.000 - 0.00% -
631.deepsjeng_s (max) (percentage) -3.23% 0.620 0.600 - 0.00% -
511.povray_r (max) (percentage) -3.14% 2.870 2.780 - 0.00% -
625.x264_s (avg) (percentage) -2.56% 0.390 0.380 - 0.00% -
510.parest_r (max) (percentage) -2.53% 3.160 3.080 - 0.00% -
638.imagick_s (avg) (percentage) -2.44% 1.640 1.600 - 0.00% -
605.mcf_s (avg) (percentage) -2.25% 0.890 0.870 - 0.00% -
526.blender_r (max) -2.13% 141.000 138.000 - 0.00% -
526.blender_r (max) (percentage) -2.08% 1.440 1.410 - 0.00% -
638.imagick_s -1.85% 54.000 53.000 - 0.00% -
638.imagick_s (avg) -1.85% 54.000 53.000 - 0.00% -
631.deepsjeng_s (avg) (percentage) -1.82% 0.550 0.540 - 0.00% -
657.xz_s (avg) (percentage) -1.74% 1.720 1.690 - 0.00% -
605.mcf_s -1.72% 58.000 57.000 - 0.00% -
605.mcf_s (avg) -1.72% 58.000 57.000 - 0.00% -
603.bwaves_s (max) (percentage) -1.69% 0.590 0.580 - 0.00% -
510.parest_r (max) -1.55% 194.000 191.000 - 0.00% -
620.omnetpp_s -1.49% 67.000 66.000 - 0.00% -
620.omnetpp_s (avg) -1.49% 67.000 66.000 - 0.00% -
620.omnetpp_s (avg) (percentage) -1.28% 1.560 1.540 - 0.00% -
508.namd_r (avg) (percentage) -1.18% 0.850 0.840 - 0.00% -
649.fotonik3d_s (max) (percentage) -1.14% 3.520 3.480 - 0.00% -
644.nab_s -1.08% 93.000 92.000 - 0.00% -
644.nab_s (avg) -1.08% 93.000 92.000 - 0.00% -

Added Tests - sample variability
625.x264_s (unexplained diff vs previous)
625.x264_s (unexplained diff vs previous) (percentage)

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
510.parest_r 20.92% 5139.000 6214.000 - 1.17% -
508.namd_r 5.61% 2583.000 2728.000 - 0.55% -
526.blender_r 4.25% 9432.000 9833.000 - 0.02% -
511.povray_r 2.30% 479.000 490.000 - 0.82% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -27.27% 22.000 16.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
508.namd_r -1.50% 423333.000 416994.000 - 0.00% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_execution_successful 275.00% 4.000 15.000 - 0.00% -
nb_total_tests 33.33% 24.000 32.000 - 0.00% -

Added Tests - Code Size
602.gcc_s
605.mcf_s
619.lbm_s
620.omnetpp_s
623.xalancbmk_s
625.x264_s
631.deepsjeng_s
638.imagick_s
641.leela_s
644.nab_s
657.xz_s

Added Tests - Execution
602.gcc_s
605.mcf_s
619.lbm_s
620.omnetpp_s
623.xalancbmk_s
625.x264_s
631.deepsjeng_s
638.imagick_s
641.leela_s
644.nab_s
657.xz_s

Added Tests - sample variability
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
600.perlbench_s (avg) (percentage)
600.perlbench_s (max) (percentage)
603.bwaves_s (avg) (percentage)
603.bwaves_s (max) (percentage)
605.mcf_s
605.mcf_s (avg)
605.mcf_s (avg) (percentage)
605.mcf_s (max)
605.mcf_s (max) (percentage)
605.mcf_s (unexplained diff vs previous)
605.mcf_s (unexplained diff vs previous) (percentage)
619.lbm_s
619.lbm_s (avg)
619.lbm_s (avg) (percentage)
619.lbm_s (max)
619.lbm_s (max) (percentage)
619.lbm_s (unexplained diff vs previous)
619.lbm_s (unexplained diff vs previous) (percentage)
620.omnetpp_s
620.omnetpp_s (avg)
620.omnetpp_s (avg) (percentage)
620.omnetpp_s (max)
620.omnetpp_s (max) (percentage)
620.omnetpp_s (unexplained diff vs previous)
620.omnetpp_s (unexplained diff vs previous) (percentage)
621.wrf_s (avg) (percentage)
621.wrf_s (max) (percentage)
625.x264_s
625.x264_s (avg)
625.x264_s (avg) (percentage)
625.x264_s (max)
625.x264_s (max) (percentage)
625.x264_s (unexplained diff vs previous)
625.x264_s (unexplained diff vs previous) (percentage)
628.pop2_s (avg) (percentage)
628.pop2_s (max) (percentage)
631.deepsjeng_s
631.deepsjeng_s (avg)
631.deepsjeng_s (avg) (percentage)
631.deepsjeng_s (max)
631.deepsjeng_s (max) (percentage)
631.deepsjeng_s (unexplained diff vs previous)
631.deepsjeng_s (unexplained diff vs previous) (percentage)
638.imagick_s
638.imagick_s (avg)
638.imagick_s (avg) (percentage)
638.imagick_s (max)
638.imagick_s (max) (percentage)
638.imagick_s (unexplained diff vs previous)
638.imagick_s (unexplained diff vs previous) (percentage)
641.leela_s
641.leela_s (avg)
641.leela_s (avg) (percentage)
641.leela_s (max)
641.leela_s (max) (percentage)
641.leela_s (unexplained diff vs previous)
641.leela_s (unexplained diff vs previous) (percentage)
644.nab_s
644.nab_s (avg)
644.nab_s (avg) (percentage)
644.nab_s (max)
644.nab_s (max) (percentage)
644.nab_s (unexplained diff vs previous)
644.nab_s (unexplained diff vs previous) (percentage)
648.exchange2_s (avg) (percentage)
648.exchange2_s (max) (percentage)
649.fotonik3d_s (avg) (percentage)
649.fotonik3d_s (max) (percentage)
654.roms_s (avg) (percentage)
654.roms_s (max) (percentage)
657.xz_s
657.xz_s (avg)
657.xz_s (avg) (percentage)
657.xz_s (max)
657.xz_s (max) (percentage)
657.xz_s (unexplained diff vs previous)
657.xz_s (unexplained diff vs previous) (percentage)


Report Time: 0.22s
Name Current %
508.namd_r 2728.000 -
510.parest_r 6214.000 1.17%
511.povray_r 490.000 -
526.blender_r 9833.000 -
602.gcc_s 5150.000 -
605.mcf_s 6571.000 -
619.lbm_s 34611.000 15.52%
620.omnetpp_s 4327.000 -
623.xalancbmk_s 5855.000 1.07%
625.x264_s 4790.000 -
631.deepsjeng_s 4472.000 -
638.imagick_s 3365.000 -
641.leela_s 5304.000 -
644.nab_s 11908.000 -
657.xz_s 2433.000 -
Geometric Mean 4957.447 1.29%
Name Current %
508.namd_r 416994.000 -
510.parest_r 5492407.000 -
511.povray_r 735214.000 -
526.blender_r 12054469.000 -
602.gcc_s 7353400.000 -
605.mcf_s 17568.000 -
619.lbm_s 17158.000 -
620.omnetpp_s 1723736.000 -
623.xalancbmk_s 3979949.000 -
625.x264_s 371823.000 -
631.deepsjeng_s 72296.000 -
638.imagick_s 1375084.000 -
641.leela_s 119455.000 -
644.nab_s 153872.000 -
657.xz_s 159708.000 -
Geometric Mean 503110.457 -
Name Current %
508.namd_r 22.000 -4.35%
508.namd_r (avg) 22.000 -4.35%
508.namd_r (avg) (percentage) 0.840 -1.18%
508.namd_r (max) 26.000 -3.70%
508.namd_r (max) (percentage) 0.970 -3.96%
508.namd_r (unexplained diff vs previous) 15.000 650.00%
508.namd_r (unexplained diff vs previous) (percentage) 0.550 685.71%
510.parest_r 44.000 4.76%
510.parest_r (avg) 44.000 4.76%
510.parest_r (avg) (percentage) 0.710 1.43%
510.parest_r (max) 191.000 -1.55%
510.parest_r (max) (percentage) 3.080 -2.53%
510.parest_r (unexplained diff vs previous) 72.000 188.00%
510.parest_r (unexplained diff vs previous) (percentage) 1.160 182.93%
511.povray_r 5.000 -
511.povray_r (avg) 5.000 -
511.povray_r (avg) (percentage) 1.100 -
511.povray_r (max) 13.000 -
511.povray_r (max) (percentage) 2.780 -3.14%
526.blender_r 55.000 -
526.blender_r (avg) 55.000 -
526.blender_r (avg) (percentage) 0.560 -
526.blender_r (max) 138.000 -2.13%
526.blender_r (max) (percentage) 1.410 -2.08%
600.perlbench_s (avg) (percentage) 1.440 -
600.perlbench_s (max) (percentage) 5.390 -
603.bwaves_s (avg) (percentage) 1.130 -
603.bwaves_s (max) (percentage) 0.580 -1.69%
605.mcf_s 57.000 -1.72%
605.mcf_s (avg) 57.000 -1.72%
605.mcf_s (avg) (percentage) 0.870 -2.25%
605.mcf_s (max) 51.000 -8.93%
605.mcf_s (max) (percentage) 0.780 -9.30%
605.mcf_s (unexplained diff vs previous) 5.000 -78.26%
605.mcf_s (unexplained diff vs previous) (percentage) 0.080 -77.14%
619.lbm_s 2547.000 18.41%
619.lbm_s (avg) 2547.000 18.41%
619.lbm_s (avg) (percentage) 7.360 2.51%
619.lbm_s (max) 5371.000 506.21%
619.lbm_s (max) (percentage) 15.520 424.32%
619.lbm_s (unexplained diff vs previous) 4650.000 2427.17%
619.lbm_s (unexplained diff vs previous) (percentage) 13.440 2103.28%
620.omnetpp_s 66.000 -1.49%
620.omnetpp_s (avg) 66.000 -1.49%
620.omnetpp_s (avg) (percentage) 1.540 -1.28%
620.omnetpp_s (max) 79.000 -3.66%
620.omnetpp_s (max) (percentage) 1.830 -4.69%
620.omnetpp_s (unexplained diff vs previous) 29.000 314.29%
620.omnetpp_s (unexplained diff vs previous) (percentage) 0.670 318.75%
621.wrf_s (avg) (percentage) 0.270 -
621.wrf_s (max) (percentage) 0.220 -4.35%
625.x264_s 18.000 -
625.x264_s (avg) 18.000 -
625.x264_s (avg) (percentage) 0.380 -2.56%
625.x264_s (max) 23.000 -48.89%
625.x264_s (max) (percentage) 0.490 -48.42%
625.x264_s (unexplained diff vs previous) 4.000 -
625.x264_s (unexplained diff vs previous) (percentage) 0.080 -
628.pop2_s (avg) (percentage) 0.260 -
628.pop2_s (max) (percentage) 0.290 -
631.deepsjeng_s 24.000 -
631.deepsjeng_s (avg) 24.000 -
631.deepsjeng_s (avg) (percentage) 0.540 -1.82%
631.deepsjeng_s (max) 26.000 -3.70%
631.deepsjeng_s (max) (percentage) 0.600 -3.23%
631.deepsjeng_s (unexplained diff vs previous) 7.000 16.67%
631.deepsjeng_s (unexplained diff vs previous) (percentage) 0.160 23.08%
638.imagick_s 53.000 -1.85%
638.imagick_s (avg) 53.000 -1.85%
638.imagick_s (avg) (percentage) 1.600 -2.44%
638.imagick_s (max) 65.000 -9.72%
638.imagick_s (max) (percentage) 1.940 -11.01%
638.imagick_s (unexplained diff vs previous) 17.000 88.89%
638.imagick_s (unexplained diff vs previous) (percentage) 0.510 88.89%
641.leela_s 21.000 -
641.leela_s (avg) 21.000 -
641.leela_s (avg) (percentage) 0.410 -
641.leela_s (max) 17.000 -10.53%
641.leela_s (max) (percentage) 0.330 -10.81%
641.leela_s (unexplained diff vs previous) 5.000 400.00%
641.leela_s (unexplained diff vs previous) (percentage) 0.090 350.00%
644.nab_s 92.000 -1.08%
644.nab_s (avg) 92.000 -1.08%
644.nab_s (avg) (percentage) 0.780 -
644.nab_s (max) 121.000 -4.72%
644.nab_s (max) (percentage) 1.020 -3.77%
644.nab_s (unexplained diff vs previous) 85.000 60.38%
644.nab_s (unexplained diff vs previous) (percentage) 0.710 61.36%
648.exchange2_s (avg) (percentage) 0.230 -
648.exchange2_s (max) (percentage) 0.120 -
649.fotonik3d_s (avg) (percentage) 0.610 -
649.fotonik3d_s (max) (percentage) 3.480 -1.14%
654.roms_s (avg) (percentage) 0.270 -
654.roms_s (max) (percentage) 0.180 -
657.xz_s 41.000 -
657.xz_s (avg) 41.000 -
657.xz_s (avg) (percentage) 1.690 -1.74%
657.xz_s (max) 34.000 -
657.xz_s (max) (percentage) 1.420 -
657.xz_s (unexplained diff vs previous) 12.000 200.00%
657.xz_s (unexplained diff vs previous) (percentage) 0.490 188.24%
Geometric Mean 5.623 18.38%