Fields
hardware | None |
os | None |
Parameters
Fields
Name | Value |
---|
Parameters
Name | Value |
---|---|
git_llvm | https://github.com/llvm/llvm-project/commit/07dad4ecba43bcd92453a0cd4c351025126db683 (+ 446 commits) |
test_url | https://ci.linaro.org/job/tcwg_bmk-code_size-cpu2017fast--llvm-aarch64-master-Oz-build/306/ |
Filter
llvm-aarch64-master-Oz test results
Run | Order | Start Time | Duration |
---|---|---|---|
Current | 0306 (llvmorg-21-init-15306-g07dad4ecba43) | 2025-06-10T01:46:02 | 0:00:00 |
Previous | 0305 (llvmorg-21-init-14860-geccd81f20ba3) | 2025-06-07T00:41:24 | 0:00:00 |
Baseline | 0140 (llvmorg-19-init-07219-g72e2e4f7dc68) | 2024-04-03T16:00:23 | 0:00:00 |
Tests Summary
Status Group | # | # (B) |
---|---|---|
Performance Regressions | 13 | 5 |
Performance Improvements | 45 | 3 |
Added Tests | 0 | 109 |
Unchanged Tests | 656 | 597 |
Total Tests | 714 |
Performance Regressions - Execution | Δ | Previous | Current | σ | Δ (B) | σ (B) |
---|---|---|---|---|---|---|
638.imagick_s | 2.01% | 3284.000 | 3350.000 | - | 0.00% | - |
644.nab_s | 1.38% | 11928.000 | 12093.000 | - | 0.00% | - |
Performance Regressions - sample variability | Δ | Previous | Current | σ | Δ (B) | σ (B) |
---|---|---|---|---|---|---|
644.nab_s (max) | 127.40% | 73.000 | 166.000 | - | 0.00% | - |
644.nab_s (unexplained diff vs previous) | 122.97% | 74.000 | 165.000 | - | 0.00% | - |
644.nab_s (max) (percentage) | 122.58% | 0.620 | 1.380 | - | 0.00% | - |
644.nab_s (unexplained diff vs previous) (percentage) | 119.35% | 0.620 | 1.360 | - | 0.00% | - |
657.xz_s (unexplained diff vs previous) | 100.00% | 2.000 | 4.000 | - | 0.00% | - |
657.xz_s (unexplained diff vs previous) (percentage) | 100.00% | 0.080 | 0.160 | - | 0.00% | - |
644.nab_s | 4.49% | 89.000 | 93.000 | - | 0.00% | - |
644.nab_s (avg) | 4.49% | 89.000 | 93.000 | - | 0.00% | - |
644.nab_s (avg) (percentage) | 2.67% | 0.750 | 0.770 | - | 0.00% | - |
638.imagick_s | 1.79% | 56.000 | 57.000 | - | 0.00% | - |
638.imagick_s (avg) | 1.79% | 56.000 | 57.000 | - | 0.00% | - |
Performance Improvements - Execution | Δ | Previous | Current | σ | Δ (B) | σ (B) |
---|---|---|---|---|---|---|
619.lbm_s | -1.96% | 30575.000 | 29975.000 | - | 0.00% | - |
Performance Improvements - sample variability | Δ | Previous | Current | σ | Δ (B) | σ (B) |
---|---|---|---|---|---|---|
619.lbm_s (unexplained diff vs previous) | -87.05% | 4632.000 | 600.000 | - | 0.00% | - |
619.lbm_s (unexplained diff vs previous) (percentage) | -86.80% | 15.150 | 2.000 | - | 0.00% | - |
511.povray_r (unexplained diff vs previous) | -77.78% | 9.000 | 2.000 | - | 0.00% | - |
511.povray_r (unexplained diff vs previous) (percentage) | -77.60% | 1.830 | 0.410 | - | 0.00% | - |
620.omnetpp_s (unexplained diff vs previous) (percentage) | -59.05% | 1.050 | 0.430 | - | 0.00% | - |
620.omnetpp_s (unexplained diff vs previous) | -58.70% | 46.000 | 19.000 | - | 0.00% | - |
508.namd_r (unexplained diff vs previous) (percentage) | -49.07% | 1.080 | 0.550 | - | 0.00% | - |
508.namd_r (unexplained diff vs previous) | -48.28% | 29.000 | 15.000 | - | 0.00% | - |
620.omnetpp_s (max) | -29.06% | 117.000 | 83.000 | - | 0.00% | - |
620.omnetpp_s (max) (percentage) | -28.46% | 2.670 | 1.910 | - | 0.00% | - |
508.namd_r (max) (percentage) | -16.81% | 1.130 | 0.940 | - | 0.00% | - |
508.namd_r (max) | -16.67% | 30.000 | 25.000 | - | 0.00% | - |
605.mcf_s (max) (percentage) | -12.38% | 1.050 | 0.920 | - | 0.00% | - |
605.mcf_s (max) | -11.76% | 68.000 | 60.000 | - | 0.00% | - |
619.lbm_s (max) | -11.72% | 4396.000 | 3881.000 | - | 0.00% | - |
511.povray_r (max) | -11.11% | 9.000 | 8.000 | - | 0.00% | - |
511.povray_r (max) (percentage) | -10.16% | 1.870 | 1.680 | - | 0.00% | - |
619.lbm_s (max) (percentage) | -9.94% | 14.380 | 12.950 | - | 0.00% | - |
638.imagick_s (max) (percentage) | -6.24% | 6.410 | 6.010 | - | 0.00% | - |
641.leela_s (max) (percentage) | -5.88% | 0.850 | 0.800 | - | 0.00% | - |
625.x264_s (max) (percentage) | -5.48% | 0.730 | 0.690 | - | 0.00% | - |
641.leela_s (max) | -4.55% | 44.000 | 42.000 | - | 0.00% | - |
508.namd_r | -4.35% | 23.000 | 22.000 | - | 0.00% | - |
508.namd_r (avg) | -4.35% | 23.000 | 22.000 | - | 0.00% | - |
638.imagick_s (max) | -4.29% | 210.000 | 201.000 | - | 0.00% | - |
631.deepsjeng_s (max) (percentage) | -3.91% | 1.280 | 1.230 | - | 0.00% | - |
628.pop2_s (max) (percentage) | -3.70% | 0.270 | 0.260 | - | 0.00% | - |
631.deepsjeng_s (max) | -3.57% | 56.000 | 54.000 | - | 0.00% | - |
619.lbm_s | -3.41% | 2519.000 | 2433.000 | - | 0.00% | - |
619.lbm_s (avg) | -3.41% | 2519.000 | 2433.000 | - | 0.00% | - |
526.blender_r (max) | -3.36% | 119.000 | 115.000 | - | 0.00% | - |
526.blender_r (max) (percentage) | -3.31% | 1.210 | 1.170 | - | 0.00% | - |
620.omnetpp_s | -2.94% | 68.000 | 66.000 | - | 0.00% | - |
620.omnetpp_s (avg) | -2.94% | 68.000 | 66.000 | - | 0.00% | - |
625.x264_s (max) | -2.94% | 34.000 | 33.000 | - | 0.00% | - |
657.xz_s (max) (percentage) | -2.70% | 3.700 | 3.600 | - | 0.00% | - |
511.povray_r (avg) (percentage) | -2.68% | 1.120 | 1.090 | - | 0.00% | - |
657.xz_s | -2.50% | 40.000 | 39.000 | - | 0.00% | - |
657.xz_s (avg) | -2.50% | 40.000 | 39.000 | - | 0.00% | - |
657.xz_s (avg) (percentage) | -2.38% | 1.680 | 1.640 | - | 0.00% | - |
657.xz_s (max) | -2.25% | 89.000 | 87.000 | - | 0.00% | - |
619.lbm_s (avg) (percentage) | -1.46% | 8.240 | 8.120 | - | 0.00% | - |
620.omnetpp_s (avg) (percentage) | -1.29% | 1.550 | 1.530 | - | 0.00% | - |
508.namd_r (avg) (percentage) | -1.16% | 0.860 | 0.850 | - | 0.00% | - |
Performance Regressions - Execution | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
---|---|---|---|---|---|---|
510.parest_r | 20.16% | 5139.000 | 6175.000 | - | 0.15% | - |
526.blender_r | 4.94% | 9432.000 | 9898.000 | - | 0.26% | - |
508.namd_r | 4.68% | 2583.000 | 2704.000 | - | 0.56% | - |
511.povray_r | 2.09% | 479.000 | 489.000 | - | -0.41% | - |
Performance Regressions - Score | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
---|---|---|---|---|---|---|
nb_compile_successful | -27.27% | 22.000 | 16.000 | - | 0.00% | - |
Performance Improvements - Code Size | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
---|---|---|---|---|---|---|
508.namd_r | -1.52% | 423333.000 | 416918.000 | - | 0.00% | - |
Performance Improvements - Score | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
---|---|---|---|---|---|---|
nb_execution_successful | 275.00% | 4.000 | 15.000 | - | 0.00% | - |
nb_total_tests | 33.33% | 24.000 | 32.000 | - | 0.00% | - |
Added Tests - Code Size |
---|
602.gcc_s |
605.mcf_s |
619.lbm_s |
620.omnetpp_s |
623.xalancbmk_s |
625.x264_s |
631.deepsjeng_s |
638.imagick_s |
641.leela_s |
644.nab_s |
657.xz_s |
Added Tests - Execution |
---|
602.gcc_s |
605.mcf_s |
619.lbm_s |
620.omnetpp_s |
623.xalancbmk_s |
625.x264_s |
631.deepsjeng_s |
638.imagick_s |
641.leela_s |
644.nab_s |
657.xz_s |
Added Tests - sample variability |
---|
508.namd_r |
508.namd_r (avg) |
508.namd_r (avg) (percentage) |
508.namd_r (max) |
508.namd_r (max) (percentage) |
510.parest_r |
510.parest_r (avg) |
510.parest_r (avg) (percentage) |
510.parest_r (max) |
510.parest_r (max) (percentage) |
511.povray_r |
511.povray_r (avg) |
511.povray_r (avg) (percentage) |
511.povray_r (max) |
511.povray_r (max) (percentage) |
526.blender_r |
526.blender_r (avg) |
526.blender_r (avg) (percentage) |
526.blender_r (max) |
526.blender_r (max) (percentage) |
600.perlbench_s (avg) (percentage) |
600.perlbench_s (max) (percentage) |
603.bwaves_s (avg) (percentage) |
603.bwaves_s (max) (percentage) |
605.mcf_s |
605.mcf_s (avg) |
605.mcf_s (avg) (percentage) |
605.mcf_s (max) |
605.mcf_s (max) (percentage) |
619.lbm_s |
619.lbm_s (avg) |
619.lbm_s (avg) (percentage) |
619.lbm_s (max) |
619.lbm_s (max) (percentage) |
619.lbm_s (unexplained diff vs previous) |
619.lbm_s (unexplained diff vs previous) (percentage) |
620.omnetpp_s |
620.omnetpp_s (avg) |
620.omnetpp_s (avg) (percentage) |
620.omnetpp_s (max) |
620.omnetpp_s (max) (percentage) |
620.omnetpp_s (unexplained diff vs previous) |
620.omnetpp_s (unexplained diff vs previous) (percentage) |
621.wrf_s (avg) (percentage) |
621.wrf_s (max) (percentage) |
625.x264_s |
625.x264_s (avg) |
625.x264_s (avg) (percentage) |
625.x264_s (max) |
625.x264_s (max) (percentage) |
628.pop2_s (avg) (percentage) |
628.pop2_s (max) (percentage) |
631.deepsjeng_s |
631.deepsjeng_s (avg) |
631.deepsjeng_s (avg) (percentage) |
631.deepsjeng_s (max) |
631.deepsjeng_s (max) (percentage) |
638.imagick_s |
638.imagick_s (avg) |
638.imagick_s (avg) (percentage) |
638.imagick_s (max) |
638.imagick_s (max) (percentage) |
641.leela_s |
641.leela_s (avg) |
641.leela_s (avg) (percentage) |
641.leela_s (max) |
641.leela_s (max) (percentage) |
644.nab_s |
644.nab_s (avg) |
644.nab_s (avg) (percentage) |
644.nab_s (max) |
644.nab_s (max) (percentage) |
644.nab_s (unexplained diff vs previous) |
644.nab_s (unexplained diff vs previous) (percentage) |
648.exchange2_s (avg) (percentage) |
648.exchange2_s (max) (percentage) |
649.fotonik3d_s (avg) (percentage) |
649.fotonik3d_s (max) (percentage) |
654.roms_s (avg) (percentage) |
654.roms_s (max) (percentage) |
657.xz_s |
657.xz_s (avg) |
657.xz_s (avg) (percentage) |
657.xz_s (max) |
657.xz_s (max) (percentage) |
657.xz_s (unexplained diff vs previous) |
657.xz_s (unexplained diff vs previous) (percentage) |
Report Time: 0.23s