Fields
| hardware | None |
| os | None |
Parameters
Fields
| Name | Value |
|---|
Parameters
| Name | Value |
|---|---|
| git_llvm | https://github.com/llvm/llvm-project/commit/03b0f55d9c6319a851a60bb084faca0e32a38f2b (+ 265 commits) |
| test_url | https://ci.linaro.org/job/tcwg_bmk-code_size-cpu2017fast--llvm-aarch64-master-Os-build/265/ |
Filter
llvm-aarch64-master-Os test results
| Run | Order | Start Time | Duration |
|---|---|---|---|
| Current | 0265 (llvmorg-21-init-08611-g03b0f55d9c63) | 2025-04-11T02:43:37 | 0:00:00 |
| Previous | 0264 (llvmorg-21-init-08346-g4dd80b73b00c) | 2025-04-06T18:51:14 | 0:00:00 |
| Baseline | 0126 (llvmorg-19-init-07229-g315c88c5fbdb) | 2024-04-03T17:19:06 | 0:00:00 |
Tests Summary
| Status Group | # | # (B) |
|---|---|---|
| Performance Regressions | 9 | 6 |
| Performance Improvements | 65 | 2 |
| Added Tests | 0 | 116 |
| Unchanged Tests | 664 | 614 |
| Total Tests | 738 |
| Performance Regressions - Execution | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 638.imagick_s | 1.91% | 3195.000 | 3256.000 | - | 0.00% | - |
| 623.xalancbmk_s | 1.79% | 4182.000 | 4257.000 | - | 0.00% | - |
| 644.nab_s | 1.32% | 11861.000 | 12018.000 | - | 0.00% | - |
| Performance Regressions - sample variability | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 638.imagick_s | 2.08% | 144.000 | 147.000 | - | 0.00% | - |
| 638.imagick_s (avg) | 2.08% | 144.000 | 147.000 | - | 0.00% | - |
| 623.xalancbmk_s | 1.56% | 64.000 | 65.000 | - | 0.00% | - |
| 623.xalancbmk_s (avg) | 1.56% | 64.000 | 65.000 | - | 0.00% | - |
| 644.nab_s | 1.41% | 142.000 | 144.000 | - | 0.00% | - |
| 644.nab_s (avg) | 1.41% | 142.000 | 144.000 | - | 0.00% | - |
| Performance Improvements - Execution | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 619.lbm_s | -11.89% | 34121.000 | 30065.000 | - | 0.00% | - |
| 657.xz_s | -5.01% | 2395.000 | 2275.000 | - | 0.00% | - |
| 602.gcc_s | -1.63% | 4349.000 | 4278.000 | - | 0.00% | - |
| 620.omnetpp_s | -1.62% | 3955.000 | 3891.000 | - | 0.00% | - |
| 605.mcf_s | -1.47% | 6377.000 | 6283.000 | - | 0.00% | - |
| 625.x264_s | -1.31% | 2676.000 | 2641.000 | - | 0.00% | - |
| Performance Improvements - sample variability | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 641.leela_s (unexplained diff vs previous) (percentage) | -99.11% | 18.010 | 0.160 | - | 0.00% | - |
| 641.leela_s (unexplained diff vs previous) | -99.09% | 879.000 | 8.000 | - | 0.00% | - |
| 620.omnetpp_s (unexplained diff vs previous) | -97.14% | 2235.000 | 64.000 | - | 0.00% | - |
| 620.omnetpp_s (unexplained diff vs previous) (percentage) | -97.10% | 56.510 | 1.640 | - | 0.00% | - |
| 605.mcf_s (unexplained diff vs previous) | -96.42% | 2623.000 | 94.000 | - | 0.00% | - |
| 605.mcf_s (unexplained diff vs previous) (percentage) | -96.35% | 41.130 | 1.500 | - | 0.00% | - |
| 625.x264_s (unexplained diff vs previous) | -96.27% | 939.000 | 35.000 | - | 0.00% | - |
| 625.x264_s (unexplained diff vs previous) (percentage) | -96.21% | 35.090 | 1.330 | - | 0.00% | - |
| 619.lbm_s (unexplained diff vs previous) | -93.49% | 62322.000 | 4056.000 | - | 0.00% | - |
| 619.lbm_s (unexplained diff vs previous) (percentage) | -92.61% | 182.650 | 13.490 | - | 0.00% | - |
| 619.lbm_s (max) | -21.67% | 54163.000 | 42424.000 | - | 0.00% | - |
| 619.lbm_s | -11.79% | 3824.000 | 3373.000 | - | 0.00% | - |
| 619.lbm_s (avg) | -11.79% | 3824.000 | 3373.000 | - | 0.00% | - |
| 619.lbm_s (max) (percentage) | -11.11% | 158.740 | 141.110 | - | 0.00% | - |
| 657.xz_s (max) | -10.49% | 2164.000 | 1937.000 | - | 0.00% | - |
| 644.nab_s (max) (percentage) | -9.95% | 7.640 | 6.880 | - | 0.00% | - |
| 644.nab_s (max) | -8.83% | 906.000 | 826.000 | - | 0.00% | - |
| 605.mcf_s (max) | -8.80% | 2522.000 | 2300.000 | - | 0.00% | - |
| 620.omnetpp_s (max) | -8.05% | 2187.000 | 2011.000 | - | 0.00% | - |
| 625.x264_s (max) | -7.73% | 932.000 | 860.000 | - | 0.00% | - |
| 605.mcf_s (max) (percentage) | -7.43% | 39.560 | 36.620 | - | 0.00% | - |
| 638.imagick_s (max) (percentage) | -6.51% | 49.130 | 45.930 | - | 0.00% | - |
| 620.omnetpp_s (max) (percentage) | -6.51% | 55.300 | 51.700 | - | 0.00% | - |
| 625.x264_s (max) (percentage) | -6.48% | 34.860 | 32.600 | - | 0.00% | - |
| 657.xz_s (max) (percentage) | -5.77% | 90.370 | 85.160 | - | 0.00% | - |
| 508.namd_r (max) | -5.69% | 510.000 | 481.000 | - | 0.00% | - |
| 508.namd_r (max) (percentage) | -5.21% | 19.980 | 18.940 | - | 0.00% | - |
| 631.deepsjeng_s (max) | -5.10% | 1334.000 | 1266.000 | - | 0.00% | - |
| 657.xz_s | -4.76% | 126.000 | 120.000 | - | 0.00% | - |
| 657.xz_s (avg) | -4.76% | 126.000 | 120.000 | - | 0.00% | - |
| 641.leela_s (max) (percentage) | -4.73% | 17.540 | 16.710 | - | 0.00% | - |
| 638.imagick_s (max) | -4.72% | 1569.000 | 1495.000 | - | 0.00% | - |
| 641.leela_s (max) | -4.56% | 855.000 | 816.000 | - | 0.00% | - |
| 631.deepsjeng_s (max) (percentage) | -4.32% | 33.530 | 32.080 | - | 0.00% | - |
| 623.xalancbmk_s (max) (percentage) | -4.27% | 21.560 | 20.640 | - | 0.00% | - |
| 511.povray_r (max) | -4.17% | 24.000 | 23.000 | - | 0.00% | - |
| 510.parest_r (max) | -3.98% | 2614.000 | 2510.000 | - | 0.00% | - |
| 511.povray_r (max) (percentage) | -3.59% | 5.570 | 5.370 | - | 0.00% | - |
| 648.exchange2_s (max) (percentage) | -3.57% | 0.280 | 0.270 | - | 0.00% | - |
| 510.parest_r (max) (percentage) | -3.02% | 46.370 | 44.970 | - | 0.00% | - |
| 641.leela_s | -2.94% | 68.000 | 66.000 | - | 0.00% | - |
| 641.leela_s (avg) | -2.94% | 68.000 | 66.000 | - | 0.00% | - |
| 620.omnetpp_s | -2.88% | 139.000 | 135.000 | - | 0.00% | - |
| 620.omnetpp_s (avg) | -2.88% | 139.000 | 135.000 | - | 0.00% | - |
| 641.leela_s (avg) (percentage) | -2.86% | 1.400 | 1.360 | - | 0.00% | - |
| 605.mcf_s | -2.56% | 156.000 | 152.000 | - | 0.00% | - |
| 605.mcf_s (avg) | -2.56% | 156.000 | 152.000 | - | 0.00% | - |
| 623.xalancbmk_s (max) | -2.55% | 901.000 | 878.000 | - | 0.00% | - |
| 621.wrf_s (max) (percentage) | -2.50% | 0.400 | 0.390 | - | 0.00% | - |
| 526.blender_r (max) | -2.33% | 43.000 | 42.000 | - | 0.00% | - |
| 508.namd_r | -2.22% | 45.000 | 44.000 | - | 0.00% | - |
| 508.namd_r (avg) | -2.22% | 45.000 | 44.000 | - | 0.00% | - |
| 526.blender_r (max) (percentage) | -2.04% | 0.490 | 0.480 | - | 0.00% | - |
| 625.x264_s | -1.92% | 52.000 | 51.000 | - | 0.00% | - |
| 625.x264_s (avg) | -1.92% | 52.000 | 51.000 | - | 0.00% | - |
| 620.omnetpp_s (avg) (percentage) | -1.42% | 3.520 | 3.470 | - | 0.00% | - |
| 605.mcf_s (avg) (percentage) | -1.22% | 2.460 | 2.430 | - | 0.00% | - |
| 625.x264_s (avg) (percentage) | -1.02% | 1.970 | 1.950 | - | 0.00% | - |
| 600.perlbench_s (max) (percentage) | -1.00% | 1.000 | 0.990 | - | 0.00% | - |
| Performance Regressions - Code Size | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 510.parest_r | 2.56% | 6923482.000 | 7100811.000 | - | -0.00% | - |
| Performance Regressions - Execution | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 510.parest_r | 22.01% | 4576.000 | 5583.000 | - | -0.98% | - |
| 508.namd_r | 4.18% | 2439.000 | 2541.000 | - | -0.51% | - |
| 526.blender_r | 2.74% | 8685.000 | 8923.000 | - | 0.50% | - |
| 511.povray_r | 2.31% | 433.000 | 443.000 | - | 0.45% | - |
| Performance Regressions - Score | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| nb_compile_successful | -27.27% | 22.000 | 16.000 | - | 0.00% | - |
| Performance Improvements - Score | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| nb_execution_successful | 275.00% | 4.000 | 15.000 | - | 0.00% | - |
| nb_total_tests | 33.33% | 24.000 | 32.000 | - | 0.00% | - |
| Added Tests - Code Size |
|---|
| 602.gcc_s |
| 605.mcf_s |
| 619.lbm_s |
| 620.omnetpp_s |
| 623.xalancbmk_s |
| 625.x264_s |
| 631.deepsjeng_s |
| 638.imagick_s |
| 641.leela_s |
| 644.nab_s |
| 657.xz_s |
| Added Tests - Execution |
|---|
| 602.gcc_s |
| 605.mcf_s |
| 619.lbm_s |
| 620.omnetpp_s |
| 623.xalancbmk_s |
| 625.x264_s |
| 631.deepsjeng_s |
| 638.imagick_s |
| 641.leela_s |
| 644.nab_s |
| 657.xz_s |
| Added Tests - sample variability |
|---|
| 508.namd_r |
| 508.namd_r (avg) |
| 508.namd_r (avg) (percentage) |
| 508.namd_r (max) |
| 508.namd_r (max) (percentage) |
| 510.parest_r |
| 510.parest_r (avg) |
| 510.parest_r (avg) (percentage) |
| 510.parest_r (max) |
| 510.parest_r (max) (percentage) |
| 511.povray_r |
| 511.povray_r (avg) |
| 511.povray_r (avg) (percentage) |
| 511.povray_r (max) |
| 511.povray_r (max) (percentage) |
| 526.blender_r |
| 526.blender_r (avg) |
| 526.blender_r (avg) (percentage) |
| 526.blender_r (max) |
| 526.blender_r (max) (percentage) |
| 600.perlbench_s (avg) (percentage) |
| 600.perlbench_s (max) (percentage) |
| 603.bwaves_s (avg) (percentage) |
| 603.bwaves_s (max) (percentage) |
| 605.mcf_s |
| 605.mcf_s (avg) |
| 605.mcf_s (avg) (percentage) |
| 605.mcf_s (max) |
| 605.mcf_s (max) (percentage) |
| 605.mcf_s (unexplained diff vs previous) |
| 605.mcf_s (unexplained diff vs previous) (percentage) |
| 619.lbm_s |
| 619.lbm_s (avg) |
| 619.lbm_s (avg) (percentage) |
| 619.lbm_s (max) |
| 619.lbm_s (max) (percentage) |
| 619.lbm_s (unexplained diff vs previous) |
| 619.lbm_s (unexplained diff vs previous) (percentage) |
| 620.omnetpp_s |
| 620.omnetpp_s (avg) |
| 620.omnetpp_s (avg) (percentage) |
| 620.omnetpp_s (max) |
| 620.omnetpp_s (max) (percentage) |
| 620.omnetpp_s (unexplained diff vs previous) |
| 620.omnetpp_s (unexplained diff vs previous) (percentage) |
| 621.wrf_s (avg) (percentage) |
| 621.wrf_s (max) (percentage) |
| 623.xalancbmk_s |
| 623.xalancbmk_s (avg) |
| 623.xalancbmk_s (avg) (percentage) |
| 623.xalancbmk_s (max) |
| 623.xalancbmk_s (max) (percentage) |
| 625.x264_s |
| 625.x264_s (avg) |
| 625.x264_s (avg) (percentage) |
| 625.x264_s (max) |
| 625.x264_s (max) (percentage) |
| 625.x264_s (unexplained diff vs previous) |
| 625.x264_s (unexplained diff vs previous) (percentage) |
| 628.pop2_s (avg) (percentage) |
| 628.pop2_s (max) (percentage) |
| 631.deepsjeng_s |
| 631.deepsjeng_s (avg) |
| 631.deepsjeng_s (avg) (percentage) |
| 631.deepsjeng_s (max) |
| 631.deepsjeng_s (max) (percentage) |
| 638.imagick_s |
| 638.imagick_s (avg) |
| 638.imagick_s (avg) (percentage) |
| 638.imagick_s (max) |
| 638.imagick_s (max) (percentage) |
| 641.leela_s |
| 641.leela_s (avg) |
| 641.leela_s (avg) (percentage) |
| 641.leela_s (max) |
| 641.leela_s (max) (percentage) |
| 641.leela_s (unexplained diff vs previous) |
| 641.leela_s (unexplained diff vs previous) (percentage) |
| 644.nab_s |
| 644.nab_s (avg) |
| 644.nab_s (avg) (percentage) |
| 644.nab_s (max) |
| 644.nab_s (max) (percentage) |
| 648.exchange2_s (avg) (percentage) |
| 648.exchange2_s (max) (percentage) |
| 649.fotonik3d_s (avg) (percentage) |
| 649.fotonik3d_s (max) (percentage) |
| 654.roms_s (avg) (percentage) |
| 654.roms_s (max) (percentage) |
| 657.xz_s |
| 657.xz_s (avg) |
| 657.xz_s (avg) (percentage) |
| 657.xz_s (max) |
| 657.xz_s (max) (percentage) |
Report Time: 0.23s