Fields
| hardware | None |
| os | None |
Parameters
Fields
| Name | Value |
|---|
Parameters
| Name | Value |
|---|---|
| git_llvm | https://github.com/llvm/llvm-project/commit/23e3cbb2e82b62586266116c8ab77ce68e412cf8 (+ 276 commits) |
| test_url | https://ci.linaro.org/job/tcwg_bmk-code_size-cpu2017fast--llvm-aarch64-master-Os-build/267/ |
Filter
llvm-aarch64-master-Os test results
| Run | Order | Start Time | Duration |
|---|---|---|---|
| Current | 0267 (llvmorg-21-init-08887-g23e3cbb2e82b) | 2025-04-14T07:40:28 | 0:00:00 |
| Previous | 0265 (llvmorg-21-init-08611-g03b0f55d9c63) | 2025-04-11T02:43:37 | 0:00:00 |
| Baseline | 0126 (llvmorg-19-init-07229-g315c88c5fbdb) | 2024-04-03T17:19:06 | 0:00:00 |
Tests Summary
| Status Group | # | # (B) |
|---|---|---|
| Performance Regressions | 10 | 6 |
| Performance Improvements | 39 | 3 |
| Added Tests | 4 | 112 |
| Unchanged Tests | 649 | 581 |
| Total Tests | 702 |
| Performance Regressions - Execution | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 619.lbm_s | 9.28% | 30065.000 | 32854.000 | - | 0.00% | - |
| 623.xalancbmk_s | 1.55% | 4257.000 | 4323.000 | - | 0.00% | - |
| Performance Regressions - sample variability | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 619.lbm_s | 8.89% | 3373.000 | 3673.000 | - | 0.00% | - |
| 619.lbm_s (avg) | 8.89% | 3373.000 | 3673.000 | - | 0.00% | - |
| 619.lbm_s (max) | 2.45% | 42424.000 | 43462.000 | - | 0.00% | - |
| 526.blender_r (max) | 2.38% | 42.000 | 43.000 | - | 0.00% | - |
| 508.namd_r | 2.27% | 44.000 | 45.000 | - | 0.00% | - |
| 508.namd_r (avg) | 2.27% | 44.000 | 45.000 | - | 0.00% | - |
| 623.xalancbmk_s | 1.54% | 65.000 | 66.000 | - | 0.00% | - |
| 623.xalancbmk_s (avg) | 1.54% | 65.000 | 66.000 | - | 0.00% | - |
| Performance Improvements - Code Size | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 508.namd_r | -2.06% | 481165.000 | 471230.000 | - | -2.49% | - |
| 605.mcf_s | -1.15% | 19812.000 | 19584.000 | - | 0.00% | - |
| Performance Improvements - sample variability | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 619.lbm_s (unexplained diff vs previous) (percentage) | -37.06% | 13.490 | 8.490 | - | 0.00% | - |
| 619.lbm_s (unexplained diff vs previous) | -31.24% | 4056.000 | 2789.000 | - | 0.00% | - |
| 644.nab_s (max) (percentage) | -7.41% | 6.880 | 6.370 | - | 0.00% | - |
| 644.nab_s (max) | -7.26% | 826.000 | 766.000 | - | 0.00% | - |
| 619.lbm_s (max) (percentage) | -6.25% | 141.110 | 132.290 | - | 0.00% | - |
| 605.mcf_s (max) (percentage) | -5.71% | 36.620 | 34.530 | - | 0.00% | - |
| 620.omnetpp_s (max) | -5.22% | 2011.000 | 1906.000 | - | 0.00% | - |
| 625.x264_s (max) (percentage) | -5.21% | 32.600 | 30.900 | - | 0.00% | - |
| 638.imagick_s (max) (percentage) | -5.20% | 45.930 | 43.540 | - | 0.00% | - |
| 620.omnetpp_s (max) (percentage) | -5.20% | 51.700 | 49.010 | - | 0.00% | - |
| 605.mcf_s (max) | -5.04% | 2300.000 | 2184.000 | - | 0.00% | - |
| 638.imagick_s (max) | -5.02% | 1495.000 | 1420.000 | - | 0.00% | - |
| 625.x264_s (max) | -5.00% | 860.000 | 817.000 | - | 0.00% | - |
| 657.xz_s (max) (percentage) | -4.77% | 85.160 | 81.100 | - | 0.00% | - |
| 508.namd_r (max) (percentage) | -4.38% | 18.940 | 18.110 | - | 0.00% | - |
| 511.povray_r (max) | -4.35% | 23.000 | 22.000 | - | 0.00% | - |
| 657.xz_s (max) | -4.18% | 1937.000 | 1856.000 | - | 0.00% | - |
| 641.leela_s (max) | -4.04% | 816.000 | 783.000 | - | 0.00% | - |
| 641.leela_s (max) (percentage) | -4.01% | 16.710 | 16.040 | - | 0.00% | - |
| 623.xalancbmk_s (max) (percentage) | -3.78% | 20.640 | 19.860 | - | 0.00% | - |
| 508.namd_r (max) | -3.74% | 481.000 | 463.000 | - | 0.00% | - |
| 631.deepsjeng_s (max) (percentage) | -3.74% | 32.080 | 30.880 | - | 0.00% | - |
| 510.parest_r (max) | -3.39% | 2510.000 | 2425.000 | - | 0.00% | - |
| 628.pop2_s (max) (percentage) | -3.33% | 0.300 | 0.290 | - | 0.00% | - |
| 511.povray_r (max) (percentage) | -3.17% | 5.370 | 5.200 | - | 0.00% | - |
| 631.deepsjeng_s (max) | -3.16% | 1266.000 | 1226.000 | - | 0.00% | - |
| 510.parest_r (max) (percentage) | -2.74% | 44.970 | 43.740 | - | 0.00% | - |
| 621.wrf_s (max) (percentage) | -2.56% | 0.390 | 0.380 | - | 0.00% | - |
| 603.bwaves_s (max) (percentage) | -2.50% | 0.400 | 0.390 | - | 0.00% | - |
| 623.xalancbmk_s (max) | -2.28% | 878.000 | 858.000 | - | 0.00% | - |
| 631.deepsjeng_s | -2.27% | 88.000 | 86.000 | - | 0.00% | - |
| 631.deepsjeng_s (avg) | -2.27% | 88.000 | 86.000 | - | 0.00% | - |
| 631.deepsjeng_s (avg) (percentage) | -2.24% | 2.230 | 2.180 | - | 0.00% | - |
| 620.omnetpp_s | -2.22% | 135.000 | 132.000 | - | 0.00% | - |
| 620.omnetpp_s (avg) | -2.22% | 135.000 | 132.000 | - | 0.00% | - |
| 600.perlbench_s (max) (percentage) | -2.02% | 0.990 | 0.970 | - | 0.00% | - |
| 620.omnetpp_s (avg) (percentage) | -2.02% | 3.470 | 3.400 | - | 0.00% | - |
| Added Tests - sample variability |
|---|
| 620.omnetpp_s (unexplained diff vs previous) |
| 620.omnetpp_s (unexplained diff vs previous) (percentage) |
| 631.deepsjeng_s (unexplained diff vs previous) |
| 631.deepsjeng_s (unexplained diff vs previous) (percentage) |
| Performance Regressions - Code Size | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 510.parest_r | 2.35% | 6923482.000 | 7086011.000 | - | -0.21% | - |
| Performance Regressions - Execution | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 510.parest_r | 21.20% | 4576.000 | 5546.000 | - | -0.66% | - |
| 508.namd_r | 4.88% | 2439.000 | 2558.000 | - | 0.67% | - |
| 526.blender_r | 3.44% | 8685.000 | 8984.000 | - | 0.68% | - |
| 511.povray_r | 1.62% | 433.000 | 440.000 | - | -0.68% | - |
| Performance Regressions - Score | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| nb_compile_successful | -27.27% | 22.000 | 16.000 | - | 0.00% | - |
| Performance Improvements - Code Size | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 508.namd_r | -2.49% | 483255.000 | 471230.000 | - | -2.06% | - |
| Performance Improvements - Score | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| nb_execution_successful | 275.00% | 4.000 | 15.000 | - | 0.00% | - |
| nb_total_tests | 33.33% | 24.000 | 32.000 | - | 0.00% | - |
| Added Tests - Code Size |
|---|
| 602.gcc_s |
| 605.mcf_s |
| 619.lbm_s |
| 620.omnetpp_s |
| 623.xalancbmk_s |
| 625.x264_s |
| 631.deepsjeng_s |
| 638.imagick_s |
| 641.leela_s |
| 644.nab_s |
| 657.xz_s |
| Added Tests - Execution |
|---|
| 602.gcc_s |
| 605.mcf_s |
| 619.lbm_s |
| 620.omnetpp_s |
| 623.xalancbmk_s |
| 625.x264_s |
| 631.deepsjeng_s |
| 638.imagick_s |
| 641.leela_s |
| 644.nab_s |
| 657.xz_s |
| Added Tests - sample variability |
|---|
| 508.namd_r |
| 508.namd_r (avg) |
| 508.namd_r (avg) (percentage) |
| 508.namd_r (max) |
| 508.namd_r (max) (percentage) |
| 510.parest_r |
| 510.parest_r (avg) |
| 510.parest_r (avg) (percentage) |
| 510.parest_r (max) |
| 510.parest_r (max) (percentage) |
| 511.povray_r |
| 511.povray_r (avg) |
| 511.povray_r (avg) (percentage) |
| 511.povray_r (max) |
| 511.povray_r (max) (percentage) |
| 526.blender_r |
| 526.blender_r (avg) |
| 526.blender_r (avg) (percentage) |
| 526.blender_r (max) |
| 526.blender_r (max) (percentage) |
| 600.perlbench_s (avg) (percentage) |
| 600.perlbench_s (max) (percentage) |
| 603.bwaves_s (avg) (percentage) |
| 603.bwaves_s (max) (percentage) |
| 605.mcf_s |
| 605.mcf_s (avg) |
| 605.mcf_s (avg) (percentage) |
| 605.mcf_s (max) |
| 605.mcf_s (max) (percentage) |
| 619.lbm_s |
| 619.lbm_s (avg) |
| 619.lbm_s (avg) (percentage) |
| 619.lbm_s (max) |
| 619.lbm_s (max) (percentage) |
| 619.lbm_s (unexplained diff vs previous) |
| 619.lbm_s (unexplained diff vs previous) (percentage) |
| 620.omnetpp_s |
| 620.omnetpp_s (avg) |
| 620.omnetpp_s (avg) (percentage) |
| 620.omnetpp_s (max) |
| 620.omnetpp_s (max) (percentage) |
| 620.omnetpp_s (unexplained diff vs previous) |
| 620.omnetpp_s (unexplained diff vs previous) (percentage) |
| 621.wrf_s (avg) (percentage) |
| 621.wrf_s (max) (percentage) |
| 623.xalancbmk_s |
| 623.xalancbmk_s (avg) |
| 623.xalancbmk_s (avg) (percentage) |
| 623.xalancbmk_s (max) |
| 623.xalancbmk_s (max) (percentage) |
| 625.x264_s |
| 625.x264_s (avg) |
| 625.x264_s (avg) (percentage) |
| 625.x264_s (max) |
| 625.x264_s (max) (percentage) |
| 628.pop2_s (avg) (percentage) |
| 628.pop2_s (max) (percentage) |
| 631.deepsjeng_s |
| 631.deepsjeng_s (avg) |
| 631.deepsjeng_s (avg) (percentage) |
| 631.deepsjeng_s (max) |
| 631.deepsjeng_s (max) (percentage) |
| 631.deepsjeng_s (unexplained diff vs previous) |
| 631.deepsjeng_s (unexplained diff vs previous) (percentage) |
| 638.imagick_s |
| 638.imagick_s (avg) |
| 638.imagick_s (avg) (percentage) |
| 638.imagick_s (max) |
| 638.imagick_s (max) (percentage) |
| 641.leela_s |
| 641.leela_s (avg) |
| 641.leela_s (avg) (percentage) |
| 641.leela_s (max) |
| 641.leela_s (max) (percentage) |
| 644.nab_s |
| 644.nab_s (avg) |
| 644.nab_s (avg) (percentage) |
| 644.nab_s (max) |
| 644.nab_s (max) (percentage) |
| 648.exchange2_s (avg) (percentage) |
| 648.exchange2_s (max) (percentage) |
| 649.fotonik3d_s (avg) (percentage) |
| 649.fotonik3d_s (max) (percentage) |
| 654.roms_s (avg) (percentage) |
| 654.roms_s (max) (percentage) |
| 657.xz_s |
| 657.xz_s (avg) |
| 657.xz_s (avg) (percentage) |
| 657.xz_s (max) |
| 657.xz_s (max) (percentage) |
Report Time: 0.22s