Fields
| hardware | None |
| os | None |
Parameters
Fields
| Name | Value |
|---|
Parameters
| Name | Value |
|---|---|
| git_llvm | https://github.com/llvm/llvm-project/commit/677a1da6fafddb13aebd4c170c8452029a05858d (+ 1684 commits) |
| test_url | https://ci.linaro.org/job/tcwg_bmk-code_size-cpu2017fast--llvm-aarch64-master-Os_LTO-build/43/ |
Filter
llvm-aarch64-master-Os_LTO test results
| Run | Order | Start Time | Duration |
|---|---|---|---|
| Current | 0043 (llvmorg-17-init-17788-g677a1da6fafd) | 2023-07-01T22:07:30 | 0:00:00 |
| Previous | 0039 (llvmorg-17-init-16104-g28722dcc2556) | 2023-06-20T20:16:53 | 0:00:00 |
| Baseline | 0001 (llvmorg-17-init-03361-gd77f96a9e0c8) | 2023-02-27T23:41:40 | 0:00:00 |
Tests Summary
| Status Group | # | # (B) |
|---|---|---|
| Performance Regressions | 0 | 14 |
| Performance Improvements | 53 | 5 |
| Added Tests | 0 | 75 |
| Unchanged Tests | 649 | 608 |
| Total Tests | 702 |
| Performance Improvements - Execution | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 657.xz_s | -10.52% | 2927.000 | 2619.000 | - | 14.52% | - |
| 620.omnetpp_s | -7.96% | 4547.000 | 4185.000 | - | 11.69% | - |
| 619.lbm_s | -7.27% | 53305.000 | 49429.000 | - | 59.14% | - |
| 638.imagick_s | -6.28% | 3724.000 | 3490.000 | - | 7.12% | - |
| 508.namd_r | -5.97% | 2665.000 | 2506.000 | - | 2.49% | - |
| 600.perlbench_s | -5.33% | 2589.000 | 2451.000 | - | 6.66% | - |
| 602.gcc_s | -4.77% | 4847.000 | 4616.000 | - | 9.83% | - |
| 625.x264_s | -4.32% | 3032.000 | 2901.000 | - | 8.98% | - |
| 631.deepsjeng_s | -3.55% | 3860.000 | 3723.000 | - | 3.53% | - |
| 605.mcf_s | -3.52% | 7018.000 | 6771.000 | - | 9.17% | - |
| 510.parest_r | -3.45% | 6353.000 | 6134.000 | - | 9.79% | - |
| 623.xalancbmk_s | -3.21% | 3736.000 | 3616.000 | - | -0.14% | - |
| 526.blender_r | -1.93% | 9156.000 | 8979.000 | - | 4.66% | - |
| 641.leela_s | -1.15% | 4192.000 | 4144.000 | - | 3.86% | - |
| Performance Improvements - sample variability | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 657.xz_s (max) | -10.60% | 302.000 | 270.000 | - | 0.00% | - |
| 657.xz_s | -10.57% | 227.000 | 203.000 | - | 0.00% | - |
| 657.xz_s (avg) | -10.57% | 227.000 | 203.000 | - | 0.00% | - |
| 620.omnetpp_s | -8.03% | 274.000 | 252.000 | - | 0.00% | - |
| 620.omnetpp_s (avg) | -8.03% | 274.000 | 252.000 | - | 0.00% | - |
| 620.omnetpp_s (max) | -8.01% | 1036.000 | 953.000 | - | 0.00% | - |
| 619.lbm_s | -7.27% | 10586.000 | 9816.000 | - | 0.00% | - |
| 619.lbm_s (avg) | -7.27% | 10586.000 | 9816.000 | - | 0.00% | - |
| 619.lbm_s (max) | -7.27% | 38134.000 | 35361.000 | - | 0.00% | - |
| 508.namd_r (max) | -6.98% | 43.000 | 40.000 | - | 0.00% | - |
| 638.imagick_s | -6.36% | 110.000 | 103.000 | - | 0.00% | - |
| 638.imagick_s (avg) | -6.36% | 110.000 | 103.000 | - | 0.00% | - |
| 638.imagick_s (max) | -5.83% | 120.000 | 113.000 | - | 0.00% | - |
| 508.namd_r | -5.77% | 52.000 | 49.000 | - | 0.00% | - |
| 508.namd_r (avg) | -5.77% | 52.000 | 49.000 | - | 0.00% | - |
| 600.perlbench_s | -5.56% | 36.000 | 34.000 | - | 0.00% | - |
| 600.perlbench_s (avg) | -5.56% | 36.000 | 34.000 | - | 0.00% | - |
| 600.perlbench_s (max) | -5.36% | 56.000 | 53.000 | - | 0.00% | - |
| 625.x264_s | -4.42% | 113.000 | 108.000 | - | 0.00% | - |
| 625.x264_s (avg) | -4.42% | 113.000 | 108.000 | - | 0.00% | - |
| 625.x264_s (max) | -4.38% | 388.000 | 371.000 | - | 0.00% | - |
| 510.parest_r | -4.17% | 48.000 | 46.000 | - | 0.00% | - |
| 510.parest_r (avg) | -4.17% | 48.000 | 46.000 | - | 0.00% | - |
| 631.deepsjeng_s (max) | -3.79% | 132.000 | 127.000 | - | 0.00% | - |
| 510.parest_r (max) | -3.73% | 134.000 | 129.000 | - | 0.00% | - |
| 605.mcf_s (max) | -3.52% | 909.000 | 877.000 | - | 0.00% | - |
| 605.mcf_s | -3.47% | 288.000 | 278.000 | - | 0.00% | - |
| 605.mcf_s (avg) | -3.47% | 288.000 | 278.000 | - | 0.00% | - |
| 631.deepsjeng_s | -3.17% | 126.000 | 122.000 | - | 0.00% | - |
| 631.deepsjeng_s (avg) | -3.17% | 126.000 | 122.000 | - | 0.00% | - |
| 623.xalancbmk_s (max) | -3.16% | 158.000 | 153.000 | - | 0.00% | - |
| 623.xalancbmk_s | -2.86% | 70.000 | 68.000 | - | 0.00% | - |
| 623.xalancbmk_s (avg) | -2.86% | 70.000 | 68.000 | - | 0.00% | - |
| 526.blender_r (max) | -2.67% | 75.000 | 73.000 | - | 0.00% | - |
| 526.blender_r | -1.25% | 80.000 | 79.000 | - | 0.00% | - |
| 526.blender_r (avg) | -1.25% | 80.000 | 79.000 | - | 0.00% | - |
| 641.leela_s (max) | -1.22% | 245.000 | 242.000 | - | 0.00% | - |
| 641.leela_s | -1.06% | 94.000 | 93.000 | - | 0.00% | - |
| 641.leela_s (avg) | -1.06% | 94.000 | 93.000 | - | 0.00% | - |
| Performance Regressions - Execution | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 619.lbm_s | 59.14% | 31060.000 | 49429.000 | - | -7.27% | - |
| 657.xz_s | 14.52% | 2287.000 | 2619.000 | - | -10.52% | - |
| 620.omnetpp_s | 11.69% | 3747.000 | 4185.000 | - | -7.96% | - |
| 602.gcc_s | 9.83% | 4203.000 | 4616.000 | - | -4.77% | - |
| 510.parest_r | 9.79% | 5587.000 | 6134.000 | - | -3.45% | - |
| 605.mcf_s | 9.17% | 6202.000 | 6771.000 | - | -3.52% | - |
| 625.x264_s | 8.98% | 2662.000 | 2901.000 | - | -4.32% | - |
| 638.imagick_s | 7.12% | 3258.000 | 3490.000 | - | -6.28% | - |
| 600.perlbench_s | 6.66% | 2298.000 | 2451.000 | - | -5.33% | - |
| 526.blender_r | 4.66% | 8579.000 | 8979.000 | - | -1.93% | - |
| 641.leela_s | 3.86% | 3990.000 | 4144.000 | - | -1.15% | - |
| 631.deepsjeng_s | 3.53% | 3596.000 | 3723.000 | - | -3.55% | - |
| 508.namd_r | 2.49% | 2445.000 | 2506.000 | - | -5.97% | - |
| 644.nab_s | 2.13% | 11109.000 | 11346.000 | - | 0.07% | - |
| Performance Improvements - Code Size | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 631.deepsjeng_s | -3.90% | 60687.000 | 58319.000 | - | -0.14% | - |
| 511.povray_r | -1.81% | 740092.000 | 726716.000 | - | 0.02% | - |
| 605.mcf_s | -1.41% | 15336.000 | 15120.000 | - | 0.00% | - |
| 644.nab_s | -1.04% | 84129.000 | 83253.000 | - | 0.10% | - |
| Performance Improvements - Execution | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 511.povray_r | -5.31% | 452.000 | 428.000 | - | 0.00% | - |
| Added Tests - sample variability |
|---|
| 508.namd_r |
| 508.namd_r (avg) |
| 508.namd_r (avg) (percentage) |
| 508.namd_r (max) |
| 508.namd_r (max) (percentage) |
| 510.parest_r |
| 510.parest_r (avg) |
| 510.parest_r (avg) (percentage) |
| 510.parest_r (max) |
| 510.parest_r (max) (percentage) |
| 511.povray_r |
| 511.povray_r (avg) |
| 511.povray_r (avg) (percentage) |
| 511.povray_r (max) |
| 511.povray_r (max) (percentage) |
| 526.blender_r |
| 526.blender_r (avg) |
| 526.blender_r (avg) (percentage) |
| 526.blender_r (max) |
| 526.blender_r (max) (percentage) |
| 600.perlbench_s |
| 600.perlbench_s (avg) |
| 600.perlbench_s (avg) (percentage) |
| 600.perlbench_s (max) |
| 600.perlbench_s (max) (percentage) |
| 605.mcf_s |
| 605.mcf_s (avg) |
| 605.mcf_s (avg) (percentage) |
| 605.mcf_s (max) |
| 605.mcf_s (max) (percentage) |
| 619.lbm_s |
| 619.lbm_s (avg) |
| 619.lbm_s (avg) (percentage) |
| 619.lbm_s (max) |
| 619.lbm_s (max) (percentage) |
| 620.omnetpp_s |
| 620.omnetpp_s (avg) |
| 620.omnetpp_s (avg) (percentage) |
| 620.omnetpp_s (max) |
| 620.omnetpp_s (max) (percentage) |
| 623.xalancbmk_s |
| 623.xalancbmk_s (avg) |
| 623.xalancbmk_s (avg) (percentage) |
| 623.xalancbmk_s (max) |
| 623.xalancbmk_s (max) (percentage) |
| 625.x264_s |
| 625.x264_s (avg) |
| 625.x264_s (avg) (percentage) |
| 625.x264_s (max) |
| 625.x264_s (max) (percentage) |
| 631.deepsjeng_s |
| 631.deepsjeng_s (avg) |
| 631.deepsjeng_s (avg) (percentage) |
| 631.deepsjeng_s (max) |
| 631.deepsjeng_s (max) (percentage) |
| 638.imagick_s |
| 638.imagick_s (avg) |
| 638.imagick_s (avg) (percentage) |
| 638.imagick_s (max) |
| 638.imagick_s (max) (percentage) |
| 641.leela_s |
| 641.leela_s (avg) |
| 641.leela_s (avg) (percentage) |
| 641.leela_s (max) |
| 641.leela_s (max) (percentage) |
| 644.nab_s |
| 644.nab_s (avg) |
| 644.nab_s (avg) (percentage) |
| 644.nab_s (max) |
| 644.nab_s (max) (percentage) |
| 657.xz_s |
| 657.xz_s (avg) |
| 657.xz_s (avg) (percentage) |
| 657.xz_s (max) |
| 657.xz_s (max) (percentage) |
Report Time: 0.35s