Fields
| hardware | None |
| os | None |
Parameters
Fields
| Name | Value |
|---|
Parameters
| Name | Value |
|---|---|
| git_llvm | https://github.com/llvm/llvm-project/commit/dd72b81334bb155e6e3511311f9137550aff915e (+ 444 commits) |
| test_url | https://ci.linaro.org/job/tcwg_bmk-code_size-cpu2017fast--llvm-aarch64-master-Os_LTO-build/32/ |
Filter
llvm-aarch64-master-Os_LTO test results
| Run | Order | Start Time | Duration |
|---|---|---|---|
| Current | 0032 (llvmorg-17-init-13905-gdd72b81334bb) | 2023-06-03T13:39:04 | 0:00:00 |
| Previous | 0031 (llvmorg-17-init-13461-g6effec1a5058) | 2023-05-30T08:46:39 | 0:00:00 |
| Baseline | 0001 (llvmorg-17-init-03361-gd77f96a9e0c8) | 2023-02-27T23:41:40 | 0:00:00 |
Tests Summary
| Status Group | # | # (B) |
|---|---|---|
| Performance Regressions | 4 | 0 |
| Performance Improvements | 50 | 8 |
| Added Tests | 4 | 75 |
| Unchanged Tests | 644 | 619 |
| Total Tests | 702 |
| Performance Regressions - sample variability | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 526.blender_r | 1.25% | 80.000 | 81.000 | - | 0.00% | - |
| 526.blender_r (avg) | 1.25% | 80.000 | 81.000 | - | 0.00% | - |
| 638.imagick_s | 1.16% | 86.000 | 87.000 | - | 0.00% | - |
| 638.imagick_s (avg) | 1.16% | 86.000 | 87.000 | - | 0.00% | - |
| Performance Improvements - Execution | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 600.perlbench_s | -3.47% | 2365.000 | 2283.000 | - | -0.65% | - |
| 623.xalancbmk_s | -2.47% | 3560.000 | 3472.000 | - | -4.11% | - |
| 657.xz_s | -1.27% | 2292.000 | 2263.000 | - | -1.05% | - |
| Performance Improvements - sample variability | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 619.lbm_s (unexplained diff vs previous) | -99.22% | 15478.000 | 120.000 | - | 0.00% | - |
| 619.lbm_s (unexplained diff vs previous) (percentage) | -99.22% | 49.970 | 0.390 | - | 0.00% | - |
| 625.x264_s (unexplained diff vs previous) (percentage) | -95.93% | 9.100 | 0.370 | - | 0.00% | - |
| 625.x264_s (unexplained diff vs previous) | -95.87% | 242.000 | 10.000 | - | 0.00% | - |
| 620.omnetpp_s (unexplained diff vs previous) (percentage) | -94.72% | 14.010 | 0.740 | - | 0.00% | - |
| 620.omnetpp_s (unexplained diff vs previous) | -94.68% | 526.000 | 28.000 | - | 0.00% | - |
| 619.lbm_s (max) (percentage) | -41.45% | 42.680 | 24.990 | - | 0.00% | - |
| 619.lbm_s (max) | -41.22% | 13220.000 | 7771.000 | - | 0.00% | - |
| 625.x264_s (max) (percentage) | -34.45% | 9.550 | 6.260 | - | 0.00% | - |
| 625.x264_s (max) | -33.99% | 253.000 | 167.000 | - | 0.00% | - |
| 620.omnetpp_s (max) (percentage) | -24.98% | 12.290 | 9.220 | - | 0.00% | - |
| 620.omnetpp_s (max) | -24.51% | 461.000 | 348.000 | - | 0.00% | - |
| 508.namd_r (avg) (percentage) | -9.21% | 2.390 | 2.170 | - | 0.00% | - |
| 508.namd_r | -8.62% | 58.000 | 53.000 | - | 0.00% | - |
| 508.namd_r (avg) | -8.62% | 58.000 | 53.000 | - | 0.00% | - |
| 619.lbm_s (avg) (percentage) | -8.36% | 17.950 | 16.450 | - | 0.00% | - |
| 619.lbm_s | -8.00% | 5560.000 | 5115.000 | - | 0.00% | - |
| 619.lbm_s (avg) | -8.00% | 5560.000 | 5115.000 | - | 0.00% | - |
| 625.x264_s (avg) (percentage) | -7.27% | 3.440 | 3.190 | - | 0.00% | - |
| 508.namd_r (max) (percentage) | -7.10% | 6.760 | 6.280 | - | 0.00% | - |
| 605.mcf_s (avg) (percentage) | -6.80% | 3.380 | 3.150 | - | 0.00% | - |
| 508.namd_r (max) | -6.67% | 165.000 | 154.000 | - | 0.00% | - |
| 620.omnetpp_s (avg) (percentage) | -6.62% | 5.290 | 4.940 | - | 0.00% | - |
| 625.x264_s | -6.59% | 91.000 | 85.000 | - | 0.00% | - |
| 625.x264_s (avg) | -6.59% | 91.000 | 85.000 | - | 0.00% | - |
| 605.mcf_s | -6.22% | 209.000 | 196.000 | - | 0.00% | - |
| 605.mcf_s (avg) | -6.22% | 209.000 | 196.000 | - | 0.00% | - |
| 605.mcf_s (max) (percentage) | -6.21% | 8.050 | 7.550 | - | 0.00% | - |
| 620.omnetpp_s | -6.06% | 198.000 | 186.000 | - | 0.00% | - |
| 620.omnetpp_s (avg) | -6.06% | 198.000 | 186.000 | - | 0.00% | - |
| 644.nab_s (max) (percentage) | -5.92% | 1.520 | 1.430 | - | 0.00% | - |
| 600.perlbench_s (max) | -5.66% | 53.000 | 50.000 | - | 0.00% | - |
| 605.mcf_s (max) | -5.62% | 498.000 | 470.000 | - | 0.00% | - |
| 644.nab_s (max) | -5.42% | 166.000 | 157.000 | - | 0.00% | - |
| 623.xalancbmk_s (max) | -4.89% | 184.000 | 175.000 | - | 0.00% | - |
| 600.perlbench_s | -4.17% | 24.000 | 23.000 | - | 0.00% | - |
| 600.perlbench_s (avg) | -4.17% | 24.000 | 23.000 | - | 0.00% | - |
| 631.deepsjeng_s (max) | -3.86% | 311.000 | 299.000 | - | 0.00% | - |
| 631.deepsjeng_s (max) (percentage) | -3.77% | 9.020 | 8.680 | - | 0.00% | - |
| 641.leela_s (max) (percentage) | -3.75% | 5.070 | 4.880 | - | 0.00% | - |
| 641.leela_s (max) | -3.48% | 201.000 | 194.000 | - | 0.00% | - |
| 623.xalancbmk_s | -2.86% | 70.000 | 68.000 | - | 0.00% | - |
| 623.xalancbmk_s (avg) | -2.86% | 70.000 | 68.000 | - | 0.00% | - |
| 657.xz_s (max) | -2.69% | 372.000 | 362.000 | - | 0.00% | - |
| 623.xalancbmk_s (max) (percentage) | -2.13% | 5.170 | 5.060 | - | 0.00% | - |
| 638.imagick_s (max) (percentage) | -1.28% | 7.050 | 6.960 | - | 0.00% | - |
| 657.xz_s (max) (percentage) | -1.23% | 16.240 | 16.040 | - | 0.00% | - |
| Added Tests - sample variability |
|---|
| 508.namd_r (unexplained diff vs previous) |
| 508.namd_r (unexplained diff vs previous) (percentage) |
| 605.mcf_s (unexplained diff vs previous) |
| 605.mcf_s (unexplained diff vs previous) (percentage) |
| Performance Improvements - Code Size | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 631.deepsjeng_s | -3.84% | 60687.000 | 58359.000 | - | -0.17% | - |
| 511.povray_r | -1.81% | 740092.000 | 726688.000 | - | -0.03% | - |
| 644.nab_s | -1.09% | 84129.000 | 83209.000 | - | -0.23% | - |
| Performance Improvements - Execution | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 623.xalancbmk_s | -4.11% | 3621.000 | 3472.000 | - | -2.47% | - |
| 631.deepsjeng_s | -4.06% | 3596.000 | 3450.000 | - | -0.06% | - |
| 511.povray_r | -3.76% | 452.000 | 435.000 | - | 0.23% | - |
| 602.gcc_s | -1.09% | 4203.000 | 4157.000 | - | -0.02% | - |
| 657.xz_s | -1.05% | 2287.000 | 2263.000 | - | -1.27% | - |
| Added Tests - sample variability |
|---|
| 508.namd_r |
| 508.namd_r (avg) |
| 508.namd_r (avg) (percentage) |
| 508.namd_r (max) |
| 508.namd_r (max) (percentage) |
| 510.parest_r |
| 510.parest_r (avg) |
| 510.parest_r (avg) (percentage) |
| 510.parest_r (max) |
| 510.parest_r (max) (percentage) |
| 511.povray_r |
| 511.povray_r (avg) |
| 511.povray_r (avg) (percentage) |
| 511.povray_r (max) |
| 511.povray_r (max) (percentage) |
| 526.blender_r |
| 526.blender_r (avg) |
| 526.blender_r (avg) (percentage) |
| 526.blender_r (max) |
| 526.blender_r (max) (percentage) |
| 600.perlbench_s |
| 600.perlbench_s (avg) |
| 600.perlbench_s (avg) (percentage) |
| 600.perlbench_s (max) |
| 600.perlbench_s (max) (percentage) |
| 605.mcf_s |
| 605.mcf_s (avg) |
| 605.mcf_s (avg) (percentage) |
| 605.mcf_s (max) |
| 605.mcf_s (max) (percentage) |
| 619.lbm_s |
| 619.lbm_s (avg) |
| 619.lbm_s (avg) (percentage) |
| 619.lbm_s (max) |
| 619.lbm_s (max) (percentage) |
| 620.omnetpp_s |
| 620.omnetpp_s (avg) |
| 620.omnetpp_s (avg) (percentage) |
| 620.omnetpp_s (max) |
| 620.omnetpp_s (max) (percentage) |
| 623.xalancbmk_s |
| 623.xalancbmk_s (avg) |
| 623.xalancbmk_s (avg) (percentage) |
| 623.xalancbmk_s (max) |
| 623.xalancbmk_s (max) (percentage) |
| 625.x264_s |
| 625.x264_s (avg) |
| 625.x264_s (avg) (percentage) |
| 625.x264_s (max) |
| 625.x264_s (max) (percentage) |
| 631.deepsjeng_s |
| 631.deepsjeng_s (avg) |
| 631.deepsjeng_s (avg) (percentage) |
| 631.deepsjeng_s (max) |
| 631.deepsjeng_s (max) (percentage) |
| 638.imagick_s |
| 638.imagick_s (avg) |
| 638.imagick_s (avg) (percentage) |
| 638.imagick_s (max) |
| 638.imagick_s (max) (percentage) |
| 641.leela_s |
| 641.leela_s (avg) |
| 641.leela_s (avg) (percentage) |
| 641.leela_s (max) |
| 641.leela_s (max) (percentage) |
| 644.nab_s |
| 644.nab_s (avg) |
| 644.nab_s (avg) (percentage) |
| 644.nab_s (max) |
| 644.nab_s (max) (percentage) |
| 657.xz_s |
| 657.xz_s (avg) |
| 657.xz_s (avg) (percentage) |
| 657.xz_s (max) |
| 657.xz_s (max) (percentage) |
Report Time: 0.34s