Fields
| hardware | None |
| os | None |
Parameters
Fields
| Name | Value |
|---|
Parameters
| Name | Value |
|---|---|
| git_llvm | https://github.com/llvm/llvm-project/commit/96dcd8cb9446492132dd3467ed2d3c84ecba5b25 (+ 891 commits) |
| test_url | https://ci.linaro.org/job/tcwg_bmk-code_size-cpu2017fast--llvm-aarch64-master-Oz_LTO-build/10/ |
Filter
llvm-aarch64-master-Oz_LTO test results
| Run | Order | Start Time | Duration |
|---|---|---|---|
| Current | 0010 (llvmorg-17-init-06803-g96dcd8cb9446) | 2023-03-27T14:32:15 | 0:00:00 |
| Previous | 0008 (llvmorg-17-init-05912-gd8efbcf9dcbb) | 2023-03-21T00:54:24 | 0:00:00 |
| Baseline | 0001 (llvmorg-17-init-03810-g04a9c62554cf) | 2023-03-03T19:15:36 | 0:00:00 |
Tests Summary
| Status Group | # | # (B) |
|---|---|---|
| Performance Regressions | 28 | 1 |
| Performance Improvements | 21 | 11 |
| Added Tests | 8 | 63 |
| Unchanged Tests | 501 | 483 |
| Total Tests | 558 |
| Performance Regressions - Execution | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 605.mcf_s | 12.84% | 5832.000 | 6581.000 | - | 3.12% | - |
| 619.lbm_s | 11.18% | 30782.000 | 34223.000 | - | -20.36% | - |
| 657.xz_s | 5.46% | 2473.000 | 2608.000 | - | -11.50% | - |
| 602.gcc_s | 4.55% | 5935.000 | 6205.000 | - | -3.45% | - |
| 526.blender_r | 2.08% | 10117.000 | 10327.000 | - | -0.04% | - |
| 638.imagick_s | 1.61% | 3164.000 | 3215.000 | - | -5.83% | - |
| 631.deepsjeng_s | 1.05% | 4373.000 | 4419.000 | - | -2.15% | - |
| Performance Regressions - sample variability | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 619.lbm_s (unexplained diff vs previous) | 10020.59% | 34.000 | 3441.000 | - | 0.00% | - |
| 619.lbm_s (unexplained diff vs previous) (percentage) | 9036.36% | 0.110 | 10.050 | - | 0.00% | - |
| 605.mcf_s (unexplained diff vs previous) | 4581.25% | 16.000 | 749.000 | - | 0.00% | - |
| 605.mcf_s (unexplained diff vs previous) (percentage) | 4114.81% | 0.270 | 11.380 | - | 0.00% | - |
| 605.mcf_s (max) | 147.08% | 342.000 | 845.000 | - | 0.00% | - |
| 605.mcf_s | 120.99% | 181.000 | 400.000 | - | 0.00% | - |
| 605.mcf_s (avg) | 120.99% | 181.000 | 400.000 | - | 0.00% | - |
| 605.mcf_s (max) (percentage) | 118.74% | 5.870 | 12.840 | - | 0.00% | - |
| 605.mcf_s (avg) (percentage) | 94.87% | 3.120 | 6.080 | - | 0.00% | - |
| 619.lbm_s | 5.81% | 4198.000 | 4442.000 | - | 0.00% | - |
| 619.lbm_s (avg) | 5.81% | 4198.000 | 4442.000 | - | 0.00% | - |
| 657.xz_s | 5.06% | 158.000 | 166.000 | - | 0.00% | - |
| 657.xz_s (avg) | 5.06% | 158.000 | 166.000 | - | 0.00% | - |
| 619.lbm_s (max) | 3.94% | 7707.000 | 8011.000 | - | 0.00% | - |
| 526.blender_r (max) | 3.03% | 33.000 | 34.000 | - | 0.00% | - |
| 526.blender_r | 1.75% | 57.000 | 58.000 | - | 0.00% | - |
| 526.blender_r (avg) | 1.75% | 57.000 | 58.000 | - | 0.00% | - |
| 638.imagick_s | 1.75% | 57.000 | 58.000 | - | 0.00% | - |
| 638.imagick_s (avg) | 1.75% | 57.000 | 58.000 | - | 0.00% | - |
| 625.x264_s | 1.61% | 62.000 | 63.000 | - | 0.00% | - |
| 625.x264_s (avg) | 1.61% | 62.000 | 63.000 | - | 0.00% | - |
| Performance Improvements - Execution | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 511.povray_r | -3.04% | 526.000 | 510.000 | - | -4.14% | - |
| Performance Improvements - sample variability | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 625.x264_s (max) (percentage) | -10.10% | 1.980 | 1.780 | - | 0.00% | - |
| 625.x264_s (max) | -8.51% | 94.000 | 86.000 | - | 0.00% | - |
| 511.povray_r (max) | -7.69% | 13.000 | 12.000 | - | 0.00% | - |
| 600.perlbench_s (max) | -7.45% | 255.000 | 236.000 | - | 0.00% | - |
| 508.namd_r (max) | -6.72% | 119.000 | 111.000 | - | 0.00% | - |
| 511.povray_r (max) (percentage) | -6.56% | 2.590 | 2.420 | - | 0.00% | - |
| 600.perlbench_s (max) (percentage) | -6.54% | 7.800 | 7.290 | - | 0.00% | - |
| 657.xz_s (max) (percentage) | -6.53% | 11.800 | 11.030 | - | 0.00% | - |
| 508.namd_r (max) (percentage) | -6.52% | 4.600 | 4.300 | - | 0.00% | - |
| 619.lbm_s (max) (percentage) | -6.51% | 25.040 | 23.410 | - | 0.00% | - |
| 631.deepsjeng_s (max) (percentage) | -6.27% | 2.710 | 2.540 | - | 0.00% | - |
| 638.imagick_s (max) (percentage) | -5.79% | 3.970 | 3.740 | - | 0.00% | - |
| 631.deepsjeng_s (max) | -5.08% | 118.000 | 112.000 | - | 0.00% | - |
| 619.lbm_s (avg) (percentage) | -4.84% | 13.640 | 12.980 | - | 0.00% | - |
| 644.nab_s (max) (percentage) | -4.24% | 1.180 | 1.130 | - | 0.00% | - |
| 638.imagick_s (max) | -4.00% | 125.000 | 120.000 | - | 0.00% | - |
| 644.nab_s (max) | -3.68% | 136.000 | 131.000 | - | 0.00% | - |
| 657.xz_s (max) | -1.37% | 291.000 | 287.000 | - | 0.00% | - |
| Performance Improvements - Score | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| nb_execution_successful | 33.33% | 12.000 | 16.000 | - | 33.33% | - |
| nb_compile_successful | 14.29% | 14.000 | 16.000 | - | 14.29% | - |
| Added Tests - Code Size |
|---|
| 510.parest_r |
| 620.omnetpp_s |
| 623.xalancbmk_s |
| 641.leela_s |
| Added Tests - Execution |
|---|
| 510.parest_r |
| 620.omnetpp_s |
| 623.xalancbmk_s |
| 641.leela_s |
| Performance Regressions - Execution | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 605.mcf_s | 3.12% | 6382.000 | 6581.000 | - | 12.84% | - |
| Performance Improvements - Execution | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 619.lbm_s | -20.36% | 42973.000 | 34223.000 | - | 11.18% | - |
| 657.xz_s | -11.50% | 2947.000 | 2608.000 | - | 5.46% | - |
| 600.perlbench_s | -8.02% | 3527.000 | 3244.000 | - | -0.80% | - |
| 638.imagick_s | -5.83% | 3414.000 | 3215.000 | - | 1.61% | - |
| 511.povray_r | -4.14% | 532.000 | 510.000 | - | -3.04% | - |
| 508.namd_r | -3.77% | 2703.000 | 2601.000 | - | 0.27% | - |
| 602.gcc_s | -3.45% | 6427.000 | 6205.000 | - | 4.55% | - |
| 631.deepsjeng_s | -2.15% | 4516.000 | 4419.000 | - | 1.05% | - |
| 625.x264_s | -1.69% | 4915.000 | 4832.000 | - | 0.90% | - |
| Performance Improvements - Score | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| nb_execution_successful | 33.33% | 12.000 | 16.000 | - | 33.33% | - |
| nb_compile_successful | 14.29% | 14.000 | 16.000 | - | 14.29% | - |
| Added Tests - Code Size |
|---|
| 510.parest_r |
| 620.omnetpp_s |
| 623.xalancbmk_s |
| 641.leela_s |
| Added Tests - Execution |
|---|
| 510.parest_r |
| 620.omnetpp_s |
| 623.xalancbmk_s |
| 641.leela_s |
| Added Tests - sample variability |
|---|
| 508.namd_r |
| 508.namd_r (avg) |
| 508.namd_r (avg) (percentage) |
| 508.namd_r (max) |
| 508.namd_r (max) (percentage) |
| 511.povray_r |
| 511.povray_r (avg) |
| 511.povray_r (avg) (percentage) |
| 511.povray_r (max) |
| 511.povray_r (max) (percentage) |
| 526.blender_r |
| 526.blender_r (avg) |
| 526.blender_r (avg) (percentage) |
| 526.blender_r (max) |
| 526.blender_r (max) (percentage) |
| 600.perlbench_s |
| 600.perlbench_s (avg) |
| 600.perlbench_s (avg) (percentage) |
| 600.perlbench_s (max) |
| 600.perlbench_s (max) (percentage) |
| 605.mcf_s |
| 605.mcf_s (avg) |
| 605.mcf_s (avg) (percentage) |
| 605.mcf_s (max) |
| 605.mcf_s (max) (percentage) |
| 619.lbm_s |
| 619.lbm_s (avg) |
| 619.lbm_s (avg) (percentage) |
| 619.lbm_s (max) |
| 619.lbm_s (max) (percentage) |
| 625.x264_s |
| 625.x264_s (avg) |
| 625.x264_s (avg) (percentage) |
| 625.x264_s (max) |
| 625.x264_s (max) (percentage) |
| 631.deepsjeng_s |
| 631.deepsjeng_s (avg) |
| 631.deepsjeng_s (avg) (percentage) |
| 631.deepsjeng_s (max) |
| 631.deepsjeng_s (max) (percentage) |
| 638.imagick_s |
| 638.imagick_s (avg) |
| 638.imagick_s (avg) (percentage) |
| 638.imagick_s (max) |
| 638.imagick_s (max) (percentage) |
| 644.nab_s |
| 644.nab_s (avg) |
| 644.nab_s (avg) (percentage) |
| 644.nab_s (max) |
| 644.nab_s (max) (percentage) |
| 657.xz_s |
| 657.xz_s (avg) |
| 657.xz_s (avg) (percentage) |
| 657.xz_s (max) |
| 657.xz_s (max) (percentage) |
Report Time: 0.21s