Fields
| hardware | None |
| os | None |
Parameters
Fields
| Name | Value |
|---|
Parameters
| Name | Value |
|---|---|
| git_llvm | https://github.com/llvm/llvm-project/commit/e1b569b96a06efe0993f7e478657337a6075cd71 (+ 165 commits) |
| test_url | https://ci.linaro.org/job/tcwg_bmk-code_size-cpu2017fast--llvm-aarch64-master-Os_LTO-build/3/ |
Filter
llvm-aarch64-master-Os_LTO test results
| Run | Order | Start Time | Duration |
|---|---|---|---|
| Current | 0003 (llvmorg-17-init-04006-ge1b569b96a06) | 2023-03-04T12:08:49 | 0:00:00 |
| Previous | 0002 (llvmorg-17-init-03841-gc7af9ae577bb) | 2023-03-02T00:28:47 | 0:00:00 |
| Baseline | 0001 (llvmorg-17-init-03361-gd77f96a9e0c8) | 2023-02-27T23:41:40 | 0:00:00 |
Tests Summary
| Status Group | # | # (B) |
|---|---|---|
| Performance Regressions | 9 | 16 |
| Performance Improvements | 52 | 0 |
| Added Tests | 26 | 66 |
| Unchanged Tests | 579 | 584 |
| Total Tests | 666 |
| Performance Regressions - Execution | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 657.xz_s | 2.67% | 3103.000 | 3186.000 | - | 39.31% | - |
| 619.lbm_s | 2.24% | 55026.000 | 56259.000 | - | 81.13% | - |
| 600.perlbench_s | 2.20% | 2676.000 | 2735.000 | - | 19.02% | - |
| 638.imagick_s | 2.20% | 3730.000 | 3812.000 | - | 17.00% | - |
| 508.namd_r | 1.52% | 2636.000 | 2676.000 | - | 9.45% | - |
| 641.leela_s | 1.16% | 4234.000 | 4283.000 | - | 7.34% | - |
| 511.povray_r | 1.08% | 461.000 | 466.000 | - | 3.10% | - |
| Performance Regressions - sample variability | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 638.imagick_s | 2.22% | 540.000 | 552.000 | - | 0.00% | - |
| 638.imagick_s (avg) | 2.22% | 540.000 | 552.000 | - | 0.00% | - |
| Performance Improvements - Execution | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 620.omnetpp_s | -2.28% | 4830.000 | 4720.000 | - | 25.97% | - |
| Performance Improvements - sample variability | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 625.x264_s (unexplained diff vs previous) (percentage) | -99.77% | 13.030 | 0.030 | - | 0.00% | - |
| 625.x264_s (unexplained diff vs previous) | -99.75% | 399.000 | 1.000 | - | 0.00% | - |
| 605.mcf_s (unexplained diff vs previous) (percentage) | -96.30% | 15.120 | 0.560 | - | 0.00% | - |
| 605.mcf_s (unexplained diff vs previous) | -96.29% | 1105.000 | 41.000 | - | 0.00% | - |
| 619.lbm_s (unexplained diff vs previous) (percentage) | -94.97% | 43.550 | 2.190 | - | 0.00% | - |
| 619.lbm_s (unexplained diff vs previous) | -94.86% | 23966.000 | 1233.000 | - | 0.00% | - |
| 631.deepsjeng_s (unexplained diff vs previous) (percentage) | -93.63% | 10.840 | 0.690 | - | 0.00% | - |
| 631.deepsjeng_s (unexplained diff vs previous) | -93.59% | 437.000 | 28.000 | - | 0.00% | - |
| 657.xz_s (unexplained diff vs previous) (percentage) | -90.08% | 26.300 | 2.610 | - | 0.00% | - |
| 620.omnetpp_s (unexplained diff vs previous) | -89.84% | 1083.000 | 110.000 | - | 0.00% | - |
| 657.xz_s (unexplained diff vs previous) | -89.83% | 816.000 | 83.000 | - | 0.00% | - |
| 620.omnetpp_s (unexplained diff vs previous) (percentage) | -89.61% | 22.420 | 2.330 | - | 0.00% | - |
| 508.namd_r (unexplained diff vs previous) (percentage) | -79.45% | 7.250 | 1.490 | - | 0.00% | - |
| 508.namd_r (unexplained diff vs previous) | -79.06% | 191.000 | 40.000 | - | 0.00% | - |
| 625.x264_s | -66.59% | 458.000 | 153.000 | - | 0.00% | - |
| 625.x264_s (avg) | -66.59% | 458.000 | 153.000 | - | 0.00% | - |
| 625.x264_s (avg) (percentage) | -66.51% | 14.990 | 5.020 | - | 0.00% | - |
| 605.mcf_s | -64.82% | 1302.000 | 458.000 | - | 0.00% | - |
| 605.mcf_s (avg) | -64.82% | 1302.000 | 458.000 | - | 0.00% | - |
| 619.lbm_s (avg) (percentage) | -64.74% | 77.160 | 27.210 | - | 0.00% | - |
| 605.mcf_s (avg) (percentage) | -64.59% | 17.820 | 6.310 | - | 0.00% | - |
| 619.lbm_s | -63.95% | 42458.000 | 15308.000 | - | 0.00% | - |
| 619.lbm_s (avg) | -63.95% | 42458.000 | 15308.000 | - | 0.00% | - |
| 631.deepsjeng_s (avg) (percentage) | -62.88% | 12.150 | 4.510 | - | 0.00% | - |
| 631.deepsjeng_s | -62.65% | 490.000 | 183.000 | - | 0.00% | - |
| 631.deepsjeng_s (avg) | -62.65% | 490.000 | 183.000 | - | 0.00% | - |
| 620.omnetpp_s | -62.29% | 1395.000 | 526.000 | - | 0.00% | - |
| 620.omnetpp_s (avg) | -62.29% | 1395.000 | 526.000 | - | 0.00% | - |
| 657.xz_s (avg) (percentage) | -61.69% | 35.680 | 13.670 | - | 0.00% | - |
| 620.omnetpp_s (avg) (percentage) | -61.42% | 28.900 | 11.150 | - | 0.00% | - |
| 657.xz_s | -60.70% | 1107.000 | 435.000 | - | 0.00% | - |
| 657.xz_s (avg) | -60.70% | 1107.000 | 435.000 | - | 0.00% | - |
| 508.namd_r (avg) (percentage) | -53.65% | 7.810 | 3.620 | - | 0.00% | - |
| 508.namd_r | -53.17% | 205.000 | 96.000 | - | 0.00% | - |
| 508.namd_r (avg) | -53.17% | 205.000 | 96.000 | - | 0.00% | - |
| 620.omnetpp_s (max) | -26.67% | 1395.000 | 1023.000 | - | 0.00% | - |
| 605.mcf_s (max) | -25.50% | 1302.000 | 970.000 | - | 0.00% | - |
| 605.mcf_s (max) (percentage) | -25.03% | 17.820 | 13.360 | - | 0.00% | - |
| 631.deepsjeng_s (max) (percentage) | -25.02% | 12.150 | 9.110 | - | 0.00% | - |
| 625.x264_s (max) (percentage) | -25.02% | 14.990 | 11.240 | - | 0.00% | - |
| 619.lbm_s (max) (percentage) | -25.00% | 77.160 | 57.870 | - | 0.00% | - |
| 657.xz_s (max) (percentage) | -25.00% | 35.680 | 26.760 | - | 0.00% | - |
| 638.imagick_s (max) (percentage) | -24.98% | 14.490 | 10.870 | - | 0.00% | - |
| 620.omnetpp_s (max) (percentage) | -24.98% | 28.900 | 21.680 | - | 0.00% | - |
| 508.namd_r (max) (percentage) | -24.97% | 7.810 | 5.860 | - | 0.00% | - |
| 625.x264_s (max) | -24.89% | 458.000 | 344.000 | - | 0.00% | - |
| 631.deepsjeng_s (max) | -24.69% | 490.000 | 369.000 | - | 0.00% | - |
| 508.namd_r (max) | -23.90% | 205.000 | 156.000 | - | 0.00% | - |
| 638.imagick_s (max) | -23.33% | 540.000 | 414.000 | - | 0.00% | - |
| 619.lbm_s (max) | -23.32% | 42458.000 | 32557.000 | - | 0.00% | - |
| 657.xz_s (max) | -23.04% | 1107.000 | 852.000 | - | 0.00% | - |
| Added Tests - sample variability |
|---|
| 510.parest_r |
| 510.parest_r (avg) |
| 510.parest_r (avg) (percentage) |
| 510.parest_r (unexplained diff vs previous) |
| 510.parest_r (unexplained diff vs previous) (percentage) |
| 511.povray_r (max) |
| 511.povray_r (max) (percentage) |
| 526.blender_r (max) |
| 526.blender_r (max) (percentage) |
| 600.perlbench_s (max) |
| 600.perlbench_s (max) (percentage) |
| 623.xalancbmk_s |
| 623.xalancbmk_s (avg) |
| 623.xalancbmk_s (avg) (percentage) |
| 623.xalancbmk_s (unexplained diff vs previous) |
| 623.xalancbmk_s (unexplained diff vs previous) (percentage) |
| 641.leela_s |
| 641.leela_s (avg) |
| 641.leela_s (avg) (percentage) |
| 641.leela_s (unexplained diff vs previous) |
| 641.leela_s (unexplained diff vs previous) (percentage) |
| 644.nab_s |
| 644.nab_s (avg) |
| 644.nab_s (avg) (percentage) |
| 644.nab_s (unexplained diff vs previous) |
| 644.nab_s (unexplained diff vs previous) (percentage) |
| Performance Regressions - Execution | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 619.lbm_s | 81.13% | 31060.000 | 56259.000 | - | 2.24% | - |
| 657.xz_s | 39.31% | 2287.000 | 3186.000 | - | 2.67% | - |
| 620.omnetpp_s | 25.97% | 3747.000 | 4720.000 | - | -2.28% | - |
| 602.gcc_s | 21.72% | 4203.000 | 5116.000 | - | 0.45% | - |
| 600.perlbench_s | 19.02% | 2298.000 | 2735.000 | - | 2.20% | - |
| 510.parest_r | 18.26% | 5587.000 | 6607.000 | - | 0.78% | - |
| 605.mcf_s | 17.16% | 6202.000 | 7266.000 | - | -0.56% | - |
| 638.imagick_s | 17.00% | 3258.000 | 3812.000 | - | 2.20% | - |
| 625.x264_s | 15.03% | 2662.000 | 3062.000 | - | 0.03% | - |
| 631.deepsjeng_s | 12.93% | 3596.000 | 4061.000 | - | 0.69% | - |
| 508.namd_r | 9.45% | 2445.000 | 2676.000 | - | 1.52% | - |
| 623.xalancbmk_s | 8.37% | 3621.000 | 3924.000 | - | 0.93% | - |
| 641.leela_s | 7.34% | 3990.000 | 4283.000 | - | 1.16% | - |
| 526.blender_r | 7.23% | 8579.000 | 9199.000 | - | 0.57% | - |
| 644.nab_s | 3.34% | 11109.000 | 11480.000 | - | 0.05% | - |
| 511.povray_r | 3.10% | 452.000 | 466.000 | - | 1.08% | - |
| Added Tests - sample variability |
|---|
| 508.namd_r |
| 508.namd_r (avg) |
| 508.namd_r (avg) (percentage) |
| 508.namd_r (max) |
| 508.namd_r (max) (percentage) |
| 510.parest_r |
| 510.parest_r (avg) |
| 510.parest_r (avg) (percentage) |
| 510.parest_r (max) |
| 510.parest_r (max) (percentage) |
| 511.povray_r (max) |
| 511.povray_r (max) (percentage) |
| 526.blender_r (max) |
| 526.blender_r (max) (percentage) |
| 600.perlbench_s (max) |
| 600.perlbench_s (max) (percentage) |
| 605.mcf_s |
| 605.mcf_s (avg) |
| 605.mcf_s (avg) (percentage) |
| 605.mcf_s (max) |
| 605.mcf_s (max) (percentage) |
| 619.lbm_s |
| 619.lbm_s (avg) |
| 619.lbm_s (avg) (percentage) |
| 619.lbm_s (max) |
| 619.lbm_s (max) (percentage) |
| 620.omnetpp_s |
| 620.omnetpp_s (avg) |
| 620.omnetpp_s (avg) (percentage) |
| 620.omnetpp_s (max) |
| 620.omnetpp_s (max) (percentage) |
| 623.xalancbmk_s |
| 623.xalancbmk_s (avg) |
| 623.xalancbmk_s (avg) (percentage) |
| 623.xalancbmk_s (max) |
| 623.xalancbmk_s (max) (percentage) |
| 625.x264_s |
| 625.x264_s (avg) |
| 625.x264_s (avg) (percentage) |
| 625.x264_s (max) |
| 625.x264_s (max) (percentage) |
| 631.deepsjeng_s |
| 631.deepsjeng_s (avg) |
| 631.deepsjeng_s (avg) (percentage) |
| 631.deepsjeng_s (max) |
| 631.deepsjeng_s (max) (percentage) |
| 638.imagick_s |
| 638.imagick_s (avg) |
| 638.imagick_s (avg) (percentage) |
| 638.imagick_s (max) |
| 638.imagick_s (max) (percentage) |
| 641.leela_s |
| 641.leela_s (avg) |
| 641.leela_s (avg) (percentage) |
| 641.leela_s (max) |
| 641.leela_s (max) (percentage) |
| 644.nab_s |
| 644.nab_s (avg) |
| 644.nab_s (avg) (percentage) |
| 644.nab_s (max) |
| 644.nab_s (max) (percentage) |
| 657.xz_s |
| 657.xz_s (avg) |
| 657.xz_s (avg) (percentage) |
| 657.xz_s (max) |
| 657.xz_s (max) (percentage) |
Report Time: 0.22s