Fields
| hardware | None |
| os | None |
Parameters
Fields
| Name | Value |
|---|
Parameters
| Name | Value |
|---|---|
| git_llvm | https://github.com/llvm/llvm-project/commit/aa84981224e614da95d11ce12770109132c02d41 (+ 222 commits) |
| test_url | https://ci.linaro.org/job/tcwg_bmk-code_size-cpu2017fast--llvm-aarch64-master-Os_LTO-build/19/ |
Filter
llvm-aarch64-master-Os_LTO test results
| Run | Order | Start Time | Duration |
|---|---|---|---|
| Current | 0019 (llvmorg-17-init-08988-gaa84981224e6) | 2023-04-19T05:17:59 | 0:00:00 |
| Previous | 0018 (llvmorg-17-init-08766-g2ae1aa9da788) | 2023-04-15T20:05:08 | 0:00:00 |
| Baseline | 0001 (llvmorg-17-init-03361-gd77f96a9e0c8) | 2023-02-27T23:41:40 | 0:00:00 |
Tests Summary
| Status Group | # | # (B) |
|---|---|---|
| Performance Regressions | 93 | 15 |
| Performance Improvements | 4 | 2 |
| Added Tests | 10 | 75 |
| Unchanged Tests | 595 | 610 |
| Total Tests | 702 |
| Performance Regressions - Execution | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 619.lbm_s | 48.80% | 31102.000 | 46281.000 | - | 49.01% | - |
| 657.xz_s | 25.10% | 2267.000 | 2836.000 | - | 24.01% | - |
| 620.omnetpp_s | 13.29% | 3771.000 | 4272.000 | - | 14.01% | - |
| 602.gcc_s | 11.29% | 4180.000 | 4652.000 | - | 10.68% | - |
| 600.perlbench_s | 10.45% | 2316.000 | 2558.000 | - | 11.31% | - |
| 605.mcf_s | 10.19% | 6155.000 | 6782.000 | - | 9.35% | - |
| 638.imagick_s | 9.70% | 3259.000 | 3575.000 | - | 9.73% | - |
| 510.parest_r | 9.03% | 5558.000 | 6060.000 | - | 8.47% | - |
| 625.x264_s | 8.51% | 2667.000 | 2894.000 | - | 8.72% | - |
| 631.deepsjeng_s | 7.82% | 3441.000 | 3710.000 | - | 3.17% | - |
| 508.namd_r | 5.88% | 2451.000 | 2595.000 | - | 6.13% | - |
| 623.xalancbmk_s | 4.81% | 3556.000 | 3727.000 | - | 2.93% | - |
| 641.leela_s | 4.56% | 3988.000 | 4170.000 | - | 4.51% | - |
| 526.blender_r | 4.16% | 8516.000 | 8870.000 | - | 3.39% | - |
| 511.povray_r | 1.79% | 446.000 | 454.000 | - | 0.44% | - |
| 644.nab_s | 1.45% | 11157.000 | 11319.000 | - | 1.89% | - |
| Performance Regressions - sample variability | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 631.deepsjeng_s (unexplained diff vs previous) | 8866.67% | 3.000 | 269.000 | - | 0.00% | - |
| 631.deepsjeng_s (unexplained diff vs previous) (percentage) | 7955.56% | 0.090 | 7.250 | - | 0.00% | - |
| 620.omnetpp_s (unexplained diff vs previous) | 7057.14% | 7.000 | 501.000 | - | 0.00% | - |
| 620.omnetpp_s (unexplained diff vs previous) (percentage) | 6073.68% | 0.190 | 11.730 | - | 0.00% | - |
| 625.x264_s (unexplained diff vs previous) | 3683.33% | 6.000 | 227.000 | - | 0.00% | - |
| 625.x264_s (unexplained diff vs previous) (percentage) | 3463.64% | 0.220 | 7.840 | - | 0.00% | - |
| 508.namd_r (unexplained diff vs previous) | 2300.00% | 6.000 | 144.000 | - | 0.00% | - |
| 508.namd_r (unexplained diff vs previous) (percentage) | 2212.50% | 0.240 | 5.550 | - | 0.00% | - |
| 605.mcf_s (unexplained diff vs previous) | 1467.50% | 40.000 | 627.000 | - | 0.00% | - |
| 605.mcf_s (unexplained diff vs previous) (percentage) | 1323.08% | 0.650 | 9.250 | - | 0.00% | - |
| 657.xz_s (max) | 540.54% | 111.000 | 711.000 | - | 0.00% | - |
| 641.leela_s (max) | 458.82% | 34.000 | 190.000 | - | 0.00% | - |
| 619.lbm_s (max) | 443.17% | 4158.000 | 22585.000 | - | 0.00% | - |
| 641.leela_s (max) (percentage) | 430.23% | 0.860 | 4.560 | - | 0.00% | - |
| 657.xz_s (max) (percentage) | 412.24% | 4.900 | 25.100 | - | 0.00% | - |
| 625.x264_s (max) | 382.35% | 51.000 | 246.000 | - | 0.00% | - |
| 620.omnetpp_s (max) | 380.51% | 118.000 | 567.000 | - | 0.00% | - |
| 623.xalancbmk_s (max) | 347.50% | 40.000 | 179.000 | - | 0.00% | - |
| 625.x264_s (max) (percentage) | 343.23% | 1.920 | 8.510 | - | 0.00% | - |
| 631.deepsjeng_s (max) | 332.84% | 67.000 | 290.000 | - | 0.00% | - |
| 620.omnetpp_s (max) (percentage) | 323.25% | 3.140 | 13.290 | - | 0.00% | - |
| 623.xalancbmk_s (max) (percentage) | 321.93% | 1.140 | 4.810 | - | 0.00% | - |
| 623.xalancbmk_s (unexplained diff vs previous) | 317.07% | 41.000 | 171.000 | - | 0.00% | - |
| 623.xalancbmk_s (unexplained diff vs previous) (percentage) | 299.13% | 1.150 | 4.590 | - | 0.00% | - |
| 631.deepsjeng_s (max) (percentage) | 296.95% | 1.970 | 7.820 | - | 0.00% | - |
| 619.lbm_s (max) (percentage) | 265.00% | 13.370 | 48.800 | - | 0.00% | - |
| 605.mcf_s (max) | 263.68% | 190.000 | 691.000 | - | 0.00% | - |
| 508.namd_r (max) | 237.78% | 45.000 | 152.000 | - | 0.00% | - |
| 605.mcf_s (max) (percentage) | 228.71% | 3.100 | 10.190 | - | 0.00% | - |
| 508.namd_r (max) (percentage) | 216.13% | 1.860 | 5.880 | - | 0.00% | - |
| 641.leela_s | 187.50% | 32.000 | 92.000 | - | 0.00% | - |
| 641.leela_s (avg) | 187.50% | 32.000 | 92.000 | - | 0.00% | - |
| 657.xz_s | 177.10% | 131.000 | 363.000 | - | 0.00% | - |
| 657.xz_s (avg) | 177.10% | 131.000 | 363.000 | - | 0.00% | - |
| 641.leela_s (avg) (percentage) | 172.84% | 0.810 | 2.210 | - | 0.00% | - |
| 623.xalancbmk_s | 142.42% | 33.000 | 80.000 | - | 0.00% | - |
| 623.xalancbmk_s (avg) | 142.42% | 33.000 | 80.000 | - | 0.00% | - |
| 619.lbm_s | 137.17% | 3645.000 | 8645.000 | - | 0.00% | - |
| 619.lbm_s (avg) | 137.17% | 3645.000 | 8645.000 | - | 0.00% | - |
| 623.xalancbmk_s (avg) (percentage) | 131.18% | 0.930 | 2.150 | - | 0.00% | - |
| 631.deepsjeng_s | 124.07% | 54.000 | 121.000 | - | 0.00% | - |
| 631.deepsjeng_s (avg) | 124.07% | 54.000 | 121.000 | - | 0.00% | - |
| 657.xz_s (avg) (percentage) | 121.45% | 5.780 | 12.800 | - | 0.00% | - |
| 631.deepsjeng_s (avg) (percentage) | 108.28% | 1.570 | 3.270 | - | 0.00% | - |
| 605.mcf_s | 90.68% | 118.000 | 225.000 | - | 0.00% | - |
| 605.mcf_s (avg) | 90.68% | 118.000 | 225.000 | - | 0.00% | - |
| 508.namd_r | 84.38% | 32.000 | 59.000 | - | 0.00% | - |
| 508.namd_r (avg) | 84.38% | 32.000 | 59.000 | - | 0.00% | - |
| 625.x264_s | 79.59% | 49.000 | 88.000 | - | 0.00% | - |
| 625.x264_s (avg) | 79.59% | 49.000 | 88.000 | - | 0.00% | - |
| 508.namd_r (avg) (percentage) | 76.34% | 1.310 | 2.310 | - | 0.00% | - |
| 638.imagick_s | 74.64% | 138.000 | 241.000 | - | 0.00% | - |
| 638.imagick_s (avg) | 74.64% | 138.000 | 241.000 | - | 0.00% | - |
| 605.mcf_s (avg) (percentage) | 72.54% | 1.930 | 3.330 | - | 0.00% | - |
| 625.x264_s (avg) (percentage) | 63.64% | 1.870 | 3.060 | - | 0.00% | - |
| 638.imagick_s (avg) (percentage) | 59.43% | 4.240 | 6.760 | - | 0.00% | - |
| 619.lbm_s (avg) (percentage) | 59.39% | 11.720 | 18.680 | - | 0.00% | - |
| 620.omnetpp_s | 58.57% | 140.000 | 222.000 | - | 0.00% | - |
| 620.omnetpp_s (avg) | 58.57% | 140.000 | 222.000 | - | 0.00% | - |
| 511.povray_r | 50.00% | 2.000 | 3.000 | - | 0.00% | - |
| 511.povray_r (avg) | 50.00% | 2.000 | 3.000 | - | 0.00% | - |
| 620.omnetpp_s (avg) (percentage) | 39.41% | 3.730 | 5.200 | - | 0.00% | - |
| 638.imagick_s (max) | 34.63% | 257.000 | 346.000 | - | 0.00% | - |
| 644.nab_s (max) | 30.16% | 126.000 | 164.000 | - | 0.00% | - |
| 644.nab_s (max) (percentage) | 28.32% | 1.130 | 1.450 | - | 0.00% | - |
| 638.imagick_s (max) (percentage) | 22.78% | 7.900 | 9.700 | - | 0.00% | - |
| 600.perlbench_s | 11.32% | 53.000 | 59.000 | - | 0.00% | - |
| 600.perlbench_s (avg) | 11.32% | 53.000 | 59.000 | - | 0.00% | - |
| 510.parest_r | 9.49% | 158.000 | 173.000 | - | 0.00% | - |
| 510.parest_r (avg) | 9.49% | 158.000 | 173.000 | - | 0.00% | - |
| 600.perlbench_s (max) | 7.81% | 64.000 | 69.000 | - | 0.00% | - |
| 644.nab_s | 7.69% | 130.000 | 140.000 | - | 0.00% | - |
| 644.nab_s (avg) | 7.69% | 130.000 | 140.000 | - | 0.00% | - |
| 644.nab_s (avg) (percentage) | 5.98% | 1.170 | 1.240 | - | 0.00% | - |
| 510.parest_r (max) | 5.33% | 150.000 | 158.000 | - | 0.00% | - |
| 526.blender_r | 4.35% | 92.000 | 96.000 | - | 0.00% | - |
| 526.blender_r (avg) | 4.35% | 92.000 | 96.000 | - | 0.00% | - |
| Performance Improvements - sample variability | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 511.povray_r (max) (percentage) | -3.45% | 0.870 | 0.840 | - | 0.00% | - |
| 526.blender_r (max) (percentage) | -3.05% | 1.310 | 1.270 | - | 0.00% | - |
| 510.parest_r (max) (percentage) | -2.96% | 2.700 | 2.620 | - | 0.00% | - |
| 600.perlbench_s (max) (percentage) | -2.88% | 2.780 | 2.700 | - | 0.00% | - |
| Added Tests - sample variability |
|---|
| 619.lbm_s (unexplained diff vs previous) |
| 619.lbm_s (unexplained diff vs previous) (percentage) |
| 638.imagick_s (unexplained diff vs previous) |
| 638.imagick_s (unexplained diff vs previous) (percentage) |
| 641.leela_s (unexplained diff vs previous) |
| 641.leela_s (unexplained diff vs previous) (percentage) |
| 644.nab_s (unexplained diff vs previous) |
| 644.nab_s (unexplained diff vs previous) (percentage) |
| 657.xz_s (unexplained diff vs previous) |
| 657.xz_s (unexplained diff vs previous) (percentage) |
| Performance Regressions - Execution | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 619.lbm_s | 49.01% | 31060.000 | 46281.000 | - | 48.80% | - |
| 657.xz_s | 24.01% | 2287.000 | 2836.000 | - | 25.10% | - |
| 620.omnetpp_s | 14.01% | 3747.000 | 4272.000 | - | 13.29% | - |
| 600.perlbench_s | 11.31% | 2298.000 | 2558.000 | - | 10.45% | - |
| 602.gcc_s | 10.68% | 4203.000 | 4652.000 | - | 11.29% | - |
| 638.imagick_s | 9.73% | 3258.000 | 3575.000 | - | 9.70% | - |
| 605.mcf_s | 9.35% | 6202.000 | 6782.000 | - | 10.19% | - |
| 625.x264_s | 8.72% | 2662.000 | 2894.000 | - | 8.51% | - |
| 510.parest_r | 8.47% | 5587.000 | 6060.000 | - | 9.03% | - |
| 508.namd_r | 6.13% | 2445.000 | 2595.000 | - | 5.88% | - |
| 641.leela_s | 4.51% | 3990.000 | 4170.000 | - | 4.56% | - |
| 526.blender_r | 3.39% | 8579.000 | 8870.000 | - | 4.16% | - |
| 631.deepsjeng_s | 3.17% | 3596.000 | 3710.000 | - | 7.82% | - |
| 623.xalancbmk_s | 2.93% | 3621.000 | 3727.000 | - | 4.81% | - |
| 644.nab_s | 1.89% | 11109.000 | 11319.000 | - | 1.45% | - |
| Performance Improvements - Code Size | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 631.deepsjeng_s | -3.63% | 60687.000 | 58483.000 | - | 0.00% | - |
| 511.povray_r | -1.79% | 740092.000 | 726824.000 | - | -0.01% | - |
| Added Tests - sample variability |
|---|
| 508.namd_r |
| 508.namd_r (avg) |
| 508.namd_r (avg) (percentage) |
| 508.namd_r (max) |
| 508.namd_r (max) (percentage) |
| 510.parest_r |
| 510.parest_r (avg) |
| 510.parest_r (avg) (percentage) |
| 510.parest_r (max) |
| 510.parest_r (max) (percentage) |
| 511.povray_r |
| 511.povray_r (avg) |
| 511.povray_r (avg) (percentage) |
| 511.povray_r (max) |
| 511.povray_r (max) (percentage) |
| 526.blender_r |
| 526.blender_r (avg) |
| 526.blender_r (avg) (percentage) |
| 526.blender_r (max) |
| 526.blender_r (max) (percentage) |
| 600.perlbench_s |
| 600.perlbench_s (avg) |
| 600.perlbench_s (avg) (percentage) |
| 600.perlbench_s (max) |
| 600.perlbench_s (max) (percentage) |
| 605.mcf_s |
| 605.mcf_s (avg) |
| 605.mcf_s (avg) (percentage) |
| 605.mcf_s (max) |
| 605.mcf_s (max) (percentage) |
| 619.lbm_s |
| 619.lbm_s (avg) |
| 619.lbm_s (avg) (percentage) |
| 619.lbm_s (max) |
| 619.lbm_s (max) (percentage) |
| 620.omnetpp_s |
| 620.omnetpp_s (avg) |
| 620.omnetpp_s (avg) (percentage) |
| 620.omnetpp_s (max) |
| 620.omnetpp_s (max) (percentage) |
| 623.xalancbmk_s |
| 623.xalancbmk_s (avg) |
| 623.xalancbmk_s (avg) (percentage) |
| 623.xalancbmk_s (max) |
| 623.xalancbmk_s (max) (percentage) |
| 625.x264_s |
| 625.x264_s (avg) |
| 625.x264_s (avg) (percentage) |
| 625.x264_s (max) |
| 625.x264_s (max) (percentage) |
| 631.deepsjeng_s |
| 631.deepsjeng_s (avg) |
| 631.deepsjeng_s (avg) (percentage) |
| 631.deepsjeng_s (max) |
| 631.deepsjeng_s (max) (percentage) |
| 638.imagick_s |
| 638.imagick_s (avg) |
| 638.imagick_s (avg) (percentage) |
| 638.imagick_s (max) |
| 638.imagick_s (max) (percentage) |
| 641.leela_s |
| 641.leela_s (avg) |
| 641.leela_s (avg) (percentage) |
| 641.leela_s (max) |
| 641.leela_s (max) (percentage) |
| 644.nab_s |
| 644.nab_s (avg) |
| 644.nab_s (avg) (percentage) |
| 644.nab_s (max) |
| 644.nab_s (max) (percentage) |
| 657.xz_s |
| 657.xz_s (avg) |
| 657.xz_s (avg) (percentage) |
| 657.xz_s (max) |
| 657.xz_s (max) (percentage) |
Report Time: 0.34s