Fields
| hardware | None |
| os | None |
Parameters
Fields
| Name | Value |
|---|
Parameters
| Name | Value |
|---|---|
| git_llvm | https://github.com/llvm/llvm-project/commit/2f3e17566bcf20bf580c92693f9653df3bc4f51d (+ 447 commits) |
| test_url | https://ci.linaro.org/job/tcwg_bmk-code_size-cpu2017fast--llvm-aarch64-master-Os_LTO-build/29/ |
Filter
llvm-aarch64-master-Os_LTO test results
| Run | Order | Start Time | Duration |
|---|---|---|---|
| Current | 0029 (llvmorg-17-init-12409-g2f3e17566bcf) | 2023-05-22T00:56:38 | 0:00:00 |
| Previous | 0028 (llvmorg-17-init-11962-g330319557f6e) | 2023-05-19T01:27:43 | 0:00:00 |
| Baseline | 0001 (llvmorg-17-init-03361-gd77f96a9e0c8) | 2023-02-27T23:41:40 | 0:00:00 |
Tests Summary
| Status Group | # | # (B) |
|---|---|---|
| Performance Regressions | 89 | 15 |
| Performance Improvements | 3 | 2 |
| Added Tests | 4 | 75 |
| Unchanged Tests | 606 | 610 |
| Total Tests | 702 |
| Performance Regressions - Execution | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 619.lbm_s | 64.02% | 31030.000 | 50896.000 | - | 63.86% | - |
| 657.xz_s | 28.65% | 2283.000 | 2937.000 | - | 28.42% | - |
| 620.omnetpp_s | 15.98% | 3785.000 | 4390.000 | - | 17.16% | - |
| 602.gcc_s | 15.08% | 4159.000 | 4786.000 | - | 13.87% | - |
| 600.perlbench_s | 13.93% | 2298.000 | 2618.000 | - | 13.93% | - |
| 638.imagick_s | 12.57% | 3263.000 | 3673.000 | - | 12.74% | - |
| 510.parest_r | 12.31% | 5572.000 | 6258.000 | - | 12.01% | - |
| 605.mcf_s | 12.08% | 6208.000 | 6958.000 | - | 12.19% | - |
| 625.x264_s | 11.94% | 2656.000 | 2973.000 | - | 11.68% | - |
| 631.deepsjeng_s | 9.92% | 3477.000 | 3822.000 | - | 6.28% | - |
| 508.namd_r | 7.18% | 2464.000 | 2641.000 | - | 8.02% | - |
| 526.blender_r | 5.85% | 8536.000 | 9035.000 | - | 5.32% | - |
| 641.leela_s | 5.58% | 3959.000 | 4180.000 | - | 4.76% | - |
| 623.xalancbmk_s | 5.43% | 3554.000 | 3747.000 | - | 3.48% | - |
| 644.nab_s | 1.82% | 11124.000 | 11326.000 | - | 1.95% | - |
| Performance Regressions - sample variability | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 619.lbm_s (max) | 522.88% | 5231.000 | 32583.000 | - | 0.00% | - |
| 625.x264_s (max) | 306.90% | 87.000 | 354.000 | - | 0.00% | - |
| 619.lbm_s (max) (percentage) | 279.72% | 16.860 | 64.020 | - | 0.00% | - |
| 625.x264_s (max) (percentage) | 260.73% | 3.310 | 11.940 | - | 0.00% | - |
| 641.leela_s (unexplained diff vs previous) | 256.45% | 62.000 | 221.000 | - | 0.00% | - |
| 625.x264_s (unexplained diff vs previous) | 248.35% | 91.000 | 317.000 | - | 0.00% | - |
| 641.leela_s (unexplained diff vs previous) (percentage) | 236.94% | 1.570 | 5.290 | - | 0.00% | - |
| 508.namd_r (unexplained diff vs previous) | 227.78% | 54.000 | 177.000 | - | 0.00% | - |
| 605.mcf_s (max) | 226.85% | 257.000 | 840.000 | - | 0.00% | - |
| 619.lbm_s (unexplained diff vs previous) | 219.59% | 6216.000 | 19866.000 | - | 0.00% | - |
| 605.mcf_s (unexplained diff vs previous) | 212.50% | 240.000 | 750.000 | - | 0.00% | - |
| 625.x264_s (unexplained diff vs previous) (percentage) | 210.79% | 3.430 | 10.660 | - | 0.00% | - |
| 508.namd_r (unexplained diff vs previous) (percentage) | 205.94% | 2.190 | 6.700 | - | 0.00% | - |
| 605.mcf_s (max) (percentage) | 191.08% | 4.150 | 12.080 | - | 0.00% | - |
| 620.omnetpp_s (max) | 183.81% | 247.000 | 701.000 | - | 0.00% | - |
| 605.mcf_s (unexplained diff vs previous) (percentage) | 178.55% | 3.870 | 10.780 | - | 0.00% | - |
| 644.nab_s (unexplained diff vs previous) | 165.79% | 76.000 | 202.000 | - | 0.00% | - |
| 644.nab_s (unexplained diff vs previous) (percentage) | 161.76% | 0.680 | 1.780 | - | 0.00% | - |
| 620.omnetpp_s (max) (percentage) | 144.72% | 6.530 | 15.980 | - | 0.00% | - |
| 620.omnetpp_s (unexplained diff vs previous) | 142.97% | 249.000 | 605.000 | - | 0.00% | - |
| 619.lbm_s | 134.29% | 3745.000 | 8774.000 | - | 0.00% | - |
| 619.lbm_s (avg) | 134.29% | 3745.000 | 8774.000 | - | 0.00% | - |
| 620.omnetpp_s (unexplained diff vs previous) (percentage) | 109.42% | 6.580 | 13.780 | - | 0.00% | - |
| 631.deepsjeng_s (max) | 105.98% | 184.000 | 379.000 | - | 0.00% | - |
| 644.nab_s (max) | 98.08% | 104.000 | 206.000 | - | 0.00% | - |
| 619.lbm_s (unexplained diff vs previous) (percentage) | 94.86% | 20.030 | 39.030 | - | 0.00% | - |
| 644.nab_s (max) (percentage) | 93.62% | 0.940 | 1.820 | - | 0.00% | - |
| 508.namd_r (max) | 92.86% | 98.000 | 189.000 | - | 0.00% | - |
| 641.leela_s (max) | 90.98% | 122.000 | 233.000 | - | 0.00% | - |
| 631.deepsjeng_s (max) (percentage) | 86.82% | 5.310 | 9.920 | - | 0.00% | - |
| 623.xalancbmk_s | 85.00% | 40.000 | 74.000 | - | 0.00% | - |
| 623.xalancbmk_s (avg) | 85.00% | 40.000 | 74.000 | - | 0.00% | - |
| 641.leela_s (max) (percentage) | 80.58% | 3.090 | 5.580 | - | 0.00% | - |
| 508.namd_r (max) (percentage) | 79.95% | 3.990 | 7.180 | - | 0.00% | - |
| 623.xalancbmk_s (avg) (percentage) | 75.22% | 1.130 | 1.980 | - | 0.00% | - |
| 641.leela_s | 74.36% | 39.000 | 68.000 | - | 0.00% | - |
| 641.leela_s (avg) | 74.36% | 39.000 | 68.000 | - | 0.00% | - |
| 631.deepsjeng_s | 69.88% | 83.000 | 141.000 | - | 0.00% | - |
| 631.deepsjeng_s (avg) | 69.88% | 83.000 | 141.000 | - | 0.00% | - |
| 641.leela_s (avg) (percentage) | 62.38% | 1.010 | 1.640 | - | 0.00% | - |
| 623.xalancbmk_s (max) | 58.59% | 128.000 | 203.000 | - | 0.00% | - |
| 625.x264_s | 57.89% | 57.000 | 90.000 | - | 0.00% | - |
| 625.x264_s (avg) | 57.89% | 57.000 | 90.000 | - | 0.00% | - |
| 631.deepsjeng_s (avg) (percentage) | 53.11% | 2.410 | 3.690 | - | 0.00% | - |
| 623.xalancbmk_s (max) (percentage) | 50.42% | 3.610 | 5.430 | - | 0.00% | - |
| 508.namd_r | 50.00% | 42.000 | 63.000 | - | 0.00% | - |
| 508.namd_r (avg) | 50.00% | 42.000 | 63.000 | - | 0.00% | - |
| 620.omnetpp_s | 48.61% | 144.000 | 214.000 | - | 0.00% | - |
| 620.omnetpp_s (avg) | 48.61% | 144.000 | 214.000 | - | 0.00% | - |
| 605.mcf_s | 47.59% | 166.000 | 245.000 | - | 0.00% | - |
| 605.mcf_s (avg) | 47.59% | 166.000 | 245.000 | - | 0.00% | - |
| 619.lbm_s (avg) (percentage) | 42.83% | 12.070 | 17.240 | - | 0.00% | - |
| 625.x264_s (avg) (percentage) | 41.20% | 2.160 | 3.050 | - | 0.00% | - |
| 508.namd_r (avg) (percentage) | 39.77% | 1.710 | 2.390 | - | 0.00% | - |
| 605.mcf_s (avg) (percentage) | 31.72% | 2.680 | 3.530 | - | 0.00% | - |
| 657.xz_s | 28.47% | 137.000 | 176.000 | - | 0.00% | - |
| 657.xz_s (avg) | 28.47% | 137.000 | 176.000 | - | 0.00% | - |
| 620.omnetpp_s (avg) (percentage) | 27.75% | 3.820 | 4.880 | - | 0.00% | - |
| 657.xz_s (max) | 26.55% | 388.000 | 491.000 | - | 0.00% | - |
| 644.nab_s | 15.09% | 106.000 | 122.000 | - | 0.00% | - |
| 644.nab_s (avg) | 15.09% | 106.000 | 122.000 | - | 0.00% | - |
| 600.perlbench_s | 13.04% | 23.000 | 26.000 | - | 0.00% | - |
| 600.perlbench_s (avg) | 13.04% | 23.000 | 26.000 | - | 0.00% | - |
| 638.imagick_s | 12.64% | 87.000 | 98.000 | - | 0.00% | - |
| 638.imagick_s (avg) | 12.64% | 87.000 | 98.000 | - | 0.00% | - |
| 644.nab_s (avg) (percentage) | 12.50% | 0.960 | 1.080 | - | 0.00% | - |
| 510.parest_r | 11.90% | 42.000 | 47.000 | - | 0.00% | - |
| 510.parest_r (avg) | 11.90% | 42.000 | 47.000 | - | 0.00% | - |
| 600.perlbench_s (max) | 11.32% | 53.000 | 59.000 | - | 0.00% | - |
| 510.parest_r (max) | 11.29% | 124.000 | 138.000 | - | 0.00% | - |
| 638.imagick_s (max) | 10.79% | 241.000 | 267.000 | - | 0.00% | - |
| 526.blender_r | 6.33% | 79.000 | 84.000 | - | 0.00% | - |
| 526.blender_r (avg) | 6.33% | 79.000 | 84.000 | - | 0.00% | - |
| 526.blender_r (max) | 4.30% | 93.000 | 97.000 | - | 0.00% | - |
| Performance Improvements - sample variability | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 511.povray_r (max) (percentage) | -5.41% | 0.370 | 0.350 | - | 0.00% | - |
| 657.xz_s (max) (percentage) | -1.76% | 17.030 | 16.730 | - | 0.00% | - |
| 638.imagick_s (max) (percentage) | -1.62% | 7.400 | 7.280 | - | 0.00% | - |
| Added Tests - sample variability |
|---|
| 623.xalancbmk_s (unexplained diff vs previous) |
| 623.xalancbmk_s (unexplained diff vs previous) (percentage) |
| 631.deepsjeng_s (unexplained diff vs previous) |
| 631.deepsjeng_s (unexplained diff vs previous) (percentage) |
| Performance Regressions - Execution | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 619.lbm_s | 63.86% | 31060.000 | 50896.000 | - | 64.02% | - |
| 657.xz_s | 28.42% | 2287.000 | 2937.000 | - | 28.65% | - |
| 620.omnetpp_s | 17.16% | 3747.000 | 4390.000 | - | 15.98% | - |
| 600.perlbench_s | 13.93% | 2298.000 | 2618.000 | - | 13.93% | - |
| 602.gcc_s | 13.87% | 4203.000 | 4786.000 | - | 15.08% | - |
| 638.imagick_s | 12.74% | 3258.000 | 3673.000 | - | 12.57% | - |
| 605.mcf_s | 12.19% | 6202.000 | 6958.000 | - | 12.08% | - |
| 510.parest_r | 12.01% | 5587.000 | 6258.000 | - | 12.31% | - |
| 625.x264_s | 11.68% | 2662.000 | 2973.000 | - | 11.94% | - |
| 508.namd_r | 8.02% | 2445.000 | 2641.000 | - | 7.18% | - |
| 631.deepsjeng_s | 6.28% | 3596.000 | 3822.000 | - | 9.92% | - |
| 526.blender_r | 5.32% | 8579.000 | 9035.000 | - | 5.85% | - |
| 641.leela_s | 4.76% | 3990.000 | 4180.000 | - | 5.58% | - |
| 623.xalancbmk_s | 3.48% | 3621.000 | 3747.000 | - | 5.43% | - |
| 644.nab_s | 1.95% | 11109.000 | 11326.000 | - | 1.82% | - |
| Performance Improvements - Code Size | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 631.deepsjeng_s | -3.66% | 60687.000 | 58463.000 | - | 0.00% | - |
| 511.povray_r | -1.80% | 740092.000 | 726768.000 | - | 0.00% | - |
| Added Tests - sample variability |
|---|
| 508.namd_r |
| 508.namd_r (avg) |
| 508.namd_r (avg) (percentage) |
| 508.namd_r (max) |
| 508.namd_r (max) (percentage) |
| 510.parest_r |
| 510.parest_r (avg) |
| 510.parest_r (avg) (percentage) |
| 510.parest_r (max) |
| 510.parest_r (max) (percentage) |
| 511.povray_r |
| 511.povray_r (avg) |
| 511.povray_r (avg) (percentage) |
| 511.povray_r (max) |
| 511.povray_r (max) (percentage) |
| 526.blender_r |
| 526.blender_r (avg) |
| 526.blender_r (avg) (percentage) |
| 526.blender_r (max) |
| 526.blender_r (max) (percentage) |
| 600.perlbench_s |
| 600.perlbench_s (avg) |
| 600.perlbench_s (avg) (percentage) |
| 600.perlbench_s (max) |
| 600.perlbench_s (max) (percentage) |
| 605.mcf_s |
| 605.mcf_s (avg) |
| 605.mcf_s (avg) (percentage) |
| 605.mcf_s (max) |
| 605.mcf_s (max) (percentage) |
| 619.lbm_s |
| 619.lbm_s (avg) |
| 619.lbm_s (avg) (percentage) |
| 619.lbm_s (max) |
| 619.lbm_s (max) (percentage) |
| 620.omnetpp_s |
| 620.omnetpp_s (avg) |
| 620.omnetpp_s (avg) (percentage) |
| 620.omnetpp_s (max) |
| 620.omnetpp_s (max) (percentage) |
| 623.xalancbmk_s |
| 623.xalancbmk_s (avg) |
| 623.xalancbmk_s (avg) (percentage) |
| 623.xalancbmk_s (max) |
| 623.xalancbmk_s (max) (percentage) |
| 625.x264_s |
| 625.x264_s (avg) |
| 625.x264_s (avg) (percentage) |
| 625.x264_s (max) |
| 625.x264_s (max) (percentage) |
| 631.deepsjeng_s |
| 631.deepsjeng_s (avg) |
| 631.deepsjeng_s (avg) (percentage) |
| 631.deepsjeng_s (max) |
| 631.deepsjeng_s (max) (percentage) |
| 638.imagick_s |
| 638.imagick_s (avg) |
| 638.imagick_s (avg) (percentage) |
| 638.imagick_s (max) |
| 638.imagick_s (max) (percentage) |
| 641.leela_s |
| 641.leela_s (avg) |
| 641.leela_s (avg) (percentage) |
| 641.leela_s (max) |
| 641.leela_s (max) (percentage) |
| 644.nab_s |
| 644.nab_s (avg) |
| 644.nab_s (avg) (percentage) |
| 644.nab_s (max) |
| 644.nab_s (max) (percentage) |
| 657.xz_s |
| 657.xz_s (avg) |
| 657.xz_s (avg) (percentage) |
| 657.xz_s (max) |
| 657.xz_s (max) (percentage) |
Report Time: 0.34s