Fields
| hardware | None |
| os | None |
Parameters
Fields
| Name | Value |
|---|
Parameters
| Name | Value |
|---|---|
| git_llvm | https://github.com/llvm/llvm-project/commit/a533b76468ac1df54e2e541b05ba4c060a77c603 (+ 222 commits) |
| test_url | https://ci.linaro.org/job/tcwg_bmk-code_size-cpu2017fast--llvm-aarch64-master-Os_LTO-build/91/ |
Filter
llvm-aarch64-master-Os_LTO test results
| Run | Order | Start Time | Duration |
|---|---|---|---|
| Current | 0091 (llvmorg-18-init-11497-ga533b76468ac) | 2023-11-09T17:11:25 | 0:00:00 |
| Previous | 0090 (llvmorg-18-init-11275-g51af040b22c1) | 2023-11-06T10:27:44 | 0:00:00 |
| Baseline | 0001 (llvmorg-17-init-03361-gd77f96a9e0c8) | 2023-02-27T23:41:40 | 0:00:00 |
Tests Summary
| Status Group | # | # (B) |
|---|---|---|
| Performance Regressions | 7 | 4 |
| Performance Improvements | 78 | 10 |
| Added Tests | 10 | 77 |
| Unchanged Tests | 607 | 611 |
| Total Tests | 702 |
| Performance Regressions - Execution | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 619.lbm_s | 1.96% | 30861.000 | 31467.000 | - | 1.31% | - |
| 657.xz_s | 1.05% | 2282.000 | 2306.000 | - | 0.83% | - |
| Performance Regressions - sample variability | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 511.povray_r | 100.00% | 1.000 | 2.000 | - | 0.00% | - |
| 511.povray_r (avg) | 100.00% | 1.000 | 2.000 | - | 0.00% | - |
| 511.povray_r (max) | 75.00% | 4.000 | 7.000 | - | 0.00% | - |
| 511.povray_r (max) (percentage) | 65.79% | 1.140 | 1.890 | - | 0.00% | - |
| 511.povray_r (avg) (percentage) | 48.89% | 0.450 | 0.670 | - | 0.00% | - |
| Performance Improvements - Execution | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 605.mcf_s | -2.21% | 6324.000 | 6184.000 | - | -0.29% | - |
| 511.povray_r | -1.89% | 423.000 | 415.000 | - | -8.19% | - |
| Performance Improvements - sample variability | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 644.nab_s (unexplained diff vs previous) | -99.25% | 133.000 | 1.000 | - | 0.00% | - |
| 644.nab_s (unexplained diff vs previous) (percentage) | -99.16% | 1.190 | 0.010 | - | 0.00% | - |
| 619.lbm_s (unexplained diff vs previous) (percentage) | -97.43% | 75.030 | 1.930 | - | 0.00% | - |
| 619.lbm_s (unexplained diff vs previous) | -97.38% | 23155.000 | 606.000 | - | 0.00% | - |
| 508.namd_r (unexplained diff vs previous) | -97.16% | 211.000 | 6.000 | - | 0.00% | - |
| 508.namd_r (unexplained diff vs previous) (percentage) | -97.15% | 8.430 | 0.240 | - | 0.00% | - |
| 641.leela_s (unexplained diff vs previous) (percentage) | -97.13% | 5.930 | 0.170 | - | 0.00% | - |
| 641.leela_s (unexplained diff vs previous) | -97.08% | 240.000 | 7.000 | - | 0.00% | - |
| 625.x264_s (unexplained diff vs previous) | -96.35% | 329.000 | 12.000 | - | 0.00% | - |
| 625.x264_s (unexplained diff vs previous) (percentage) | -96.35% | 12.330 | 0.450 | - | 0.00% | - |
| 620.omnetpp_s (unexplained diff vs previous) (percentage) | -95.56% | 22.080 | 0.980 | - | 0.00% | - |
| 620.omnetpp_s (unexplained diff vs previous) | -95.52% | 826.000 | 37.000 | - | 0.00% | - |
| 605.mcf_s (unexplained diff vs previous) | -80.23% | 708.000 | 140.000 | - | 0.00% | - |
| 605.mcf_s (unexplained diff vs previous) (percentage) | -79.82% | 11.200 | 2.260 | - | 0.00% | - |
| 631.deepsjeng_s (max) | -24.07% | 270.000 | 205.000 | - | 0.00% | - |
| 631.deepsjeng_s (max) (percentage) | -24.01% | 7.790 | 5.920 | - | 0.00% | - |
| 638.imagick_s (max) (percentage) | -17.52% | 16.040 | 13.230 | - | 0.00% | - |
| 638.imagick_s (max) | -17.31% | 491.000 | 406.000 | - | 0.00% | - |
| 600.perlbench_s (avg) (percentage) | -17.30% | 6.820 | 5.640 | - | 0.00% | - |
| 600.perlbench_s | -16.88% | 154.000 | 128.000 | - | 0.00% | - |
| 600.perlbench_s (avg) | -16.88% | 154.000 | 128.000 | - | 0.00% | - |
| 620.omnetpp_s (max) (percentage) | -12.49% | 18.090 | 15.830 | - | 0.00% | - |
| 625.x264_s (max) (percentage) | -12.49% | 10.970 | 9.600 | - | 0.00% | - |
| 625.x264_s (max) | -11.99% | 292.000 | 257.000 | - | 0.00% | - |
| 605.mcf_s (max) | -11.90% | 689.000 | 607.000 | - | 0.00% | - |
| 638.imagick_s (avg) (percentage) | -11.78% | 7.640 | 6.740 | - | 0.00% | - |
| 620.omnetpp_s (max) | -11.54% | 676.000 | 598.000 | - | 0.00% | - |
| 638.imagick_s | -11.54% | 234.000 | 207.000 | - | 0.00% | - |
| 638.imagick_s (avg) | -11.54% | 234.000 | 207.000 | - | 0.00% | - |
| 631.deepsjeng_s (avg) (percentage) | -10.07% | 5.460 | 4.910 | - | 0.00% | - |
| 631.deepsjeng_s | -10.05% | 189.000 | 170.000 | - | 0.00% | - |
| 631.deepsjeng_s (avg) | -10.05% | 189.000 | 170.000 | - | 0.00% | - |
| 619.lbm_s (max) (percentage) | -10.01% | 63.260 | 56.930 | - | 0.00% | - |
| 605.mcf_s (max) (percentage) | -9.99% | 10.910 | 9.820 | - | 0.00% | - |
| 623.xalancbmk_s (avg) (percentage) | -9.94% | 3.420 | 3.080 | - | 0.00% | - |
| 623.xalancbmk_s | -9.09% | 121.000 | 110.000 | - | 0.00% | - |
| 623.xalancbmk_s (avg) | -9.09% | 121.000 | 110.000 | - | 0.00% | - |
| 619.lbm_s (max) | -8.24% | 19522.000 | 17914.000 | - | 0.00% | - |
| 657.xz_s (avg) (percentage) | -8.19% | 11.230 | 10.310 | - | 0.00% | - |
| 644.nab_s (avg) (percentage) | -7.84% | 1.530 | 1.410 | - | 0.00% | - |
| 644.nab_s | -7.60% | 171.000 | 158.000 | - | 0.00% | - |
| 644.nab_s (avg) | -7.60% | 171.000 | 158.000 | - | 0.00% | - |
| 508.namd_r (avg) (percentage) | -7.50% | 4.400 | 4.070 | - | 0.00% | - |
| 657.xz_s | -7.42% | 256.000 | 237.000 | - | 0.00% | - |
| 657.xz_s (avg) | -7.42% | 256.000 | 237.000 | - | 0.00% | - |
| 508.namd_r | -7.27% | 110.000 | 102.000 | - | 0.00% | - |
| 508.namd_r (avg) | -7.27% | 110.000 | 102.000 | - | 0.00% | - |
| 641.leela_s (avg) (percentage) | -6.67% | 3.000 | 2.800 | - | 0.00% | - |
| 641.leela_s | -6.61% | 121.000 | 113.000 | - | 0.00% | - |
| 641.leela_s (avg) | -6.61% | 121.000 | 113.000 | - | 0.00% | - |
| 600.perlbench_s (max) (percentage) | -5.40% | 14.440 | 13.660 | - | 0.00% | - |
| 605.mcf_s | -5.28% | 322.000 | 305.000 | - | 0.00% | - |
| 605.mcf_s (avg) | -5.28% | 322.000 | 305.000 | - | 0.00% | - |
| 600.perlbench_s (max) | -5.20% | 327.000 | 310.000 | - | 0.00% | - |
| 623.xalancbmk_s (max) (percentage) | -5.04% | 5.160 | 4.900 | - | 0.00% | - |
| 644.nab_s (max) | -4.76% | 168.000 | 160.000 | - | 0.00% | - |
| 641.leela_s (max) | -4.74% | 232.000 | 221.000 | - | 0.00% | - |
| 641.leela_s (max) (percentage) | -4.70% | 5.740 | 5.470 | - | 0.00% | - |
| 644.nab_s (max) (percentage) | -4.67% | 1.500 | 1.430 | - | 0.00% | - |
| 657.xz_s (max) (percentage) | -4.49% | 26.960 | 25.750 | - | 0.00% | - |
| 623.xalancbmk_s (max) | -4.37% | 183.000 | 175.000 | - | 0.00% | - |
| 625.x264_s (avg) (percentage) | -4.33% | 5.080 | 4.860 | - | 0.00% | - |
| 619.lbm_s (avg) (percentage) | -4.22% | 22.750 | 21.790 | - | 0.00% | - |
| 620.omnetpp_s (avg) (percentage) | -3.85% | 8.060 | 7.750 | - | 0.00% | - |
| 625.x264_s | -3.70% | 135.000 | 130.000 | - | 0.00% | - |
| 625.x264_s (avg) | -3.70% | 135.000 | 130.000 | - | 0.00% | - |
| 508.namd_r (max) | -3.61% | 194.000 | 187.000 | - | 0.00% | - |
| 508.namd_r (max) (percentage) | -3.60% | 7.770 | 7.490 | - | 0.00% | - |
| 657.xz_s (max) | -3.58% | 615.000 | 593.000 | - | 0.00% | - |
| 605.mcf_s (avg) (percentage) | -3.14% | 5.100 | 4.940 | - | 0.00% | - |
| 620.omnetpp_s | -2.99% | 301.000 | 292.000 | - | 0.00% | - |
| 620.omnetpp_s (avg) | -2.99% | 301.000 | 292.000 | - | 0.00% | - |
| 619.lbm_s | -2.34% | 7020.000 | 6856.000 | - | 0.00% | - |
| 619.lbm_s (avg) | -2.34% | 7020.000 | 6856.000 | - | 0.00% | - |
| 510.parest_r (max) (percentage) | -2.14% | 14.040 | 13.740 | - | 0.00% | - |
| 510.parest_r (max) | -1.54% | 778.000 | 766.000 | - | 0.00% | - |
| Added Tests - sample variability |
|---|
| 600.perlbench_s (unexplained diff vs previous) |
| 600.perlbench_s (unexplained diff vs previous) (percentage) |
| 623.xalancbmk_s (unexplained diff vs previous) |
| 623.xalancbmk_s (unexplained diff vs previous) (percentage) |
| 631.deepsjeng_s (unexplained diff vs previous) |
| 631.deepsjeng_s (unexplained diff vs previous) (percentage) |
| 638.imagick_s (unexplained diff vs previous) |
| 638.imagick_s (unexplained diff vs previous) (percentage) |
| 657.xz_s (unexplained diff vs previous) |
| 657.xz_s (unexplained diff vs previous) (percentage) |
| Performance Regressions - Execution | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 526.blender_r | 5.39% | 8579.000 | 9041.000 | - | 0.94% | - |
| 508.namd_r | 2.62% | 2445.000 | 2509.000 | - | 0.24% | - |
| 641.leela_s | 1.33% | 3990.000 | 4043.000 | - | -0.17% | - |
| 619.lbm_s | 1.31% | 31060.000 | 31467.000 | - | 1.96% | - |
| Performance Improvements - Code Size | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 631.deepsjeng_s | -4.34% | 60687.000 | 58051.000 | - | 0.00% | - |
| 619.lbm_s | -2.78% | 13938.000 | 13550.000 | - | 0.00% | - |
| 605.mcf_s | -2.58% | 15336.000 | 14940.000 | - | 0.00% | - |
| 511.povray_r | -1.55% | 740092.000 | 728620.000 | - | 0.00% | - |
| 644.nab_s | -1.23% | 84129.000 | 83097.000 | - | 0.00% | - |
| Performance Improvements - Execution | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 511.povray_r | -8.19% | 452.000 | 415.000 | - | -1.89% | - |
| 638.imagick_s | -5.71% | 3258.000 | 3072.000 | - | 0.23% | - |
| 631.deepsjeng_s | -3.42% | 3596.000 | 3473.000 | - | 0.00% | - |
| 600.perlbench_s | -1.22% | 2298.000 | 2270.000 | - | 0.22% | - |
| 623.xalancbmk_s | -1.10% | 3621.000 | 3581.000 | - | 0.70% | - |
| Added Tests - sample variability |
|---|
| 508.namd_r |
| 508.namd_r (avg) |
| 508.namd_r (avg) (percentage) |
| 508.namd_r (max) |
| 508.namd_r (max) (percentage) |
| 510.parest_r |
| 510.parest_r (avg) |
| 510.parest_r (avg) (percentage) |
| 510.parest_r (max) |
| 510.parest_r (max) (percentage) |
| 511.povray_r |
| 511.povray_r (avg) |
| 511.povray_r (avg) (percentage) |
| 511.povray_r (max) |
| 511.povray_r (max) (percentage) |
| 526.blender_r |
| 526.blender_r (avg) |
| 526.blender_r (avg) (percentage) |
| 526.blender_r (max) |
| 526.blender_r (max) (percentage) |
| 600.perlbench_s |
| 600.perlbench_s (avg) |
| 600.perlbench_s (avg) (percentage) |
| 600.perlbench_s (max) |
| 600.perlbench_s (max) (percentage) |
| 605.mcf_s |
| 605.mcf_s (avg) |
| 605.mcf_s (avg) (percentage) |
| 605.mcf_s (max) |
| 605.mcf_s (max) (percentage) |
| 619.lbm_s |
| 619.lbm_s (avg) |
| 619.lbm_s (avg) (percentage) |
| 619.lbm_s (max) |
| 619.lbm_s (max) (percentage) |
| 620.omnetpp_s |
| 620.omnetpp_s (avg) |
| 620.omnetpp_s (avg) (percentage) |
| 620.omnetpp_s (max) |
| 620.omnetpp_s (max) (percentage) |
| 623.xalancbmk_s |
| 623.xalancbmk_s (avg) |
| 623.xalancbmk_s (avg) (percentage) |
| 623.xalancbmk_s (max) |
| 623.xalancbmk_s (max) (percentage) |
| 625.x264_s |
| 625.x264_s (avg) |
| 625.x264_s (avg) (percentage) |
| 625.x264_s (max) |
| 625.x264_s (max) (percentage) |
| 631.deepsjeng_s |
| 631.deepsjeng_s (avg) |
| 631.deepsjeng_s (avg) (percentage) |
| 631.deepsjeng_s (max) |
| 631.deepsjeng_s (max) (percentage) |
| 631.deepsjeng_s (unexplained diff vs previous) |
| 631.deepsjeng_s (unexplained diff vs previous) (percentage) |
| 638.imagick_s |
| 638.imagick_s (avg) |
| 638.imagick_s (avg) (percentage) |
| 638.imagick_s (max) |
| 638.imagick_s (max) (percentage) |
| 641.leela_s |
| 641.leela_s (avg) |
| 641.leela_s (avg) (percentage) |
| 641.leela_s (max) |
| 641.leela_s (max) (percentage) |
| 644.nab_s |
| 644.nab_s (avg) |
| 644.nab_s (avg) (percentage) |
| 644.nab_s (max) |
| 644.nab_s (max) (percentage) |
| 657.xz_s |
| 657.xz_s (avg) |
| 657.xz_s (avg) (percentage) |
| 657.xz_s (max) |
| 657.xz_s (max) (percentage) |
Report Time: 0.35s