Fields
| hardware | None |
| os | None |
Parameters
Fields
| Name | Value |
|---|
Parameters
| Name | Value |
|---|---|
| git_llvm | https://github.com/llvm/llvm-project/commit/78502251f4019953e462bb8bc886381589e9d257 (+ 341 commits) |
| test_url | https://ci.linaro.org/job/tcwg_bmk-code_size-cpu2017fast--llvm-aarch64-master-Os_LTO-build/80/ |
Filter
llvm-aarch64-master-Os_LTO test results
| Run | Order | Start Time | Duration |
|---|---|---|---|
| Current | 0080 (llvmorg-18-init-08014-g78502251f401) | 2023-10-02T18:25:02 | 0:00:00 |
| Previous | 0079 (llvmorg-18-init-07673-g427f120f60be) | 2023-09-28T13:30:22 | 0:00:00 |
| Baseline | 0001 (llvmorg-17-init-03361-gd77f96a9e0c8) | 2023-02-27T23:41:40 | 0:00:00 |
Tests Summary
| Status Group | # | # (B) |
|---|---|---|
| Performance Regressions | 5 | 4 |
| Performance Improvements | 39 | 14 |
| Added Tests | 0 | 75 |
| Unchanged Tests | 658 | 609 |
| Total Tests | 702 |
| Performance Regressions - Execution | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 623.xalancbmk_s | 3.52% | 3441.000 | 3562.000 | - | -1.63% | - |
| 511.povray_r | 1.67% | 418.000 | 425.000 | - | -5.97% | - |
| Performance Regressions - sample variability | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 623.xalancbmk_s | 2.73% | 110.000 | 113.000 | - | 0.00% | - |
| 623.xalancbmk_s (avg) | 2.73% | 110.000 | 113.000 | - | 0.00% | - |
| 623.xalancbmk_s (max) | 1.86% | 215.000 | 219.000 | - | 0.00% | - |
| Performance Improvements - Execution | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 620.omnetpp_s | -4.79% | 3817.000 | 3634.000 | - | -3.02% | - |
| 600.perlbench_s | -1.70% | 2294.000 | 2255.000 | - | -1.87% | - |
| 657.xz_s | -1.47% | 2311.000 | 2277.000 | - | -0.44% | - |
| Performance Improvements - sample variability | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 620.omnetpp_s (max) | -11.07% | 497.000 | 442.000 | - | 0.00% | - |
| 625.x264_s (max) (percentage) | -8.60% | 7.090 | 6.480 | - | 0.00% | - |
| 625.x264_s (max) | -8.56% | 187.000 | 171.000 | - | 0.00% | - |
| 620.omnetpp_s (max) (percentage) | -6.67% | 13.040 | 12.170 | - | 0.00% | - |
| 619.lbm_s (max) | -4.94% | 14171.000 | 13471.000 | - | 0.00% | - |
| 620.omnetpp_s | -4.80% | 271.000 | 258.000 | - | 0.00% | - |
| 620.omnetpp_s (avg) | -4.80% | 271.000 | 258.000 | - | 0.00% | - |
| 619.lbm_s (max) (percentage) | -4.77% | 50.320 | 47.920 | - | 0.00% | - |
| 657.xz_s (max) | -4.44% | 608.000 | 581.000 | - | 0.00% | - |
| 644.nab_s (max) | -4.19% | 477.000 | 457.000 | - | 0.00% | - |
| 644.nab_s (max) (percentage) | -3.52% | 4.260 | 4.110 | - | 0.00% | - |
| 605.mcf_s (max) | -3.21% | 560.000 | 542.000 | - | 0.00% | - |
| 657.xz_s (max) (percentage) | -3.07% | 26.350 | 25.540 | - | 0.00% | - |
| 605.mcf_s (max) (percentage) | -2.98% | 9.060 | 8.790 | - | 0.00% | - |
| 600.perlbench_s (max) | -2.97% | 303.000 | 294.000 | - | 0.00% | - |
| 631.deepsjeng_s (max) | -2.96% | 338.000 | 328.000 | - | 0.00% | - |
| 641.leela_s (max) | -2.80% | 214.000 | 208.000 | - | 0.00% | - |
| 508.namd_r (max) (percentage) | -2.71% | 7.390 | 7.190 | - | 0.00% | - |
| 508.namd_r (max) | -2.70% | 185.000 | 180.000 | - | 0.00% | - |
| 641.leela_s (max) (percentage) | -2.65% | 5.280 | 5.140 | - | 0.00% | - |
| 631.deepsjeng_s (max) (percentage) | -2.13% | 9.840 | 9.630 | - | 0.00% | - |
| 638.imagick_s (max) | -1.85% | 649.000 | 637.000 | - | 0.00% | - |
| 600.perlbench_s | -1.82% | 110.000 | 108.000 | - | 0.00% | - |
| 600.perlbench_s (avg) | -1.82% | 110.000 | 108.000 | - | 0.00% | - |
| 638.imagick_s (max) (percentage) | -1.81% | 20.970 | 20.590 | - | 0.00% | - |
| 511.povray_r (max) (percentage) | -1.52% | 1.320 | 1.300 | - | 0.00% | - |
| 657.xz_s | -1.41% | 213.000 | 210.000 | - | 0.00% | - |
| 657.xz_s (avg) | -1.41% | 213.000 | 210.000 | - | 0.00% | - |
| 623.xalancbmk_s (max) (percentage) | -1.28% | 6.250 | 6.170 | - | 0.00% | - |
| 526.blender_r (max) (percentage) | -1.22% | 4.910 | 4.850 | - | 0.00% | - |
| 600.perlbench_s (max) (percentage) | -1.21% | 13.240 | 13.080 | - | 0.00% | - |
| 644.nab_s | -1.19% | 168.000 | 166.000 | - | 0.00% | - |
| 644.nab_s (avg) | -1.19% | 168.000 | 166.000 | - | 0.00% | - |
| 526.blender_r (max) | -1.16% | 430.000 | 425.000 | - | 0.00% | - |
| 631.deepsjeng_s | -1.09% | 183.000 | 181.000 | - | 0.00% | - |
| 631.deepsjeng_s (avg) | -1.09% | 183.000 | 181.000 | - | 0.00% | - |
| Performance Regressions - Code Size | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 508.namd_r | 1.13% | 376399.000 | 380659.000 | - | -0.02% | - |
| Performance Regressions - Execution | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 508.namd_r | 2.54% | 2445.000 | 2507.000 | - | -0.08% | - |
| 526.blender_r | 2.18% | 8579.000 | 8766.000 | - | 0.08% | - |
| 641.leela_s | 1.60% | 3990.000 | 4054.000 | - | -0.37% | - |
| Performance Improvements - Code Size | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 631.deepsjeng_s | -4.48% | 60687.000 | 57971.000 | - | -0.06% | - |
| 619.lbm_s | -2.76% | 13938.000 | 13554.000 | - | -0.09% | - |
| 605.mcf_s | -2.50% | 15336.000 | 14952.000 | - | 0.24% | - |
| 511.povray_r | -1.63% | 740092.000 | 728000.000 | - | -0.23% | - |
| 644.nab_s | -1.18% | 84129.000 | 83137.000 | - | -0.20% | - |
| 641.leela_s | -1.02% | 71474.000 | 70742.000 | - | -0.52% | - |
| Performance Improvements - Execution | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 619.lbm_s | -9.49% | 31060.000 | 28113.000 | - | -0.17% | - |
| 511.povray_r | -5.97% | 452.000 | 425.000 | - | 1.67% | - |
| 631.deepsjeng_s | -5.20% | 3596.000 | 3409.000 | - | -0.87% | - |
| 638.imagick_s | -5.03% | 3258.000 | 3094.000 | - | -0.03% | - |
| 620.omnetpp_s | -3.02% | 3747.000 | 3634.000 | - | -4.79% | - |
| 602.gcc_s | -2.40% | 4203.000 | 4102.000 | - | -0.32% | - |
| 600.perlbench_s | -1.87% | 2298.000 | 2255.000 | - | -1.70% | - |
| 623.xalancbmk_s | -1.63% | 3621.000 | 3562.000 | - | 3.52% | - |
| Added Tests - sample variability |
|---|
| 508.namd_r |
| 508.namd_r (avg) |
| 508.namd_r (avg) (percentage) |
| 508.namd_r (max) |
| 508.namd_r (max) (percentage) |
| 510.parest_r |
| 510.parest_r (avg) |
| 510.parest_r (avg) (percentage) |
| 510.parest_r (max) |
| 510.parest_r (max) (percentage) |
| 511.povray_r |
| 511.povray_r (avg) |
| 511.povray_r (avg) (percentage) |
| 511.povray_r (max) |
| 511.povray_r (max) (percentage) |
| 526.blender_r |
| 526.blender_r (avg) |
| 526.blender_r (avg) (percentage) |
| 526.blender_r (max) |
| 526.blender_r (max) (percentage) |
| 600.perlbench_s |
| 600.perlbench_s (avg) |
| 600.perlbench_s (avg) (percentage) |
| 600.perlbench_s (max) |
| 600.perlbench_s (max) (percentage) |
| 605.mcf_s |
| 605.mcf_s (avg) |
| 605.mcf_s (avg) (percentage) |
| 605.mcf_s (max) |
| 605.mcf_s (max) (percentage) |
| 619.lbm_s |
| 619.lbm_s (avg) |
| 619.lbm_s (avg) (percentage) |
| 619.lbm_s (max) |
| 619.lbm_s (max) (percentage) |
| 620.omnetpp_s |
| 620.omnetpp_s (avg) |
| 620.omnetpp_s (avg) (percentage) |
| 620.omnetpp_s (max) |
| 620.omnetpp_s (max) (percentage) |
| 623.xalancbmk_s |
| 623.xalancbmk_s (avg) |
| 623.xalancbmk_s (avg) (percentage) |
| 623.xalancbmk_s (max) |
| 623.xalancbmk_s (max) (percentage) |
| 625.x264_s |
| 625.x264_s (avg) |
| 625.x264_s (avg) (percentage) |
| 625.x264_s (max) |
| 625.x264_s (max) (percentage) |
| 631.deepsjeng_s |
| 631.deepsjeng_s (avg) |
| 631.deepsjeng_s (avg) (percentage) |
| 631.deepsjeng_s (max) |
| 631.deepsjeng_s (max) (percentage) |
| 638.imagick_s |
| 638.imagick_s (avg) |
| 638.imagick_s (avg) (percentage) |
| 638.imagick_s (max) |
| 638.imagick_s (max) (percentage) |
| 641.leela_s |
| 641.leela_s (avg) |
| 641.leela_s (avg) (percentage) |
| 641.leela_s (max) |
| 641.leela_s (max) (percentage) |
| 644.nab_s |
| 644.nab_s (avg) |
| 644.nab_s (avg) (percentage) |
| 644.nab_s (max) |
| 644.nab_s (max) (percentage) |
| 657.xz_s |
| 657.xz_s (avg) |
| 657.xz_s (avg) (percentage) |
| 657.xz_s (max) |
| 657.xz_s (max) (percentage) |
Report Time: 0.22s