Fields
| hardware | None |
| os | None |
Parameters
Fields
| Name | Value |
|---|
Parameters
| Name | Value |
|---|---|
| git_llvm | https://github.com/llvm/llvm-project/commit/2b21327fee50bf401e48d1592073d82da72a433f (+ 292 commits) |
| test_url | https://ci.linaro.org/job/tcwg_bmk-code_size-cpu2017fast--llvm-aarch64-master-Os_LTO-build/8/ |
Filter
llvm-aarch64-master-Os_LTO test results
| Run | Order | Start Time | Duration |
|---|---|---|---|
| Current | 0008 (llvmorg-17-init-05651-g2b21327fee50) | 2023-03-17T12:41:37 | 0:00:00 |
| Previous | 0007 (llvmorg-17-init-05359-g93a04a0591c1) | 2023-03-13T01:37:55 | 0:00:00 |
| Baseline | 0001 (llvmorg-17-init-03361-gd77f96a9e0c8) | 2023-02-27T23:41:40 | 0:00:00 |
Tests Summary
| Status Group | # | # (B) |
|---|---|---|
| Performance Regressions | 4 | 1 |
| Performance Improvements | 58 | 2 |
| Added Tests | 22 | 74 |
| Unchanged Tests | 606 | 613 |
| Total Tests | 690 |
| Performance Regressions - Execution | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 644.nab_s | 2.25% | 11033.000 | 11281.000 | - | 1.55% | - |
| Performance Regressions - sample variability | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 644.nab_s | 16.93% | 189.000 | 221.000 | - | 0.00% | - |
| 644.nab_s (avg) | 16.93% | 189.000 | 221.000 | - | 0.00% | - |
| 644.nab_s (avg) (percentage) | 13.95% | 1.720 | 1.960 | - | 0.00% | - |
| Performance Improvements - Execution | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 605.mcf_s | -1.45% | 6256.000 | 6165.000 | - | -0.60% | - |
| 620.omnetpp_s | -1.02% | 3737.000 | 3699.000 | - | -1.28% | - |
| Performance Improvements - sample variability | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 619.lbm_s (unexplained diff vs previous) (percentage) | -99.21% | 49.410 | 0.390 | - | 0.00% | - |
| 619.lbm_s (unexplained diff vs previous) | -99.21% | 15262.000 | 121.000 | - | 0.00% | - |
| 625.x264_s (unexplained diff vs previous) (percentage) | -98.35% | 9.100 | 0.150 | - | 0.00% | - |
| 625.x264_s (unexplained diff vs previous) | -98.35% | 242.000 | 4.000 | - | 0.00% | - |
| 620.omnetpp_s (unexplained diff vs previous) | -94.52% | 694.000 | 38.000 | - | 0.00% | - |
| 620.omnetpp_s (unexplained diff vs previous) (percentage) | -94.45% | 18.570 | 1.030 | - | 0.00% | - |
| 508.namd_r (max) | -68.91% | 119.000 | 37.000 | - | 0.00% | - |
| 508.namd_r (max) (percentage) | -68.85% | 4.880 | 1.520 | - | 0.00% | - |
| 641.leela_s | -63.04% | 46.000 | 17.000 | - | 0.00% | - |
| 641.leela_s (avg) | -63.04% | 46.000 | 17.000 | - | 0.00% | - |
| 657.xz_s | -62.58% | 310.000 | 116.000 | - | 0.00% | - |
| 657.xz_s (avg) | -62.58% | 310.000 | 116.000 | - | 0.00% | - |
| 657.xz_s (avg) (percentage) | -62.47% | 13.670 | 5.130 | - | 0.00% | - |
| 641.leela_s (avg) (percentage) | -62.07% | 1.160 | 0.440 | - | 0.00% | - |
| 631.deepsjeng_s | -57.41% | 162.000 | 69.000 | - | 0.00% | - |
| 631.deepsjeng_s (avg) | -57.41% | 162.000 | 69.000 | - | 0.00% | - |
| 631.deepsjeng_s (avg) (percentage) | -56.76% | 4.510 | 1.950 | - | 0.00% | - |
| 605.mcf_s | -48.98% | 394.000 | 201.000 | - | 0.00% | - |
| 605.mcf_s (avg) | -48.98% | 394.000 | 201.000 | - | 0.00% | - |
| 605.mcf_s (avg) (percentage) | -48.18% | 6.310 | 3.270 | - | 0.00% | - |
| 508.namd_r | -45.83% | 72.000 | 39.000 | - | 0.00% | - |
| 508.namd_r (avg) | -45.83% | 72.000 | 39.000 | - | 0.00% | - |
| 508.namd_r (avg) (percentage) | -44.75% | 2.950 | 1.630 | - | 0.00% | - |
| 619.lbm_s (max) (percentage) | -42.85% | 48.220 | 27.560 | - | 0.00% | - |
| 619.lbm_s (max) | -42.63% | 14895.000 | 8546.000 | - | 0.00% | - |
| 619.lbm_s (avg) (percentage) | -41.13% | 30.560 | 17.990 | - | 0.00% | - |
| 619.lbm_s | -40.90% | 9439.000 | 5578.000 | - | 0.00% | - |
| 619.lbm_s (avg) | -40.90% | 9439.000 | 5578.000 | - | 0.00% | - |
| 625.x264_s | -40.76% | 184.000 | 109.000 | - | 0.00% | - |
| 625.x264_s (avg) | -40.76% | 184.000 | 109.000 | - | 0.00% | - |
| 625.x264_s (avg) (percentage) | -40.75% | 6.920 | 4.100 | - | 0.00% | - |
| 620.omnetpp_s | -31.15% | 427.000 | 294.000 | - | 0.00% | - |
| 620.omnetpp_s (avg) | -31.15% | 427.000 | 294.000 | - | 0.00% | - |
| 620.omnetpp_s (avg) (percentage) | -30.39% | 11.450 | 7.970 | - | 0.00% | - |
| 620.omnetpp_s (max) | -28.49% | 674.000 | 482.000 | - | 0.00% | - |
| 620.omnetpp_s (max) (percentage) | -27.74% | 18.060 | 13.050 | - | 0.00% | - |
| 625.x264_s (max) (percentage) | -25.83% | 9.370 | 6.950 | - | 0.00% | - |
| 625.x264_s (max) | -25.70% | 249.000 | 185.000 | - | 0.00% | - |
| 644.nab_s (unexplained diff vs previous) (percentage) | -16.35% | 2.630 | 2.200 | - | 0.00% | - |
| 644.nab_s (unexplained diff vs previous) | -14.48% | 290.000 | 248.000 | - | 0.00% | - |
| 644.nab_s (max) (percentage) | -10.16% | 2.560 | 2.300 | - | 0.00% | - |
| 623.xalancbmk_s (max) | -8.33% | 24.000 | 22.000 | - | 0.00% | - |
| 644.nab_s (max) | -8.16% | 282.000 | 259.000 | - | 0.00% | - |
| 623.xalancbmk_s (max) (percentage) | -7.14% | 0.700 | 0.650 | - | 0.00% | - |
| 641.leela_s (max) (percentage) | -6.90% | 0.870 | 0.810 | - | 0.00% | - |
| 510.parest_r (max) | -6.25% | 32.000 | 30.000 | - | 0.00% | - |
| 641.leela_s (max) | -5.88% | 34.000 | 32.000 | - | 0.00% | - |
| 605.mcf_s (max) | -5.32% | 696.000 | 659.000 | - | 0.00% | - |
| 510.parest_r (max) (percentage) | -5.17% | 0.580 | 0.550 | - | 0.00% | - |
| 631.deepsjeng_s (max) | -4.40% | 273.000 | 261.000 | - | 0.00% | - |
| 638.imagick_s (max) (percentage) | -4.08% | 9.060 | 8.690 | - | 0.00% | - |
| 638.imagick_s (max) | -4.08% | 294.000 | 282.000 | - | 0.00% | - |
| 605.mcf_s (max) (percentage) | -4.04% | 11.140 | 10.690 | - | 0.00% | - |
| 657.xz_s (max) (percentage) | -3.99% | 22.300 | 21.410 | - | 0.00% | - |
| 657.xz_s (max) | -3.96% | 505.000 | 485.000 | - | 0.00% | - |
| 631.deepsjeng_s (max) (percentage) | -3.95% | 7.590 | 7.290 | - | 0.00% | - |
| Added Tests - sample variability |
|---|
| 508.namd_r (unexplained diff vs previous) |
| 508.namd_r (unexplained diff vs previous) (percentage) |
| 511.povray_r |
| 511.povray_r (avg) |
| 511.povray_r (avg) (percentage) |
| 511.povray_r (unexplained diff vs previous) |
| 511.povray_r (unexplained diff vs previous) (percentage) |
| 526.blender_r (max) |
| 526.blender_r (max) (percentage) |
| 600.perlbench_s |
| 600.perlbench_s (avg) |
| 600.perlbench_s (avg) (percentage) |
| 600.perlbench_s (unexplained diff vs previous) |
| 600.perlbench_s (unexplained diff vs previous) (percentage) |
| 605.mcf_s (unexplained diff vs previous) |
| 605.mcf_s (unexplained diff vs previous) (percentage) |
| 631.deepsjeng_s (unexplained diff vs previous) |
| 631.deepsjeng_s (unexplained diff vs previous) (percentage) |
| 641.leela_s (unexplained diff vs previous) |
| 641.leela_s (unexplained diff vs previous) (percentage) |
| 657.xz_s (unexplained diff vs previous) |
| 657.xz_s (unexplained diff vs previous) (percentage) |
| Performance Regressions - Execution | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 644.nab_s | 1.55% | 11109.000 | 11281.000 | - | 2.25% | - |
| Performance Improvements - Execution | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 623.xalancbmk_s | -3.51% | 3621.000 | 3494.000 | - | -0.11% | - |
| 620.omnetpp_s | -1.28% | 3747.000 | 3699.000 | - | -1.02% | - |
| Added Tests - sample variability |
|---|
| 508.namd_r |
| 508.namd_r (avg) |
| 508.namd_r (avg) (percentage) |
| 508.namd_r (max) |
| 508.namd_r (max) (percentage) |
| 510.parest_r |
| 510.parest_r (avg) |
| 510.parest_r (avg) (percentage) |
| 510.parest_r (max) |
| 510.parest_r (max) (percentage) |
| 511.povray_r |
| 511.povray_r (avg) |
| 511.povray_r (avg) (percentage) |
| 511.povray_r (max) |
| 511.povray_r (max) (percentage) |
| 526.blender_r (max) |
| 526.blender_r (max) (percentage) |
| 600.perlbench_s |
| 600.perlbench_s (avg) |
| 600.perlbench_s (avg) (percentage) |
| 600.perlbench_s (max) |
| 600.perlbench_s (max) (percentage) |
| 605.mcf_s |
| 605.mcf_s (avg) |
| 605.mcf_s (avg) (percentage) |
| 605.mcf_s (max) |
| 605.mcf_s (max) (percentage) |
| 619.lbm_s |
| 619.lbm_s (avg) |
| 619.lbm_s (avg) (percentage) |
| 619.lbm_s (max) |
| 619.lbm_s (max) (percentage) |
| 620.omnetpp_s |
| 620.omnetpp_s (avg) |
| 620.omnetpp_s (avg) (percentage) |
| 620.omnetpp_s (max) |
| 620.omnetpp_s (max) (percentage) |
| 623.xalancbmk_s |
| 623.xalancbmk_s (avg) |
| 623.xalancbmk_s (avg) (percentage) |
| 623.xalancbmk_s (max) |
| 623.xalancbmk_s (max) (percentage) |
| 625.x264_s |
| 625.x264_s (avg) |
| 625.x264_s (avg) (percentage) |
| 625.x264_s (max) |
| 625.x264_s (max) (percentage) |
| 631.deepsjeng_s |
| 631.deepsjeng_s (avg) |
| 631.deepsjeng_s (avg) (percentage) |
| 631.deepsjeng_s (max) |
| 631.deepsjeng_s (max) (percentage) |
| 638.imagick_s |
| 638.imagick_s (avg) |
| 638.imagick_s (avg) (percentage) |
| 638.imagick_s (max) |
| 638.imagick_s (max) (percentage) |
| 641.leela_s |
| 641.leela_s (avg) |
| 641.leela_s (avg) (percentage) |
| 641.leela_s (max) |
| 641.leela_s (max) (percentage) |
| 644.nab_s |
| 644.nab_s (avg) |
| 644.nab_s (avg) (percentage) |
| 644.nab_s (max) |
| 644.nab_s (max) (percentage) |
| 657.xz_s |
| 657.xz_s (avg) |
| 657.xz_s (avg) (percentage) |
| 657.xz_s (max) |
| 657.xz_s (max) (percentage) |
| 657.xz_s (unexplained diff vs previous) |
| 657.xz_s (unexplained diff vs previous) (percentage) |
Report Time: 0.33s