Fields
| hardware | None |
| os | None |
Parameters
Fields
| Name | Value |
|---|
Parameters
| Name | Value |
|---|---|
| git_llvm | https://github.com/llvm/llvm-project/commit/79e106f6e7627aaf9bda62c05c3e7ac12cf11327 (+ 419 commits) |
| test_url | https://ci.linaro.org/job/tcwg_bmk-code_size-cpu2017fast--llvm-aarch64-master-Os_LTO-build/17/ |
Filter
llvm-aarch64-master-Os_LTO test results
| Run | Order | Start Time | Duration |
|---|---|---|---|
| Current | 0017 (llvmorg-17-init-08275-g79e106f6e762) | 2023-04-11T02:48:29 | 0:00:00 |
| Previous | 0016 (llvmorg-17-init-07856-g2c12e9b7b2df) | 2023-04-05T08:12:36 | 0:00:00 |
| Baseline | 0001 (llvmorg-17-init-03361-gd77f96a9e0c8) | 2023-02-27T23:41:40 | 0:00:00 |
Tests Summary
| Status Group | # | # (B) |
|---|---|---|
| Performance Regressions | 11 | 1 |
| Performance Improvements | 57 | 6 |
| Added Tests | 2 | 75 |
| Unchanged Tests | 632 | 620 |
| Total Tests | 702 |
| Performance Regressions - Execution | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 511.povray_r | 5.58% | 430.000 | 454.000 | - | 0.44% | - |
| 623.xalancbmk_s | 2.98% | 3493.000 | 3597.000 | - | -0.66% | - |
| 600.perlbench_s | 2.04% | 2300.000 | 2347.000 | - | 2.13% | - |
| 620.omnetpp_s | 1.07% | 3738.000 | 3778.000 | - | 0.83% | - |
| Performance Regressions - sample variability | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 511.povray_r | 50.00% | 2.000 | 3.000 | - | 0.00% | - |
| 511.povray_r (avg) | 50.00% | 2.000 | 3.000 | - | 0.00% | - |
| 511.povray_r (max) | 33.33% | 3.000 | 4.000 | - | 0.00% | - |
| 623.xalancbmk_s | 3.85% | 26.000 | 27.000 | - | 0.00% | - |
| 623.xalancbmk_s (avg) | 3.85% | 26.000 | 27.000 | - | 0.00% | - |
| 600.perlbench_s | 1.89% | 53.000 | 54.000 | - | 0.00% | - |
| 600.perlbench_s (avg) | 1.89% | 53.000 | 54.000 | - | 0.00% | - |
| Performance Improvements - Execution | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 526.blender_r | -1.39% | 8554.000 | 8435.000 | - | -1.68% | - |
| 657.xz_s | -1.01% | 2283.000 | 2260.000 | - | -1.18% | - |
| Performance Improvements - sample variability | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 619.lbm_s (unexplained diff vs previous) (percentage) | -98.83% | 7.700 | 0.090 | - | 0.00% | - |
| 619.lbm_s (unexplained diff vs previous) | -98.79% | 2389.000 | 29.000 | - | 0.00% | - |
| 605.mcf_s (unexplained diff vs previous) (percentage) | -95.52% | 1.340 | 0.060 | - | 0.00% | - |
| 605.mcf_s (unexplained diff vs previous) | -95.18% | 83.000 | 4.000 | - | 0.00% | - |
| 625.x264_s (unexplained diff vs previous) (percentage) | -89.21% | 1.390 | 0.150 | - | 0.00% | - |
| 625.x264_s (unexplained diff vs previous) | -89.19% | 37.000 | 4.000 | - | 0.00% | - |
| 620.omnetpp_s (unexplained diff vs previous) (percentage) | -65.58% | 3.080 | 1.060 | - | 0.00% | - |
| 620.omnetpp_s (unexplained diff vs previous) | -65.22% | 115.000 | 40.000 | - | 0.00% | - |
| 644.nab_s (max) | -36.71% | 207.000 | 131.000 | - | 0.00% | - |
| 644.nab_s (max) (percentage) | -36.22% | 1.850 | 1.180 | - | 0.00% | - |
| 625.x264_s | -22.08% | 77.000 | 60.000 | - | 0.00% | - |
| 625.x264_s (avg) | -22.08% | 77.000 | 60.000 | - | 0.00% | - |
| 625.x264_s (avg) (percentage) | -21.38% | 2.900 | 2.280 | - | 0.00% | - |
| 605.mcf_s (avg) (percentage) | -20.36% | 2.800 | 2.230 | - | 0.00% | - |
| 605.mcf_s | -20.23% | 173.000 | 138.000 | - | 0.00% | - |
| 605.mcf_s (avg) | -20.23% | 173.000 | 138.000 | - | 0.00% | - |
| 619.lbm_s | -19.19% | 4493.000 | 3631.000 | - | 0.00% | - |
| 619.lbm_s (avg) | -19.19% | 4493.000 | 3631.000 | - | 0.00% | - |
| 619.lbm_s (avg) (percentage) | -19.12% | 14.490 | 11.720 | - | 0.00% | - |
| 644.nab_s | -18.75% | 160.000 | 130.000 | - | 0.00% | - |
| 644.nab_s (avg) | -18.75% | 160.000 | 130.000 | - | 0.00% | - |
| 644.nab_s (avg) (percentage) | -18.18% | 1.430 | 1.170 | - | 0.00% | - |
| 620.omnetpp_s (avg) (percentage) | -14.45% | 5.190 | 4.440 | - | 0.00% | - |
| 620.omnetpp_s | -13.92% | 194.000 | 167.000 | - | 0.00% | - |
| 620.omnetpp_s (avg) | -13.92% | 194.000 | 167.000 | - | 0.00% | - |
| 625.x264_s (max) | -7.02% | 57.000 | 53.000 | - | 0.00% | - |
| 625.x264_s (max) (percentage) | -6.48% | 2.160 | 2.020 | - | 0.00% | - |
| 526.blender_r (max) | -5.79% | 121.000 | 114.000 | - | 0.00% | - |
| 605.mcf_s (max) | -5.66% | 212.000 | 200.000 | - | 0.00% | - |
| 631.deepsjeng_s (max) | -5.41% | 74.000 | 70.000 | - | 0.00% | - |
| 641.leela_s (max) | -5.41% | 37.000 | 35.000 | - | 0.00% | - |
| 641.leela_s (max) (percentage) | -5.32% | 0.940 | 0.890 | - | 0.00% | - |
| 605.mcf_s (max) (percentage) | -5.26% | 3.420 | 3.240 | - | 0.00% | - |
| 631.deepsjeng_s (max) (percentage) | -5.07% | 2.170 | 2.060 | - | 0.00% | - |
| 657.xz_s (max) | -4.96% | 121.000 | 115.000 | - | 0.00% | - |
| 510.parest_r (max) | -4.94% | 162.000 | 154.000 | - | 0.00% | - |
| 508.namd_r (max) (percentage) | -4.93% | 2.030 | 1.930 | - | 0.00% | - |
| 657.xz_s (max) (percentage) | -4.50% | 5.330 | 5.090 | - | 0.00% | - |
| 526.blender_r (max) (percentage) | -4.23% | 1.420 | 1.360 | - | 0.00% | - |
| 510.parest_r (max) (percentage) | -4.12% | 2.910 | 2.790 | - | 0.00% | - |
| 508.namd_r (max) | -4.08% | 49.000 | 47.000 | - | 0.00% | - |
| 619.lbm_s (max) | -4.08% | 4441.000 | 4260.000 | - | 0.00% | - |
| 600.perlbench_s (max) (percentage) | -4.00% | 3.000 | 2.880 | - | 0.00% | - |
| 619.lbm_s (max) (percentage) | -3.98% | 14.320 | 13.750 | - | 0.00% | - |
| 620.omnetpp_s (max) (percentage) | -3.87% | 3.360 | 3.230 | - | 0.00% | - |
| 623.xalancbmk_s (max) (percentage) | -3.85% | 0.780 | 0.750 | - | 0.00% | - |
| 623.xalancbmk_s (max) | -3.70% | 27.000 | 26.000 | - | 0.00% | - |
| 511.povray_r (max) (percentage) | -3.23% | 0.930 | 0.900 | - | 0.00% | - |
| 641.leela_s | -3.12% | 32.000 | 31.000 | - | 0.00% | - |
| 641.leela_s (avg) | -3.12% | 32.000 | 31.000 | - | 0.00% | - |
| 600.perlbench_s (max) | -2.90% | 69.000 | 67.000 | - | 0.00% | - |
| 620.omnetpp_s (max) | -2.40% | 125.000 | 122.000 | - | 0.00% | - |
| 526.blender_r | -2.15% | 93.000 | 91.000 | - | 0.00% | - |
| 526.blender_r (avg) | -2.15% | 93.000 | 91.000 | - | 0.00% | - |
| 638.imagick_s (max) | -1.15% | 262.000 | 259.000 | - | 0.00% | - |
| Added Tests - sample variability |
|---|
| 644.nab_s (unexplained diff vs previous) |
| 644.nab_s (unexplained diff vs previous) (percentage) |
| Performance Regressions - Execution | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 600.perlbench_s | 2.13% | 2298.000 | 2347.000 | - | 2.04% | - |
| Performance Improvements - Code Size | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 631.deepsjeng_s | -3.63% | 60687.000 | 58483.000 | - | -0.03% | - |
| 511.povray_r | -1.75% | 740092.000 | 727112.000 | - | 0.03% | - |
| Performance Improvements - Execution | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 631.deepsjeng_s | -4.23% | 3596.000 | 3444.000 | - | -0.35% | - |
| 526.blender_r | -1.68% | 8579.000 | 8435.000 | - | -1.39% | - |
| 602.gcc_s | -1.36% | 4203.000 | 4146.000 | - | -0.10% | - |
| 657.xz_s | -1.18% | 2287.000 | 2260.000 | - | -1.01% | - |
| Added Tests - sample variability |
|---|
| 508.namd_r |
| 508.namd_r (avg) |
| 508.namd_r (avg) (percentage) |
| 508.namd_r (max) |
| 508.namd_r (max) (percentage) |
| 510.parest_r |
| 510.parest_r (avg) |
| 510.parest_r (avg) (percentage) |
| 510.parest_r (max) |
| 510.parest_r (max) (percentage) |
| 511.povray_r |
| 511.povray_r (avg) |
| 511.povray_r (avg) (percentage) |
| 511.povray_r (max) |
| 511.povray_r (max) (percentage) |
| 526.blender_r |
| 526.blender_r (avg) |
| 526.blender_r (avg) (percentage) |
| 526.blender_r (max) |
| 526.blender_r (max) (percentage) |
| 600.perlbench_s |
| 600.perlbench_s (avg) |
| 600.perlbench_s (avg) (percentage) |
| 600.perlbench_s (max) |
| 600.perlbench_s (max) (percentage) |
| 605.mcf_s |
| 605.mcf_s (avg) |
| 605.mcf_s (avg) (percentage) |
| 605.mcf_s (max) |
| 605.mcf_s (max) (percentage) |
| 619.lbm_s |
| 619.lbm_s (avg) |
| 619.lbm_s (avg) (percentage) |
| 619.lbm_s (max) |
| 619.lbm_s (max) (percentage) |
| 620.omnetpp_s |
| 620.omnetpp_s (avg) |
| 620.omnetpp_s (avg) (percentage) |
| 620.omnetpp_s (max) |
| 620.omnetpp_s (max) (percentage) |
| 623.xalancbmk_s |
| 623.xalancbmk_s (avg) |
| 623.xalancbmk_s (avg) (percentage) |
| 623.xalancbmk_s (max) |
| 623.xalancbmk_s (max) (percentage) |
| 625.x264_s |
| 625.x264_s (avg) |
| 625.x264_s (avg) (percentage) |
| 625.x264_s (max) |
| 625.x264_s (max) (percentage) |
| 631.deepsjeng_s |
| 631.deepsjeng_s (avg) |
| 631.deepsjeng_s (avg) (percentage) |
| 631.deepsjeng_s (max) |
| 631.deepsjeng_s (max) (percentage) |
| 638.imagick_s |
| 638.imagick_s (avg) |
| 638.imagick_s (avg) (percentage) |
| 638.imagick_s (max) |
| 638.imagick_s (max) (percentage) |
| 641.leela_s |
| 641.leela_s (avg) |
| 641.leela_s (avg) (percentage) |
| 641.leela_s (max) |
| 641.leela_s (max) (percentage) |
| 644.nab_s |
| 644.nab_s (avg) |
| 644.nab_s (avg) (percentage) |
| 644.nab_s (max) |
| 644.nab_s (max) (percentage) |
| 657.xz_s |
| 657.xz_s (avg) |
| 657.xz_s (avg) (percentage) |
| 657.xz_s (max) |
| 657.xz_s (max) (percentage) |
Report Time: 0.32s