Fields
| hardware | None |
| os | None |
Parameters
Fields
| Name | Value |
|---|
Parameters
| Name | Value |
|---|---|
| git_llvm | https://github.com/llvm/llvm-project/commit/8a5e9c4b35cb83dd0c1b9f3aabf92698f8d3bf90 (+ 394 commits) |
| test_url | https://ci.linaro.org/job/tcwg_bmk-code_size-cpu2017fast--llvm-aarch64-master-Oz_LTO-build/3/ |
Filter
llvm-aarch64-master-Oz_LTO test results
| Run | Order | Start Time | Duration |
|---|---|---|---|
| Current | 0003 (llvmorg-17-init-04282-g8a5e9c4b35cb) | 2023-03-07T01:50:58 | 0:00:00 |
| Previous | 0002 (llvmorg-17-init-03888-gfb661e255439) | 2023-03-04T22:37:10 | 0:00:00 |
| Baseline | 0001 (llvmorg-17-init-03810-g04a9c62554cf) | 2023-03-03T19:15:36 | 0:00:00 |
Tests Summary
| Status Group | # | # (B) |
|---|---|---|
| Performance Regressions | 14 | 0 |
| Performance Improvements | 41 | 12 |
| Added Tests | 5 | 55 |
| Unchanged Tests | 498 | 491 |
| Total Tests | 558 |
| Performance Regressions - sample variability | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 625.x264_s (max) | 1700.00% | 6.000 | 108.000 | - | 0.00% | - |
| 625.x264_s (unexplained diff vs previous) (percentage) | 1550.00% | 0.140 | 2.310 | - | 0.00% | - |
| 625.x264_s (max) (percentage) | 1514.29% | 0.140 | 2.260 | - | 0.00% | - |
| 625.x264_s (unexplained diff vs previous) | 1485.71% | 7.000 | 111.000 | - | 0.00% | - |
| 625.x264_s | 1133.33% | 6.000 | 74.000 | - | 0.00% | - |
| 625.x264_s (avg) | 1133.33% | 6.000 | 74.000 | - | 0.00% | - |
| 625.x264_s (avg) (percentage) | 1007.14% | 0.140 | 1.550 | - | 0.00% | - |
| 508.namd_r (unexplained diff vs previous) (percentage) | 576.62% | 0.770 | 5.210 | - | 0.00% | - |
| 508.namd_r (unexplained diff vs previous) | 542.86% | 21.000 | 135.000 | - | 0.00% | - |
| 508.namd_r (max) (percentage) | 535.90% | 0.780 | 4.960 | - | 0.00% | - |
| 508.namd_r (max) | 509.52% | 21.000 | 128.000 | - | 0.00% | - |
| 508.namd_r (avg) (percentage) | 357.69% | 0.780 | 3.570 | - | 0.00% | - |
| 508.namd_r | 338.10% | 21.000 | 92.000 | - | 0.00% | - |
| 508.namd_r (avg) | 338.10% | 21.000 | 92.000 | - | 0.00% | - |
| Performance Improvements - Execution | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 619.lbm_s | -27.36% | 42660.000 | 30989.000 | - | -27.89% | - |
| 657.xz_s | -14.61% | 2929.000 | 2501.000 | - | -15.13% | - |
| 605.mcf_s | -10.01% | 6395.000 | 5755.000 | - | -9.82% | - |
| 602.gcc_s | -6.62% | 6373.000 | 5951.000 | - | -7.41% | - |
| 600.perlbench_s | -6.58% | 3557.000 | 3323.000 | - | -5.78% | - |
| 638.imagick_s | -6.41% | 3383.000 | 3166.000 | - | -7.26% | - |
| 508.namd_r | -4.96% | 2724.000 | 2589.000 | - | -4.22% | - |
| 631.deepsjeng_s | -3.43% | 4518.000 | 4363.000 | - | -3.39% | - |
| 526.blender_r | -3.39% | 10390.000 | 10038.000 | - | -2.84% | - |
| 511.povray_r | -3.20% | 532.000 | 515.000 | - | -3.20% | - |
| 644.nab_s | -2.37% | 11666.000 | 11389.000 | - | -1.09% | - |
| 625.x264_s | -2.26% | 4908.000 | 4797.000 | - | -2.40% | - |
| Performance Improvements - sample variability | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 619.lbm_s (max) | -45.34% | 311.000 | 170.000 | - | 0.00% | - |
| 657.xz_s (max) | -35.29% | 17.000 | 11.000 | - | 0.00% | - |
| 605.mcf_s (max) | -33.33% | 12.000 | 8.000 | - | 0.00% | - |
| 600.perlbench_s (max) | -30.00% | 30.000 | 21.000 | - | 0.00% | - |
| 638.imagick_s (max) | -30.00% | 30.000 | 21.000 | - | 0.00% | - |
| 619.lbm_s | -27.33% | 311.000 | 226.000 | - | 0.00% | - |
| 619.lbm_s (avg) | -27.33% | 311.000 | 226.000 | - | 0.00% | - |
| 526.blender_r (max) | -27.12% | 59.000 | 43.000 | - | 0.00% | - |
| 644.nab_s (max) | -26.80% | 153.000 | 112.000 | - | 0.00% | - |
| 638.imagick_s (max) (percentage) | -25.27% | 0.910 | 0.680 | - | 0.00% | - |
| 605.mcf_s (max) (percentage) | -25.00% | 0.200 | 0.150 | - | 0.00% | - |
| 631.deepsjeng_s (max) (percentage) | -25.00% | 0.040 | 0.030 | - | 0.00% | - |
| 644.nab_s (max) (percentage) | -25.00% | 1.320 | 0.990 | - | 0.00% | - |
| 600.perlbench_s (max) (percentage) | -24.71% | 0.850 | 0.640 | - | 0.00% | - |
| 619.lbm_s (max) (percentage) | -24.66% | 0.730 | 0.550 | - | 0.00% | - |
| 657.xz_s (max) (percentage) | -24.59% | 0.610 | 0.460 | - | 0.00% | - |
| 526.blender_r (max) (percentage) | -24.56% | 0.570 | 0.430 | - | 0.00% | - |
| 657.xz_s | -11.76% | 17.000 | 15.000 | - | 0.00% | - |
| 657.xz_s (avg) | -11.76% | 17.000 | 15.000 | - | 0.00% | - |
| 605.mcf_s | -8.33% | 12.000 | 11.000 | - | 0.00% | - |
| 605.mcf_s (avg) | -8.33% | 12.000 | 11.000 | - | 0.00% | - |
| 600.perlbench_s | -6.67% | 30.000 | 28.000 | - | 0.00% | - |
| 600.perlbench_s (avg) | -6.67% | 30.000 | 28.000 | - | 0.00% | - |
| 638.imagick_s | -6.67% | 30.000 | 28.000 | - | 0.00% | - |
| 638.imagick_s (avg) | -6.67% | 30.000 | 28.000 | - | 0.00% | - |
| 526.blender_r | -3.39% | 59.000 | 57.000 | - | 0.00% | - |
| 526.blender_r (avg) | -3.39% | 59.000 | 57.000 | - | 0.00% | - |
| 644.nab_s | -1.96% | 153.000 | 150.000 | - | 0.00% | - |
| 644.nab_s (avg) | -1.96% | 153.000 | 150.000 | - | 0.00% | - |
| Added Tests - sample variability |
|---|
| 511.povray_r |
| 511.povray_r (avg) |
| 511.povray_r (avg) (percentage) |
| 511.povray_r (max) |
| 511.povray_r (max) (percentage) |
| Performance Improvements - Execution | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 619.lbm_s | -27.89% | 42973.000 | 30989.000 | - | -27.36% | - |
| 657.xz_s | -15.13% | 2947.000 | 2501.000 | - | -14.61% | - |
| 605.mcf_s | -9.82% | 6382.000 | 5755.000 | - | -10.01% | - |
| 602.gcc_s | -7.41% | 6427.000 | 5951.000 | - | -6.62% | - |
| 638.imagick_s | -7.26% | 3414.000 | 3166.000 | - | -6.41% | - |
| 600.perlbench_s | -5.78% | 3527.000 | 3323.000 | - | -6.58% | - |
| 508.namd_r | -4.22% | 2703.000 | 2589.000 | - | -4.96% | - |
| 631.deepsjeng_s | -3.39% | 4516.000 | 4363.000 | - | -3.43% | - |
| 511.povray_r | -3.20% | 532.000 | 515.000 | - | -3.20% | - |
| 526.blender_r | -2.84% | 10331.000 | 10038.000 | - | -3.39% | - |
| 625.x264_s | -2.40% | 4915.000 | 4797.000 | - | -2.26% | - |
| 644.nab_s | -1.09% | 11514.000 | 11389.000 | - | -2.37% | - |
| Added Tests - sample variability |
|---|
| 508.namd_r |
| 508.namd_r (avg) |
| 508.namd_r (avg) (percentage) |
| 508.namd_r (max) |
| 508.namd_r (max) (percentage) |
| 511.povray_r |
| 511.povray_r (avg) |
| 511.povray_r (avg) (percentage) |
| 511.povray_r (max) |
| 511.povray_r (max) (percentage) |
| 526.blender_r |
| 526.blender_r (avg) |
| 526.blender_r (avg) (percentage) |
| 526.blender_r (max) |
| 526.blender_r (max) (percentage) |
| 600.perlbench_s |
| 600.perlbench_s (avg) |
| 600.perlbench_s (avg) (percentage) |
| 600.perlbench_s (max) |
| 600.perlbench_s (max) (percentage) |
| 605.mcf_s |
| 605.mcf_s (avg) |
| 605.mcf_s (avg) (percentage) |
| 605.mcf_s (max) |
| 605.mcf_s (max) (percentage) |
| 619.lbm_s |
| 619.lbm_s (avg) |
| 619.lbm_s (avg) (percentage) |
| 619.lbm_s (max) |
| 619.lbm_s (max) (percentage) |
| 625.x264_s |
| 625.x264_s (avg) |
| 625.x264_s (avg) (percentage) |
| 625.x264_s (max) |
| 625.x264_s (max) (percentage) |
| 631.deepsjeng_s |
| 631.deepsjeng_s (avg) |
| 631.deepsjeng_s (avg) (percentage) |
| 631.deepsjeng_s (max) |
| 631.deepsjeng_s (max) (percentage) |
| 638.imagick_s |
| 638.imagick_s (avg) |
| 638.imagick_s (avg) (percentage) |
| 638.imagick_s (max) |
| 638.imagick_s (max) (percentage) |
| 644.nab_s |
| 644.nab_s (avg) |
| 644.nab_s (avg) (percentage) |
| 644.nab_s (max) |
| 644.nab_s (max) (percentage) |
| 657.xz_s |
| 657.xz_s (avg) |
| 657.xz_s (avg) (percentage) |
| 657.xz_s (max) |
| 657.xz_s (max) (percentage) |
Report Time: 0.22s