Fields
| hardware | None |
| os | None |
Parameters
Fields
| Name | Value |
|---|
Parameters
| Name | Value |
|---|---|
| git_llvm | https://github.com/llvm/llvm-project/commit/f061a395ffb78215a23e0f503e8ea121ee3b13ad (+ 13840 commits) |
| test_url | https://ci.linaro.org/job/tcwg_bmk-code_size-cpu2017fast--llvm-aarch64-master-Oz_LTO-build/134/ |
Filter
llvm-aarch64-master-Oz_LTO test results
| Run | Order | Start Time | Duration |
|---|---|---|---|
| Current | 0134 (llvmorg-19-init-09943-gf061a395ffb7) | 2024-02-18T04:35:37 | 0:00:00 |
| Previous | 0086 (llvmorg-18-init-14463-g95dce3e86d69) | 2023-12-07T14:48:12 | 0:00:00 |
| Baseline | 0001 (llvmorg-17-init-03810-g04a9c62554cf) | 2023-03-03T19:15:36 | 0:00:00 |
Tests Summary
| Status Group | # | # (B) |
|---|---|---|
| Performance Regressions | 7 | 2 |
| Performance Improvements | 39 | 17 |
| Added Tests | 10 | 88 |
| Unchanged Tests | 610 | 559 |
| Total Tests | 666 |
| Performance Regressions - Execution | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 623.xalancbmk_s | 2.76% | 7038.000 | 7232.000 | - | 0.00% | - |
| 511.povray_r | 1.93% | 517.000 | 527.000 | - | -0.94% | - |
| 508.namd_r | 1.36% | 2649.000 | 2685.000 | - | -0.67% | - |
| Performance Regressions - sample variability | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 511.povray_r | 9.09% | 11.000 | 12.000 | - | 0.00% | - |
| 511.povray_r (avg) | 9.09% | 11.000 | 12.000 | - | 0.00% | - |
| 508.namd_r | 1.96% | 51.000 | 52.000 | - | 0.00% | - |
| 508.namd_r (avg) | 1.96% | 51.000 | 52.000 | - | 0.00% | - |
| Performance Improvements - Execution | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 657.xz_s | -7.06% | 2521.000 | 2343.000 | - | -20.50% | - |
| 619.lbm_s | -4.67% | 30623.000 | 29193.000 | - | -32.07% | - |
| 625.x264_s | -2.09% | 4882.000 | 4780.000 | - | -2.75% | - |
| 644.nab_s | -1.62% | 11529.000 | 11342.000 | - | -1.49% | - |
| Performance Improvements - sample variability | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 605.mcf_s (max) (percentage) | -11.59% | 0.690 | 0.610 | - | 0.00% | - |
| 605.mcf_s (max) | -11.36% | 44.000 | 39.000 | - | 0.00% | - |
| 657.xz_s (max) | -11.19% | 402.000 | 357.000 | - | 0.00% | - |
| 619.lbm_s (max) | -8.22% | 10540.000 | 9674.000 | - | 0.00% | - |
| 657.xz_s | -7.33% | 150.000 | 139.000 | - | 0.00% | - |
| 657.xz_s (avg) | -7.33% | 150.000 | 139.000 | - | 0.00% | - |
| 641.leela_s (max) | -5.63% | 142.000 | 134.000 | - | 0.00% | - |
| 641.leela_s (max) (percentage) | -4.79% | 3.130 | 2.980 | - | 0.00% | - |
| 644.nab_s (max) | -4.76% | 231.000 | 220.000 | - | 0.00% | - |
| 619.lbm_s | -4.67% | 3193.000 | 3044.000 | - | 0.00% | - |
| 619.lbm_s (avg) | -4.67% | 3193.000 | 3044.000 | - | 0.00% | - |
| 657.xz_s (max) (percentage) | -4.57% | 15.970 | 15.240 | - | 0.00% | - |
| 620.omnetpp_s (max) | -4.48% | 469.000 | 448.000 | - | 0.00% | - |
| 620.omnetpp_s (max) (percentage) | -4.20% | 10.720 | 10.270 | - | 0.00% | - |
| 600.perlbench_s (max) | -3.85% | 286.000 | 275.000 | - | 0.00% | - |
| 638.imagick_s (max) | -3.79% | 343.000 | 330.000 | - | 0.00% | - |
| 619.lbm_s (max) (percentage) | -3.72% | 34.420 | 33.140 | - | 0.00% | - |
| 644.nab_s (max) (percentage) | -3.48% | 2.010 | 1.940 | - | 0.00% | - |
| 625.x264_s | -3.45% | 29.000 | 28.000 | - | 0.00% | - |
| 625.x264_s (avg) | -3.45% | 29.000 | 28.000 | - | 0.00% | - |
| 511.povray_r (max) (percentage) | -3.38% | 4.140 | 4.000 | - | 0.00% | - |
| 631.deepsjeng_s (max) (percentage) | -3.31% | 6.640 | 6.420 | - | 0.00% | - |
| 600.perlbench_s (max) (percentage) | -3.27% | 9.170 | 8.870 | - | 0.00% | - |
| 631.deepsjeng_s (max) | -3.26% | 276.000 | 267.000 | - | 0.00% | - |
| 508.namd_r (max) (percentage) | -3.22% | 5.590 | 5.410 | - | 0.00% | - |
| 638.imagick_s (max) (percentage) | -3.06% | 10.780 | 10.450 | - | 0.00% | - |
| 510.parest_r (max) | -2.55% | 550.000 | 536.000 | - | 0.00% | - |
| 510.parest_r (max) (percentage) | -2.44% | 9.020 | 8.800 | - | 0.00% | - |
| 508.namd_r (max) | -2.03% | 148.000 | 145.000 | - | 0.00% | - |
| 644.nab_s | -1.63% | 123.000 | 121.000 | - | 0.00% | - |
| 644.nab_s (avg) | -1.63% | 123.000 | 121.000 | - | 0.00% | - |
| 625.x264_s (max) | -1.54% | 65.000 | 64.000 | - | 0.00% | - |
| Performance Improvements - Score | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| nb_compile_successful | 175.00% | 16.000 | 44.000 | - | 214.29% | - |
| nb_total_tests | 166.67% | 18.000 | 48.000 | - | 100.00% | - |
| nb_execution_successful | 150.00% | 16.000 | 40.000 | - | 233.33% | - |
| Added Tests - Code Size |
|---|
| 603.bwaves_s |
| 648.exchange2_s |
| 649.fotonik3d_s |
| 654.roms_s |
| Added Tests - Execution |
|---|
| 603.bwaves_s |
| 627.cam4_s |
| 628.pop2_s |
| 648.exchange2_s |
| 649.fotonik3d_s |
| 654.roms_s |
| Performance Regressions - Execution | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 526.blender_r | 3.69% | 10331.000 | 10712.000 | - | -0.48% | - |
| 605.mcf_s | 1.35% | 6382.000 | 6468.000 | - | 0.39% | - |
| Performance Improvements - Code Size | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 631.deepsjeng_s | -5.06% | 59343.000 | 56339.000 | - | -0.18% | - |
| 644.nab_s | -2.77% | 82210.000 | 79934.000 | - | -0.17% | - |
| 605.mcf_s | -2.38% | 14136.000 | 13800.000 | - | -0.26% | - |
| 657.xz_s | -2.24% | 107659.000 | 105243.000 | - | -0.52% | - |
| 511.povray_r | -2.06% | 692391.000 | 678111.000 | - | -0.20% | - |
| 619.lbm_s | -1.57% | 13782.000 | 13566.000 | - | -0.67% | - |
| Performance Improvements - Execution | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 619.lbm_s | -32.07% | 42973.000 | 29193.000 | - | -4.67% | - |
| 657.xz_s | -20.50% | 2947.000 | 2343.000 | - | -7.06% | - |
| 600.perlbench_s | -11.99% | 3527.000 | 3104.000 | - | -0.64% | - |
| 631.deepsjeng_s | -7.71% | 4516.000 | 4168.000 | - | 0.14% | - |
| 638.imagick_s | -7.35% | 3414.000 | 3163.000 | - | -0.60% | - |
| 602.gcc_s | -6.08% | 6427.000 | 6036.000 | - | 0.05% | - |
| 625.x264_s | -2.75% | 4915.000 | 4780.000 | - | -2.09% | - |
| 644.nab_s | -1.49% | 11514.000 | 11342.000 | - | -1.62% | - |
| Performance Improvements - Score | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| nb_execution_successful | 233.33% | 12.000 | 40.000 | - | 150.00% | - |
| nb_compile_successful | 214.29% | 14.000 | 44.000 | - | 175.00% | - |
| nb_total_tests | 100.00% | 24.000 | 48.000 | - | 166.67% | - |
| Added Tests - Code Size |
|---|
| 510.parest_r |
| 603.bwaves_s |
| 620.omnetpp_s |
| 623.xalancbmk_s |
| 641.leela_s |
| 648.exchange2_s |
| 649.fotonik3d_s |
| 654.roms_s |
| Added Tests - Execution |
|---|
| 510.parest_r |
| 603.bwaves_s |
| 620.omnetpp_s |
| 623.xalancbmk_s |
| 627.cam4_s |
| 628.pop2_s |
| 641.leela_s |
| 648.exchange2_s |
| 649.fotonik3d_s |
| 654.roms_s |
| Added Tests - sample variability |
|---|
| 508.namd_r |
| 508.namd_r (avg) |
| 508.namd_r (avg) (percentage) |
| 508.namd_r (max) |
| 508.namd_r (max) (percentage) |
| 510.parest_r |
| 510.parest_r (avg) |
| 510.parest_r (avg) (percentage) |
| 510.parest_r (max) |
| 510.parest_r (max) (percentage) |
| 511.povray_r |
| 511.povray_r (avg) |
| 511.povray_r (avg) (percentage) |
| 511.povray_r (max) |
| 511.povray_r (max) (percentage) |
| 526.blender_r |
| 526.blender_r (avg) |
| 526.blender_r (avg) (percentage) |
| 526.blender_r (max) |
| 526.blender_r (max) (percentage) |
| 600.perlbench_s |
| 600.perlbench_s (avg) |
| 600.perlbench_s (avg) (percentage) |
| 600.perlbench_s (max) |
| 600.perlbench_s (max) (percentage) |
| 605.mcf_s |
| 605.mcf_s (avg) |
| 605.mcf_s (avg) (percentage) |
| 605.mcf_s (max) |
| 605.mcf_s (max) (percentage) |
| 619.lbm_s |
| 619.lbm_s (avg) |
| 619.lbm_s (avg) (percentage) |
| 619.lbm_s (max) |
| 619.lbm_s (max) (percentage) |
| 620.omnetpp_s |
| 620.omnetpp_s (avg) |
| 620.omnetpp_s (avg) (percentage) |
| 620.omnetpp_s (max) |
| 620.omnetpp_s (max) (percentage) |
| 625.x264_s |
| 625.x264_s (avg) |
| 625.x264_s (avg) (percentage) |
| 625.x264_s (max) |
| 625.x264_s (max) (percentage) |
| 631.deepsjeng_s |
| 631.deepsjeng_s (avg) |
| 631.deepsjeng_s (avg) (percentage) |
| 631.deepsjeng_s (max) |
| 631.deepsjeng_s (max) (percentage) |
| 638.imagick_s |
| 638.imagick_s (avg) |
| 638.imagick_s (avg) (percentage) |
| 638.imagick_s (max) |
| 638.imagick_s (max) (percentage) |
| 641.leela_s |
| 641.leela_s (avg) |
| 641.leela_s (avg) (percentage) |
| 641.leela_s (max) |
| 641.leela_s (max) (percentage) |
| 644.nab_s |
| 644.nab_s (avg) |
| 644.nab_s (avg) (percentage) |
| 644.nab_s (max) |
| 644.nab_s (max) (percentage) |
| 657.xz_s |
| 657.xz_s (avg) |
| 657.xz_s (avg) (percentage) |
| 657.xz_s (max) |
| 657.xz_s (max) (percentage) |
Report Time: 0.22s