Fields
| hardware | None |
| os | None |
Parameters
Fields
| Name | Value |
|---|
Parameters
| Name | Value |
|---|---|
| git_llvm | https://github.com/llvm/llvm-project/commit/ce14f7b18fe137d862604a1959ff80cfa87ba844 (+ 664 commits) |
| test_url | https://ci.linaro.org/job/tcwg_bmk-code_size-cpu2017fast--llvm-aarch64-master-Oz_LTO-build/5/ |
Filter
llvm-aarch64-master-Oz_LTO test results
| Run | Order | Start Time | Duration |
|---|---|---|---|
| Current | 0005 (llvmorg-17-init-04946-gce14f7b18fe1) | 2023-03-11T03:19:53 | 0:00:00 |
| Previous | 0003 (llvmorg-17-init-04282-g8a5e9c4b35cb) | 2023-03-07T01:50:58 | 0:00:00 |
| Baseline | 0001 (llvmorg-17-init-03810-g04a9c62554cf) | 2023-03-03T19:15:36 | 0:00:00 |
Tests Summary
| Status Group | # | # (B) |
|---|---|---|
| Performance Regressions | 33 | 0 |
| Performance Improvements | 14 | 11 |
| Added Tests | 9 | 55 |
| Unchanged Tests | 502 | 492 |
| Total Tests | 558 |
| Performance Regressions - Execution | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 619.lbm_s | 13.77% | 30989.000 | 35255.000 | - | -17.96% | - |
| 657.xz_s | 6.28% | 2501.000 | 2658.000 | - | -9.81% | - |
| 605.mcf_s | 4.36% | 5755.000 | 6006.000 | - | -5.89% | - |
| 600.perlbench_s | 2.71% | 3323.000 | 3413.000 | - | -3.23% | - |
| 508.namd_r | 2.43% | 2589.000 | 2652.000 | - | -1.89% | - |
| 602.gcc_s | 2.40% | 5951.000 | 6094.000 | - | -5.18% | - |
| 638.imagick_s | 2.21% | 3166.000 | 3236.000 | - | -5.21% | - |
| 511.povray_r | 1.94% | 515.000 | 525.000 | - | -1.32% | - |
| 526.blender_r | 1.67% | 10038.000 | 10206.000 | - | -1.21% | - |
| 644.nab_s | 1.58% | 11389.000 | 11569.000 | - | 0.48% | - |
| 631.deepsjeng_s | 1.03% | 4363.000 | 4408.000 | - | -2.39% | - |
| Performance Regressions - sample variability | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 619.lbm_s (max) | 2755.29% | 170.000 | 4854.000 | - | 0.00% | - |
| 619.lbm_s (max) (percentage) | 2403.64% | 0.550 | 13.770 | - | 0.00% | - |
| 619.lbm_s | 1539.38% | 226.000 | 3705.000 | - | 0.00% | - |
| 619.lbm_s (avg) | 1539.38% | 226.000 | 3705.000 | - | 0.00% | - |
| 619.lbm_s (avg) (percentage) | 1339.73% | 0.730 | 10.510 | - | 0.00% | - |
| 644.nab_s (max) | 62.50% | 112.000 | 182.000 | - | 0.00% | - |
| 644.nab_s (max) (percentage) | 59.60% | 0.990 | 1.580 | - | 0.00% | - |
| 644.nab_s | 16.67% | 150.000 | 175.000 | - | 0.00% | - |
| 644.nab_s (avg) | 16.67% | 150.000 | 175.000 | - | 0.00% | - |
| 644.nab_s (avg) (percentage) | 15.15% | 1.320 | 1.520 | - | 0.00% | - |
| 605.mcf_s | 9.09% | 11.000 | 12.000 | - | 0.00% | - |
| 605.mcf_s (avg) | 9.09% | 11.000 | 12.000 | - | 0.00% | - |
| 657.xz_s | 6.67% | 15.000 | 16.000 | - | 0.00% | - |
| 657.xz_s (avg) | 6.67% | 15.000 | 16.000 | - | 0.00% | - |
| 600.perlbench_s | 3.57% | 28.000 | 29.000 | - | 0.00% | - |
| 600.perlbench_s (avg) | 3.57% | 28.000 | 29.000 | - | 0.00% | - |
| 638.imagick_s | 3.57% | 28.000 | 29.000 | - | 0.00% | - |
| 638.imagick_s (avg) | 3.57% | 28.000 | 29.000 | - | 0.00% | - |
| 508.namd_r | 2.17% | 92.000 | 94.000 | - | 0.00% | - |
| 508.namd_r (avg) | 2.17% | 92.000 | 94.000 | - | 0.00% | - |
| 526.blender_r | 1.75% | 57.000 | 58.000 | - | 0.00% | - |
| 526.blender_r (avg) | 1.75% | 57.000 | 58.000 | - | 0.00% | - |
| Performance Improvements - sample variability | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 625.x264_s (max) (percentage) | -16.81% | 2.260 | 1.880 | - | 0.00% | - |
| 508.namd_r (max) (percentage) | -16.73% | 4.960 | 4.130 | - | 0.00% | - |
| 625.x264_s (max) | -16.67% | 108.000 | 90.000 | - | 0.00% | - |
| 508.namd_r (max) | -14.84% | 128.000 | 109.000 | - | 0.00% | - |
| 605.mcf_s (max) (percentage) | -13.33% | 0.150 | 0.130 | - | 0.00% | - |
| 605.mcf_s (max) | -12.50% | 8.000 | 7.000 | - | 0.00% | - |
| 526.blender_r (max) | -11.63% | 43.000 | 38.000 | - | 0.00% | - |
| 526.blender_r (max) (percentage) | -11.63% | 0.430 | 0.380 | - | 0.00% | - |
| 600.perlbench_s (max) (percentage) | -10.94% | 0.640 | 0.570 | - | 0.00% | - |
| 657.xz_s (max) (percentage) | -10.87% | 0.460 | 0.410 | - | 0.00% | - |
| 638.imagick_s (max) (percentage) | -10.29% | 0.680 | 0.610 | - | 0.00% | - |
| 600.perlbench_s (max) | -9.52% | 21.000 | 19.000 | - | 0.00% | - |
| 638.imagick_s (max) | -9.52% | 21.000 | 19.000 | - | 0.00% | - |
| 657.xz_s (max) | -9.09% | 11.000 | 10.000 | - | 0.00% | - |
| Added Tests - sample variability |
|---|
| 511.povray_r |
| 511.povray_r (avg) |
| 511.povray_r (avg) (percentage) |
| 511.povray_r (max) |
| 511.povray_r (max) (percentage) |
| 619.lbm_s (unexplained diff vs previous) |
| 619.lbm_s (unexplained diff vs previous) (percentage) |
| 644.nab_s (unexplained diff vs previous) |
| 644.nab_s (unexplained diff vs previous) (percentage) |
| Performance Improvements - Execution | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 619.lbm_s | -17.96% | 42973.000 | 35255.000 | - | 13.77% | - |
| 657.xz_s | -9.81% | 2947.000 | 2658.000 | - | 6.28% | - |
| 605.mcf_s | -5.89% | 6382.000 | 6006.000 | - | 4.36% | - |
| 638.imagick_s | -5.21% | 3414.000 | 3236.000 | - | 2.21% | - |
| 602.gcc_s | -5.18% | 6427.000 | 6094.000 | - | 2.40% | - |
| 600.perlbench_s | -3.23% | 3527.000 | 3413.000 | - | 2.71% | - |
| 631.deepsjeng_s | -2.39% | 4516.000 | 4408.000 | - | 1.03% | - |
| 508.namd_r | -1.89% | 2703.000 | 2652.000 | - | 2.43% | - |
| 625.x264_s | -1.57% | 4915.000 | 4838.000 | - | 0.85% | - |
| 511.povray_r | -1.32% | 532.000 | 525.000 | - | 1.94% | - |
| 526.blender_r | -1.21% | 10331.000 | 10206.000 | - | 1.67% | - |
| Added Tests - sample variability |
|---|
| 508.namd_r |
| 508.namd_r (avg) |
| 508.namd_r (avg) (percentage) |
| 508.namd_r (max) |
| 508.namd_r (max) (percentage) |
| 511.povray_r |
| 511.povray_r (avg) |
| 511.povray_r (avg) (percentage) |
| 511.povray_r (max) |
| 511.povray_r (max) (percentage) |
| 526.blender_r |
| 526.blender_r (avg) |
| 526.blender_r (avg) (percentage) |
| 526.blender_r (max) |
| 526.blender_r (max) (percentage) |
| 600.perlbench_s |
| 600.perlbench_s (avg) |
| 600.perlbench_s (avg) (percentage) |
| 600.perlbench_s (max) |
| 600.perlbench_s (max) (percentage) |
| 605.mcf_s |
| 605.mcf_s (avg) |
| 605.mcf_s (avg) (percentage) |
| 605.mcf_s (max) |
| 605.mcf_s (max) (percentage) |
| 619.lbm_s |
| 619.lbm_s (avg) |
| 619.lbm_s (avg) (percentage) |
| 619.lbm_s (max) |
| 619.lbm_s (max) (percentage) |
| 625.x264_s |
| 625.x264_s (avg) |
| 625.x264_s (avg) (percentage) |
| 625.x264_s (max) |
| 625.x264_s (max) (percentage) |
| 631.deepsjeng_s |
| 631.deepsjeng_s (avg) |
| 631.deepsjeng_s (avg) (percentage) |
| 631.deepsjeng_s (max) |
| 631.deepsjeng_s (max) (percentage) |
| 638.imagick_s |
| 638.imagick_s (avg) |
| 638.imagick_s (avg) (percentage) |
| 638.imagick_s (max) |
| 638.imagick_s (max) (percentage) |
| 644.nab_s |
| 644.nab_s (avg) |
| 644.nab_s (avg) (percentage) |
| 644.nab_s (max) |
| 644.nab_s (max) (percentage) |
| 657.xz_s |
| 657.xz_s (avg) |
| 657.xz_s (avg) (percentage) |
| 657.xz_s (max) |
| 657.xz_s (max) (percentage) |
Report Time: 0.22s