Fields
| hardware | None |
| os | None |
Parameters
Fields
| Name | Value |
|---|
Parameters
| Name | Value |
|---|---|
| git_llvm | https://github.com/llvm/llvm-project/commit/19d3f3417100dc99caa4394fbd26fc0c4702264e (+ 397 commits) |
| test_url | https://ci.linaro.org/job/tcwg_bmk-code_size-cpu2017fast--llvm-aarch64-master-Os_LTO-build/182/ |
Filter
llvm-aarch64-master-Os_LTO test results
| Run | Order | Start Time | Duration |
|---|---|---|---|
| Current | 0182 (llvmorg-20-init-03224-g19d3f3417100) | 2024-08-18T00:34:47 | 0:00:00 |
| Previous | 0181 (llvmorg-20-init-02827-gc64ce8bf2831) | 2024-08-14T01:15:57 | 0:00:00 |
| Baseline | 0001 (llvmorg-17-init-03361-gd77f96a9e0c8) | 2023-02-27T23:41:40 | 0:00:00 |
Tests Summary
| Status Group | # | # (B) |
|---|---|---|
| Performance Regressions | 87 | 15 |
| Performance Improvements | 11 | 8 |
| Added Tests | 4 | 107 |
| Unchanged Tests | 720 | 692 |
| Total Tests | 822 |
| Performance Regressions - Execution | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 619.lbm_s | 72.94% | 32127.000 | 55559.000 | - | 78.88% | - |
| 649.fotonik3d_s | 45.56% | 12961.000 | 18866.000 | - | 0.00% | - |
| 603.bwaves_s | 42.18% | 9520.000 | 13536.000 | - | 0.00% | - |
| 657.xz_s | 33.61% | 2160.000 | 2886.000 | - | 26.19% | - |
| 654.roms_s | 26.85% | 39941.000 | 50666.000 | - | 0.00% | - |
| 638.imagick_s | 23.58% | 3062.000 | 3784.000 | - | 16.14% | - |
| 620.omnetpp_s | 18.66% | 3858.000 | 4578.000 | - | 22.18% | - |
| 602.gcc_s | 16.59% | 4172.000 | 4864.000 | - | 15.73% | - |
| 600.perlbench_s | 16.24% | 2248.000 | 2613.000 | - | 13.71% | - |
| 510.parest_r | 14.59% | 5621.000 | 6441.000 | - | 15.29% | - |
| 605.mcf_s | 13.08% | 6421.000 | 7261.000 | - | 17.08% | - |
| 627.cam4_s | 12.21% | 426.000 | 478.000 | - | 0.00% | - |
| 625.x264_s | 11.20% | 2678.000 | 2978.000 | - | 11.87% | - |
| 631.deepsjeng_s | 10.56% | 3438.000 | 3801.000 | - | 5.70% | - |
| 508.namd_r | 10.17% | 2526.000 | 2783.000 | - | 13.82% | - |
| 628.pop2_s | 7.77% | 18162.000 | 19573.000 | - | 0.00% | - |
| 526.blender_r | 6.13% | 8927.000 | 9474.000 | - | 10.43% | - |
| 641.leela_s | 6.05% | 4098.000 | 4346.000 | - | 8.92% | - |
| 644.nab_s | 4.67% | 11160.000 | 11681.000 | - | 5.15% | - |
| 511.povray_r | 3.13% | 415.000 | 428.000 | - | -5.31% | - |
| Performance Regressions - sample variability | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 510.parest_r (unexplained diff vs previous) | 13566.67% | 6.000 | 820.000 | 0.000 | 0.00% | 0.000 |
| 510.parest_r (unexplained diff vs previous) (percentage) | 11472.73% | 0.110 | 12.730 | 0.000 | 0.00% | 0.000 |
| 625.x264_s (unexplained diff vs previous) | 5900.00% | 5.000 | 300.000 | 0.000 | 0.00% | 0.000 |
| 625.x264_s (unexplained diff vs previous) (percentage) | 5200.00% | 0.190 | 10.070 | 0.000 | 0.00% | 0.000 |
| 649.fotonik3d_s (max) | 4520.97% | 186.000 | 8595.000 | - | 0.00% | - |
| 649.fotonik3d_s (max) (percentage) | 3063.89% | 1.440 | 45.560 | - | 0.00% | - |
| 625.x264_s (max) | 2927.27% | 11.000 | 333.000 | - | 0.00% | - |
| 625.x264_s (max) (percentage) | 2566.67% | 0.420 | 11.200 | - | 0.00% | - |
| 510.parest_r (max) | 1073.75% | 80.000 | 939.000 | - | 0.00% | - |
| 620.omnetpp_s (max) | 1009.09% | 77.000 | 854.000 | - | 0.00% | - |
| 619.lbm_s (max) | 950.39% | 3858.000 | 40524.000 | - | 0.00% | - |
| 510.parest_r (max) (percentage) | 913.19% | 1.440 | 14.590 | - | 0.00% | - |
| 620.omnetpp_s (unexplained diff vs previous) | 847.37% | 76.000 | 720.000 | 0.000 | 0.00% | 0.000 |
| 620.omnetpp_s (max) (percentage) | 828.36% | 2.010 | 18.660 | - | 0.00% | - |
| 620.omnetpp_s (unexplained diff vs previous) (percentage) | 698.48% | 1.970 | 15.730 | 0.000 | 0.00% | 0.000 |
| 649.fotonik3d_s | 586.99% | 146.000 | 1003.000 | - | 0.00% | - |
| 649.fotonik3d_s (avg) | 586.99% | 146.000 | 1003.000 | - | 0.00% | - |
| 619.lbm_s (unexplained diff vs previous) | 580.17% | 3445.000 | 23432.000 | 0.000 | 0.00% | 0.000 |
| 619.lbm_s (max) (percentage) | 507.33% | 12.010 | 72.940 | - | 0.00% | - |
| 649.fotonik3d_s (avg) (percentage) | 370.80% | 1.130 | 5.320 | - | 0.00% | - |
| 619.lbm_s (unexplained diff vs previous) (percentage) | 293.38% | 10.720 | 42.170 | 0.000 | 0.00% | 0.000 |
| 619.lbm_s | 96.77% | 3617.000 | 7117.000 | - | 0.00% | - |
| 619.lbm_s (avg) | 96.77% | 3617.000 | 7117.000 | - | 0.00% | - |
| 510.parest_r | 48.57% | 105.000 | 156.000 | - | 0.00% | - |
| 510.parest_r (avg) | 48.57% | 105.000 | 156.000 | - | 0.00% | - |
| 603.bwaves_s | 42.31% | 208.000 | 296.000 | - | 0.00% | - |
| 603.bwaves_s (avg) | 42.31% | 208.000 | 296.000 | - | 0.00% | - |
| 603.bwaves_s (max) | 37.58% | 447.000 | 615.000 | - | 0.00% | - |
| 657.xz_s | 33.77% | 77.000 | 103.000 | - | 0.00% | - |
| 657.xz_s (avg) | 33.77% | 77.000 | 103.000 | - | 0.00% | - |
| 657.xz_s (max) | 30.77% | 26.000 | 34.000 | - | 0.00% | - |
| 510.parest_r (avg) (percentage) | 29.95% | 1.870 | 2.430 | - | 0.00% | - |
| 620.omnetpp_s | 29.58% | 142.000 | 184.000 | - | 0.00% | - |
| 620.omnetpp_s (avg) | 29.58% | 142.000 | 184.000 | - | 0.00% | - |
| 654.roms_s | 26.92% | 910.000 | 1155.000 | - | 0.00% | - |
| 654.roms_s (avg) | 26.92% | 910.000 | 1155.000 | - | 0.00% | - |
| 654.roms_s (max) | 24.43% | 663.000 | 825.000 | - | 0.00% | - |
| 638.imagick_s | 24.29% | 70.000 | 87.000 | - | 0.00% | - |
| 638.imagick_s (avg) | 24.29% | 70.000 | 87.000 | - | 0.00% | - |
| 625.x264_s | 21.82% | 55.000 | 67.000 | - | 0.00% | - |
| 625.x264_s (avg) | 21.82% | 55.000 | 67.000 | - | 0.00% | - |
| 638.imagick_s (max) | 18.42% | 38.000 | 45.000 | - | 0.00% | - |
| 600.perlbench_s | 16.33% | 49.000 | 57.000 | - | 0.00% | - |
| 600.perlbench_s (avg) | 16.33% | 49.000 | 57.000 | - | 0.00% | - |
| 600.perlbench_s (max) | 14.29% | 14.000 | 16.000 | - | 0.00% | - |
| 619.lbm_s (avg) (percentage) | 13.77% | 11.260 | 12.810 | - | 0.00% | - |
| 605.mcf_s | 13.19% | 144.000 | 163.000 | - | 0.00% | - |
| 605.mcf_s (avg) | 13.19% | 144.000 | 163.000 | - | 0.00% | - |
| 625.x264_s (avg) (percentage) | 10.14% | 2.070 | 2.280 | - | 0.00% | - |
| 631.deepsjeng_s | 10.00% | 60.000 | 66.000 | - | 0.00% | - |
| 631.deepsjeng_s (avg) | 10.00% | 60.000 | 66.000 | - | 0.00% | - |
| 508.namd_r | 9.76% | 41.000 | 45.000 | - | 0.00% | - |
| 508.namd_r (avg) | 9.76% | 41.000 | 45.000 | - | 0.00% | - |
| 620.omnetpp_s (avg) (percentage) | 8.65% | 3.700 | 4.020 | - | 0.00% | - |
| 605.mcf_s (max) | 7.64% | 144.000 | 155.000 | - | 0.00% | - |
| 508.namd_r (max) | 7.14% | 14.000 | 15.000 | - | 0.00% | - |
| 641.leela_s | 6.38% | 47.000 | 50.000 | - | 0.00% | - |
| 641.leela_s (avg) | 6.38% | 47.000 | 50.000 | - | 0.00% | - |
| 648.exchange2_s (max) | 6.35% | 126.000 | 134.000 | - | 0.00% | - |
| 526.blender_r | 5.88% | 68.000 | 72.000 | - | 0.00% | - |
| 526.blender_r (avg) | 5.88% | 68.000 | 72.000 | - | 0.00% | - |
| 648.exchange2_s (max) (percentage) | 5.88% | 0.340 | 0.360 | - | 0.00% | - |
| 644.nab_s | 4.63% | 108.000 | 113.000 | - | 0.00% | - |
| 644.nab_s (avg) | 4.63% | 108.000 | 113.000 | - | 0.00% | - |
| 526.blender_r (max) | 4.55% | 44.000 | 46.000 | - | 0.00% | - |
| 631.deepsjeng_s (max) | 4.55% | 22.000 | 23.000 | - | 0.00% | - |
| 641.leela_s (max) | 2.38% | 42.000 | 43.000 | - | 0.00% | - |
| Performance Improvements - sample variability | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 508.namd_r (max) (percentage) | -6.78% | 0.590 | 0.550 | - | 0.00% | - |
| 605.mcf_s (max) (percentage) | -4.89% | 2.250 | 2.140 | - | 0.00% | - |
| 638.imagick_s (max) (percentage) | -4.76% | 1.260 | 1.200 | - | 0.00% | - |
| 631.deepsjeng_s (max) (percentage) | -4.55% | 0.660 | 0.630 | - | 0.00% | - |
| 644.nab_s (max) (percentage) | -4.17% | 1.920 | 1.840 | - | 0.00% | - |
| 641.leela_s (max) (percentage) | -3.85% | 1.040 | 1.000 | - | 0.00% | - |
| 657.xz_s (max) (percentage) | -3.28% | 1.220 | 1.180 | - | 0.00% | - |
| 603.bwaves_s (max) (percentage) | -3.19% | 4.700 | 4.550 | - | 0.00% | - |
| 511.povray_r (max) (percentage) | -2.02% | 0.990 | 0.970 | - | 0.00% | - |
| 526.blender_r (max) (percentage) | -2.00% | 0.500 | 0.490 | - | 0.00% | - |
| 654.roms_s (max) (percentage) | -1.81% | 1.660 | 1.630 | - | 0.00% | - |
| Added Tests - sample variability |
|---|
| 648.exchange2_s (unexplained diff vs previous) |
| 648.exchange2_s (unexplained diff vs previous) (percentage) |
| 649.fotonik3d_s (unexplained diff vs previous) |
| 649.fotonik3d_s (unexplained diff vs previous) (percentage) |
| Performance Regressions - Code Size | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 620.omnetpp_s | 1.92% | 1650838.000 | 1682570.000 | - | -0.01% | - |
| Performance Regressions - Execution | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 619.lbm_s | 78.88% | 31060.000 | 55559.000 | - | 72.94% | - |
| 657.xz_s | 26.19% | 2287.000 | 2886.000 | - | 33.61% | - |
| 620.omnetpp_s | 22.18% | 3747.000 | 4578.000 | - | 18.66% | - |
| 605.mcf_s | 17.08% | 6202.000 | 7261.000 | - | 13.08% | - |
| 638.imagick_s | 16.14% | 3258.000 | 3784.000 | - | 23.58% | - |
| 602.gcc_s | 15.73% | 4203.000 | 4864.000 | - | 16.59% | - |
| 510.parest_r | 15.29% | 5587.000 | 6441.000 | - | 14.59% | - |
| 508.namd_r | 13.82% | 2445.000 | 2783.000 | - | 10.17% | - |
| 600.perlbench_s | 13.71% | 2298.000 | 2613.000 | - | 16.24% | - |
| 625.x264_s | 11.87% | 2662.000 | 2978.000 | - | 11.20% | - |
| 526.blender_r | 10.43% | 8579.000 | 9474.000 | - | 6.13% | - |
| 641.leela_s | 8.92% | 3990.000 | 4346.000 | - | 6.05% | - |
| 631.deepsjeng_s | 5.70% | 3596.000 | 3801.000 | - | 10.56% | - |
| 644.nab_s | 5.15% | 11109.000 | 11681.000 | - | 4.67% | - |
| Performance Improvements - Code Size | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 631.deepsjeng_s | -5.23% | 60687.000 | 57511.000 | - | 0.00% | - |
| 619.lbm_s | -3.10% | 13938.000 | 13506.000 | - | 0.00% | - |
| 605.mcf_s | -2.43% | 15336.000 | 14964.000 | - | 0.00% | - |
| 638.imagick_s | -1.21% | 1169552.000 | 1155352.000 | - | 0.00% | - |
| Performance Improvements - Execution | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 511.povray_r | -5.31% | 452.000 | 428.000 | - | 3.13% | - |
| Performance Improvements - Score | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| nb_compile_successful | 162.50% | 16.000 | 42.000 | - | 0.00% | - |
| nb_execution_successful | 150.00% | 16.000 | 40.000 | - | 0.00% | - |
| nb_total_tests | 108.33% | 24.000 | 50.000 | - | 0.00% | - |
| Added Tests - Code Size |
|---|
| 603.bwaves_s |
| 628.pop2_s |
| 648.exchange2_s |
| 649.fotonik3d_s |
| 654.roms_s |
| Added Tests - Execution |
|---|
| 603.bwaves_s |
| 627.cam4_s |
| 628.pop2_s |
| 648.exchange2_s |
| 649.fotonik3d_s |
| 654.roms_s |
| Added Tests - sample variability |
|---|
| 508.namd_r |
| 508.namd_r (avg) |
| 508.namd_r (avg) (percentage) |
| 508.namd_r (max) |
| 508.namd_r (max) (percentage) |
| 510.parest_r |
| 510.parest_r (avg) |
| 510.parest_r (avg) (percentage) |
| 510.parest_r (max) |
| 510.parest_r (max) (percentage) |
| 511.povray_r |
| 511.povray_r (avg) |
| 511.povray_r (avg) (percentage) |
| 511.povray_r (max) |
| 511.povray_r (max) (percentage) |
| 526.blender_r |
| 526.blender_r (avg) |
| 526.blender_r (avg) (percentage) |
| 526.blender_r (max) |
| 526.blender_r (max) (percentage) |
| 600.perlbench_s |
| 600.perlbench_s (avg) |
| 600.perlbench_s (avg) (percentage) |
| 600.perlbench_s (max) |
| 600.perlbench_s (max) (percentage) |
| 603.bwaves_s |
| 603.bwaves_s (avg) |
| 603.bwaves_s (avg) (percentage) |
| 603.bwaves_s (max) |
| 603.bwaves_s (max) (percentage) |
| 605.mcf_s |
| 605.mcf_s (avg) |
| 605.mcf_s (avg) (percentage) |
| 605.mcf_s (max) |
| 605.mcf_s (max) (percentage) |
| 619.lbm_s |
| 619.lbm_s (avg) |
| 619.lbm_s (avg) (percentage) |
| 619.lbm_s (max) |
| 619.lbm_s (max) (percentage) |
| 620.omnetpp_s |
| 620.omnetpp_s (avg) |
| 620.omnetpp_s (avg) (percentage) |
| 620.omnetpp_s (max) |
| 620.omnetpp_s (max) (percentage) |
| 623.xalancbmk_s (avg) (percentage) |
| 623.xalancbmk_s (max) (percentage) |
| 625.x264_s |
| 625.x264_s (avg) |
| 625.x264_s (avg) (percentage) |
| 625.x264_s (max) |
| 625.x264_s (max) (percentage) |
| 631.deepsjeng_s |
| 631.deepsjeng_s (avg) |
| 631.deepsjeng_s (avg) (percentage) |
| 631.deepsjeng_s (max) |
| 631.deepsjeng_s (max) (percentage) |
| 638.imagick_s |
| 638.imagick_s (avg) |
| 638.imagick_s (avg) (percentage) |
| 638.imagick_s (max) |
| 638.imagick_s (max) (percentage) |
| 641.leela_s |
| 641.leela_s (avg) |
| 641.leela_s (avg) (percentage) |
| 641.leela_s (max) |
| 641.leela_s (max) (percentage) |
| 644.nab_s |
| 644.nab_s (avg) |
| 644.nab_s (avg) (percentage) |
| 644.nab_s (max) |
| 644.nab_s (max) (percentage) |
| 648.exchange2_s |
| 648.exchange2_s (avg) |
| 648.exchange2_s (avg) (percentage) |
| 648.exchange2_s (max) |
| 648.exchange2_s (max) (percentage) |
| 648.exchange2_s (unexplained diff vs previous) |
| 648.exchange2_s (unexplained diff vs previous) (percentage) |
| 649.fotonik3d_s |
| 649.fotonik3d_s (avg) |
| 649.fotonik3d_s (avg) (percentage) |
| 649.fotonik3d_s (max) |
| 649.fotonik3d_s (max) (percentage) |
| 649.fotonik3d_s (unexplained diff vs previous) |
| 649.fotonik3d_s (unexplained diff vs previous) (percentage) |
| 654.roms_s |
| 654.roms_s (avg) |
| 654.roms_s (avg) (percentage) |
| 654.roms_s (max) |
| 654.roms_s (max) (percentage) |
| 657.xz_s |
| 657.xz_s (avg) |
| 657.xz_s (avg) (percentage) |
| 657.xz_s (max) |
| 657.xz_s (max) (percentage) |
Report Time: 0.33s