Fields
| hardware | None |
| os | None |
Parameters
Fields
| Name | Value |
|---|
Parameters
| Name | Value |
|---|---|
| git_llvm | https://github.com/llvm/llvm-project/commit/c87b1ca4edefe3c267a20f28eaf79f6b83d36c66 (+ 425 commits) |
| test_url | https://ci.linaro.org/job/tcwg_bmk-code_size-cpu2017fast--llvm-aarch64-master-Os_LTO-build/147/ |
Filter
llvm-aarch64-master-Os_LTO test results
| Run | Order | Start Time | Duration |
|---|---|---|---|
| Current | 0147 (llvmorg-19-init-11442-gc87b1ca4edef) | 2024-04-30T18:53:23 | 0:00:00 |
| Previous | 0146 (no-change) | 2024-04-15T14:05:22 | 0:00:00 |
| Baseline | 0001 (llvmorg-17-init-03361-gd77f96a9e0c8) | 2023-02-27T23:41:40 | 0:00:00 |
Tests Summary
| Status Group | # | # (B) |
|---|---|---|
| Performance Regressions | 10 | 6 |
| Performance Improvements | 109 | 17 |
| Added Tests | 1 | 109 |
| Unchanged Tests | 714 | 702 |
| Total Tests | 834 |
| Performance Regressions - Execution | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 603.bwaves_s | 3.27% | 9473.000 | 9783.000 | - | 0.00% | - |
| 620.omnetpp_s | 2.99% | 3743.000 | 3855.000 | - | 2.88% | - |
| 628.pop2_s | 1.34% | 17630.000 | 17867.000 | - | 0.00% | - |
| Performance Regressions - sample variability | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 603.bwaves_s | 8.61% | 209.000 | 227.000 | - | 0.00% | - |
| 603.bwaves_s (avg) | 8.61% | 209.000 | 227.000 | - | 0.00% | - |
| 603.bwaves_s (avg) (percentage) | 5.43% | 2.210 | 2.330 | - | 0.00% | - |
| 620.omnetpp_s | 1.32% | 227.000 | 230.000 | - | 0.00% | - |
| 620.omnetpp_s (avg) | 1.32% | 227.000 | 230.000 | - | 0.00% | - |
| Performance Regressions - Score | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| nb_total_tests | -7.41% | 54.000 | 50.000 | - | 108.33% | - |
| nb_execution_successful | -4.76% | 42.000 | 40.000 | - | 150.00% | - |
| Performance Improvements - Execution | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 648.exchange2_s | -1.04% | 35407.000 | 35038.000 | - | 0.00% | - |
| 600.perlbench_s | -1.00% | 2289.000 | 2266.000 | - | -1.39% | - |
| Performance Improvements - sample variability | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 654.roms_s (unexplained diff vs previous) (percentage) | -99.31% | 14.550 | 0.100 | 0.000 | 0.00% | 0.000 |
| 654.roms_s (unexplained diff vs previous) | -99.28% | 4603.000 | 33.000 | 0.000 | 0.00% | 0.000 |
| 526.blender_r (unexplained diff vs previous) (percentage) | -98.69% | 1.530 | 0.020 | 0.000 | 0.00% | 0.000 |
| 526.blender_r (unexplained diff vs previous) | -98.53% | 136.000 | 2.000 | 0.000 | 0.00% | 0.000 |
| 619.lbm_s (unexplained diff vs previous) (percentage) | -95.32% | 16.880 | 0.790 | 0.000 | 0.00% | 0.000 |
| 619.lbm_s (unexplained diff vs previous) | -95.26% | 4810.000 | 228.000 | 0.000 | 0.00% | 0.000 |
| 631.deepsjeng_s (unexplained diff vs previous) | -93.88% | 49.000 | 3.000 | 0.000 | 0.00% | 0.000 |
| 631.deepsjeng_s (unexplained diff vs previous) (percentage) | -93.75% | 1.440 | 0.090 | 0.000 | 0.00% | 0.000 |
| 625.x264_s (unexplained diff vs previous) | -91.30% | 23.000 | 2.000 | 0.000 | 0.00% | 0.000 |
| 625.x264_s (unexplained diff vs previous) (percentage) | -90.70% | 0.860 | 0.080 | 0.000 | 0.00% | 0.000 |
| 510.parest_r (unexplained diff vs previous) (percentage) | -87.27% | 1.650 | 0.210 | 0.000 | 0.00% | 0.000 |
| 510.parest_r (unexplained diff vs previous) | -87.23% | 94.000 | 12.000 | 0.000 | 0.00% | 0.000 |
| 657.xz_s (unexplained diff vs previous) (percentage) | -83.30% | 5.270 | 0.880 | 0.000 | 0.00% | 0.000 |
| 657.xz_s (unexplained diff vs previous) | -83.19% | 113.000 | 19.000 | 0.000 | 0.00% | 0.000 |
| 600.perlbench_s (max) | -81.25% | 240.000 | 45.000 | - | 0.00% | - |
| 600.perlbench_s (max) (percentage) | -81.07% | 10.510 | 1.990 | - | 0.00% | - |
| 649.fotonik3d_s (unexplained diff vs previous) (percentage) | -78.79% | 4.290 | 0.910 | 0.000 | 0.00% | 0.000 |
| 511.povray_r (unexplained diff vs previous) (percentage) | -78.72% | 3.430 | 0.730 | 0.000 | 0.00% | 0.000 |
| 649.fotonik3d_s (unexplained diff vs previous) | -78.58% | 537.000 | 115.000 | 0.000 | 0.00% | 0.000 |
| 511.povray_r (unexplained diff vs previous) | -78.57% | 14.000 | 3.000 | 0.000 | 0.00% | 0.000 |
| 644.nab_s (unexplained diff vs previous) (percentage) | -77.99% | 1.590 | 0.350 | 0.000 | 0.00% | 0.000 |
| 644.nab_s (unexplained diff vs previous) | -77.97% | 177.000 | 39.000 | 0.000 | 0.00% | 0.000 |
| 605.mcf_s (unexplained diff vs previous) (percentage) | -63.13% | 1.790 | 0.660 | 0.000 | 0.00% | 0.000 |
| 605.mcf_s (unexplained diff vs previous) | -62.61% | 115.000 | 43.000 | 0.000 | 0.00% | 0.000 |
| 526.blender_r (max) (percentage) | -60.38% | 3.710 | 1.470 | - | 0.00% | - |
| 526.blender_r (max) | -60.30% | 330.000 | 131.000 | - | 0.00% | - |
| 600.perlbench_s (unexplained diff vs previous) | -52.08% | 48.000 | 23.000 | 0.000 | 0.00% | 0.000 |
| 600.perlbench_s (unexplained diff vs previous) (percentage) | -51.43% | 2.100 | 1.020 | 0.000 | 0.00% | 0.000 |
| 508.namd_r (unexplained diff vs previous) (percentage) | -47.92% | 1.440 | 0.750 | 0.000 | 0.00% | 0.000 |
| 508.namd_r (unexplained diff vs previous) | -47.22% | 36.000 | 19.000 | 0.000 | 0.00% | 0.000 |
| 641.leela_s (unexplained diff vs previous) (percentage) | -37.59% | 1.330 | 0.830 | 0.000 | 0.00% | 0.000 |
| 641.leela_s (unexplained diff vs previous) | -37.04% | 54.000 | 34.000 | 0.000 | 0.00% | 0.000 |
| 603.bwaves_s (unexplained diff vs previous) (percentage) | -35.44% | 4.910 | 3.170 | 0.000 | 0.00% | 0.000 |
| 620.omnetpp_s (unexplained diff vs previous) (percentage) | -34.75% | 4.460 | 2.910 | 0.000 | 0.00% | 0.000 |
| 654.roms_s (avg) (percentage) | -34.43% | 7.000 | 4.590 | - | 0.00% | - |
| 654.roms_s | -34.37% | 2214.000 | 1453.000 | - | 0.00% | - |
| 654.roms_s (avg) | -34.37% | 2214.000 | 1453.000 | - | 0.00% | - |
| 603.bwaves_s (unexplained diff vs previous) | -33.33% | 465.000 | 310.000 | 0.000 | 0.00% | 0.000 |
| 620.omnetpp_s (unexplained diff vs previous) | -32.93% | 167.000 | 112.000 | 0.000 | 0.00% | 0.000 |
| 644.nab_s (max) | -29.79% | 235.000 | 165.000 | - | 0.00% | - |
| 644.nab_s (max) (percentage) | -29.38% | 2.110 | 1.490 | - | 0.00% | - |
| 526.blender_r | -17.78% | 135.000 | 111.000 | - | 0.00% | - |
| 526.blender_r (avg) | -17.78% | 135.000 | 111.000 | - | 0.00% | - |
| 526.blender_r (avg) (percentage) | -17.76% | 1.520 | 1.250 | - | 0.00% | - |
| 625.x264_s (max) (percentage) | -16.28% | 0.860 | 0.720 | - | 0.00% | - |
| 625.x264_s (max) | -13.64% | 22.000 | 19.000 | - | 0.00% | - |
| 649.fotonik3d_s (avg) (percentage) | -12.50% | 1.760 | 1.540 | - | 0.00% | - |
| 649.fotonik3d_s | -11.82% | 220.000 | 194.000 | - | 0.00% | - |
| 649.fotonik3d_s (avg) | -11.82% | 220.000 | 194.000 | - | 0.00% | - |
| 600.perlbench_s | -10.23% | 88.000 | 79.000 | - | 0.00% | - |
| 600.perlbench_s (avg) | -10.23% | 88.000 | 79.000 | - | 0.00% | - |
| 619.lbm_s (max) (percentage) | -10.03% | 14.450 | 13.000 | - | 0.00% | - |
| 657.xz_s (max) (percentage) | -9.98% | 5.010 | 4.510 | - | 0.00% | - |
| 641.leela_s (max) (percentage) | -9.92% | 1.310 | 1.180 | - | 0.00% | - |
| 510.parest_r (max) (percentage) | -9.88% | 1.620 | 1.460 | - | 0.00% | - |
| 508.namd_r (max) (percentage) | -9.86% | 1.420 | 1.280 | - | 0.00% | - |
| 510.parest_r (max) | -9.78% | 92.000 | 83.000 | - | 0.00% | - |
| 641.leela_s (max) | -9.43% | 53.000 | 48.000 | - | 0.00% | - |
| 657.xz_s (max) | -9.35% | 107.000 | 97.000 | - | 0.00% | - |
| 619.lbm_s (max) | -9.31% | 4116.000 | 3733.000 | - | 0.00% | - |
| 600.perlbench_s (avg) (percentage) | -9.04% | 3.870 | 3.520 | - | 0.00% | - |
| 508.namd_r (max) | -8.57% | 35.000 | 32.000 | - | 0.00% | - |
| 605.mcf_s (max) (percentage) | -8.52% | 1.760 | 1.610 | - | 0.00% | - |
| 631.deepsjeng_s (max) (percentage) | -8.45% | 1.420 | 1.300 | - | 0.00% | - |
| 511.povray_r (max) (percentage) | -8.43% | 3.320 | 3.040 | - | 0.00% | - |
| 631.deepsjeng_s (max) | -8.33% | 48.000 | 44.000 | - | 0.00% | - |
| 603.bwaves_s (max) (percentage) | -8.33% | 4.680 | 4.290 | - | 0.00% | - |
| 510.parest_r (avg) (percentage) | -8.11% | 4.070 | 3.740 | - | 0.00% | - |
| 605.mcf_s (max) | -7.96% | 113.000 | 104.000 | - | 0.00% | - |
| 510.parest_r | -7.79% | 231.000 | 213.000 | - | 0.00% | - |
| 510.parest_r (avg) | -7.79% | 231.000 | 213.000 | - | 0.00% | - |
| 511.povray_r (max) | -7.69% | 13.000 | 12.000 | - | 0.00% | - |
| 620.omnetpp_s (max) (percentage) | -7.03% | 4.270 | 3.970 | - | 0.00% | - |
| 631.deepsjeng_s (avg) (percentage) | -6.19% | 3.390 | 3.180 | - | 0.00% | - |
| 631.deepsjeng_s | -6.09% | 115.000 | 108.000 | - | 0.00% | - |
| 631.deepsjeng_s (avg) | -6.09% | 115.000 | 108.000 | - | 0.00% | - |
| 657.xz_s (avg) (percentage) | -6.03% | 7.300 | 6.860 | - | 0.00% | - |
| 638.imagick_s (max) (percentage) | -5.57% | 8.790 | 8.300 | - | 0.00% | - |
| 603.bwaves_s (max) | -5.42% | 443.000 | 419.000 | - | 0.00% | - |
| 657.xz_s | -5.13% | 156.000 | 148.000 | - | 0.00% | - |
| 657.xz_s (avg) | -5.13% | 156.000 | 148.000 | - | 0.00% | - |
| 638.imagick_s (max) | -4.89% | 266.000 | 253.000 | - | 0.00% | - |
| 644.nab_s | -4.35% | 138.000 | 132.000 | - | 0.00% | - |
| 644.nab_s (avg) | -4.35% | 138.000 | 132.000 | - | 0.00% | - |
| 508.namd_r | -4.17% | 72.000 | 69.000 | - | 0.00% | - |
| 508.namd_r (avg) | -4.17% | 72.000 | 69.000 | - | 0.00% | - |
| 644.nab_s (avg) (percentage) | -4.03% | 1.240 | 1.190 | - | 0.00% | - |
| 508.namd_r (avg) (percentage) | -3.82% | 2.880 | 2.770 | - | 0.00% | - |
| 620.omnetpp_s (max) | -3.77% | 159.000 | 153.000 | - | 0.00% | - |
| 641.leela_s (avg) (percentage) | -3.57% | 1.960 | 1.890 | - | 0.00% | - |
| 619.lbm_s (avg) (percentage) | -3.56% | 17.420 | 16.800 | - | 0.00% | - |
| 605.mcf_s (avg) (percentage) | -3.52% | 3.690 | 3.560 | - | 0.00% | - |
| 511.povray_r (avg) (percentage) | -3.36% | 1.190 | 1.150 | - | 0.00% | - |
| 625.x264_s (avg) (percentage) | -3.33% | 3.600 | 3.480 | - | 0.00% | - |
| 625.x264_s | -3.16% | 95.000 | 92.000 | - | 0.00% | - |
| 625.x264_s (avg) | -3.16% | 95.000 | 92.000 | - | 0.00% | - |
| 605.mcf_s | -2.95% | 237.000 | 230.000 | - | 0.00% | - |
| 605.mcf_s (avg) | -2.95% | 237.000 | 230.000 | - | 0.00% | - |
| 619.lbm_s | -2.78% | 4962.000 | 4824.000 | - | 0.00% | - |
| 619.lbm_s (avg) | -2.78% | 4962.000 | 4824.000 | - | 0.00% | - |
| 641.leela_s | -2.53% | 79.000 | 77.000 | - | 0.00% | - |
| 641.leela_s (avg) | -2.53% | 79.000 | 77.000 | - | 0.00% | - |
| 648.exchange2_s (max) | -2.21% | 272.000 | 266.000 | - | 0.00% | - |
| 620.omnetpp_s (avg) (percentage) | -1.64% | 6.080 | 5.980 | - | 0.00% | - |
| 648.exchange2_s (max) (percentage) | -1.30% | 0.770 | 0.760 | - | 0.00% | - |
| 648.exchange2_s | -1.26% | 159.000 | 157.000 | - | 0.00% | - |
| 648.exchange2_s (avg) | -1.26% | 159.000 | 157.000 | - | 0.00% | - |
| Added Tests - Execution |
|---|
| 627.cam4_s |
| Performance Regressions - Execution | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 605.mcf_s | 4.37% | 6202.000 | 6473.000 | - | 0.67% | - |
| 526.blender_r | 3.95% | 8579.000 | 8918.000 | - | 0.02% | - |
| 508.namd_r | 3.15% | 2445.000 | 2522.000 | - | 0.76% | - |
| 620.omnetpp_s | 2.88% | 3747.000 | 3855.000 | - | 2.99% | - |
| 641.leela_s | 2.83% | 3990.000 | 4103.000 | - | 0.84% | - |
| 510.parest_r | 2.17% | 5587.000 | 5708.000 | - | 0.21% | - |
| Performance Improvements - Code Size | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 631.deepsjeng_s | -5.17% | 60687.000 | 57547.000 | - | 0.00% | - |
| 619.lbm_s | -2.98% | 13938.000 | 13522.000 | - | 0.00% | - |
| 605.mcf_s | -2.53% | 15336.000 | 14948.000 | - | 0.00% | - |
| 644.nab_s | -1.50% | 84129.000 | 82869.000 | - | 0.00% | - |
| 641.leela_s | -1.21% | 71474.000 | 70610.000 | - | 0.00% | - |
| 510.parest_r | -1.07% | 1480641.000 | 1464854.000 | - | 0.00% | - |
| 638.imagick_s | -1.05% | 1169552.000 | 1157328.000 | - | -0.01% | - |
| Performance Improvements - Execution | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 511.povray_r | -9.07% | 452.000 | 411.000 | - | 0.74% | - |
| 619.lbm_s | -7.55% | 31060.000 | 28716.000 | - | 0.80% | - |
| 638.imagick_s | -6.26% | 3258.000 | 3054.000 | - | 0.83% | - |
| 657.xz_s | -5.42% | 2287.000 | 2163.000 | - | 0.89% | - |
| 631.deepsjeng_s | -5.26% | 3596.000 | 3407.000 | - | -0.09% | - |
| 602.gcc_s | -1.90% | 4203.000 | 4123.000 | - | 0.39% | - |
| 600.perlbench_s | -1.39% | 2298.000 | 2266.000 | - | -1.00% | - |
| Performance Improvements - Score | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| nb_compile_successful | 162.50% | 16.000 | 42.000 | - | 0.00% | - |
| nb_execution_successful | 150.00% | 16.000 | 40.000 | - | -4.76% | - |
| nb_total_tests | 108.33% | 24.000 | 50.000 | - | -7.41% | - |
| Added Tests - Code Size |
|---|
| 603.bwaves_s |
| 628.pop2_s |
| 648.exchange2_s |
| 649.fotonik3d_s |
| 654.roms_s |
| Added Tests - Execution |
|---|
| 603.bwaves_s |
| 627.cam4_s |
| 628.pop2_s |
| 648.exchange2_s |
| 649.fotonik3d_s |
| 654.roms_s |
| Added Tests - sample variability |
|---|
| 508.namd_r |
| 508.namd_r (avg) |
| 508.namd_r (avg) (percentage) |
| 508.namd_r (max) |
| 508.namd_r (max) (percentage) |
| 510.parest_r |
| 510.parest_r (avg) |
| 510.parest_r (avg) (percentage) |
| 510.parest_r (max) |
| 510.parest_r (max) (percentage) |
| 511.povray_r |
| 511.povray_r (avg) |
| 511.povray_r (avg) (percentage) |
| 511.povray_r (max) |
| 511.povray_r (max) (percentage) |
| 526.blender_r |
| 526.blender_r (avg) |
| 526.blender_r (avg) (percentage) |
| 526.blender_r (max) |
| 526.blender_r (max) (percentage) |
| 600.perlbench_s |
| 600.perlbench_s (avg) |
| 600.perlbench_s (avg) (percentage) |
| 600.perlbench_s (max) |
| 600.perlbench_s (max) (percentage) |
| 603.bwaves_s |
| 603.bwaves_s (avg) |
| 603.bwaves_s (avg) (percentage) |
| 603.bwaves_s (max) |
| 603.bwaves_s (max) (percentage) |
| 603.bwaves_s (unexplained diff vs previous) |
| 603.bwaves_s (unexplained diff vs previous) (percentage) |
| 605.mcf_s |
| 605.mcf_s (avg) |
| 605.mcf_s (avg) (percentage) |
| 605.mcf_s (max) |
| 605.mcf_s (max) (percentage) |
| 619.lbm_s |
| 619.lbm_s (avg) |
| 619.lbm_s (avg) (percentage) |
| 619.lbm_s (max) |
| 619.lbm_s (max) (percentage) |
| 620.omnetpp_s |
| 620.omnetpp_s (avg) |
| 620.omnetpp_s (avg) (percentage) |
| 620.omnetpp_s (max) |
| 620.omnetpp_s (max) (percentage) |
| 623.xalancbmk_s (avg) (percentage) |
| 623.xalancbmk_s (max) (percentage) |
| 625.x264_s |
| 625.x264_s (avg) |
| 625.x264_s (avg) (percentage) |
| 625.x264_s (max) |
| 625.x264_s (max) (percentage) |
| 631.deepsjeng_s |
| 631.deepsjeng_s (avg) |
| 631.deepsjeng_s (avg) (percentage) |
| 631.deepsjeng_s (max) |
| 631.deepsjeng_s (max) (percentage) |
| 638.imagick_s |
| 638.imagick_s (avg) |
| 638.imagick_s (avg) (percentage) |
| 638.imagick_s (max) |
| 638.imagick_s (max) (percentage) |
| 641.leela_s |
| 641.leela_s (avg) |
| 641.leela_s (avg) (percentage) |
| 641.leela_s (max) |
| 641.leela_s (max) (percentage) |
| 644.nab_s |
| 644.nab_s (avg) |
| 644.nab_s (avg) (percentage) |
| 644.nab_s (max) |
| 644.nab_s (max) (percentage) |
| 648.exchange2_s |
| 648.exchange2_s (avg) |
| 648.exchange2_s (avg) (percentage) |
| 648.exchange2_s (max) |
| 648.exchange2_s (max) (percentage) |
| 649.fotonik3d_s |
| 649.fotonik3d_s (avg) |
| 649.fotonik3d_s (avg) (percentage) |
| 649.fotonik3d_s (max) |
| 649.fotonik3d_s (max) (percentage) |
| 649.fotonik3d_s (unexplained diff vs previous) |
| 649.fotonik3d_s (unexplained diff vs previous) (percentage) |
| 654.roms_s |
| 654.roms_s (avg) |
| 654.roms_s (avg) (percentage) |
| 654.roms_s (max) |
| 654.roms_s (max) (percentage) |
| 654.roms_s (unexplained diff vs previous) |
| 654.roms_s (unexplained diff vs previous) (percentage) |
| 657.xz_s |
| 657.xz_s (avg) |
| 657.xz_s (avg) (percentage) |
| 657.xz_s (max) |
| 657.xz_s (max) (percentage) |
Report Time: 0.36s