Fields
| hardware | None |
| os | None |
Parameters
Fields
| Name | Value |
|---|
Parameters
| Name | Value |
|---|---|
| git_binutils | https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=ac3885707473777fed6d7344a548e580186fa100 (unchanged) |
| git_gcc | https://github.com/gcc-mirror/gcc/commit/6a0a46c57999d1f805f6c604a8868ae588a104f2 (+ 125 commits) |
| git_glibc | https://sourceware.org/git/?p=glibc.git;a=commit;h=8d7b6b4cb27d4dec1dd5f7960298c1699275f962 (unchanged) |
| git_linux | https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=30e92e8838a078df359a97e36d048f06bbd5bec1 (unchanged) |
| test_url | https://ci.linaro.org/job/tcwg_bmk-code_size-cpu2017fast--gnu-aarch64-master-Os_LTO-build/186/ |
Filter
gnu-aarch64-master-Os_LTO test results
| Run | Order | Start Time | Duration |
|---|---|---|---|
| Current | 0186 (basepoints/gcc-15-00625-g6a0a46c5799) | 2024-05-17T01:09:12 | 0:00:00 |
| Previous | 0184 (3-changed-components) | 2024-05-15T09:18:15 | 0:00:00 |
| Baseline | 0105 (4-changed-components) | 2023-10-18T06:40:59 | 0:00:00 |
Tests Summary
| Status Group | # | # (B) |
|---|---|---|
| Performance Regressions | 7 | 6 |
| Performance Improvements | 68 | 13 |
| Added Tests | 0 | 105 |
| Unchanged Tests | 843 | 794 |
| Total Tests | 918 |
| Performance Regressions - Code Size | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 621.wrf_s | 7.99% | 9340988.000 | 10087572.000 | - | 7.16% | - |
| Performance Regressions - Execution | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 649.fotonik3d_s | 11.49% | 10645.000 | 11868.000 | - | 15.91% | - |
| Performance Regressions - sample variability | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 619.lbm_s (unexplained diff vs previous) (percentage) | 787.13% | 1.010 | 8.960 | 0.000 | 0.00% | 0.000 |
| 619.lbm_s (unexplained diff vs previous) | 712.08% | 331.000 | 2688.000 | 0.000 | 0.00% | 0.000 |
| 649.fotonik3d_s | 11.51% | 730.000 | 814.000 | - | 0.00% | - |
| 649.fotonik3d_s (avg) | 11.51% | 730.000 | 814.000 | - | 0.00% | - |
| 649.fotonik3d_s (max) | 4.51% | 4394.000 | 4592.000 | - | 0.00% | - |
| Performance Improvements - Code Size | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 649.fotonik3d_s | -1.63% | 244703.000 | 240707.000 | - | -3.09% | - |
| Performance Improvements - Execution | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 619.lbm_s | -8.22% | 32690.000 | 30002.000 | - | -1.48% | - |
| 654.roms_s | -4.32% | 34788.000 | 33284.000 | - | -1.80% | - |
| 607.cactuBSSN_s | -2.53% | 5177.000 | 5046.000 | - | -0.63% | - |
| 603.bwaves_s | -2.17% | 9497.000 | 9291.000 | - | -10.97% | - |
| 511.povray_r | -2.07% | 531.000 | 520.000 | - | -1.33% | - |
| 600.perlbench_s | -1.46% | 2261.000 | 2228.000 | - | -0.09% | - |
| 508.namd_r | -1.04% | 3452.000 | 3416.000 | - | -1.01% | - |
| Performance Improvements - sample variability | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 619.lbm_s (max) | -13.96% | 32958.000 | 28357.000 | - | 0.00% | - |
| 619.lbm_s | -10.86% | 5459.000 | 4866.000 | - | 0.00% | - |
| 619.lbm_s (avg) | -10.86% | 5459.000 | 4866.000 | - | 0.00% | - |
| 654.roms_s (max) | -10.32% | 12165.000 | 10910.000 | - | 0.00% | - |
| 638.imagick_s (max) | -9.24% | 790.000 | 717.000 | - | 0.00% | - |
| 638.imagick_s (max) (percentage) | -8.57% | 13.190 | 12.060 | - | 0.00% | - |
| 603.bwaves_s (max) | -8.32% | 2680.000 | 2457.000 | - | 0.00% | - |
| 628.pop2_s (max) | -8.04% | 2438.000 | 2242.000 | - | 0.00% | - |
| 625.x264_s (max) | -7.99% | 438.000 | 403.000 | - | 0.00% | - |
| 657.xz_s (max) | -7.89% | 646.000 | 595.000 | - | 0.00% | - |
| 641.leela_s (max) | -7.78% | 347.000 | 320.000 | - | 0.00% | - |
| 511.povray_r (max) | -7.69% | 26.000 | 24.000 | - | 0.00% | - |
| 607.cactuBSSN_s (max) | -7.56% | 1442.000 | 1333.000 | - | 0.00% | - |
| 620.omnetpp_s (max) | -7.55% | 1126.000 | 1041.000 | - | 0.00% | - |
| 623.xalancbmk_s (max) (percentage) | -7.50% | 7.870 | 7.280 | - | 0.00% | - |
| 628.pop2_s (max) (percentage) | -7.41% | 17.280 | 16.000 | - | 0.00% | - |
| 511.povray_r (max) (percentage) | -7.40% | 5.000 | 4.630 | - | 0.00% | - |
| 657.xz_s (max) (percentage) | -7.38% | 25.600 | 23.710 | - | 0.00% | - |
| 641.leela_s (max) (percentage) | -7.37% | 7.730 | 7.160 | - | 0.00% | - |
| 625.x264_s (max) (percentage) | -7.28% | 11.120 | 10.310 | - | 0.00% | - |
| 508.namd_r (max) | -7.17% | 307.000 | 285.000 | - | 0.00% | - |
| 605.mcf_s (max) | -7.04% | 1236.000 | 1149.000 | - | 0.00% | - |
| 510.parest_r (max) | -6.93% | 1212.000 | 1128.000 | - | 0.00% | - |
| 600.perlbench_s (max) | -6.81% | 279.000 | 260.000 | - | 0.00% | - |
| 623.xalancbmk_s (max) | -6.76% | 370.000 | 345.000 | - | 0.00% | - |
| 644.nab_s (max) (percentage) | -6.68% | 4.790 | 4.470 | - | 0.00% | - |
| 620.omnetpp_s (max) (percentage) | -6.68% | 25.460 | 23.760 | - | 0.00% | - |
| 526.blender_r (max) (percentage) | -6.54% | 5.960 | 5.570 | - | 0.00% | - |
| 526.blender_r (max) | -6.44% | 761.000 | 712.000 | - | 0.00% | - |
| 644.nab_s (max) | -6.40% | 609.000 | 570.000 | - | 0.00% | - |
| 631.deepsjeng_s (max) (percentage) | -6.29% | 12.720 | 11.920 | - | 0.00% | - |
| 508.namd_r (max) (percentage) | -6.28% | 8.920 | 8.360 | - | 0.00% | - |
| 603.bwaves_s (max) (percentage) | -6.27% | 28.220 | 26.450 | - | 0.00% | - |
| 654.roms_s (max) (percentage) | -6.26% | 34.970 | 32.780 | - | 0.00% | - |
| 510.parest_r (max) (percentage) | -6.25% | 18.070 | 16.940 | - | 0.00% | - |
| 631.deepsjeng_s (max) | -6.25% | 544.000 | 510.000 | - | 0.00% | - |
| 649.fotonik3d_s (max) (percentage) | -6.25% | 41.280 | 38.700 | - | 0.00% | - |
| 619.lbm_s (max) (percentage) | -6.25% | 100.820 | 94.520 | - | 0.00% | - |
| 605.mcf_s (max) (percentage) | -6.24% | 16.990 | 15.930 | - | 0.00% | - |
| 600.perlbench_s (max) (percentage) | -5.19% | 12.340 | 11.700 | - | 0.00% | - |
| 607.cactuBSSN_s (max) (percentage) | -5.17% | 27.870 | 26.430 | - | 0.00% | - |
| 654.roms_s | -4.32% | 2198.000 | 2103.000 | - | 0.00% | - |
| 654.roms_s (avg) | -4.32% | 2198.000 | 2103.000 | - | 0.00% | - |
| 648.exchange2_s (max) | -3.70% | 27.000 | 26.000 | - | 0.00% | - |
| 619.lbm_s (avg) (percentage) | -2.87% | 16.700 | 16.220 | - | 0.00% | - |
| 648.exchange2_s (max) (percentage) | -2.47% | 0.810 | 0.790 | - | 0.00% | - |
| 607.cactuBSSN_s | -2.35% | 213.000 | 208.000 | - | 0.00% | - |
| 607.cactuBSSN_s (avg) | -2.35% | 213.000 | 208.000 | - | 0.00% | - |
| 603.bwaves_s | -2.16% | 464.000 | 454.000 | - | 0.00% | - |
| 603.bwaves_s (avg) | -2.16% | 464.000 | 454.000 | - | 0.00% | - |
| 600.perlbench_s | -2.04% | 49.000 | 48.000 | - | 0.00% | - |
| 600.perlbench_s (avg) | -2.04% | 49.000 | 48.000 | - | 0.00% | - |
| 508.namd_r | -1.82% | 55.000 | 54.000 | - | 0.00% | - |
| 508.namd_r (avg) | -1.82% | 55.000 | 54.000 | - | 0.00% | - |
| 625.x264_s | -1.27% | 79.000 | 78.000 | - | 0.00% | - |
| 625.x264_s (avg) | -1.27% | 79.000 | 78.000 | - | 0.00% | - |
| 620.omnetpp_s | -1.07% | 187.000 | 185.000 | - | 0.00% | - |
| 620.omnetpp_s (avg) | -1.07% | 187.000 | 185.000 | - | 0.00% | - |
| 638.imagick_s | -1.01% | 99.000 | 98.000 | - | 0.00% | - |
| 638.imagick_s (avg) | -1.01% | 99.000 | 98.000 | - | 0.00% | - |
| Performance Regressions - Code Size | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 621.wrf_s | 7.16% | 9413720.000 | 10087572.000 | - | 7.99% | - |
| 644.nab_s | 4.88% | 76740.000 | 80484.000 | - | -0.24% | - |
| Performance Regressions - Execution | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 649.fotonik3d_s | 15.91% | 10239.000 | 11868.000 | - | 11.49% | - |
| 657.xz_s | 1.70% | 2470.000 | 2512.000 | - | -0.59% | - |
| 631.deepsjeng_s | 1.64% | 4214.000 | 4283.000 | - | 0.02% | - |
| 644.nab_s | 1.47% | 12577.000 | 12762.000 | - | 0.35% | - |
| Performance Improvements - Code Size | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 508.namd_r | -3.59% | 435429.000 | 419813.000 | - | -0.97% | - |
| 649.fotonik3d_s | -3.09% | 248379.000 | 240707.000 | - | -1.63% | - |
| 603.bwaves_s | -2.07% | 44462.000 | 43542.000 | - | -0.18% | - |
| Performance Improvements - Execution | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 603.bwaves_s | -10.97% | 10436.000 | 9291.000 | - | -2.17% | - |
| 621.wrf_s | -2.36% | 12528.000 | 12232.000 | - | -0.42% | - |
| 654.roms_s | -1.80% | 33893.000 | 33284.000 | - | -4.32% | - |
| 526.blender_r | -1.52% | 12996.000 | 12798.000 | - | 0.11% | - |
| 619.lbm_s | -1.48% | 30454.000 | 30002.000 | - | -8.22% | - |
| 511.povray_r | -1.33% | 527.000 | 520.000 | - | -2.07% | - |
| 508.namd_r | -1.01% | 3451.000 | 3416.000 | - | -1.04% | - |
| Performance Improvements - Score | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| nb_total_tests | 108.33% | 24.000 | 50.000 | - | 0.00% | - |
| nb_execution_successful | 100.00% | 23.000 | 46.000 | - | 0.00% | - |
| nb_compile_successful | 91.67% | 24.000 | 46.000 | - | 0.00% | - |
| Added Tests - sample variability |
|---|
| 508.namd_r |
| 508.namd_r (avg) |
| 508.namd_r (avg) (percentage) |
| 508.namd_r (max) |
| 508.namd_r (max) (percentage) |
| 510.parest_r |
| 510.parest_r (avg) |
| 510.parest_r (avg) (percentage) |
| 510.parest_r (max) |
| 510.parest_r (max) (percentage) |
| 511.povray_r |
| 511.povray_r (avg) |
| 511.povray_r (avg) (percentage) |
| 511.povray_r (max) |
| 511.povray_r (max) (percentage) |
| 526.blender_r |
| 526.blender_r (avg) |
| 526.blender_r (avg) (percentage) |
| 526.blender_r (max) |
| 526.blender_r (max) (percentage) |
| 600.perlbench_s |
| 600.perlbench_s (avg) |
| 600.perlbench_s (avg) (percentage) |
| 600.perlbench_s (max) |
| 600.perlbench_s (max) (percentage) |
| 603.bwaves_s |
| 603.bwaves_s (avg) |
| 603.bwaves_s (avg) (percentage) |
| 603.bwaves_s (max) |
| 603.bwaves_s (max) (percentage) |
| 605.mcf_s |
| 605.mcf_s (avg) |
| 605.mcf_s (avg) (percentage) |
| 605.mcf_s (max) |
| 605.mcf_s (max) (percentage) |
| 607.cactuBSSN_s |
| 607.cactuBSSN_s (avg) |
| 607.cactuBSSN_s (avg) (percentage) |
| 607.cactuBSSN_s (max) |
| 607.cactuBSSN_s (max) (percentage) |
| 619.lbm_s |
| 619.lbm_s (avg) |
| 619.lbm_s (avg) (percentage) |
| 619.lbm_s (max) |
| 619.lbm_s (max) (percentage) |
| 620.omnetpp_s |
| 620.omnetpp_s (avg) |
| 620.omnetpp_s (avg) (percentage) |
| 620.omnetpp_s (max) |
| 620.omnetpp_s (max) (percentage) |
| 623.xalancbmk_s |
| 623.xalancbmk_s (avg) |
| 623.xalancbmk_s (avg) (percentage) |
| 623.xalancbmk_s (max) |
| 623.xalancbmk_s (max) (percentage) |
| 625.x264_s |
| 625.x264_s (avg) |
| 625.x264_s (avg) (percentage) |
| 625.x264_s (max) |
| 625.x264_s (max) (percentage) |
| 628.pop2_s |
| 628.pop2_s (avg) |
| 628.pop2_s (avg) (percentage) |
| 628.pop2_s (max) |
| 628.pop2_s (max) (percentage) |
| 631.deepsjeng_s |
| 631.deepsjeng_s (avg) |
| 631.deepsjeng_s (avg) (percentage) |
| 631.deepsjeng_s (max) |
| 631.deepsjeng_s (max) (percentage) |
| 638.imagick_s |
| 638.imagick_s (avg) |
| 638.imagick_s (avg) (percentage) |
| 638.imagick_s (max) |
| 638.imagick_s (max) (percentage) |
| 641.leela_s |
| 641.leela_s (avg) |
| 641.leela_s (avg) (percentage) |
| 641.leela_s (max) |
| 641.leela_s (max) (percentage) |
| 644.nab_s |
| 644.nab_s (avg) |
| 644.nab_s (avg) (percentage) |
| 644.nab_s (max) |
| 644.nab_s (max) (percentage) |
| 648.exchange2_s |
| 648.exchange2_s (avg) |
| 648.exchange2_s (avg) (percentage) |
| 648.exchange2_s (max) |
| 648.exchange2_s (max) (percentage) |
| 649.fotonik3d_s |
| 649.fotonik3d_s (avg) |
| 649.fotonik3d_s (avg) (percentage) |
| 649.fotonik3d_s (max) |
| 649.fotonik3d_s (max) (percentage) |
| 654.roms_s |
| 654.roms_s (avg) |
| 654.roms_s (avg) (percentage) |
| 654.roms_s (max) |
| 654.roms_s (max) (percentage) |
| 657.xz_s |
| 657.xz_s (avg) |
| 657.xz_s (avg) (percentage) |
| 657.xz_s (max) |
| 657.xz_s (max) (percentage) |
Report Time: 0.35s