Fields
| hardware | None |
| os | None |
Parameters
Fields
| Name | Value |
|---|
Parameters
| Name | Value |
|---|---|
| git_binutils | https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=4635b42ac78b532dfdc5f6725e8267ee928cc5f0 (+ 29 commits) |
| git_gcc | https://github.com/gcc-mirror/gcc/commit/c0ded050cd29cc73f78cb4ab23674c7bc024969e (+ 201 commits) |
| git_glibc | https://sourceware.org/git/?p=glibc.git;a=commit;h=46b5e98ef6f1b9f4b53851f152ecb8209064b26c (+ 4 commits) |
| git_linux | https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=b84a9523bab4a2483d7b7566b81a7859c2fd9a78 (+ 16139 commits) |
| test_url | https://ci.linaro.org/job/tcwg_bmk-fujitsu_speed-cpu2017speed--gnu-aarch64-master-O3-build/328/ |
Filter
gnu-aarch64-master-O3 test results
| Run | Order | Start Time | Duration |
|---|---|---|---|
| Current | 0328 (4-changed-components) | 2024-05-28T16:33:15 | 0:00:00 |
| Previous | 0326 (3-changed-components) | 2024-05-25T05:21:29 | 0:00:00 |
| Baseline | 0002 (4-changed-components) | 2023-02-28T02:02:59 | 0:00:00 |
Tests Summary
| Status Group | # | # (B) |
|---|---|---|
| Performance Regressions | 6 | 14 |
| Performance Improvements | 63 | 19 |
| Added Tests | 6 | 98 |
| Unchanged Tests | 771 | 715 |
| Total Tests | 846 |
| Performance Regressions - Code Size | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 607.cactuBSSN_s | 1.15% | 4909153.000 | 4965365.000 | - | 17.83% | - |
| Performance Regressions - sample variability | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 620.omnetpp_s (unexplained diff vs previous) (percentage) | 5661.90% | 0.210 | 12.100 | 0.000 | 0.00% | 0.000 |
| 620.omnetpp_s (unexplained diff vs previous) | 5113.51% | 37.000 | 1929.000 | 0.000 | 0.00% | 0.000 |
| 620.omnetpp_s (avg) (percentage) | 12.95% | 1.930 | 2.180 | - | 0.00% | - |
| 620.omnetpp_s (max) (percentage) | 7.79% | 10.010 | 10.790 | - | 0.00% | - |
| Performance Regressions - Score | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| nb_total_tests | -4.55% | 44.000 | 42.000 | - | 110.00% | - |
| Performance Improvements - Execution | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 657.xz_s | -19.77% | 153184.000 | 122907.000 | - | 0.04% | - |
| 620.omnetpp_s | -10.79% | 17872.000 | 15943.000 | - | -3.93% | - |
| 605.mcf_s | -10.72% | 34104.000 | 30449.000 | - | 6.36% | - |
| 602.gcc_s | -7.89% | 22710.000 | 20918.000 | - | -2.16% | - |
| 631.deepsjeng_s | -3.19% | 12721.000 | 12315.000 | - | -3.52% | - |
| 623.xalancbmk_s | -2.72% | 19770.000 | 19233.000 | - | 5.91% | - |
| 625.x264_s | -1.56% | 8480.000 | 8348.000 | - | -2.68% | - |
| Performance Improvements - sample variability | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 619.lbm_s (unexplained diff vs previous) | -96.97% | 33.000 | 1.000 | 0.000 | 0.00% | 0.000 |
| 648.exchange2_s (unexplained diff vs previous) | -47.06% | 51.000 | 27.000 | 0.000 | 0.00% | 0.000 |
| 648.exchange2_s (unexplained diff vs previous) (percentage) | -46.27% | 0.670 | 0.360 | 0.000 | 0.00% | 0.000 |
| 648.exchange2_s (max) | -27.45% | 51.000 | 37.000 | - | 0.00% | - |
| 648.exchange2_s (max) (percentage) | -25.37% | 0.670 | 0.500 | - | 0.00% | - |
| 657.xz_s (max) | -23.93% | 34512.000 | 26252.000 | - | 0.00% | - |
| 657.xz_s | -19.76% | 5866.000 | 4707.000 | - | 0.00% | - |
| 657.xz_s (avg) | -19.76% | 5866.000 | 4707.000 | - | 0.00% | - |
| 605.mcf_s (max) | -18.40% | 2772.000 | 2262.000 | - | 0.00% | - |
| 641.leela_s (max) | -14.29% | 21.000 | 18.000 | - | 0.00% | - |
| 649.fotonik3d_s (max) | -12.84% | 444.000 | 387.000 | - | 0.00% | - |
| 649.fotonik3d_s (max) (percentage) | -12.68% | 0.710 | 0.620 | - | 0.00% | - |
| 623.xalancbmk_s (max) | -12.45% | 498.000 | 436.000 | - | 0.00% | - |
| 641.leela_s (max) (percentage) | -11.76% | 0.170 | 0.150 | - | 0.00% | - |
| 602.gcc_s (max) | -11.45% | 1214.000 | 1075.000 | - | 0.00% | - |
| 631.deepsjeng_s (max) | -11.24% | 169.000 | 150.000 | - | 0.00% | - |
| 605.mcf_s | -10.81% | 518.000 | 462.000 | - | 0.00% | - |
| 605.mcf_s (avg) | -10.81% | 518.000 | 462.000 | - | 0.00% | - |
| 619.lbm_s (max) | -10.26% | 39.000 | 35.000 | - | 0.00% | - |
| 600.perlbench_s (max) | -10.08% | 397.000 | 357.000 | - | 0.00% | - |
| 619.lbm_s (max) (percentage) | -10.00% | 0.100 | 0.090 | - | 0.00% | - |
| 600.perlbench_s (max) (percentage) | -9.95% | 2.210 | 1.990 | - | 0.00% | - |
| 623.xalancbmk_s (max) (percentage) | -9.92% | 2.520 | 2.270 | - | 0.00% | - |
| 654.roms_s (max) | -9.09% | 176.000 | 160.000 | - | 0.00% | - |
| 654.roms_s (max) (percentage) | -9.09% | 0.220 | 0.200 | - | 0.00% | - |
| 605.mcf_s (max) (percentage) | -8.61% | 8.130 | 7.430 | - | 0.00% | - |
| 631.deepsjeng_s (max) (percentage) | -8.27% | 1.330 | 1.220 | - | 0.00% | - |
| 602.gcc_s | -7.75% | 258.000 | 238.000 | - | 0.00% | - |
| 602.gcc_s (avg) | -7.75% | 258.000 | 238.000 | - | 0.00% | - |
| 638.imagick_s (max) | -7.19% | 292.000 | 271.000 | - | 0.00% | - |
| 638.imagick_s (max) (percentage) | -7.14% | 0.140 | 0.130 | - | 0.00% | - |
| 625.x264_s (max) | -7.14% | 56.000 | 52.000 | - | 0.00% | - |
| 625.x264_s (max) (percentage) | -5.97% | 0.670 | 0.630 | - | 0.00% | - |
| 603.bwaves_s (max) | -5.54% | 1427.000 | 1348.000 | - | 0.00% | - |
| 657.xz_s (max) (percentage) | -5.19% | 22.530 | 21.360 | - | 0.00% | - |
| 603.bwaves_s (max) (percentage) | -5.08% | 0.590 | 0.560 | - | 0.00% | - |
| 644.nab_s (max) (percentage) | -4.55% | 0.220 | 0.210 | - | 0.00% | - |
| 644.nab_s (max) | -4.53% | 309.000 | 295.000 | - | 0.00% | - |
| 641.leela_s | -4.17% | 24.000 | 23.000 | - | 0.00% | - |
| 641.leela_s (avg) | -4.17% | 24.000 | 23.000 | - | 0.00% | - |
| 628.pop2_s (max) | -4.02% | 224.000 | 215.000 | - | 0.00% | - |
| 602.gcc_s (max) (percentage) | -3.93% | 5.350 | 5.140 | - | 0.00% | - |
| 607.cactuBSSN_s (max) (percentage) | -3.85% | 1.040 | 1.000 | - | 0.00% | - |
| 620.omnetpp_s (max) | -3.80% | 1788.000 | 1720.000 | - | 0.00% | - |
| 607.cactuBSSN_s (max) | -3.75% | 1066.000 | 1026.000 | - | 0.00% | - |
| 631.deepsjeng_s | -3.37% | 89.000 | 86.000 | - | 0.00% | - |
| 631.deepsjeng_s (avg) | -3.37% | 89.000 | 86.000 | - | 0.00% | - |
| 625.x264_s | -3.23% | 31.000 | 30.000 | - | 0.00% | - |
| 625.x264_s (avg) | -3.23% | 31.000 | 30.000 | - | 0.00% | - |
| 623.xalancbmk_s | -2.71% | 442.000 | 430.000 | - | 0.00% | - |
| 623.xalancbmk_s (avg) | -2.71% | 442.000 | 430.000 | - | 0.00% | - |
| 619.lbm_s | -2.04% | 196.000 | 192.000 | - | 0.00% | - |
| 619.lbm_s (avg) | -2.04% | 196.000 | 192.000 | - | 0.00% | - |
| 619.lbm_s (avg) (percentage) | -2.00% | 0.500 | 0.490 | - | 0.00% | - |
| Performance Improvements - Score | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| nb_compile_successful | 5.56% | 36.000 | 38.000 | - | 90.00% | - |
| nb_execution_successful | 5.56% | 36.000 | 38.000 | - | 90.00% | - |
| Added Tests - Code Size |
|---|
| 621.wrf_s |
| Added Tests - Execution |
|---|
| 621.wrf_s |
| Added Tests - sample variability |
|---|
| 619.lbm_s (unexplained diff vs previous) (percentage) |
| 621.wrf_s |
| 621.wrf_s (avg) |
| 621.wrf_s (max) |
| Performance Regressions - Code Size | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 607.cactuBSSN_s | 17.83% | 4214065.000 | 4965365.000 | - | 1.15% | - |
| 623.xalancbmk_s | 8.22% | 5497646.000 | 5949603.000 | - | 0.13% | - |
| 644.nab_s | 8.11% | 218975.000 | 236741.000 | - | 0.01% | - |
| 657.xz_s | 7.36% | 205531.000 | 220667.000 | - | 0.18% | - |
| 600.perlbench_s | 7.09% | 2404724.000 | 2575215.000 | - | -0.13% | - |
| 602.gcc_s | 6.36% | 10008387.000 | 10644443.000 | - | -0.14% | - |
| 631.deepsjeng_s | 5.88% | 95946.000 | 101586.000 | - | 0.00% | - |
| 620.omnetpp_s | 4.31% | 2247854.000 | 2344778.000 | - | -0.23% | - |
| 638.imagick_s | 4.29% | 2221370.000 | 2316662.000 | - | -0.01% | - |
| 641.leela_s | 3.97% | 202615.000 | 210655.000 | - | -0.02% | - |
| 649.fotonik3d_s | 2.19% | 353975.000 | 361719.000 | - | 0.23% | - |
| Performance Regressions - Execution | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 605.mcf_s | 6.36% | 28627.000 | 30449.000 | - | -10.72% | - |
| 623.xalancbmk_s | 5.91% | 18160.000 | 19233.000 | - | -2.72% | - |
| 638.imagick_s | 2.91% | 202929.000 | 208826.000 | - | -0.01% | - |
| Performance Improvements - Code Size | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 619.lbm_s | -16.96% | 21250.000 | 17646.000 | - | 0.00% | - |
| 654.roms_s | -10.42% | 1075717.000 | 963649.000 | - | -0.74% | - |
| 648.exchange2_s | -7.81% | 177422.000 | 163566.000 | - | 0.25% | - |
| 605.mcf_s | -6.70% | 28789.000 | 26859.000 | - | 0.00% | - |
| 625.x264_s | -3.31% | 626778.000 | 606005.000 | - | -0.61% | - |
| 621.wrf_s | -1.31% | 20302811.000 | 20035841.000 | - | 0.00% | - |
| Performance Improvements - Execution | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 654.roms_s | -62.64% | 214456.000 | 80129.000 | - | 0.14% | - |
| 621.wrf_s | -37.90% | 112446.000 | 69833.000 | - | 0.00% | - |
| 628.pop2_s | -23.66% | 100834.000 | 76977.000 | - | -0.37% | - |
| 644.nab_s | -12.52% | 160803.000 | 140674.000 | - | 0.01% | - |
| 641.leela_s | -8.18% | 13731.000 | 12608.000 | - | -0.64% | - |
| 620.omnetpp_s | -3.93% | 16595.000 | 15943.000 | - | -10.79% | - |
| 607.cactuBSSN_s | -3.89% | 106786.000 | 102628.000 | - | 0.12% | - |
| 631.deepsjeng_s | -3.52% | 12764.000 | 12315.000 | - | -3.19% | - |
| 625.x264_s | -2.68% | 8578.000 | 8348.000 | - | -1.56% | - |
| 602.gcc_s | -2.16% | 21380.000 | 20918.000 | - | -7.89% | - |
| Performance Improvements - Score | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| nb_total_tests | 110.00% | 20.000 | 42.000 | - | -4.55% | - |
| nb_compile_successful | 90.00% | 20.000 | 38.000 | - | 5.56% | - |
| nb_execution_successful | 90.00% | 20.000 | 38.000 | - | 5.56% | - |
| Added Tests - sample variability |
|---|
| 600.perlbench_s |
| 600.perlbench_s (avg) |
| 600.perlbench_s (avg) (percentage) |
| 600.perlbench_s (max) |
| 600.perlbench_s (max) (percentage) |
| 602.gcc_s |
| 602.gcc_s (avg) |
| 602.gcc_s (avg) (percentage) |
| 602.gcc_s (max) |
| 602.gcc_s (max) (percentage) |
| 603.bwaves_s |
| 603.bwaves_s (avg) |
| 603.bwaves_s (avg) (percentage) |
| 603.bwaves_s (max) |
| 603.bwaves_s (max) (percentage) |
| 605.mcf_s |
| 605.mcf_s (avg) |
| 605.mcf_s (avg) (percentage) |
| 605.mcf_s (max) |
| 605.mcf_s (max) (percentage) |
| 607.cactuBSSN_s |
| 607.cactuBSSN_s (avg) |
| 607.cactuBSSN_s (avg) (percentage) |
| 607.cactuBSSN_s (max) |
| 607.cactuBSSN_s (max) (percentage) |
| 619.lbm_s |
| 619.lbm_s (avg) |
| 619.lbm_s (avg) (percentage) |
| 619.lbm_s (max) |
| 619.lbm_s (max) (percentage) |
| 619.lbm_s (unexplained diff vs previous) (percentage) |
| 620.omnetpp_s |
| 620.omnetpp_s (avg) |
| 620.omnetpp_s (avg) (percentage) |
| 620.omnetpp_s (max) |
| 620.omnetpp_s (max) (percentage) |
| 621.wrf_s |
| 621.wrf_s (avg) |
| 621.wrf_s (avg) (percentage) |
| 621.wrf_s (max) |
| 621.wrf_s (max) (percentage) |
| 623.xalancbmk_s |
| 623.xalancbmk_s (avg) |
| 623.xalancbmk_s (avg) (percentage) |
| 623.xalancbmk_s (max) |
| 623.xalancbmk_s (max) (percentage) |
| 625.x264_s |
| 625.x264_s (avg) |
| 625.x264_s (avg) (percentage) |
| 625.x264_s (max) |
| 625.x264_s (max) (percentage) |
| 627.cam4_s (avg) (percentage) |
| 627.cam4_s (max) (percentage) |
| 628.pop2_s |
| 628.pop2_s (avg) |
| 628.pop2_s (avg) (percentage) |
| 628.pop2_s (max) |
| 628.pop2_s (max) (percentage) |
| 631.deepsjeng_s |
| 631.deepsjeng_s (avg) |
| 631.deepsjeng_s (avg) (percentage) |
| 631.deepsjeng_s (max) |
| 631.deepsjeng_s (max) (percentage) |
| 638.imagick_s |
| 638.imagick_s (avg) |
| 638.imagick_s (avg) (percentage) |
| 638.imagick_s (max) |
| 638.imagick_s (max) (percentage) |
| 641.leela_s |
| 641.leela_s (avg) |
| 641.leela_s (avg) (percentage) |
| 641.leela_s (max) |
| 641.leela_s (max) (percentage) |
| 644.nab_s |
| 644.nab_s (avg) |
| 644.nab_s (avg) (percentage) |
| 644.nab_s (max) |
| 644.nab_s (max) (percentage) |
| 648.exchange2_s |
| 648.exchange2_s (avg) |
| 648.exchange2_s (avg) (percentage) |
| 648.exchange2_s (max) |
| 648.exchange2_s (max) (percentage) |
| 649.fotonik3d_s |
| 649.fotonik3d_s (avg) |
| 649.fotonik3d_s (avg) (percentage) |
| 649.fotonik3d_s (max) |
| 649.fotonik3d_s (max) (percentage) |
| 654.roms_s |
| 654.roms_s (avg) |
| 654.roms_s (avg) (percentage) |
| 654.roms_s (max) |
| 654.roms_s (max) (percentage) |
| 657.xz_s |
| 657.xz_s (avg) |
| 657.xz_s (avg) (percentage) |
| 657.xz_s (max) |
| 657.xz_s (max) (percentage) |
Report Time: 0.32s