Fields
| hardware | None |
| os | None |
Parameters
Fields
| Name | Value |
|---|
Parameters
| Name | Value |
|---|---|
| git_binutils | https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=8c3273ee07fae4badfd6f25f67162e5f6ec7f03e (+ 17 commits) |
| git_gcc | https://github.com/gcc-mirror/gcc/commit/0f40e59f193f96f1bb0fa3e1c2d160567ed29b32 (unchanged) |
| git_glibc | https://sourceware.org/git/?p=glibc.git;a=commit;h=bf033c0072554366fe9617c283c982594059ad9d (+ 9 commits) |
| git_linux | https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=288a2f83ed42ce91cf92c2b08dad298a3da0cd9a (unchanged) |
| test_url | https://ci.linaro.org/job/tcwg_bmk-fujitsu_speed-cpu2017speed--gnu-aarch64-master-O3-build/221/ |
Filter
gnu-aarch64-master-O3 test results
| Run | Order | Start Time | Duration |
|---|---|---|---|
| Current | 0221 (2-changed-components) | 2023-10-30T09:41:02 | 0:00:00 |
| Previous | 0218 (3-changed-components) | 2023-10-22T02:23:06 | 0:00:00 |
| Baseline | 0002 (4-changed-components) | 2023-02-28T02:02:59 | 0:00:00 |
Tests Summary
| Status Group | # | # (B) |
|---|---|---|
| Performance Regressions | 84 | 13 |
| Performance Improvements | 43 | 18 |
| Added Tests | 0 | 100 |
| Unchanged Tests | 731 | 727 |
| Total Tests | 858 |
| Performance Regressions - Execution | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 623.xalancbmk_s | 4.69% | 18173.000 | 19026.000 | - | 4.77% | - |
| 620.omnetpp_s | 2.38% | 15149.000 | 15509.000 | - | -6.54% | - |
| 605.mcf_s | 2.19% | 28885.000 | 29519.000 | - | 3.12% | - |
| 602.gcc_s | 1.06% | 20600.000 | 20818.000 | - | -2.63% | - |
| Performance Regressions - sample variability | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 623.xalancbmk_s (unexplained diff vs previous) (percentage) | 14833.33% | 0.030 | 4.480 | - | 0.00% | - |
| 623.xalancbmk_s (unexplained diff vs previous) | 14116.67% | 6.000 | 853.000 | - | 0.00% | - |
| 631.deepsjeng_s (unexplained diff vs previous) (percentage) | 3375.00% | 0.040 | 1.390 | - | 0.00% | - |
| 631.deepsjeng_s (unexplained diff vs previous) | 3300.00% | 5.000 | 170.000 | - | 0.00% | - |
| 657.xz_s (unexplained diff vs previous) (percentage) | 1775.00% | 0.160 | 3.000 | - | 0.00% | - |
| 605.mcf_s (unexplained diff vs previous) | 1764.71% | 34.000 | 634.000 | - | 0.00% | - |
| 657.xz_s (unexplained diff vs previous) | 1709.46% | 222.000 | 4017.000 | - | 0.00% | - |
| 605.mcf_s (unexplained diff vs previous) (percentage) | 1691.67% | 0.120 | 2.150 | - | 0.00% | - |
| 649.fotonik3d_s (unexplained diff vs previous) | 1511.70% | 94.000 | 1515.000 | - | 0.00% | - |
| 649.fotonik3d_s (unexplained diff vs previous) (percentage) | 1506.67% | 0.150 | 2.410 | - | 0.00% | - |
| 620.omnetpp_s (unexplained diff vs previous) | 1340.00% | 25.000 | 360.000 | - | 0.00% | - |
| 620.omnetpp_s (unexplained diff vs previous) (percentage) | 1264.71% | 0.170 | 2.320 | - | 0.00% | - |
| 625.x264_s (unexplained diff vs previous) | 957.14% | 7.000 | 74.000 | - | 0.00% | - |
| 625.x264_s (unexplained diff vs previous) (percentage) | 888.89% | 0.090 | 0.890 | - | 0.00% | - |
| 654.roms_s (unexplained diff vs previous) (percentage) | 808.33% | 0.240 | 2.180 | - | 0.00% | - |
| 654.roms_s (unexplained diff vs previous) | 775.63% | 279.000 | 2443.000 | - | 0.00% | - |
| 607.cactuBSSN_s (unexplained diff vs previous) | 673.87% | 111.000 | 859.000 | - | 0.00% | - |
| 607.cactuBSSN_s (unexplained diff vs previous) (percentage) | 645.45% | 0.110 | 0.820 | - | 0.00% | - |
| 602.gcc_s (unexplained diff vs previous) | 289.29% | 56.000 | 218.000 | - | 0.00% | - |
| 602.gcc_s (unexplained diff vs previous) (percentage) | 288.89% | 0.270 | 1.050 | - | 0.00% | - |
| 603.bwaves_s (unexplained diff vs previous) (percentage) | 188.89% | 0.090 | 0.260 | - | 0.00% | - |
| 603.bwaves_s (unexplained diff vs previous) | 179.91% | 219.000 | 613.000 | - | 0.00% | - |
| 641.leela_s (unexplained diff vs previous) (percentage) | 125.00% | 0.080 | 0.180 | - | 0.00% | - |
| 641.leela_s (unexplained diff vs previous) | 118.18% | 11.000 | 24.000 | - | 0.00% | - |
| 623.xalancbmk_s (max) | 69.90% | 525.000 | 892.000 | - | 0.00% | - |
| 625.x264_s (max) | 68.18% | 44.000 | 74.000 | - | 0.00% | - |
| 625.x264_s (max) (percentage) | 66.67% | 0.540 | 0.900 | - | 0.00% | - |
| 638.imagick_s (unexplained diff vs previous) (percentage) | 62.50% | 0.080 | 0.130 | - | 0.00% | - |
| 638.imagick_s (unexplained diff vs previous) | 62.42% | 157.000 | 255.000 | - | 0.00% | - |
| 623.xalancbmk_s (max) (percentage) | 62.28% | 2.890 | 4.690 | - | 0.00% | - |
| 654.roms_s (max) (percentage) | 48.95% | 1.430 | 2.130 | - | 0.00% | - |
| 654.roms_s (max) | 45.79% | 1640.000 | 2391.000 | - | 0.00% | - |
| 605.mcf_s (max) | 45.50% | 444.000 | 646.000 | - | 0.00% | - |
| 605.mcf_s (max) (percentage) | 42.21% | 1.540 | 2.190 | - | 0.00% | - |
| 623.xalancbmk_s | 32.37% | 241.000 | 319.000 | - | 0.00% | - |
| 623.xalancbmk_s (avg) | 32.37% | 241.000 | 319.000 | - | 0.00% | - |
| 620.omnetpp_s (max) | 29.93% | 284.000 | 369.000 | - | 0.00% | - |
| 620.omnetpp_s (max) (percentage) | 26.60% | 1.880 | 2.380 | - | 0.00% | - |
| 623.xalancbmk_s (avg) (percentage) | 26.32% | 1.330 | 1.680 | - | 0.00% | - |
| 607.cactuBSSN_s (max) (percentage) | 24.62% | 0.650 | 0.810 | - | 0.00% | - |
| 607.cactuBSSN_s (max) | 23.50% | 685.000 | 846.000 | - | 0.00% | - |
| 657.xz_s (max) (percentage) | 19.75% | 2.430 | 2.910 | - | 0.00% | - |
| 657.xz_s (max) | 16.26% | 3351.000 | 3896.000 | - | 0.00% | - |
| 600.perlbench_s (unexplained diff vs previous) | 15.49% | 71.000 | 82.000 | - | 0.00% | - |
| 600.perlbench_s (max) (percentage) | 15.00% | 0.400 | 0.460 | - | 0.00% | - |
| 600.perlbench_s (unexplained diff vs previous) (percentage) | 15.00% | 0.400 | 0.460 | - | 0.00% | - |
| 600.perlbench_s (max) | 14.08% | 71.000 | 81.000 | - | 0.00% | - |
| 619.lbm_s (unexplained diff vs previous) | 13.33% | 30.000 | 34.000 | - | 0.00% | - |
| 625.x264_s | 12.90% | 31.000 | 35.000 | - | 0.00% | - |
| 625.x264_s (avg) | 12.90% | 31.000 | 35.000 | - | 0.00% | - |
| 621.wrf_s (unexplained diff vs previous) | 11.96% | 92.000 | 103.000 | - | 0.00% | - |
| 649.fotonik3d_s (max) (percentage) | 11.85% | 2.110 | 2.360 | - | 0.00% | - |
| 644.nab_s (avg) (percentage) | 11.11% | 0.090 | 0.100 | - | 0.00% | - |
| 644.nab_s | 10.94% | 128.000 | 142.000 | - | 0.00% | - |
| 644.nab_s (avg) | 10.94% | 128.000 | 142.000 | - | 0.00% | - |
| 631.deepsjeng_s (avg) (percentage) | 10.94% | 0.640 | 0.710 | - | 0.00% | - |
| 625.x264_s (avg) (percentage) | 10.26% | 0.390 | 0.430 | - | 0.00% | - |
| 644.nab_s (unexplained diff vs previous) | 10.13% | 158.000 | 174.000 | - | 0.00% | - |
| 649.fotonik3d_s (max) | 9.22% | 1356.000 | 1481.000 | - | 0.00% | - |
| 644.nab_s (max) | 8.92% | 157.000 | 171.000 | - | 0.00% | - |
| 631.deepsjeng_s | 8.86% | 79.000 | 86.000 | - | 0.00% | - |
| 631.deepsjeng_s (avg) | 8.86% | 79.000 | 86.000 | - | 0.00% | - |
| 605.mcf_s | 8.59% | 361.000 | 392.000 | - | 0.00% | - |
| 605.mcf_s (avg) | 8.59% | 361.000 | 392.000 | - | 0.00% | - |
| 654.roms_s (avg) (percentage) | 7.87% | 1.270 | 1.370 | - | 0.00% | - |
| 600.perlbench_s (avg) (percentage) | 7.41% | 0.270 | 0.290 | - | 0.00% | - |
| 605.mcf_s (avg) (percentage) | 6.40% | 1.250 | 1.330 | - | 0.00% | - |
| 600.perlbench_s | 6.25% | 48.000 | 51.000 | - | 0.00% | - |
| 600.perlbench_s (avg) | 6.25% | 48.000 | 51.000 | - | 0.00% | - |
| 607.cactuBSSN_s (avg) (percentage) | 5.66% | 0.530 | 0.560 | - | 0.00% | - |
| 654.roms_s | 5.56% | 1457.000 | 1538.000 | - | 0.00% | - |
| 654.roms_s (avg) | 5.56% | 1457.000 | 1538.000 | - | 0.00% | - |
| 602.gcc_s | 4.88% | 164.000 | 172.000 | - | 0.00% | - |
| 602.gcc_s (avg) | 4.88% | 164.000 | 172.000 | - | 0.00% | - |
| 607.cactuBSSN_s | 4.84% | 558.000 | 585.000 | - | 0.00% | - |
| 607.cactuBSSN_s (avg) | 4.84% | 558.000 | 585.000 | - | 0.00% | - |
| 602.gcc_s (avg) (percentage) | 3.75% | 0.800 | 0.830 | - | 0.00% | - |
| 620.omnetpp_s | 2.65% | 339.000 | 348.000 | - | 0.00% | - |
| 620.omnetpp_s (avg) | 2.65% | 339.000 | 348.000 | - | 0.00% | - |
| 649.fotonik3d_s (avg) (percentage) | 2.06% | 1.940 | 1.980 | - | 0.00% | - |
| Performance Improvements - Execution | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 657.xz_s | -2.91% | 137922.000 | 133905.000 | - | 8.99% | - |
| 649.fotonik3d_s | -2.36% | 64310.000 | 62795.000 | - | 1.25% | - |
| 654.roms_s | -2.13% | 114742.000 | 112299.000 | - | -47.64% | - |
| 631.deepsjeng_s | -1.37% | 12364.000 | 12194.000 | - | -4.47% | - |
| Performance Improvements - sample variability | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 628.pop2_s (unexplained diff vs previous) (percentage) | -90.91% | 0.110 | 0.010 | - | 0.00% | - |
| 628.pop2_s (unexplained diff vs previous) | -86.67% | 105.000 | 14.000 | - | 0.00% | - |
| 648.exchange2_s (unexplained diff vs previous) | -31.82% | 22.000 | 15.000 | - | 0.00% | - |
| 648.exchange2_s (unexplained diff vs previous) (percentage) | -31.03% | 0.290 | 0.200 | - | 0.00% | - |
| 648.exchange2_s (max) (percentage) | -24.14% | 0.290 | 0.220 | - | 0.00% | - |
| 648.exchange2_s (max) | -23.81% | 21.000 | 16.000 | - | 0.00% | - |
| 627.cam4_s (unexplained diff vs previous) (percentage) | -15.38% | 0.130 | 0.110 | - | 0.00% | - |
| 627.cam4_s (unexplained diff vs previous) | -15.32% | 124.000 | 105.000 | - | 0.00% | - |
| 628.pop2_s | -12.90% | 155.000 | 135.000 | - | 0.00% | - |
| 628.pop2_s (avg) | -12.90% | 155.000 | 135.000 | - | 0.00% | - |
| 628.pop2_s (avg) (percentage) | -12.50% | 0.160 | 0.140 | - | 0.00% | - |
| 627.cam4_s (avg) (percentage) | -8.33% | 0.240 | 0.220 | - | 0.00% | - |
| 627.cam4_s | -8.15% | 233.000 | 214.000 | - | 0.00% | - |
| 627.cam4_s (avg) | -8.15% | 233.000 | 214.000 | - | 0.00% | - |
| 619.lbm_s (max) | -7.50% | 40.000 | 37.000 | - | 0.00% | - |
| 621.wrf_s (avg) (percentage) | -6.06% | 0.330 | 0.310 | - | 0.00% | - |
| 648.exchange2_s | -5.88% | 17.000 | 16.000 | - | 0.00% | - |
| 648.exchange2_s (avg) | -5.88% | 17.000 | 16.000 | - | 0.00% | - |
| 621.wrf_s | -5.80% | 276.000 | 260.000 | - | 0.00% | - |
| 621.wrf_s (avg) | -5.80% | 276.000 | 260.000 | - | 0.00% | - |
| 628.pop2_s (max) | -5.75% | 174.000 | 164.000 | - | 0.00% | - |
| 619.lbm_s (avg) (percentage) | -5.56% | 0.540 | 0.510 | - | 0.00% | - |
| 619.lbm_s | -5.50% | 200.000 | 189.000 | - | 0.00% | - |
| 619.lbm_s (avg) | -5.50% | 200.000 | 189.000 | - | 0.00% | - |
| 641.leela_s (max) | -5.06% | 79.000 | 75.000 | - | 0.00% | - |
| 631.deepsjeng_s (max) | -5.03% | 179.000 | 170.000 | - | 0.00% | - |
| 641.leela_s (max) (percentage) | -5.00% | 0.600 | 0.570 | - | 0.00% | - |
| 648.exchange2_s (avg) (percentage) | -4.35% | 0.230 | 0.220 | - | 0.00% | - |
| 603.bwaves_s (max) | -3.91% | 639.000 | 614.000 | - | 0.00% | - |
| 603.bwaves_s (max) (percentage) | -3.70% | 0.270 | 0.260 | - | 0.00% | - |
| 631.deepsjeng_s (max) (percentage) | -3.45% | 1.450 | 1.400 | - | 0.00% | - |
| 657.xz_s | -3.22% | 4220.000 | 4084.000 | - | 0.00% | - |
| 657.xz_s (avg) | -3.22% | 4220.000 | 4084.000 | - | 0.00% | - |
| 641.leela_s (avg) (percentage) | -3.03% | 0.330 | 0.320 | - | 0.00% | - |
| 602.gcc_s (max) (percentage) | -2.56% | 1.170 | 1.140 | - | 0.00% | - |
| 641.leela_s | -2.33% | 43.000 | 42.000 | - | 0.00% | - |
| 641.leela_s (avg) | -2.33% | 43.000 | 42.000 | - | 0.00% | - |
| 627.cam4_s (max) | -2.19% | 457.000 | 447.000 | - | 0.00% | - |
| 602.gcc_s (max) | -1.66% | 241.000 | 237.000 | - | 0.00% | - |
| Performance Regressions - Code Size | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 631.deepsjeng_s | 5.73% | 95946.000 | 101446.000 | - | 0.00% | - |
| 607.cactuBSSN_s | 2.49% | 4214065.000 | 4319003.000 | - | 0.00% | - |
| 648.exchange2_s | 2.27% | 177422.000 | 181442.000 | - | 0.00% | - |
| 657.xz_s | 1.91% | 205531.000 | 209463.000 | - | 0.00% | - |
| 654.roms_s | 1.56% | 1075717.000 | 1092504.000 | - | 0.00% | - |
| 603.bwaves_s | 1.43% | 53831.000 | 54603.000 | - | 0.00% | - |
| 602.gcc_s | 1.40% | 10008387.000 | 10148927.000 | - | 0.00% | - |
| 625.x264_s | 1.32% | 626778.000 | 635061.000 | - | 0.00% | - |
| 600.perlbench_s | 1.31% | 2404724.000 | 2436345.000 | - | 0.00% | - |
| Performance Regressions - Execution | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 657.xz_s | 8.99% | 122860.000 | 133905.000 | - | -2.91% | - |
| 623.xalancbmk_s | 4.77% | 18160.000 | 19026.000 | - | 4.69% | - |
| 605.mcf_s | 3.12% | 28627.000 | 29519.000 | - | 2.19% | - |
| 649.fotonik3d_s | 1.25% | 62018.000 | 62795.000 | - | -2.36% | - |
| Performance Improvements - Code Size | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 619.lbm_s | -19.65% | 21250.000 | 17074.000 | - | 0.00% | - |
| 620.omnetpp_s | -1.65% | 2247854.000 | 2210756.000 | - | 0.00% | - |
| 605.mcf_s | -1.38% | 28789.000 | 28393.000 | - | 0.00% | - |
| Performance Improvements - Execution | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 654.roms_s | -47.64% | 214456.000 | 112299.000 | - | -2.13% | - |
| 621.wrf_s | -25.30% | 112446.000 | 83993.000 | - | 0.12% | - |
| 644.nab_s | -11.14% | 160803.000 | 142896.000 | - | -0.12% | - |
| 620.omnetpp_s | -6.54% | 16595.000 | 15509.000 | - | 2.38% | - |
| 619.lbm_s | -5.30% | 39335.000 | 37250.000 | - | 0.09% | - |
| 631.deepsjeng_s | -4.47% | 12764.000 | 12194.000 | - | -1.37% | - |
| 628.pop2_s | -3.75% | 100834.000 | 97056.000 | - | 0.01% | - |
| 625.x264_s | -3.56% | 8578.000 | 8273.000 | - | 0.90% | - |
| 641.leela_s | -2.90% | 13731.000 | 13333.000 | - | 0.18% | - |
| 602.gcc_s | -2.63% | 21380.000 | 20818.000 | - | 1.06% | - |
| 600.perlbench_s | -2.17% | 18097.000 | 17705.000 | - | -0.46% | - |
| 607.cactuBSSN_s | -2.10% | 106786.000 | 104545.000 | - | -0.81% | - |
| 627.cam4_s | -1.86% | 99181.000 | 97339.000 | - | -0.11% | - |
| 648.exchange2_s | -1.52% | 7633.000 | 7517.000 | - | -0.20% | - |
| 603.bwaves_s | -1.22% | 239232.000 | 236303.000 | - | -0.26% | - |
| Added Tests - sample variability |
|---|
| 600.perlbench_s |
| 600.perlbench_s (avg) |
| 600.perlbench_s (avg) (percentage) |
| 600.perlbench_s (max) |
| 600.perlbench_s (max) (percentage) |
| 602.gcc_s |
| 602.gcc_s (avg) |
| 602.gcc_s (avg) (percentage) |
| 602.gcc_s (max) |
| 602.gcc_s (max) (percentage) |
| 603.bwaves_s |
| 603.bwaves_s (avg) |
| 603.bwaves_s (avg) (percentage) |
| 603.bwaves_s (max) |
| 603.bwaves_s (max) (percentage) |
| 605.mcf_s |
| 605.mcf_s (avg) |
| 605.mcf_s (avg) (percentage) |
| 605.mcf_s (max) |
| 605.mcf_s (max) (percentage) |
| 607.cactuBSSN_s |
| 607.cactuBSSN_s (avg) |
| 607.cactuBSSN_s (avg) (percentage) |
| 607.cactuBSSN_s (max) |
| 607.cactuBSSN_s (max) (percentage) |
| 619.lbm_s |
| 619.lbm_s (avg) |
| 619.lbm_s (avg) (percentage) |
| 619.lbm_s (max) |
| 619.lbm_s (max) (percentage) |
| 620.omnetpp_s |
| 620.omnetpp_s (avg) |
| 620.omnetpp_s (avg) (percentage) |
| 620.omnetpp_s (max) |
| 620.omnetpp_s (max) (percentage) |
| 621.wrf_s |
| 621.wrf_s (avg) |
| 621.wrf_s (avg) (percentage) |
| 621.wrf_s (max) |
| 621.wrf_s (max) (percentage) |
| 623.xalancbmk_s |
| 623.xalancbmk_s (avg) |
| 623.xalancbmk_s (avg) (percentage) |
| 623.xalancbmk_s (max) |
| 623.xalancbmk_s (max) (percentage) |
| 625.x264_s |
| 625.x264_s (avg) |
| 625.x264_s (avg) (percentage) |
| 625.x264_s (max) |
| 625.x264_s (max) (percentage) |
| 627.cam4_s |
| 627.cam4_s (avg) |
| 627.cam4_s (avg) (percentage) |
| 627.cam4_s (max) |
| 627.cam4_s (max) (percentage) |
| 628.pop2_s |
| 628.pop2_s (avg) |
| 628.pop2_s (avg) (percentage) |
| 628.pop2_s (max) |
| 628.pop2_s (max) (percentage) |
| 631.deepsjeng_s |
| 631.deepsjeng_s (avg) |
| 631.deepsjeng_s (avg) (percentage) |
| 631.deepsjeng_s (max) |
| 631.deepsjeng_s (max) (percentage) |
| 638.imagick_s |
| 638.imagick_s (avg) |
| 638.imagick_s (avg) (percentage) |
| 638.imagick_s (max) |
| 638.imagick_s (max) (percentage) |
| 641.leela_s |
| 641.leela_s (avg) |
| 641.leela_s (avg) (percentage) |
| 641.leela_s (max) |
| 641.leela_s (max) (percentage) |
| 644.nab_s |
| 644.nab_s (avg) |
| 644.nab_s (avg) (percentage) |
| 644.nab_s (max) |
| 644.nab_s (max) (percentage) |
| 648.exchange2_s |
| 648.exchange2_s (avg) |
| 648.exchange2_s (avg) (percentage) |
| 648.exchange2_s (max) |
| 648.exchange2_s (max) (percentage) |
| 649.fotonik3d_s |
| 649.fotonik3d_s (avg) |
| 649.fotonik3d_s (avg) (percentage) |
| 649.fotonik3d_s (max) |
| 649.fotonik3d_s (max) (percentage) |
| 654.roms_s |
| 654.roms_s (avg) |
| 654.roms_s (avg) (percentage) |
| 654.roms_s (max) |
| 654.roms_s (max) (percentage) |
| 657.xz_s |
| 657.xz_s (avg) |
| 657.xz_s (avg) (percentage) |
| 657.xz_s (max) |
| 657.xz_s (max) (percentage) |
Report Time: 0.36s