Fields
| hardware | None |
| os | None |
Parameters
Fields
| Name | Value |
|---|
Parameters
| Name | Value |
|---|---|
| git_binutils | https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=ecc3c386677c2c096b2d589588dd26d21a0fb476 (unchanged) |
| git_gcc | https://github.com/gcc-mirror/gcc/commit/7924e352523b37155ed9d76dc426701de9d11a22 (+ 58 commits) |
| git_glibc | https://sourceware.org/git/?p=glibc.git;a=commit;h=1f94147a79fcb7211f1421b87383cad93986797f (unchanged) |
| git_linux | https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=f13102b78850c48082dca7202b8402d9dd6745b5 (unchanged) |
| test_url | https://ci.linaro.org/job/tcwg_bmk-fujitsu_speed-cpu2017speed--gnu-aarch64-master-O2-build/238/ |
Filter
gnu-aarch64-master-O2 test results
| Run | Order | Start Time | Duration |
|---|---|---|---|
| Current | 0238 (basepoints/gcc-14-09884-g7924e352523) | 2024-04-06T01:31:36 | 0:00:00 |
| Previous | 0223 (3-changed-components) | 2024-04-02T00:23:19 | 0:00:00 |
| Baseline | 0193 (4-changed-components) | 2024-01-29T02:35:05 | 0:00:00 |
Tests Summary
| Status Group | # | # (B) |
|---|---|---|
| Performance Regressions | 58 | 29 |
| Performance Improvements | 23 | 8 |
| Added Tests | 0 | 95 |
| Unchanged Tests | 741 | 690 |
| Total Tests | 822 |
| Performance Regressions - Code Size | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 619.lbm_s | 26.67% | 16214.000 | 20538.000 | - | 26.67% | - |
| 607.cactuBSSN_s | 10.04% | 3213538.000 | 3536244.000 | - | 9.76% | - |
| 644.nab_s | 7.88% | 176747.000 | 190677.000 | - | 7.97% | - |
| 605.mcf_s | 7.17% | 21325.000 | 22855.000 | - | 7.62% | - |
| 600.perlbench_s | 6.67% | 2151807.000 | 2295271.000 | - | 7.50% | - |
| 623.xalancbmk_s | 6.26% | 4504075.000 | 4786219.000 | - | 6.19% | - |
| 641.leela_s | 6.21% | 151137.000 | 160516.000 | - | 6.93% | - |
| 648.exchange2_s | 6.20% | 61982.000 | 65822.000 | - | 6.33% | - |
| 602.gcc_s | 5.75% | 9128947.000 | 9653767.000 | - | 5.56% | - |
| 657.xz_s | 5.63% | 192091.000 | 202907.000 | - | 5.62% | - |
| 625.x264_s | 5.54% | 445902.000 | 470606.000 | - | 5.62% | - |
| 620.omnetpp_s | 5.18% | 2022980.000 | 2127673.000 | - | 5.44% | - |
| 638.imagick_s | 4.96% | 1872258.000 | 1965046.000 | - | 5.24% | - |
| 621.wrf_s | 3.90% | 17133201.000 | 17800953.000 | - | 3.46% | - |
| 649.fotonik3d_s | 3.44% | 317453.000 | 328385.000 | - | 2.41% | - |
| 631.deepsjeng_s | 3.13% | 85906.000 | 88594.000 | - | 8.22% | - |
| 654.roms_s | 2.74% | 683282.000 | 702002.000 | - | 3.79% | - |
| Performance Regressions - Execution | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 648.exchange2_s | 37.97% | 11436.000 | 15778.000 | - | 37.46% | - |
| 607.cactuBSSN_s | 10.21% | 101703.000 | 112087.000 | - | 10.39% | - |
| 631.deepsjeng_s | 6.56% | 12235.000 | 13038.000 | - | 7.49% | - |
| 620.omnetpp_s | 4.88% | 16714.000 | 17529.000 | - | 5.49% | - |
| 644.nab_s | 2.92% | 144297.000 | 148516.000 | - | 2.73% | - |
| 638.imagick_s | 2.73% | 208394.000 | 214088.000 | - | 2.77% | - |
| 641.leela_s | 2.12% | 14854.000 | 15169.000 | - | 2.67% | - |
| 600.perlbench_s | 2.10% | 18067.000 | 18447.000 | - | 2.99% | - |
| 603.bwaves_s | 1.46% | 237055.000 | 240512.000 | - | 2.37% | - |
| 602.gcc_s | 1.03% | 24283.000 | 24533.000 | - | 1.98% | - |
| Performance Regressions - sample variability | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 648.exchange2_s | 37.50% | 24.000 | 33.000 | - | 0.00% | - |
| 648.exchange2_s (avg) | 37.50% | 24.000 | 33.000 | - | 0.00% | - |
| 648.exchange2_s (max) | 36.36% | 33.000 | 45.000 | - | 0.00% | - |
| 607.cactuBSSN_s | 10.27% | 711.000 | 784.000 | - | 0.00% | - |
| 607.cactuBSSN_s (avg) | 10.27% | 711.000 | 784.000 | - | 0.00% | - |
| 607.cactuBSSN_s (max) | 10.16% | 915.000 | 1008.000 | - | 0.00% | - |
| 631.deepsjeng_s (max) | 6.62% | 151.000 | 161.000 | - | 0.00% | - |
| 631.deepsjeng_s | 6.32% | 95.000 | 101.000 | - | 0.00% | - |
| 631.deepsjeng_s (avg) | 6.32% | 95.000 | 101.000 | - | 0.00% | - |
| 620.omnetpp_s (max) | 4.95% | 404.000 | 424.000 | - | 0.00% | - |
| 620.omnetpp_s | 4.63% | 259.000 | 271.000 | - | 0.00% | - |
| 620.omnetpp_s (avg) | 4.63% | 259.000 | 271.000 | - | 0.00% | - |
| 641.leela_s (max) | 3.85% | 26.000 | 27.000 | - | 0.00% | - |
| 644.nab_s (max) | 3.21% | 187.000 | 193.000 | - | 0.00% | - |
| 638.imagick_s | 2.88% | 104.000 | 107.000 | - | 0.00% | - |
| 638.imagick_s (avg) | 2.88% | 104.000 | 107.000 | - | 0.00% | - |
| 638.imagick_s (max) | 2.88% | 104.000 | 107.000 | - | 0.00% | - |
| 644.nab_s | 2.78% | 144.000 | 148.000 | - | 0.00% | - |
| 644.nab_s (avg) | 2.78% | 144.000 | 148.000 | - | 0.00% | - |
| 600.perlbench_s (max) | 2.61% | 115.000 | 118.000 | - | 0.00% | - |
| 625.x264_s | 2.50% | 40.000 | 41.000 | - | 0.00% | - |
| 625.x264_s (avg) | 2.50% | 40.000 | 41.000 | - | 0.00% | - |
| 623.xalancbmk_s (max) | 2.38% | 42.000 | 43.000 | - | 0.00% | - |
| 603.bwaves_s | 1.47% | 1019.000 | 1034.000 | - | 0.00% | - |
| 603.bwaves_s (avg) | 1.47% | 1019.000 | 1034.000 | - | 0.00% | - |
| 603.bwaves_s (max) | 1.45% | 1446.000 | 1467.000 | - | 0.00% | - |
| 602.gcc_s | 1.29% | 155.000 | 157.000 | - | 0.00% | - |
| 602.gcc_s (avg) | 1.29% | 155.000 | 157.000 | - | 0.00% | - |
| 600.perlbench_s | 1.20% | 83.000 | 84.000 | - | 0.00% | - |
| 600.perlbench_s (avg) | 1.20% | 83.000 | 84.000 | - | 0.00% | - |
| 602.gcc_s (max) | 1.20% | 167.000 | 169.000 | - | 0.00% | - |
| Performance Improvements - Execution | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 621.wrf_s | -50.80% | 159217.000 | 78334.000 | - | -52.83% | - |
| 628.pop2_s | -29.12% | 110811.000 | 78542.000 | - | -29.19% | - |
| 654.roms_s | -22.39% | 152518.000 | 118371.000 | - | -22.16% | - |
| 619.lbm_s | -5.60% | 41625.000 | 39292.000 | - | -5.54% | - |
| 605.mcf_s | -2.71% | 30144.000 | 29327.000 | - | -1.13% | - |
| Performance Improvements - sample variability | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 621.wrf_s | -51.35% | 111.000 | 54.000 | - | 0.00% | - |
| 621.wrf_s (avg) | -51.35% | 111.000 | 54.000 | - | 0.00% | - |
| 621.wrf_s (max) | -51.05% | 143.000 | 70.000 | - | 0.00% | - |
| 628.pop2_s (max) | -29.68% | 155.000 | 109.000 | - | 0.00% | - |
| 628.pop2_s | -29.17% | 144.000 | 102.000 | - | 0.00% | - |
| 628.pop2_s (avg) | -29.17% | 144.000 | 102.000 | - | 0.00% | - |
| 654.roms_s (max) | -22.39% | 2135.000 | 1657.000 | - | 0.00% | - |
| 654.roms_s | -22.37% | 2409.000 | 1870.000 | - | 0.00% | - |
| 654.roms_s (avg) | -22.37% | 2409.000 | 1870.000 | - | 0.00% | - |
| 619.lbm_s (max) | -8.33% | 12.000 | 11.000 | - | 0.00% | - |
| 619.lbm_s | -6.25% | 16.000 | 15.000 | - | 0.00% | - |
| 619.lbm_s (avg) | -6.25% | 16.000 | 15.000 | - | 0.00% | - |
| 605.mcf_s (max) | -2.88% | 452.000 | 439.000 | - | 0.00% | - |
| 605.mcf_s | -2.67% | 262.000 | 255.000 | - | 0.00% | - |
| 605.mcf_s (avg) | -2.67% | 262.000 | 255.000 | - | 0.00% | - |
| Performance Improvements - Score | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| nb_compile_successful | 100.00% | 19.000 | 38.000 | - | 100.00% | - |
| nb_execution_successful | 100.00% | 19.000 | 38.000 | - | 100.00% | - |
| nb_total_tests | 100.00% | 21.000 | 42.000 | - | 100.00% | - |
| Performance Regressions - Code Size | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 619.lbm_s | 26.67% | 16214.000 | 20538.000 | - | 26.67% | - |
| 607.cactuBSSN_s | 9.76% | 3221738.000 | 3536244.000 | - | 10.04% | - |
| 631.deepsjeng_s | 8.22% | 81866.000 | 88594.000 | - | 3.13% | - |
| 644.nab_s | 7.97% | 176595.000 | 190677.000 | - | 7.88% | - |
| 605.mcf_s | 7.62% | 21237.000 | 22855.000 | - | 7.17% | - |
| 600.perlbench_s | 7.50% | 2135159.000 | 2295271.000 | - | 6.67% | - |
| 641.leela_s | 6.93% | 150120.000 | 160516.000 | - | 6.21% | - |
| 648.exchange2_s | 6.33% | 61906.000 | 65822.000 | - | 6.20% | - |
| 623.xalancbmk_s | 6.19% | 4507423.000 | 4786219.000 | - | 6.26% | - |
| 625.x264_s | 5.62% | 445582.000 | 470606.000 | - | 5.54% | - |
| 657.xz_s | 5.62% | 192119.000 | 202907.000 | - | 5.63% | - |
| 602.gcc_s | 5.56% | 9145395.000 | 9653767.000 | - | 5.75% | - |
| 620.omnetpp_s | 5.44% | 2017940.000 | 2127673.000 | - | 5.18% | - |
| 638.imagick_s | 5.24% | 1867246.000 | 1965046.000 | - | 4.96% | - |
| 654.roms_s | 3.79% | 676338.000 | 702002.000 | - | 2.74% | - |
| 621.wrf_s | 3.46% | 17204865.000 | 17800953.000 | - | 3.90% | - |
| 649.fotonik3d_s | 2.41% | 320653.000 | 328385.000 | - | 3.44% | - |
| Performance Regressions - Execution | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 648.exchange2_s | 37.46% | 11478.000 | 15778.000 | - | 37.97% | - |
| 607.cactuBSSN_s | 10.39% | 101535.000 | 112087.000 | - | 10.21% | - |
| 631.deepsjeng_s | 7.49% | 12129.000 | 13038.000 | - | 6.56% | - |
| 620.omnetpp_s | 5.49% | 16616.000 | 17529.000 | - | 4.88% | - |
| 623.xalancbmk_s | 4.94% | 18667.000 | 19590.000 | - | 0.60% | - |
| 600.perlbench_s | 2.99% | 17912.000 | 18447.000 | - | 2.10% | - |
| 638.imagick_s | 2.77% | 208321.000 | 214088.000 | - | 2.73% | - |
| 644.nab_s | 2.73% | 144568.000 | 148516.000 | - | 2.92% | - |
| 641.leela_s | 2.67% | 14774.000 | 15169.000 | - | 2.12% | - |
| 603.bwaves_s | 2.37% | 234947.000 | 240512.000 | - | 1.46% | - |
| 602.gcc_s | 1.98% | 24056.000 | 24533.000 | - | 1.03% | - |
| 625.x264_s | 1.09% | 12760.000 | 12899.000 | - | 0.68% | - |
| Performance Improvements - Execution | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 621.wrf_s | -52.83% | 166081.000 | 78334.000 | - | -50.80% | - |
| 628.pop2_s | -29.19% | 110917.000 | 78542.000 | - | -29.12% | - |
| 654.roms_s | -22.16% | 152075.000 | 118371.000 | - | -22.39% | - |
| 619.lbm_s | -5.54% | 41595.000 | 39292.000 | - | -5.60% | - |
| 605.mcf_s | -1.13% | 29661.000 | 29327.000 | - | -2.71% | - |
| Performance Improvements - Score | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| nb_compile_successful | 100.00% | 19.000 | 38.000 | - | 100.00% | - |
| nb_execution_successful | 100.00% | 19.000 | 38.000 | - | 100.00% | - |
| nb_total_tests | 100.00% | 21.000 | 42.000 | - | 100.00% | - |
| Added Tests - sample variability |
|---|
| 600.perlbench_s |
| 600.perlbench_s (avg) |
| 600.perlbench_s (avg) (percentage) |
| 600.perlbench_s (max) |
| 600.perlbench_s (max) (percentage) |
| 602.gcc_s |
| 602.gcc_s (avg) |
| 602.gcc_s (avg) (percentage) |
| 602.gcc_s (max) |
| 602.gcc_s (max) (percentage) |
| 603.bwaves_s |
| 603.bwaves_s (avg) |
| 603.bwaves_s (avg) (percentage) |
| 603.bwaves_s (max) |
| 603.bwaves_s (max) (percentage) |
| 605.mcf_s |
| 605.mcf_s (avg) |
| 605.mcf_s (avg) (percentage) |
| 605.mcf_s (max) |
| 605.mcf_s (max) (percentage) |
| 607.cactuBSSN_s |
| 607.cactuBSSN_s (avg) |
| 607.cactuBSSN_s (avg) (percentage) |
| 607.cactuBSSN_s (max) |
| 607.cactuBSSN_s (max) (percentage) |
| 619.lbm_s |
| 619.lbm_s (avg) |
| 619.lbm_s (avg) (percentage) |
| 619.lbm_s (max) |
| 619.lbm_s (max) (percentage) |
| 620.omnetpp_s |
| 620.omnetpp_s (avg) |
| 620.omnetpp_s (avg) (percentage) |
| 620.omnetpp_s (max) |
| 620.omnetpp_s (max) (percentage) |
| 621.wrf_s |
| 621.wrf_s (avg) |
| 621.wrf_s (avg) (percentage) |
| 621.wrf_s (max) |
| 621.wrf_s (max) (percentage) |
| 623.xalancbmk_s |
| 623.xalancbmk_s (avg) |
| 623.xalancbmk_s (avg) (percentage) |
| 623.xalancbmk_s (max) |
| 623.xalancbmk_s (max) (percentage) |
| 625.x264_s |
| 625.x264_s (avg) |
| 625.x264_s (avg) (percentage) |
| 625.x264_s (max) |
| 625.x264_s (max) (percentage) |
| 628.pop2_s |
| 628.pop2_s (avg) |
| 628.pop2_s (avg) (percentage) |
| 628.pop2_s (max) |
| 628.pop2_s (max) (percentage) |
| 631.deepsjeng_s |
| 631.deepsjeng_s (avg) |
| 631.deepsjeng_s (avg) (percentage) |
| 631.deepsjeng_s (max) |
| 631.deepsjeng_s (max) (percentage) |
| 638.imagick_s |
| 638.imagick_s (avg) |
| 638.imagick_s (avg) (percentage) |
| 638.imagick_s (max) |
| 638.imagick_s (max) (percentage) |
| 641.leela_s |
| 641.leela_s (avg) |
| 641.leela_s (avg) (percentage) |
| 641.leela_s (max) |
| 641.leela_s (max) (percentage) |
| 644.nab_s |
| 644.nab_s (avg) |
| 644.nab_s (avg) (percentage) |
| 644.nab_s (max) |
| 644.nab_s (max) (percentage) |
| 648.exchange2_s |
| 648.exchange2_s (avg) |
| 648.exchange2_s (avg) (percentage) |
| 648.exchange2_s (max) |
| 648.exchange2_s (max) (percentage) |
| 649.fotonik3d_s |
| 649.fotonik3d_s (avg) |
| 649.fotonik3d_s (avg) (percentage) |
| 649.fotonik3d_s (max) |
| 649.fotonik3d_s (max) (percentage) |
| 654.roms_s |
| 654.roms_s (avg) |
| 654.roms_s (avg) (percentage) |
| 654.roms_s (max) |
| 654.roms_s (max) (percentage) |
| 657.xz_s |
| 657.xz_s (avg) |
| 657.xz_s (avg) (percentage) |
| 657.xz_s (max) |
| 657.xz_s (max) (percentage) |
Report Time: 0.23s