Fields
| hardware | None |
| os | None |
Parameters
Fields
| Name | Value |
|---|
Parameters
| Name | Value |
|---|---|
| git_binutils | https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=bf0e35375461ef2a17e2872e7f5c1446a5924b64 (+ 61 commits) |
| git_gcc | https://github.com/gcc-mirror/gcc/commit/288bc7b5d17511d1791899e4b2e3bf3489eb06dd (+ 49 commits) |
| git_glibc | https://sourceware.org/git/?p=glibc.git;a=commit;h=10f980d31e3d65c4c5bfafd176e7e1db92e2babe (+ 16 commits) |
| git_linux | https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=8a1c87c391aa0de11900231e2c208b6516a6921c (unchanged) |
| test_url | https://ci.linaro.org/job/tcwg_bmk-code_size-cpu2017fast--gnu-aarch64-master-Os-build/4/ |
Filter
gnu-aarch64-master-Os test results
| Run | Order | Start Time | Duration |
|---|---|---|---|
| Current | 0004 (3-changed-components) | 2023-03-06T10:36:36 | 0:00:00 |
| Previous | 0003 (3-changed-components) | 2023-03-03T15:40:15 | 0:00:00 |
| Baseline | 0001 (4-changed-components) | 2023-02-27T01:05:11 | 0:00:00 |
Tests Summary
| Status Group | # | # (B) |
|---|---|---|
| Performance Regressions | 105 | 18 |
| Performance Improvements | 52 | 2 |
| Added Tests | 0 | 105 |
| Unchanged Tests | 761 | 793 |
| Total Tests | 918 |
| Performance Regressions - Execution | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 619.lbm_s | 38.93% | 30705.000 | 42659.000 | - | 16.86% | - |
| 603.bwaves_s | 17.60% | 10409.000 | 12241.000 | - | 10.01% | - |
| 649.fotonik3d_s | 16.15% | 10784.000 | 12526.000 | - | 18.07% | - |
| 607.cactuBSSN_s | 15.02% | 4999.000 | 5750.000 | - | 11.11% | - |
| 605.mcf_s | 12.79% | 7241.000 | 8167.000 | - | 11.77% | - |
| 657.xz_s | 12.21% | 2597.000 | 2914.000 | - | 6.82% | - |
| 620.omnetpp_s | 11.47% | 4402.000 | 4907.000 | - | 8.59% | - |
| 654.roms_s | 6.92% | 36046.000 | 38540.000 | - | 4.28% | - |
| 602.gcc_s | 6.42% | 4988.000 | 5308.000 | - | 3.73% | - |
| 510.parest_r | 5.93% | 6632.000 | 7025.000 | - | 3.97% | - |
| 638.imagick_s | 5.14% | 5978.000 | 6285.000 | - | 3.41% | - |
| 511.povray_r | 3.76% | 532.000 | 552.000 | - | 4.35% | - |
| 644.nab_s | 3.52% | 12256.000 | 12688.000 | - | 2.63% | - |
| 628.pop2_s | 2.79% | 14140.000 | 14535.000 | - | 0.01% | - |
| 641.leela_s | 2.70% | 5147.000 | 5286.000 | - | 1.83% | - |
| 526.blender_r | 2.37% | 13012.000 | 13321.000 | - | 1.05% | - |
| 621.wrf_s | 2.35% | 12524.000 | 12818.000 | - | 1.09% | - |
| 508.namd_r | 2.03% | 3500.000 | 3571.000 | - | 1.45% | - |
| 623.xalancbmk_s | 2.01% | 5362.000 | 5470.000 | - | 4.23% | - |
| 600.perlbench_s | 1.72% | 2326.000 | 2366.000 | - | -1.17% | - |
| 625.x264_s | 1.30% | 4000.000 | 4052.000 | - | -0.25% | - |
| Performance Regressions - sample variability | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 511.povray_r (unexplained diff vs previous) | 900.00% | 2.000 | 20.000 | - | 0.00% | - |
| 511.povray_r (unexplained diff vs previous) (percentage) | 852.63% | 0.380 | 3.620 | - | 0.00% | - |
| 511.povray_r (max) | 566.67% | 3.000 | 20.000 | - | 0.00% | - |
| 625.x264_s (unexplained diff vs previous) | 550.00% | 8.000 | 52.000 | - | 0.00% | - |
| 625.x264_s (unexplained diff vs previous) (percentage) | 540.00% | 0.200 | 1.280 | - | 0.00% | - |
| 511.povray_r | 450.00% | 2.000 | 11.000 | - | 0.00% | - |
| 511.povray_r (avg) | 450.00% | 2.000 | 11.000 | - | 0.00% | - |
| 511.povray_r (max) (percentage) | 429.58% | 0.710 | 3.760 | - | 0.00% | - |
| 511.povray_r (avg) (percentage) | 285.71% | 0.560 | 2.160 | - | 0.00% | - |
| 644.nab_s (max) | 151.98% | 177.000 | 446.000 | - | 0.00% | - |
| 644.nab_s (max) (percentage) | 142.76% | 1.450 | 3.520 | - | 0.00% | - |
| 644.nab_s (unexplained diff vs previous) | 140.00% | 180.000 | 432.000 | - | 0.00% | - |
| 607.cactuBSSN_s (max) | 136.44% | 365.000 | 863.000 | - | 0.00% | - |
| 644.nab_s (unexplained diff vs previous) (percentage) | 131.29% | 1.470 | 3.400 | - | 0.00% | - |
| 619.lbm_s (max) | 122.58% | 7461.000 | 16607.000 | - | 0.00% | - |
| 648.exchange2_s (unexplained diff vs previous) (percentage) | 115.91% | 0.440 | 0.950 | - | 0.00% | - |
| 648.exchange2_s (max) (percentage) | 113.64% | 0.440 | 0.940 | - | 0.00% | - |
| 648.exchange2_s (unexplained diff vs previous) | 113.33% | 15.000 | 32.000 | - | 0.00% | - |
| 644.nab_s | 108.45% | 142.000 | 296.000 | - | 0.00% | - |
| 644.nab_s (avg) | 108.45% | 142.000 | 296.000 | - | 0.00% | - |
| 648.exchange2_s (max) | 106.67% | 15.000 | 31.000 | - | 0.00% | - |
| 607.cactuBSSN_s (max) (percentage) | 105.47% | 7.310 | 15.020 | - | 0.00% | - |
| 619.lbm_s | 105.30% | 6113.000 | 12550.000 | - | 0.00% | - |
| 619.lbm_s (avg) | 105.30% | 6113.000 | 12550.000 | - | 0.00% | - |
| 644.nab_s (avg) (percentage) | 101.72% | 1.160 | 2.340 | - | 0.00% | - |
| 607.cactuBSSN_s (unexplained diff vs previous) | 90.61% | 394.000 | 751.000 | - | 0.00% | - |
| 607.cactuBSSN_s | 87.95% | 365.000 | 686.000 | - | 0.00% | - |
| 607.cactuBSSN_s (avg) | 87.95% | 365.000 | 686.000 | - | 0.00% | - |
| 603.bwaves_s (max) | 75.98% | 1224.000 | 2154.000 | - | 0.00% | - |
| 508.namd_r (max) | 67.44% | 43.000 | 72.000 | - | 0.00% | - |
| 638.imagick_s (max) | 66.49% | 194.000 | 323.000 | - | 0.00% | - |
| 648.exchange2_s (avg) (percentage) | 65.85% | 0.410 | 0.680 | - | 0.00% | - |
| 607.cactuBSSN_s (unexplained diff vs previous) (percentage) | 65.74% | 7.880 | 13.060 | - | 0.00% | - |
| 625.x264_s | 65.22% | 23.000 | 38.000 | - | 0.00% | - |
| 625.x264_s (avg) | 65.22% | 23.000 | 38.000 | - | 0.00% | - |
| 648.exchange2_s | 64.29% | 14.000 | 23.000 | - | 0.00% | - |
| 648.exchange2_s (avg) | 64.29% | 14.000 | 23.000 | - | 0.00% | - |
| 603.bwaves_s | 63.96% | 1024.000 | 1679.000 | - | 0.00% | - |
| 603.bwaves_s (avg) | 63.96% | 1024.000 | 1679.000 | - | 0.00% | - |
| 508.namd_r (max) (percentage) | 63.71% | 1.240 | 2.030 | - | 0.00% | - |
| 607.cactuBSSN_s (avg) (percentage) | 63.34% | 7.310 | 11.940 | - | 0.00% | - |
| 625.x264_s (avg) (percentage) | 62.07% | 0.580 | 0.940 | - | 0.00% | - |
| 508.namd_r (unexplained diff vs previous) | 61.36% | 44.000 | 71.000 | - | 0.00% | - |
| 619.lbm_s (max) (percentage) | 60.21% | 24.300 | 38.930 | - | 0.00% | - |
| 638.imagick_s (max) (percentage) | 58.15% | 3.250 | 5.140 | - | 0.00% | - |
| 508.namd_r (unexplained diff vs previous) (percentage) | 57.94% | 1.260 | 1.990 | - | 0.00% | - |
| 638.imagick_s (unexplained diff vs previous) | 52.74% | 201.000 | 307.000 | - | 0.00% | - |
| 603.bwaves_s (max) (percentage) | 49.66% | 11.760 | 17.600 | - | 0.00% | - |
| 619.lbm_s (avg) (percentage) | 47.76% | 19.910 | 29.420 | - | 0.00% | - |
| 638.imagick_s (unexplained diff vs previous) (percentage) | 45.24% | 3.360 | 4.880 | - | 0.00% | - |
| 508.namd_r | 41.86% | 43.000 | 61.000 | - | 0.00% | - |
| 508.namd_r (avg) | 41.86% | 43.000 | 61.000 | - | 0.00% | - |
| 638.imagick_s | 41.75% | 194.000 | 275.000 | - | 0.00% | - |
| 638.imagick_s (avg) | 41.75% | 194.000 | 275.000 | - | 0.00% | - |
| 603.bwaves_s (avg) (percentage) | 39.43% | 9.840 | 13.720 | - | 0.00% | - |
| 508.namd_r (avg) (percentage) | 37.90% | 1.240 | 1.710 | - | 0.00% | - |
| 638.imagick_s (avg) (percentage) | 34.77% | 3.250 | 4.380 | - | 0.00% | - |
| 603.bwaves_s (unexplained diff vs previous) | 32.08% | 1387.000 | 1832.000 | - | 0.00% | - |
| 625.x264_s (max) (percentage) | 30.00% | 1.000 | 1.300 | - | 0.00% | - |
| 625.x264_s (max) | 30.00% | 40.000 | 52.000 | - | 0.00% | - |
| 605.mcf_s (max) | 22.39% | 853.000 | 1044.000 | - | 0.00% | - |
| 619.lbm_s (unexplained diff vs previous) | 21.25% | 9859.000 | 11954.000 | - | 0.00% | - |
| 657.xz_s | 18.73% | 283.000 | 336.000 | - | 0.00% | - |
| 657.xz_s (avg) | 18.73% | 283.000 | 336.000 | - | 0.00% | - |
| 605.mcf_s | 16.74% | 866.000 | 1011.000 | - | 0.00% | - |
| 605.mcf_s (avg) | 16.74% | 866.000 | 1011.000 | - | 0.00% | - |
| 657.xz_s (max) | 12.34% | 316.000 | 355.000 | - | 0.00% | - |
| 603.bwaves_s (unexplained diff vs previous) (percentage) | 12.30% | 13.330 | 14.970 | - | 0.00% | - |
| 605.mcf_s (max) (percentage) | 8.48% | 11.790 | 12.790 | - | 0.00% | - |
| 649.fotonik3d_s (max) | 7.38% | 1883.000 | 2022.000 | - | 0.00% | - |
| 620.omnetpp_s | 7.13% | 547.000 | 586.000 | - | 0.00% | - |
| 620.omnetpp_s (avg) | 7.13% | 547.000 | 586.000 | - | 0.00% | - |
| 649.fotonik3d_s | 6.51% | 2088.000 | 2224.000 | - | 0.00% | - |
| 649.fotonik3d_s (avg) | 6.51% | 2088.000 | 2224.000 | - | 0.00% | - |
| 657.xz_s (avg) (percentage) | 5.96% | 10.910 | 11.560 | - | 0.00% | - |
| 628.pop2_s | 5.36% | 373.000 | 393.000 | - | 0.00% | - |
| 628.pop2_s (avg) | 5.36% | 373.000 | 393.000 | - | 0.00% | - |
| 605.mcf_s (avg) (percentage) | 3.43% | 11.970 | 12.380 | - | 0.00% | - |
| 628.pop2_s (avg) (percentage) | 2.65% | 2.640 | 2.710 | - | 0.00% | - |
| 526.blender_r | 2.61% | 307.000 | 315.000 | - | 0.00% | - |
| 526.blender_r (avg) | 2.61% | 307.000 | 315.000 | - | 0.00% | - |
| 526.blender_r (max) | 2.61% | 307.000 | 315.000 | - | 0.00% | - |
| 621.wrf_s | 2.38% | 672.000 | 688.000 | - | 0.00% | - |
| 621.wrf_s (avg) | 2.38% | 672.000 | 688.000 | - | 0.00% | - |
| Performance Regressions - Execution | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 649.fotonik3d_s | 18.07% | 10609.000 | 12526.000 | - | 16.15% | - |
| 619.lbm_s | 16.86% | 36505.000 | 42659.000 | - | 38.93% | - |
| 605.mcf_s | 11.77% | 7307.000 | 8167.000 | - | 12.79% | - |
| 607.cactuBSSN_s | 11.11% | 5175.000 | 5750.000 | - | 15.02% | - |
| 603.bwaves_s | 10.01% | 11127.000 | 12241.000 | - | 17.60% | - |
| 620.omnetpp_s | 8.59% | 4519.000 | 4907.000 | - | 11.47% | - |
| 657.xz_s | 6.82% | 2728.000 | 2914.000 | - | 12.21% | - |
| 511.povray_r | 4.35% | 529.000 | 552.000 | - | 3.76% | - |
| 654.roms_s | 4.28% | 36958.000 | 38540.000 | - | 6.92% | - |
| 623.xalancbmk_s | 4.23% | 5248.000 | 5470.000 | - | 2.01% | - |
| 510.parest_r | 3.97% | 6757.000 | 7025.000 | - | 5.93% | - |
| 602.gcc_s | 3.73% | 5117.000 | 5308.000 | - | 6.42% | - |
| 638.imagick_s | 3.41% | 6078.000 | 6285.000 | - | 5.14% | - |
| 644.nab_s | 2.63% | 12363.000 | 12688.000 | - | 3.52% | - |
| 641.leela_s | 1.83% | 5191.000 | 5286.000 | - | 2.70% | - |
| 508.namd_r | 1.45% | 3520.000 | 3571.000 | - | 2.03% | - |
| 621.wrf_s | 1.09% | 12680.000 | 12818.000 | - | 2.35% | - |
| 526.blender_r | 1.05% | 13182.000 | 13321.000 | - | 2.37% | - |
| Performance Improvements - Execution | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 631.deepsjeng_s | -2.39% | 4475.000 | 4368.000 | - | -0.73% | - |
| 600.perlbench_s | -1.17% | 2394.000 | 2366.000 | - | 1.72% | - |
| Added Tests - sample variability |
|---|
| 508.namd_r |
| 508.namd_r (avg) |
| 508.namd_r (avg) (percentage) |
| 508.namd_r (max) |
| 508.namd_r (max) (percentage) |
| 510.parest_r |
| 510.parest_r (avg) |
| 510.parest_r (avg) (percentage) |
| 510.parest_r (max) |
| 510.parest_r (max) (percentage) |
| 511.povray_r |
| 511.povray_r (avg) |
| 511.povray_r (avg) (percentage) |
| 511.povray_r (max) |
| 511.povray_r (max) (percentage) |
| 526.blender_r |
| 526.blender_r (avg) |
| 526.blender_r (avg) (percentage) |
| 526.blender_r (max) |
| 526.blender_r (max) (percentage) |
| 600.perlbench_s |
| 600.perlbench_s (avg) |
| 600.perlbench_s (avg) (percentage) |
| 600.perlbench_s (max) |
| 600.perlbench_s (max) (percentage) |
| 603.bwaves_s |
| 603.bwaves_s (avg) |
| 603.bwaves_s (avg) (percentage) |
| 603.bwaves_s (max) |
| 603.bwaves_s (max) (percentage) |
| 605.mcf_s |
| 605.mcf_s (avg) |
| 605.mcf_s (avg) (percentage) |
| 605.mcf_s (max) |
| 605.mcf_s (max) (percentage) |
| 607.cactuBSSN_s |
| 607.cactuBSSN_s (avg) |
| 607.cactuBSSN_s (avg) (percentage) |
| 607.cactuBSSN_s (max) |
| 607.cactuBSSN_s (max) (percentage) |
| 619.lbm_s |
| 619.lbm_s (avg) |
| 619.lbm_s (avg) (percentage) |
| 619.lbm_s (max) |
| 619.lbm_s (max) (percentage) |
| 620.omnetpp_s |
| 620.omnetpp_s (avg) |
| 620.omnetpp_s (avg) (percentage) |
| 620.omnetpp_s (max) |
| 620.omnetpp_s (max) (percentage) |
| 621.wrf_s |
| 621.wrf_s (avg) |
| 621.wrf_s (avg) (percentage) |
| 621.wrf_s (max) |
| 621.wrf_s (max) (percentage) |
| 625.x264_s |
| 625.x264_s (avg) |
| 625.x264_s (avg) (percentage) |
| 625.x264_s (max) |
| 625.x264_s (max) (percentage) |
| 628.pop2_s |
| 628.pop2_s (avg) |
| 628.pop2_s (avg) (percentage) |
| 628.pop2_s (max) |
| 628.pop2_s (max) (percentage) |
| 631.deepsjeng_s |
| 631.deepsjeng_s (avg) |
| 631.deepsjeng_s (avg) (percentage) |
| 631.deepsjeng_s (max) |
| 631.deepsjeng_s (max) (percentage) |
| 638.imagick_s |
| 638.imagick_s (avg) |
| 638.imagick_s (avg) (percentage) |
| 638.imagick_s (max) |
| 638.imagick_s (max) (percentage) |
| 641.leela_s |
| 641.leela_s (avg) |
| 641.leela_s (avg) (percentage) |
| 641.leela_s (max) |
| 641.leela_s (max) (percentage) |
| 644.nab_s |
| 644.nab_s (avg) |
| 644.nab_s (avg) (percentage) |
| 644.nab_s (max) |
| 644.nab_s (max) (percentage) |
| 648.exchange2_s |
| 648.exchange2_s (avg) |
| 648.exchange2_s (avg) (percentage) |
| 648.exchange2_s (max) |
| 648.exchange2_s (max) (percentage) |
| 649.fotonik3d_s |
| 649.fotonik3d_s (avg) |
| 649.fotonik3d_s (avg) (percentage) |
| 649.fotonik3d_s (max) |
| 649.fotonik3d_s (max) (percentage) |
| 654.roms_s |
| 654.roms_s (avg) |
| 654.roms_s (avg) (percentage) |
| 654.roms_s (max) |
| 654.roms_s (max) (percentage) |
| 657.xz_s |
| 657.xz_s (avg) |
| 657.xz_s (avg) (percentage) |
| 657.xz_s (max) |
| 657.xz_s (max) (percentage) |
Report Time: 0.41s