Fields
| hardware | None |
| os | None |
Parameters
Fields
| Name | Value |
|---|
Parameters
| Name | Value |
|---|---|
| git_binutils | https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=29c70787112e01cd52b53bf14bdcacb0a11e0725 (+ 130 commits) |
| git_gcc | https://github.com/gcc-mirror/gcc/commit/bfb9105ffbff952599ec949cee1e18ddc1f849ba (+ 348 commits) |
| git_glibc | https://sourceware.org/git/?p=glibc.git;a=commit;h=a2509a8bc955988f01f389a1cf74db3a9da42409 (+ 35 commits) |
| git_linux | https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/6f0a8fd3aaa73ffc8e87ab9da86f27331820085c (+ 610 commits) |
| test_url | https://ci.linaro.org/job/tcwg_bmk-code_size-cpu2017fast--gnu-aarch64-master-O2-build/262/ |
Filter
gnu-aarch64-master-O2 test results
| Run | Order | Start Time | Duration |
|---|---|---|---|
| Current | 0262 (4-changed-components) | 2024-08-30T19:06:21 | 0:00:00 |
| Previous | 0259 (3-changed-components) | 2024-08-22T08:16:01 | 0:00:00 |
| Baseline | 0001 (4-changed-components) | 2023-03-26T18:17:00 | 0:00:00 |
Tests Summary
| Status Group | # | # (B) |
|---|---|---|
| Performance Regressions | 45 | 11 |
| Performance Improvements | 85 | 16 |
| Added Tests | 0 | 108 |
| Unchanged Tests | 788 | 783 |
| Total Tests | 918 |
| Performance Regressions - Code Size | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 508.namd_r | 1.27% | 633808.000 | 641880.000 | - | 2.31% | - |
| Performance Regressions - sample variability | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 619.lbm_s (unexplained diff vs previous) (percentage) | 263.41% | 36.510 | 132.680 | 0.000 | 0.00% | 0.000 |
| 607.cactuBSSN_s (unexplained diff vs previous) (percentage) | 128.58% | 19.910 | 45.510 | 0.000 | 0.00% | 0.000 |
| 603.bwaves_s (unexplained diff vs previous) (percentage) | 101.27% | 18.180 | 36.590 | 0.000 | 0.00% | 0.000 |
| 657.xz_s (unexplained diff vs previous) (percentage) | 87.77% | 17.010 | 31.940 | 0.000 | 0.00% | 0.000 |
| 620.omnetpp_s (unexplained diff vs previous) (percentage) | 73.30% | 19.550 | 33.880 | 0.000 | 0.00% | 0.000 |
| 605.mcf_s (unexplained diff vs previous) (percentage) | 65.30% | 14.930 | 24.680 | 0.000 | 0.00% | 0.000 |
| 631.deepsjeng_s (unexplained diff vs previous) (percentage) | 64.01% | 10.780 | 17.680 | 0.000 | 0.00% | 0.000 |
| 607.cactuBSSN_s (unexplained diff vs previous) | 57.09% | 1382.000 | 2171.000 | 0.000 | 0.00% | 0.000 |
| 619.lbm_s (unexplained diff vs previous) | 56.19% | 24757.000 | 38669.000 | 0.000 | 0.00% | 0.000 |
| 603.bwaves_s (unexplained diff vs previous) | 47.32% | 2236.000 | 3294.000 | 0.000 | 0.00% | 0.000 |
| 641.leela_s (unexplained diff vs previous) (percentage) | 44.99% | 5.890 | 8.540 | 0.000 | 0.00% | 0.000 |
| 657.xz_s (unexplained diff vs previous) | 42.31% | 494.000 | 703.000 | 0.000 | 0.00% | 0.000 |
| 631.deepsjeng_s (unexplained diff vs previous) | 39.30% | 486.000 | 677.000 | 0.000 | 0.00% | 0.000 |
| 623.xalancbmk_s (unexplained diff vs previous) (percentage) | 38.33% | 6.940 | 9.600 | 0.000 | 0.00% | 0.000 |
| 641.leela_s (unexplained diff vs previous) | 33.44% | 302.000 | 403.000 | 0.000 | 0.00% | 0.000 |
| 605.mcf_s (unexplained diff vs previous) | 32.62% | 1217.000 | 1614.000 | 0.000 | 0.00% | 0.000 |
| 620.omnetpp_s (unexplained diff vs previous) | 29.45% | 1073.000 | 1389.000 | 0.000 | 0.00% | 0.000 |
| 631.deepsjeng_s (avg) (percentage) | 26.72% | 1.160 | 1.470 | - | 0.00% | - |
| 623.xalancbmk_s (unexplained diff vs previous) | 26.30% | 289.000 | 365.000 | 0.000 | 0.00% | 0.000 |
| 607.cactuBSSN_s (max) (percentage) | 25.82% | 24.860 | 31.280 | - | 0.00% | - |
| 657.xz_s (avg) (percentage) | 25.82% | 1.820 | 2.290 | - | 0.00% | - |
| 641.leela_s (max) (percentage) | 25.72% | 6.260 | 7.870 | - | 0.00% | - |
| 631.deepsjeng_s (max) (percentage) | 24.23% | 12.090 | 15.020 | - | 0.00% | - |
| 641.leela_s (avg) (percentage) | 21.62% | 0.740 | 0.900 | - | 0.00% | - |
| 603.bwaves_s (max) (percentage) | 20.57% | 22.220 | 26.790 | - | 0.00% | - |
| 605.mcf_s (avg) (percentage) | 18.18% | 1.980 | 2.340 | - | 0.00% | - |
| 603.bwaves_s (avg) (percentage) | 18.11% | 2.650 | 3.130 | - | 0.00% | - |
| 657.xz_s (max) (percentage) | 18.10% | 20.500 | 24.210 | - | 0.00% | - |
| 620.omnetpp_s (avg) (percentage) | 18.06% | 2.270 | 2.680 | - | 0.00% | - |
| 607.cactuBSSN_s (avg) (percentage) | 18.03% | 3.660 | 4.320 | - | 0.00% | - |
| 623.xalancbmk_s (max) (percentage) | 17.58% | 7.450 | 8.760 | - | 0.00% | - |
| 623.xalancbmk_s (avg) (percentage) | 17.48% | 1.030 | 1.210 | - | 0.00% | - |
| 641.leela_s (max) | 15.94% | 320.000 | 371.000 | - | 0.00% | - |
| 641.leela_s | 13.51% | 37.000 | 42.000 | - | 0.00% | - |
| 641.leela_s (avg) | 13.51% | 37.000 | 42.000 | - | 0.00% | - |
| 605.mcf_s (max) (percentage) | 12.83% | 17.540 | 19.790 | - | 0.00% | - |
| 619.lbm_s (avg) (percentage) | 10.72% | 8.580 | 9.500 | - | 0.00% | - |
| 631.deepsjeng_s | 7.69% | 52.000 | 56.000 | - | 0.00% | - |
| 631.deepsjeng_s (avg) | 7.69% | 52.000 | 56.000 | - | 0.00% | - |
| 623.xalancbmk_s | 7.14% | 42.000 | 45.000 | - | 0.00% | - |
| 623.xalancbmk_s (avg) | 7.14% | 42.000 | 45.000 | - | 0.00% | - |
| 623.xalancbmk_s (max) | 7.10% | 310.000 | 332.000 | - | 0.00% | - |
| 631.deepsjeng_s (max) | 5.70% | 544.000 | 575.000 | - | 0.00% | - |
| 620.omnetpp_s (max) (percentage) | 4.16% | 24.300 | 25.310 | - | 0.00% | - |
| Performance Improvements - Code Size | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 649.fotonik3d_s | -1.34% | 303886.000 | 299822.000 | - | -2.92% | - |
| Performance Improvements - Execution | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 619.lbm_s | -57.02% | 67814.000 | 29145.000 | - | 2.58% | - |
| 654.roms_s | -35.48% | 43443.000 | 28028.000 | - | 2.34% | - |
| 607.cactuBSSN_s | -31.28% | 6941.000 | 4770.000 | - | 0.46% | - |
| 627.cam4_s | -28.78% | 205.000 | 146.000 | - | 0.00% | - |
| 649.fotonik3d_s | -28.41% | 13558.000 | 9706.000 | - | -1.09% | - |
| 603.bwaves_s | -26.79% | 12297.000 | 9003.000 | - | 0.98% | - |
| 620.omnetpp_s | -25.31% | 5489.000 | 4100.000 | - | -1.51% | - |
| 602.gcc_s | -24.22% | 5537.000 | 4196.000 | - | -2.58% | - |
| 657.xz_s | -24.21% | 2904.000 | 2201.000 | - | -1.21% | - |
| 621.wrf_s | -23.03% | 12023.000 | 9254.000 | - | 1.48% | - |
| 628.pop2_s | -21.57% | 13281.000 | 10416.000 | - | -2.11% | - |
| 510.parest_r | -20.96% | 7261.000 | 5739.000 | - | 1.81% | - |
| 605.mcf_s | -19.79% | 8154.000 | 6540.000 | - | -5.11% | - |
| 638.imagick_s | -17.83% | 4056.000 | 3333.000 | - | -0.39% | - |
| 631.deepsjeng_s | -15.02% | 4507.000 | 3830.000 | - | -0.44% | - |
| 600.perlbench_s | -13.22% | 2322.000 | 2015.000 | - | -2.09% | - |
| 625.x264_s | -13.20% | 2947.000 | 2558.000 | - | 0.00% | - |
| 623.xalancbmk_s | -8.76% | 4166.000 | 3801.000 | - | -0.08% | - |
| 526.blender_r | -8.45% | 10936.000 | 10012.000 | - | -0.41% | - |
| 508.namd_r | -8.13% | 2707.000 | 2487.000 | - | 2.47% | - |
| 641.leela_s | -7.87% | 5123.000 | 4720.000 | - | -3.79% | - |
| 511.povray_r | -4.26% | 423.000 | 405.000 | - | -4.71% | - |
| 644.nab_s | -3.81% | 10952.000 | 10535.000 | - | 0.64% | - |
| Performance Improvements - sample variability | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 619.lbm_s (max) | -57.38% | 38993.000 | 16618.000 | - | 0.00% | - |
| 619.lbm_s | -52.42% | 5818.000 | 2768.000 | - | 0.00% | - |
| 619.lbm_s (avg) | -52.42% | 5818.000 | 2768.000 | - | 0.00% | - |
| 654.roms_s (max) | -38.71% | 18923.000 | 11597.000 | - | 0.00% | - |
| 654.roms_s | -35.52% | 1481.000 | 955.000 | - | 0.00% | - |
| 654.roms_s (avg) | -35.52% | 1481.000 | 955.000 | - | 0.00% | - |
| 649.fotonik3d_s (max) | -32.00% | 3331.000 | 2265.000 | - | 0.00% | - |
| 649.fotonik3d_s | -28.43% | 299.000 | 214.000 | - | 0.00% | - |
| 649.fotonik3d_s (avg) | -28.43% | 299.000 | 214.000 | - | 0.00% | - |
| 510.parest_r (max) | -24.92% | 1312.000 | 985.000 | - | 0.00% | - |
| 628.pop2_s (max) | -22.50% | 2738.000 | 2122.000 | - | 0.00% | - |
| 620.omnetpp_s (max) | -22.21% | 1333.000 | 1037.000 | - | 0.00% | - |
| 638.imagick_s (max) | -22.00% | 559.000 | 436.000 | - | 0.00% | - |
| 628.pop2_s | -21.47% | 354.000 | 278.000 | - | 0.00% | - |
| 628.pop2_s (avg) | -21.47% | 354.000 | 278.000 | - | 0.00% | - |
| 510.parest_r | -20.93% | 129.000 | 102.000 | - | 0.00% | - |
| 510.parest_r (avg) | -20.93% | 129.000 | 102.000 | - | 0.00% | - |
| 600.perlbench_s (max) | -19.60% | 250.000 | 201.000 | - | 0.00% | - |
| 607.cactuBSSN_s | -18.90% | 254.000 | 206.000 | - | 0.00% | - |
| 607.cactuBSSN_s (avg) | -18.90% | 254.000 | 206.000 | - | 0.00% | - |
| 638.imagick_s | -18.18% | 55.000 | 45.000 | - | 0.00% | - |
| 638.imagick_s (avg) | -18.18% | 55.000 | 45.000 | - | 0.00% | - |
| 625.x264_s (max) | -17.76% | 259.000 | 213.000 | - | 0.00% | - |
| 526.blender_r (max) | -15.10% | 775.000 | 658.000 | - | 0.00% | - |
| 603.bwaves_s | -13.54% | 325.000 | 281.000 | - | 0.00% | - |
| 603.bwaves_s (avg) | -13.54% | 325.000 | 281.000 | - | 0.00% | - |
| 600.perlbench_s | -13.51% | 37.000 | 32.000 | - | 0.00% | - |
| 600.perlbench_s (avg) | -13.51% | 37.000 | 32.000 | - | 0.00% | - |
| 607.cactuBSSN_s (max) | -13.51% | 1725.000 | 1492.000 | - | 0.00% | - |
| 508.namd_r (max) | -12.30% | 122.000 | 107.000 | - | 0.00% | - |
| 625.x264_s | -12.20% | 41.000 | 36.000 | - | 0.00% | - |
| 625.x264_s (avg) | -12.20% | 41.000 | 36.000 | - | 0.00% | - |
| 620.omnetpp_s | -12.10% | 124.000 | 109.000 | - | 0.00% | - |
| 620.omnetpp_s (avg) | -12.10% | 124.000 | 109.000 | - | 0.00% | - |
| 603.bwaves_s (max) | -11.75% | 2732.000 | 2411.000 | - | 0.00% | - |
| 657.xz_s (max) | -10.59% | 595.000 | 532.000 | - | 0.00% | - |
| 605.mcf_s (max) | -9.51% | 1430.000 | 1294.000 | - | 0.00% | - |
| 644.nab_s (max) | -8.82% | 340.000 | 310.000 | - | 0.00% | - |
| 526.blender_r | -8.18% | 110.000 | 101.000 | - | 0.00% | - |
| 526.blender_r (avg) | -8.18% | 110.000 | 101.000 | - | 0.00% | - |
| 648.exchange2_s (max) (percentage) | -8.11% | 0.370 | 0.340 | - | 0.00% | - |
| 508.namd_r | -8.00% | 25.000 | 23.000 | - | 0.00% | - |
| 508.namd_r (avg) | -8.00% | 25.000 | 23.000 | - | 0.00% | - |
| 526.blender_r (max) (percentage) | -7.19% | 7.090 | 6.580 | - | 0.00% | - |
| 511.povray_r (max) | -7.14% | 14.000 | 13.000 | - | 0.00% | - |
| 600.perlbench_s (max) (percentage) | -7.14% | 10.780 | 10.010 | - | 0.00% | - |
| 644.nab_s (max) (percentage) | -5.14% | 3.110 | 2.950 | - | 0.00% | - |
| 649.fotonik3d_s (max) (percentage) | -5.01% | 24.570 | 23.340 | - | 0.00% | - |
| 625.x264_s (max) (percentage) | -5.01% | 8.790 | 8.350 | - | 0.00% | - |
| 654.roms_s (max) (percentage) | -5.00% | 43.560 | 41.380 | - | 0.00% | - |
| 638.imagick_s (max) (percentage) | -5.00% | 13.800 | 13.110 | - | 0.00% | - |
| 510.parest_r (max) (percentage) | -4.98% | 18.070 | 17.170 | - | 0.00% | - |
| 511.povray_r (max) (percentage) | -4.97% | 3.420 | 3.250 | - | 0.00% | - |
| 605.mcf_s | -4.97% | 161.000 | 153.000 | - | 0.00% | - |
| 605.mcf_s (avg) | -4.97% | 161.000 | 153.000 | - | 0.00% | - |
| 508.namd_r (max) (percentage) | -4.65% | 4.520 | 4.310 | - | 0.00% | - |
| 644.nab_s | -4.29% | 70.000 | 67.000 | - | 0.00% | - |
| 644.nab_s (avg) | -4.29% | 70.000 | 67.000 | - | 0.00% | - |
| 657.xz_s | -3.85% | 52.000 | 50.000 | - | 0.00% | - |
| 657.xz_s (avg) | -3.85% | 52.000 | 50.000 | - | 0.00% | - |
| 628.pop2_s (max) (percentage) | -1.16% | 20.620 | 20.380 | - | 0.00% | - |
| Performance Regressions - Code Size | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 510.parest_r | 3.15% | 7623044.000 | 7863089.000 | - | -0.05% | - |
| 508.namd_r | 2.31% | 627398.000 | 641880.000 | - | 1.27% | - |
| 631.deepsjeng_s | 1.75% | 80966.000 | 82382.000 | - | 0.00% | - |
| 600.perlbench_s | 1.45% | 2120214.000 | 2150903.000 | - | 0.00% | - |
| 657.xz_s | 1.12% | 190987.000 | 193119.000 | - | 0.00% | - |
| Performance Regressions - Execution | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 648.exchange2_s | 7.59% | 2199.000 | 2366.000 | - | 0.51% | - |
| 619.lbm_s | 2.58% | 28412.000 | 29145.000 | - | -57.02% | - |
| 508.namd_r | 2.47% | 2427.000 | 2487.000 | - | -8.13% | - |
| 654.roms_s | 2.34% | 27387.000 | 28028.000 | - | -35.48% | - |
| 510.parest_r | 1.81% | 5637.000 | 5739.000 | - | -20.96% | - |
| 621.wrf_s | 1.48% | 9119.000 | 9254.000 | - | -23.03% | - |
| Performance Improvements - Code Size | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 649.fotonik3d_s | -2.92% | 308847.000 | 299822.000 | - | -1.34% | - |
| 603.bwaves_s | -2.06% | 49143.000 | 48131.000 | - | 0.00% | - |
| 511.povray_r | -1.97% | 851500.000 | 834760.000 | - | 0.01% | - |
| 654.roms_s | -1.22% | 680117.000 | 671812.000 | - | 0.62% | - |
| Performance Improvements - Execution | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 605.mcf_s | -5.11% | 6892.000 | 6540.000 | - | -19.79% | - |
| 511.povray_r | -4.71% | 425.000 | 405.000 | - | -4.26% | - |
| 641.leela_s | -3.79% | 4906.000 | 4720.000 | - | -7.87% | - |
| 602.gcc_s | -2.58% | 4307.000 | 4196.000 | - | -24.22% | - |
| 628.pop2_s | -2.11% | 10641.000 | 10416.000 | - | -21.57% | - |
| 600.perlbench_s | -2.09% | 2058.000 | 2015.000 | - | -13.22% | - |
| 620.omnetpp_s | -1.51% | 4163.000 | 4100.000 | - | -25.31% | - |
| 657.xz_s | -1.21% | 2228.000 | 2201.000 | - | -24.21% | - |
| 649.fotonik3d_s | -1.09% | 9813.000 | 9706.000 | - | -28.41% | - |
| Performance Improvements - Score | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| nb_execution_successful | 109.09% | 22.000 | 46.000 | - | 0.00% | - |
| nb_compile_successful | 100.00% | 24.000 | 48.000 | - | 0.00% | - |
| nb_total_tests | 100.00% | 24.000 | 48.000 | - | 0.00% | - |
| Added Tests - Code Size |
|---|
| 625.x264_s |
| Added Tests - Execution |
|---|
| 625.x264_s |
| 627.cam4_s |
| Added Tests - sample variability |
|---|
| 508.namd_r |
| 508.namd_r (avg) |
| 508.namd_r (avg) (percentage) |
| 508.namd_r (max) |
| 508.namd_r (max) (percentage) |
| 510.parest_r |
| 510.parest_r (avg) |
| 510.parest_r (avg) (percentage) |
| 510.parest_r (max) |
| 510.parest_r (max) (percentage) |
| 511.povray_r |
| 511.povray_r (avg) |
| 511.povray_r (avg) (percentage) |
| 511.povray_r (max) |
| 511.povray_r (max) (percentage) |
| 526.blender_r |
| 526.blender_r (avg) |
| 526.blender_r (avg) (percentage) |
| 526.blender_r (max) |
| 526.blender_r (max) (percentage) |
| 600.perlbench_s |
| 600.perlbench_s (avg) |
| 600.perlbench_s (avg) (percentage) |
| 600.perlbench_s (max) |
| 600.perlbench_s (max) (percentage) |
| 603.bwaves_s |
| 603.bwaves_s (avg) |
| 603.bwaves_s (avg) (percentage) |
| 603.bwaves_s (max) |
| 603.bwaves_s (max) (percentage) |
| 605.mcf_s |
| 605.mcf_s (avg) |
| 605.mcf_s (avg) (percentage) |
| 605.mcf_s (max) |
| 605.mcf_s (max) (percentage) |
| 607.cactuBSSN_s |
| 607.cactuBSSN_s (avg) |
| 607.cactuBSSN_s (avg) (percentage) |
| 607.cactuBSSN_s (max) |
| 607.cactuBSSN_s (max) (percentage) |
| 619.lbm_s |
| 619.lbm_s (avg) |
| 619.lbm_s (avg) (percentage) |
| 619.lbm_s (max) |
| 619.lbm_s (max) (percentage) |
| 620.omnetpp_s |
| 620.omnetpp_s (avg) |
| 620.omnetpp_s (avg) (percentage) |
| 620.omnetpp_s (max) |
| 620.omnetpp_s (max) (percentage) |
| 623.xalancbmk_s |
| 623.xalancbmk_s (avg) |
| 623.xalancbmk_s (avg) (percentage) |
| 623.xalancbmk_s (max) |
| 623.xalancbmk_s (max) (percentage) |
| 625.x264_s |
| 625.x264_s (avg) |
| 625.x264_s (avg) (percentage) |
| 625.x264_s (max) |
| 625.x264_s (max) (percentage) |
| 628.pop2_s |
| 628.pop2_s (avg) |
| 628.pop2_s (avg) (percentage) |
| 628.pop2_s (max) |
| 628.pop2_s (max) (percentage) |
| 631.deepsjeng_s |
| 631.deepsjeng_s (avg) |
| 631.deepsjeng_s (avg) (percentage) |
| 631.deepsjeng_s (max) |
| 631.deepsjeng_s (max) (percentage) |
| 638.imagick_s |
| 638.imagick_s (avg) |
| 638.imagick_s (avg) (percentage) |
| 638.imagick_s (max) |
| 638.imagick_s (max) (percentage) |
| 641.leela_s |
| 641.leela_s (avg) |
| 641.leela_s (avg) (percentage) |
| 641.leela_s (max) |
| 641.leela_s (max) (percentage) |
| 644.nab_s |
| 644.nab_s (avg) |
| 644.nab_s (avg) (percentage) |
| 644.nab_s (max) |
| 644.nab_s (max) (percentage) |
| 648.exchange2_s |
| 648.exchange2_s (avg) |
| 648.exchange2_s (avg) (percentage) |
| 648.exchange2_s (max) |
| 648.exchange2_s (max) (percentage) |
| 649.fotonik3d_s |
| 649.fotonik3d_s (avg) |
| 649.fotonik3d_s (avg) (percentage) |
| 649.fotonik3d_s (max) |
| 649.fotonik3d_s (max) (percentage) |
| 654.roms_s |
| 654.roms_s (avg) |
| 654.roms_s (avg) (percentage) |
| 654.roms_s (max) |
| 654.roms_s (max) (percentage) |
| 657.xz_s |
| 657.xz_s (avg) |
| 657.xz_s (avg) (percentage) |
| 657.xz_s (max) |
| 657.xz_s (max) (percentage) |
Report Time: 0.37s