Fields
| hardware | None |
| os | None |
Parameters
Fields
| Name | Value |
|---|
Parameters
| Name | Value |
|---|---|
| git_binutils | https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=bcd5ead36a141e78dad5baf48a2acf962f83b3fb (+ 31 commits) |
| git_gcc | https://github.com/gcc-mirror/gcc/commit/1bd13193fab77a19da323974aec876f0fc1817ee (+ 41 commits) |
| git_glibc | https://sourceware.org/git/?p=glibc.git;a=commit;h=c4468cd3995b4236ea886901109b194641132b08 (+ 37 commits) |
| git_linux | https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=773e23b4ee1ad9cd0502d3969e2f2598b1ccc6fe (unchanged) |
| test_url | https://ci.linaro.org/job/tcwg_bmk-code_vect-cpu2017fast--gnu-aarch64-master-O3-build/11/ |
Filter
gnu-aarch64-master-O3 test results
| Run | Order | Start Time | Duration |
|---|---|---|---|
| Current | 0011 (3-changed-components) | 2023-04-01T03:54:26 | 0:00:00 |
| Previous | 0010 (4-changed-components) | 2023-03-27T09:41:07 | 0:00:00 |
| Baseline | 0001 (4-changed-components) | 2023-03-02T21:02:50 | 0:00:00 |
Tests Summary
| Status Group | # | # (B) |
|---|---|---|
| Performance Regressions | 5 | 5 |
| Performance Improvements | 94 | 13 |
| Added Tests | 14 | 112 |
| Unchanged Tests | 829 | 812 |
| Total Tests | 942 |
| Performance Regressions - Execution | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 623.xalancbmk_s | 1.50% | 3812.000 | 3869.000 | - | 3.28% | - |
| Performance Regressions - sample variability | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 603.bwaves_s (unexplained diff vs previous) | 85.71% | 14.000 | 26.000 | - | 0.00% | - |
| 603.bwaves_s (unexplained diff vs previous) (percentage) | 81.25% | 0.160 | 0.290 | - | 0.00% | - |
| 623.xalancbmk_s | 1.75% | 57.000 | 58.000 | - | 0.00% | - |
| 623.xalancbmk_s (avg) | 1.75% | 57.000 | 58.000 | - | 0.00% | - |
| Performance Improvements - Execution | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 628.pop2_s | -1.34% | 9991.000 | 9857.000 | - | -1.89% | - |
| Performance Improvements - sample variability | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 619.lbm_s (unexplained diff vs previous) | -91.76% | 437.000 | 36.000 | - | 0.00% | - |
| 619.lbm_s (unexplained diff vs previous) (percentage) | -91.50% | 1.530 | 0.130 | - | 0.00% | - |
| 620.omnetpp_s (unexplained diff vs previous) | -86.05% | 43.000 | 6.000 | - | 0.00% | - |
| 620.omnetpp_s (unexplained diff vs previous) (percentage) | -85.71% | 1.050 | 0.150 | - | 0.00% | - |
| 510.parest_r (unexplained diff vs previous) | -71.88% | 32.000 | 9.000 | - | 0.00% | - |
| 510.parest_r (unexplained diff vs previous) (percentage) | -71.19% | 0.590 | 0.170 | - | 0.00% | - |
| 631.deepsjeng_s (max) (percentage) | -47.48% | 2.380 | 1.250 | - | 0.00% | - |
| 631.deepsjeng_s (max) | -47.31% | 93.000 | 49.000 | - | 0.00% | - |
| 649.fotonik3d_s | -38.05% | 205.000 | 127.000 | - | 0.00% | - |
| 649.fotonik3d_s (avg) | -38.05% | 205.000 | 127.000 | - | 0.00% | - |
| 649.fotonik3d_s (avg) (percentage) | -37.62% | 2.100 | 1.310 | - | 0.00% | - |
| 641.leela_s | -27.59% | 58.000 | 42.000 | - | 0.00% | - |
| 641.leela_s (avg) | -27.59% | 58.000 | 42.000 | - | 0.00% | - |
| 641.leela_s (avg) (percentage) | -27.27% | 1.430 | 1.040 | - | 0.00% | - |
| 625.x264_s (avg) (percentage) | -25.94% | 3.470 | 2.570 | - | 0.00% | - |
| 625.x264_s | -25.93% | 54.000 | 40.000 | - | 0.00% | - |
| 625.x264_s (avg) | -25.93% | 54.000 | 40.000 | - | 0.00% | - |
| 648.exchange2_s (unexplained diff vs previous) | -25.00% | 12.000 | 9.000 | - | 0.00% | - |
| 657.xz_s (unexplained diff vs previous) | -25.00% | 4.000 | 3.000 | - | 0.00% | - |
| 648.exchange2_s (unexplained diff vs previous) (percentage) | -24.71% | 0.850 | 0.640 | - | 0.00% | - |
| 605.mcf_s (avg) (percentage) | -23.90% | 6.360 | 4.840 | - | 0.00% | - |
| 605.mcf_s | -23.76% | 425.000 | 324.000 | - | 0.00% | - |
| 605.mcf_s (avg) | -23.76% | 425.000 | 324.000 | - | 0.00% | - |
| 657.xz_s (unexplained diff vs previous) (percentage) | -22.22% | 0.180 | 0.140 | - | 0.00% | - |
| 510.parest_r (avg) (percentage) | -22.14% | 2.800 | 2.180 | - | 0.00% | - |
| 510.parest_r | -21.85% | 151.000 | 118.000 | - | 0.00% | - |
| 510.parest_r (avg) | -21.85% | 151.000 | 118.000 | - | 0.00% | - |
| 644.nab_s (avg) (percentage) | -21.23% | 1.460 | 1.150 | - | 0.00% | - |
| 644.nab_s | -20.95% | 148.000 | 117.000 | - | 0.00% | - |
| 644.nab_s (avg) | -20.95% | 148.000 | 117.000 | - | 0.00% | - |
| 619.lbm_s | -19.89% | 4157.000 | 3330.000 | - | 0.00% | - |
| 619.lbm_s (avg) | -19.89% | 4157.000 | 3330.000 | - | 0.00% | - |
| 619.lbm_s (avg) (percentage) | -19.81% | 14.590 | 11.700 | - | 0.00% | - |
| 620.omnetpp_s | -19.51% | 246.000 | 198.000 | - | 0.00% | - |
| 620.omnetpp_s (avg) | -19.51% | 246.000 | 198.000 | - | 0.00% | - |
| 620.omnetpp_s (avg) (percentage) | -19.47% | 6.010 | 4.840 | - | 0.00% | - |
| 657.xz_s (avg) (percentage) | -19.46% | 6.320 | 5.090 | - | 0.00% | - |
| 603.bwaves_s | -19.44% | 504.000 | 406.000 | - | 0.00% | - |
| 603.bwaves_s (avg) | -19.44% | 504.000 | 406.000 | - | 0.00% | - |
| 657.xz_s | -19.42% | 139.000 | 112.000 | - | 0.00% | - |
| 657.xz_s (avg) | -19.42% | 139.000 | 112.000 | - | 0.00% | - |
| 603.bwaves_s (avg) (percentage) | -19.11% | 5.600 | 4.530 | - | 0.00% | - |
| 644.nab_s (max) (percentage) | -10.86% | 2.210 | 1.970 | - | 0.00% | - |
| 648.exchange2_s (avg) (percentage) | -10.71% | 1.120 | 1.000 | - | 0.00% | - |
| 644.nab_s (max) | -10.67% | 225.000 | 201.000 | - | 0.00% | - |
| 623.xalancbmk_s (max) (percentage) | -10.39% | 2.310 | 2.070 | - | 0.00% | - |
| 641.leela_s (max) | -10.34% | 116.000 | 104.000 | - | 0.00% | - |
| 641.leela_s (max) (percentage) | -10.21% | 2.840 | 2.550 | - | 0.00% | - |
| 623.xalancbmk_s (max) | -9.09% | 88.000 | 80.000 | - | 0.00% | - |
| 619.lbm_s (max) | -6.79% | 7380.000 | 6879.000 | - | 0.00% | - |
| 625.x264_s (max) | -6.76% | 74.000 | 69.000 | - | 0.00% | - |
| 620.omnetpp_s (max) | -6.74% | 475.000 | 443.000 | - | 0.00% | - |
| 619.lbm_s (max) (percentage) | -6.68% | 25.900 | 24.170 | - | 0.00% | - |
| 648.exchange2_s | -6.67% | 15.000 | 14.000 | - | 0.00% | - |
| 648.exchange2_s (avg) | -6.67% | 15.000 | 14.000 | - | 0.00% | - |
| 657.xz_s (max) (percentage) | -6.67% | 11.700 | 10.920 | - | 0.00% | - |
| 657.xz_s (max) | -6.61% | 257.000 | 240.000 | - | 0.00% | - |
| 625.x264_s (max) (percentage) | -6.53% | 4.750 | 4.440 | - | 0.00% | - |
| 510.parest_r (max) | -6.51% | 307.000 | 287.000 | - | 0.00% | - |
| 510.parest_r (max) (percentage) | -6.51% | 5.680 | 5.310 | - | 0.00% | - |
| 620.omnetpp_s (max) (percentage) | -6.48% | 11.580 | 10.830 | - | 0.00% | - |
| 628.pop2_s (max) | -6.14% | 554.000 | 520.000 | - | 0.00% | - |
| 603.bwaves_s (max) | -5.99% | 1001.000 | 941.000 | - | 0.00% | - |
| 605.mcf_s (max) (percentage) | -5.75% | 10.600 | 9.990 | - | 0.00% | - |
| 603.bwaves_s (max) (percentage) | -5.67% | 11.120 | 10.490 | - | 0.00% | - |
| 605.mcf_s (max) | -5.64% | 709.000 | 669.000 | - | 0.00% | - |
| 508.namd_r (max) | -5.48% | 73.000 | 69.000 | - | 0.00% | - |
| 648.exchange2_s (max) (percentage) | -5.44% | 1.470 | 1.390 | - | 0.00% | - |
| 648.exchange2_s (max) | -5.00% | 20.000 | 19.000 | - | 0.00% | - |
| 508.namd_r (max) (percentage) | -4.89% | 3.070 | 2.920 | - | 0.00% | - |
| 628.pop2_s (max) (percentage) | -4.86% | 5.550 | 5.280 | - | 0.00% | - |
| 638.imagick_s (max) (percentage) | -4.81% | 7.700 | 7.330 | - | 0.00% | - |
| 631.deepsjeng_s (avg) (percentage) | -4.72% | 1.060 | 1.010 | - | 0.00% | - |
| 638.imagick_s (max) | -4.69% | 256.000 | 244.000 | - | 0.00% | - |
| 526.blender_r (max) (percentage) | -4.68% | 2.350 | 2.240 | - | 0.00% | - |
| 526.blender_r (max) | -4.31% | 232.000 | 222.000 | - | 0.00% | - |
| 600.perlbench_s | -4.00% | 25.000 | 24.000 | - | 0.00% | - |
| 600.perlbench_s (avg) | -4.00% | 25.000 | 24.000 | - | 0.00% | - |
| 654.roms_s (max) (percentage) | -2.64% | 11.350 | 11.050 | - | 0.00% | - |
| 511.povray_r (max) (percentage) | -2.46% | 1.220 | 1.190 | - | 0.00% | - |
| 631.deepsjeng_s | -2.44% | 41.000 | 40.000 | - | 0.00% | - |
| 631.deepsjeng_s (avg) | -2.44% | 41.000 | 40.000 | - | 0.00% | - |
| 600.perlbench_s (max) (percentage) | -2.28% | 2.190 | 2.140 | - | 0.00% | - |
| 600.perlbench_s (max) | -2.22% | 45.000 | 44.000 | - | 0.00% | - |
| 607.cactuBSSN_s (max) | -2.22% | 90.000 | 88.000 | - | 0.00% | - |
| 654.roms_s (max) | -2.01% | 2637.000 | 2584.000 | - | 0.00% | - |
| 628.pop2_s | -1.33% | 602.000 | 594.000 | - | 0.00% | - |
| 628.pop2_s (avg) | -1.33% | 602.000 | 594.000 | - | 0.00% | - |
| 649.fotonik3d_s (max) | -1.31% | 535.000 | 528.000 | - | 0.00% | - |
| 621.wrf_s (max) (percentage) | -1.30% | 5.400 | 5.330 | - | 0.00% | - |
| 621.wrf_s (max) | -1.16% | 346.000 | 342.000 | - | 0.00% | - |
| 649.fotonik3d_s (max) (percentage) | -1.09% | 5.480 | 5.420 | - | 0.00% | - |
| 607.cactuBSSN_s (max) (percentage) | -1.08% | 1.850 | 1.830 | - | 0.00% | - |
| Added Tests - sample variability |
|---|
| 605.mcf_s (unexplained diff vs previous) |
| 605.mcf_s (unexplained diff vs previous) (percentage) |
| 623.xalancbmk_s (unexplained diff vs previous) |
| 623.xalancbmk_s (unexplained diff vs previous) (percentage) |
| 625.x264_s (unexplained diff vs previous) |
| 625.x264_s (unexplained diff vs previous) (percentage) |
| 631.deepsjeng_s (unexplained diff vs previous) |
| 631.deepsjeng_s (unexplained diff vs previous) (percentage) |
| 641.leela_s (unexplained diff vs previous) |
| 641.leela_s (unexplained diff vs previous) (percentage) |
| 644.nab_s (unexplained diff vs previous) |
| 644.nab_s (unexplained diff vs previous) (percentage) |
| 649.fotonik3d_s (unexplained diff vs previous) |
| 649.fotonik3d_s (unexplained diff vs previous) (percentage) |
| Performance Regressions - Code Size | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 644.nab_s | 1.49% | 218975.000 | 222239.000 | - | 0.00% | - |
| 649.fotonik3d_s | 1.25% | 353975.000 | 358415.000 | - | 0.00% | - |
| Performance Regressions - Execution | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 623.xalancbmk_s | 3.28% | 3746.000 | 3869.000 | - | 1.50% | - |
| 605.mcf_s | 1.16% | 6626.000 | 6703.000 | - | 0.10% | - |
| 648.exchange2_s | 1.15% | 1392.000 | 1408.000 | - | -0.64% | - |
| Performance Improvements - Code Size | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 508.namd_r | -1.73% | 738062.000 | 725302.000 | - | 0.00% | - |
| 620.omnetpp_s | -1.48% | 2248766.000 | 2215399.000 | - | 0.00% | - |
| Performance Improvements - Execution | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 619.lbm_s | -8.28% | 31031.000 | 28462.000 | - | -0.13% | - |
| 625.x264_s | -4.42% | 1629.000 | 1557.000 | - | -0.06% | - |
| 657.xz_s | -3.71% | 2290.000 | 2205.000 | - | 0.14% | - |
| 654.roms_s | -3.38% | 24211.000 | 23393.000 | - | 0.66% | - |
| 649.fotonik3d_s | -3.30% | 10076.000 | 9743.000 | - | -0.25% | - |
| 621.wrf_s | -2.39% | 6581.000 | 6424.000 | - | 0.02% | - |
| 511.povray_r | -2.17% | 414.000 | 405.000 | - | 0.25% | - |
| 628.pop2_s | -1.89% | 10047.000 | 9857.000 | - | -1.34% | - |
| 620.omnetpp_s | -1.18% | 4146.000 | 4097.000 | - | -0.15% | - |
| 638.imagick_s | -1.04% | 3367.000 | 3332.000 | - | -0.06% | - |
| Performance Improvements - Score | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| nb_execution_successful | 4.55% | 22.000 | 23.000 | - | 0.00% | - |
| Added Tests - Code Size |
|---|
| 600.perlbench_s |
| Added Tests - Execution |
|---|
| 600.perlbench_s |
| Added Tests - sample variability |
|---|
| 508.namd_r |
| 508.namd_r (avg) |
| 508.namd_r (avg) (percentage) |
| 508.namd_r (max) |
| 508.namd_r (max) (percentage) |
| 510.parest_r |
| 510.parest_r (avg) |
| 510.parest_r (avg) (percentage) |
| 510.parest_r (max) |
| 510.parest_r (max) (percentage) |
| 511.povray_r |
| 511.povray_r (avg) |
| 511.povray_r (avg) (percentage) |
| 511.povray_r (max) |
| 511.povray_r (max) (percentage) |
| 526.blender_r |
| 526.blender_r (avg) |
| 526.blender_r (avg) (percentage) |
| 526.blender_r (max) |
| 526.blender_r (max) (percentage) |
| 600.perlbench_s |
| 600.perlbench_s (avg) |
| 600.perlbench_s (avg) (percentage) |
| 600.perlbench_s (max) |
| 600.perlbench_s (max) (percentage) |
| 603.bwaves_s |
| 603.bwaves_s (avg) |
| 603.bwaves_s (avg) (percentage) |
| 603.bwaves_s (max) |
| 603.bwaves_s (max) (percentage) |
| 605.mcf_s |
| 605.mcf_s (avg) |
| 605.mcf_s (avg) (percentage) |
| 605.mcf_s (max) |
| 605.mcf_s (max) (percentage) |
| 607.cactuBSSN_s |
| 607.cactuBSSN_s (avg) |
| 607.cactuBSSN_s (avg) (percentage) |
| 607.cactuBSSN_s (max) |
| 607.cactuBSSN_s (max) (percentage) |
| 619.lbm_s |
| 619.lbm_s (avg) |
| 619.lbm_s (avg) (percentage) |
| 619.lbm_s (max) |
| 619.lbm_s (max) (percentage) |
| 620.omnetpp_s |
| 620.omnetpp_s (avg) |
| 620.omnetpp_s (avg) (percentage) |
| 620.omnetpp_s (max) |
| 620.omnetpp_s (max) (percentage) |
| 621.wrf_s |
| 621.wrf_s (avg) |
| 621.wrf_s (avg) (percentage) |
| 621.wrf_s (max) |
| 621.wrf_s (max) (percentage) |
| 623.xalancbmk_s |
| 623.xalancbmk_s (avg) |
| 623.xalancbmk_s (avg) (percentage) |
| 623.xalancbmk_s (max) |
| 623.xalancbmk_s (max) (percentage) |
| 625.x264_s |
| 625.x264_s (avg) |
| 625.x264_s (avg) (percentage) |
| 625.x264_s (max) |
| 625.x264_s (max) (percentage) |
| 628.pop2_s |
| 628.pop2_s (avg) |
| 628.pop2_s (avg) (percentage) |
| 628.pop2_s (max) |
| 628.pop2_s (max) (percentage) |
| 631.deepsjeng_s |
| 631.deepsjeng_s (avg) |
| 631.deepsjeng_s (avg) (percentage) |
| 631.deepsjeng_s (max) |
| 631.deepsjeng_s (max) (percentage) |
| 638.imagick_s |
| 638.imagick_s (avg) |
| 638.imagick_s (avg) (percentage) |
| 638.imagick_s (max) |
| 638.imagick_s (max) (percentage) |
| 641.leela_s |
| 641.leela_s (avg) |
| 641.leela_s (avg) (percentage) |
| 641.leela_s (max) |
| 641.leela_s (max) (percentage) |
| 644.nab_s |
| 644.nab_s (avg) |
| 644.nab_s (avg) (percentage) |
| 644.nab_s (max) |
| 644.nab_s (max) (percentage) |
| 648.exchange2_s |
| 648.exchange2_s (avg) |
| 648.exchange2_s (avg) (percentage) |
| 648.exchange2_s (max) |
| 648.exchange2_s (max) (percentage) |
| 649.fotonik3d_s |
| 649.fotonik3d_s (avg) |
| 649.fotonik3d_s (avg) (percentage) |
| 649.fotonik3d_s (max) |
| 649.fotonik3d_s (max) (percentage) |
| 654.roms_s |
| 654.roms_s (avg) |
| 654.roms_s (avg) (percentage) |
| 654.roms_s (max) |
| 654.roms_s (max) (percentage) |
| 657.xz_s |
| 657.xz_s (avg) |
| 657.xz_s (avg) (percentage) |
| 657.xz_s (max) |
| 657.xz_s (max) (percentage) |
Report Time: 0.36s