Fields
| hardware | None |
| os | None |
Parameters
Fields
| Name | Value |
|---|
Parameters
| Name | Value |
|---|---|
| git_binutils | https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=ddc6677b170be399dfcc7d81325870ff022ba875 (+ 44 commits) |
| git_gcc | https://github.com/gcc-mirror/gcc/commit/d9922e4bb5d8014ff3e4057442bbd6d2ed58cc36 (+ 61 commits) |
| git_glibc | https://sourceware.org/git/?p=glibc.git;a=commit;h=e78c4c49831d0ca6253ff5ce5b956cdc4189c8a9 (+ 3 commits) |
| git_linux | https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=ba54dc23ed6a5006f509222036dde9525e32b8cd (+ 1216 commits) |
| test_url | https://ci.linaro.org/job/tcwg_bmk-code_vect-cpu2017fast--gnu-aarch64-master-O3-build/4/ |
Filter
gnu-aarch64-master-O3 test results
| Run | Order | Start Time | Duration |
|---|---|---|---|
| Current | 0004 (4-changed-components) | 2023-03-09T03:14:17 | 0:00:00 |
| Previous | 0003 (3-changed-components) | 2023-03-06T13:54:16 | 0:00:00 |
| Baseline | 0001 (4-changed-components) | 2023-03-02T21:02:50 | 0:00:00 |
Tests Summary
| Status Group | # | # (B) |
|---|---|---|
| Performance Regressions | 13 | 2 |
| Performance Improvements | 118 | 10 |
| Added Tests | 0 | 112 |
| Unchanged Tests | 823 | 830 |
| Total Tests | 954 |
| Performance Regressions - Execution | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 644.nab_s | 2.37% | 10059.000 | 10297.000 | - | 1.77% | - |
| Performance Regressions - sample variability | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 619.lbm_s (unexplained diff vs previous) (percentage) | 249.01% | 10.120 | 35.320 | - | 0.00% | - |
| 619.lbm_s (unexplained diff vs previous) | 157.89% | 3902.000 | 10063.000 | - | 0.00% | - |
| 510.parest_r (unexplained diff vs previous) (percentage) | 92.64% | 2.580 | 4.970 | - | 0.00% | - |
| 510.parest_r (unexplained diff vs previous) | 83.56% | 146.000 | 268.000 | - | 0.00% | - |
| 619.lbm_s (avg) (percentage) | 20.92% | 18.400 | 22.250 | - | 0.00% | - |
| 657.xz_s (unexplained diff vs previous) (percentage) | 13.72% | 6.050 | 6.880 | - | 0.00% | - |
| 510.parest_r (avg) (percentage) | 6.43% | 4.200 | 4.470 | - | 0.00% | - |
| 657.xz_s (unexplained diff vs previous) | 6.34% | 142.000 | 151.000 | - | 0.00% | - |
| 644.nab_s | 2.78% | 72.000 | 74.000 | - | 0.00% | - |
| 644.nab_s (avg) | 2.78% | 72.000 | 74.000 | - | 0.00% | - |
| 510.parest_r | 1.69% | 237.000 | 241.000 | - | 0.00% | - |
| 510.parest_r (avg) | 1.69% | 237.000 | 241.000 | - | 0.00% | - |
| Performance Improvements - Execution | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 654.roms_s | -26.56% | 32085.000 | 23563.000 | - | -2.68% | - |
| 619.lbm_s | -26.10% | 38550.000 | 28487.000 | - | -8.20% | - |
| 649.fotonik3d_s | -6.65% | 10416.000 | 9723.000 | - | -3.50% | - |
| 600.perlbench_s | -6.47% | 2225.000 | 2081.000 | - | 0.00% | - |
| 657.xz_s | -6.43% | 2347.000 | 2196.000 | - | -4.10% | - |
| 625.x264_s | -5.18% | 1641.000 | 1556.000 | - | -4.48% | - |
| 602.gcc_s | -5.03% | 4431.000 | 4208.000 | - | 0.14% | - |
| 510.parest_r | -4.73% | 5664.000 | 5396.000 | - | -0.07% | - |
| 621.wrf_s | -3.99% | 6771.000 | 6501.000 | - | -1.22% | - |
| 620.omnetpp_s | -3.75% | 4315.000 | 4153.000 | - | 0.17% | - |
| 603.bwaves_s | -3.45% | 9271.000 | 8951.000 | - | -0.39% | - |
| 628.pop2_s | -2.99% | 10253.000 | 9946.000 | - | -1.01% | - |
| 638.imagick_s | -2.60% | 3421.000 | 3332.000 | - | -1.04% | - |
| 631.deepsjeng_s | -2.44% | 4054.000 | 3955.000 | - | -0.38% | - |
| 605.mcf_s | -1.94% | 6924.000 | 6790.000 | - | 2.48% | - |
| 508.namd_r | -1.85% | 2438.000 | 2393.000 | - | -0.83% | - |
| 623.xalancbmk_s | -1.51% | 3839.000 | 3781.000 | - | 0.93% | - |
| 648.exchange2_s | -1.27% | 1421.000 | 1403.000 | - | 0.79% | - |
| 641.leela_s | -1.22% | 4185.000 | 4134.000 | - | 0.58% | - |
| Performance Improvements - sample variability | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 648.exchange2_s (unexplained diff vs previous) | -41.94% | 31.000 | 18.000 | - | 0.00% | - |
| 648.exchange2_s (unexplained diff vs previous) (percentage) | -41.28% | 2.180 | 1.280 | - | 0.00% | - |
| 654.roms_s (max) | -38.84% | 5804.000 | 3550.000 | - | 0.00% | - |
| 619.lbm_s (max) | -30.14% | 10643.000 | 7435.000 | - | 0.00% | - |
| 648.exchange2_s | -30.00% | 40.000 | 28.000 | - | 0.00% | - |
| 648.exchange2_s (avg) | -30.00% | 40.000 | 28.000 | - | 0.00% | - |
| 648.exchange2_s (avg) (percentage) | -27.97% | 2.860 | 2.060 | - | 0.00% | - |
| 605.mcf_s | -26.59% | 267.000 | 196.000 | - | 0.00% | - |
| 605.mcf_s (avg) | -26.59% | 267.000 | 196.000 | - | 0.00% | - |
| 654.roms_s | -26.55% | 5178.000 | 3803.000 | - | 0.00% | - |
| 654.roms_s (avg) | -26.55% | 5178.000 | 3803.000 | - | 0.00% | - |
| 508.namd_r (unexplained diff vs previous) | -25.00% | 60.000 | 45.000 | - | 0.00% | - |
| 605.mcf_s (avg) (percentage) | -24.87% | 3.860 | 2.900 | - | 0.00% | - |
| 508.namd_r (unexplained diff vs previous) (percentage) | -23.58% | 2.460 | 1.880 | - | 0.00% | - |
| 600.perlbench_s (max) | -23.08% | 78.000 | 60.000 | - | 0.00% | - |
| 623.xalancbmk_s | -20.00% | 90.000 | 72.000 | - | 0.00% | - |
| 623.xalancbmk_s (avg) | -20.00% | 90.000 | 72.000 | - | 0.00% | - |
| 620.omnetpp_s | -19.83% | 242.000 | 194.000 | - | 0.00% | - |
| 620.omnetpp_s (avg) | -19.83% | 242.000 | 194.000 | - | 0.00% | - |
| 625.x264_s (max) | -19.64% | 56.000 | 45.000 | - | 0.00% | - |
| 641.leela_s | -19.23% | 78.000 | 63.000 | - | 0.00% | - |
| 641.leela_s (avg) | -19.23% | 78.000 | 63.000 | - | 0.00% | - |
| 603.bwaves_s | -19.03% | 473.000 | 383.000 | - | 0.00% | - |
| 603.bwaves_s (avg) | -19.03% | 473.000 | 383.000 | - | 0.00% | - |
| 605.mcf_s (unexplained diff vs previous) | -18.29% | 164.000 | 134.000 | - | 0.00% | - |
| 623.xalancbmk_s (avg) (percentage) | -18.22% | 2.360 | 1.930 | - | 0.00% | - |
| 508.namd_r | -17.91% | 67.000 | 55.000 | - | 0.00% | - |
| 508.namd_r (avg) | -17.91% | 67.000 | 55.000 | - | 0.00% | - |
| 641.leela_s (avg) (percentage) | -17.65% | 1.870 | 1.540 | - | 0.00% | - |
| 649.fotonik3d_s (max) | -17.08% | 761.000 | 631.000 | - | 0.00% | - |
| 511.povray_r (max) (percentage) | -16.92% | 1.950 | 1.620 | - | 0.00% | - |
| 605.mcf_s (unexplained diff vs previous) (percentage) | -16.88% | 2.370 | 1.970 | - | 0.00% | - |
| 600.perlbench_s (max) (percentage) | -16.81% | 3.510 | 2.920 | - | 0.00% | - |
| 620.omnetpp_s (avg) (percentage) | -16.70% | 5.630 | 4.690 | - | 0.00% | - |
| 654.roms_s (max) (percentage) | -16.69% | 18.090 | 15.070 | - | 0.00% | - |
| 508.namd_r (avg) (percentage) | -16.61% | 2.770 | 2.310 | - | 0.00% | - |
| 644.nab_s (max) (percentage) | -16.48% | 0.910 | 0.760 | - | 0.00% | - |
| 603.bwaves_s (avg) (percentage) | -16.24% | 5.110 | 4.280 | - | 0.00% | - |
| 603.bwaves_s (unexplained diff vs previous) | -16.23% | 382.000 | 320.000 | - | 0.00% | - |
| 625.x264_s (max) (percentage) | -16.14% | 3.470 | 2.910 | - | 0.00% | - |
| 510.parest_r (max) | -15.22% | 322.000 | 273.000 | - | 0.00% | - |
| 607.cactuBSSN_s (max) | -15.08% | 126.000 | 107.000 | - | 0.00% | - |
| 607.cactuBSSN_s (max) (percentage) | -14.79% | 2.570 | 2.190 | - | 0.00% | - |
| 621.wrf_s (max) | -14.58% | 487.000 | 416.000 | - | 0.00% | - |
| 620.omnetpp_s (max) | -14.44% | 277.000 | 237.000 | - | 0.00% | - |
| 511.povray_r (max) | -14.29% | 7.000 | 6.000 | - | 0.00% | - |
| 644.nab_s (max) | -14.29% | 91.000 | 78.000 | - | 0.00% | - |
| 603.bwaves_s (max) | -13.98% | 515.000 | 443.000 | - | 0.00% | - |
| 628.pop2_s (max) | -13.91% | 539.000 | 464.000 | - | 0.00% | - |
| 638.imagick_s (max) | -13.85% | 130.000 | 112.000 | - | 0.00% | - |
| 620.omnetpp_s (unexplained diff vs previous) | -13.37% | 187.000 | 162.000 | - | 0.00% | - |
| 631.deepsjeng_s (max) | -13.28% | 128.000 | 111.000 | - | 0.00% | - |
| 603.bwaves_s (unexplained diff vs previous) (percentage) | -13.11% | 4.120 | 3.580 | - | 0.00% | - |
| 605.mcf_s (max) | -12.98% | 362.000 | 315.000 | - | 0.00% | - |
| 508.namd_r (max) | -12.50% | 64.000 | 56.000 | - | 0.00% | - |
| 641.leela_s (max) | -12.37% | 97.000 | 85.000 | - | 0.00% | - |
| 526.blender_r (max) | -12.16% | 255.000 | 224.000 | - | 0.00% | - |
| 623.xalancbmk_s (max) | -12.07% | 116.000 | 102.000 | - | 0.00% | - |
| 628.pop2_s (max) (percentage) | -11.22% | 5.260 | 4.670 | - | 0.00% | - |
| 641.leela_s (max) (percentage) | -11.16% | 2.330 | 2.070 | - | 0.00% | - |
| 648.exchange2_s (max) (percentage) | -11.15% | 3.230 | 2.870 | - | 0.00% | - |
| 648.exchange2_s (max) | -11.11% | 45.000 | 40.000 | - | 0.00% | - |
| 621.wrf_s (max) (percentage) | -11.11% | 7.200 | 6.400 | - | 0.00% | - |
| 605.mcf_s (max) (percentage) | -11.09% | 5.230 | 4.650 | - | 0.00% | - |
| 649.fotonik3d_s (max) (percentage) | -11.08% | 7.310 | 6.500 | - | 0.00% | - |
| 510.parest_r (max) (percentage) | -11.07% | 5.690 | 5.060 | - | 0.00% | - |
| 631.deepsjeng_s (max) (percentage) | -11.04% | 3.170 | 2.820 | - | 0.00% | - |
| 620.omnetpp_s (max) (percentage) | -11.02% | 6.440 | 5.730 | - | 0.00% | - |
| 526.blender_r (max) (percentage) | -11.02% | 2.540 | 2.260 | - | 0.00% | - |
| 638.imagick_s (max) (percentage) | -11.02% | 3.810 | 3.390 | - | 0.00% | - |
| 508.namd_r (max) (percentage) | -10.98% | 2.640 | 2.350 | - | 0.00% | - |
| 603.bwaves_s (max) (percentage) | -10.97% | 5.560 | 4.950 | - | 0.00% | - |
| 623.xalancbmk_s (max) (percentage) | -10.86% | 3.040 | 2.710 | - | 0.00% | - |
| 619.lbm_s | -10.64% | 7093.000 | 6338.000 | - | 0.00% | - |
| 619.lbm_s (avg) | -10.64% | 7093.000 | 6338.000 | - | 0.00% | - |
| 620.omnetpp_s (unexplained diff vs previous) (percentage) | -9.93% | 4.330 | 3.900 | - | 0.00% | - |
| 657.xz_s | -8.28% | 157.000 | 144.000 | - | 0.00% | - |
| 657.xz_s (avg) | -8.28% | 157.000 | 144.000 | - | 0.00% | - |
| 657.xz_s (max) | -7.84% | 153.000 | 141.000 | - | 0.00% | - |
| 649.fotonik3d_s | -6.61% | 741.000 | 692.000 | - | 0.00% | - |
| 649.fotonik3d_s (avg) | -6.61% | 741.000 | 692.000 | - | 0.00% | - |
| 600.perlbench_s | -6.41% | 78.000 | 73.000 | - | 0.00% | - |
| 600.perlbench_s (avg) | -6.41% | 78.000 | 73.000 | - | 0.00% | - |
| 619.lbm_s (max) (percentage) | -5.47% | 27.610 | 26.100 | - | 0.00% | - |
| 625.x264_s | -4.92% | 61.000 | 58.000 | - | 0.00% | - |
| 625.x264_s (avg) | -4.92% | 61.000 | 58.000 | - | 0.00% | - |
| 621.wrf_s | -4.06% | 493.000 | 473.000 | - | 0.00% | - |
| 621.wrf_s (avg) | -4.06% | 493.000 | 473.000 | - | 0.00% | - |
| 641.leela_s (unexplained diff vs previous) | -3.77% | 53.000 | 51.000 | - | 0.00% | - |
| 641.leela_s (unexplained diff vs previous) (percentage) | -3.15% | 1.270 | 1.230 | - | 0.00% | - |
| 638.imagick_s | -3.01% | 133.000 | 129.000 | - | 0.00% | - |
| 638.imagick_s (avg) | -3.01% | 133.000 | 129.000 | - | 0.00% | - |
| 628.pop2_s | -2.88% | 555.000 | 539.000 | - | 0.00% | - |
| 628.pop2_s (avg) | -2.88% | 555.000 | 539.000 | - | 0.00% | - |
| 657.xz_s (avg) (percentage) | -1.94% | 6.700 | 6.570 | - | 0.00% | - |
| 631.deepsjeng_s | -1.80% | 111.000 | 109.000 | - | 0.00% | - |
| 631.deepsjeng_s (avg) | -1.80% | 111.000 | 109.000 | - | 0.00% | - |
| 623.xalancbmk_s (unexplained diff vs previous) | -1.69% | 59.000 | 58.000 | - | 0.00% | - |
| 657.xz_s (max) (percentage) | -1.38% | 6.520 | 6.430 | - | 0.00% | - |
| Performance Regressions - Execution | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 605.mcf_s | 2.48% | 6626.000 | 6790.000 | - | -1.94% | - |
| 644.nab_s | 1.77% | 10118.000 | 10297.000 | - | 2.37% | - |
| Performance Improvements - Execution | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 619.lbm_s | -8.20% | 31031.000 | 28487.000 | - | -26.10% | - |
| 625.x264_s | -4.48% | 1629.000 | 1556.000 | - | -5.18% | - |
| 657.xz_s | -4.10% | 2290.000 | 2196.000 | - | -6.43% | - |
| 649.fotonik3d_s | -3.50% | 10076.000 | 9723.000 | - | -6.65% | - |
| 511.povray_r | -3.38% | 414.000 | 400.000 | - | -0.74% | - |
| 654.roms_s | -2.68% | 24211.000 | 23563.000 | - | -26.56% | - |
| 621.wrf_s | -1.22% | 6581.000 | 6501.000 | - | -3.99% | - |
| 638.imagick_s | -1.04% | 3367.000 | 3332.000 | - | -2.60% | - |
| 628.pop2_s | -1.01% | 10047.000 | 9946.000 | - | -2.99% | - |
| Performance Improvements - Score | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| nb_execution_successful | 4.55% | 22.000 | 23.000 | - | 0.00% | - |
| Added Tests - Code Size |
|---|
| 600.perlbench_s |
| Added Tests - Execution |
|---|
| 600.perlbench_s |
| Added Tests - sample variability |
|---|
| 508.namd_r |
| 508.namd_r (avg) |
| 508.namd_r (avg) (percentage) |
| 508.namd_r (max) |
| 508.namd_r (max) (percentage) |
| 510.parest_r |
| 510.parest_r (avg) |
| 510.parest_r (avg) (percentage) |
| 510.parest_r (max) |
| 510.parest_r (max) (percentage) |
| 511.povray_r |
| 511.povray_r (avg) |
| 511.povray_r (avg) (percentage) |
| 511.povray_r (max) |
| 511.povray_r (max) (percentage) |
| 526.blender_r |
| 526.blender_r (avg) |
| 526.blender_r (avg) (percentage) |
| 526.blender_r (max) |
| 526.blender_r (max) (percentage) |
| 600.perlbench_s |
| 600.perlbench_s (avg) |
| 600.perlbench_s (avg) (percentage) |
| 600.perlbench_s (max) |
| 600.perlbench_s (max) (percentage) |
| 603.bwaves_s |
| 603.bwaves_s (avg) |
| 603.bwaves_s (avg) (percentage) |
| 603.bwaves_s (max) |
| 603.bwaves_s (max) (percentage) |
| 605.mcf_s |
| 605.mcf_s (avg) |
| 605.mcf_s (avg) (percentage) |
| 605.mcf_s (max) |
| 605.mcf_s (max) (percentage) |
| 607.cactuBSSN_s |
| 607.cactuBSSN_s (avg) |
| 607.cactuBSSN_s (avg) (percentage) |
| 607.cactuBSSN_s (max) |
| 607.cactuBSSN_s (max) (percentage) |
| 619.lbm_s |
| 619.lbm_s (avg) |
| 619.lbm_s (avg) (percentage) |
| 619.lbm_s (max) |
| 619.lbm_s (max) (percentage) |
| 620.omnetpp_s |
| 620.omnetpp_s (avg) |
| 620.omnetpp_s (avg) (percentage) |
| 620.omnetpp_s (max) |
| 620.omnetpp_s (max) (percentage) |
| 621.wrf_s |
| 621.wrf_s (avg) |
| 621.wrf_s (avg) (percentage) |
| 621.wrf_s (max) |
| 621.wrf_s (max) (percentage) |
| 623.xalancbmk_s |
| 623.xalancbmk_s (avg) |
| 623.xalancbmk_s (avg) (percentage) |
| 623.xalancbmk_s (max) |
| 623.xalancbmk_s (max) (percentage) |
| 625.x264_s |
| 625.x264_s (avg) |
| 625.x264_s (avg) (percentage) |
| 625.x264_s (max) |
| 625.x264_s (max) (percentage) |
| 628.pop2_s |
| 628.pop2_s (avg) |
| 628.pop2_s (avg) (percentage) |
| 628.pop2_s (max) |
| 628.pop2_s (max) (percentage) |
| 631.deepsjeng_s |
| 631.deepsjeng_s (avg) |
| 631.deepsjeng_s (avg) (percentage) |
| 631.deepsjeng_s (max) |
| 631.deepsjeng_s (max) (percentage) |
| 638.imagick_s |
| 638.imagick_s (avg) |
| 638.imagick_s (avg) (percentage) |
| 638.imagick_s (max) |
| 638.imagick_s (max) (percentage) |
| 641.leela_s |
| 641.leela_s (avg) |
| 641.leela_s (avg) (percentage) |
| 641.leela_s (max) |
| 641.leela_s (max) (percentage) |
| 644.nab_s |
| 644.nab_s (avg) |
| 644.nab_s (avg) (percentage) |
| 644.nab_s (max) |
| 644.nab_s (max) (percentage) |
| 648.exchange2_s |
| 648.exchange2_s (avg) |
| 648.exchange2_s (avg) (percentage) |
| 648.exchange2_s (max) |
| 648.exchange2_s (max) (percentage) |
| 649.fotonik3d_s |
| 649.fotonik3d_s (avg) |
| 649.fotonik3d_s (avg) (percentage) |
| 649.fotonik3d_s (max) |
| 649.fotonik3d_s (max) (percentage) |
| 654.roms_s |
| 654.roms_s (avg) |
| 654.roms_s (avg) (percentage) |
| 654.roms_s (max) |
| 654.roms_s (max) (percentage) |
| 657.xz_s |
| 657.xz_s (avg) |
| 657.xz_s (avg) (percentage) |
| 657.xz_s (max) |
| 657.xz_s (max) (percentage) |
Report Time: 0.37s