Fields
| hardware | None |
| os | None |
Parameters
Fields
| Name | Value |
|---|
Parameters
| Name | Value |
|---|---|
| git_binutils | https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=61ced226a4fc2e6df7836cd9c0f7e1ad47af2440 (+ 78 commits) |
| git_gcc | https://github.com/gcc-mirror/gcc/commit/ecd2c373720af214f20671f9e7d760548b51ef4a (+ 1 commits) |
| git_glibc | https://sourceware.org/git/?p=glibc.git;a=commit;h=dc1a77269c971652a8a5167ec366792eae052e65 (+ 20 commits) |
| git_linux | https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=378e271eb0f3f02d1e81bd813ec97c106238613e (+ 61 commits) |
| test_url | https://ci.linaro.org/job/tcwg_bmk-fujitsu_speed-cpu2017speed--gnu-aarch64-master-O3-build/288/ |
Filter
gnu-aarch64-master-O3 test results
| Run | Order | Start Time | Duration |
|---|---|---|---|
| Current | 0288 (4-changed-components) | 2024-03-23T03:18:08 | 0:00:00 |
| Previous | 0287 (basepoints/gcc-14-09649-gbb04a11418f) | 2024-03-20T21:40:52 | 0:00:00 |
| Baseline | 0002 (4-changed-components) | 2023-02-28T02:02:59 | 0:00:00 |
Tests Summary
| Status Group | # | # (B) |
|---|---|---|
| Performance Regressions | 21 | 19 |
| Performance Improvements | 96 | 15 |
| Added Tests | 3 | 98 |
| Unchanged Tests | 726 | 714 |
| Total Tests | 846 |
| Performance Regressions - Execution | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 649.fotonik3d_s | 3.87% | 64511.000 | 67009.000 | - | 8.05% | - |
| 654.roms_s | 2.99% | 115616.000 | 119074.000 | - | -44.48% | - |
| 657.xz_s | 2.96% | 136163.000 | 140197.000 | - | 14.11% | - |
| 623.xalancbmk_s | 1.14% | 18622.000 | 18834.000 | - | 3.71% | - |
| Performance Regressions - sample variability | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 625.x264_s (unexplained diff vs previous) (percentage) | 38.89% | 0.180 | 0.250 | - | 0.00% | - |
| 625.x264_s (unexplained diff vs previous) | 33.33% | 15.000 | 20.000 | - | 0.00% | - |
| 654.roms_s | 9.23% | 1711.000 | 1869.000 | - | 0.00% | - |
| 654.roms_s (avg) | 9.23% | 1711.000 | 1869.000 | - | 0.00% | - |
| 649.fotonik3d_s | 9.07% | 1290.000 | 1407.000 | - | 0.00% | - |
| 649.fotonik3d_s (avg) | 9.07% | 1290.000 | 1407.000 | - | 0.00% | - |
| 654.roms_s (avg) (percentage) | 6.08% | 1.480 | 1.570 | - | 0.00% | - |
| 649.fotonik3d_s (avg) (percentage) | 5.00% | 2.000 | 2.100 | - | 0.00% | - |
| 657.xz_s | 3.79% | 3485.000 | 3617.000 | - | 0.00% | - |
| 657.xz_s (avg) | 3.79% | 3485.000 | 3617.000 | - | 0.00% | - |
| 603.bwaves_s | 2.75% | 1129.000 | 1160.000 | - | 0.00% | - |
| 603.bwaves_s (avg) | 2.75% | 1129.000 | 1160.000 | - | 0.00% | - |
| 628.pop2_s (unexplained diff vs previous) | 2.68% | 112.000 | 115.000 | - | 0.00% | - |
| 607.cactuBSSN_s | 2.16% | 740.000 | 756.000 | - | 0.00% | - |
| 607.cactuBSSN_s (avg) | 2.16% | 740.000 | 756.000 | - | 0.00% | - |
| 603.bwaves_s (avg) (percentage) | 2.08% | 0.480 | 0.490 | - | 0.00% | - |
| 607.cactuBSSN_s (avg) (percentage) | 1.43% | 0.700 | 0.710 | - | 0.00% | - |
| Performance Improvements - Execution | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 605.mcf_s | -1.01% | 29663.000 | 29363.000 | - | 2.57% | - |
| Performance Improvements - sample variability | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 644.nab_s (unexplained diff vs previous) | -98.58% | 141.000 | 2.000 | - | 0.00% | - |
| 621.wrf_s (unexplained diff vs previous) | -98.28% | 290.000 | 5.000 | - | 0.00% | - |
| 621.wrf_s (unexplained diff vs previous) (percentage) | -97.14% | 0.350 | 0.010 | - | 0.00% | - |
| 600.perlbench_s (unexplained diff vs previous) (percentage) | -95.83% | 0.240 | 0.010 | - | 0.00% | - |
| 600.perlbench_s (unexplained diff vs previous) | -95.35% | 43.000 | 2.000 | - | 0.00% | - |
| 648.exchange2_s (unexplained diff vs previous) | -90.91% | 33.000 | 3.000 | - | 0.00% | - |
| 648.exchange2_s (unexplained diff vs previous) (percentage) | -90.70% | 0.430 | 0.040 | - | 0.00% | - |
| 620.omnetpp_s (unexplained diff vs previous) | -85.66% | 286.000 | 41.000 | - | 0.00% | - |
| 620.omnetpp_s (unexplained diff vs previous) (percentage) | -85.41% | 1.850 | 0.270 | - | 0.00% | - |
| 641.leela_s (unexplained diff vs previous) (percentage) | -83.33% | 0.120 | 0.020 | - | 0.00% | - |
| 641.leela_s (unexplained diff vs previous) | -80.00% | 15.000 | 3.000 | - | 0.00% | - |
| 619.lbm_s (unexplained diff vs previous) | -57.14% | 35.000 | 15.000 | - | 0.00% | - |
| 619.lbm_s (unexplained diff vs previous) (percentage) | -55.56% | 0.090 | 0.040 | - | 0.00% | - |
| 602.gcc_s (unexplained diff vs previous) (percentage) | -39.56% | 0.910 | 0.550 | - | 0.00% | - |
| 602.gcc_s (unexplained diff vs previous) | -39.47% | 190.000 | 115.000 | - | 0.00% | - |
| 600.perlbench_s (max) | -38.60% | 57.000 | 35.000 | - | 0.00% | - |
| 600.perlbench_s (max) (percentage) | -37.50% | 0.320 | 0.200 | - | 0.00% | - |
| 631.deepsjeng_s (unexplained diff vs previous) (percentage) | -36.23% | 0.690 | 0.440 | - | 0.00% | - |
| 631.deepsjeng_s (unexplained diff vs previous) | -35.71% | 84.000 | 54.000 | - | 0.00% | - |
| 657.xz_s (unexplained diff vs previous) (percentage) | -32.71% | 4.280 | 2.880 | - | 0.00% | - |
| 603.bwaves_s (unexplained diff vs previous) (percentage) | -31.31% | 0.990 | 0.680 | - | 0.00% | - |
| 603.bwaves_s (unexplained diff vs previous) | -31.05% | 2325.000 | 1603.000 | - | 0.00% | - |
| 657.xz_s (unexplained diff vs previous) | -30.70% | 5821.000 | 4034.000 | - | 0.00% | - |
| 619.lbm_s (max) | -22.22% | 36.000 | 28.000 | - | 0.00% | - |
| 619.lbm_s (max) (percentage) | -22.22% | 0.090 | 0.070 | - | 0.00% | - |
| 621.wrf_s (max) (percentage) | -21.43% | 0.420 | 0.330 | - | 0.00% | - |
| 621.wrf_s (max) | -21.28% | 343.000 | 270.000 | - | 0.00% | - |
| 641.leela_s (max) | -20.00% | 15.000 | 12.000 | - | 0.00% | - |
| 641.leela_s (max) (percentage) | -16.67% | 0.120 | 0.100 | - | 0.00% | - |
| 607.cactuBSSN_s (max) (percentage) | -15.56% | 0.900 | 0.760 | - | 0.00% | - |
| 607.cactuBSSN_s (max) | -14.93% | 951.000 | 809.000 | - | 0.00% | - |
| 644.nab_s (max) | -14.43% | 201.000 | 172.000 | - | 0.00% | - |
| 644.nab_s (max) (percentage) | -14.29% | 0.140 | 0.120 | - | 0.00% | - |
| 607.cactuBSSN_s (unexplained diff vs previous) (percentage) | -13.64% | 0.880 | 0.760 | - | 0.00% | - |
| 607.cactuBSSN_s (unexplained diff vs previous) | -13.53% | 931.000 | 805.000 | - | 0.00% | - |
| 654.roms_s (unexplained diff vs previous) (percentage) | -13.17% | 3.340 | 2.900 | - | 0.00% | - |
| 657.xz_s (max) (percentage) | -12.44% | 4.100 | 3.590 | - | 0.00% | - |
| 605.mcf_s (unexplained diff vs previous) | -12.28% | 342.000 | 300.000 | - | 0.00% | - |
| 605.mcf_s (unexplained diff vs previous) (percentage) | -11.30% | 1.150 | 1.020 | - | 0.00% | - |
| 649.fotonik3d_s (unexplained diff vs previous) (percentage) | -10.77% | 4.180 | 3.730 | - | 0.00% | - |
| 654.roms_s (unexplained diff vs previous) | -10.51% | 3864.000 | 3458.000 | - | 0.00% | - |
| 657.xz_s (max) | -9.84% | 5582.000 | 5033.000 | - | 0.00% | - |
| 605.mcf_s (max) | -8.47% | 590.000 | 540.000 | - | 0.00% | - |
| 620.omnetpp_s (max) | -7.88% | 330.000 | 304.000 | - | 0.00% | - |
| 605.mcf_s (max) (percentage) | -7.54% | 1.990 | 1.840 | - | 0.00% | - |
| 620.omnetpp_s (max) (percentage) | -7.48% | 2.140 | 1.980 | - | 0.00% | - |
| 602.gcc_s (max) | -7.45% | 188.000 | 174.000 | - | 0.00% | - |
| 654.roms_s (max) (percentage) | -7.43% | 3.230 | 2.990 | - | 0.00% | - |
| 649.fotonik3d_s (unexplained diff vs previous) | -7.38% | 2697.000 | 2498.000 | - | 0.00% | - |
| 621.wrf_s (avg) (percentage) | -6.98% | 0.430 | 0.400 | - | 0.00% | - |
| 638.imagick_s (max) | -6.89% | 305.000 | 284.000 | - | 0.00% | - |
| 621.wrf_s | -6.84% | 351.000 | 327.000 | - | 0.00% | - |
| 621.wrf_s (avg) | -6.84% | 351.000 | 327.000 | - | 0.00% | - |
| 648.exchange2_s (max) (percentage) | -6.82% | 0.440 | 0.410 | - | 0.00% | - |
| 602.gcc_s (max) (percentage) | -6.67% | 0.900 | 0.840 | - | 0.00% | - |
| 603.bwaves_s (max) (percentage) | -6.12% | 0.980 | 0.920 | - | 0.00% | - |
| 631.deepsjeng_s (max) (percentage) | -6.10% | 0.820 | 0.770 | - | 0.00% | - |
| 648.exchange2_s (max) | -6.06% | 33.000 | 31.000 | - | 0.00% | - |
| 631.deepsjeng_s (max) | -6.00% | 100.000 | 94.000 | - | 0.00% | - |
| 648.exchange2_s (avg) (percentage) | -5.88% | 0.340 | 0.320 | - | 0.00% | - |
| 623.xalancbmk_s (max) (percentage) | -5.79% | 3.970 | 3.740 | - | 0.00% | - |
| 603.bwaves_s (max) | -5.51% | 2305.000 | 2178.000 | - | 0.00% | - |
| 625.x264_s (max) | -5.41% | 37.000 | 35.000 | - | 0.00% | - |
| 623.xalancbmk_s (max) | -4.74% | 739.000 | 704.000 | - | 0.00% | - |
| 654.roms_s (max) | -4.66% | 3734.000 | 3560.000 | - | 0.00% | - |
| 625.x264_s (max) (percentage) | -4.35% | 0.460 | 0.440 | - | 0.00% | - |
| 600.perlbench_s | -4.17% | 48.000 | 46.000 | - | 0.00% | - |
| 600.perlbench_s (avg) | -4.17% | 48.000 | 46.000 | - | 0.00% | - |
| 648.exchange2_s | -4.00% | 25.000 | 24.000 | - | 0.00% | - |
| 648.exchange2_s (avg) | -4.00% | 25.000 | 24.000 | - | 0.00% | - |
| 600.perlbench_s (avg) (percentage) | -3.70% | 0.270 | 0.260 | - | 0.00% | - |
| 649.fotonik3d_s (max) (percentage) | -3.49% | 4.010 | 3.870 | - | 0.00% | - |
| 619.lbm_s | -3.44% | 262.000 | 253.000 | - | 0.00% | - |
| 619.lbm_s (avg) | -3.44% | 262.000 | 253.000 | - | 0.00% | - |
| 620.omnetpp_s | -3.40% | 294.000 | 284.000 | - | 0.00% | - |
| 620.omnetpp_s (avg) | -3.40% | 294.000 | 284.000 | - | 0.00% | - |
| 620.omnetpp_s (avg) (percentage) | -3.14% | 1.910 | 1.850 | - | 0.00% | - |
| 619.lbm_s (avg) (percentage) | -3.13% | 0.640 | 0.620 | - | 0.00% | - |
| 625.x264_s | -3.03% | 33.000 | 32.000 | - | 0.00% | - |
| 625.x264_s (avg) | -3.03% | 33.000 | 32.000 | - | 0.00% | - |
| 623.xalancbmk_s (avg) (percentage) | -3.01% | 2.660 | 2.580 | - | 0.00% | - |
| 628.pop2_s | -2.79% | 359.000 | 349.000 | - | 0.00% | - |
| 628.pop2_s (avg) | -2.79% | 359.000 | 349.000 | - | 0.00% | - |
| 602.gcc_s | -2.76% | 217.000 | 211.000 | - | 0.00% | - |
| 602.gcc_s (avg) | -2.76% | 217.000 | 211.000 | - | 0.00% | - |
| 628.pop2_s (avg) (percentage) | -2.70% | 0.370 | 0.360 | - | 0.00% | - |
| 638.imagick_s (unexplained diff vs previous) | -2.11% | 142.000 | 139.000 | - | 0.00% | - |
| 623.xalancbmk_s | -2.02% | 495.000 | 485.000 | - | 0.00% | - |
| 623.xalancbmk_s (avg) | -2.02% | 495.000 | 485.000 | - | 0.00% | - |
| 602.gcc_s (avg) (percentage) | -1.92% | 1.040 | 1.020 | - | 0.00% | - |
| 605.mcf_s | -1.85% | 379.000 | 372.000 | - | 0.00% | - |
| 605.mcf_s (avg) | -1.85% | 379.000 | 372.000 | - | 0.00% | - |
| 631.deepsjeng_s (avg) (percentage) | -1.43% | 0.700 | 0.690 | - | 0.00% | - |
| 631.deepsjeng_s | -1.18% | 85.000 | 84.000 | - | 0.00% | - |
| 631.deepsjeng_s (avg) | -1.18% | 85.000 | 84.000 | - | 0.00% | - |
| Added Tests - sample variability |
|---|
| 623.xalancbmk_s (unexplained diff vs previous) |
| 623.xalancbmk_s (unexplained diff vs previous) (percentage) |
| 644.nab_s (unexplained diff vs previous) (percentage) |
| Performance Regressions - Code Size | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 621.wrf_s | 7.28% | 20302811.000 | 21780528.000 | - | 0.00% | - |
| 638.imagick_s | 4.62% | 2221370.000 | 2324014.000 | - | 0.00% | - |
| 654.roms_s | 3.45% | 1075717.000 | 1112841.000 | - | 0.00% | - |
| 648.exchange2_s | 2.88% | 177422.000 | 182538.000 | - | 0.00% | - |
| 607.cactuBSSN_s | 2.55% | 4214065.000 | 4321591.000 | - | 0.00% | - |
| 657.xz_s | 2.39% | 205531.000 | 210451.000 | - | 0.00% | - |
| 623.xalancbmk_s | 2.18% | 5497646.000 | 5617647.000 | - | 0.00% | - |
| 600.perlbench_s | 2.12% | 2404724.000 | 2455799.000 | - | 0.00% | - |
| 603.bwaves_s | 1.88% | 53831.000 | 54843.000 | - | 0.00% | - |
| 602.gcc_s | 1.50% | 10008387.000 | 10158775.000 | - | 0.00% | - |
| 605.mcf_s | 1.24% | 28789.000 | 29145.000 | - | 0.00% | - |
| 625.x264_s | 1.20% | 626778.000 | 634325.000 | - | 0.00% | - |
| Performance Regressions - Execution | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 657.xz_s | 14.11% | 122860.000 | 140197.000 | - | 2.96% | - |
| 649.fotonik3d_s | 8.05% | 62018.000 | 67009.000 | - | 3.87% | - |
| 619.lbm_s | 4.05% | 39335.000 | 40930.000 | - | -0.04% | - |
| 623.xalancbmk_s | 3.71% | 18160.000 | 18834.000 | - | 1.14% | - |
| 605.mcf_s | 2.57% | 28627.000 | 29363.000 | - | -1.01% | - |
| Performance Regressions - Score | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| nb_compile_successful | -5.00% | 20.000 | 19.000 | - | 0.00% | - |
| nb_execution_successful | -5.00% | 20.000 | 19.000 | - | 0.00% | - |
| Performance Improvements - Code Size | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 619.lbm_s | -18.94% | 21250.000 | 17226.000 | - | 0.00% | - |
| 631.deepsjeng_s | -1.80% | 95946.000 | 94218.000 | - | 0.00% | - |
| 620.omnetpp_s | -1.05% | 2247854.000 | 2224352.000 | - | 0.00% | - |
| Performance Improvements - Execution | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 654.roms_s | -44.48% | 214456.000 | 119074.000 | - | 2.99% | - |
| 621.wrf_s | -27.22% | 112446.000 | 81842.000 | - | -0.01% | - |
| 644.nab_s | -10.50% | 160803.000 | 143911.000 | - | -0.00% | - |
| 620.omnetpp_s | -7.23% | 16595.000 | 15396.000 | - | -0.27% | - |
| 641.leela_s | -6.12% | 13731.000 | 12891.000 | - | -0.02% | - |
| 625.x264_s | -5.22% | 8578.000 | 8130.000 | - | 0.25% | - |
| 631.deepsjeng_s | -3.80% | 12764.000 | 12279.000 | - | 0.44% | - |
| 628.pop2_s | -3.75% | 100834.000 | 97052.000 | - | -0.12% | - |
| 602.gcc_s | -2.81% | 21380.000 | 20779.000 | - | -0.55% | - |
| 600.perlbench_s | -1.34% | 18097.000 | 17855.000 | - | 0.01% | - |
| 603.bwaves_s | -1.00% | 239232.000 | 236839.000 | - | 0.68% | - |
| Performance Improvements - Score | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| nb_total_tests | 5.00% | 20.000 | 21.000 | - | 0.00% | - |
| Added Tests - sample variability |
|---|
| 600.perlbench_s |
| 600.perlbench_s (avg) |
| 600.perlbench_s (avg) (percentage) |
| 600.perlbench_s (max) |
| 600.perlbench_s (max) (percentage) |
| 602.gcc_s |
| 602.gcc_s (avg) |
| 602.gcc_s (avg) (percentage) |
| 602.gcc_s (max) |
| 602.gcc_s (max) (percentage) |
| 603.bwaves_s |
| 603.bwaves_s (avg) |
| 603.bwaves_s (avg) (percentage) |
| 603.bwaves_s (max) |
| 603.bwaves_s (max) (percentage) |
| 605.mcf_s |
| 605.mcf_s (avg) |
| 605.mcf_s (avg) (percentage) |
| 605.mcf_s (max) |
| 605.mcf_s (max) (percentage) |
| 607.cactuBSSN_s |
| 607.cactuBSSN_s (avg) |
| 607.cactuBSSN_s (avg) (percentage) |
| 607.cactuBSSN_s (max) |
| 607.cactuBSSN_s (max) (percentage) |
| 619.lbm_s |
| 619.lbm_s (avg) |
| 619.lbm_s (avg) (percentage) |
| 619.lbm_s (max) |
| 619.lbm_s (max) (percentage) |
| 620.omnetpp_s |
| 620.omnetpp_s (avg) |
| 620.omnetpp_s (avg) (percentage) |
| 620.omnetpp_s (max) |
| 620.omnetpp_s (max) (percentage) |
| 621.wrf_s |
| 621.wrf_s (avg) |
| 621.wrf_s (avg) (percentage) |
| 621.wrf_s (max) |
| 621.wrf_s (max) (percentage) |
| 623.xalancbmk_s |
| 623.xalancbmk_s (avg) |
| 623.xalancbmk_s (avg) (percentage) |
| 623.xalancbmk_s (max) |
| 623.xalancbmk_s (max) (percentage) |
| 625.x264_s |
| 625.x264_s (avg) |
| 625.x264_s (avg) (percentage) |
| 625.x264_s (max) |
| 625.x264_s (max) (percentage) |
| 627.cam4_s (avg) (percentage) |
| 627.cam4_s (max) (percentage) |
| 628.pop2_s |
| 628.pop2_s (avg) |
| 628.pop2_s (avg) (percentage) |
| 628.pop2_s (max) |
| 628.pop2_s (max) (percentage) |
| 631.deepsjeng_s |
| 631.deepsjeng_s (avg) |
| 631.deepsjeng_s (avg) (percentage) |
| 631.deepsjeng_s (max) |
| 631.deepsjeng_s (max) (percentage) |
| 638.imagick_s |
| 638.imagick_s (avg) |
| 638.imagick_s (avg) (percentage) |
| 638.imagick_s (max) |
| 638.imagick_s (max) (percentage) |
| 641.leela_s |
| 641.leela_s (avg) |
| 641.leela_s (avg) (percentage) |
| 641.leela_s (max) |
| 641.leela_s (max) (percentage) |
| 644.nab_s |
| 644.nab_s (avg) |
| 644.nab_s (avg) (percentage) |
| 644.nab_s (max) |
| 644.nab_s (max) (percentage) |
| 644.nab_s (unexplained diff vs previous) (percentage) |
| 648.exchange2_s |
| 648.exchange2_s (avg) |
| 648.exchange2_s (avg) (percentage) |
| 648.exchange2_s (max) |
| 648.exchange2_s (max) (percentage) |
| 649.fotonik3d_s |
| 649.fotonik3d_s (avg) |
| 649.fotonik3d_s (avg) (percentage) |
| 649.fotonik3d_s (max) |
| 649.fotonik3d_s (max) (percentage) |
| 654.roms_s |
| 654.roms_s (avg) |
| 654.roms_s (avg) (percentage) |
| 654.roms_s (max) |
| 654.roms_s (max) (percentage) |
| 657.xz_s |
| 657.xz_s (avg) |
| 657.xz_s (avg) (percentage) |
| 657.xz_s (max) |
| 657.xz_s (max) (percentage) |
Report Time: 0.35s