Fields
| hardware | None |
| os | None |
Parameters
Fields
| Name | Value |
|---|
Parameters
| Name | Value |
|---|---|
| git_llvm | https://github.com/llvm/llvm-project/commit/b65e0947cade9bd39036a7700b54c1df4ec00756 (+ 480 commits) |
| test_url | https://ci.linaro.org/job/tcwg_bmk-fujitsu_speed-cpu2017speed--llvm-aarch64-master-O3-build/671/ |
Filter
llvm-aarch64-master-O3 test results
| Run | Order | Start Time | Duration |
|---|---|---|---|
| Current | 0671 (llvmorg-21-init-03499-gb65e0947cade) | 2025-02-27T12:27:07 | 0:00:00 |
| Previous | 0670 (no-change) | 2025-02-25T06:27:26 | 0:00:00 |
| Baseline | 0001 (llvmorg-17-init-03218-g58de24ebbb35) | 2023-02-25T18:39:57 | 0:00:00 |
Tests Summary
| Status Group | # | # (B) |
|---|---|---|
| Performance Regressions | 9 | 20 |
| Performance Improvements | 35 | 12 |
| Added Tests | 0 | 103 |
| Unchanged Tests | 766 | 675 |
| Total Tests | 810 |
| Performance Regressions - sample variability | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 625.x264_s (unexplained diff vs previous) (percentage) | 916.67% | 0.060 | 0.610 | - | 0.00% | - |
| 625.x264_s (unexplained diff vs previous) | 900.00% | 5.000 | 50.000 | - | 0.00% | - |
| 619.lbm_s (unexplained diff vs previous) (percentage) | 340.00% | 0.050 | 0.220 | - | 0.00% | - |
| 619.lbm_s (unexplained diff vs previous) | 309.52% | 21.000 | 86.000 | - | 0.00% | - |
| 625.x264_s (avg) (percentage) | 3.85% | 0.260 | 0.270 | - | 0.00% | - |
| 631.deepsjeng_s | 1.03% | 97.000 | 98.000 | - | 0.00% | - |
| 631.deepsjeng_s (avg) | 1.03% | 97.000 | 98.000 | - | 0.00% | - |
| 638.imagick_s | 1.01% | 99.000 | 100.000 | - | 0.00% | - |
| 638.imagick_s (avg) | 1.01% | 99.000 | 100.000 | - | 0.00% | - |
| Performance Improvements - Execution | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 649.fotonik3d_s | -1.79% | 45264.000 | 44455.000 | - | 0.00% | - |
| Performance Improvements - sample variability | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 620.omnetpp_s (unexplained diff vs previous) | -76.07% | 117.000 | 28.000 | - | 0.00% | - |
| 620.omnetpp_s (unexplained diff vs previous) (percentage) | -76.06% | 0.710 | 0.170 | - | 0.00% | - |
| 644.nab_s (max) | -14.38% | 146.000 | 125.000 | - | 0.00% | - |
| 644.nab_s (max) (percentage) | -14.29% | 0.070 | 0.060 | - | 0.00% | - |
| 620.omnetpp_s (max) | -10.23% | 1105.000 | 992.000 | - | 0.00% | - |
| 620.omnetpp_s (max) (percentage) | -10.04% | 6.670 | 6.000 | - | 0.00% | - |
| 603.bwaves_s (max) | -8.10% | 642.000 | 590.000 | - | 0.00% | - |
| 603.bwaves_s (max) (percentage) | -8.00% | 0.250 | 0.230 | - | 0.00% | - |
| 605.mcf_s (max) | -7.37% | 217.000 | 201.000 | - | 0.00% | - |
| 625.x264_s (max) (percentage) | -7.04% | 0.710 | 0.660 | - | 0.00% | - |
| 625.x264_s (max) | -7.02% | 57.000 | 53.000 | - | 0.00% | - |
| 605.mcf_s (max) (percentage) | -6.76% | 0.740 | 0.690 | - | 0.00% | - |
| 649.fotonik3d_s (max) | -6.58% | 1656.000 | 1547.000 | - | 0.00% | - |
| 607.cactuBSSN_s (max) (percentage) | -6.19% | 0.970 | 0.910 | - | 0.00% | - |
| 607.cactuBSSN_s (max) | -6.14% | 929.000 | 872.000 | - | 0.00% | - |
| 657.xz_s (max) | -5.36% | 7535.000 | 7131.000 | - | 0.00% | - |
| 649.fotonik3d_s (max) (percentage) | -4.92% | 3.660 | 3.480 | - | 0.00% | - |
| 657.xz_s (max) (percentage) | -4.86% | 5.760 | 5.480 | - | 0.00% | - |
| 641.leela_s (max) | -4.76% | 21.000 | 20.000 | - | 0.00% | - |
| 602.gcc_s (max) (percentage) | -4.04% | 0.990 | 0.950 | - | 0.00% | - |
| 623.xalancbmk_s (max) (percentage) | -3.86% | 2.590 | 2.490 | - | 0.00% | - |
| 623.xalancbmk_s (max) | -3.77% | 504.000 | 485.000 | - | 0.00% | - |
| 602.gcc_s (max) | -3.74% | 214.000 | 206.000 | - | 0.00% | - |
| 641.leela_s | -3.57% | 28.000 | 27.000 | - | 0.00% | - |
| 641.leela_s (avg) | -3.57% | 28.000 | 27.000 | - | 0.00% | - |
| 631.deepsjeng_s (max) (percentage) | -3.41% | 0.880 | 0.850 | - | 0.00% | - |
| 631.deepsjeng_s (max) | -2.73% | 110.000 | 107.000 | - | 0.00% | - |
| 600.perlbench_s | -2.70% | 37.000 | 36.000 | - | 0.00% | - |
| 600.perlbench_s (avg) | -2.70% | 37.000 | 36.000 | - | 0.00% | - |
| 649.fotonik3d_s | -1.74% | 864.000 | 849.000 | - | 0.00% | - |
| 649.fotonik3d_s (avg) | -1.74% | 864.000 | 849.000 | - | 0.00% | - |
| 620.omnetpp_s | -1.39% | 288.000 | 284.000 | - | 0.00% | - |
| 620.omnetpp_s (avg) | -1.39% | 288.000 | 284.000 | - | 0.00% | - |
| 620.omnetpp_s (avg) (percentage) | -1.15% | 1.740 | 1.720 | - | 0.00% | - |
| Performance Regressions - Code Size | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 607.cactuBSSN_s | 69.22% | 3909905.000 | 6616188.000 | - | -0.00% | - |
| 631.deepsjeng_s | 34.57% | 90832.000 | 122236.000 | - | -0.01% | - |
| 654.roms_s | 33.79% | 3086796.000 | 4129875.000 | - | 0.01% | - |
| 619.lbm_s | 32.60% | 18491.000 | 24519.000 | - | 0.00% | - |
| 648.exchange2_s | 23.20% | 2567097.000 | 3162587.000 | - | 0.02% | - |
| 605.mcf_s | 17.51% | 28401.000 | 33375.000 | - | -0.11% | - |
| 621.wrf_s | 16.46% | 24593974.000 | 28642456.000 | - | 0.01% | - |
| 638.imagick_s | 13.16% | 1914135.000 | 2166083.000 | - | -0.14% | - |
| 625.x264_s | 8.10% | 562344.000 | 607920.000 | - | -0.02% | - |
| 644.nab_s | 7.83% | 210558.000 | 227053.000 | - | -0.01% | - |
| 641.leela_s | 7.76% | 153985.000 | 165927.000 | - | -0.00% | - |
| 657.xz_s | 4.97% | 195635.000 | 205363.000 | - | -0.02% | - |
| 623.xalancbmk_s | 4.14% | 4853229.000 | 5054110.000 | - | -0.03% | - |
| 602.gcc_s | 3.71% | 9686310.000 | 10045690.000 | - | -0.01% | - |
| 600.perlbench_s | 3.27% | 2263585.000 | 2337663.000 | - | 0.01% | - |
| 620.omnetpp_s | 2.47% | 2221518.000 | 2276500.000 | - | -0.00% | - |
| Performance Regressions - Execution | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 648.exchange2_s | 68.18% | 20971.000 | 35269.000 | - | -0.09% | - |
| 644.nab_s | 29.43% | 161383.000 | 208885.000 | - | 0.04% | - |
| 607.cactuBSSN_s | 7.57% | 89127.000 | 95872.000 | - | 0.02% | - |
| 657.xz_s | 2.54% | 126911.000 | 130129.000 | - | -0.53% | - |
| Performance Improvements - Execution | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 654.roms_s | -67.92% | 306683.000 | 98387.000 | - | -0.12% | - |
| 621.wrf_s | -47.74% | 139583.000 | 72949.000 | - | -0.33% | - |
| 620.omnetpp_s | -5.69% | 17541.000 | 16543.000 | - | -0.17% | - |
| 619.lbm_s | -5.57% | 42215.000 | 39862.000 | - | -0.22% | - |
| 631.deepsjeng_s | -4.42% | 13255.000 | 12669.000 | - | 0.92% | - |
| 600.perlbench_s | -4.28% | 20326.000 | 19457.000 | - | -0.41% | - |
| 602.gcc_s | -3.76% | 22619.000 | 21768.000 | - | 0.51% | - |
| 625.x264_s | -2.50% | 8350.000 | 8141.000 | - | 0.62% | - |
| 605.mcf_s | -2.21% | 29858.000 | 29197.000 | - | -0.82% | - |
| 641.leela_s | -1.10% | 14129.000 | 13974.000 | - | -0.19% | - |
| Performance Improvements - Score | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| nb_execution_successful | 25.00% | 16.000 | 20.000 | - | 0.00% | - |
| nb_compile_successful | 17.65% | 17.000 | 20.000 | - | 0.00% | - |
| Added Tests - Code Size |
|---|
| 603.bwaves_s |
| 627.cam4_s |
| 628.pop2_s |
| 649.fotonik3d_s |
| Added Tests - Execution |
|---|
| 603.bwaves_s |
| 627.cam4_s |
| 628.pop2_s |
| 649.fotonik3d_s |
| Added Tests - sample variability |
|---|
| 600.perlbench_s |
| 600.perlbench_s (avg) |
| 600.perlbench_s (avg) (percentage) |
| 600.perlbench_s (max) |
| 600.perlbench_s (max) (percentage) |
| 602.gcc_s |
| 602.gcc_s (avg) |
| 602.gcc_s (avg) (percentage) |
| 602.gcc_s (max) |
| 602.gcc_s (max) (percentage) |
| 603.bwaves_s |
| 603.bwaves_s (avg) |
| 603.bwaves_s (avg) (percentage) |
| 603.bwaves_s (max) |
| 603.bwaves_s (max) (percentage) |
| 605.mcf_s |
| 605.mcf_s (avg) |
| 605.mcf_s (avg) (percentage) |
| 605.mcf_s (max) |
| 605.mcf_s (max) (percentage) |
| 607.cactuBSSN_s |
| 607.cactuBSSN_s (avg) |
| 607.cactuBSSN_s (avg) (percentage) |
| 607.cactuBSSN_s (max) |
| 607.cactuBSSN_s (max) (percentage) |
| 619.lbm_s |
| 619.lbm_s (avg) |
| 619.lbm_s (avg) (percentage) |
| 619.lbm_s (max) |
| 619.lbm_s (max) (percentage) |
| 620.omnetpp_s |
| 620.omnetpp_s (avg) |
| 620.omnetpp_s (avg) (percentage) |
| 620.omnetpp_s (max) |
| 620.omnetpp_s (max) (percentage) |
| 621.wrf_s |
| 621.wrf_s (avg) |
| 621.wrf_s (avg) (percentage) |
| 621.wrf_s (max) |
| 621.wrf_s (max) (percentage) |
| 623.xalancbmk_s |
| 623.xalancbmk_s (avg) |
| 623.xalancbmk_s (avg) (percentage) |
| 623.xalancbmk_s (max) |
| 623.xalancbmk_s (max) (percentage) |
| 625.x264_s |
| 625.x264_s (avg) |
| 625.x264_s (avg) (percentage) |
| 625.x264_s (max) |
| 625.x264_s (max) (percentage) |
| 627.cam4_s |
| 627.cam4_s (avg) |
| 627.cam4_s (avg) (percentage) |
| 627.cam4_s (max) |
| 627.cam4_s (max) (percentage) |
| 631.deepsjeng_s |
| 631.deepsjeng_s (avg) |
| 631.deepsjeng_s (avg) (percentage) |
| 631.deepsjeng_s (max) |
| 631.deepsjeng_s (max) (percentage) |
| 638.imagick_s |
| 638.imagick_s (avg) |
| 638.imagick_s (avg) (percentage) |
| 638.imagick_s (max) |
| 638.imagick_s (max) (percentage) |
| 641.leela_s |
| 641.leela_s (avg) |
| 641.leela_s (avg) (percentage) |
| 641.leela_s (max) |
| 641.leela_s (max) (percentage) |
| 644.nab_s |
| 644.nab_s (avg) |
| 644.nab_s (avg) (percentage) |
| 644.nab_s (max) |
| 644.nab_s (max) (percentage) |
| 648.exchange2_s |
| 648.exchange2_s (avg) |
| 648.exchange2_s (avg) (percentage) |
| 648.exchange2_s (max) |
| 648.exchange2_s (max) (percentage) |
| 649.fotonik3d_s |
| 649.fotonik3d_s (avg) |
| 649.fotonik3d_s (avg) (percentage) |
| 649.fotonik3d_s (max) |
| 649.fotonik3d_s (max) (percentage) |
| 654.roms_s |
| 654.roms_s (avg) |
| 654.roms_s (avg) (percentage) |
| 654.roms_s (max) |
| 654.roms_s (max) (percentage) |
| 657.xz_s |
| 657.xz_s (avg) |
| 657.xz_s (avg) (percentage) |
| 657.xz_s (max) |
| 657.xz_s (max) (percentage) |
Report Time: 0.34s