Fields
| hardware | None |
| os | None |
Parameters
Fields
| Name | Value |
|---|
Parameters
| Name | Value |
|---|---|
| git_llvm | https://github.com/llvm/llvm-project/commit/f9fe6032cd6fd0814a15dfddf3116494ffa46ac7 (+ 147 commits) |
| test_url | https://ci.linaro.org/job/tcwg_bmk-fujitsu_speed-cpu2017speed--llvm-aarch64-master-O3-build/134/ |
Filter
llvm-aarch64-master-O3 test results
| Run | Order | Start Time | Duration |
|---|---|---|---|
| Current | 0134 (llvmorg-18-init-04874-gf9fe6032cd6f) | 2023-09-06T17:47:50 | 0:00:00 |
| Previous | 0133 (llvmorg-18-init-04727-gec70337d136a) | 2023-09-05T16:12:29 | 0:00:00 |
| Baseline | 0001 (llvmorg-17-init-03218-g58de24ebbb35) | 2023-02-25T18:39:57 | 0:00:00 |
Tests Summary
| Status Group | # | # (B) |
|---|---|---|
| Performance Regressions | 29 | 8 |
| Performance Improvements | 26 | 7 |
| Added Tests | 2 | 73 |
| Unchanged Tests | 633 | 602 |
| Total Tests | 690 |
| Performance Regressions - Execution | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 600.perlbench_s | 1.87% | 19921.000 | 20294.000 | - | -0.16% | - |
| Performance Regressions - sample variability | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 605.mcf_s (unexplained diff vs previous) (percentage) | 726.32% | 0.190 | 1.570 | - | 0.00% | - |
| 605.mcf_s (unexplained diff vs previous) | 698.36% | 61.000 | 487.000 | - | 0.00% | - |
| 605.mcf_s (max) (percentage) | 520.00% | 0.250 | 1.550 | - | 0.00% | - |
| 605.mcf_s (max) | 515.38% | 78.000 | 480.000 | - | 0.00% | - |
| 625.x264_s (unexplained diff vs previous) (percentage) | 400.00% | 0.100 | 0.500 | - | 0.00% | - |
| 625.x264_s (unexplained diff vs previous) | 387.50% | 8.000 | 39.000 | - | 0.00% | - |
| 625.x264_s (max) | 216.67% | 12.000 | 38.000 | - | 0.00% | - |
| 625.x264_s (max) (percentage) | 212.50% | 0.160 | 0.500 | - | 0.00% | - |
| 620.omnetpp_s (unexplained diff vs previous) (percentage) | 127.91% | 0.430 | 0.980 | - | 0.00% | - |
| 620.omnetpp_s (unexplained diff vs previous) | 126.58% | 79.000 | 179.000 | - | 0.00% | - |
| 620.omnetpp_s (max) (percentage) | 97.96% | 0.490 | 0.970 | - | 0.00% | - |
| 620.omnetpp_s (max) | 96.67% | 90.000 | 177.000 | - | 0.00% | - |
| 641.leela_s (max) | 32.26% | 31.000 | 41.000 | - | 0.00% | - |
| 641.leela_s (unexplained diff vs previous) | 32.26% | 31.000 | 41.000 | - | 0.00% | - |
| 641.leela_s (max) (percentage) | 31.82% | 0.220 | 0.290 | - | 0.00% | - |
| 641.leela_s (unexplained diff vs previous) (percentage) | 31.82% | 0.220 | 0.290 | - | 0.00% | - |
| 641.leela_s | 8.00% | 25.000 | 27.000 | - | 0.00% | - |
| 641.leela_s (avg) | 8.00% | 25.000 | 27.000 | - | 0.00% | - |
| 641.leela_s (avg) (percentage) | 5.56% | 0.180 | 0.190 | - | 0.00% | - |
| 625.x264_s | 5.56% | 18.000 | 19.000 | - | 0.00% | - |
| 625.x264_s (avg) | 5.56% | 18.000 | 19.000 | - | 0.00% | - |
| 625.x264_s (avg) (percentage) | 4.17% | 0.240 | 0.250 | - | 0.00% | - |
| 605.mcf_s (avg) (percentage) | 3.00% | 1.000 | 1.030 | - | 0.00% | - |
| 600.perlbench_s | 1.49% | 67.000 | 68.000 | - | 0.00% | - |
| 600.perlbench_s (avg) | 1.49% | 67.000 | 68.000 | - | 0.00% | - |
| 605.mcf_s | 1.27% | 315.000 | 319.000 | - | 0.00% | - |
| 605.mcf_s (avg) | 1.27% | 315.000 | 319.000 | - | 0.00% | - |
| 644.nab_s (max) | 1.15% | 174.000 | 176.000 | - | 0.00% | - |
| Performance Improvements - Execution | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 605.mcf_s | -1.55% | 31517.000 | 31030.000 | - | 3.93% | - |
| 623.xalancbmk_s | -1.17% | 19071.000 | 18848.000 | - | -2.52% | - |
| Performance Improvements - sample variability | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 619.lbm_s (unexplained diff vs previous) (percentage) | -52.38% | 0.210 | 0.100 | - | 0.00% | - |
| 619.lbm_s (unexplained diff vs previous) | -51.19% | 84.000 | 41.000 | - | 0.00% | - |
| 638.imagick_s (max) | -16.16% | 99.000 | 83.000 | - | 0.00% | - |
| 623.xalancbmk_s (max) | -10.00% | 20.000 | 18.000 | - | 0.00% | - |
| 619.lbm_s (max) | -9.52% | 84.000 | 76.000 | - | 0.00% | - |
| 619.lbm_s (max) (percentage) | -9.52% | 0.210 | 0.190 | - | 0.00% | - |
| 657.xz_s (max) | -8.39% | 310.000 | 284.000 | - | 0.00% | - |
| 657.xz_s (max) (percentage) | -8.33% | 0.240 | 0.220 | - | 0.00% | - |
| 631.deepsjeng_s (max) (percentage) | -6.06% | 0.660 | 0.620 | - | 0.00% | - |
| 631.deepsjeng_s (max) | -5.95% | 84.000 | 79.000 | - | 0.00% | - |
| 631.deepsjeng_s (avg) (percentage) | -5.38% | 0.930 | 0.880 | - | 0.00% | - |
| 631.deepsjeng_s | -5.08% | 118.000 | 112.000 | - | 0.00% | - |
| 631.deepsjeng_s (avg) | -5.08% | 118.000 | 112.000 | - | 0.00% | - |
| 619.lbm_s | -4.63% | 281.000 | 268.000 | - | 0.00% | - |
| 619.lbm_s (avg) | -4.63% | 281.000 | 268.000 | - | 0.00% | - |
| 600.perlbench_s (max) (percentage) | -4.35% | 0.230 | 0.220 | - | 0.00% | - |
| 619.lbm_s (avg) (percentage) | -4.29% | 0.700 | 0.670 | - | 0.00% | - |
| 620.omnetpp_s | -3.40% | 441.000 | 426.000 | - | 0.00% | - |
| 620.omnetpp_s (avg) | -3.40% | 441.000 | 426.000 | - | 0.00% | - |
| 620.omnetpp_s (avg) (percentage) | -2.51% | 2.390 | 2.330 | - | 0.00% | - |
| 600.perlbench_s (max) | -2.22% | 45.000 | 44.000 | - | 0.00% | - |
| 623.xalancbmk_s | -1.22% | 246.000 | 243.000 | - | 0.00% | - |
| 623.xalancbmk_s (avg) | -1.22% | 246.000 | 243.000 | - | 0.00% | - |
| 602.gcc_s (max) | -1.04% | 676.000 | 669.000 | - | 0.00% | - |
| Added Tests - sample variability |
|---|
| 631.deepsjeng_s (unexplained diff vs previous) |
| 631.deepsjeng_s (unexplained diff vs previous) (percentage) |
| Performance Regressions - Code Size | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 602.gcc_s | 2.70% | 9686310.000 | 9948030.000 | - | 0.01% | - |
| 619.lbm_s | 1.45% | 18491.000 | 18759.000 | - | 0.00% | - |
| Performance Regressions - Execution | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 620.omnetpp_s | 4.38% | 17541.000 | 18309.000 | - | -0.97% | - |
| 605.mcf_s | 3.93% | 29858.000 | 31030.000 | - | -1.55% | - |
| 657.xz_s | 1.93% | 126911.000 | 129364.000 | - | 0.04% | - |
| 641.leela_s | 1.01% | 14129.000 | 14272.000 | - | 0.29% | - |
| Performance Regressions - Score | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| nb_compile_successful | -23.53% | 17.000 | 13.000 | - | 0.00% | - |
| nb_execution_successful | -18.75% | 16.000 | 13.000 | - | 0.00% | - |
| Performance Improvements - Code Size | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 607.cactuBSSN_s | -1.50% | 3909905.000 | 3851066.000 | - | 0.00% | - |
| Performance Improvements - Execution | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 625.x264_s | -6.77% | 8350.000 | 7785.000 | - | 0.50% | - |
| 619.lbm_s | -4.90% | 42215.000 | 40147.000 | - | -0.10% | - |
| 602.gcc_s | -4.47% | 22619.000 | 21607.000 | - | -0.35% | - |
| 631.deepsjeng_s | -3.87% | 13255.000 | 12742.000 | - | -0.18% | - |
| 623.xalancbmk_s | -2.52% | 19336.000 | 18848.000 | - | -1.17% | - |
| 638.imagick_s | -1.23% | 168091.000 | 166024.000 | - | -0.21% | - |
| Added Tests - sample variability |
|---|
| 600.perlbench_s |
| 600.perlbench_s (avg) |
| 600.perlbench_s (avg) (percentage) |
| 600.perlbench_s (max) |
| 600.perlbench_s (max) (percentage) |
| 602.gcc_s |
| 602.gcc_s (avg) |
| 602.gcc_s (avg) (percentage) |
| 602.gcc_s (max) |
| 602.gcc_s (max) (percentage) |
| 603.bwaves_s (avg) (percentage) |
| 603.bwaves_s (max) (percentage) |
| 605.mcf_s |
| 605.mcf_s (avg) |
| 605.mcf_s (avg) (percentage) |
| 605.mcf_s (max) |
| 605.mcf_s (max) (percentage) |
| 607.cactuBSSN_s |
| 607.cactuBSSN_s (avg) |
| 607.cactuBSSN_s (avg) (percentage) |
| 607.cactuBSSN_s (max) |
| 607.cactuBSSN_s (max) (percentage) |
| 619.lbm_s |
| 619.lbm_s (avg) |
| 619.lbm_s (avg) (percentage) |
| 619.lbm_s (max) |
| 619.lbm_s (max) (percentage) |
| 620.omnetpp_s |
| 620.omnetpp_s (avg) |
| 620.omnetpp_s (avg) (percentage) |
| 620.omnetpp_s (max) |
| 620.omnetpp_s (max) (percentage) |
| 621.wrf_s (avg) (percentage) |
| 621.wrf_s (max) (percentage) |
| 623.xalancbmk_s |
| 623.xalancbmk_s (avg) |
| 623.xalancbmk_s (avg) (percentage) |
| 623.xalancbmk_s (max) |
| 623.xalancbmk_s (max) (percentage) |
| 625.x264_s |
| 625.x264_s (avg) |
| 625.x264_s (avg) (percentage) |
| 625.x264_s (max) |
| 625.x264_s (max) (percentage) |
| 631.deepsjeng_s |
| 631.deepsjeng_s (avg) |
| 631.deepsjeng_s (avg) (percentage) |
| 631.deepsjeng_s (max) |
| 631.deepsjeng_s (max) (percentage) |
| 638.imagick_s |
| 638.imagick_s (avg) |
| 638.imagick_s (avg) (percentage) |
| 638.imagick_s (max) |
| 638.imagick_s (max) (percentage) |
| 641.leela_s |
| 641.leela_s (avg) |
| 641.leela_s (avg) (percentage) |
| 641.leela_s (max) |
| 641.leela_s (max) (percentage) |
| 644.nab_s |
| 644.nab_s (avg) |
| 644.nab_s (avg) (percentage) |
| 644.nab_s (max) |
| 644.nab_s (max) (percentage) |
| 648.exchange2_s (avg) (percentage) |
| 648.exchange2_s (max) (percentage) |
| 654.roms_s (avg) (percentage) |
| 654.roms_s (max) (percentage) |
| 657.xz_s |
| 657.xz_s (avg) |
| 657.xz_s (avg) (percentage) |
| 657.xz_s (max) |
| 657.xz_s (max) (percentage) |
Report Time: 0.23s