Fields
| hardware | None |
| os | None |
Parameters
Fields
| Name | Value |
|---|
Parameters
| Name | Value |
|---|---|
| git_llvm | https://github.com/llvm/llvm-project/commit/2c9372e78d7c183ba7f28095cee0e2fb6a074c88 (+ 157 commits) |
| test_url | https://ci.linaro.org/job/tcwg_bmk-fujitsu_speed-cpu2017speed--llvm-aarch64-master-O3-build/121/ |
Filter
llvm-aarch64-master-O3 test results
| Run | Order | Start Time | Duration |
|---|---|---|---|
| Current | 0121 (llvmorg-18-init-03582-g2c9372e78d7c) | 2023-08-25T09:39:53 | 0:00:00 |
| Previous | 0119 (llvmorg-18-init-03425-gb59cf211a096) | 2023-08-24T03:30:55 | 0:00:00 |
| Baseline | 0001 (llvmorg-17-init-03218-g58de24ebbb35) | 2023-02-25T18:39:57 | 0:00:00 |
Tests Summary
| Status Group | # | # (B) |
|---|---|---|
| Performance Regressions | 32 | 6 |
| Performance Improvements | 37 | 10 |
| Added Tests | 2 | 73 |
| Unchanged Tests | 619 | 601 |
| Total Tests | 690 |
| Performance Regressions - Execution | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 631.deepsjeng_s | 1.58% | 12527.000 | 12725.000 | - | -4.00% | - |
| Performance Improvements - Execution | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 623.xalancbmk_s | -3.31% | 19291.000 | 18652.000 | - | -3.54% | - |
| 607.cactuBSSN_s | -2.35% | 91990.000 | 89832.000 | - | 0.79% | - |
| 657.xz_s | -2.14% | 132103.000 | 129273.000 | - | 1.86% | - |
| 620.omnetpp_s | -1.53% | 17057.000 | 16796.000 | - | -4.25% | - |
| Performance Improvements - sample variability | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 619.lbm_s (unexplained diff vs previous) (percentage) | -94.74% | 0.190 | 0.010 | - | 0.00% | - |
| 619.lbm_s (unexplained diff vs previous) | -93.59% | 78.000 | 5.000 | - | 0.00% | - |
| 641.leela_s (unexplained diff vs previous) | -69.44% | 72.000 | 22.000 | - | 0.00% | - |
| 641.leela_s (unexplained diff vs previous) (percentage) | -68.63% | 0.510 | 0.160 | - | 0.00% | - |
| 641.leela_s (max) (percentage) | -25.49% | 0.510 | 0.380 | - | 0.00% | - |
| 641.leela_s (max) | -25.35% | 71.000 | 53.000 | - | 0.00% | - |
| 644.nab_s (max) | -13.08% | 367.000 | 319.000 | - | 0.00% | - |
| 644.nab_s (max) (percentage) | -13.04% | 0.230 | 0.200 | - | 0.00% | - |
| 644.nab_s (unexplained diff vs previous) | -10.58% | 359.000 | 321.000 | - | 0.00% | - |
| 619.lbm_s (max) | -10.53% | 76.000 | 68.000 | - | 0.00% | - |
| 619.lbm_s (max) (percentage) | -10.53% | 0.190 | 0.170 | - | 0.00% | - |
| 607.cactuBSSN_s (max) | -9.11% | 395.000 | 359.000 | - | 0.00% | - |
| 644.nab_s (unexplained diff vs previous) (percentage) | -9.09% | 0.220 | 0.200 | - | 0.00% | - |
| 619.lbm_s | -7.00% | 414.000 | 385.000 | - | 0.00% | - |
| 619.lbm_s (avg) | -7.00% | 414.000 | 385.000 | - | 0.00% | - |
| 607.cactuBSSN_s (max) (percentage) | -6.98% | 0.430 | 0.400 | - | 0.00% | - |
| 619.lbm_s (avg) (percentage) | -6.80% | 1.030 | 0.960 | - | 0.00% | - |
| 605.mcf_s (avg) (percentage) | -6.56% | 1.220 | 1.140 | - | 0.00% | - |
| 605.mcf_s | -6.38% | 376.000 | 352.000 | - | 0.00% | - |
| 605.mcf_s (avg) | -6.38% | 376.000 | 352.000 | - | 0.00% | - |
| 605.mcf_s (max) (percentage) | -6.25% | 0.320 | 0.300 | - | 0.00% | - |
| 605.mcf_s (max) | -6.12% | 98.000 | 92.000 | - | 0.00% | - |
| 620.omnetpp_s | -3.69% | 434.000 | 418.000 | - | 0.00% | - |
| 620.omnetpp_s (avg) | -3.69% | 434.000 | 418.000 | - | 0.00% | - |
| 607.cactuBSSN_s | -2.38% | 588.000 | 574.000 | - | 0.00% | - |
| 607.cactuBSSN_s (avg) | -2.38% | 588.000 | 574.000 | - | 0.00% | - |
| 620.omnetpp_s (avg) (percentage) | -2.35% | 2.550 | 2.490 | - | 0.00% | - |
| 600.perlbench_s (avg) (percentage) | -2.17% | 0.460 | 0.450 | - | 0.00% | - |
| 600.perlbench_s | -2.17% | 92.000 | 90.000 | - | 0.00% | - |
| 600.perlbench_s (avg) | -2.17% | 92.000 | 90.000 | - | 0.00% | - |
| 654.roms_s (max) (percentage) | -1.75% | 1.710 | 1.680 | - | 0.00% | - |
| 600.perlbench_s (max) (percentage) | -1.56% | 0.640 | 0.630 | - | 0.00% | - |
| 600.perlbench_s (max) | -1.56% | 128.000 | 126.000 | - | 0.00% | - |
| Added Tests - sample variability |
|---|
| 638.imagick_s (unexplained diff vs previous) |
| 638.imagick_s (unexplained diff vs previous) (percentage) |
| Performance Regressions - Code Size | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 602.gcc_s | 2.69% | 9686310.000 | 9947178.000 | - | 0.00% | - |
| 619.lbm_s | 1.45% | 18491.000 | 18759.000 | - | 0.00% | - |
| Performance Regressions - Execution | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 605.mcf_s | 3.49% | 29858.000 | 30900.000 | - | 0.23% | - |
| 657.xz_s | 1.86% | 126911.000 | 129273.000 | - | -2.14% | - |
| Performance Regressions - Score | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| nb_compile_successful | -23.53% | 17.000 | 13.000 | - | 0.00% | - |
| nb_execution_successful | -18.75% | 16.000 | 13.000 | - | 0.00% | - |
| Performance Improvements - Code Size | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 607.cactuBSSN_s | -1.51% | 3909905.000 | 3850946.000 | - | 0.00% | - |
| Performance Improvements - Execution | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 625.x264_s | -6.84% | 8350.000 | 7779.000 | - | 0.19% | - |
| 619.lbm_s | -4.79% | 42215.000 | 40193.000 | - | -0.01% | - |
| 620.omnetpp_s | -4.25% | 17541.000 | 16796.000 | - | -1.53% | - |
| 631.deepsjeng_s | -4.00% | 13255.000 | 12725.000 | - | 1.58% | - |
| 602.gcc_s | -3.85% | 22619.000 | 21749.000 | - | -0.03% | - |
| 623.xalancbmk_s | -3.54% | 19336.000 | 18652.000 | - | -3.31% | - |
| 600.perlbench_s | -1.19% | 20326.000 | 20085.000 | - | 0.37% | - |
| 644.nab_s | -1.15% | 161383.000 | 159535.000 | - | -0.20% | - |
| 638.imagick_s | -1.09% | 168091.000 | 166255.000 | - | -0.10% | - |
| Added Tests - sample variability |
|---|
| 600.perlbench_s |
| 600.perlbench_s (avg) |
| 600.perlbench_s (avg) (percentage) |
| 600.perlbench_s (max) |
| 600.perlbench_s (max) (percentage) |
| 602.gcc_s |
| 602.gcc_s (avg) |
| 602.gcc_s (avg) (percentage) |
| 602.gcc_s (max) |
| 602.gcc_s (max) (percentage) |
| 603.bwaves_s (avg) (percentage) |
| 603.bwaves_s (max) (percentage) |
| 605.mcf_s |
| 605.mcf_s (avg) |
| 605.mcf_s (avg) (percentage) |
| 605.mcf_s (max) |
| 605.mcf_s (max) (percentage) |
| 607.cactuBSSN_s |
| 607.cactuBSSN_s (avg) |
| 607.cactuBSSN_s (avg) (percentage) |
| 607.cactuBSSN_s (max) |
| 607.cactuBSSN_s (max) (percentage) |
| 619.lbm_s |
| 619.lbm_s (avg) |
| 619.lbm_s (avg) (percentage) |
| 619.lbm_s (max) |
| 619.lbm_s (max) (percentage) |
| 620.omnetpp_s |
| 620.omnetpp_s (avg) |
| 620.omnetpp_s (avg) (percentage) |
| 620.omnetpp_s (max) |
| 620.omnetpp_s (max) (percentage) |
| 621.wrf_s (avg) (percentage) |
| 621.wrf_s (max) (percentage) |
| 623.xalancbmk_s |
| 623.xalancbmk_s (avg) |
| 623.xalancbmk_s (avg) (percentage) |
| 623.xalancbmk_s (max) |
| 623.xalancbmk_s (max) (percentage) |
| 625.x264_s |
| 625.x264_s (avg) |
| 625.x264_s (avg) (percentage) |
| 625.x264_s (max) |
| 625.x264_s (max) (percentage) |
| 631.deepsjeng_s |
| 631.deepsjeng_s (avg) |
| 631.deepsjeng_s (avg) (percentage) |
| 631.deepsjeng_s (max) |
| 631.deepsjeng_s (max) (percentage) |
| 638.imagick_s |
| 638.imagick_s (avg) |
| 638.imagick_s (avg) (percentage) |
| 638.imagick_s (max) |
| 638.imagick_s (max) (percentage) |
| 641.leela_s |
| 641.leela_s (avg) |
| 641.leela_s (avg) (percentage) |
| 641.leela_s (max) |
| 641.leela_s (max) (percentage) |
| 644.nab_s |
| 644.nab_s (avg) |
| 644.nab_s (avg) (percentage) |
| 644.nab_s (max) |
| 644.nab_s (max) (percentage) |
| 648.exchange2_s (avg) (percentage) |
| 648.exchange2_s (max) (percentage) |
| 654.roms_s (avg) (percentage) |
| 654.roms_s (max) (percentage) |
| 657.xz_s |
| 657.xz_s (avg) |
| 657.xz_s (avg) (percentage) |
| 657.xz_s (max) |
| 657.xz_s (max) (percentage) |
Report Time: 0.22s