Fields
| hardware | None |
| os | None |
Parameters
Fields
| Name | Value |
|---|
Parameters
| Name | Value |
|---|---|
| git_llvm | https://github.com/llvm/llvm-project/commit/be98d938794fb531db6f04e55775e4096e4c7ab1 |
| test_url | https://ci.linaro.org/job/tcwg_bmk_ci_llvm-build-tcwg_bmk_tk1-llvm-master-arm-spec2k6-O2/365/ |
Filter
llvm-arm-master-O2 test results
| Run | Order | Start Time | Duration |
|---|---|---|---|
| Current | 0365 (llvmorg-16-init-01466-gbe98d938794f) | 2021-09-14T15:57:03 | 0:00:00 |
| Previous | 0203 (llvmorg-19-init-09944-g8009bbec59d1) | 2024-04-27T14:57:22 | 0:00:00 |
| Baseline | 0001 (llvmorg-16-init-16024-ga455c91601a8) | 2022-12-31T07:27:27 | 0:00:00 |
Tests Summary
| Status Group | # | # (B) |
|---|---|---|
| Performance Regressions | 16 | 7 |
| Performance Improvements | 4 | 2 |
| Added Tests | 34 | 32 |
| Unchanged Tests | 726 | 739 |
| Total Tests | 780 |
| Performance Regressions - Code Size | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 462.libquantum | 5.02% | 33184.000 | 34849.000 | - | -1.44% | - |
| 444.namd | 3.49% | 220982.000 | 228698.000 | - | 0.84% | - |
| 464.h264ref | 1.65% | 618105.000 | 628286.000 | - | 0.90% | - |
| 453.povray | 1.52% | 901104.000 | 914766.000 | - | 0.17% | - |
| Performance Regressions - Execution | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 462.libquantum | 23.61% | 11877.000 | 14681.000 | - | 0.01% | - |
| 458.sjeng | 6.46% | 13912.000 | 14811.000 | - | 1.02% | - |
| 471.omnetpp | 3.86% | 7274.000 | 7555.000 | - | 2.43% | - |
| 453.povray | 1.96% | 4548.000 | 4637.000 | - | 0.50% | - |
| 464.h264ref | 1.65% | 9609.000 | 9768.000 | - | 0.11% | - |
| 450.soplex | 1.62% | 8351.000 | 8486.000 | - | 1.04% | - |
| 403.gcc | 1.27% | 6541.000 | 6624.000 | - | 0.17% | - |
| 433.milc | 1.21% | 11829.000 | 11972.000 | - | 0.15% | - |
| 445.gobmk | 1.11% | 11026.000 | 11148.000 | - | -0.46% | - |
| Performance Regressions - Score | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| nb_execution_successful | -5.88% | 17.000 | 16.000 | - | -11.11% | - |
| nb_compile_successful | -5.56% | 18.000 | 17.000 | - | -10.53% | - |
| nb_total_tests | -5.00% | 20.000 | 19.000 | - | 0.00% | - |
| Performance Improvements - Code Size | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 429.mcf | -5.17% | 11654.000 | 11051.000 | - | 0.29% | - |
| 473.astar | -3.83% | 37527.000 | 36091.000 | - | 0.57% | - |
| Performance Improvements - Execution | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 429.mcf | -1.19% | 9718.000 | 9602.000 | - | -0.04% | - |
| 470.lbm | -1.06% | 16065.000 | 15895.000 | - | -0.01% | - |
| Added Tests - Code Size |
|---|
| 483.xalancbmk |
| Added Tests - Execution |
|---|
| 483.xalancbmk |
| Added Tests - sample variability |
|---|
| 403.gcc (unexplained diff vs previous) |
| 403.gcc (unexplained diff vs previous) (percentage) |
| 429.mcf (unexplained diff vs previous) |
| 429.mcf (unexplained diff vs previous) (percentage) |
| 433.milc (unexplained diff vs previous) |
| 433.milc (unexplained diff vs previous) (percentage) |
| 444.namd (unexplained diff vs previous) |
| 444.namd (unexplained diff vs previous) (percentage) |
| 445.gobmk (unexplained diff vs previous) |
| 445.gobmk (unexplained diff vs previous) (percentage) |
| 447.dealII (unexplained diff vs previous) |
| 447.dealII (unexplained diff vs previous) (percentage) |
| 450.soplex (unexplained diff vs previous) |
| 450.soplex (unexplained diff vs previous) (percentage) |
| 453.povray (unexplained diff vs previous) |
| 453.povray (unexplained diff vs previous) (percentage) |
| 458.sjeng (unexplained diff vs previous) |
| 458.sjeng (unexplained diff vs previous) (percentage) |
| 462.libquantum (unexplained diff vs previous) |
| 462.libquantum (unexplained diff vs previous) (percentage) |
| 464.h264ref (unexplained diff vs previous) |
| 464.h264ref (unexplained diff vs previous) (percentage) |
| 470.lbm (unexplained diff vs previous) |
| 470.lbm (unexplained diff vs previous) (percentage) |
| 471.omnetpp (unexplained diff vs previous) |
| 471.omnetpp (unexplained diff vs previous) (percentage) |
| 473.astar (unexplained diff vs previous) |
| 473.astar (unexplained diff vs previous) (percentage) |
| 482.sphinx3 (unexplained diff vs previous) |
| 482.sphinx3 (unexplained diff vs previous) (percentage) |
| 483.xalancbmk (unexplained diff vs previous) |
| 483.xalancbmk (unexplained diff vs previous) (percentage) |
| Performance Regressions - Code Size | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 450.soplex | 1.81% | 309981.000 | 315577.000 | - | -0.80% | - |
| 471.omnetpp | 1.00% | 527703.000 | 533003.000 | - | -0.39% | - |
| Performance Regressions - Execution | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 471.omnetpp | 2.43% | 7376.000 | 7555.000 | - | 3.86% | - |
| 450.soplex | 1.04% | 8399.000 | 8486.000 | - | 1.62% | - |
| 458.sjeng | 1.02% | 14662.000 | 14811.000 | - | 6.46% | - |
| Performance Regressions - Score | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| nb_execution_successful | -11.11% | 18.000 | 16.000 | - | -5.88% | - |
| nb_compile_successful | -10.53% | 19.000 | 17.000 | - | -5.56% | - |
| Performance Improvements - Code Size | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 462.libquantum | -1.44% | 35357.000 | 34849.000 | - | 5.02% | - |
| Performance Improvements - Execution | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 483.xalancbmk | -3.82% | 5921.000 | 5695.000 | - | 0.00% | - |
| Added Tests - sample variability |
|---|
| 403.gcc (unexplained diff vs previous) |
| 403.gcc (unexplained diff vs previous) (percentage) |
| 429.mcf (unexplained diff vs previous) |
| 429.mcf (unexplained diff vs previous) (percentage) |
| 433.milc (unexplained diff vs previous) |
| 433.milc (unexplained diff vs previous) (percentage) |
| 444.namd (unexplained diff vs previous) |
| 444.namd (unexplained diff vs previous) (percentage) |
| 445.gobmk (unexplained diff vs previous) |
| 445.gobmk (unexplained diff vs previous) (percentage) |
| 447.dealII (unexplained diff vs previous) |
| 447.dealII (unexplained diff vs previous) (percentage) |
| 450.soplex (unexplained diff vs previous) |
| 450.soplex (unexplained diff vs previous) (percentage) |
| 453.povray (unexplained diff vs previous) |
| 453.povray (unexplained diff vs previous) (percentage) |
| 458.sjeng (unexplained diff vs previous) |
| 458.sjeng (unexplained diff vs previous) (percentage) |
| 462.libquantum (unexplained diff vs previous) |
| 462.libquantum (unexplained diff vs previous) (percentage) |
| 464.h264ref (unexplained diff vs previous) |
| 464.h264ref (unexplained diff vs previous) (percentage) |
| 470.lbm (unexplained diff vs previous) |
| 470.lbm (unexplained diff vs previous) (percentage) |
| 471.omnetpp (unexplained diff vs previous) |
| 471.omnetpp (unexplained diff vs previous) (percentage) |
| 473.astar (unexplained diff vs previous) |
| 473.astar (unexplained diff vs previous) (percentage) |
| 482.sphinx3 (unexplained diff vs previous) |
| 482.sphinx3 (unexplained diff vs previous) (percentage) |
| 483.xalancbmk (unexplained diff vs previous) |
| 483.xalancbmk (unexplained diff vs previous) (percentage) |
Report Time: 0.22s