Fields
| hardware | None |
| os | None |
Parameters
Fields
| Name | Value |
|---|
Parameters
| Name | Value |
|---|---|
| git_llvm | https://github.com/llvm/llvm-project/commit/ce004fb4f2e64650c37ac057dc18934b379a6016 (+ 1925 commits) |
| test_url | https://ci.linaro.org/job/tcwg_bmk_ci_llvm-build-tcwg_bmk_apm-llvm-master-aarch64-spec2k6-Oz_LTO/285/ |
Filter
llvm-aarch64-master-Oz_LTO test results
| Run | Order | Start Time | Duration |
|---|---|---|---|
| Current | 0285 (llvmorg-16-init-05829-gce004fb4f2e6) | 2022-09-12T16:26:01 | 0:00:00 |
| Previous | 0284 (llvmorg-20-init-17412-gb900379e26d9) | 2025-01-09T18:37:55 | 0:00:00 |
| Baseline | 0001 (llvmorg-16-init-17110-gb1256f2345f6) | 2022-12-17T20:51:03 | 0:00:00 |
Tests Summary
| Status Group | # | # (B) |
|---|---|---|
| Performance Regressions | 48 | 28 |
| Performance Improvements | 3 | 3 |
| Added Tests | 2 | 4 |
| Unchanged Tests | 1063 | 1081 |
| Total Tests | 1116 |
| Performance Regressions - Code Size | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 444.namd | 6.25% | 135372.000 | 143829.000 | - | 0.28% | - |
| 464.h264ref | 3.85% | 385311.000 | 400154.000 | - | 0.05% | - |
| 447.dealII | 3.17% | 320047.000 | 330205.000 | - | 1.53% | - |
| 453.povray | 3.09% | 671559.000 | 692290.000 | - | 0.11% | - |
| 403.gcc | 3.01% | 2416320.000 | 2489089.000 | - | 0.08% | - |
| 462.libquantum | 2.86% | 16512.000 | 16985.000 | - | -0.02% | - |
| 482.sphinx3 | 2.39% | 117637.000 | 120454.000 | - | 0.17% | - |
| 400.perlbench | 1.97% | 883727.000 | 901115.000 | - | 0.10% | - |
| 456.hmmer | 1.93% | 111488.000 | 113645.000 | - | 0.03% | - |
| 401.bzip2 | 1.78% | 43644.000 | 44421.000 | - | 0.14% | - |
| 473.astar | 1.71% | 23664.000 | 24068.000 | - | 1.17% | - |
| 471.omnetpp | 1.71% | 487258.000 | 495571.000 | - | 1.11% | - |
| 433.milc | 1.62% | 62150.000 | 63155.000 | - | 0.46% | - |
| 445.gobmk | 1.59% | 1821926.000 | 1850859.000 | - | 0.03% | - |
| 458.sjeng | 1.51% | 105415.000 | 107004.000 | - | 0.12% | - |
| 450.soplex | 1.49% | 228474.000 | 231883.000 | - | 3.33% | - |
| Performance Regressions - Execution | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 403.gcc | 14595.77% | 71.000 | 10434.000 | - | 2.80% | - |
| 462.libquantum | 11144.23% | 104.000 | 11694.000 | - | 21.07% | - |
| 482.sphinx3 | 3219.11% | 811.000 | 26918.000 | - | 13.20% | - |
| 450.soplex | 2503.51% | 541.000 | 14085.000 | - | 0.69% | - |
| 444.namd | 1395.35% | 666.000 | 9959.000 | - | 6.21% | - |
| 453.povray | 1290.93% | 529.000 | 7358.000 | - | 0.78% | - |
| 433.milc | 1083.79% | 1252.000 | 14821.000 | - | 1.58% | - |
| 429.mcf | 1064.65% | 1505.000 | 17528.000 | - | -7.28% | - |
| 400.perlbench | 521.77% | 1961.000 | 12193.000 | - | 10.00% | - |
| 447.dealII | 403.80% | 1919.000 | 9668.000 | - | 6.22% | - |
| 401.bzip2 | 355.83% | 2735.000 | 12467.000 | - | -10.71% | - |
| 471.omnetpp | 339.47% | 3083.000 | 13549.000 | - | 13.69% | - |
| 470.lbm | 294.68% | 3234.000 | 12764.000 | - | 15.55% | - |
| 456.hmmer | 278.75% | 2917.000 | 11048.000 | - | 21.11% | - |
| 464.h264ref | 205.68% | 4471.000 | 13667.000 | - | 12.56% | - |
| 473.astar | 187.98% | 5183.000 | 14926.000 | - | 12.22% | - |
| 445.gobmk | 133.28% | 5486.000 | 12798.000 | - | 9.68% | - |
| 458.sjeng | 93.19% | 7519.000 | 14526.000 | - | -4.95% | - |
| Performance Regressions - sample variability | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 470.lbm (unexplained diff vs previous) | 28633.33% | 6.000 | 1724.000 | - | 0.00% | - |
| 470.lbm (unexplained diff vs previous) (percentage) | 7010.53% | 0.190 | 13.510 | - | 0.00% | - |
| 470.lbm | 5939.39% | 33.000 | 1993.000 | - | 3014.06% | - |
| 470.lbm (avg) | 5939.39% | 33.000 | 1993.000 | - | 3014.06% | - |
| 470.lbm (max) | 2217.44% | 86.000 | 1993.000 | - | 33116.67% | - |
| 470.lbm (avg) (percentage) | 1416.50% | 1.030 | 15.620 | - | 2593.10% | - |
| 429.mcf | 767.50% | 80.000 | 694.000 | - | 905.80% | - |
| 429.mcf (avg) | 767.50% | 80.000 | 694.000 | - | 905.80% | - |
| 470.lbm (max) (percentage) | 485.02% | 2.670 | 15.620 | - | 25933.33% | - |
| 429.mcf (max) | 83.60% | 378.000 | 694.000 | - | 920.59% | - |
| 429.mcf (unexplained diff vs previous) | 42.89% | 506.000 | 723.000 | - | 0.00% | - |
| Performance Regressions - Score | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| nb_total_tests | -38.71% | 31.000 | 19.000 | - | 0.00% | - |
| nb_compile_successful | -29.63% | 27.000 | 19.000 | - | 0.00% | - |
| nb_execution_successful | -29.63% | 27.000 | 19.000 | - | 0.00% | - |
| Performance Improvements - sample variability | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 429.mcf (unexplained diff vs previous) (percentage) | -87.75% | 33.620 | 4.120 | - | 0.00% | - |
| 429.mcf (max) (percentage) | -84.26% | 25.160 | 3.960 | - | 1000.00% | - |
| 429.mcf (avg) (percentage) | -26.26% | 5.370 | 3.960 | - | 970.27% | - |
| Added Tests - Code Size |
|---|
| 483.xalancbmk |
| Added Tests - Execution |
|---|
| 483.xalancbmk |
| Performance Regressions - Code Size | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 450.soplex | 3.33% | 224407.000 | 231883.000 | - | 1.49% | - |
| 447.dealII | 1.53% | 325219.000 | 330205.000 | - | 3.17% | - |
| 473.astar | 1.17% | 23789.000 | 24068.000 | - | 1.71% | - |
| 471.omnetpp | 1.11% | 490147.000 | 495571.000 | - | 1.71% | - |
| Performance Regressions - Execution | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 483.xalancbmk | 24.16% | 9633.000 | 11960.000 | - | 0.00% | - |
| 456.hmmer | 21.11% | 9122.000 | 11048.000 | - | 278.75% | - |
| 462.libquantum | 21.07% | 9659.000 | 11694.000 | - | 11144.23% | - |
| 470.lbm | 15.55% | 11046.000 | 12764.000 | - | 294.68% | - |
| 471.omnetpp | 13.69% | 11917.000 | 13549.000 | - | 339.47% | - |
| 482.sphinx3 | 13.20% | 23779.000 | 26918.000 | - | 3219.11% | - |
| 464.h264ref | 12.56% | 12142.000 | 13667.000 | - | 205.68% | - |
| 473.astar | 12.22% | 13301.000 | 14926.000 | - | 187.98% | - |
| 400.perlbench | 10.00% | 11085.000 | 12193.000 | - | 521.77% | - |
| 445.gobmk | 9.68% | 11668.000 | 12798.000 | - | 133.28% | - |
| 447.dealII | 6.22% | 9102.000 | 9668.000 | - | 403.80% | - |
| 444.namd | 6.21% | 9377.000 | 9959.000 | - | 1395.35% | - |
| 403.gcc | 2.80% | 10150.000 | 10434.000 | - | 14595.77% | - |
| 433.milc | 1.58% | 14590.000 | 14821.000 | - | 1083.79% | - |
| Performance Regressions - sample variability | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 470.lbm (max) | 33116.67% | 6.000 | 1993.000 | - | 2217.44% | - |
| 470.lbm (max) (percentage) | 25933.33% | 0.060 | 15.620 | - | 485.02% | - |
| 470.lbm | 3014.06% | 64.000 | 1993.000 | - | 5939.39% | - |
| 470.lbm (avg) | 3014.06% | 64.000 | 1993.000 | - | 5939.39% | - |
| 470.lbm (avg) (percentage) | 2593.10% | 0.580 | 15.620 | - | 1416.50% | - |
| 429.mcf (max) (percentage) | 1000.00% | 0.360 | 3.960 | - | -84.26% | - |
| 429.mcf (avg) (percentage) | 970.27% | 0.370 | 3.960 | - | -26.26% | - |
| 429.mcf (max) | 920.59% | 68.000 | 694.000 | - | 83.60% | - |
| 429.mcf | 905.80% | 69.000 | 694.000 | - | 767.50% | - |
| 429.mcf (avg) | 905.80% | 69.000 | 694.000 | - | 767.50% | - |
| Performance Improvements - Execution | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 401.bzip2 | -10.71% | 13962.000 | 12467.000 | - | 355.83% | - |
| 429.mcf | -7.28% | 18905.000 | 17528.000 | - | 1064.65% | - |
| 458.sjeng | -4.95% | 15282.000 | 14526.000 | - | 93.19% | - |
| Added Tests - sample variability |
|---|
| 429.mcf (unexplained diff vs previous) |
| 429.mcf (unexplained diff vs previous) (percentage) |
| 470.lbm (unexplained diff vs previous) |
| 470.lbm (unexplained diff vs previous) (percentage) |
Report Time: 0.36s