Fields
| hardware | None |
| os | None |
Parameters
Fields
| Name | Value |
|---|
Parameters
| Name | Value |
|---|---|
| git_llvm | https://github.com/llvm/llvm-project/commit/afb0b21f24adecfa0b302c79366980453b15ba7b (+ 1756 commits) |
| test_url | https://ci.linaro.org/job/tcwg_bmk_ci_llvm-build-tcwg_bmk_apm-llvm-master-arm-spec2k6-Oz_LTO/180/ |
Filter
llvm-arm-master-Oz_LTO test results
| Run | Order | Start Time | Duration |
|---|---|---|---|
| Current | 0180 (llvmorg-16-init-05662-gafb0b21f24ad) | 2022-09-11T21:39:12 | 0:00:00 |
| Previous | 0179 (llvmorg-20-init-05423-g757d8b3efdd8) | 2024-09-08T18:19:12 | 0:00:00 |
| Baseline | 0001 (llvmorg-16-init-17036-g4f40923103d2) | 2023-01-06T17:55:45 | 0:00:00 |
Tests Summary
| Status Group | # | # (B) |
|---|---|---|
| Performance Regressions | 56 | 43 |
| Performance Improvements | 0 | 6 |
| Added Tests | 2 | 0 |
| Unchanged Tests | 710 | 719 |
| Total Tests | 768 |
| Performance Regressions - Code Size | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 429.mcf | 3.90% | 6967.000 | 7239.000 | - | 0.00% | - |
| 462.libquantum | 3.39% | 12055.000 | 12464.000 | - | -0.32% | - |
| 433.milc | 2.27% | 46105.000 | 47153.000 | - | 0.32% | - |
| 458.sjeng | 2.21% | 79094.000 | 80845.000 | - | 0.68% | - |
| 444.namd | 2.20% | 122622.000 | 125319.000 | - | 0.28% | - |
| 453.povray | 2.11% | 512464.000 | 523273.000 | - | -0.23% | - |
| 464.h264ref | 1.78% | 298989.000 | 304311.000 | - | 0.18% | - |
| 401.bzip2 | 1.43% | 33373.000 | 33850.000 | - | 0.45% | - |
| 470.lbm | 1.28% | 9232.000 | 9350.000 | - | 0.13% | - |
| 447.dealII | 1.13% | 195830.000 | 198046.000 | - | 1.15% | - |
| Performance Regressions - Execution | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 403.gcc | 17437.50% | 56.000 | 9821.000 | - | 3.28% | - |
| 462.libquantum | 8478.45% | 181.000 | 15527.000 | - | 7.76% | - |
| 482.sphinx3 | 2802.74% | 986.000 | 28621.000 | - | 7.27% | - |
| 450.soplex | 2712.68% | 544.000 | 15301.000 | - | 1.25% | - |
| 444.namd | 1579.14% | 815.000 | 13685.000 | - | 10.36% | - |
| 453.povray | 1323.51% | 502.000 | 7146.000 | - | 2.28% | - |
| 433.milc | 1101.29% | 1164.000 | 13983.000 | - | 2.81% | - |
| 429.mcf | 932.00% | 1128.000 | 11641.000 | - | -16.78% | - |
| 401.bzip2 | 488.47% | 2828.000 | 16642.000 | - | 3.13% | - |
| 447.dealII | 449.00% | 1947.000 | 10689.000 | - | 13.96% | - |
| 471.omnetpp | 293.13% | 2927.000 | 11507.000 | - | 9.83% | - |
| 470.lbm | 264.73% | 3992.000 | 14560.000 | - | 9.81% | - |
| 456.hmmer | 252.89% | 3806.000 | 13431.000 | - | 13.30% | - |
| 473.astar | 193.95% | 4598.000 | 13516.000 | - | 10.14% | - |
| 464.h264ref | 166.90% | 5958.000 | 15902.000 | - | 9.68% | - |
| 445.gobmk | 135.66% | 4891.000 | 11526.000 | - | 3.90% | - |
| 458.sjeng | 95.75% | 8158.000 | 15969.000 | - | -6.37% | - |
| Performance Regressions - sample variability | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 429.mcf (unexplained diff vs previous) | 12593.33% | 15.000 | 1904.000 | - | 8554.55% | - |
| 429.mcf | 11585.71% | 14.000 | 1636.000 | - | 452.70% | - |
| 429.mcf (avg) | 11585.71% | 14.000 | 1636.000 | - | 452.70% | - |
| 450.soplex | 7142.86% | 7.000 | 507.000 | - | 576.00% | - |
| 450.soplex (avg) | 7142.86% | 7.000 | 507.000 | - | 576.00% | - |
| 470.lbm | 6609.09% | 22.000 | 1476.000 | - | 234.69% | - |
| 470.lbm (avg) | 6609.09% | 22.000 | 1476.000 | - | 234.69% | - |
| 470.lbm (max) | 6317.39% | 23.000 | 1476.000 | - | 94.72% | - |
| 429.mcf (max) | 5177.42% | 31.000 | 1636.000 | - | -28.28% | - |
| 450.soplex (unexplained diff vs previous) | 3991.67% | 12.000 | 491.000 | - | 611.59% | - |
| 450.soplex (max) | 3521.43% | 14.000 | 507.000 | - | 103.61% | - |
| 471.omnetpp (max) | 2637.14% | 35.000 | 958.000 | - | -1.44% | - |
| 471.omnetpp (unexplained diff vs previous) | 2428.57% | 35.000 | 885.000 | - | 759.22% | - |
| 471.omnetpp | 2356.41% | 39.000 | 958.000 | - | 473.65% | - |
| 471.omnetpp (avg) | 2356.41% | 39.000 | 958.000 | - | 473.65% | - |
| 470.lbm (avg) (percentage) | 1710.71% | 0.560 | 10.140 | - | 204.50% | - |
| 470.lbm (max) (percentage) | 1648.28% | 0.580 | 10.140 | - | 77.27% | - |
| 429.mcf (unexplained diff vs previous) (percentage) | 1130.08% | 1.330 | 16.360 | - | 10125.00% | - |
| 429.mcf (avg) (percentage) | 973.28% | 1.310 | 14.060 | - | 563.21% | - |
| 471.omnetpp (max) (percentage) | 588.43% | 1.210 | 8.330 | - | -10.24% | - |
| 471.omnetpp (unexplained diff vs previous) (percentage) | 540.83% | 1.200 | 7.690 | - | 684.69% | - |
| 471.omnetpp (avg) (percentage) | 512.50% | 1.360 | 8.330 | - | 420.62% | - |
| 429.mcf (max) (percentage) | 411.27% | 2.750 | 14.060 | - | -13.80% | - |
| 450.soplex (avg) (percentage) | 145.93% | 1.350 | 3.320 | - | 564.00% | - |
| 450.soplex (unexplained diff vs previous) (percentage) | 45.25% | 2.210 | 3.210 | - | 597.83% | - |
| 450.soplex (max) (percentage) | 24.81% | 2.660 | 3.320 | - | 101.21% | - |
| Performance Regressions - Score | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| nb_total_tests | -52.50% | 40.000 | 19.000 | - | 0.00% | - |
| nb_compile_successful | -47.22% | 36.000 | 19.000 | - | 0.00% | - |
| nb_execution_successful | -47.06% | 34.000 | 18.000 | - | 0.00% | - |
| Added Tests - Code Size |
|---|
| 483.xalancbmk |
| Added Tests - Execution |
|---|
| 483.xalancbmk |
| Performance Regressions - Code Size | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 450.soplex | 2.72% | 146765.000 | 150761.000 | - | 0.82% | - |
| 471.omnetpp | 1.60% | 316676.000 | 321756.000 | - | -0.08% | - |
| 447.dealII | 1.15% | 195792.000 | 198046.000 | - | 1.13% | - |
| Performance Regressions - Execution | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 483.xalancbmk | 14.38% | 9376.000 | 10724.000 | - | 0.00% | - |
| 447.dealII | 13.96% | 9380.000 | 10689.000 | - | 449.00% | - |
| 456.hmmer | 13.30% | 11854.000 | 13431.000 | - | 252.89% | - |
| 444.namd | 10.36% | 12400.000 | 13685.000 | - | 1579.14% | - |
| 473.astar | 10.14% | 12272.000 | 13516.000 | - | 193.95% | - |
| 471.omnetpp | 9.83% | 10477.000 | 11507.000 | - | 293.13% | - |
| 470.lbm | 9.81% | 13259.000 | 14560.000 | - | 264.73% | - |
| 464.h264ref | 9.68% | 14498.000 | 15902.000 | - | 166.90% | - |
| 462.libquantum | 7.76% | 14409.000 | 15527.000 | - | 8478.45% | - |
| 482.sphinx3 | 7.27% | 26682.000 | 28621.000 | - | 2802.74% | - |
| 445.gobmk | 3.90% | 11093.000 | 11526.000 | - | 135.66% | - |
| 403.gcc | 3.28% | 9509.000 | 9821.000 | - | 17437.50% | - |
| 401.bzip2 | 3.13% | 16137.000 | 16642.000 | - | 488.47% | - |
| 433.milc | 2.81% | 13601.000 | 13983.000 | - | 1101.29% | - |
| 453.povray | 2.28% | 6987.000 | 7146.000 | - | 1323.51% | - |
| 450.soplex | 1.25% | 15112.000 | 15301.000 | - | 2712.68% | - |
| Performance Regressions - sample variability | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 429.mcf (unexplained diff vs previous) (percentage) | 10125.00% | 0.160 | 16.360 | - | 1130.08% | - |
| 429.mcf (unexplained diff vs previous) | 8554.55% | 22.000 | 1904.000 | - | 12593.33% | - |
| 471.omnetpp (unexplained diff vs previous) | 759.22% | 103.000 | 885.000 | - | 2428.57% | - |
| 471.omnetpp (unexplained diff vs previous) (percentage) | 684.69% | 0.980 | 7.690 | - | 540.83% | - |
| 450.soplex (unexplained diff vs previous) | 611.59% | 69.000 | 491.000 | - | 3991.67% | - |
| 450.soplex (unexplained diff vs previous) (percentage) | 597.83% | 0.460 | 3.210 | - | 45.25% | - |
| 450.soplex | 576.00% | 75.000 | 507.000 | - | 7142.86% | - |
| 450.soplex (avg) | 576.00% | 75.000 | 507.000 | - | 7142.86% | - |
| 450.soplex (avg) (percentage) | 564.00% | 0.500 | 3.320 | - | 145.93% | - |
| 429.mcf (avg) (percentage) | 563.21% | 2.120 | 14.060 | - | 973.28% | - |
| 471.omnetpp | 473.65% | 167.000 | 958.000 | - | 2356.41% | - |
| 471.omnetpp (avg) | 473.65% | 167.000 | 958.000 | - | 2356.41% | - |
| 429.mcf | 452.70% | 296.000 | 1636.000 | - | 11585.71% | - |
| 429.mcf (avg) | 452.70% | 296.000 | 1636.000 | - | 11585.71% | - |
| 471.omnetpp (avg) (percentage) | 420.62% | 1.600 | 8.330 | - | 512.50% | - |
| 470.lbm | 234.69% | 441.000 | 1476.000 | - | 6609.09% | - |
| 470.lbm (avg) | 234.69% | 441.000 | 1476.000 | - | 6609.09% | - |
| 470.lbm (avg) (percentage) | 204.50% | 3.330 | 10.140 | - | 1710.71% | - |
| 450.soplex (max) | 103.61% | 249.000 | 507.000 | - | 3521.43% | - |
| 450.soplex (max) (percentage) | 101.21% | 1.650 | 3.320 | - | 24.81% | - |
| 470.lbm (max) | 94.72% | 758.000 | 1476.000 | - | 6317.39% | - |
| 470.lbm (max) (percentage) | 77.27% | 5.720 | 10.140 | - | 1648.28% | - |
| 470.lbm (unexplained diff vs previous) | 66.79% | 804.000 | 1341.000 | - | 0.00% | - |
| 470.lbm (unexplained diff vs previous) (percentage) | 51.98% | 6.060 | 9.210 | - | 0.00% | - |
| Performance Improvements - Execution | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 429.mcf | -16.78% | 13988.000 | 11641.000 | - | 932.00% | - |
| 458.sjeng | -6.37% | 17055.000 | 15969.000 | - | 95.75% | - |
| Performance Improvements - sample variability | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 429.mcf (max) | -28.28% | 2281.000 | 1636.000 | - | 5177.42% | - |
| 429.mcf (max) (percentage) | -13.80% | 16.310 | 14.060 | - | 411.27% | - |
| 471.omnetpp (max) (percentage) | -10.24% | 9.280 | 8.330 | - | 588.43% | - |
| 471.omnetpp (max) | -1.44% | 972.000 | 958.000 | - | 2637.14% | - |
Report Time: 0.35s