Fields
| hardware | None |
| os | None |
Parameters
Fields
| Name | Value |
|---|
Parameters
| Name | Value |
|---|---|
| git_binutils | https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=105afa7f230e5fed8f5a2eb28bc14d7696f5ac72 |
| git_gcc | https://github.com/gcc-mirror/gcc/commit/6624ad73064de241e937e97a28b65c50fe14c78e |
| git_glibc | https://sourceware.org/git/?p=glibc.git;a=commit;h=453b88efe6fa79f5c7c6fccc3a520c75fdd43074 |
| git_linux | https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=8e7e7ba8867994efd4d1c73c54da87dd4bb61152 |
| test_url | https://ci.linaro.org/job/tcwg_bmk_ci_gnu-build-tcwg_bmk_apm-gnu-master-aarch64-spec2k6-Os/260/ |
Filter
gnu-aarch64-master-Os test results
| Run | Order | Start Time | Duration |
|---|---|---|---|
| Current | 0260 (4-changed-components) | 2022-08-15T06:39:29 | 0:00:00 |
| Previous | 0211 (3-changed-components) | 2024-03-29T08:27:09 | 0:00:00 |
| Baseline | 0001 (3-changed-components) | 2023-01-01T08:38:47 | 0:00:00 |
Tests Summary
| Status Group | # | # (B) |
|---|---|---|
| Performance Regressions | 35 | 18 |
| Performance Improvements | 6 | 14 |
| Added Tests | 60 | 58 |
| Unchanged Tests | 1135 | 1146 |
| Total Tests | 1236 |
| Performance Regressions - Code Size | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 450.soplex | 2.88% | 259941.000 | 267429.000 | - | 2.60% | - |
| 464.h264ref | 2.38% | 417968.000 | 427916.000 | - | -0.10% | - |
| 400.perlbench | 2.28% | 929250.000 | 950396.000 | - | 2.12% | - |
| 434.zeusmp | 1.71% | 162829.000 | 165607.000 | - | -0.06% | - |
| 410.bwaves | 1.36% | 17640.000 | 17880.000 | - | 0.00% | - |
| 471.omnetpp | 1.16% | 566460.000 | 573038.000 | - | 1.15% | - |
| 459.GemsFDTD | 1.03% | 254373.000 | 256984.000 | - | 1.29% | - |
| Performance Regressions - Execution | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 454.calculix | 33785.48% | 62.000 | 21009.000 | - | -8.10% | - |
| 403.gcc | 14874.14% | 58.000 | 8685.000 | - | -3.61% | - |
| 462.libquantum | 9867.88% | 137.000 | 13656.000 | - | 17.58% | - |
| 482.sphinx3 | 2801.69% | 945.000 | 27421.000 | - | -8.38% | - |
| 450.soplex | 2461.49% | 579.000 | 14831.000 | - | -4.11% | - |
| 453.povray | 1292.70% | 493.000 | 6866.000 | - | 4.92% | - |
| 429.mcf | 1255.65% | 1504.000 | 20389.000 | - | 18.83% | - |
| 444.namd | 1169.35% | 734.000 | 9317.000 | - | 2.95% | - |
| 433.milc | 972.79% | 1176.000 | 12616.000 | - | -2.77% | - |
| 436.cactusADM | 766.82% | 2116.000 | 18342.000 | - | 4.55% | - |
| 400.perlbench | 563.47% | 1596.000 | 10589.000 | - | -0.57% | - |
| 434.zeusmp | 439.62% | 2572.000 | 13879.000 | - | 5.06% | - |
| 447.dealII | 383.56% | 1971.000 | 9531.000 | - | -2.26% | - |
| 401.bzip2 | 373.78% | 3021.000 | 14313.000 | - | -5.74% | - |
| 471.omnetpp | 358.92% | 2936.000 | 13474.000 | - | 25.47% | - |
| 470.lbm | 277.33% | 3750.000 | 14150.000 | - | 10.38% | - |
| 456.hmmer | 254.92% | 2924.000 | 10378.000 | - | -6.05% | - |
| 459.GemsFDTD | 247.74% | 6123.000 | 21292.000 | - | -8.84% | - |
| 481.wrf | 224.80% | 5537.000 | 17984.000 | - | 6.83% | - |
| 473.astar | 166.80% | 5916.000 | 15784.000 | - | 5.71% | - |
| 410.bwaves | 142.41% | 6067.000 | 14707.000 | - | -0.33% | - |
| 445.gobmk | 133.37% | 5208.000 | 12154.000 | - | 1.33% | - |
| 464.h264ref | 121.13% | 5939.000 | 13133.000 | - | -9.78% | - |
| 458.sjeng | 98.87% | 7707.000 | 15327.000 | - | 7.37% | - |
| 435.gromacs | 96.92% | 7153.000 | 14086.000 | - | -8.65% | - |
| 416.gamess | 78.39% | 12547.000 | 22383.000 | - | -1.41% | - |
| 437.leslie3d | 24.50% | 10923.000 | 13599.000 | - | -9.37% | - |
| Performance Regressions - Score | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| nb_total_tests | -3.33% | 30.000 | 29.000 | - | 0.00% | - |
| Performance Improvements - Code Size | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 458.sjeng | -6.61% | 120025.000 | 112097.000 | - | -6.76% | - |
| 433.milc | -3.90% | 99705.000 | 95813.000 | - | -0.06% | - |
| 456.hmmer | -1.41% | 234488.000 | 231177.000 | - | -0.01% | - |
| Performance Improvements - Execution | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 465.tonto | -17.70% | 11599.000 | 9546.000 | - | 16.34% | - |
| Performance Improvements - Score | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| nb_compile_successful | 3.57% | 28.000 | 29.000 | - | 0.00% | - |
| nb_execution_successful | 3.57% | 28.000 | 29.000 | - | 0.00% | - |
| Added Tests - Code Size |
|---|
| 483.xalancbmk |
| Added Tests - Execution |
|---|
| 483.xalancbmk |
| Added Tests - sample variability |
|---|
| 400.perlbench (unexplained diff vs previous) |
| 400.perlbench (unexplained diff vs previous) (percentage) |
| 401.bzip2 (unexplained diff vs previous) |
| 401.bzip2 (unexplained diff vs previous) (percentage) |
| 403.gcc (unexplained diff vs previous) |
| 403.gcc (unexplained diff vs previous) (percentage) |
| 410.bwaves (unexplained diff vs previous) |
| 410.bwaves (unexplained diff vs previous) (percentage) |
| 416.gamess (unexplained diff vs previous) |
| 416.gamess (unexplained diff vs previous) (percentage) |
| 429.mcf (unexplained diff vs previous) |
| 429.mcf (unexplained diff vs previous) (percentage) |
| 433.milc (unexplained diff vs previous) |
| 433.milc (unexplained diff vs previous) (percentage) |
| 434.zeusmp (unexplained diff vs previous) |
| 434.zeusmp (unexplained diff vs previous) (percentage) |
| 435.gromacs (unexplained diff vs previous) |
| 435.gromacs (unexplained diff vs previous) (percentage) |
| 436.cactusADM (unexplained diff vs previous) |
| 436.cactusADM (unexplained diff vs previous) (percentage) |
| 437.leslie3d (unexplained diff vs previous) |
| 437.leslie3d (unexplained diff vs previous) (percentage) |
| 444.namd (unexplained diff vs previous) |
| 444.namd (unexplained diff vs previous) (percentage) |
| 445.gobmk (unexplained diff vs previous) |
| 445.gobmk (unexplained diff vs previous) (percentage) |
| 447.dealII (unexplained diff vs previous) |
| 447.dealII (unexplained diff vs previous) (percentage) |
| 450.soplex (unexplained diff vs previous) |
| 450.soplex (unexplained diff vs previous) (percentage) |
| 453.povray (unexplained diff vs previous) |
| 453.povray (unexplained diff vs previous) (percentage) |
| 454.calculix (unexplained diff vs previous) |
| 454.calculix (unexplained diff vs previous) (percentage) |
| 456.hmmer (unexplained diff vs previous) |
| 456.hmmer (unexplained diff vs previous) (percentage) |
| 458.sjeng (unexplained diff vs previous) |
| 458.sjeng (unexplained diff vs previous) (percentage) |
| 459.GemsFDTD (unexplained diff vs previous) |
| 459.GemsFDTD (unexplained diff vs previous) (percentage) |
| 462.libquantum (unexplained diff vs previous) |
| 462.libquantum (unexplained diff vs previous) (percentage) |
| 464.h264ref (unexplained diff vs previous) |
| 464.h264ref (unexplained diff vs previous) (percentage) |
| 465.tonto (unexplained diff vs previous) |
| 465.tonto (unexplained diff vs previous) (percentage) |
| 470.lbm (unexplained diff vs previous) |
| 470.lbm (unexplained diff vs previous) (percentage) |
| 471.omnetpp (unexplained diff vs previous) |
| 471.omnetpp (unexplained diff vs previous) (percentage) |
| 473.astar (unexplained diff vs previous) |
| 473.astar (unexplained diff vs previous) (percentage) |
| 481.wrf (unexplained diff vs previous) |
| 481.wrf (unexplained diff vs previous) (percentage) |
| 482.sphinx3 (unexplained diff vs previous) |
| 482.sphinx3 (unexplained diff vs previous) (percentage) |
| 483.xalancbmk (unexplained diff vs previous) |
| 483.xalancbmk (unexplained diff vs previous) (percentage) |
| Performance Regressions - Code Size | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 450.soplex | 2.60% | 260647.000 | 267429.000 | - | 2.88% | - |
| 400.perlbench | 2.12% | 930652.000 | 950396.000 | - | 2.28% | - |
| 459.GemsFDTD | 1.29% | 253716.000 | 256984.000 | - | 1.03% | - |
| 471.omnetpp | 1.15% | 566534.000 | 573038.000 | - | 1.16% | - |
| Performance Regressions - Execution | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 471.omnetpp | 25.47% | 10739.000 | 13474.000 | - | 358.92% | - |
| 429.mcf | 18.83% | 17158.000 | 20389.000 | - | 1255.65% | - |
| 483.xalancbmk | 17.89% | 11172.000 | 13171.000 | - | 0.00% | - |
| 462.libquantum | 17.58% | 11614.000 | 13656.000 | - | 9867.88% | - |
| 465.tonto | 16.34% | 8205.000 | 9546.000 | - | -17.70% | - |
| 470.lbm | 10.38% | 12819.000 | 14150.000 | - | 277.33% | - |
| 458.sjeng | 7.37% | 14275.000 | 15327.000 | - | 98.87% | - |
| 481.wrf | 6.83% | 16834.000 | 17984.000 | - | 224.80% | - |
| 473.astar | 5.71% | 14932.000 | 15784.000 | - | 166.80% | - |
| 434.zeusmp | 5.06% | 13211.000 | 13879.000 | - | 439.62% | - |
| 453.povray | 4.92% | 6544.000 | 6866.000 | - | 1292.70% | - |
| 436.cactusADM | 4.55% | 17544.000 | 18342.000 | - | 766.82% | - |
| 444.namd | 2.95% | 9050.000 | 9317.000 | - | 1169.35% | - |
| 445.gobmk | 1.33% | 11995.000 | 12154.000 | - | 133.37% | - |
| Performance Improvements - Code Size | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 458.sjeng | -6.76% | 120221.000 | 112097.000 | - | -6.61% | - |
| Performance Improvements - Execution | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 464.h264ref | -9.78% | 14556.000 | 13133.000 | - | 121.13% | - |
| 437.leslie3d | -9.37% | 15005.000 | 13599.000 | - | 24.50% | - |
| 459.GemsFDTD | -8.84% | 23356.000 | 21292.000 | - | 247.74% | - |
| 435.gromacs | -8.65% | 15419.000 | 14086.000 | - | 96.92% | - |
| 482.sphinx3 | -8.38% | 29928.000 | 27421.000 | - | 2801.69% | - |
| 454.calculix | -8.10% | 22860.000 | 21009.000 | - | 33785.48% | - |
| 456.hmmer | -6.05% | 11046.000 | 10378.000 | - | 254.92% | - |
| 401.bzip2 | -5.74% | 15185.000 | 14313.000 | - | 373.78% | - |
| 450.soplex | -4.11% | 15466.000 | 14831.000 | - | 2461.49% | - |
| 403.gcc | -3.61% | 9010.000 | 8685.000 | - | 14874.14% | - |
| 433.milc | -2.77% | 12976.000 | 12616.000 | - | 972.79% | - |
| 447.dealII | -2.26% | 9751.000 | 9531.000 | - | 383.56% | - |
| 416.gamess | -1.41% | 22704.000 | 22383.000 | - | 78.39% | - |
| Added Tests - sample variability |
|---|
| 400.perlbench (unexplained diff vs previous) |
| 400.perlbench (unexplained diff vs previous) (percentage) |
| 401.bzip2 (unexplained diff vs previous) |
| 401.bzip2 (unexplained diff vs previous) (percentage) |
| 403.gcc (unexplained diff vs previous) |
| 403.gcc (unexplained diff vs previous) (percentage) |
| 410.bwaves (unexplained diff vs previous) |
| 410.bwaves (unexplained diff vs previous) (percentage) |
| 416.gamess (unexplained diff vs previous) |
| 416.gamess (unexplained diff vs previous) (percentage) |
| 429.mcf (unexplained diff vs previous) |
| 429.mcf (unexplained diff vs previous) (percentage) |
| 433.milc (unexplained diff vs previous) |
| 433.milc (unexplained diff vs previous) (percentage) |
| 434.zeusmp (unexplained diff vs previous) |
| 434.zeusmp (unexplained diff vs previous) (percentage) |
| 435.gromacs (unexplained diff vs previous) |
| 435.gromacs (unexplained diff vs previous) (percentage) |
| 436.cactusADM (unexplained diff vs previous) |
| 436.cactusADM (unexplained diff vs previous) (percentage) |
| 437.leslie3d (unexplained diff vs previous) |
| 437.leslie3d (unexplained diff vs previous) (percentage) |
| 444.namd (unexplained diff vs previous) |
| 444.namd (unexplained diff vs previous) (percentage) |
| 445.gobmk (unexplained diff vs previous) |
| 445.gobmk (unexplained diff vs previous) (percentage) |
| 447.dealII (unexplained diff vs previous) |
| 447.dealII (unexplained diff vs previous) (percentage) |
| 450.soplex (unexplained diff vs previous) |
| 450.soplex (unexplained diff vs previous) (percentage) |
| 453.povray (unexplained diff vs previous) |
| 453.povray (unexplained diff vs previous) (percentage) |
| 454.calculix (unexplained diff vs previous) |
| 454.calculix (unexplained diff vs previous) (percentage) |
| 456.hmmer (unexplained diff vs previous) |
| 456.hmmer (unexplained diff vs previous) (percentage) |
| 458.sjeng (unexplained diff vs previous) |
| 458.sjeng (unexplained diff vs previous) (percentage) |
| 459.GemsFDTD (unexplained diff vs previous) |
| 459.GemsFDTD (unexplained diff vs previous) (percentage) |
| 462.libquantum (unexplained diff vs previous) |
| 462.libquantum (unexplained diff vs previous) (percentage) |
| 464.h264ref (unexplained diff vs previous) |
| 464.h264ref (unexplained diff vs previous) (percentage) |
| 465.tonto (unexplained diff vs previous) |
| 465.tonto (unexplained diff vs previous) (percentage) |
| 470.lbm (unexplained diff vs previous) |
| 470.lbm (unexplained diff vs previous) (percentage) |
| 471.omnetpp (unexplained diff vs previous) |
| 471.omnetpp (unexplained diff vs previous) (percentage) |
| 473.astar (unexplained diff vs previous) |
| 473.astar (unexplained diff vs previous) (percentage) |
| 481.wrf (unexplained diff vs previous) |
| 481.wrf (unexplained diff vs previous) (percentage) |
| 482.sphinx3 (unexplained diff vs previous) |
| 482.sphinx3 (unexplained diff vs previous) (percentage) |
| 483.xalancbmk (unexplained diff vs previous) |
| 483.xalancbmk (unexplained diff vs previous) (percentage) |
Report Time: 0.36s