Fields
| hardware | None |
| os | None |
Parameters
Fields
| Name | Value |
|---|
Parameters
| Name | Value |
|---|---|
| git_llvm | https://github.com/llvm/llvm-project/commit/ea2ed80e6dac21bf19d87de8bef1ec01b00dbb8d (unchanged) |
| test_url | https://ci.linaro.org/job/tcwg_bmk_ci_llvm-build-tcwg_bmk_apm-llvm-master-arm-spec2k6-Oz_LTO/188/ |
Filter
llvm-arm-master-Oz_LTO test results
| Run | Order | Start Time | Duration |
|---|---|---|---|
| Current | 0188 (no-change) | 2022-09-30T01:10:53 | 0:00:00 |
| Previous | 0186 (llvmorg-20-init-08115-g37ce3c220816) | 2024-09-29T09:59:08 | 0:00:00 |
| Baseline | 0001 (llvmorg-16-init-17036-g4f40923103d2) | 2023-01-06T17:55:45 | 0:00:00 |
Tests Summary
| Status Group | # | # (B) |
|---|---|---|
| Performance Regressions | 101 | 50 |
| Performance Improvements | 31 | 84 |
| Added Tests | 25 | 6 |
| Unchanged Tests | 623 | 640 |
| Total Tests | 780 |
| Performance Regressions - Code Size | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 429.mcf | 4.38% | 6935.000 | 7239.000 | - | 0.00% | - |
| 462.libquantum | 3.39% | 12055.000 | 12464.000 | - | -0.32% | - |
| 458.sjeng | 2.35% | 78986.000 | 80845.000 | - | 0.68% | - |
| 433.milc | 2.31% | 46089.000 | 47153.000 | - | 0.32% | - |
| 444.namd | 2.20% | 122622.000 | 125319.000 | - | 0.28% | - |
| 453.povray | 2.11% | 512312.000 | 523145.000 | - | -0.26% | - |
| 401.bzip2 | 2.05% | 33185.000 | 33866.000 | - | 0.50% | - |
| 464.h264ref | 1.86% | 298765.000 | 304327.000 | - | 0.18% | - |
| 447.dealII | 1.59% | 194907.000 | 198002.000 | - | 1.13% | - |
| 470.lbm | 1.02% | 9256.000 | 9350.000 | - | 0.13% | - |
| Performance Regressions - Execution | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 403.gcc | 16610.17% | 59.000 | 9859.000 | - | 3.68% | - |
| 462.libquantum | 8381.97% | 183.000 | 15522.000 | - | 7.72% | - |
| 482.sphinx3 | 2891.57% | 985.000 | 29467.000 | - | 10.44% | - |
| 450.soplex | 2730.81% | 542.000 | 15343.000 | - | 1.53% | - |
| 444.namd | 1479.17% | 816.000 | 12886.000 | - | 3.92% | - |
| 453.povray | 1303.43% | 496.000 | 6961.000 | - | -0.37% | - |
| 433.milc | 1088.82% | 1172.000 | 13933.000 | - | 2.44% | - |
| 429.mcf | 925.69% | 1129.000 | 11580.000 | - | -17.21% | - |
| 401.bzip2 | 487.17% | 2836.000 | 16652.000 | - | 3.19% | - |
| 447.dealII | 441.48% | 1943.000 | 10521.000 | - | 12.16% | - |
| 471.omnetpp | 298.26% | 2880.000 | 11470.000 | - | 9.48% | - |
| 470.lbm | 283.21% | 3997.000 | 15317.000 | - | 15.52% | - |
| 456.hmmer | 255.95% | 3814.000 | 13576.000 | - | 14.53% | - |
| 473.astar | 191.68% | 4615.000 | 13461.000 | - | 9.69% | - |
| 464.h264ref | 168.42% | 5943.000 | 15952.000 | - | 10.03% | - |
| 445.gobmk | 135.21% | 4891.000 | 11504.000 | - | 3.71% | - |
| 458.sjeng | 94.72% | 8189.000 | 15946.000 | - | -6.50% | - |
| Performance Regressions - sample variability | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 444.namd (unexplained diff vs previous) | 80100.00% | 1.000 | 802.000 | - | 9925.00% | - |
| 444.namd (max) | 75400.00% | 1.000 | 755.000 | - | -24.73% | - |
| 444.namd | 8283.33% | 6.000 | 503.000 | - | 58.18% | - |
| 444.namd (avg) | 8283.33% | 6.000 | 503.000 | - | 58.18% | - |
| 482.sphinx3 | 7971.43% | 7.000 | 565.000 | - | 21.77% | - |
| 482.sphinx3 (avg) | 7971.43% | 7.000 | 565.000 | - | 21.77% | - |
| 482.sphinx3 (max) | 5814.29% | 14.000 | 828.000 | - | -6.23% | - |
| 429.mcf (max) | 5714.29% | 14.000 | 814.000 | - | -64.31% | - |
| 444.namd (unexplained diff vs previous) (percentage) | 5083.33% | 0.120 | 6.220 | - | 10266.67% | - |
| 403.gcc | 4500.00% | 1.000 | 46.000 | - | -11.54% | - |
| 403.gcc (avg) | 4500.00% | 1.000 | 46.000 | - | -11.54% | - |
| 453.povray | 4175.00% | 4.000 | 171.000 | - | 210.91% | - |
| 453.povray (avg) | 4175.00% | 4.000 | 171.000 | - | 210.91% | - |
| 470.lbm (max) | 4150.00% | 26.000 | 1105.000 | - | 45.78% | - |
| 450.soplex (max) | 4133.33% | 6.000 | 254.000 | - | 2.01% | - |
| 470.lbm | 3866.67% | 21.000 | 833.000 | - | 88.89% | - |
| 470.lbm (avg) | 3866.67% | 21.000 | 833.000 | - | 88.89% | - |
| 444.namd (max) (percentage) | 3562.50% | 0.160 | 5.860 | - | -27.56% | - |
| 453.povray (max) | 3320.00% | 5.000 | 171.000 | - | 584.00% | - |
| 462.libquantum | 1350.00% | 2.000 | 29.000 | - | -73.64% | - |
| 462.libquantum (avg) | 1350.00% | 2.000 | 29.000 | - | -73.64% | - |
| 471.omnetpp (max) | 1092.50% | 40.000 | 477.000 | - | -50.93% | - |
| 429.mcf (unexplained diff vs previous) | 1050.00% | 8.000 | 92.000 | - | 318.18% | - |
| 470.lbm (max) (percentage) | 993.94% | 0.660 | 7.220 | - | 26.22% | - |
| 447.dealII | 928.57% | 14.000 | 144.000 | - | 46.94% | - |
| 447.dealII (avg) | 928.57% | 14.000 | 144.000 | - | 46.94% | - |
| 470.lbm (avg) (percentage) | 889.09% | 0.550 | 5.440 | - | 63.36% | - |
| 450.soplex (unexplained diff vs previous) | 800.00% | 3.000 | 27.000 | - | -60.87% | - |
| 483.xalancbmk (max) (percentage) | 780.00% | 0.050 | 0.440 | - | -96.59% | - |
| 403.gcc (max) | 666.67% | 6.000 | 46.000 | - | -79.19% | - |
| 447.dealII (max) | 585.71% | 21.000 | 144.000 | - | -35.43% | - |
| 450.soplex | 485.71% | 7.000 | 41.000 | - | -45.33% | - |
| 450.soplex (avg) | 485.71% | 7.000 | 41.000 | - | -45.33% | - |
| 401.bzip2 (unexplained diff vs previous) | 450.00% | 6.000 | 33.000 | - | 0.00% | - |
| 429.mcf (max) (percentage) | 432.58% | 1.320 | 7.030 | - | -56.90% | - |
| 444.namd (avg) (percentage) | 421.33% | 0.750 | 3.910 | - | 52.14% | - |
| 429.mcf | 407.14% | 14.000 | 71.000 | - | -76.01% | - |
| 429.mcf (avg) | 407.14% | 14.000 | 71.000 | - | -76.01% | - |
| 445.gobmk (max) | 277.78% | 9.000 | 34.000 | - | -91.77% | - |
| 401.bzip2 (max) | 230.00% | 10.000 | 33.000 | - | -94.58% | - |
| 456.hmmer (max) | 212.00% | 25.000 | 78.000 | - | -93.72% | - |
| 462.libquantum (unexplained diff vs previous) | 211.11% | 9.000 | 28.000 | - | 2700.00% | - |
| 401.bzip2 | 200.00% | 11.000 | 33.000 | - | -68.27% | - |
| 401.bzip2 (avg) | 200.00% | 11.000 | 33.000 | - | -68.27% | - |
| 462.libquantum (max) | 200.00% | 9.000 | 27.000 | - | -97.06% | - |
| 471.omnetpp (max) (percentage) | 199.28% | 1.390 | 4.160 | - | -55.17% | - |
| 453.povray (avg) (percentage) | 171.43% | 0.910 | 2.470 | - | 208.75% | - |
| 433.milc (max) | 170.00% | 10.000 | 27.000 | - | -75.00% | - |
| 471.omnetpp (unexplained diff vs previous) | 164.71% | 34.000 | 90.000 | - | -12.62% | - |
| 445.gobmk | 161.54% | 13.000 | 34.000 | - | -54.05% | - |
| 445.gobmk (avg) | 161.54% | 13.000 | 34.000 | - | -54.05% | - |
| 433.milc | 150.00% | 8.000 | 20.000 | - | -82.76% | - |
| 433.milc (avg) | 150.00% | 8.000 | 20.000 | - | -82.76% | - |
| 482.sphinx3 (avg) (percentage) | 140.00% | 0.800 | 1.920 | - | 10.34% | - |
| 453.povray (max) (percentage) | 139.81% | 1.030 | 2.470 | - | 586.11% | - |
| 456.hmmer | 113.79% | 29.000 | 62.000 | - | -62.20% | - |
| 456.hmmer (avg) | 113.79% | 29.000 | 62.000 | - | -62.20% | - |
| 473.astar (max) | 112.50% | 8.000 | 17.000 | - | -97.93% | - |
| 471.omnetpp | 100.00% | 38.000 | 76.000 | - | -54.49% | - |
| 471.omnetpp (avg) | 100.00% | 38.000 | 76.000 | - | -54.49% | - |
| 482.sphinx3 (max) (percentage) | 93.79% | 1.450 | 2.810 | - | -15.11% | - |
| 447.dealII (avg) (percentage) | 85.14% | 0.740 | 1.370 | - | 30.48% | - |
| 464.h264ref | 76.92% | 13.000 | 23.000 | - | -45.24% | - |
| 464.h264ref (avg) | 76.92% | 13.000 | 23.000 | - | -45.24% | - |
| 458.sjeng (max) | 72.22% | 18.000 | 31.000 | - | -96.46% | - |
| 458.sjeng (unexplained diff vs previous) | 63.64% | 11.000 | 18.000 | - | 0.00% | - |
| 456.hmmer (unexplained diff vs previous) | 60.00% | 25.000 | 40.000 | - | -13.04% | - |
| 445.gobmk (max) (percentage) | 57.89% | 0.190 | 0.300 | - | -91.96% | - |
| 464.h264ref (max) | 37.50% | 16.000 | 22.000 | - | -63.33% | - |
| 450.soplex (max) (percentage) | 32.80% | 1.250 | 1.660 | - | 0.61% | - |
| 447.dealII (max) (percentage) | 23.42% | 1.110 | 1.370 | - | -42.44% | - |
| 429.mcf (unexplained diff vs previous) (percentage) | 11.27% | 0.710 | 0.790 | - | 393.75% | - |
| 445.gobmk (avg) (percentage) | 7.14% | 0.280 | 0.300 | - | -55.22% | - |
| Performance Regressions - Score | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| nb_total_tests | -5.00% | 20.000 | 19.000 | - | 0.00% | - |
| Performance Improvements - sample variability | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 462.libquantum (max) (percentage) | -96.52% | 5.170 | 0.180 | - | -97.18% | - |
| 462.libquantum (unexplained diff vs previous) (percentage) | -96.34% | 4.920 | 0.180 | - | 1700.00% | - |
| 403.gcc (max) (percentage) | -95.45% | 10.330 | 0.470 | - | -79.83% | - |
| 462.libquantum (avg) (percentage) | -87.82% | 1.560 | 0.190 | - | -75.32% | - |
| 403.gcc (avg) (percentage) | -85.63% | 3.270 | 0.470 | - | -14.55% | - |
| 450.soplex (avg) (percentage) | -79.23% | 1.300 | 0.270 | - | -46.00% | - |
| 433.milc (avg) (percentage) | -78.26% | 0.690 | 0.150 | - | -82.56% | - |
| 433.milc (max) (percentage) | -77.01% | 0.870 | 0.200 | - | -75.00% | - |
| 473.astar (avg) (percentage) | -74.51% | 0.510 | 0.130 | - | -85.87% | - |
| 483.xalancbmk (avg) (percentage) | -69.44% | 1.440 | 0.440 | - | -79.25% | - |
| 450.soplex (unexplained diff vs previous) (percentage) | -67.27% | 0.550 | 0.180 | - | -60.87% | - |
| 456.hmmer (unexplained diff vs previous) (percentage) | -56.06% | 0.660 | 0.290 | - | -25.64% | - |
| 401.bzip2 (avg) (percentage) | -52.38% | 0.420 | 0.200 | - | -69.23% | - |
| 458.sjeng (avg) (percentage) | -51.52% | 0.330 | 0.160 | - | -80.00% | - |
| 429.mcf (avg) (percentage) | -51.18% | 1.270 | 0.620 | - | -70.75% | - |
| 471.omnetpp (avg) (percentage) | -50.37% | 1.350 | 0.670 | - | -58.13% | - |
| 464.h264ref (max) (percentage) | -48.15% | 0.270 | 0.140 | - | -66.67% | - |
| 401.bzip2 (max) (percentage) | -47.37% | 0.380 | 0.200 | - | -94.71% | - |
| 456.hmmer (avg) (percentage) | -40.26% | 0.770 | 0.460 | - | -66.91% | - |
| 471.omnetpp (unexplained diff vs previous) (percentage) | -33.90% | 1.180 | 0.780 | - | -20.41% | - |
| 464.h264ref (avg) (percentage) | -31.82% | 0.220 | 0.150 | - | -48.28% | - |
| 473.astar (max) (percentage) | -27.78% | 0.180 | 0.130 | - | -98.06% | - |
| 473.astar | -26.09% | 23.000 | 17.000 | - | -84.82% | - |
| 473.astar (avg) | -26.09% | 23.000 | 17.000 | - | -84.82% | - |
| 458.sjeng (unexplained diff vs previous) (percentage) | -15.38% | 0.130 | 0.110 | - | 0.00% | - |
| 456.hmmer (max) (percentage) | -14.71% | 0.680 | 0.580 | - | -94.47% | - |
| 458.sjeng (max) (percentage) | -13.04% | 0.230 | 0.200 | - | -96.11% | - |
| 458.sjeng | -7.41% | 27.000 | 25.000 | - | -81.62% | - |
| 458.sjeng (avg) | -7.41% | 27.000 | 25.000 | - | -81.62% | - |
| Performance Improvements - Score | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| nb_execution_successful | 5.88% | 17.000 | 18.000 | - | 0.00% | - |
| nb_compile_successful | 5.56% | 18.000 | 19.000 | - | 0.00% | - |
| Added Tests - Code Size |
|---|
| 483.xalancbmk |
| Added Tests - Execution |
|---|
| 483.xalancbmk |
| Added Tests - sample variability |
|---|
| 403.gcc (unexplained diff vs previous) |
| 403.gcc (unexplained diff vs previous) (percentage) |
| 433.milc (unexplained diff vs previous) |
| 433.milc (unexplained diff vs previous) (percentage) |
| 445.gobmk (unexplained diff vs previous) |
| 445.gobmk (unexplained diff vs previous) (percentage) |
| 447.dealII (unexplained diff vs previous) |
| 447.dealII (unexplained diff vs previous) (percentage) |
| 453.povray (unexplained diff vs previous) |
| 453.povray (unexplained diff vs previous) (percentage) |
| 464.h264ref (unexplained diff vs previous) |
| 464.h264ref (unexplained diff vs previous) (percentage) |
| 470.lbm (unexplained diff vs previous) |
| 470.lbm (unexplained diff vs previous) (percentage) |
| 473.astar (unexplained diff vs previous) |
| 473.astar (unexplained diff vs previous) (percentage) |
| 482.sphinx3 (unexplained diff vs previous) |
| 482.sphinx3 (unexplained diff vs previous) (percentage) |
| 483.xalancbmk |
| 483.xalancbmk (avg) |
| 483.xalancbmk (max) |
| 483.xalancbmk (unexplained diff vs previous) |
| 483.xalancbmk (unexplained diff vs previous) (percentage) |
| Performance Regressions - Code Size | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 450.soplex | 2.73% | 146765.000 | 150769.000 | - | 0.79% | - |
| 471.omnetpp | 1.60% | 316676.000 | 321756.000 | - | -0.06% | - |
| 447.dealII | 1.13% | 195792.000 | 198002.000 | - | 1.59% | - |
| Performance Regressions - Execution | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 470.lbm | 15.52% | 13259.000 | 15317.000 | - | 283.21% | - |
| 456.hmmer | 14.53% | 11854.000 | 13576.000 | - | 255.95% | - |
| 483.xalancbmk | 13.66% | 9376.000 | 10657.000 | - | 0.00% | - |
| 447.dealII | 12.16% | 9380.000 | 10521.000 | - | 441.48% | - |
| 482.sphinx3 | 10.44% | 26682.000 | 29467.000 | - | 2891.57% | - |
| 464.h264ref | 10.03% | 14498.000 | 15952.000 | - | 168.42% | - |
| 473.astar | 9.69% | 12272.000 | 13461.000 | - | 191.68% | - |
| 471.omnetpp | 9.48% | 10477.000 | 11470.000 | - | 298.26% | - |
| 462.libquantum | 7.72% | 14409.000 | 15522.000 | - | 8381.97% | - |
| 444.namd | 3.92% | 12400.000 | 12886.000 | - | 1479.17% | - |
| 445.gobmk | 3.71% | 11093.000 | 11504.000 | - | 135.21% | - |
| 403.gcc | 3.68% | 9509.000 | 9859.000 | - | 16610.17% | - |
| 401.bzip2 | 3.19% | 16137.000 | 16652.000 | - | 487.17% | - |
| 433.milc | 2.44% | 13601.000 | 13933.000 | - | 1088.82% | - |
| 450.soplex | 1.53% | 15112.000 | 15343.000 | - | 2730.81% | - |
| Performance Regressions - sample variability | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 444.namd (unexplained diff vs previous) (percentage) | 10266.67% | 0.060 | 6.220 | - | 5083.33% | - |
| 444.namd (unexplained diff vs previous) | 9925.00% | 8.000 | 802.000 | - | 80100.00% | - |
| 462.libquantum (unexplained diff vs previous) | 2700.00% | 1.000 | 28.000 | - | 211.11% | - |
| 462.libquantum (unexplained diff vs previous) (percentage) | 1700.00% | 0.010 | 0.180 | - | -96.34% | - |
| 453.povray (max) (percentage) | 586.11% | 0.360 | 2.470 | - | 139.81% | - |
| 453.povray (max) | 584.00% | 25.000 | 171.000 | - | 3320.00% | - |
| 429.mcf (unexplained diff vs previous) (percentage) | 393.75% | 0.160 | 0.790 | - | 11.27% | - |
| 403.gcc (unexplained diff vs previous) | 318.18% | 11.000 | 46.000 | - | 0.00% | - |
| 429.mcf (unexplained diff vs previous) | 318.18% | 22.000 | 92.000 | - | 1050.00% | - |
| 403.gcc (unexplained diff vs previous) (percentage) | 291.67% | 0.120 | 0.470 | - | 0.00% | - |
| 453.povray | 210.91% | 55.000 | 171.000 | - | 4175.00% | - |
| 453.povray (avg) | 210.91% | 55.000 | 171.000 | - | 4175.00% | - |
| 453.povray (avg) (percentage) | 208.75% | 0.800 | 2.470 | - | 171.43% | - |
| 447.dealII (unexplained diff vs previous) | 170.37% | 54.000 | 146.000 | - | 0.00% | - |
| 447.dealII (unexplained diff vs previous) (percentage) | 139.66% | 0.580 | 1.390 | - | 0.00% | - |
| 470.lbm | 88.89% | 441.000 | 833.000 | - | 3866.67% | - |
| 470.lbm (avg) | 88.89% | 441.000 | 833.000 | - | 3866.67% | - |
| 470.lbm (avg) (percentage) | 63.36% | 3.330 | 5.440 | - | 889.09% | - |
| 444.namd | 58.18% | 318.000 | 503.000 | - | 8283.33% | - |
| 444.namd (avg) | 58.18% | 318.000 | 503.000 | - | 8283.33% | - |
| 444.namd (avg) (percentage) | 52.14% | 2.570 | 3.910 | - | 421.33% | - |
| 447.dealII | 46.94% | 98.000 | 144.000 | - | 928.57% | - |
| 447.dealII (avg) | 46.94% | 98.000 | 144.000 | - | 928.57% | - |
| 470.lbm (max) | 45.78% | 758.000 | 1105.000 | - | 4150.00% | - |
| 447.dealII (avg) (percentage) | 30.48% | 1.050 | 1.370 | - | 85.14% | - |
| 470.lbm (unexplained diff vs previous) | 28.36% | 804.000 | 1032.000 | - | 0.00% | - |
| 470.lbm (max) (percentage) | 26.22% | 5.720 | 7.220 | - | 993.94% | - |
| 482.sphinx3 | 21.77% | 464.000 | 565.000 | - | 7971.43% | - |
| 482.sphinx3 (avg) | 21.77% | 464.000 | 565.000 | - | 7971.43% | - |
| 470.lbm (unexplained diff vs previous) (percentage) | 11.22% | 6.060 | 6.740 | - | 0.00% | - |
| 482.sphinx3 (avg) (percentage) | 10.34% | 1.740 | 1.920 | - | 140.00% | - |
| 450.soplex (max) | 2.01% | 249.000 | 254.000 | - | 4133.33% | - |
| Performance Improvements - Execution | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 429.mcf | -17.21% | 13988.000 | 11580.000 | - | 925.69% | - |
| 458.sjeng | -6.50% | 17055.000 | 15946.000 | - | 94.72% | - |
| Performance Improvements - sample variability | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 473.astar (max) (percentage) | -98.06% | 6.700 | 0.130 | - | -27.78% | - |
| 473.astar (max) | -97.93% | 822.000 | 17.000 | - | 112.50% | - |
| 462.libquantum (max) (percentage) | -97.18% | 6.380 | 0.180 | - | -96.52% | - |
| 462.libquantum (max) | -97.06% | 919.000 | 27.000 | - | 200.00% | - |
| 483.xalancbmk (max) (percentage) | -96.59% | 12.900 | 0.440 | - | 780.00% | - |
| 458.sjeng (max) | -96.46% | 876.000 | 31.000 | - | 72.22% | - |
| 483.xalancbmk (max) | -96.20% | 1209.000 | 46.000 | - | 0.00% | - |
| 458.sjeng (max) (percentage) | -96.11% | 5.140 | 0.200 | - | -13.04% | - |
| 401.bzip2 (max) (percentage) | -94.71% | 3.780 | 0.200 | - | -47.37% | - |
| 401.bzip2 (max) | -94.58% | 609.000 | 33.000 | - | 230.00% | - |
| 456.hmmer (max) (percentage) | -94.47% | 10.480 | 0.580 | - | -14.71% | - |
| 456.hmmer (max) | -93.72% | 1242.000 | 78.000 | - | 212.00% | - |
| 445.gobmk (max) (percentage) | -91.96% | 3.730 | 0.300 | - | 57.89% | - |
| 445.gobmk (max) | -91.77% | 413.000 | 34.000 | - | 277.78% | - |
| 473.astar (avg) (percentage) | -85.87% | 0.920 | 0.130 | - | -74.51% | - |
| 473.astar | -84.82% | 112.000 | 17.000 | - | -26.09% | - |
| 473.astar (avg) | -84.82% | 112.000 | 17.000 | - | -26.09% | - |
| 433.milc | -82.76% | 116.000 | 20.000 | - | 150.00% | - |
| 433.milc (avg) | -82.76% | 116.000 | 20.000 | - | 150.00% | - |
| 433.milc (avg) (percentage) | -82.56% | 0.860 | 0.150 | - | -78.26% | - |
| 458.sjeng | -81.62% | 136.000 | 25.000 | - | -7.41% | - |
| 458.sjeng (avg) | -81.62% | 136.000 | 25.000 | - | -7.41% | - |
| 458.sjeng (avg) (percentage) | -80.00% | 0.800 | 0.160 | - | -51.52% | - |
| 403.gcc (max) (percentage) | -79.83% | 2.330 | 0.470 | - | -95.45% | - |
| 483.xalancbmk (avg) (percentage) | -79.25% | 2.120 | 0.440 | - | -69.44% | - |
| 403.gcc (max) | -79.19% | 221.000 | 46.000 | - | 666.67% | - |
| 483.xalancbmk | -76.77% | 198.000 | 46.000 | - | 0.00% | - |
| 483.xalancbmk (avg) | -76.77% | 198.000 | 46.000 | - | 0.00% | - |
| 429.mcf | -76.01% | 296.000 | 71.000 | - | 407.14% | - |
| 429.mcf (avg) | -76.01% | 296.000 | 71.000 | - | 407.14% | - |
| 462.libquantum (avg) (percentage) | -75.32% | 0.770 | 0.190 | - | -87.82% | - |
| 433.milc (max) (percentage) | -75.00% | 0.800 | 0.200 | - | -77.01% | - |
| 433.milc (max) | -75.00% | 108.000 | 27.000 | - | 170.00% | - |
| 462.libquantum | -73.64% | 110.000 | 29.000 | - | 1350.00% | - |
| 462.libquantum (avg) | -73.64% | 110.000 | 29.000 | - | 1350.00% | - |
| 429.mcf (avg) (percentage) | -70.75% | 2.120 | 0.620 | - | -51.18% | - |
| 401.bzip2 (avg) (percentage) | -69.23% | 0.650 | 0.200 | - | -52.38% | - |
| 401.bzip2 | -68.27% | 104.000 | 33.000 | - | 200.00% | - |
| 401.bzip2 (avg) | -68.27% | 104.000 | 33.000 | - | 200.00% | - |
| 456.hmmer (avg) (percentage) | -66.91% | 1.390 | 0.460 | - | -40.26% | - |
| 464.h264ref (max) (percentage) | -66.67% | 0.420 | 0.140 | - | -48.15% | - |
| 429.mcf (max) | -64.31% | 2281.000 | 814.000 | - | 5714.29% | - |
| 464.h264ref (max) | -63.33% | 60.000 | 22.000 | - | 37.50% | - |
| 456.hmmer | -62.20% | 164.000 | 62.000 | - | 113.79% | - |
| 456.hmmer (avg) | -62.20% | 164.000 | 62.000 | - | 113.79% | - |
| 450.soplex (unexplained diff vs previous) | -60.87% | 69.000 | 27.000 | - | 800.00% | - |
| 450.soplex (unexplained diff vs previous) (percentage) | -60.87% | 0.460 | 0.180 | - | -67.27% | - |
| 471.omnetpp (avg) (percentage) | -58.13% | 1.600 | 0.670 | - | -50.37% | - |
| 429.mcf (max) (percentage) | -56.90% | 16.310 | 7.030 | - | 432.58% | - |
| 445.gobmk (avg) (percentage) | -55.22% | 0.670 | 0.300 | - | 7.14% | - |
| 471.omnetpp (max) (percentage) | -55.17% | 9.280 | 4.160 | - | 199.28% | - |
| 471.omnetpp | -54.49% | 167.000 | 76.000 | - | 100.00% | - |
| 471.omnetpp (avg) | -54.49% | 167.000 | 76.000 | - | 100.00% | - |
| 445.gobmk | -54.05% | 74.000 | 34.000 | - | 161.54% | - |
| 445.gobmk (avg) | -54.05% | 74.000 | 34.000 | - | 161.54% | - |
| 471.omnetpp (max) | -50.93% | 972.000 | 477.000 | - | 1092.50% | - |
| 464.h264ref (avg) (percentage) | -48.28% | 0.290 | 0.150 | - | -31.82% | - |
| 450.soplex (avg) (percentage) | -46.00% | 0.500 | 0.270 | - | -79.23% | - |
| 450.soplex | -45.33% | 75.000 | 41.000 | - | 485.71% | - |
| 450.soplex (avg) | -45.33% | 75.000 | 41.000 | - | 485.71% | - |
| 464.h264ref | -45.24% | 42.000 | 23.000 | - | 76.92% | - |
| 464.h264ref (avg) | -45.24% | 42.000 | 23.000 | - | 76.92% | - |
| 447.dealII (max) (percentage) | -42.44% | 2.380 | 1.370 | - | 23.42% | - |
| 447.dealII (max) | -35.43% | 223.000 | 144.000 | - | 585.71% | - |
| 473.astar (unexplained diff vs previous) (percentage) | -35.00% | 0.200 | 0.130 | - | 0.00% | - |
| 473.astar (unexplained diff vs previous) | -28.00% | 25.000 | 18.000 | - | 0.00% | - |
| 444.namd (max) (percentage) | -27.56% | 8.090 | 5.860 | - | 3562.50% | - |
| 456.hmmer (unexplained diff vs previous) (percentage) | -25.64% | 0.390 | 0.290 | - | -56.06% | - |
| 444.namd (max) | -24.73% | 1003.000 | 755.000 | - | 75400.00% | - |
| 471.omnetpp (unexplained diff vs previous) (percentage) | -20.41% | 0.980 | 0.780 | - | -33.90% | - |
| 482.sphinx3 (unexplained diff vs previous) (percentage) | -20.12% | 3.430 | 2.740 | - | 0.00% | - |
| 445.gobmk (unexplained diff vs previous) (percentage) | -16.67% | 0.360 | 0.300 | - | 0.00% | - |
| 482.sphinx3 (max) (percentage) | -15.11% | 3.310 | 2.810 | - | 93.79% | - |
| 445.gobmk (unexplained diff vs previous) | -15.00% | 40.000 | 34.000 | - | 0.00% | - |
| 403.gcc (avg) (percentage) | -14.55% | 0.550 | 0.470 | - | -85.63% | - |
| 456.hmmer (unexplained diff vs previous) | -13.04% | 46.000 | 40.000 | - | 60.00% | - |
| 471.omnetpp (unexplained diff vs previous) | -12.62% | 103.000 | 90.000 | - | 164.71% | - |
| 482.sphinx3 (unexplained diff vs previous) | -11.82% | 914.000 | 806.000 | - | 0.00% | - |
| 403.gcc | -11.54% | 52.000 | 46.000 | - | 4500.00% | - |
| 403.gcc (avg) | -11.54% | 52.000 | 46.000 | - | 4500.00% | - |
| 433.milc (unexplained diff vs previous) (percentage) | -10.00% | 0.100 | 0.090 | - | 0.00% | - |
| 482.sphinx3 (max) | -6.23% | 883.000 | 828.000 | - | 5814.29% | - |
| Added Tests - sample variability |
|---|
| 458.sjeng (unexplained diff vs previous) |
| 458.sjeng (unexplained diff vs previous) (percentage) |
| 464.h264ref (unexplained diff vs previous) |
| 464.h264ref (unexplained diff vs previous) (percentage) |
| 483.xalancbmk (unexplained diff vs previous) |
| 483.xalancbmk (unexplained diff vs previous) (percentage) |
Report Time: 0.36s