Fields
| hardware | None |
| os | None |
Parameters
Fields
| Name | Value |
|---|
Parameters
| Name | Value |
|---|---|
| git_llvm | https://github.com/llvm/llvm-project/commit/b3ab26b4aa2fe242218b1c0cfae9420f2c4021fa (+ 218 commits) |
| test_url | https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6-llvm-arm-master-Os-build/8/ |
Filter
llvm-arm-master-Os test results
| Run | Order | Start Time | Duration |
|---|---|---|---|
| Current | 0008 (llvmorg-17-init-01172-gb3ab26b4aa2f) | 2023-02-02T02:49:47 | 0:00:00 |
| Previous | 0007 (llvmorg-17-init-00954-gb88ebb3d94cb) | 2023-01-29T09:07:58 | 0:00:00 |
| Baseline | 0001 (llvmorg-16-init-16061-ge7790fbed32b) | 2022-12-29T19:41:07 | 0:00:00 |
Tests Summary
| Status Group | # | # (B) |
|---|---|---|
| Performance Regressions | 103 | 105 |
| Performance Improvements | 9 | 24 |
| Added Tests | 24 | 0 |
| Unchanged Tests | 644 | 651 |
| Total Tests | 780 |
| Performance Regressions - Execution | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 483.xalancbmk | 20.68% | 7737.000 | 9337.000 | - | -0.95% | - |
| 456.hmmer | 13.99% | 11805.000 | 13456.000 | - | 0.68% | - |
| 471.omnetpp | 13.46% | 9626.000 | 10922.000 | - | 1.64% | - |
| 470.lbm | 12.42% | 12208.000 | 13724.000 | - | -1.14% | - |
| 462.libquantum | 11.89% | 11744.000 | 13140.000 | - | 0.11% | - |
| 473.astar | 11.00% | 12859.000 | 14273.000 | - | 0.08% | - |
| 444.namd | 10.89% | 11410.000 | 12653.000 | - | -6.24% | - |
| 464.h264ref | 9.53% | 14183.000 | 15535.000 | - | 0.27% | - |
| 482.sphinx3 | 7.79% | 24436.000 | 26340.000 | - | 0.11% | - |
| 401.bzip2 | 4.24% | 15035.000 | 15673.000 | - | -0.06% | - |
| 445.gobmk | 4.15% | 11685.000 | 12170.000 | - | -1.85% | - |
| 433.milc | 3.95% | 12878.000 | 13387.000 | - | -0.70% | - |
| 403.gcc | 2.60% | 8890.000 | 9121.000 | - | 0.24% | - |
| 447.dealII | 1.23% | 7902.000 | 7999.000 | - | -2.40% | - |
| Performance Regressions - sample variability | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 429.mcf (unexplained diff vs previous) (percentage) | 52675.00% | 0.040 | 21.110 | - | 3669.64% | - |
| 429.mcf (unexplained diff vs previous) | 41866.67% | 6.000 | 2518.000 | - | 3658.21% | - |
| 429.mcf (max) (percentage) | 10793.75% | 0.160 | 17.430 | - | 3012.50% | - |
| 429.mcf (max) | 8939.13% | 23.000 | 2079.000 | - | 3002.99% | - |
| 470.lbm (unexplained diff vs previous) | 6491.30% | 23.000 | 1516.000 | - | 205.03% | - |
| 470.lbm (unexplained diff vs previous) (percentage) | 5715.79% | 0.190 | 11.050 | - | 208.66% | - |
| 464.h264ref (max) | 5003.45% | 29.000 | 1480.000 | - | 2366.67% | - |
| 464.h264ref (max) (percentage) | 4438.10% | 0.210 | 9.530 | - | 2343.59% | - |
| 462.libquantum (unexplained diff vs previous) | 4005.88% | 34.000 | 1396.000 | - | 8625.00% | - |
| 462.libquantum (unexplained diff vs previous) (percentage) | 3562.07% | 0.290 | 10.620 | - | 8750.00% | - |
| 456.hmmer (max) | 3260.71% | 56.000 | 1882.000 | - | 4605.00% | - |
| 462.libquantum (max) | 3087.76% | 49.000 | 1562.000 | - | 5907.69% | - |
| 456.hmmer (max) (percentage) | 2814.58% | 0.480 | 13.990 | - | 4563.33% | - |
| 462.libquantum (max) (percentage) | 2730.95% | 0.420 | 11.890 | - | 5845.00% | - |
| 473.astar (max) | 1912.82% | 78.000 | 1570.000 | - | 1277.19% | - |
| 433.milc (unexplained diff vs previous) | 1785.19% | 27.000 | 509.000 | - | 179.67% | - |
| 433.milc (unexplained diff vs previous) (percentage) | 1709.52% | 0.210 | 3.800 | - | 181.48% | - |
| 473.astar (max) (percentage) | 1703.28% | 0.610 | 11.000 | - | 1275.00% | - |
| 450.soplex (unexplained diff vs previous) (percentage) | 1050.00% | 0.040 | 0.460 | - | -19.30% | - |
| 450.soplex (unexplained diff vs previous) | 1000.00% | 6.000 | 66.000 | - | -19.51% | - |
| 433.milc (max) | 500.00% | 88.000 | 528.000 | - | 186.96% | - |
| 445.gobmk (max) | 487.21% | 86.000 | 505.000 | - | 1641.38% | - |
| 433.milc (max) (percentage) | 472.46% | 0.690 | 3.950 | - | 188.32% | - |
| 445.gobmk (max) (percentage) | 460.81% | 0.740 | 4.150 | - | 1629.17% | - |
| 471.omnetpp (max) | 321.20% | 349.000 | 1470.000 | - | 677.78% | - |
| 471.omnetpp (unexplained diff vs previous) | 284.57% | 337.000 | 1296.000 | - | 1308.70% | - |
| 470.lbm (max) | 283.78% | 444.000 | 1704.000 | - | 121.59% | - |
| 471.omnetpp (max) (percentage) | 270.80% | 3.630 | 13.460 | - | 664.77% | - |
| 482.sphinx3 (max) | 266.91% | 559.000 | 2051.000 | - | 134.94% | - |
| 470.lbm (max) (percentage) | 241.21% | 3.640 | 12.420 | - | 124.19% | - |
| 482.sphinx3 (max) (percentage) | 240.17% | 2.290 | 7.790 | - | 134.64% | - |
| 471.omnetpp (unexplained diff vs previous) (percentage) | 239.14% | 3.500 | 11.870 | - | 1280.23% | - |
| 483.xalancbmk | 138.57% | 140.000 | 334.000 | - | 610.64% | - |
| 483.xalancbmk (avg) | 138.57% | 140.000 | 334.000 | - | 610.64% | - |
| 462.libquantum | 114.29% | 84.000 | 180.000 | - | 847.37% | - |
| 462.libquantum (avg) | 114.29% | 84.000 | 180.000 | - | 847.37% | - |
| 456.hmmer | 109.29% | 140.000 | 293.000 | - | 510.42% | - |
| 456.hmmer (avg) | 109.29% | 140.000 | 293.000 | - | 510.42% | - |
| 444.namd (max) | 108.64% | 660.000 | 1377.000 | - | 56.12% | - |
| 483.xalancbmk (max) | 102.52% | 953.000 | 1930.000 | - | 3063.93% | - |
| 464.h264ref | 96.84% | 95.000 | 187.000 | - | 266.67% | - |
| 464.h264ref (avg) | 96.84% | 95.000 | 187.000 | - | 266.67% | - |
| 483.xalancbmk (avg) (percentage) | 96.70% | 1.820 | 3.580 | - | 616.00% | - |
| 462.libquantum (avg) (percentage) | 90.28% | 0.720 | 1.370 | - | 813.33% | - |
| 444.namd (max) (percentage) | 88.08% | 5.790 | 10.890 | - | 66.51% | - |
| 456.hmmer (avg) (percentage) | 83.19% | 1.190 | 2.180 | - | 505.56% | - |
| 473.astar | 82.35% | 136.000 | 248.000 | - | 249.30% | - |
| 473.astar (avg) | 82.35% | 136.000 | 248.000 | - | 249.30% | - |
| 464.h264ref (avg) (percentage) | 80.60% | 0.670 | 1.210 | - | 266.67% | - |
| 403.gcc (max) | 79.55% | 132.000 | 237.000 | - | 597.06% | - |
| 429.mcf (avg) (percentage) | 77.24% | 1.230 | 2.180 | - | 384.44% | - |
| 403.gcc (max) (percentage) | 74.50% | 1.490 | 2.600 | - | 584.21% | - |
| 401.bzip2 | 73.02% | 63.000 | 109.000 | - | 220.59% | - |
| 401.bzip2 (avg) | 73.02% | 63.000 | 109.000 | - | 220.59% | - |
| 483.xalancbmk (max) (percentage) | 67.86% | 12.320 | 20.680 | - | 3081.54% | - |
| 401.bzip2 (avg) (percentage) | 66.67% | 0.420 | 0.700 | - | 218.18% | - |
| 450.soplex (max) | 65.00% | 40.000 | 66.000 | - | -19.51% | - |
| 450.soplex (max) (percentage) | 64.29% | 0.280 | 0.460 | - | -19.30% | - |
| 473.astar (avg) (percentage) | 64.15% | 1.060 | 1.740 | - | 248.00% | - |
| 445.gobmk | 62.07% | 58.000 | 94.000 | - | 327.27% | - |
| 445.gobmk (avg) | 62.07% | 58.000 | 94.000 | - | 327.27% | - |
| 471.omnetpp | 60.40% | 149.000 | 239.000 | - | 187.95% | - |
| 471.omnetpp (avg) | 60.40% | 149.000 | 239.000 | - | 187.95% | - |
| 458.sjeng (max) (percentage) | 57.14% | 3.780 | 5.940 | - | 1385.00% | - |
| 445.gobmk (avg) (percentage) | 56.00% | 0.500 | 0.780 | - | 333.33% | - |
| 401.bzip2 (max) | 53.35% | 433.000 | 664.000 | - | 1283.33% | - |
| 458.sjeng (avg) (percentage) | 48.75% | 0.800 | 1.190 | - | 105.17% | - |
| 458.sjeng (max) | 47.87% | 658.000 | 973.000 | - | 1396.92% | - |
| 401.bzip2 (max) (percentage) | 47.22% | 2.880 | 4.240 | - | 1267.74% | - |
| 429.mcf | 46.89% | 177.000 | 260.000 | - | 390.57% | - |
| 429.mcf (avg) | 46.89% | 177.000 | 260.000 | - | 390.57% | - |
| 471.omnetpp (avg) (percentage) | 41.29% | 1.550 | 2.190 | - | 180.77% | - |
| 458.sjeng | 40.29% | 139.000 | 195.000 | - | 105.26% | - |
| 458.sjeng (avg) | 40.29% | 139.000 | 195.000 | - | 105.26% | - |
| 403.gcc | 32.14% | 56.000 | 74.000 | - | 72.09% | - |
| 403.gcc (avg) | 32.14% | 56.000 | 74.000 | - | 72.09% | - |
| 470.lbm | 30.75% | 374.000 | 489.000 | - | 51.86% | - |
| 470.lbm (avg) | 30.75% | 374.000 | 489.000 | - | 51.86% | - |
| 482.sphinx3 | 30.00% | 520.000 | 676.000 | - | 38.24% | - |
| 482.sphinx3 (avg) | 30.00% | 520.000 | 676.000 | - | 38.24% | - |
| 403.gcc (avg) (percentage) | 28.12% | 0.640 | 0.820 | - | 70.83% | - |
| 444.namd | 24.40% | 459.000 | 571.000 | - | 11.09% | - |
| 444.namd (avg) | 24.40% | 459.000 | 571.000 | - | 11.09% | - |
| 433.milc | 23.85% | 109.000 | 135.000 | - | -0.74% | - |
| 433.milc (avg) | 23.85% | 109.000 | 135.000 | - | -0.74% | - |
| 482.sphinx3 (avg) (percentage) | 20.66% | 2.130 | 2.570 | - | 38.17% | - |
| 433.milc (avg) (percentage) | 18.82% | 0.850 | 1.010 | - | 0.00% | - |
| 470.lbm (avg) (percentage) | 16.29% | 3.070 | 3.570 | - | 53.88% | - |
| 444.namd (avg) (percentage) | 12.16% | 4.030 | 4.520 | - | 18.64% | - |
| Performance Improvements - Execution | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 429.mcf | -17.43% | 14446.000 | 11928.000 | - | -0.59% | - |
| 458.sjeng | -5.94% | 17422.000 | 16388.000 | - | -0.11% | - |
| Performance Improvements - sample variability | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 453.povray (max) | -12.21% | 131.000 | 115.000 | - | -12.88% | - |
| 453.povray (max) (percentage) | -12.18% | 1.970 | 1.730 | - | -10.36% | - |
| 453.povray (avg) (percentage) | -8.40% | 1.310 | 1.200 | - | -12.41% | - |
| 453.povray | -8.05% | 87.000 | 80.000 | - | -13.98% | - |
| 453.povray (avg) | -8.05% | 87.000 | 80.000 | - | -13.98% | - |
| 447.dealII (max) (percentage) | -1.87% | 2.140 | 2.100 | - | 32.91% | - |
| 447.dealII (max) | -1.18% | 169.000 | 167.000 | - | 29.46% | - |
| Added Tests - sample variability |
|---|
| 401.bzip2 (unexplained diff vs previous) |
| 401.bzip2 (unexplained diff vs previous) (percentage) |
| 403.gcc (unexplained diff vs previous) |
| 403.gcc (unexplained diff vs previous) (percentage) |
| 444.namd (unexplained diff vs previous) |
| 444.namd (unexplained diff vs previous) (percentage) |
| 445.gobmk (unexplained diff vs previous) |
| 445.gobmk (unexplained diff vs previous) (percentage) |
| 447.dealII (unexplained diff vs previous) |
| 447.dealII (unexplained diff vs previous) (percentage) |
| 453.povray (unexplained diff vs previous) |
| 453.povray (unexplained diff vs previous) (percentage) |
| 456.hmmer (unexplained diff vs previous) |
| 456.hmmer (unexplained diff vs previous) (percentage) |
| 458.sjeng (unexplained diff vs previous) |
| 458.sjeng (unexplained diff vs previous) (percentage) |
| 464.h264ref (unexplained diff vs previous) |
| 464.h264ref (unexplained diff vs previous) (percentage) |
| 473.astar (unexplained diff vs previous) |
| 473.astar (unexplained diff vs previous) (percentage) |
| 482.sphinx3 (unexplained diff vs previous) |
| 482.sphinx3 (unexplained diff vs previous) (percentage) |
| 483.xalancbmk (unexplained diff vs previous) |
| 483.xalancbmk (unexplained diff vs previous) (percentage) |
| Performance Regressions - Execution | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 471.omnetpp | 1.64% | 10746.000 | 10922.000 | - | 13.46% | - |
| Performance Regressions - sample variability | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 456.hmmer (unexplained diff vs previous) | 18244.44% | 9.000 | 1651.000 | - | 0.00% | - |
| 456.hmmer (unexplained diff vs previous) (percentage) | 17428.57% | 0.070 | 12.270 | - | 0.00% | - |
| 462.libquantum (unexplained diff vs previous) (percentage) | 8750.00% | 0.120 | 10.620 | - | 3562.07% | - |
| 462.libquantum (unexplained diff vs previous) | 8625.00% | 16.000 | 1396.000 | - | 4005.88% | - |
| 462.libquantum (max) | 5907.69% | 26.000 | 1562.000 | - | 3087.76% | - |
| 462.libquantum (max) (percentage) | 5845.00% | 0.200 | 11.890 | - | 2730.95% | - |
| 456.hmmer (max) | 4605.00% | 40.000 | 1882.000 | - | 3260.71% | - |
| 456.hmmer (max) (percentage) | 4563.33% | 0.300 | 13.990 | - | 2814.58% | - |
| 429.mcf (unexplained diff vs previous) (percentage) | 3669.64% | 0.560 | 21.110 | - | 52675.00% | - |
| 429.mcf (unexplained diff vs previous) | 3658.21% | 67.000 | 2518.000 | - | 41866.67% | - |
| 483.xalancbmk (max) (percentage) | 3081.54% | 0.650 | 20.680 | - | 67.86% | - |
| 483.xalancbmk (max) | 3063.93% | 61.000 | 1930.000 | - | 102.52% | - |
| 429.mcf (max) (percentage) | 3012.50% | 0.560 | 17.430 | - | 10793.75% | - |
| 429.mcf (max) | 3002.99% | 67.000 | 2079.000 | - | 8939.13% | - |
| 483.xalancbmk (unexplained diff vs previous) (percentage) | 2536.92% | 0.650 | 17.140 | - | 0.00% | - |
| 483.xalancbmk (unexplained diff vs previous) | 2522.95% | 61.000 | 1600.000 | - | 0.00% | - |
| 458.sjeng (unexplained diff vs previous) (percentage) | 2424.00% | 0.250 | 6.310 | - | 0.00% | - |
| 458.sjeng (unexplained diff vs previous) | 2421.95% | 41.000 | 1034.000 | - | 0.00% | - |
| 464.h264ref (max) | 2366.67% | 60.000 | 1480.000 | - | 5003.45% | - |
| 464.h264ref (max) (percentage) | 2343.59% | 0.390 | 9.530 | - | 4438.10% | - |
| 464.h264ref (unexplained diff vs previous) | 2153.33% | 60.000 | 1352.000 | - | 0.00% | - |
| 464.h264ref (unexplained diff vs previous) (percentage) | 2130.77% | 0.390 | 8.700 | - | 0.00% | - |
| 445.gobmk (max) | 1641.38% | 29.000 | 505.000 | - | 487.21% | - |
| 445.gobmk (max) (percentage) | 1629.17% | 0.240 | 4.150 | - | 460.81% | - |
| 445.gobmk (unexplained diff vs previous) (percentage) | 1562.50% | 0.240 | 3.990 | - | 0.00% | - |
| 445.gobmk (unexplained diff vs previous) | 1516.67% | 30.000 | 485.000 | - | 0.00% | - |
| 458.sjeng (max) | 1396.92% | 65.000 | 973.000 | - | 47.87% | - |
| 458.sjeng (max) (percentage) | 1385.00% | 0.400 | 5.940 | - | 57.14% | - |
| 471.omnetpp (unexplained diff vs previous) | 1308.70% | 92.000 | 1296.000 | - | 284.57% | - |
| 401.bzip2 (max) | 1283.33% | 48.000 | 664.000 | - | 53.35% | - |
| 471.omnetpp (unexplained diff vs previous) (percentage) | 1280.23% | 0.860 | 11.870 | - | 239.14% | - |
| 473.astar (max) | 1277.19% | 114.000 | 1570.000 | - | 1912.82% | - |
| 473.astar (max) (percentage) | 1275.00% | 0.800 | 11.000 | - | 1703.28% | - |
| 401.bzip2 (max) (percentage) | 1267.74% | 0.310 | 4.240 | - | 47.22% | - |
| 401.bzip2 (unexplained diff vs previous) (percentage) | 1212.90% | 0.310 | 4.070 | - | 0.00% | - |
| 473.astar (unexplained diff vs previous) | 1209.26% | 108.000 | 1414.000 | - | 0.00% | - |
| 473.astar (unexplained diff vs previous) (percentage) | 1203.95% | 0.760 | 9.910 | - | 0.00% | - |
| 401.bzip2 (unexplained diff vs previous) | 1202.04% | 49.000 | 638.000 | - | 0.00% | - |
| 462.libquantum | 847.37% | 19.000 | 180.000 | - | 114.29% | - |
| 462.libquantum (avg) | 847.37% | 19.000 | 180.000 | - | 114.29% | - |
| 462.libquantum (avg) (percentage) | 813.33% | 0.150 | 1.370 | - | 90.28% | - |
| 471.omnetpp (max) | 677.78% | 189.000 | 1470.000 | - | 321.20% | - |
| 471.omnetpp (max) (percentage) | 664.77% | 1.760 | 13.460 | - | 270.80% | - |
| 483.xalancbmk (avg) (percentage) | 616.00% | 0.500 | 3.580 | - | 96.70% | - |
| 483.xalancbmk | 610.64% | 47.000 | 334.000 | - | 138.57% | - |
| 483.xalancbmk (avg) | 610.64% | 47.000 | 334.000 | - | 138.57% | - |
| 403.gcc (max) | 597.06% | 34.000 | 237.000 | - | 79.55% | - |
| 403.gcc (max) (percentage) | 584.21% | 0.380 | 2.600 | - | 74.50% | - |
| 403.gcc (unexplained diff vs previous) (percentage) | 583.78% | 0.370 | 2.530 | - | 0.00% | - |
| 403.gcc (unexplained diff vs previous) | 579.41% | 34.000 | 231.000 | - | 0.00% | - |
| 456.hmmer | 510.42% | 48.000 | 293.000 | - | 109.29% | - |
| 456.hmmer (avg) | 510.42% | 48.000 | 293.000 | - | 109.29% | - |
| 456.hmmer (avg) (percentage) | 505.56% | 0.360 | 2.180 | - | 83.19% | - |
| 429.mcf | 390.57% | 53.000 | 260.000 | - | 46.89% | - |
| 429.mcf (avg) | 390.57% | 53.000 | 260.000 | - | 46.89% | - |
| 429.mcf (avg) (percentage) | 384.44% | 0.450 | 2.180 | - | 77.24% | - |
| 445.gobmk (avg) (percentage) | 333.33% | 0.180 | 0.780 | - | 56.00% | - |
| 445.gobmk | 327.27% | 22.000 | 94.000 | - | 62.07% | - |
| 445.gobmk (avg) | 327.27% | 22.000 | 94.000 | - | 62.07% | - |
| 464.h264ref | 266.67% | 51.000 | 187.000 | - | 96.84% | - |
| 464.h264ref (avg) | 266.67% | 51.000 | 187.000 | - | 96.84% | - |
| 464.h264ref (avg) (percentage) | 266.67% | 0.330 | 1.210 | - | 80.60% | - |
| 473.astar | 249.30% | 71.000 | 248.000 | - | 82.35% | - |
| 473.astar (avg) | 249.30% | 71.000 | 248.000 | - | 82.35% | - |
| 473.astar (avg) (percentage) | 248.00% | 0.500 | 1.740 | - | 64.15% | - |
| 401.bzip2 | 220.59% | 34.000 | 109.000 | - | 73.02% | - |
| 401.bzip2 (avg) | 220.59% | 34.000 | 109.000 | - | 73.02% | - |
| 401.bzip2 (avg) (percentage) | 218.18% | 0.220 | 0.700 | - | 66.67% | - |
| 470.lbm (unexplained diff vs previous) (percentage) | 208.66% | 3.580 | 11.050 | - | 5715.79% | - |
| 470.lbm (unexplained diff vs previous) | 205.03% | 497.000 | 1516.000 | - | 6491.30% | - |
| 433.milc (max) (percentage) | 188.32% | 1.370 | 3.950 | - | 472.46% | - |
| 471.omnetpp | 187.95% | 83.000 | 239.000 | - | 60.40% | - |
| 471.omnetpp (avg) | 187.95% | 83.000 | 239.000 | - | 60.40% | - |
| 433.milc (max) | 186.96% | 184.000 | 528.000 | - | 500.00% | - |
| 433.milc (unexplained diff vs previous) (percentage) | 181.48% | 1.350 | 3.800 | - | 1709.52% | - |
| 471.omnetpp (avg) (percentage) | 180.77% | 0.780 | 2.190 | - | 41.29% | - |
| 433.milc (unexplained diff vs previous) | 179.67% | 182.000 | 509.000 | - | 1785.19% | - |
| 482.sphinx3 (max) | 134.94% | 873.000 | 2051.000 | - | 266.91% | - |
| 482.sphinx3 (max) (percentage) | 134.64% | 3.320 | 7.790 | - | 240.17% | - |
| 470.lbm (max) (percentage) | 124.19% | 5.540 | 12.420 | - | 241.21% | - |
| 470.lbm (max) | 121.59% | 769.000 | 1704.000 | - | 283.78% | - |
| 482.sphinx3 (unexplained diff vs previous) | 110.62% | 904.000 | 1904.000 | - | 0.00% | - |
| 482.sphinx3 (unexplained diff vs previous) (percentage) | 110.17% | 3.440 | 7.230 | - | 0.00% | - |
| 458.sjeng | 105.26% | 95.000 | 195.000 | - | 40.29% | - |
| 458.sjeng (avg) | 105.26% | 95.000 | 195.000 | - | 40.29% | - |
| 458.sjeng (avg) (percentage) | 105.17% | 0.580 | 1.190 | - | 48.75% | - |
| 403.gcc | 72.09% | 43.000 | 74.000 | - | 32.14% | - |
| 403.gcc (avg) | 72.09% | 43.000 | 74.000 | - | 32.14% | - |
| 403.gcc (avg) (percentage) | 70.83% | 0.480 | 0.820 | - | 28.12% | - |
| 444.namd (max) (percentage) | 66.51% | 6.540 | 10.890 | - | 88.08% | - |
| 444.namd (unexplained diff vs previous) (percentage) | 59.93% | 6.140 | 9.820 | - | 0.00% | - |
| 444.namd (max) | 56.12% | 882.000 | 1377.000 | - | 108.64% | - |
| 470.lbm (avg) (percentage) | 53.88% | 2.320 | 3.570 | - | 16.29% | - |
| 470.lbm | 51.86% | 322.000 | 489.000 | - | 30.75% | - |
| 470.lbm (avg) | 51.86% | 322.000 | 489.000 | - | 30.75% | - |
| 444.namd (unexplained diff vs previous) | 50.12% | 828.000 | 1243.000 | - | 0.00% | - |
| 482.sphinx3 | 38.24% | 489.000 | 676.000 | - | 30.00% | - |
| 482.sphinx3 (avg) | 38.24% | 489.000 | 676.000 | - | 30.00% | - |
| 482.sphinx3 (avg) (percentage) | 38.17% | 1.860 | 2.570 | - | 20.66% | - |
| 447.dealII (max) (percentage) | 32.91% | 1.580 | 2.100 | - | -1.87% | - |
| 447.dealII (max) | 29.46% | 129.000 | 167.000 | - | -1.18% | - |
| 444.namd (avg) (percentage) | 18.64% | 3.810 | 4.520 | - | 12.16% | - |
| 444.namd | 11.09% | 514.000 | 571.000 | - | 24.40% | - |
| 444.namd (avg) | 11.09% | 514.000 | 571.000 | - | 24.40% | - |
| Performance Improvements - Execution | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 444.namd | -6.24% | 13495.000 | 12653.000 | - | 10.89% | - |
| 447.dealII | -2.40% | 8196.000 | 7999.000 | - | 1.23% | - |
| 453.povray | -2.33% | 6857.000 | 6697.000 | - | 0.12% | - |
| 445.gobmk | -1.85% | 12400.000 | 12170.000 | - | 4.15% | - |
| 470.lbm | -1.14% | 13882.000 | 13724.000 | - | 12.42% | - |
| Performance Improvements - sample variability | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 453.povray (unexplained diff vs previous) | -93.85% | 130.000 | 8.000 | - | 0.00% | - |
| 453.povray (unexplained diff vs previous) (percentage) | -93.68% | 1.900 | 0.120 | - | 0.00% | - |
| 447.dealII (unexplained diff vs previous) | -19.83% | 121.000 | 97.000 | - | 0.00% | - |
| 450.soplex (max) | -19.51% | 82.000 | 66.000 | - | 65.00% | - |
| 450.soplex (unexplained diff vs previous) | -19.51% | 82.000 | 66.000 | - | 1000.00% | - |
| 450.soplex (max) (percentage) | -19.30% | 0.570 | 0.460 | - | 64.29% | - |
| 450.soplex (unexplained diff vs previous) (percentage) | -19.30% | 0.570 | 0.460 | - | 1050.00% | - |
| 447.dealII (unexplained diff vs previous) (percentage) | -18.24% | 1.480 | 1.210 | - | 0.00% | - |
| 447.dealII | -15.83% | 120.000 | 101.000 | - | 0.00% | - |
| 447.dealII (avg) | -15.83% | 120.000 | 101.000 | - | 0.00% | - |
| 453.povray | -13.98% | 93.000 | 80.000 | - | -8.05% | - |
| 453.povray (avg) | -13.98% | 93.000 | 80.000 | - | -8.05% | - |
| 447.dealII (avg) (percentage) | -13.61% | 1.470 | 1.270 | - | -0.78% | - |
| 453.povray (max) | -12.88% | 132.000 | 115.000 | - | -12.21% | - |
| 453.povray (avg) (percentage) | -12.41% | 1.370 | 1.200 | - | -8.40% | - |
| 453.povray (max) (percentage) | -10.36% | 1.930 | 1.730 | - | -12.18% | - |
| 450.soplex | -5.88% | 51.000 | 48.000 | - | 0.00% | - |
| 450.soplex (avg) | -5.88% | 51.000 | 48.000 | - | 0.00% | - |
| 450.soplex (avg) (percentage) | -5.56% | 0.360 | 0.340 | - | 0.00% | - |
Report Time: 0.34s