Fields
| hardware | None |
| os | None |
Parameters
Fields
| Name | Value |
|---|
Parameters
| Name | Value |
|---|---|
| git_llvm | https://github.com/llvm/llvm-project/commit/7c63431cc22c68742a6a42d3304fdb68431247c3 (+ 447 commits) |
| test_url | https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--llvm-aarch64-master-Oz_LTO-build/132/ |
Filter
llvm-aarch64-master-Oz_LTO test results
| Run | Order | Start Time | Duration |
|---|---|---|---|
| Current | 0132 (llvmorg-19-init-04482-g7c63431cc22c) | 2024-03-03T19:17:20 | 0:00:00 |
| Previous | 0131 (llvmorg-19-init-04035-g96b2c3bde72e) | 2024-02-29T06:56:53 | 0:00:00 |
| Baseline | 0001 (llvmorg-16-init-17110-gb1256f2345f6) | 2022-12-17T20:51:03 | 0:00:00 |
Tests Summary
| Status Group | # | # (B) |
|---|---|---|
| Performance Regressions | 122 | 43 |
| Performance Improvements | 12 | 88 |
| Added Tests | 6 | 59 |
| Unchanged Tests | 856 | 806 |
| Total Tests | 996 |
| Performance Regressions - Execution | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 450.soplex | 9.55% | 534.000 | 585.000 | - | -95.82% | - |
| 482.sphinx3 | 8.15% | 822.000 | 889.000 | - | -96.26% | - |
| 403.gcc | 7.25% | 69.000 | 74.000 | - | -99.27% | - |
| 400.perlbench | 6.34% | 1923.000 | 2045.000 | - | -81.55% | - |
| 471.omnetpp | 6.15% | 3041.000 | 3228.000 | - | -72.91% | - |
| 447.dealII | 4.77% | 1887.000 | 1977.000 | - | -78.28% | - |
| 462.libquantum | 4.62% | 130.000 | 136.000 | - | -98.59% | - |
| 444.namd | 4.05% | 666.000 | 693.000 | - | -92.61% | - |
| 453.povray | 3.95% | 531.000 | 552.000 | - | -92.44% | - |
| 473.astar | 3.12% | 5155.000 | 5316.000 | - | -60.03% | - |
| 410.bwaves | 2.92% | 4798.000 | 4938.000 | - | 0.00% | - |
| 433.milc | 2.87% | 1256.000 | 1292.000 | - | -91.14% | - |
| 470.lbm | 2.42% | 3222.000 | 3300.000 | - | -70.12% | - |
| 434.zeusmp | 2.29% | 2053.000 | 2100.000 | - | 0.00% | - |
| 459.GemsFDTD | 2.20% | 6583.000 | 6728.000 | - | 0.00% | - |
| 464.h264ref | 2.18% | 4630.000 | 4731.000 | - | -61.04% | - |
| 483.xalancbmk | 2.15% | 5353.000 | 5468.000 | - | -43.24% | - |
| 445.gobmk | 1.86% | 5316.000 | 5415.000 | - | -53.59% | - |
| 401.bzip2 | 1.81% | 2705.000 | 2754.000 | - | -80.28% | - |
| 456.hmmer | 1.61% | 2922.000 | 2969.000 | - | -67.45% | - |
| 437.leslie3d | 1.50% | 17251.000 | 17510.000 | - | 0.00% | - |
| 458.sjeng | 1.28% | 7491.000 | 7587.000 | - | -50.35% | - |
| Performance Regressions - sample variability | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 429.mcf (unexplained diff vs previous) (percentage) | 2708.57% | 0.350 | 9.830 | - | 0.00% | - |
| 429.mcf (unexplained diff vs previous) | 2471.43% | 7.000 | 180.000 | - | 0.00% | - |
| 429.mcf (max) (percentage) | 1845.65% | 0.460 | 8.950 | - | 2386.11% | - |
| 429.mcf (max) | 1711.11% | 9.000 | 163.000 | - | 139.71% | - |
| 458.sjeng (unexplained diff vs previous) | 540.00% | 15.000 | 96.000 | - | 0.00% | - |
| 458.sjeng (unexplained diff vs previous) (percentage) | 535.00% | 0.200 | 1.270 | - | 0.00% | - |
| 444.namd (unexplained diff vs previous) | 350.00% | 6.000 | 27.000 | - | 0.00% | - |
| 444.namd (unexplained diff vs previous) (percentage) | 333.33% | 0.900 | 3.900 | - | 0.00% | - |
| 434.zeusmp (max) | 269.23% | 13.000 | 48.000 | - | 0.00% | - |
| 434.zeusmp (max) (percentage) | 252.31% | 0.650 | 2.290 | - | 0.00% | - |
| 456.hmmer (max) | 235.71% | 14.000 | 47.000 | - | -30.88% | - |
| 456.hmmer (unexplained diff vs previous) | 235.71% | 14.000 | 47.000 | - | 0.00% | - |
| 456.hmmer (max) (percentage) | 235.42% | 0.480 | 1.610 | - | 114.67% | - |
| 456.hmmer (unexplained diff vs previous) (percentage) | 229.17% | 0.480 | 1.580 | - | 0.00% | - |
| 471.omnetpp (max) | 186.96% | 69.000 | 198.000 | - | 66.39% | - |
| 433.milc (max) | 184.62% | 13.000 | 37.000 | - | -86.25% | - |
| 444.namd (max) | 180.00% | 10.000 | 28.000 | - | -94.23% | - |
| 433.milc (unexplained diff vs previous) | 176.92% | 13.000 | 36.000 | - | 1100.00% | - |
| 471.omnetpp (max) (percentage) | 169.74% | 2.280 | 6.150 | - | 515.00% | - |
| 433.milc (unexplained diff vs previous) (percentage) | 168.27% | 1.040 | 2.790 | - | 13850.00% | - |
| 470.lbm (max) | 163.33% | 30.000 | 79.000 | - | 1216.67% | - |
| 433.milc (max) (percentage) | 158.56% | 1.110 | 2.870 | - | 55.14% | - |
| 470.lbm (max) (percentage) | 154.74% | 0.950 | 2.420 | - | 3933.33% | - |
| 444.namd (max) (percentage) | 153.12% | 1.600 | 4.050 | - | -21.81% | - |
| 470.lbm (unexplained diff vs previous) | 151.61% | 31.000 | 78.000 | - | 0.00% | - |
| 470.lbm (unexplained diff vs previous) (percentage) | 145.83% | 0.960 | 2.360 | - | 0.00% | - |
| 401.bzip2 (max) | 145.00% | 20.000 | 49.000 | - | 716.67% | - |
| 458.sjeng (max) | 142.50% | 40.000 | 97.000 | - | 177.14% | - |
| 434.zeusmp | 137.50% | 8.000 | 19.000 | - | 0.00% | - |
| 434.zeusmp (avg) | 137.50% | 8.000 | 19.000 | - | 0.00% | - |
| 458.sjeng (max) (percentage) | 137.04% | 0.540 | 1.280 | - | 456.52% | - |
| 473.astar (max) | 135.71% | 70.000 | 165.000 | - | 1550.00% | - |
| 401.bzip2 (max) (percentage) | 135.06% | 0.770 | 1.810 | - | 3520.00% | - |
| 401.bzip2 (unexplained diff vs previous) | 133.33% | 21.000 | 49.000 | - | 0.00% | - |
| 473.astar (max) (percentage) | 129.41% | 1.360 | 3.120 | - | 3800.00% | - |
| 401.bzip2 (unexplained diff vs previous) (percentage) | 128.21% | 0.780 | 1.780 | - | 0.00% | - |
| 473.astar (unexplained diff vs previous) | 126.76% | 71.000 | 161.000 | - | 0.00% | - |
| 473.astar (unexplained diff vs previous) (percentage) | 119.57% | 1.380 | 3.030 | - | 0.00% | - |
| 434.zeusmp (avg) (percentage) | 113.95% | 0.430 | 0.920 | - | 0.00% | - |
| 403.gcc | 100.00% | 1.000 | 2.000 | - | -93.55% | - |
| 403.gcc (avg) | 100.00% | 1.000 | 2.000 | - | -93.55% | - |
| 462.libquantum | 100.00% | 1.000 | 2.000 | - | -80.00% | - |
| 462.libquantum (avg) | 100.00% | 1.000 | 2.000 | - | -80.00% | - |
| 462.libquantum (max) | 100.00% | 3.000 | 6.000 | - | 100.00% | - |
| 462.libquantum (unexplained diff vs previous) | 100.00% | 3.000 | 6.000 | - | 0.00% | - |
| 462.libquantum (unexplained diff vs previous) (percentage) | 90.91% | 2.310 | 4.410 | - | 0.00% | - |
| 459.GemsFDTD (max) | 85.00% | 80.000 | 148.000 | - | 0.00% | - |
| 459.GemsFDTD (max) (percentage) | 78.86% | 1.230 | 2.200 | - | 0.00% | - |
| 462.libquantum (max) (percentage) | 70.48% | 2.710 | 4.620 | - | 11450.00% | - |
| 410.bwaves (max) | 60.00% | 90.000 | 144.000 | - | 0.00% | - |
| 410.bwaves (max) (percentage) | 55.32% | 1.880 | 2.920 | - | 0.00% | - |
| 410.bwaves (unexplained diff vs previous) | 52.17% | 92.000 | 140.000 | - | 0.00% | - |
| 410.bwaves (unexplained diff vs previous) (percentage) | 47.92% | 1.920 | 2.840 | - | 0.00% | - |
| 444.namd | 40.00% | 5.000 | 7.000 | - | -96.71% | - |
| 444.namd (avg) | 40.00% | 5.000 | 7.000 | - | -96.71% | - |
| 459.GemsFDTD | 39.44% | 71.000 | 99.000 | - | 0.00% | - |
| 459.GemsFDTD (avg) | 39.44% | 71.000 | 99.000 | - | 0.00% | - |
| 459.GemsFDTD (avg) (percentage) | 35.78% | 1.090 | 1.480 | - | 0.00% | - |
| 471.omnetpp | 28.57% | 35.000 | 45.000 | - | -36.62% | - |
| 471.omnetpp (avg) | 28.57% | 35.000 | 45.000 | - | -36.62% | - |
| 458.sjeng | 25.00% | 20.000 | 25.000 | - | -28.57% | - |
| 458.sjeng (avg) | 25.00% | 20.000 | 25.000 | - | -28.57% | - |
| 433.milc | 22.22% | 9.000 | 11.000 | - | -90.91% | - |
| 433.milc (avg) | 22.22% | 9.000 | 11.000 | - | -90.91% | - |
| 410.bwaves | 20.37% | 54.000 | 65.000 | - | 0.00% | - |
| 410.bwaves (avg) | 20.37% | 54.000 | 65.000 | - | 0.00% | - |
| 471.omnetpp (avg) (percentage) | 20.34% | 1.180 | 1.420 | - | 136.67% | - |
| 444.namd (avg) (percentage) | 18.18% | 0.880 | 1.040 | - | -54.39% | - |
| 458.sjeng (avg) (percentage) | 17.86% | 0.280 | 0.330 | - | 43.48% | - |
| 410.bwaves (avg) (percentage) | 17.70% | 1.130 | 1.330 | - | 0.00% | - |
| 437.leslie3d | 17.33% | 150.000 | 176.000 | - | 0.00% | - |
| 437.leslie3d (avg) | 17.33% | 150.000 | 176.000 | - | 0.00% | - |
| 437.leslie3d (avg) (percentage) | 16.09% | 0.870 | 1.010 | - | 0.00% | - |
| 429.mcf (avg) (percentage) | 15.22% | 1.840 | 2.120 | - | 472.97% | - |
| 456.hmmer | 14.29% | 14.000 | 16.000 | - | -80.00% | - |
| 456.hmmer (avg) | 14.29% | 14.000 | 16.000 | - | -80.00% | - |
| 400.perlbench (max) | 12.50% | 8.000 | 9.000 | - | -88.31% | - |
| 450.soplex | 12.50% | 16.000 | 18.000 | - | -76.00% | - |
| 450.soplex (avg) | 12.50% | 16.000 | 18.000 | - | -76.00% | - |
| 456.hmmer (avg) (percentage) | 12.00% | 0.500 | 0.560 | - | -36.36% | - |
| 473.astar | 12.00% | 50.000 | 56.000 | - | 522.22% | - |
| 473.astar (avg) | 12.00% | 50.000 | 56.000 | - | 522.22% | - |
| 482.sphinx3 | 11.76% | 17.000 | 19.000 | - | -91.20% | - |
| 482.sphinx3 (avg) | 11.76% | 17.000 | 19.000 | - | -91.20% | - |
| 433.milc (avg) (percentage) | 11.54% | 0.780 | 0.870 | - | 4.82% | - |
| 401.bzip2 | 10.53% | 19.000 | 21.000 | - | 61.54% | - |
| 401.bzip2 (avg) | 10.53% | 19.000 | 21.000 | - | 61.54% | - |
| 473.astar (avg) (percentage) | 9.18% | 0.980 | 1.070 | - | 1428.57% | - |
| 462.libquantum (avg) (percentage) | 8.90% | 1.460 | 1.590 | - | 1345.45% | - |
| 447.dealII | 8.33% | 12.000 | 13.000 | - | -84.15% | - |
| 447.dealII (avg) | 8.33% | 12.000 | 13.000 | - | -84.15% | - |
| 437.leslie3d (max) | 7.82% | 243.000 | 262.000 | - | 0.00% | - |
| 401.bzip2 (avg) (percentage) | 6.85% | 0.730 | 0.780 | - | 680.00% | - |
| 437.leslie3d (max) (percentage) | 6.38% | 1.410 | 1.500 | - | 0.00% | - |
| 470.lbm | 6.12% | 49.000 | 52.000 | - | -18.75% | - |
| 470.lbm (avg) | 6.12% | 49.000 | 52.000 | - | -18.75% | - |
| 482.sphinx3 (max) | 4.65% | 43.000 | 45.000 | - | -72.56% | - |
| 429.mcf | 2.70% | 37.000 | 38.000 | - | -44.93% | - |
| 429.mcf (avg) | 2.70% | 37.000 | 38.000 | - | -44.93% | - |
| 470.lbm (avg) (percentage) | 2.60% | 1.540 | 1.580 | - | 172.41% | - |
| Performance Improvements - Execution | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 429.mcf | -8.95% | 2011.000 | 1831.000 | - | -90.31% | - |
| Performance Improvements - sample variability | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 450.soplex (max) (percentage) | -8.13% | 6.640 | 6.100 | - | 454.55% | - |
| 447.dealII (max) (percentage) | -5.36% | 1.120 | 1.060 | - | -23.74% | - |
| 447.dealII (max) | -4.76% | 21.000 | 20.000 | - | -84.13% | - |
| 465.tonto (max) | -4.23% | 71.000 | 68.000 | - | 0.00% | - |
| 445.gobmk (max) (percentage) | -3.85% | 0.260 | 0.250 | - | -58.33% | - |
| 465.tonto (max) (percentage) | -3.85% | 0.260 | 0.250 | - | 0.00% | - |
| 482.sphinx3 (max) (percentage) | -3.58% | 5.300 | 5.110 | - | 640.58% | - |
| 453.povray (max) (percentage) | -3.45% | 0.870 | 0.840 | - | -20.75% | - |
| 464.h264ref (max) (percentage) | -2.74% | 0.730 | 0.710 | - | 162.96% | - |
| 465.tonto | -1.35% | 74.000 | 73.000 | - | 0.00% | - |
| 465.tonto (avg) | -1.35% | 74.000 | 73.000 | - | 0.00% | - |
| Added Tests - sample variability |
|---|
| 434.zeusmp (unexplained diff vs previous) |
| 434.zeusmp (unexplained diff vs previous) (percentage) |
| 437.leslie3d (unexplained diff vs previous) |
| 437.leslie3d (unexplained diff vs previous) (percentage) |
| 459.GemsFDTD (unexplained diff vs previous) |
| 459.GemsFDTD (unexplained diff vs previous) (percentage) |
| Performance Regressions - Code Size | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 450.soplex | 1.80% | 224407.000 | 228442.000 | - | 0.04% | - |
| Performance Regressions - sample variability | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 433.milc (unexplained diff vs previous) (percentage) | 13850.00% | 0.020 | 2.790 | - | 168.27% | - |
| 462.libquantum (max) (percentage) | 11450.00% | 0.040 | 4.620 | - | 70.48% | - |
| 470.lbm (max) (percentage) | 3933.33% | 0.060 | 2.420 | - | 154.74% | - |
| 473.astar (max) (percentage) | 3800.00% | 0.080 | 3.120 | - | 129.41% | - |
| 401.bzip2 (max) (percentage) | 3520.00% | 0.050 | 1.810 | - | 135.06% | - |
| 429.mcf (max) (percentage) | 2386.11% | 0.360 | 8.950 | - | 1845.65% | - |
| 403.gcc (max) (percentage) | 1707.50% | 0.400 | 7.230 | - | -0.82% | - |
| 473.astar (max) | 1550.00% | 10.000 | 165.000 | - | 135.71% | - |
| 473.astar (avg) (percentage) | 1428.57% | 0.070 | 1.070 | - | 9.18% | - |
| 462.libquantum (avg) (percentage) | 1345.45% | 0.110 | 1.590 | - | 8.90% | - |
| 470.lbm (max) | 1216.67% | 6.000 | 79.000 | - | 163.33% | - |
| 433.milc (unexplained diff vs previous) | 1100.00% | 3.000 | 36.000 | - | 176.92% | - |
| 403.gcc (avg) (percentage) | 829.03% | 0.310 | 2.880 | - | 0.00% | - |
| 401.bzip2 (max) | 716.67% | 6.000 | 49.000 | - | 145.00% | - |
| 401.bzip2 (avg) (percentage) | 680.00% | 0.100 | 0.780 | - | 6.85% | - |
| 482.sphinx3 (max) (percentage) | 640.58% | 0.690 | 5.110 | - | -3.58% | - |
| 473.astar | 522.22% | 9.000 | 56.000 | - | 12.00% | - |
| 473.astar (avg) | 522.22% | 9.000 | 56.000 | - | 12.00% | - |
| 471.omnetpp (max) (percentage) | 515.00% | 1.000 | 6.150 | - | 169.74% | - |
| 450.soplex (avg) (percentage) | 475.93% | 0.540 | 3.110 | - | 0.00% | - |
| 471.omnetpp (unexplained diff vs previous) (percentage) | 473.27% | 1.010 | 5.790 | - | 0.00% | - |
| 429.mcf (avg) (percentage) | 472.97% | 0.370 | 2.120 | - | 15.22% | - |
| 458.sjeng (max) (percentage) | 456.52% | 0.230 | 1.280 | - | 137.04% | - |
| 450.soplex (max) (percentage) | 454.55% | 1.100 | 6.100 | - | -8.13% | - |
| 458.sjeng (max) | 177.14% | 35.000 | 97.000 | - | 142.50% | - |
| 470.lbm (avg) (percentage) | 172.41% | 0.580 | 1.580 | - | 2.60% | - |
| 464.h264ref (max) (percentage) | 162.96% | 0.270 | 0.710 | - | -2.74% | - |
| 429.mcf (max) | 139.71% | 68.000 | 163.000 | - | 1711.11% | - |
| 471.omnetpp (avg) (percentage) | 136.67% | 0.600 | 1.420 | - | 20.34% | - |
| 482.sphinx3 (avg) (percentage) | 135.16% | 0.910 | 2.140 | - | 0.00% | - |
| 456.hmmer (max) (percentage) | 114.67% | 0.750 | 1.610 | - | 235.42% | - |
| 462.libquantum (max) | 100.00% | 3.000 | 6.000 | - | 100.00% | - |
| 471.omnetpp (max) | 66.39% | 119.000 | 198.000 | - | 186.96% | - |
| 401.bzip2 | 61.54% | 13.000 | 21.000 | - | 10.53% | - |
| 401.bzip2 (avg) | 61.54% | 13.000 | 21.000 | - | 10.53% | - |
| 471.omnetpp (unexplained diff vs previous) | 55.83% | 120.000 | 187.000 | - | 0.00% | - |
| 433.milc (max) (percentage) | 55.14% | 1.850 | 2.870 | - | 158.56% | - |
| 458.sjeng (avg) (percentage) | 43.48% | 0.230 | 0.330 | - | 17.86% | - |
| 445.gobmk (avg) (percentage) | 6.25% | 0.320 | 0.340 | - | 0.00% | - |
| 433.milc (avg) (percentage) | 4.82% | 0.830 | 0.870 | - | 11.54% | - |
| 464.h264ref (max) | 3.12% | 32.000 | 33.000 | - | 0.00% | - |
| 464.h264ref (avg) (percentage) | 2.70% | 0.370 | 0.380 | - | 0.00% | - |
| Performance Improvements - Code Size | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 444.namd | -5.06% | 143421.000 | 136160.000 | - | 0.00% | - |
| 464.h264ref | -2.77% | 399974.000 | 388877.000 | - | 0.01% | - |
| 453.povray | -2.06% | 691522.000 | 677269.000 | - | 0.00% | - |
| 401.bzip2 | -1.79% | 44357.000 | 43564.000 | - | 0.00% | - |
| 429.mcf | -1.65% | 9249.000 | 9096.000 | - | 0.00% | - |
| 462.libquantum | -1.49% | 16989.000 | 16736.000 | - | 0.00% | - |
| 473.astar | -1.47% | 23789.000 | 23440.000 | - | 0.00% | - |
| 433.milc | -1.35% | 62863.000 | 62014.000 | - | 0.00% | - |
| 456.hmmer | -1.29% | 113613.000 | 112152.000 | - | 0.00% | - |
| 482.sphinx3 | -1.08% | 120254.000 | 118957.000 | - | 0.00% | - |
| Performance Improvements - Execution | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 403.gcc | -99.27% | 10150.000 | 74.000 | - | 7.25% | - |
| 462.libquantum | -98.59% | 9659.000 | 136.000 | - | 4.62% | - |
| 482.sphinx3 | -96.26% | 23779.000 | 889.000 | - | 8.15% | - |
| 450.soplex | -95.82% | 13988.000 | 585.000 | - | 9.55% | - |
| 444.namd | -92.61% | 9377.000 | 693.000 | - | 4.05% | - |
| 453.povray | -92.44% | 7301.000 | 552.000 | - | 3.95% | - |
| 433.milc | -91.14% | 14590.000 | 1292.000 | - | 2.87% | - |
| 429.mcf | -90.31% | 18905.000 | 1831.000 | - | -8.95% | - |
| 400.perlbench | -81.55% | 11085.000 | 2045.000 | - | 6.34% | - |
| 401.bzip2 | -80.28% | 13962.000 | 2754.000 | - | 1.81% | - |
| 447.dealII | -78.28% | 9102.000 | 1977.000 | - | 4.77% | - |
| 471.omnetpp | -72.91% | 11917.000 | 3228.000 | - | 6.15% | - |
| 470.lbm | -70.12% | 11046.000 | 3300.000 | - | 2.42% | - |
| 456.hmmer | -67.45% | 9122.000 | 2969.000 | - | 1.61% | - |
| 464.h264ref | -61.04% | 12142.000 | 4731.000 | - | 2.18% | - |
| 473.astar | -60.03% | 13301.000 | 5316.000 | - | 3.12% | - |
| 445.gobmk | -53.59% | 11668.000 | 5415.000 | - | 1.86% | - |
| 458.sjeng | -50.35% | 15282.000 | 7587.000 | - | 1.28% | - |
| 483.xalancbmk | -43.24% | 9633.000 | 5468.000 | - | 2.15% | - |
| Performance Improvements - sample variability | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 444.namd | -96.71% | 213.000 | 7.000 | - | 40.00% | - |
| 444.namd (avg) | -96.71% | 213.000 | 7.000 | - | 40.00% | - |
| 453.povray (max) | -94.81% | 77.000 | 4.000 | - | 0.00% | - |
| 453.povray | -94.34% | 53.000 | 3.000 | - | 0.00% | - |
| 453.povray (avg) | -94.34% | 53.000 | 3.000 | - | 0.00% | - |
| 444.namd (max) | -94.23% | 485.000 | 28.000 | - | 180.00% | - |
| 403.gcc | -93.55% | 31.000 | 2.000 | - | 100.00% | - |
| 403.gcc (avg) | -93.55% | 31.000 | 2.000 | - | 100.00% | - |
| 482.sphinx3 | -91.20% | 216.000 | 19.000 | - | 11.76% | - |
| 482.sphinx3 (avg) | -91.20% | 216.000 | 19.000 | - | 11.76% | - |
| 400.perlbench | -91.07% | 56.000 | 5.000 | - | 0.00% | - |
| 400.perlbench (avg) | -91.07% | 56.000 | 5.000 | - | 0.00% | - |
| 433.milc | -90.91% | 121.000 | 11.000 | - | 22.22% | - |
| 433.milc (avg) | -90.91% | 121.000 | 11.000 | - | 22.22% | - |
| 400.perlbench (max) | -88.31% | 77.000 | 9.000 | - | 12.50% | - |
| 403.gcc (max) | -87.50% | 40.000 | 5.000 | - | 0.00% | - |
| 433.milc (max) | -86.25% | 269.000 | 37.000 | - | 184.62% | - |
| 447.dealII | -84.15% | 82.000 | 13.000 | - | 8.33% | - |
| 447.dealII (avg) | -84.15% | 82.000 | 13.000 | - | 8.33% | - |
| 447.dealII (max) | -84.13% | 126.000 | 20.000 | - | -4.76% | - |
| 445.gobmk (max) | -81.43% | 70.000 | 13.000 | - | 0.00% | - |
| 456.hmmer | -80.00% | 80.000 | 16.000 | - | 14.29% | - |
| 456.hmmer (avg) | -80.00% | 80.000 | 16.000 | - | 14.29% | - |
| 462.libquantum | -80.00% | 10.000 | 2.000 | - | 100.00% | - |
| 462.libquantum (avg) | -80.00% | 10.000 | 2.000 | - | 100.00% | - |
| 450.soplex (max) | -77.12% | 153.000 | 35.000 | - | 0.00% | - |
| 450.soplex | -76.00% | 75.000 | 18.000 | - | 12.50% | - |
| 450.soplex (avg) | -76.00% | 75.000 | 18.000 | - | 12.50% | - |
| 482.sphinx3 (max) | -72.56% | 164.000 | 45.000 | - | 4.65% | - |
| 464.h264ref | -61.36% | 44.000 | 17.000 | - | 0.00% | - |
| 464.h264ref (avg) | -61.36% | 44.000 | 17.000 | - | 0.00% | - |
| 483.xalancbmk (max) | -59.18% | 49.000 | 20.000 | - | 0.00% | - |
| 445.gobmk (max) (percentage) | -58.33% | 0.600 | 0.250 | - | -3.85% | - |
| 444.namd (avg) (percentage) | -54.39% | 2.280 | 1.040 | - | 18.18% | - |
| 445.gobmk | -51.35% | 37.000 | 18.000 | - | 0.00% | - |
| 445.gobmk (avg) | -51.35% | 37.000 | 18.000 | - | 0.00% | - |
| 400.perlbench (avg) (percentage) | -47.06% | 0.510 | 0.270 | - | 0.00% | - |
| 429.mcf | -44.93% | 69.000 | 38.000 | - | 2.70% | - |
| 429.mcf (avg) | -44.93% | 69.000 | 38.000 | - | 2.70% | - |
| 483.xalancbmk | -43.90% | 41.000 | 23.000 | - | 0.00% | - |
| 483.xalancbmk (avg) | -43.90% | 41.000 | 23.000 | - | 0.00% | - |
| 471.omnetpp | -36.62% | 71.000 | 45.000 | - | 28.57% | - |
| 471.omnetpp (avg) | -36.62% | 71.000 | 45.000 | - | 28.57% | - |
| 456.hmmer (avg) (percentage) | -36.36% | 0.880 | 0.560 | - | 12.00% | - |
| 400.perlbench (max) (percentage) | -34.29% | 0.700 | 0.460 | - | 0.00% | - |
| 456.hmmer (max) | -30.88% | 68.000 | 47.000 | - | 235.71% | - |
| 458.sjeng | -28.57% | 35.000 | 25.000 | - | 25.00% | - |
| 458.sjeng (avg) | -28.57% | 35.000 | 25.000 | - | 25.00% | - |
| 447.dealII (avg) (percentage) | -26.37% | 0.910 | 0.670 | - | 0.00% | - |
| 483.xalancbmk (max) (percentage) | -25.49% | 0.510 | 0.380 | - | 0.00% | - |
| 447.dealII (max) (percentage) | -23.74% | 1.390 | 1.060 | - | -5.36% | - |
| 444.namd (max) (percentage) | -21.81% | 5.180 | 4.050 | - | 153.12% | - |
| 453.povray (max) (percentage) | -20.75% | 1.060 | 0.840 | - | -3.45% | - |
| 470.lbm | -18.75% | 64.000 | 52.000 | - | 6.12% | - |
| 470.lbm (avg) | -18.75% | 64.000 | 52.000 | - | 6.12% | - |
| 453.povray (avg) (percentage) | -8.22% | 0.730 | 0.670 | - | 0.00% | - |
| Performance Improvements - Score | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| nb_total_tests | 78.95% | 19.000 | 34.000 | - | 0.00% | - |
| nb_compile_successful | 26.32% | 19.000 | 24.000 | - | 0.00% | - |
| nb_execution_successful | 26.32% | 19.000 | 24.000 | - | 0.00% | - |
| Added Tests - Code Size |
|---|
| 410.bwaves |
| 434.zeusmp |
| 437.leslie3d |
| 459.GemsFDTD |
| 465.tonto |
| Added Tests - Execution |
|---|
| 410.bwaves |
| 434.zeusmp |
| 437.leslie3d |
| 459.GemsFDTD |
| 465.tonto |
| Added Tests - sample variability |
|---|
| 401.bzip2 (unexplained diff vs previous) |
| 401.bzip2 (unexplained diff vs previous) (percentage) |
| 410.bwaves |
| 410.bwaves (avg) |
| 410.bwaves (avg) (percentage) |
| 410.bwaves (max) |
| 410.bwaves (max) (percentage) |
| 410.bwaves (unexplained diff vs previous) |
| 410.bwaves (unexplained diff vs previous) (percentage) |
| 429.mcf (unexplained diff vs previous) |
| 429.mcf (unexplained diff vs previous) (percentage) |
| 434.zeusmp |
| 434.zeusmp (avg) |
| 434.zeusmp (avg) (percentage) |
| 434.zeusmp (max) |
| 434.zeusmp (max) (percentage) |
| 434.zeusmp (unexplained diff vs previous) |
| 434.zeusmp (unexplained diff vs previous) (percentage) |
| 437.leslie3d |
| 437.leslie3d (avg) |
| 437.leslie3d (avg) (percentage) |
| 437.leslie3d (max) |
| 437.leslie3d (max) (percentage) |
| 437.leslie3d (unexplained diff vs previous) |
| 437.leslie3d (unexplained diff vs previous) (percentage) |
| 444.namd (unexplained diff vs previous) |
| 444.namd (unexplained diff vs previous) (percentage) |
| 456.hmmer (unexplained diff vs previous) |
| 456.hmmer (unexplained diff vs previous) (percentage) |
| 458.sjeng (unexplained diff vs previous) |
| 458.sjeng (unexplained diff vs previous) (percentage) |
| 459.GemsFDTD |
| 459.GemsFDTD (avg) |
| 459.GemsFDTD (avg) (percentage) |
| 459.GemsFDTD (max) |
| 459.GemsFDTD (max) (percentage) |
| 459.GemsFDTD (unexplained diff vs previous) |
| 459.GemsFDTD (unexplained diff vs previous) (percentage) |
| 462.libquantum (unexplained diff vs previous) |
| 462.libquantum (unexplained diff vs previous) (percentage) |
| 465.tonto |
| 465.tonto (avg) |
| 465.tonto (avg) (percentage) |
| 465.tonto (max) |
| 465.tonto (max) (percentage) |
| 470.lbm (unexplained diff vs previous) |
| 470.lbm (unexplained diff vs previous) (percentage) |
| 473.astar (unexplained diff vs previous) |
| 473.astar (unexplained diff vs previous) (percentage) |
Report Time: 0.46s