Fields
| hardware | None |
| os | None |
Parameters
Fields
| Name | Value |
|---|
Parameters
| Name | Value |
|---|---|
| git_binutils | https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=5e39600a691e3ba76acf6ab94edb24844c2e82b7 (+ 67 commits) |
| git_gcc | https://github.com/gcc-mirror/gcc/commit/320dc51c2d9969f644885cc1afa0d8a924f0ab87 (+ 137 commits) |
| git_glibc | https://sourceware.org/git/?p=glibc.git;a=commit;h=8b014a1b1f7aee1e3348db108aeea396359d481e (+ 18 commits) |
| git_linux | https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=2904376bda0d36fd4b7660e223ac7a781c0647af (unchanged) |
| test_url | https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6-gnu-aarch64-master-Os-build/19/ |
Filter
gnu-aarch64-master-Os test results
| Run | Order | Start Time | Duration |
|---|---|---|---|
| Current | 0019 (3-changed-components) | 2023-02-18T02:10:43 | 0:00:00 |
| Previous | 0018 (4-changed-components) | 2023-02-13T20:01:35 | 0:00:00 |
| Baseline | 0001 (3-changed-components) | 2023-01-01T08:38:47 | 0:00:00 |
Tests Summary
| Status Group | # | # (B) |
|---|---|---|
| Performance Regressions | 78 | 155 |
| Performance Improvements | 108 | 74 |
| Added Tests | 26 | 0 |
| Unchanged Tests | 1024 | 1007 |
| Total Tests | 1236 |
| Performance Regressions - Execution | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 456.hmmer | 6.02% | 10650.000 | 11291.000 | - | 2.22% | - |
| 410.bwaves | 4.08% | 14871.000 | 15478.000 | - | 4.90% | - |
| 436.cactusADM | 3.41% | 18399.000 | 19027.000 | - | 8.45% | - |
| 434.zeusmp | 3.25% | 13700.000 | 14145.000 | - | 7.07% | - |
| 433.milc | 2.61% | 12521.000 | 12848.000 | - | -0.99% | - |
| 429.mcf | 1.80% | 20576.000 | 20947.000 | - | 22.08% | - |
| 473.astar | 1.64% | 15988.000 | 16251.000 | - | 8.83% | - |
| 482.sphinx3 | 1.52% | 26677.000 | 27082.000 | - | -9.51% | - |
| 444.namd | 1.47% | 9215.000 | 9350.000 | - | 3.31% | - |
| 401.bzip2 | 1.19% | 13993.000 | 14159.000 | - | -6.76% | - |
| 453.povray | 1.11% | 6197.000 | 6266.000 | - | -4.25% | - |
| 465.tonto | 1.07% | 9053.000 | 9150.000 | - | 11.52% | - |
| Performance Regressions - sample variability | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 429.mcf (unexplained diff vs previous) | 234.23% | 111.000 | 371.000 | - | 298.92% | - |
| 429.mcf (unexplained diff vs previous) (percentage) | 227.78% | 0.540 | 1.770 | - | 227.78% | - |
| 410.bwaves (unexplained diff vs previous) | 221.16% | 189.000 | 607.000 | - | 3946.67% | - |
| 410.bwaves (unexplained diff vs previous) (percentage) | 208.66% | 1.270 | 3.920 | - | 3820.00% | - |
| 444.namd (unexplained diff vs previous) | 206.82% | 44.000 | 135.000 | - | -80.71% | - |
| 444.namd (unexplained diff vs previous) (percentage) | 200.00% | 0.480 | 1.440 | - | -81.37% | - |
| 410.bwaves (max) | 166.24% | 237.000 | 631.000 | - | 2003.33% | - |
| 456.hmmer (max) | 164.20% | 257.000 | 679.000 | - | 385.00% | - |
| 410.bwaves (max) (percentage) | 155.00% | 1.600 | 4.080 | - | 1842.86% | - |
| 456.hmmer (max) (percentage) | 148.76% | 2.420 | 6.020 | - | 374.02% | - |
| 445.gobmk (max) (percentage) | 147.22% | 1.440 | 3.560 | - | 132.68% | - |
| 456.hmmer (unexplained diff vs previous) | 142.80% | 264.000 | 641.000 | - | 672.29% | - |
| 445.gobmk (max) | 138.95% | 172.000 | 411.000 | - | 124.59% | - |
| 456.hmmer (unexplained diff vs previous) (percentage) | 129.03% | 2.480 | 5.680 | - | 657.33% | - |
| 454.calculix (max) (percentage) | 112.21% | 2.130 | 4.520 | - | -3.83% | - |
| 458.sjeng (unexplained diff vs previous) (percentage) | 107.50% | 1.200 | 2.490 | - | 4050.00% | - |
| 454.calculix (max) | 102.97% | 471.000 | 956.000 | - | -10.99% | - |
| 458.sjeng (unexplained diff vs previous) | 101.69% | 178.000 | 359.000 | - | 3888.89% | - |
| 447.dealII (max) (percentage) | 66.10% | 0.590 | 0.980 | - | -10.91% | - |
| 447.dealII (max) | 65.45% | 55.000 | 91.000 | - | -14.95% | - |
| 462.libquantum (unexplained diff vs previous) | 55.56% | 9.000 | 14.000 | - | 1300.00% | - |
| 429.mcf (max) | 44.44% | 261.000 | 377.000 | - | 309.78% | - |
| 462.libquantum (unexplained diff vs previous) (percentage) | 42.86% | 0.070 | 0.100 | - | 900.00% | - |
| 429.mcf (max) (percentage) | 41.73% | 1.270 | 1.800 | - | 233.33% | - |
| 456.hmmer | 36.96% | 92.000 | 126.000 | - | 68.00% | - |
| 456.hmmer (avg) | 36.96% | 92.000 | 126.000 | - | 68.00% | - |
| 456.hmmer (avg) (percentage) | 28.74% | 0.870 | 1.120 | - | 64.71% | - |
| 437.leslie3d (unexplained diff vs previous) (percentage) | 28.57% | 1.050 | 1.350 | - | -41.05% | - |
| 437.leslie3d (unexplained diff vs previous) | 26.71% | 146.000 | 185.000 | - | -46.06% | - |
| 473.astar (unexplained diff vs previous) | 22.90% | 214.000 | 263.000 | - | 8666.67% | - |
| 473.astar (unexplained diff vs previous) (percentage) | 20.90% | 1.340 | 1.620 | - | 8000.00% | - |
| 445.gobmk (avg) (percentage) | 19.23% | 0.780 | 0.930 | - | 20.78% | - |
| 458.sjeng (avg) (percentage) | 16.36% | 0.550 | 0.640 | - | 93.94% | - |
| 445.gobmk | 15.05% | 93.000 | 107.000 | - | 16.30% | - |
| 445.gobmk (avg) | 15.05% | 93.000 | 107.000 | - | 16.30% | - |
| 410.bwaves | 14.45% | 173.000 | 198.000 | - | 23.75% | - |
| 410.bwaves (avg) | 14.45% | 173.000 | 198.000 | - | 23.75% | - |
| 473.astar | 14.08% | 71.000 | 81.000 | - | 189.29% | - |
| 473.astar (avg) | 14.08% | 71.000 | 81.000 | - | 189.29% | - |
| 437.leslie3d (max) (percentage) | 13.68% | 1.170 | 1.330 | - | -43.16% | - |
| 458.sjeng | 13.58% | 81.000 | 92.000 | - | 95.74% | - |
| 458.sjeng (avg) | 13.58% | 81.000 | 92.000 | - | 95.74% | - |
| 437.leslie3d (max) | 11.73% | 162.000 | 181.000 | - | -48.43% | - |
| 473.astar (avg) (percentage) | 11.11% | 0.450 | 0.500 | - | 163.16% | - |
| 410.bwaves (avg) (percentage) | 9.40% | 1.170 | 1.280 | - | 17.43% | - |
| 436.cactusADM (max) | 8.72% | 596.000 | 648.000 | - | 17.39% | - |
| 454.calculix (avg) (percentage) | 8.21% | 1.950 | 2.110 | - | 4.98% | - |
| 434.zeusmp | 7.29% | 247.000 | 265.000 | - | 35.90% | - |
| 434.zeusmp (avg) | 7.29% | 247.000 | 265.000 | - | 35.90% | - |
| 436.cactusADM | 7.25% | 331.000 | 355.000 | - | 21.99% | - |
| 436.cactusADM (avg) | 7.25% | 331.000 | 355.000 | - | 21.99% | - |
| 436.cactusADM (max) (percentage) | 5.25% | 3.240 | 3.410 | - | 8.25% | - |
| 433.milc | 4.44% | 225.000 | 235.000 | - | 6.82% | - |
| 433.milc (avg) | 4.44% | 225.000 | 235.000 | - | 6.82% | - |
| 436.cactusADM (avg) (percentage) | 3.89% | 1.800 | 1.870 | - | 12.65% | - |
| 401.bzip2 | 3.88% | 103.000 | 107.000 | - | 62.12% | - |
| 401.bzip2 (avg) | 3.88% | 103.000 | 107.000 | - | 62.12% | - |
| 434.zeusmp (avg) (percentage) | 3.87% | 1.810 | 1.880 | - | 27.03% | - |
| 429.mcf | 3.45% | 261.000 | 270.000 | - | 200.00% | - |
| 429.mcf (avg) | 3.45% | 261.000 | 270.000 | - | 200.00% | - |
| 454.calculix | 3.24% | 432.000 | 446.000 | - | -2.83% | - |
| 454.calculix (avg) | 3.24% | 432.000 | 446.000 | - | -2.83% | - |
| 401.bzip2 (avg) (percentage) | 2.70% | 0.740 | 0.760 | - | 72.73% | - |
| 436.cactusADM (unexplained diff vs previous) | 1.78% | 617.000 | 628.000 | - | 10.18% | - |
| 433.milc (avg) (percentage) | 1.67% | 1.800 | 1.830 | - | 7.65% | - |
| 429.mcf (avg) (percentage) | 1.57% | 1.270 | 1.290 | - | 143.40% | - |
| Performance Improvements - Execution | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 454.calculix | -4.52% | 22156.000 | 21155.000 | - | -7.46% | - |
| 445.gobmk | -3.56% | 11982.000 | 11556.000 | - | -3.66% | - |
| 458.sjeng | -2.43% | 14779.000 | 14420.000 | - | 1.02% | - |
| 437.leslie3d | -1.33% | 13867.000 | 13682.000 | - | -8.82% | - |
| Performance Improvements - sample variability | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 450.soplex (max) | -96.14% | 440.000 | 17.000 | - | -94.41% | - |
| 450.soplex (max) (percentage) | -95.95% | 2.960 | 0.120 | - | -93.91% | - |
| 481.wrf (max) | -92.68% | 929.000 | 68.000 | - | -87.17% | - |
| 481.wrf (max) (percentage) | -92.64% | 5.300 | 0.390 | - | -87.62% | - |
| 471.omnetpp (max) (percentage) | -92.36% | 19.500 | 1.490 | - | -75.85% | - |
| 471.omnetpp (max) | -92.31% | 2615.000 | 201.000 | - | -69.64% | - |
| 464.h264ref (max) | -92.11% | 1140.000 | 90.000 | - | 45.16% | - |
| 400.perlbench (unexplained diff vs previous) | -92.02% | 514.000 | 41.000 | - | -88.52% | - |
| 400.perlbench (unexplained diff vs previous) (percentage) | -92.00% | 5.000 | 0.400 | - | -88.06% | - |
| 464.h264ref (max) (percentage) | -91.98% | 8.600 | 0.690 | - | 60.47% | - |
| 401.bzip2 (max) (percentage) | -73.20% | 4.850 | 1.300 | - | 47.73% | - |
| 401.bzip2 (max) | -72.86% | 678.000 | 184.000 | - | 38.35% | - |
| 435.gromacs (max) (percentage) | -71.47% | 6.310 | 1.800 | - | -10.89% | - |
| 435.gromacs (max) | -71.26% | 908.000 | 261.000 | - | -16.08% | - |
| 470.lbm (unexplained diff vs previous) (percentage) | -68.97% | 0.290 | 0.090 | - | -18.18% | - |
| 470.lbm (unexplained diff vs previous) | -67.50% | 40.000 | 13.000 | - | -7.14% | - |
| 471.omnetpp (unexplained diff vs previous) (percentage) | -53.85% | 1.820 | 0.840 | - | 250.00% | - |
| 471.omnetpp (unexplained diff vs previous) | -53.28% | 244.000 | 114.000 | - | 338.46% | - |
| 459.GemsFDTD (unexplained diff vs previous) | -35.93% | 295.000 | 189.000 | - | 293.75% | - |
| 459.GemsFDTD (unexplained diff vs previous) (percentage) | -35.77% | 1.370 | 0.880 | - | 319.05% | - |
| 434.zeusmp (unexplained diff vs previous) (percentage) | -32.26% | 4.650 | 3.150 | - | 35.19% | - |
| 434.zeusmp (unexplained diff vs previous) | -30.14% | 637.000 | 445.000 | - | 44.48% | - |
| 401.bzip2 (unexplained diff vs previous) (percentage) | -26.42% | 1.590 | 1.170 | - | 34.48% | - |
| 401.bzip2 (unexplained diff vs previous) | -25.23% | 222.000 | 166.000 | - | 25.76% | - |
| 482.sphinx3 (max) (percentage) | -19.97% | 6.210 | 4.970 | - | 238.10% | - |
| 482.sphinx3 (max) | -18.78% | 1656.000 | 1345.000 | - | 206.38% | - |
| 459.GemsFDTD (max) | -17.06% | 299.000 | 248.000 | - | 77.14% | - |
| 434.zeusmp (max) (percentage) | -16.67% | 4.440 | 3.700 | - | 62.28% | - |
| 416.gamess (max) | -16.62% | 662.000 | 552.000 | - | -15.85% | - |
| 459.GemsFDTD (max) (percentage) | -16.55% | 1.390 | 1.160 | - | 93.33% | - |
| 416.gamess (max) (percentage) | -16.27% | 2.950 | 2.470 | - | -14.53% | - |
| 434.zeusmp (max) | -13.98% | 608.000 | 523.000 | - | 73.75% | - |
| 462.libquantum (max) (percentage) | -11.54% | 0.260 | 0.230 | - | -64.06% | - |
| 462.libquantum (max) | -11.43% | 35.000 | 31.000 | - | -58.11% | - |
| 470.lbm (max) | -11.36% | 88.000 | 78.000 | - | -88.06% | - |
| 444.namd (max) (percentage) | -10.96% | 5.200 | 4.630 | - | -35.52% | - |
| 470.lbm (max) (percentage) | -10.94% | 0.640 | 0.570 | - | -88.82% | - |
| 400.perlbench (max) | -10.43% | 489.000 | 438.000 | - | 26.96% | - |
| 400.perlbench (max) (percentage) | -10.08% | 4.760 | 4.280 | - | 32.10% | - |
| 444.namd (max) | -9.81% | 479.000 | 432.000 | - | -33.44% | - |
| 433.milc (unexplained diff vs previous) (percentage) | -8.93% | 2.800 | 2.550 | - | -22.26% | - |
| 458.sjeng (max) | -7.27% | 495.000 | 459.000 | - | 1380.65% | - |
| 433.milc (unexplained diff vs previous) | -6.57% | 350.000 | 327.000 | - | -23.06% | - |
| 403.gcc (avg) (percentage) | -6.33% | 0.790 | 0.740 | - | 21.31% | - |
| 450.soplex | -5.91% | 186.000 | 175.000 | - | -8.38% | - |
| 450.soplex (avg) | -5.91% | 186.000 | 175.000 | - | -8.38% | - |
| 416.gamess | -5.83% | 446.000 | 420.000 | - | -14.63% | - |
| 416.gamess (avg) | -5.83% | 446.000 | 420.000 | - | -14.63% | - |
| 403.gcc | -5.80% | 69.000 | 65.000 | - | 20.37% | - |
| 403.gcc (avg) | -5.80% | 69.000 | 65.000 | - | 20.37% | - |
| 400.perlbench | -5.62% | 160.000 | 151.000 | - | -3.21% | - |
| 400.perlbench (avg) | -5.62% | 160.000 | 151.000 | - | -3.21% | - |
| 481.wrf | -5.60% | 357.000 | 337.000 | - | 5.97% | - |
| 481.wrf (avg) | -5.60% | 357.000 | 337.000 | - | 5.97% | - |
| 450.soplex (avg) (percentage) | -5.60% | 1.250 | 1.180 | - | -4.84% | - |
| 416.gamess (avg) (percentage) | -5.53% | 1.990 | 1.880 | - | -13.36% | - |
| 481.wrf (avg) (percentage) | -5.39% | 2.040 | 1.930 | - | 2.12% | - |
| 400.perlbench (avg) (percentage) | -5.13% | 1.560 | 1.480 | - | 0.68% | - |
| 465.tonto (max) (percentage) | -4.80% | 10.620 | 10.110 | - | 182.40% | - |
| 458.sjeng (max) (percentage) | -4.78% | 3.350 | 3.190 | - | 1350.00% | - |
| 453.povray (max) (percentage) | -4.74% | 7.590 | 7.230 | - | 185.77% | - |
| 470.lbm (avg) (percentage) | -4.37% | 2.520 | 2.410 | - | 1.69% | - |
| 470.lbm | -4.34% | 346.000 | 331.000 | - | 9.24% | - |
| 470.lbm (avg) | -4.34% | 346.000 | 331.000 | - | 9.24% | - |
| 473.astar (max) (percentage) | -4.26% | 4.690 | 4.490 | - | 3107.14% | - |
| 403.gcc (max) | -4.09% | 269.000 | 258.000 | - | 303.12% | - |
| 433.milc (max) (percentage) | -4.04% | 2.720 | 2.610 | - | -17.67% | - |
| 462.libquantum | -4.00% | 175.000 | 168.000 | - | 124.00% | - |
| 462.libquantum (avg) | -4.00% | 175.000 | 168.000 | - | 124.00% | - |
| 403.gcc (max) (percentage) | -3.95% | 3.040 | 2.920 | - | 305.56% | - |
| 462.libquantum (avg) (percentage) | -3.91% | 1.280 | 1.230 | - | 89.23% | - |
| 465.tonto (max) | -3.75% | 961.000 | 925.000 | - | 215.70% | - |
| 465.tonto (avg) (percentage) | -3.70% | 2.430 | 2.340 | - | 40.12% | - |
| 453.povray (max) | -3.62% | 470.000 | 453.000 | - | 174.55% | - |
| 483.xalancbmk (max) (percentage) | -3.48% | 9.190 | 8.870 | - | 2063.41% | - |
| 464.h264ref | -3.36% | 149.000 | 144.000 | - | 84.62% | - |
| 464.h264ref (avg) | -3.36% | 149.000 | 144.000 | - | 84.62% | - |
| 483.xalancbmk | -3.33% | 150.000 | 145.000 | - | 95.95% | - |
| 483.xalancbmk (avg) | -3.33% | 150.000 | 145.000 | - | 95.95% | - |
| 483.xalancbmk (avg) (percentage) | -3.28% | 1.220 | 1.180 | - | 76.12% | - |
| 483.xalancbmk (max) | -3.01% | 1130.000 | 1096.000 | - | 2335.56% | - |
| 444.namd (avg) (percentage) | -2.99% | 4.020 | 3.900 | - | -0.76% | - |
| 435.gromacs (avg) (percentage) | -2.97% | 2.020 | 1.960 | - | 13.29% | - |
| 437.leslie3d | -2.87% | 314.000 | 305.000 | - | -14.57% | - |
| 437.leslie3d (avg) | -2.87% | 314.000 | 305.000 | - | -14.57% | - |
| 473.astar (max) | -2.67% | 749.000 | 729.000 | - | 3545.00% | - |
| 464.h264ref (avg) (percentage) | -2.65% | 1.130 | 1.100 | - | 103.70% | - |
| 471.omnetpp (avg) (percentage) | -2.47% | 2.430 | 2.370 | - | 49.06% | - |
| 465.tonto | -2.28% | 219.000 | 214.000 | - | 56.20% | - |
| 465.tonto (avg) | -2.28% | 219.000 | 214.000 | - | 56.20% | - |
| 453.povray (avg) (percentage) | -2.23% | 1.790 | 1.750 | - | 40.00% | - |
| 435.gromacs | -2.07% | 290.000 | 284.000 | - | 6.77% | - |
| 435.gromacs (avg) | -2.07% | 290.000 | 284.000 | - | 6.77% | - |
| 459.GemsFDTD | -2.02% | 248.000 | 243.000 | - | 15.71% | - |
| 459.GemsFDTD (avg) | -2.02% | 248.000 | 243.000 | - | 15.71% | - |
| 437.leslie3d (avg) (percentage) | -1.76% | 2.270 | 2.230 | - | -6.30% | - |
| 444.namd | -1.62% | 370.000 | 364.000 | - | 2.54% | - |
| 444.namd (avg) | -1.62% | 370.000 | 364.000 | - | 2.54% | - |
| 471.omnetpp | -1.54% | 325.000 | 320.000 | - | 88.24% | - |
| 471.omnetpp (avg) | -1.54% | 325.000 | 320.000 | - | 88.24% | - |
| 436.cactusADM (unexplained diff vs previous) (percentage) | -1.49% | 3.350 | 3.300 | - | 1.54% | - |
| 433.milc (max) | -1.47% | 340.000 | 335.000 | - | -18.49% | - |
| 447.dealII | -1.11% | 90.000 | 89.000 | - | -14.42% | - |
| 447.dealII (avg) | -1.11% | 90.000 | 89.000 | - | -14.42% | - |
| Added Tests - sample variability |
|---|
| 403.gcc (unexplained diff vs previous) |
| 403.gcc (unexplained diff vs previous) (percentage) |
| 416.gamess (unexplained diff vs previous) |
| 416.gamess (unexplained diff vs previous) (percentage) |
| 435.gromacs (unexplained diff vs previous) |
| 435.gromacs (unexplained diff vs previous) (percentage) |
| 445.gobmk (unexplained diff vs previous) |
| 445.gobmk (unexplained diff vs previous) (percentage) |
| 447.dealII (unexplained diff vs previous) |
| 447.dealII (unexplained diff vs previous) (percentage) |
| 450.soplex (unexplained diff vs previous) |
| 450.soplex (unexplained diff vs previous) (percentage) |
| 453.povray (unexplained diff vs previous) |
| 453.povray (unexplained diff vs previous) (percentage) |
| 454.calculix (unexplained diff vs previous) |
| 454.calculix (unexplained diff vs previous) (percentage) |
| 464.h264ref (unexplained diff vs previous) |
| 464.h264ref (unexplained diff vs previous) (percentage) |
| 465.tonto (unexplained diff vs previous) |
| 465.tonto (unexplained diff vs previous) (percentage) |
| 481.wrf (unexplained diff vs previous) |
| 481.wrf (unexplained diff vs previous) (percentage) |
| 482.sphinx3 (unexplained diff vs previous) |
| 482.sphinx3 (unexplained diff vs previous) (percentage) |
| 483.xalancbmk (unexplained diff vs previous) |
| 483.xalancbmk (unexplained diff vs previous) (percentage) |
| Performance Regressions - Execution | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 471.omnetpp | 25.96% | 10739.000 | 13527.000 | - | 0.85% | - |
| 429.mcf | 22.08% | 17158.000 | 20947.000 | - | 1.80% | - |
| 462.libquantum | 18.25% | 11614.000 | 13734.000 | - | 0.10% | - |
| 465.tonto | 11.52% | 8205.000 | 9150.000 | - | 1.07% | - |
| 483.xalancbmk | 10.70% | 11172.000 | 12367.000 | - | 0.50% | - |
| 473.astar | 8.83% | 14932.000 | 16251.000 | - | 1.64% | - |
| 436.cactusADM | 8.45% | 17544.000 | 19027.000 | - | 3.41% | - |
| 470.lbm | 7.45% | 12819.000 | 13774.000 | - | 0.09% | - |
| 434.zeusmp | 7.07% | 13211.000 | 14145.000 | - | 3.25% | - |
| 410.bwaves | 4.90% | 14755.000 | 15478.000 | - | 4.08% | - |
| 481.wrf | 3.97% | 16834.000 | 17503.000 | - | -0.21% | - |
| 444.namd | 3.31% | 9050.000 | 9350.000 | - | 1.47% | - |
| 456.hmmer | 2.22% | 11046.000 | 11291.000 | - | 6.02% | - |
| 458.sjeng | 1.02% | 14275.000 | 14420.000 | - | -2.43% | - |
| Performance Regressions - sample variability | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 454.calculix (unexplained diff vs previous) (percentage) | 23550.00% | 0.020 | 4.730 | - | 0.00% | - |
| 454.calculix (unexplained diff vs previous) | 19920.00% | 5.000 | 1001.000 | - | 0.00% | - |
| 473.astar (unexplained diff vs previous) | 8666.67% | 3.000 | 263.000 | - | 22.90% | - |
| 473.astar (unexplained diff vs previous) (percentage) | 8000.00% | 0.020 | 1.620 | - | 20.90% | - |
| 453.povray (unexplained diff vs previous) | 6800.00% | 1.000 | 69.000 | - | 0.00% | - |
| 453.povray (unexplained diff vs previous) (percentage) | 5400.00% | 0.020 | 1.100 | - | 0.00% | - |
| 458.sjeng (unexplained diff vs previous) (percentage) | 4050.00% | 0.060 | 2.490 | - | 107.50% | - |
| 410.bwaves (unexplained diff vs previous) | 3946.67% | 15.000 | 607.000 | - | 221.16% | - |
| 458.sjeng (unexplained diff vs previous) | 3888.89% | 9.000 | 359.000 | - | 101.69% | - |
| 410.bwaves (unexplained diff vs previous) (percentage) | 3820.00% | 0.100 | 3.920 | - | 208.66% | - |
| 473.astar (max) | 3545.00% | 20.000 | 729.000 | - | -2.67% | - |
| 473.astar (max) (percentage) | 3107.14% | 0.140 | 4.490 | - | -4.26% | - |
| 483.xalancbmk (max) | 2335.56% | 45.000 | 1096.000 | - | -3.01% | - |
| 483.xalancbmk (max) (percentage) | 2063.41% | 0.410 | 8.870 | - | -3.48% | - |
| 410.bwaves (max) | 2003.33% | 30.000 | 631.000 | - | 166.24% | - |
| 410.bwaves (max) (percentage) | 1842.86% | 0.210 | 4.080 | - | 155.00% | - |
| 458.sjeng (max) | 1380.65% | 31.000 | 459.000 | - | -7.27% | - |
| 458.sjeng (max) (percentage) | 1350.00% | 0.220 | 3.190 | - | -4.78% | - |
| 462.libquantum (unexplained diff vs previous) | 1300.00% | 1.000 | 14.000 | - | 55.56% | - |
| 462.libquantum (unexplained diff vs previous) (percentage) | 900.00% | 0.010 | 0.100 | - | 42.86% | - |
| 456.hmmer (unexplained diff vs previous) | 672.29% | 83.000 | 641.000 | - | 142.80% | - |
| 456.hmmer (unexplained diff vs previous) (percentage) | 657.33% | 0.750 | 5.680 | - | 129.03% | - |
| 464.h264ref (unexplained diff vs previous) (percentage) | 590.00% | 0.100 | 0.690 | - | 0.00% | - |
| 464.h264ref (unexplained diff vs previous) | 506.67% | 15.000 | 91.000 | - | 0.00% | - |
| 456.hmmer (max) | 385.00% | 140.000 | 679.000 | - | 164.20% | - |
| 456.hmmer (max) (percentage) | 374.02% | 1.270 | 6.020 | - | 148.76% | - |
| 471.omnetpp (unexplained diff vs previous) | 338.46% | 26.000 | 114.000 | - | -53.28% | - |
| 459.GemsFDTD (unexplained diff vs previous) (percentage) | 319.05% | 0.210 | 0.880 | - | -35.77% | - |
| 429.mcf (max) | 309.78% | 92.000 | 377.000 | - | 44.44% | - |
| 403.gcc (max) (percentage) | 305.56% | 0.720 | 2.920 | - | -3.95% | - |
| 403.gcc (max) | 303.12% | 64.000 | 258.000 | - | -4.09% | - |
| 429.mcf (unexplained diff vs previous) | 298.92% | 93.000 | 371.000 | - | 234.23% | - |
| 459.GemsFDTD (unexplained diff vs previous) | 293.75% | 48.000 | 189.000 | - | -35.93% | - |
| 471.omnetpp (unexplained diff vs previous) (percentage) | 250.00% | 0.240 | 0.840 | - | -53.85% | - |
| 482.sphinx3 (max) (percentage) | 238.10% | 1.470 | 4.970 | - | -19.97% | - |
| 429.mcf (max) (percentage) | 233.33% | 0.540 | 1.800 | - | 41.73% | - |
| 429.mcf (unexplained diff vs previous) (percentage) | 227.78% | 0.540 | 1.770 | - | 227.78% | - |
| 465.tonto (max) | 215.70% | 293.000 | 925.000 | - | -3.75% | - |
| 482.sphinx3 (max) | 206.38% | 439.000 | 1345.000 | - | -18.78% | - |
| 429.mcf | 200.00% | 90.000 | 270.000 | - | 3.45% | - |
| 429.mcf (avg) | 200.00% | 90.000 | 270.000 | - | 3.45% | - |
| 473.astar | 189.29% | 28.000 | 81.000 | - | 14.08% | - |
| 473.astar (avg) | 189.29% | 28.000 | 81.000 | - | 14.08% | - |
| 453.povray (max) (percentage) | 185.77% | 2.530 | 7.230 | - | -4.74% | - |
| 465.tonto (max) (percentage) | 182.40% | 3.580 | 10.110 | - | -4.80% | - |
| 453.povray (max) | 174.55% | 165.000 | 453.000 | - | -3.62% | - |
| 473.astar (avg) (percentage) | 163.16% | 0.190 | 0.500 | - | 11.11% | - |
| 429.mcf (avg) (percentage) | 143.40% | 0.530 | 1.290 | - | 1.57% | - |
| 482.sphinx3 (unexplained diff vs previous) (percentage) | 141.94% | 0.620 | 1.500 | - | 0.00% | - |
| 445.gobmk (unexplained diff vs previous) (percentage) | 138.06% | 1.550 | 3.690 | - | 0.00% | - |
| 445.gobmk (max) (percentage) | 132.68% | 1.530 | 3.560 | - | 147.22% | - |
| 445.gobmk (unexplained diff vs previous) | 129.03% | 186.000 | 426.000 | - | 0.00% | - |
| 445.gobmk (max) | 124.59% | 183.000 | 411.000 | - | 138.95% | - |
| 462.libquantum | 124.00% | 75.000 | 168.000 | - | -4.00% | - |
| 462.libquantum (avg) | 124.00% | 75.000 | 168.000 | - | -4.00% | - |
| 482.sphinx3 (unexplained diff vs previous) | 117.74% | 186.000 | 405.000 | - | 0.00% | - |
| 464.h264ref (avg) (percentage) | 103.70% | 0.540 | 1.100 | - | -2.65% | - |
| 483.xalancbmk | 95.95% | 74.000 | 145.000 | - | -3.33% | - |
| 483.xalancbmk (avg) | 95.95% | 74.000 | 145.000 | - | -3.33% | - |
| 458.sjeng | 95.74% | 47.000 | 92.000 | - | 13.58% | - |
| 458.sjeng (avg) | 95.74% | 47.000 | 92.000 | - | 13.58% | - |
| 458.sjeng (avg) (percentage) | 93.94% | 0.330 | 0.640 | - | 16.36% | - |
| 459.GemsFDTD (max) (percentage) | 93.33% | 0.600 | 1.160 | - | -16.55% | - |
| 462.libquantum (avg) (percentage) | 89.23% | 0.650 | 1.230 | - | -3.91% | - |
| 471.omnetpp | 88.24% | 170.000 | 320.000 | - | -1.54% | - |
| 471.omnetpp (avg) | 88.24% | 170.000 | 320.000 | - | -1.54% | - |
| 464.h264ref | 84.62% | 78.000 | 144.000 | - | -3.36% | - |
| 464.h264ref (avg) | 84.62% | 78.000 | 144.000 | - | -3.36% | - |
| 459.GemsFDTD (max) | 77.14% | 140.000 | 248.000 | - | -17.06% | - |
| 483.xalancbmk (avg) (percentage) | 76.12% | 0.670 | 1.180 | - | -3.28% | - |
| 434.zeusmp (max) | 73.75% | 301.000 | 523.000 | - | -13.98% | - |
| 401.bzip2 (avg) (percentage) | 72.73% | 0.440 | 0.760 | - | 2.70% | - |
| 456.hmmer | 68.00% | 75.000 | 126.000 | - | 36.96% | - |
| 456.hmmer (avg) | 68.00% | 75.000 | 126.000 | - | 36.96% | - |
| 456.hmmer (avg) (percentage) | 64.71% | 0.680 | 1.120 | - | 28.74% | - |
| 434.zeusmp (max) (percentage) | 62.28% | 2.280 | 3.700 | - | -16.67% | - |
| 401.bzip2 | 62.12% | 66.000 | 107.000 | - | 3.88% | - |
| 401.bzip2 (avg) | 62.12% | 66.000 | 107.000 | - | 3.88% | - |
| 464.h264ref (max) (percentage) | 60.47% | 0.430 | 0.690 | - | -91.98% | - |
| 465.tonto | 56.20% | 137.000 | 214.000 | - | -2.28% | - |
| 465.tonto (avg) | 56.20% | 137.000 | 214.000 | - | -2.28% | - |
| 465.tonto (unexplained diff vs previous) | 53.97% | 63.000 | 97.000 | - | 0.00% | - |
| 471.omnetpp (avg) (percentage) | 49.06% | 1.590 | 2.370 | - | -2.47% | - |
| 401.bzip2 (max) (percentage) | 47.73% | 0.880 | 1.300 | - | -73.20% | - |
| 464.h264ref (max) | 45.16% | 62.000 | 90.000 | - | -92.11% | - |
| 434.zeusmp (unexplained diff vs previous) | 44.48% | 308.000 | 445.000 | - | -30.14% | - |
| 465.tonto (avg) (percentage) | 40.12% | 1.670 | 2.340 | - | -3.70% | - |
| 453.povray (avg) (percentage) | 40.00% | 1.250 | 1.750 | - | -2.23% | - |
| 401.bzip2 (max) | 38.35% | 133.000 | 184.000 | - | -72.86% | - |
| 465.tonto (unexplained diff vs previous) (percentage) | 37.66% | 0.770 | 1.060 | - | 0.00% | - |
| 434.zeusmp | 35.90% | 195.000 | 265.000 | - | 7.29% | - |
| 434.zeusmp (avg) | 35.90% | 195.000 | 265.000 | - | 7.29% | - |
| 434.zeusmp (unexplained diff vs previous) (percentage) | 35.19% | 2.330 | 3.150 | - | -32.26% | - |
| 453.povray | 34.57% | 81.000 | 109.000 | - | -0.91% | - |
| 453.povray (avg) | 34.57% | 81.000 | 109.000 | - | -0.91% | - |
| 401.bzip2 (unexplained diff vs previous) (percentage) | 34.48% | 0.870 | 1.170 | - | -26.42% | - |
| 483.xalancbmk (unexplained diff vs previous) | 32.61% | 46.000 | 61.000 | - | 0.00% | - |
| 400.perlbench (max) (percentage) | 32.10% | 3.240 | 4.280 | - | -10.08% | - |
| 434.zeusmp (avg) (percentage) | 27.03% | 1.480 | 1.880 | - | 3.87% | - |
| 400.perlbench (max) | 26.96% | 345.000 | 438.000 | - | -10.43% | - |
| 447.dealII (unexplained diff vs previous) (percentage) | 26.92% | 0.780 | 0.990 | - | 0.00% | - |
| 459.GemsFDTD (avg) (percentage) | 26.67% | 0.900 | 1.140 | - | -0.87% | - |
| 401.bzip2 (unexplained diff vs previous) | 25.76% | 132.000 | 166.000 | - | -25.23% | - |
| 410.bwaves | 23.75% | 160.000 | 198.000 | - | 14.45% | - |
| 410.bwaves (avg) | 23.75% | 160.000 | 198.000 | - | 14.45% | - |
| 447.dealII (unexplained diff vs previous) | 22.37% | 76.000 | 93.000 | - | 0.00% | - |
| 436.cactusADM | 21.99% | 291.000 | 355.000 | - | 7.25% | - |
| 436.cactusADM (avg) | 21.99% | 291.000 | 355.000 | - | 7.25% | - |
| 403.gcc (avg) (percentage) | 21.31% | 0.610 | 0.740 | - | -6.33% | - |
| 445.gobmk (avg) (percentage) | 20.78% | 0.770 | 0.930 | - | 19.23% | - |
| 403.gcc | 20.37% | 54.000 | 65.000 | - | -5.80% | - |
| 403.gcc (avg) | 20.37% | 54.000 | 65.000 | - | -5.80% | - |
| 482.sphinx3 (avg) (percentage) | 19.86% | 1.460 | 1.750 | - | -0.57% | - |
| 483.xalancbmk (unexplained diff vs previous) (percentage) | 19.51% | 0.410 | 0.490 | - | 0.00% | - |
| 410.bwaves (avg) (percentage) | 17.43% | 1.090 | 1.280 | - | 9.40% | - |
| 436.cactusADM (max) | 17.39% | 552.000 | 648.000 | - | 8.72% | - |
| 445.gobmk | 16.30% | 92.000 | 107.000 | - | 15.05% | - |
| 445.gobmk (avg) | 16.30% | 92.000 | 107.000 | - | 15.05% | - |
| 459.GemsFDTD | 15.71% | 210.000 | 243.000 | - | -2.02% | - |
| 459.GemsFDTD (avg) | 15.71% | 210.000 | 243.000 | - | -2.02% | - |
| 435.gromacs (avg) (percentage) | 13.29% | 1.730 | 1.960 | - | -2.97% | - |
| 436.cactusADM (avg) (percentage) | 12.65% | 1.660 | 1.870 | - | 3.89% | - |
| 436.cactusADM (unexplained diff vs previous) | 10.18% | 570.000 | 628.000 | - | 1.78% | - |
| 470.lbm | 9.24% | 303.000 | 331.000 | - | -4.34% | - |
| 470.lbm (avg) | 9.24% | 303.000 | 331.000 | - | -4.34% | - |
| 482.sphinx3 | 8.49% | 436.000 | 473.000 | - | 0.85% | - |
| 482.sphinx3 (avg) | 8.49% | 436.000 | 473.000 | - | 0.85% | - |
| 436.cactusADM (max) (percentage) | 8.25% | 3.150 | 3.410 | - | 5.25% | - |
| 433.milc (avg) (percentage) | 7.65% | 1.700 | 1.830 | - | 1.67% | - |
| 433.milc | 6.82% | 220.000 | 235.000 | - | 4.44% | - |
| 433.milc (avg) | 6.82% | 220.000 | 235.000 | - | 4.44% | - |
| 435.gromacs | 6.77% | 266.000 | 284.000 | - | -2.07% | - |
| 435.gromacs (avg) | 6.77% | 266.000 | 284.000 | - | -2.07% | - |
| 481.wrf | 5.97% | 318.000 | 337.000 | - | -5.60% | - |
| 481.wrf (avg) | 5.97% | 318.000 | 337.000 | - | -5.60% | - |
| 454.calculix (avg) (percentage) | 4.98% | 2.010 | 2.110 | - | 8.21% | - |
| 444.namd | 2.54% | 355.000 | 364.000 | - | -1.62% | - |
| 444.namd (avg) | 2.54% | 355.000 | 364.000 | - | -1.62% | - |
| 481.wrf (avg) (percentage) | 2.12% | 1.890 | 1.930 | - | -5.39% | - |
| 470.lbm (avg) (percentage) | 1.69% | 2.370 | 2.410 | - | -4.37% | - |
| 436.cactusADM (unexplained diff vs previous) (percentage) | 1.54% | 3.250 | 3.300 | - | -1.49% | - |
| Performance Improvements - Execution | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 482.sphinx3 | -9.51% | 29928.000 | 27082.000 | - | 1.52% | - |
| 464.h264ref | -9.51% | 14556.000 | 13172.000 | - | -0.69% | - |
| 437.leslie3d | -8.82% | 15005.000 | 13682.000 | - | -1.33% | - |
| 459.GemsFDTD | -8.42% | 23356.000 | 21390.000 | - | -0.88% | - |
| 454.calculix | -7.46% | 22860.000 | 21155.000 | - | -4.52% | - |
| 401.bzip2 | -6.76% | 15185.000 | 14159.000 | - | 1.19% | - |
| 435.gromacs | -5.77% | 15419.000 | 14530.000 | - | 0.97% | - |
| 453.povray | -4.25% | 6544.000 | 6266.000 | - | 1.11% | - |
| 447.dealII | -3.88% | 9751.000 | 9373.000 | - | -0.98% | - |
| 450.soplex | -3.82% | 15466.000 | 14875.000 | - | -0.04% | - |
| 400.perlbench | -3.78% | 10650.000 | 10247.000 | - | -0.40% | - |
| 445.gobmk | -3.66% | 11995.000 | 11556.000 | - | -3.56% | - |
| 403.gcc | -1.58% | 9010.000 | 8868.000 | - | 0.19% | - |
| 416.gamess | -1.48% | 22704.000 | 22367.000 | - | -0.40% | - |
| Performance Improvements - sample variability | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 450.soplex (unexplained diff vs previous) | -98.07% | 311.000 | 6.000 | - | 0.00% | - |
| 450.soplex (unexplained diff vs previous) (percentage) | -98.01% | 2.010 | 0.040 | - | 0.00% | - |
| 450.soplex (max) | -94.41% | 304.000 | 17.000 | - | -96.14% | - |
| 450.soplex (max) (percentage) | -93.91% | 1.970 | 0.120 | - | -95.95% | - |
| 470.lbm (max) (percentage) | -88.82% | 5.100 | 0.570 | - | -10.94% | - |
| 400.perlbench (unexplained diff vs previous) | -88.52% | 357.000 | 41.000 | - | -92.02% | - |
| 400.perlbench (unexplained diff vs previous) (percentage) | -88.06% | 3.350 | 0.400 | - | -92.00% | - |
| 470.lbm (max) | -88.06% | 653.000 | 78.000 | - | -11.36% | - |
| 481.wrf (max) (percentage) | -87.62% | 3.150 | 0.390 | - | -92.64% | - |
| 481.wrf (max) | -87.17% | 530.000 | 68.000 | - | -92.68% | - |
| 416.gamess (unexplained diff vs previous) | -86.69% | 676.000 | 90.000 | - | 0.00% | - |
| 416.gamess (unexplained diff vs previous) (percentage) | -86.58% | 2.980 | 0.400 | - | 0.00% | - |
| 444.namd (unexplained diff vs previous) (percentage) | -81.37% | 7.730 | 1.440 | - | 200.00% | - |
| 444.namd (unexplained diff vs previous) | -80.71% | 700.000 | 135.000 | - | 206.82% | - |
| 471.omnetpp (max) (percentage) | -75.85% | 6.170 | 1.490 | - | -92.36% | - |
| 403.gcc (unexplained diff vs previous) | -73.85% | 65.000 | 17.000 | - | 0.00% | - |
| 403.gcc (unexplained diff vs previous) (percentage) | -73.61% | 0.720 | 0.190 | - | 0.00% | - |
| 471.omnetpp (max) | -69.64% | 662.000 | 201.000 | - | -92.31% | - |
| 481.wrf (unexplained diff vs previous) (percentage) | -68.66% | 0.670 | 0.210 | - | 0.00% | - |
| 481.wrf (unexplained diff vs previous) | -66.96% | 112.000 | 37.000 | - | 0.00% | - |
| 462.libquantum (max) (percentage) | -64.06% | 0.640 | 0.230 | - | -11.54% | - |
| 462.libquantum (max) | -58.11% | 74.000 | 31.000 | - | -11.43% | - |
| 435.gromacs (unexplained diff vs previous) | -55.97% | 318.000 | 140.000 | - | 0.00% | - |
| 435.gromacs (unexplained diff vs previous) (percentage) | -53.40% | 2.060 | 0.960 | - | 0.00% | - |
| 437.leslie3d (max) | -48.43% | 351.000 | 181.000 | - | 11.73% | - |
| 437.leslie3d (unexplained diff vs previous) | -46.06% | 343.000 | 185.000 | - | 26.71% | - |
| 437.leslie3d (max) (percentage) | -43.16% | 2.340 | 1.330 | - | 13.68% | - |
| 437.leslie3d (unexplained diff vs previous) (percentage) | -41.05% | 2.290 | 1.350 | - | 28.57% | - |
| 444.namd (max) (percentage) | -35.52% | 7.180 | 4.630 | - | -10.96% | - |
| 444.namd (max) | -33.44% | 649.000 | 432.000 | - | -9.81% | - |
| 433.milc (unexplained diff vs previous) | -23.06% | 425.000 | 327.000 | - | -6.57% | - |
| 433.milc (unexplained diff vs previous) (percentage) | -22.26% | 3.280 | 2.550 | - | -8.93% | - |
| 433.milc (max) | -18.49% | 411.000 | 335.000 | - | -1.47% | - |
| 470.lbm (unexplained diff vs previous) (percentage) | -18.18% | 0.110 | 0.090 | - | -68.97% | - |
| 433.milc (max) (percentage) | -17.67% | 3.170 | 2.610 | - | -4.04% | - |
| 435.gromacs (max) | -16.08% | 311.000 | 261.000 | - | -71.26% | - |
| 416.gamess (max) | -15.85% | 656.000 | 552.000 | - | -16.62% | - |
| 447.dealII (max) | -14.95% | 107.000 | 91.000 | - | 65.45% | - |
| 416.gamess | -14.63% | 492.000 | 420.000 | - | -5.83% | - |
| 416.gamess (avg) | -14.63% | 492.000 | 420.000 | - | -5.83% | - |
| 437.leslie3d | -14.57% | 357.000 | 305.000 | - | -2.87% | - |
| 437.leslie3d (avg) | -14.57% | 357.000 | 305.000 | - | -2.87% | - |
| 416.gamess (max) (percentage) | -14.53% | 2.890 | 2.470 | - | -16.27% | - |
| 447.dealII | -14.42% | 104.000 | 89.000 | - | -1.11% | - |
| 447.dealII (avg) | -14.42% | 104.000 | 89.000 | - | -1.11% | - |
| 416.gamess (avg) (percentage) | -13.36% | 2.170 | 1.880 | - | -5.53% | - |
| 454.calculix (max) | -10.99% | 1074.000 | 956.000 | - | 102.97% | - |
| 447.dealII (max) (percentage) | -10.91% | 1.100 | 0.980 | - | 66.10% | - |
| 435.gromacs (max) (percentage) | -10.89% | 2.020 | 1.800 | - | -71.47% | - |
| 447.dealII (avg) (percentage) | -10.28% | 1.070 | 0.960 | - | 0.00% | - |
| 450.soplex | -8.38% | 191.000 | 175.000 | - | -5.91% | - |
| 450.soplex (avg) | -8.38% | 191.000 | 175.000 | - | -5.91% | - |
| 470.lbm (unexplained diff vs previous) | -7.14% | 14.000 | 13.000 | - | -67.50% | - |
| 437.leslie3d (avg) (percentage) | -6.30% | 2.380 | 2.230 | - | -1.76% | - |
| 450.soplex (avg) (percentage) | -4.84% | 1.240 | 1.180 | - | -5.60% | - |
| 454.calculix (max) (percentage) | -3.83% | 4.700 | 4.520 | - | 112.21% | - |
| 400.perlbench | -3.21% | 156.000 | 151.000 | - | -5.62% | - |
| 400.perlbench (avg) | -3.21% | 156.000 | 151.000 | - | -5.62% | - |
| 454.calculix | -2.83% | 459.000 | 446.000 | - | 3.24% | - |
| 454.calculix (avg) | -2.83% | 459.000 | 446.000 | - | 3.24% | - |
Report Time: 0.39s