Fields
| hardware | None |
| os | None |
Parameters
Fields
| Name | Value |
|---|
Parameters
| Name | Value |
|---|---|
| git_binutils | https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=5e39600a691e3ba76acf6ab94edb24844c2e82b7 (unchanged) |
| git_gcc | https://github.com/gcc-mirror/gcc/commit/4341106354c6a463ce3628a4ef9c1a1d37193b59 (unchanged) |
| git_glibc | https://sourceware.org/git/?p=glibc.git;a=commit;h=91689649656314b04f3dbee0415a9254eb1424dd (+ 17 commits) |
| git_linux | https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=2904376bda0d36fd4b7660e223ac7a781c0647af (unchanged) |
| test_url | https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-aarch64-master-Os-build/4/ |
Filter
gnu-aarch64-master-Os test results
| Run | Order | Start Time | Duration |
|---|---|---|---|
| Current | 0004 (glibc-2.37.9000-00130-g9168964965) | 2023-02-23T06:46:02 | 0:00:00 |
| Previous | 0003 (basepoints/gcc-13-06340-g4341106354c6) | 2023-02-21T13:14:16 | 0:00:00 |
| Baseline | 0001 (3-changed-components) | 2023-01-01T08:38:47 | 0:00:00 |
Tests Summary
| Status Group | # | # (B) |
|---|---|---|
| Performance Regressions | 7 | 128 |
| Performance Improvements | 183 | 94 |
| Added Tests | 4 | 4 |
| Unchanged Tests | 1042 | 1010 |
| Total Tests | 1236 |
| Performance Regressions - Execution | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 435.gromacs | 2.29% | 7245.000 | 7411.000 | - | -51.94% | - |
| 462.libquantum | 2.19% | 137.000 | 140.000 | - | -98.79% | - |
| Performance Regressions - sample variability | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 437.leslie3d (avg) (percentage) | 13.90% | 2.590 | 2.950 | - | 23.95% | - |
| 437.leslie3d (unexplained diff vs previous) (percentage) | 6.03% | 11.120 | 11.790 | - | 414.85% | - |
| 437.leslie3d (max) (percentage) | 5.39% | 10.010 | 10.550 | - | 350.85% | - |
| 437.leslie3d | 1.89% | 318.000 | 324.000 | - | -9.24% | - |
| 437.leslie3d (avg) | 1.89% | 318.000 | 324.000 | - | -9.24% | - |
| Performance Improvements - Execution | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 437.leslie3d | -10.55% | 12313.000 | 11014.000 | - | -26.60% | - |
| 403.gcc | -3.33% | 60.000 | 58.000 | - | -99.36% | - |
| 454.calculix | -3.17% | 63.000 | 61.000 | - | -99.73% | - |
| 453.povray | -1.98% | 555.000 | 544.000 | - | -91.69% | - |
| 400.perlbench | -1.09% | 1644.000 | 1626.000 | - | -84.73% | - |
| Performance Improvements - sample variability | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 450.soplex (unexplained diff vs previous) (percentage) | -99.99% | 2505.080 | 0.170 | - | -91.54% | - |
| 450.soplex (unexplained diff vs previous) | -99.99% | 14304.000 | 1.000 | - | -99.68% | - |
| 454.calculix (unexplained diff vs previous) | -99.99% | 21092.000 | 2.000 | - | -60.00% | - |
| 454.calculix (unexplained diff vs previous) (percentage) | -99.99% | 33479.370 | 3.280 | - | 16300.00% | - |
| 429.mcf (unexplained diff vs previous) (percentage) | -99.99% | 1269.980 | 0.130 | - | -75.93% | - |
| 429.mcf (unexplained diff vs previous) | -99.99% | 19418.000 | 2.000 | - | -97.85% | - |
| 482.sphinx3 (unexplained diff vs previous) | -99.98% | 26150.000 | 4.000 | - | -97.85% | - |
| 482.sphinx3 (unexplained diff vs previous) (percentage) | -99.98% | 2805.790 | 0.430 | - | -30.65% | - |
| 436.cactusADM (unexplained diff vs previous) (percentage) | -99.98% | 802.180 | 0.140 | - | -95.69% | - |
| 436.cactusADM (unexplained diff vs previous) | -99.98% | 16918.000 | 3.000 | - | -99.47% | - |
| 462.libquantum (unexplained diff vs previous) (percentage) | -99.98% | 9924.820 | 2.140 | - | 21300.00% | - |
| 462.libquantum (unexplained diff vs previous) | -99.98% | 13597.000 | 3.000 | - | 200.00% | - |
| 444.namd (unexplained diff vs previous) (percentage) | -99.97% | 1186.110 | 0.410 | - | -94.70% | - |
| 444.namd (unexplained diff vs previous) | -99.97% | 8623.000 | 3.000 | - | -99.57% | - |
| 416.gamess (unexplained diff vs previous) (percentage) | -99.96% | 79.760 | 0.030 | - | -98.99% | - |
| 416.gamess (unexplained diff vs previous) | -99.96% | 9924.000 | 4.000 | - | -99.41% | - |
| 470.lbm (unexplained diff vs previous) (percentage) | -99.92% | 269.080 | 0.210 | - | 90.91% | - |
| 470.lbm (unexplained diff vs previous) | -99.92% | 10042.000 | 8.000 | - | -42.86% | - |
| 471.omnetpp (unexplained diff vs previous) (percentage) | -99.88% | 360.260 | 0.440 | - | 83.33% | - |
| 471.omnetpp (unexplained diff vs previous) | -99.88% | 10588.000 | 13.000 | - | -50.00% | - |
| 401.bzip2 (unexplained diff vs previous) (percentage) | -99.88% | 377.380 | 0.470 | - | -45.98% | - |
| 401.bzip2 (unexplained diff vs previous) | -99.87% | 11193.000 | 14.000 | - | -89.39% | - |
| 434.zeusmp (unexplained diff vs previous) | -99.85% | 11619.000 | 17.000 | - | -94.48% | - |
| 434.zeusmp (unexplained diff vs previous) (percentage) | -99.85% | 459.980 | 0.680 | - | -70.82% | - |
| 459.GemsFDTD (unexplained diff vs previous) (percentage) | -99.82% | 249.450 | 0.440 | - | 109.52% | - |
| 459.GemsFDTD (unexplained diff vs previous) | -99.82% | 15269.000 | 27.000 | - | -43.75% | - |
| 453.povray (unexplained diff vs previous) | -99.81% | 5711.000 | 11.000 | - | 1000.00% | - |
| 453.povray (unexplained diff vs previous) (percentage) | -99.80% | 1029.010 | 2.020 | - | 10000.00% | - |
| 400.perlbench (unexplained diff vs previous) | -99.79% | 8603.000 | 18.000 | - | -94.96% | - |
| 400.perlbench (unexplained diff vs previous) (percentage) | -99.79% | 523.300 | 1.110 | - | -66.87% | - |
| 456.hmmer (unexplained diff vs previous) (percentage) | -99.78% | 291.640 | 0.650 | - | -13.33% | - |
| 456.hmmer (unexplained diff vs previous) | -99.77% | 8408.000 | 19.000 | - | -77.11% | - |
| 464.h264ref (unexplained diff vs previous) | -99.77% | 7282.000 | 17.000 | - | 13.33% | - |
| 464.h264ref (unexplained diff vs previous) (percentage) | -99.77% | 123.630 | 0.290 | - | 190.00% | - |
| 447.dealII (unexplained diff vs previous) | -99.76% | 7376.000 | 18.000 | - | -76.32% | - |
| 447.dealII (unexplained diff vs previous) (percentage) | -99.75% | 369.350 | 0.910 | - | 16.67% | - |
| 445.gobmk (unexplained diff vs previous) | -99.75% | 6354.000 | 16.000 | - | -91.40% | - |
| 445.gobmk (unexplained diff vs previous) (percentage) | -99.75% | 122.150 | 0.310 | - | -80.00% | - |
| 410.bwaves (unexplained diff vs previous) | -99.75% | 9425.000 | 24.000 | - | 60.00% | - |
| 410.bwaves (unexplained diff vs previous) (percentage) | -99.74% | 155.710 | 0.400 | - | 300.00% | - |
| 481.wrf (unexplained diff vs previous) (percentage) | -99.64% | 218.820 | 0.780 | - | 16.42% | - |
| 481.wrf (unexplained diff vs previous) | -99.64% | 12013.000 | 43.000 | - | -61.61% | - |
| 458.sjeng (unexplained diff vs previous) (percentage) | -99.50% | 84.640 | 0.420 | - | 600.00% | - |
| 458.sjeng (unexplained diff vs previous) | -99.50% | 6610.000 | 33.000 | - | 266.67% | - |
| 435.gromacs (unexplained diff vs previous) (percentage) | -97.77% | 100.550 | 2.240 | - | 8.74% | - |
| 435.gromacs (unexplained diff vs previous) | -97.72% | 7285.000 | 166.000 | - | -47.80% | - |
| 465.tonto (unexplained diff vs previous) | -94.85% | 2001.000 | 103.000 | - | 63.49% | - |
| 465.tonto (unexplained diff vs previous) (percentage) | -94.82% | 17.940 | 0.930 | - | 20.78% | - |
| 400.perlbench (max) | -25.87% | 1380.000 | 1023.000 | - | 196.52% | - |
| 434.zeusmp (max) | -25.51% | 2074.000 | 1545.000 | - | 413.29% | - |
| 471.omnetpp (max) | -25.35% | 2300.000 | 1717.000 | - | 159.37% | - |
| 434.zeusmp (max) (percentage) | -25.01% | 82.140 | 61.600 | - | 2601.75% | - |
| 471.omnetpp (max) (percentage) | -25.00% | 78.270 | 58.700 | - | 851.38% | - |
| 400.perlbench (max) (percentage) | -25.00% | 83.960 | 62.970 | - | 1843.52% | - |
| 401.bzip2 (max) (percentage) | -25.00% | 79.050 | 59.290 | - | 6637.50% | - |
| 401.bzip2 (max) | -24.66% | 2344.000 | 1766.000 | - | 1227.82% | - |
| 410.bwaves (max) | -16.99% | 3685.000 | 3059.000 | - | 10096.67% | - |
| 464.h264ref (max) | -16.90% | 3255.000 | 2705.000 | - | 4262.90% | - |
| 470.lbm (max) | -16.87% | 2721.000 | 2262.000 | - | 246.40% | - |
| 429.mcf (max) | -16.80% | 1417.000 | 1179.000 | - | 1181.52% | - |
| 416.gamess (max) | -16.70% | 5520.000 | 4598.000 | - | 600.91% | - |
| 464.h264ref (max) (percentage) | -16.68% | 55.280 | 46.060 | - | 10611.63% | - |
| 416.gamess (max) (percentage) | -16.68% | 44.370 | 36.970 | - | 1179.24% | - |
| 435.gromacs (max) (percentage) | -16.67% | 50.140 | 41.780 | - | 1968.32% | - |
| 459.GemsFDTD (max) (percentage) | -16.67% | 71.380 | 59.480 | - | 9813.33% | - |
| 450.soplex (max) (percentage) | -16.67% | 96.160 | 80.130 | - | 3967.51% | - |
| 410.bwaves (max) (percentage) | -16.67% | 60.890 | 50.740 | - | 24061.90% | - |
| 481.wrf (max) (percentage) | -16.67% | 68.630 | 57.190 | - | 1715.56% | - |
| 436.cactusADM (max) (percentage) | -16.67% | 88.920 | 74.100 | - | 2252.38% | - |
| 433.milc (max) (percentage) | -16.67% | 90.900 | 75.750 | - | 2289.59% | - |
| 444.namd (max) (percentage) | -16.67% | 92.220 | 76.850 | - | 970.33% | - |
| 429.mcf (max) (percentage) | -16.67% | 92.700 | 77.250 | - | 14205.56% | - |
| 433.milc (max) | -16.67% | 1062.000 | 885.000 | - | 115.33% | - |
| 462.libquantum (max) (percentage) | -16.67% | 99.000 | 82.500 | - | 12790.62% | - |
| 470.lbm (max) (percentage) | -16.66% | 72.910 | 60.760 | - | 1091.37% | - |
| 436.cactusADM (max) | -16.59% | 1875.000 | 1564.000 | - | 183.33% | - |
| 450.soplex (max) | -16.58% | 549.000 | 458.000 | - | 50.66% | - |
| 459.GemsFDTD (max) | -16.32% | 4369.000 | 3656.000 | - | 2511.43% | - |
| 444.namd (max) | -16.27% | 670.000 | 561.000 | - | -13.56% | - |
| 481.wrf (max) | -16.01% | 3767.000 | 3164.000 | - | 496.98% | - |
| 462.libquantum (max) | -14.81% | 135.000 | 115.000 | - | 55.41% | - |
| 435.gromacs (max) | -14.76% | 3632.000 | 3096.000 | - | 895.50% | - |
| 454.calculix (max) | -12.90% | 62.000 | 54.000 | - | -94.97% | - |
| 453.povray (max) | -11.68% | 505.000 | 446.000 | - | 170.30% | - |
| 465.tonto (max) | -10.83% | 2438.000 | 2174.000 | - | 641.98% | - |
| 458.sjeng (max) | -10.39% | 3580.000 | 3208.000 | - | 10248.39% | - |
| 445.gobmk (max) | -10.28% | 2860.000 | 2566.000 | - | 1302.19% | - |
| 465.tonto (max) (percentage) | -10.01% | 21.870 | 19.680 | - | 449.72% | - |
| 482.sphinx3 (max) (percentage) | -10.00% | 96.560 | 86.900 | - | 5811.56% | - |
| 456.hmmer (max) (percentage) | -10.00% | 74.470 | 67.020 | - | 5177.17% | - |
| 445.gobmk (max) (percentage) | -10.00% | 54.980 | 49.480 | - | 3133.99% | - |
| 454.calculix (max) (percentage) | -10.00% | 99.700 | 89.730 | - | 1809.15% | - |
| 473.astar (max) | -10.00% | 3751.000 | 3376.000 | - | 16780.00% | - |
| 453.povray (max) (percentage) | -10.00% | 91.140 | 82.030 | - | 3142.29% | - |
| 473.astar (max) (percentage) | -10.00% | 63.830 | 57.450 | - | 40935.71% | - |
| 458.sjeng (max) (percentage) | -9.99% | 45.840 | 41.260 | - | 18654.55% | - |
| 482.sphinx3 (max) | -9.57% | 899.000 | 813.000 | - | 85.19% | - |
| 456.hmmer (max) | -9.41% | 2146.000 | 1944.000 | - | 1288.57% | - |
| 447.dealII (max) | -7.96% | 1571.000 | 1446.000 | - | 1251.40% | - |
| 453.povray | -7.69% | 39.000 | 36.000 | - | -55.56% | - |
| 453.povray (avg) | -7.69% | 39.000 | 36.000 | - | -55.56% | - |
| 447.dealII (max) (percentage) | -7.14% | 78.690 | 73.070 | - | 6542.73% | - |
| 403.gcc (max) | -6.78% | 59.000 | 55.000 | - | -14.06% | - |
| 400.perlbench | -6.60% | 106.000 | 99.000 | - | -36.54% | - |
| 400.perlbench (avg) | -6.60% | 106.000 | 99.000 | - | -36.54% | - |
| 416.gamess (avg) (percentage) | -6.49% | 4.780 | 4.470 | - | 105.99% | - |
| 416.gamess | -6.40% | 594.000 | 556.000 | - | 13.01% | - |
| 416.gamess (avg) | -6.40% | 594.000 | 556.000 | - | 13.01% | - |
| 437.leslie3d (max) | -5.76% | 1232.000 | 1161.000 | - | 230.77% | - |
| 450.soplex | -5.71% | 35.000 | 33.000 | - | -82.72% | - |
| 450.soplex (avg) | -5.71% | 35.000 | 33.000 | - | -82.72% | - |
| 465.tonto | -5.51% | 399.000 | 377.000 | - | 175.18% | - |
| 465.tonto (avg) | -5.51% | 399.000 | 377.000 | - | 175.18% | - |
| 447.dealII | -5.41% | 111.000 | 105.000 | - | 0.96% | - |
| 447.dealII (avg) | -5.41% | 111.000 | 105.000 | - | 0.96% | - |
| 464.h264ref | -5.35% | 243.000 | 230.000 | - | 194.87% | - |
| 464.h264ref (avg) | -5.35% | 243.000 | 230.000 | - | 194.87% | - |
| 444.namd | -5.17% | 58.000 | 55.000 | - | -84.51% | - |
| 444.namd (avg) | -5.17% | 58.000 | 55.000 | - | -84.51% | - |
| 437.leslie3d (unexplained diff vs previous) | -5.11% | 1369.000 | 1299.000 | - | 278.72% | - |
| 445.gobmk | -5.08% | 197.000 | 187.000 | - | 103.26% | - |
| 445.gobmk (avg) | -5.08% | 197.000 | 187.000 | - | 103.26% | - |
| 450.soplex (avg) (percentage) | -4.88% | 6.150 | 5.850 | - | 371.77% | - |
| 464.h264ref (avg) (percentage) | -4.84% | 4.130 | 3.930 | - | 627.78% | - |
| 447.dealII (avg) (percentage) | -4.84% | 5.580 | 5.310 | - | 396.26% | - |
| 433.milc | -4.84% | 62.000 | 59.000 | - | -73.18% | - |
| 433.milc (avg) | -4.84% | 62.000 | 59.000 | - | -73.18% | - |
| 400.perlbench (avg) (percentage) | -4.80% | 6.460 | 6.150 | - | 318.37% | - |
| 445.gobmk (avg) (percentage) | -4.75% | 3.790 | 3.610 | - | 368.83% | - |
| 482.sphinx3 (avg) (percentage) | -4.60% | 6.520 | 6.220 | - | 326.03% | - |
| 481.wrf (avg) (percentage) | -4.48% | 5.580 | 5.330 | - | 182.01% | - |
| 465.tonto (avg) (percentage) | -4.47% | 3.580 | 3.420 | - | 104.79% | - |
| 473.astar | -4.44% | 180.000 | 172.000 | - | 514.29% | - |
| 473.astar (avg) | -4.44% | 180.000 | 172.000 | - | 514.29% | - |
| 434.zeusmp | -4.41% | 136.000 | 130.000 | - | -33.33% | - |
| 434.zeusmp (avg) | -4.41% | 136.000 | 130.000 | - | -33.33% | - |
| 444.namd (avg) (percentage) | -4.24% | 8.010 | 7.670 | - | 95.17% | - |
| 473.astar (avg) (percentage) | -4.23% | 3.070 | 2.940 | - | 1447.37% | - |
| 453.povray (avg) (percentage) | -4.23% | 7.090 | 6.790 | - | 443.20% | - |
| 458.sjeng | -4.23% | 213.000 | 204.000 | - | 334.04% | - |
| 458.sjeng (avg) | -4.23% | 213.000 | 204.000 | - | 334.04% | - |
| 403.gcc (max) (percentage) | -4.17% | 99.320 | 95.180 | - | 13119.44% | - |
| 459.GemsFDTD (avg) (percentage) | -4.17% | 4.560 | 4.370 | - | 385.56% | - |
| 401.bzip2 (avg) (percentage) | -4.14% | 4.350 | 4.170 | - | 847.73% | - |
| 429.mcf | -4.05% | 74.000 | 71.000 | - | -21.11% | - |
| 429.mcf (avg) | -4.05% | 74.000 | 71.000 | - | -21.11% | - |
| 470.lbm | -4.02% | 199.000 | 191.000 | - | -36.96% | - |
| 470.lbm (avg) | -4.02% | 199.000 | 191.000 | - | -36.96% | - |
| 459.GemsFDTD | -3.94% | 279.000 | 268.000 | - | 27.62% | - |
| 459.GemsFDTD (avg) | -3.94% | 279.000 | 268.000 | - | 27.62% | - |
| 433.milc (avg) (percentage) | -3.94% | 5.330 | 5.120 | - | 201.18% | - |
| 470.lbm (avg) (percentage) | -3.93% | 5.350 | 5.140 | - | 116.88% | - |
| 481.wrf | -3.92% | 306.000 | 294.000 | - | -7.55% | - |
| 481.wrf (avg) | -3.92% | 306.000 | 294.000 | - | -7.55% | - |
| 429.mcf (avg) (percentage) | -3.89% | 4.880 | 4.690 | - | 784.91% | - |
| 401.bzip2 | -3.88% | 129.000 | 124.000 | - | 87.88% | - |
| 401.bzip2 (avg) | -3.88% | 129.000 | 124.000 | - | 87.88% | - |
| 471.omnetpp | -3.85% | 156.000 | 150.000 | - | -11.76% | - |
| 471.omnetpp (avg) | -3.85% | 156.000 | 150.000 | - | -11.76% | - |
| 436.cactusADM (avg) (percentage) | -3.79% | 5.280 | 5.080 | - | 206.02% | - |
| 456.hmmer (avg) (percentage) | -3.76% | 4.520 | 4.350 | - | 539.71% | - |
| 434.zeusmp (avg) (percentage) | -3.69% | 5.420 | 5.220 | - | 252.70% | - |
| 458.sjeng (avg) (percentage) | -3.66% | 2.730 | 2.630 | - | 696.97% | - |
| 410.bwaves | -3.65% | 219.000 | 211.000 | - | 31.87% | - |
| 410.bwaves (avg) | -3.65% | 219.000 | 211.000 | - | 31.87% | - |
| 436.cactusADM | -3.60% | 111.000 | 107.000 | - | -63.23% | - |
| 436.cactusADM (avg) | -3.60% | 111.000 | 107.000 | - | -63.23% | - |
| 471.omnetpp (avg) (percentage) | -3.56% | 5.340 | 5.150 | - | 223.90% | - |
| 482.sphinx3 | -3.33% | 60.000 | 58.000 | - | -86.70% | - |
| 482.sphinx3 (avg) | -3.33% | 60.000 | 58.000 | - | -86.70% | - |
| 410.bwaves (avg) (percentage) | -3.31% | 3.620 | 3.500 | - | 221.10% | - |
| 454.calculix (avg) (percentage) | -3.23% | 7.730 | 7.480 | - | 272.14% | - |
| 456.hmmer | -3.08% | 130.000 | 126.000 | - | 68.00% | - |
| 456.hmmer (avg) | -3.08% | 130.000 | 126.000 | - | 68.00% | - |
| 483.xalancbmk (max) | -2.87% | 348.000 | 338.000 | - | 651.11% | - |
| 435.gromacs (avg) (percentage) | -2.80% | 4.640 | 4.510 | - | 160.69% | - |
| 483.xalancbmk (max) (percentage) | -2.68% | 8.590 | 8.360 | - | 1939.02% | - |
| 462.libquantum (avg) (percentage) | -2.29% | 5.250 | 5.130 | - | 689.23% | - |
| Added Tests - sample variability |
|---|
| 433.milc (unexplained diff vs previous) |
| 433.milc (unexplained diff vs previous) (percentage) |
| 473.astar (unexplained diff vs previous) |
| 473.astar (unexplained diff vs previous) (percentage) |
| Performance Regressions - Execution | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 465.tonto | 34.65% | 8205.000 | 11048.000 | - | -0.92% | - |
| Performance Regressions - sample variability | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 473.astar (max) (percentage) | 40935.71% | 0.140 | 57.450 | - | -10.00% | - |
| 410.bwaves (max) (percentage) | 24061.90% | 0.210 | 50.740 | - | -16.67% | - |
| 462.libquantum (unexplained diff vs previous) (percentage) | 21300.00% | 0.010 | 2.140 | - | -99.98% | - |
| 458.sjeng (max) (percentage) | 18654.55% | 0.220 | 41.260 | - | -9.99% | - |
| 473.astar (max) | 16780.00% | 20.000 | 3376.000 | - | -10.00% | - |
| 454.calculix (unexplained diff vs previous) (percentage) | 16300.00% | 0.020 | 3.280 | - | -99.99% | - |
| 429.mcf (max) (percentage) | 14205.56% | 0.540 | 77.250 | - | -16.67% | - |
| 403.gcc (max) (percentage) | 13119.44% | 0.720 | 95.180 | - | -4.17% | - |
| 462.libquantum (max) (percentage) | 12790.62% | 0.640 | 82.500 | - | -16.67% | - |
| 464.h264ref (max) (percentage) | 10611.63% | 0.430 | 46.060 | - | -16.68% | - |
| 458.sjeng (max) | 10248.39% | 31.000 | 3208.000 | - | -10.39% | - |
| 410.bwaves (max) | 10096.67% | 30.000 | 3059.000 | - | -16.99% | - |
| 453.povray (unexplained diff vs previous) (percentage) | 10000.00% | 0.020 | 2.020 | - | -99.80% | - |
| 459.GemsFDTD (max) (percentage) | 9813.33% | 0.600 | 59.480 | - | -16.67% | - |
| 401.bzip2 (max) (percentage) | 6637.50% | 0.880 | 59.290 | - | -25.00% | - |
| 447.dealII (max) (percentage) | 6542.73% | 1.100 | 73.070 | - | -7.14% | - |
| 482.sphinx3 (max) (percentage) | 5811.56% | 1.470 | 86.900 | - | -10.00% | - |
| 456.hmmer (max) (percentage) | 5177.17% | 1.270 | 67.020 | - | -10.00% | - |
| 464.h264ref (max) | 4262.90% | 62.000 | 2705.000 | - | -16.90% | - |
| 450.soplex (max) (percentage) | 3967.51% | 1.970 | 80.130 | - | -16.67% | - |
| 453.povray (max) (percentage) | 3142.29% | 2.530 | 82.030 | - | -10.00% | - |
| 445.gobmk (max) (percentage) | 3133.99% | 1.530 | 49.480 | - | -10.00% | - |
| 434.zeusmp (max) (percentage) | 2601.75% | 2.280 | 61.600 | - | -25.01% | - |
| 459.GemsFDTD (max) | 2511.43% | 140.000 | 3656.000 | - | -16.32% | - |
| 433.milc (max) (percentage) | 2289.59% | 3.170 | 75.750 | - | -16.67% | - |
| 436.cactusADM (max) (percentage) | 2252.38% | 3.150 | 74.100 | - | -16.67% | - |
| 435.gromacs (max) (percentage) | 1968.32% | 2.020 | 41.780 | - | -16.67% | - |
| 483.xalancbmk (max) (percentage) | 1939.02% | 0.410 | 8.360 | - | -2.68% | - |
| 400.perlbench (max) (percentage) | 1843.52% | 3.240 | 62.970 | - | -25.00% | - |
| 454.calculix (max) (percentage) | 1809.15% | 4.700 | 89.730 | - | -10.00% | - |
| 481.wrf (max) (percentage) | 1715.56% | 3.150 | 57.190 | - | -16.67% | - |
| 473.astar (avg) (percentage) | 1447.37% | 0.190 | 2.940 | - | -4.23% | - |
| 445.gobmk (max) | 1302.19% | 183.000 | 2566.000 | - | -10.28% | - |
| 456.hmmer (max) | 1288.57% | 140.000 | 1944.000 | - | -9.41% | - |
| 447.dealII (max) | 1251.40% | 107.000 | 1446.000 | - | -7.96% | - |
| 401.bzip2 (max) | 1227.82% | 133.000 | 1766.000 | - | -24.66% | - |
| 429.mcf (max) | 1181.52% | 92.000 | 1179.000 | - | -16.80% | - |
| 416.gamess (max) (percentage) | 1179.24% | 2.890 | 36.970 | - | -16.68% | - |
| 403.gcc (avg) (percentage) | 1116.39% | 0.610 | 7.420 | - | 0.00% | - |
| 470.lbm (max) (percentage) | 1091.37% | 5.100 | 60.760 | - | -16.66% | - |
| 453.povray (unexplained diff vs previous) | 1000.00% | 1.000 | 11.000 | - | -99.81% | - |
| 444.namd (max) (percentage) | 970.33% | 7.180 | 76.850 | - | -16.67% | - |
| 435.gromacs (max) | 895.50% | 311.000 | 3096.000 | - | -14.76% | - |
| 471.omnetpp (max) (percentage) | 851.38% | 6.170 | 58.700 | - | -25.00% | - |
| 401.bzip2 (avg) (percentage) | 847.73% | 0.440 | 4.170 | - | -4.14% | - |
| 429.mcf (avg) (percentage) | 784.91% | 0.530 | 4.690 | - | -3.89% | - |
| 458.sjeng (avg) (percentage) | 696.97% | 0.330 | 2.630 | - | -3.66% | - |
| 462.libquantum (avg) (percentage) | 689.23% | 0.650 | 5.130 | - | -2.29% | - |
| 483.xalancbmk (max) | 651.11% | 45.000 | 338.000 | - | -2.87% | - |
| 465.tonto (max) | 641.98% | 293.000 | 2174.000 | - | -10.83% | - |
| 464.h264ref (avg) (percentage) | 627.78% | 0.540 | 3.930 | - | -4.84% | - |
| 416.gamess (max) | 600.91% | 656.000 | 4598.000 | - | -16.70% | - |
| 458.sjeng (unexplained diff vs previous) (percentage) | 600.00% | 0.060 | 0.420 | - | -99.50% | - |
| 456.hmmer (avg) (percentage) | 539.71% | 0.680 | 4.350 | - | -3.76% | - |
| 473.astar | 514.29% | 28.000 | 172.000 | - | -4.44% | - |
| 473.astar (avg) | 514.29% | 28.000 | 172.000 | - | -4.44% | - |
| 481.wrf (max) | 496.98% | 530.000 | 3164.000 | - | -16.01% | - |
| 465.tonto (max) (percentage) | 449.72% | 3.580 | 19.680 | - | -10.01% | - |
| 453.povray (avg) (percentage) | 443.20% | 1.250 | 6.790 | - | -4.23% | - |
| 437.leslie3d (unexplained diff vs previous) (percentage) | 414.85% | 2.290 | 11.790 | - | 6.03% | - |
| 434.zeusmp (max) | 413.29% | 301.000 | 1545.000 | - | -25.51% | - |
| 447.dealII (avg) (percentage) | 396.26% | 1.070 | 5.310 | - | -4.84% | - |
| 459.GemsFDTD (avg) (percentage) | 385.56% | 0.900 | 4.370 | - | -4.17% | - |
| 450.soplex (avg) (percentage) | 371.77% | 1.240 | 5.850 | - | -4.88% | - |
| 445.gobmk (avg) (percentage) | 368.83% | 0.770 | 3.610 | - | -4.75% | - |
| 437.leslie3d (max) (percentage) | 350.85% | 2.340 | 10.550 | - | 5.39% | - |
| 458.sjeng | 334.04% | 47.000 | 204.000 | - | -4.23% | - |
| 458.sjeng (avg) | 334.04% | 47.000 | 204.000 | - | -4.23% | - |
| 482.sphinx3 (avg) (percentage) | 326.03% | 1.460 | 6.220 | - | -4.60% | - |
| 400.perlbench (avg) (percentage) | 318.37% | 1.470 | 6.150 | - | -4.80% | - |
| 410.bwaves (unexplained diff vs previous) (percentage) | 300.00% | 0.100 | 0.400 | - | -99.74% | - |
| 437.leslie3d (unexplained diff vs previous) | 278.72% | 343.000 | 1299.000 | - | -5.11% | - |
| 454.calculix (avg) (percentage) | 272.14% | 2.010 | 7.480 | - | -3.23% | - |
| 458.sjeng (unexplained diff vs previous) | 266.67% | 9.000 | 33.000 | - | -99.50% | - |
| 434.zeusmp (avg) (percentage) | 252.70% | 1.480 | 5.220 | - | -3.69% | - |
| 470.lbm (max) | 246.40% | 653.000 | 2262.000 | - | -16.87% | - |
| 437.leslie3d (max) | 230.77% | 351.000 | 1161.000 | - | -5.76% | - |
| 471.omnetpp (avg) (percentage) | 223.90% | 1.590 | 5.150 | - | -3.56% | - |
| 410.bwaves (avg) (percentage) | 221.10% | 1.090 | 3.500 | - | -3.31% | - |
| 436.cactusADM (avg) (percentage) | 206.02% | 1.660 | 5.080 | - | -3.79% | - |
| 433.milc (avg) (percentage) | 201.18% | 1.700 | 5.120 | - | -3.94% | - |
| 462.libquantum (unexplained diff vs previous) | 200.00% | 1.000 | 3.000 | - | -99.98% | - |
| 400.perlbench (max) | 196.52% | 345.000 | 1023.000 | - | -25.87% | - |
| 464.h264ref | 194.87% | 78.000 | 230.000 | - | -5.35% | - |
| 464.h264ref (avg) | 194.87% | 78.000 | 230.000 | - | -5.35% | - |
| 464.h264ref (unexplained diff vs previous) (percentage) | 190.00% | 0.100 | 0.290 | - | -99.77% | - |
| 436.cactusADM (max) | 183.33% | 552.000 | 1564.000 | - | -16.59% | - |
| 481.wrf (avg) (percentage) | 182.01% | 1.890 | 5.330 | - | -4.48% | - |
| 465.tonto | 175.18% | 137.000 | 377.000 | - | -5.51% | - |
| 465.tonto (avg) | 175.18% | 137.000 | 377.000 | - | -5.51% | - |
| 453.povray (max) | 170.30% | 165.000 | 446.000 | - | -11.68% | - |
| 435.gromacs (avg) (percentage) | 160.69% | 1.730 | 4.510 | - | -2.80% | - |
| 471.omnetpp (max) | 159.37% | 662.000 | 1717.000 | - | -25.35% | - |
| 470.lbm (avg) (percentage) | 116.88% | 2.370 | 5.140 | - | -3.93% | - |
| 433.milc (max) | 115.33% | 411.000 | 885.000 | - | -16.67% | - |
| 459.GemsFDTD (unexplained diff vs previous) (percentage) | 109.52% | 0.210 | 0.440 | - | -99.82% | - |
| 416.gamess (avg) (percentage) | 105.99% | 2.170 | 4.470 | - | -6.49% | - |
| 465.tonto (avg) (percentage) | 104.79% | 1.670 | 3.420 | - | -4.47% | - |
| 445.gobmk | 103.26% | 92.000 | 187.000 | - | -5.08% | - |
| 445.gobmk (avg) | 103.26% | 92.000 | 187.000 | - | -5.08% | - |
| 444.namd (avg) (percentage) | 95.17% | 3.930 | 7.670 | - | -4.24% | - |
| 470.lbm (unexplained diff vs previous) (percentage) | 90.91% | 0.110 | 0.210 | - | -99.92% | - |
| 401.bzip2 | 87.88% | 66.000 | 124.000 | - | -3.88% | - |
| 401.bzip2 (avg) | 87.88% | 66.000 | 124.000 | - | -3.88% | - |
| 482.sphinx3 (max) | 85.19% | 439.000 | 813.000 | - | -9.57% | - |
| 471.omnetpp (unexplained diff vs previous) (percentage) | 83.33% | 0.240 | 0.440 | - | -99.88% | - |
| 483.xalancbmk (avg) (percentage) | 76.12% | 0.670 | 1.180 | - | 0.00% | - |
| 456.hmmer | 68.00% | 75.000 | 126.000 | - | -3.08% | - |
| 456.hmmer (avg) | 68.00% | 75.000 | 126.000 | - | -3.08% | - |
| 465.tonto (unexplained diff vs previous) | 63.49% | 63.000 | 103.000 | - | -94.85% | - |
| 410.bwaves (unexplained diff vs previous) | 60.00% | 15.000 | 24.000 | - | -99.75% | - |
| 462.libquantum (max) | 55.41% | 74.000 | 115.000 | - | -14.81% | - |
| 450.soplex (max) | 50.66% | 304.000 | 458.000 | - | -16.58% | - |
| 410.bwaves | 31.87% | 160.000 | 211.000 | - | -3.65% | - |
| 410.bwaves (avg) | 31.87% | 160.000 | 211.000 | - | -3.65% | - |
| 459.GemsFDTD | 27.62% | 210.000 | 268.000 | - | -3.94% | - |
| 459.GemsFDTD (avg) | 27.62% | 210.000 | 268.000 | - | -3.94% | - |
| 435.gromacs | 25.56% | 266.000 | 334.000 | - | -0.60% | - |
| 435.gromacs (avg) | 25.56% | 266.000 | 334.000 | - | -0.60% | - |
| 437.leslie3d (avg) (percentage) | 23.95% | 2.380 | 2.950 | - | 13.90% | - |
| 465.tonto (unexplained diff vs previous) (percentage) | 20.78% | 0.770 | 0.930 | - | -94.82% | - |
| 447.dealII (unexplained diff vs previous) (percentage) | 16.67% | 0.780 | 0.910 | - | -99.75% | - |
| 481.wrf (unexplained diff vs previous) (percentage) | 16.42% | 0.670 | 0.780 | - | -99.64% | - |
| 464.h264ref (unexplained diff vs previous) | 13.33% | 15.000 | 17.000 | - | -99.77% | - |
| 416.gamess | 13.01% | 492.000 | 556.000 | - | -6.40% | - |
| 416.gamess (avg) | 13.01% | 492.000 | 556.000 | - | -6.40% | - |
| 435.gromacs (unexplained diff vs previous) (percentage) | 8.74% | 2.060 | 2.240 | - | -97.77% | - |
| Performance Improvements - Execution | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 454.calculix | -99.73% | 22860.000 | 61.000 | - | -3.17% | - |
| 403.gcc | -99.36% | 9010.000 | 58.000 | - | -3.33% | - |
| 462.libquantum | -98.79% | 11614.000 | 140.000 | - | 2.19% | - |
| 482.sphinx3 | -96.87% | 29928.000 | 936.000 | - | 0.43% | - |
| 450.soplex | -96.30% | 15466.000 | 572.000 | - | 0.18% | - |
| 444.namd | -91.93% | 9050.000 | 730.000 | - | 0.41% | - |
| 453.povray | -91.69% | 6544.000 | 544.000 | - | -1.98% | - |
| 429.mcf | -91.10% | 17158.000 | 1527.000 | - | -0.13% | - |
| 433.milc | -90.99% | 12976.000 | 1169.000 | - | 0.00% | - |
| 436.cactusADM | -87.96% | 17544.000 | 2112.000 | - | 0.14% | - |
| 400.perlbench | -84.73% | 10650.000 | 1626.000 | - | -1.09% | - |
| 434.zeusmp | -81.01% | 13211.000 | 2509.000 | - | -0.67% | - |
| 401.bzip2 | -80.38% | 15185.000 | 2980.000 | - | 0.47% | - |
| 447.dealII | -79.70% | 9751.000 | 1979.000 | - | -0.90% | - |
| 456.hmmer | -73.73% | 11046.000 | 2902.000 | - | 0.66% | - |
| 459.GemsFDTD | -73.68% | 23356.000 | 6148.000 | - | 0.44% | - |
| 471.omnetpp | -72.75% | 10739.000 | 2926.000 | - | -0.44% | - |
| 470.lbm | -70.95% | 12819.000 | 3724.000 | - | -0.21% | - |
| 481.wrf | -67.13% | 16834.000 | 5533.000 | - | 0.78% | - |
| 483.xalancbmk | -63.75% | 11172.000 | 4050.000 | - | -0.30% | - |
| 473.astar | -60.63% | 14932.000 | 5878.000 | - | 0.00% | - |
| 464.h264ref | -59.65% | 14556.000 | 5873.000 | - | -0.29% | - |
| 410.bwaves | -59.14% | 14755.000 | 6029.000 | - | -0.40% | - |
| 445.gobmk | -56.77% | 11995.000 | 5186.000 | - | -0.31% | - |
| 435.gromacs | -51.94% | 15419.000 | 7411.000 | - | 2.29% | - |
| 458.sjeng | -45.52% | 14275.000 | 7777.000 | - | -0.42% | - |
| 416.gamess | -45.21% | 22704.000 | 12439.000 | - | -0.03% | - |
| 437.leslie3d | -26.60% | 15005.000 | 11014.000 | - | -10.55% | - |
| Performance Improvements - sample variability | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 450.soplex (unexplained diff vs previous) | -99.68% | 311.000 | 1.000 | - | -99.99% | - |
| 444.namd (unexplained diff vs previous) | -99.57% | 700.000 | 3.000 | - | -99.97% | - |
| 436.cactusADM (unexplained diff vs previous) | -99.47% | 570.000 | 3.000 | - | -99.98% | - |
| 416.gamess (unexplained diff vs previous) | -99.41% | 676.000 | 4.000 | - | -99.96% | - |
| 454.calculix | -99.13% | 459.000 | 4.000 | - | 0.00% | - |
| 454.calculix (avg) | -99.13% | 459.000 | 4.000 | - | 0.00% | - |
| 416.gamess (unexplained diff vs previous) (percentage) | -98.99% | 2.980 | 0.030 | - | -99.96% | - |
| 429.mcf (unexplained diff vs previous) | -97.85% | 93.000 | 2.000 | - | -99.99% | - |
| 482.sphinx3 (unexplained diff vs previous) | -97.85% | 186.000 | 4.000 | - | -99.98% | - |
| 436.cactusADM (unexplained diff vs previous) (percentage) | -95.69% | 3.250 | 0.140 | - | -99.98% | - |
| 454.calculix (max) | -94.97% | 1074.000 | 54.000 | - | -12.90% | - |
| 400.perlbench (unexplained diff vs previous) | -94.96% | 357.000 | 18.000 | - | -99.79% | - |
| 444.namd (unexplained diff vs previous) (percentage) | -94.70% | 7.730 | 0.410 | - | -99.97% | - |
| 434.zeusmp (unexplained diff vs previous) | -94.48% | 308.000 | 17.000 | - | -99.85% | - |
| 403.gcc | -92.59% | 54.000 | 4.000 | - | 0.00% | - |
| 403.gcc (avg) | -92.59% | 54.000 | 4.000 | - | 0.00% | - |
| 450.soplex (unexplained diff vs previous) (percentage) | -91.54% | 2.010 | 0.170 | - | -99.99% | - |
| 445.gobmk (unexplained diff vs previous) | -91.40% | 186.000 | 16.000 | - | -99.75% | - |
| 462.libquantum | -90.67% | 75.000 | 7.000 | - | 0.00% | - |
| 462.libquantum (avg) | -90.67% | 75.000 | 7.000 | - | 0.00% | - |
| 401.bzip2 (unexplained diff vs previous) | -89.39% | 132.000 | 14.000 | - | -99.87% | - |
| 482.sphinx3 | -86.70% | 436.000 | 58.000 | - | -3.33% | - |
| 482.sphinx3 (avg) | -86.70% | 436.000 | 58.000 | - | -3.33% | - |
| 444.namd | -84.51% | 355.000 | 55.000 | - | -5.17% | - |
| 444.namd (avg) | -84.51% | 355.000 | 55.000 | - | -5.17% | - |
| 450.soplex | -82.72% | 191.000 | 33.000 | - | -5.71% | - |
| 450.soplex (avg) | -82.72% | 191.000 | 33.000 | - | -5.71% | - |
| 445.gobmk (unexplained diff vs previous) (percentage) | -80.00% | 1.550 | 0.310 | - | -99.75% | - |
| 456.hmmer (unexplained diff vs previous) | -77.11% | 83.000 | 19.000 | - | -99.77% | - |
| 447.dealII (unexplained diff vs previous) | -76.32% | 76.000 | 18.000 | - | -99.76% | - |
| 429.mcf (unexplained diff vs previous) (percentage) | -75.93% | 0.540 | 0.130 | - | -99.99% | - |
| 433.milc | -73.18% | 220.000 | 59.000 | - | -4.84% | - |
| 433.milc (avg) | -73.18% | 220.000 | 59.000 | - | -4.84% | - |
| 434.zeusmp (unexplained diff vs previous) (percentage) | -70.82% | 2.330 | 0.680 | - | -99.85% | - |
| 400.perlbench (unexplained diff vs previous) (percentage) | -66.87% | 3.350 | 1.110 | - | -99.79% | - |
| 436.cactusADM | -63.23% | 291.000 | 107.000 | - | -3.60% | - |
| 436.cactusADM (avg) | -63.23% | 291.000 | 107.000 | - | -3.60% | - |
| 481.wrf (unexplained diff vs previous) | -61.61% | 112.000 | 43.000 | - | -99.64% | - |
| 454.calculix (unexplained diff vs previous) | -60.00% | 5.000 | 2.000 | - | -99.99% | - |
| 453.povray | -55.56% | 81.000 | 36.000 | - | -7.69% | - |
| 453.povray (avg) | -55.56% | 81.000 | 36.000 | - | -7.69% | - |
| 471.omnetpp (unexplained diff vs previous) | -50.00% | 26.000 | 13.000 | - | -99.88% | - |
| 435.gromacs (unexplained diff vs previous) | -47.80% | 318.000 | 166.000 | - | -97.72% | - |
| 401.bzip2 (unexplained diff vs previous) (percentage) | -45.98% | 0.870 | 0.470 | - | -99.88% | - |
| 459.GemsFDTD (unexplained diff vs previous) | -43.75% | 48.000 | 27.000 | - | -99.82% | - |
| 470.lbm (unexplained diff vs previous) | -42.86% | 14.000 | 8.000 | - | -99.92% | - |
| 470.lbm | -36.96% | 303.000 | 191.000 | - | -4.02% | - |
| 470.lbm (avg) | -36.96% | 303.000 | 191.000 | - | -4.02% | - |
| 400.perlbench | -36.54% | 156.000 | 99.000 | - | -6.60% | - |
| 400.perlbench (avg) | -36.54% | 156.000 | 99.000 | - | -6.60% | - |
| 483.xalancbmk | -36.49% | 74.000 | 47.000 | - | 0.00% | - |
| 483.xalancbmk (avg) | -36.49% | 74.000 | 47.000 | - | 0.00% | - |
| 434.zeusmp | -33.33% | 195.000 | 130.000 | - | -4.41% | - |
| 434.zeusmp (avg) | -33.33% | 195.000 | 130.000 | - | -4.41% | - |
| 482.sphinx3 (unexplained diff vs previous) (percentage) | -30.65% | 0.620 | 0.430 | - | -99.98% | - |
| 429.mcf | -21.11% | 90.000 | 71.000 | - | -4.05% | - |
| 429.mcf (avg) | -21.11% | 90.000 | 71.000 | - | -4.05% | - |
| 403.gcc (max) | -14.06% | 64.000 | 55.000 | - | -6.78% | - |
| 444.namd (max) | -13.56% | 649.000 | 561.000 | - | -16.27% | - |
| 456.hmmer (unexplained diff vs previous) (percentage) | -13.33% | 0.750 | 0.650 | - | -99.78% | - |
| 471.omnetpp | -11.76% | 170.000 | 150.000 | - | -3.85% | - |
| 471.omnetpp (avg) | -11.76% | 170.000 | 150.000 | - | -3.85% | - |
| 437.leslie3d | -9.24% | 357.000 | 324.000 | - | 1.89% | - |
| 437.leslie3d (avg) | -9.24% | 357.000 | 324.000 | - | 1.89% | - |
| 481.wrf | -7.55% | 318.000 | 294.000 | - | -3.92% | - |
| 481.wrf (avg) | -7.55% | 318.000 | 294.000 | - | -3.92% | - |
| Added Tests - sample variability |
|---|
| 433.milc (unexplained diff vs previous) |
| 433.milc (unexplained diff vs previous) (percentage) |
| 473.astar (unexplained diff vs previous) |
| 473.astar (unexplained diff vs previous) (percentage) |
Report Time: 0.40s