Fields
| hardware | None |
| os | None |
Parameters
Fields
| Name | Value |
|---|
Parameters
| Name | Value |
|---|---|
| git_binutils | https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=978042640c7da4ee0d14c9c6e20fe7b6c07615fb (+ 82 commits) |
| git_gcc | https://github.com/gcc-mirror/gcc/commit/4f5a1198065dc078f8099db628da7b06a2666f34 (+ 166 commits) |
| git_glibc | https://sourceware.org/git/?p=glibc.git;a=commit;h=000ca24f807762a1fa6bf076d80f152d2512f17d (+ 13 commits) |
| git_linux | https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=657b3ebc26ae7bc5bb30e2d32e7c81ee17d087d9 (unchanged) |
| test_url | https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6-gnu-aarch64-master-Os_LTO-build/11/ |
Filter
gnu-aarch64-master-Os_LTO test results
| Run | Order | Start Time | Duration |
|---|---|---|---|
| Current | 0011 (3-changed-components) | 2023-02-10T06:43:04 | 0:00:00 |
| Previous | 0010 (4-changed-components) | 2023-02-06T11:22:42 | 0:00:00 |
| Baseline | 0001 (4-changed-components) | 2023-02-20T22:48:24 | 0:00:00 |
Tests Summary
| Status Group | # | # (B) |
|---|---|---|
| Performance Regressions | 124 | 71 |
| Performance Improvements | 67 | 143 |
| Added Tests | 8 | 0 |
| Unchanged Tests | 1037 | 1022 |
| Total Tests | 1236 |
| Performance Regressions - Execution | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 464.h264ref | 11.67% | 12320.000 | 13758.000 | - | 138.81% | - |
| 482.sphinx3 | 11.65% | 26846.000 | 29974.000 | - | 3071.85% | - |
| 459.GemsFDTD | 10.17% | 21443.000 | 23623.000 | - | 282.68% | - |
| 401.bzip2 | 7.97% | 13888.000 | 14995.000 | - | 409.86% | - |
| 454.calculix | 6.40% | 21453.000 | 22825.000 | - | 36714.52% | - |
| 450.soplex | 5.11% | 15019.000 | 15787.000 | - | 2684.30% | - |
| 435.gromacs | 5.04% | 14597.000 | 15332.000 | - | 110.92% | - |
| 410.bwaves | 4.62% | 13471.000 | 14094.000 | - | 149.36% | - |
| 403.gcc | 4.07% | 8703.000 | 9057.000 | - | 16073.21% | - |
| 437.leslie3d | 3.42% | 13645.000 | 14111.000 | - | 21.23% | - |
| 456.hmmer | 2.87% | 10632.000 | 10937.000 | - | 279.49% | - |
| 447.dealII | 2.80% | 8657.000 | 8899.000 | - | 416.18% | - |
| 433.milc | 1.22% | 12714.000 | 12869.000 | - | 1018.07% | - |
| Performance Regressions - sample variability | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 471.omnetpp (unexplained diff vs previous) (percentage) | 26350.00% | 0.100 | 26.450 | - | -93.24% | - |
| 462.libquantum (unexplained diff vs previous) (percentage) | 20233.33% | 0.090 | 18.300 | - | -99.81% | - |
| 471.omnetpp (unexplained diff vs previous) | 19871.43% | 14.000 | 2796.000 | - | -73.77% | - |
| 462.libquantum (unexplained diff vs previous) | 17475.00% | 12.000 | 2109.000 | - | -84.40% | - |
| 458.sjeng (unexplained diff vs previous) (percentage) | 11875.00% | 0.040 | 4.790 | - | -94.73% | - |
| 458.sjeng (unexplained diff vs previous) | 11116.67% | 6.000 | 673.000 | - | -90.21% | - |
| 473.astar (unexplained diff vs previous) (percentage) | 4242.86% | 0.140 | 6.080 | - | -96.93% | - |
| 473.astar (unexplained diff vs previous) | 4009.52% | 21.000 | 863.000 | - | -91.49% | - |
| 464.h264ref (unexplained diff vs previous) | 2337.29% | 59.000 | 1438.000 | - | -78.99% | - |
| 464.h264ref (unexplained diff vs previous) (percentage) | 2077.08% | 0.480 | 10.450 | - | -91.20% | - |
| 401.bzip2 (unexplained diff vs previous) | 1376.00% | 75.000 | 1107.000 | - | -89.78% | - |
| 401.bzip2 (unexplained diff vs previous) (percentage) | 1266.67% | 0.540 | 7.380 | - | -98.00% | - |
| 459.GemsFDTD (unexplained diff vs previous) | 968.63% | 204.000 | 2180.000 | - | -85.90% | - |
| 459.GemsFDTD (unexplained diff vs previous) (percentage) | 871.58% | 0.950 | 9.230 | - | -96.31% | - |
| 465.tonto (unexplained diff vs previous) (percentage) | 804.49% | 0.890 | 8.050 | - | -50.28% | - |
| 429.mcf (unexplained diff vs previous) (percentage) | 790.40% | 1.980 | 17.630 | - | -98.65% | - |
| 465.tonto (unexplained diff vs previous) | 733.73% | 83.000 | 692.000 | - | -60.93% | - |
| 429.mcf (unexplained diff vs previous) | 655.33% | 403.000 | 3044.000 | - | -83.63% | - |
| 410.bwaves (unexplained diff vs previous) | 504.85% | 103.000 | 623.000 | - | -92.01% | - |
| 470.lbm (unexplained diff vs previous) (percentage) | 483.47% | 1.210 | 7.060 | - | -97.32% | - |
| 410.bwaves (unexplained diff vs previous) (percentage) | 481.58% | 0.760 | 4.420 | - | -96.79% | - |
| 470.lbm (unexplained diff vs previous) | 444.58% | 166.000 | 904.000 | - | -90.95% | - |
| 410.bwaves (max) | 139.34% | 272.000 | 651.000 | - | -80.13% | - |
| 410.bwaves (max) (percentage) | 128.71% | 2.020 | 4.620 | - | -92.03% | - |
| 436.cactusADM (unexplained diff vs previous) (percentage) | 122.48% | 3.470 | 7.720 | - | -99.02% | - |
| 434.zeusmp (unexplained diff vs previous) (percentage) | 111.14% | 3.680 | 7.770 | - | -98.27% | - |
| 436.cactusADM (unexplained diff vs previous) | 106.50% | 662.000 | 1367.000 | - | -91.66% | - |
| 436.cactusADM (max) (percentage) | 99.17% | 3.600 | 7.170 | - | -91.92% | - |
| 434.zeusmp (unexplained diff vs previous) | 95.86% | 532.000 | 1042.000 | - | -90.76% | - |
| 434.zeusmp (max) (percentage) | 88.74% | 3.820 | 7.210 | - | -91.18% | - |
| 436.cactusADM (max) | 84.99% | 686.000 | 1269.000 | - | -31.33% | - |
| 434.zeusmp (max) | 75.32% | 551.000 | 966.000 | - | -52.99% | - |
| 482.sphinx3 (max) | 69.14% | 2064.000 | 3491.000 | - | 283.21% | - |
| 459.GemsFDTD (max) | 67.27% | 1436.000 | 2402.000 | - | -45.55% | - |
| 464.h264ref | 55.19% | 183.000 | 284.000 | - | -3.07% | - |
| 464.h264ref (avg) | 55.19% | 183.000 | 284.000 | - | -3.07% | - |
| 459.GemsFDTD (max) (percentage) | 51.79% | 6.700 | 10.170 | - | -85.77% | - |
| 482.sphinx3 (max) (percentage) | 51.50% | 7.690 | 11.650 | - | -87.93% | - |
| 403.gcc | 46.15% | 52.000 | 76.000 | - | 1800.00% | - |
| 403.gcc (avg) | 46.15% | 52.000 | 76.000 | - | 1800.00% | - |
| 459.GemsFDTD | 43.20% | 338.000 | 484.000 | - | 34.44% | - |
| 459.GemsFDTD (avg) | 43.20% | 338.000 | 484.000 | - | 34.44% | - |
| 437.leslie3d (max) | 42.18% | 339.000 | 482.000 | - | -75.01% | - |
| 403.gcc (avg) (percentage) | 41.67% | 0.600 | 0.850 | - | -88.39% | - |
| 464.h264ref (max) | 41.16% | 1137.000 | 1605.000 | - | -48.67% | - |
| 464.h264ref (avg) (percentage) | 38.93% | 1.490 | 2.070 | - | -59.33% | - |
| 437.leslie3d (max) (percentage) | 37.35% | 2.490 | 3.420 | - | -79.37% | - |
| 429.mcf (avg) (percentage) | 36.51% | 1.890 | 2.580 | - | -66.36% | - |
| 401.bzip2 (max) | 35.80% | 880.000 | 1195.000 | - | -48.34% | - |
| 401.bzip2 | 34.41% | 186.000 | 250.000 | - | 55.28% | - |
| 401.bzip2 (avg) | 34.41% | 186.000 | 250.000 | - | 55.28% | - |
| 482.sphinx3 | 34.17% | 679.000 | 911.000 | - | 1131.08% | - |
| 482.sphinx3 (avg) | 34.17% | 679.000 | 911.000 | - | 1131.08% | - |
| 437.leslie3d (unexplained diff vs previous) | 33.91% | 348.000 | 466.000 | - | -79.86% | - |
| 458.sjeng (avg) (percentage) | 32.31% | 0.650 | 0.860 | - | -73.04% | - |
| 459.GemsFDTD (avg) (percentage) | 29.75% | 1.580 | 2.050 | - | -64.90% | - |
| 437.leslie3d (unexplained diff vs previous) (percentage) | 29.41% | 2.550 | 3.300 | - | -83.40% | - |
| 471.omnetpp (avg) (percentage) | 27.88% | 3.120 | 3.990 | - | -51.34% | - |
| 464.h264ref (max) (percentage) | 26.44% | 9.230 | 11.670 | - | -78.50% | - |
| 458.sjeng | 26.32% | 95.000 | 120.000 | - | -50.21% | - |
| 458.sjeng (avg) | 26.32% | 95.000 | 120.000 | - | -50.21% | - |
| 483.xalancbmk (avg) (percentage) | 26.06% | 1.880 | 2.370 | - | -63.54% | - |
| 401.bzip2 (max) (percentage) | 25.71% | 6.340 | 7.970 | - | -89.87% | - |
| 473.astar (max) (percentage) | 24.84% | 4.590 | 5.730 | - | -91.37% | - |
| 401.bzip2 (avg) (percentage) | 24.63% | 1.340 | 1.670 | - | -69.53% | - |
| 473.astar (avg) (percentage) | 22.92% | 0.960 | 1.180 | - | -71.63% | - |
| 462.libquantum (avg) (percentage) | 22.75% | 2.550 | 3.130 | - | -59.14% | - |
| 482.sphinx3 (avg) (percentage) | 20.16% | 2.530 | 3.040 | - | -61.66% | - |
| 465.tonto (avg) (percentage) | 18.27% | 1.970 | 2.330 | - | -30.24% | - |
| 462.libquantum (max) (percentage) | 18.00% | 13.110 | 15.470 | - | -84.37% | - |
| 473.astar (max) | 17.68% | 690.000 | 812.000 | - | -76.16% | - |
| 429.mcf | 16.19% | 383.000 | 445.000 | - | 308.26% | - |
| 429.mcf (avg) | 16.19% | 383.000 | 445.000 | - | 308.26% | - |
| 473.astar | 15.97% | 144.000 | 167.000 | - | -21.60% | - |
| 473.astar (avg) | 15.97% | 144.000 | 167.000 | - | -21.60% | - |
| 434.zeusmp (avg) (percentage) | 14.53% | 1.790 | 2.050 | - | -64.96% | - |
| 483.xalancbmk | 13.97% | 229.000 | 261.000 | - | 5.24% | - |
| 483.xalancbmk (avg) | 13.97% | 229.000 | 261.000 | - | 5.24% | - |
| 410.bwaves | 13.42% | 231.000 | 262.000 | - | 5.22% | - |
| 410.bwaves (avg) | 13.42% | 231.000 | 262.000 | - | 5.22% | - |
| 436.cactusADM (avg) (percentage) | 11.79% | 1.950 | 2.180 | - | -63.55% | - |
| 429.mcf (max) (percentage) | 10.06% | 13.620 | 14.990 | - | -83.86% | - |
| 465.tonto | 9.89% | 182.000 | 200.000 | - | -45.21% | - |
| 465.tonto (avg) | 9.89% | 182.000 | 200.000 | - | -45.21% | - |
| 403.gcc (max) | 9.52% | 336.000 | 368.000 | - | 569.09% | - |
| 410.bwaves (avg) (percentage) | 8.14% | 1.720 | 1.860 | - | -57.82% | - |
| 454.calculix | 6.54% | 321.000 | 342.000 | - | 8450.00% | - |
| 454.calculix (avg) | 6.54% | 321.000 | 342.000 | - | 8450.00% | - |
| 437.leslie3d | 6.39% | 313.000 | 333.000 | - | -6.20% | - |
| 437.leslie3d (avg) | 6.39% | 313.000 | 333.000 | - | -6.20% | - |
| 434.zeusmp | 6.20% | 258.000 | 274.000 | - | 86.39% | - |
| 434.zeusmp (avg) | 6.20% | 258.000 | 274.000 | - | 86.39% | - |
| 470.lbm (avg) (percentage) | 5.63% | 3.020 | 3.190 | - | -49.61% | - |
| 403.gcc (max) (percentage) | 5.17% | 3.870 | 4.070 | - | -95.90% | - |
| 435.gromacs | 4.93% | 284.000 | 298.000 | - | -18.80% | - |
| 435.gromacs (avg) | 4.93% | 284.000 | 298.000 | - | -18.80% | - |
| 450.soplex | 4.90% | 204.000 | 214.000 | - | 494.44% | - |
| 450.soplex (avg) | 4.90% | 204.000 | 214.000 | - | 494.44% | - |
| 458.sjeng (max) (percentage) | 3.86% | 4.400 | 4.570 | - | -90.40% | - |
| 436.cactusADM | 3.77% | 371.000 | 385.000 | - | 210.48% | - |
| 436.cactusADM (avg) | 3.77% | 371.000 | 385.000 | - | 210.48% | - |
| 462.libquantum | 3.75% | 347.000 | 360.000 | - | 3500.00% | - |
| 462.libquantum (avg) | 3.75% | 347.000 | 360.000 | - | 3500.00% | - |
| 447.dealII | 2.86% | 70.000 | 72.000 | - | -27.27% | - |
| 447.dealII (avg) | 2.86% | 70.000 | 72.000 | - | -27.27% | - |
| 400.perlbench (avg) (percentage) | 2.80% | 1.430 | 1.470 | - | -76.85% | - |
| 437.leslie3d (avg) (percentage) | 2.61% | 2.300 | 2.360 | - | -22.62% | - |
| 456.hmmer | 1.98% | 101.000 | 103.000 | - | -18.90% | - |
| 456.hmmer (avg) | 1.98% | 101.000 | 103.000 | - | -18.90% | - |
| 471.omnetpp | 1.20% | 416.000 | 421.000 | - | 88.79% | - |
| 471.omnetpp (avg) | 1.20% | 416.000 | 421.000 | - | 88.79% | - |
| Performance Improvements - Execution | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 471.omnetpp | -20.92% | 13365.000 | 10569.000 | - | 288.00% | - |
| 462.libquantum | -15.47% | 13636.000 | 11527.000 | - | 8133.57% | - |
| 429.mcf | -14.99% | 20306.000 | 17262.000 | - | 1112.22% | - |
| 483.xalancbmk | -9.45% | 12207.000 | 11054.000 | - | 189.52% | - |
| 465.tonto | -7.45% | 9289.000 | 8597.000 | - | -21.42% | - |
| 434.zeusmp | -7.21% | 14447.000 | 13405.000 | - | 433.21% | - |
| 436.cactusADM | -7.17% | 19068.000 | 17701.000 | - | 749.78% | - |
| 470.lbm | -6.60% | 13701.000 | 12797.000 | - | 237.83% | - |
| 473.astar | -5.73% | 15049.000 | 14186.000 | - | 176.64% | - |
| 453.povray | -4.88% | 6867.000 | 6532.000 | - | 1094.15% | - |
| 458.sjeng | -4.57% | 14721.000 | 14048.000 | - | 85.65% | - |
| 481.wrf | -2.91% | 17364.000 | 16858.000 | - | 204.63% | - |
| 416.gamess | -2.89% | 21216.000 | 20603.000 | - | 65.29% | - |
| 400.perlbench | -2.18% | 10992.000 | 10752.000 | - | 546.54% | - |
| 444.namd | -1.70% | 9201.000 | 9045.000 | - | 1110.84% | - |
| Performance Improvements - sample variability | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 444.namd (unexplained diff vs previous) | -77.13% | 682.000 | 156.000 | - | -98.13% | - |
| 444.namd (unexplained diff vs previous) (percentage) | -76.79% | 7.410 | 1.720 | - | -99.85% | - |
| 433.milc (unexplained diff vs previous) (percentage) | -62.50% | 3.200 | 1.200 | - | -99.88% | - |
| 433.milc (unexplained diff vs previous) | -61.92% | 407.000 | 155.000 | - | -98.63% | - |
| 471.omnetpp (max) | -26.78% | 3032.000 | 2220.000 | - | 2.35% | - |
| 483.xalancbmk (max) | -20.06% | 1306.000 | 1044.000 | - | -60.17% | - |
| 465.tonto (max) | -15.34% | 958.000 | 811.000 | - | -61.60% | - |
| 400.perlbench (max) | -14.68% | 327.000 | 279.000 | - | -80.03% | - |
| 470.lbm (max) | -14.59% | 1453.000 | 1241.000 | - | -54.81% | - |
| 400.perlbench (max) (percentage) | -12.75% | 2.980 | 2.600 | - | -96.91% | - |
| 483.xalancbmk (max) (percentage) | -11.68% | 10.700 | 9.450 | - | -86.24% | - |
| 433.milc (max) (percentage) | -11.17% | 3.580 | 3.180 | - | -96.50% | - |
| 453.povray (max) | -10.91% | 706.000 | 629.000 | - | 26.05% | - |
| 444.namd (max) | -10.17% | 747.000 | 671.000 | - | -2.04% | - |
| 433.milc (max) | -10.11% | 455.000 | 409.000 | - | -60.82% | - |
| 416.gamess (max) | -9.71% | 659.000 | 595.000 | - | -87.62% | - |
| 445.gobmk (max) | -8.98% | 167.000 | 152.000 | - | -94.25% | - |
| 444.namd (max) (percentage) | -8.62% | 8.120 | 7.420 | - | -91.92% | - |
| 470.lbm (max) (percentage) | -8.58% | 10.610 | 9.700 | - | -86.62% | - |
| 450.soplex (max) (percentage) | -8.56% | 3.270 | 2.990 | - | -96.89% | - |
| 465.tonto (max) (percentage) | -8.53% | 10.320 | 9.440 | - | -51.11% | - |
| 445.gobmk (max) (percentage) | -8.33% | 1.440 | 1.320 | - | -97.49% | - |
| 471.omnetpp (max) (percentage) | -7.40% | 22.690 | 21.010 | - | -73.62% | - |
| 416.gamess (max) (percentage) | -7.07% | 3.110 | 2.890 | - | -92.50% | - |
| 435.gromacs (max) (percentage) | -6.72% | 6.250 | 5.830 | - | -88.14% | - |
| 429.mcf (max) | -6.44% | 2765.000 | 2587.000 | - | 95.69% | - |
| 453.povray (max) (percentage) | -6.41% | 10.290 | 9.630 | - | -89.45% | - |
| 447.dealII (max) (percentage) | -6.25% | 1.760 | 1.650 | - | -97.94% | - |
| 456.hmmer (max) (percentage) | -6.25% | 2.240 | 2.100 | - | -97.15% | - |
| 454.calculix (max) (percentage) | -5.67% | 2.820 | 2.660 | - | -97.33% | - |
| 444.namd | -5.10% | 431.000 | 409.000 | - | 501.47% | - |
| 444.namd (avg) | -5.10% | 431.000 | 409.000 | - | 501.47% | - |
| 453.povray | -5.10% | 157.000 | 149.000 | - | 254.76% | - |
| 453.povray (avg) | -5.10% | 157.000 | 149.000 | - | 254.76% | - |
| 481.wrf (max) | -4.76% | 399.000 | 380.000 | - | -90.00% | - |
| 447.dealII (max) | -3.95% | 152.000 | 146.000 | - | -89.45% | - |
| 450.soplex (max) | -3.87% | 491.000 | 472.000 | - | -13.39% | - |
| 456.hmmer (max) | -3.78% | 238.000 | 229.000 | - | -89.20% | - |
| 444.namd (avg) (percentage) | -3.41% | 4.690 | 4.530 | - | -50.87% | - |
| 416.gamess | -3.11% | 386.000 | 374.000 | - | -32.00% | - |
| 416.gamess (avg) | -3.11% | 386.000 | 374.000 | - | -32.00% | - |
| 481.wrf | -2.75% | 291.000 | 283.000 | - | -17.97% | - |
| 481.wrf (avg) | -2.75% | 291.000 | 283.000 | - | -17.97% | - |
| 433.milc (avg) (percentage) | -2.20% | 2.270 | 2.220 | - | -63.31% | - |
| 435.gromacs (max) | -2.08% | 912.000 | 893.000 | - | -75.01% | - |
| 481.wrf (max) (percentage) | -1.74% | 2.300 | 2.260 | - | -96.71% | - |
| 470.lbm | -1.21% | 413.000 | 408.000 | - | 70.71% | - |
| 470.lbm (avg) | -1.21% | 413.000 | 408.000 | - | 70.71% | - |
| 445.gobmk | -1.15% | 87.000 | 86.000 | - | -56.12% | - |
| 445.gobmk (avg) | -1.15% | 87.000 | 86.000 | - | -56.12% | - |
| 433.milc | -1.04% | 288.000 | 285.000 | - | 313.04% | - |
| 433.milc (avg) | -1.04% | 288.000 | 285.000 | - | 313.04% | - |
| Added Tests - sample variability |
|---|
| 400.perlbench (unexplained diff vs previous) |
| 400.perlbench (unexplained diff vs previous) (percentage) |
| 403.gcc (unexplained diff vs previous) |
| 403.gcc (unexplained diff vs previous) (percentage) |
| 482.sphinx3 (unexplained diff vs previous) |
| 482.sphinx3 (unexplained diff vs previous) (percentage) |
| 483.xalancbmk (unexplained diff vs previous) |
| 483.xalancbmk (unexplained diff vs previous) (percentage) |
| Performance Regressions - Execution | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 454.calculix | 36714.52% | 62.000 | 22825.000 | - | 6.40% | - |
| 403.gcc | 16073.21% | 56.000 | 9057.000 | - | 4.07% | - |
| 462.libquantum | 8133.57% | 140.000 | 11527.000 | - | -15.47% | - |
| 482.sphinx3 | 3071.85% | 945.000 | 29974.000 | - | 11.65% | - |
| 450.soplex | 2684.30% | 567.000 | 15787.000 | - | 5.11% | - |
| 429.mcf | 1112.22% | 1424.000 | 17262.000 | - | -14.99% | - |
| 444.namd | 1110.84% | 747.000 | 9045.000 | - | -1.70% | - |
| 453.povray | 1094.15% | 547.000 | 6532.000 | - | -4.88% | - |
| 433.milc | 1018.07% | 1151.000 | 12869.000 | - | 1.22% | - |
| 436.cactusADM | 749.78% | 2083.000 | 17701.000 | - | -7.17% | - |
| 400.perlbench | 546.54% | 1663.000 | 10752.000 | - | -2.18% | - |
| 434.zeusmp | 433.21% | 2514.000 | 13405.000 | - | -7.21% | - |
| 447.dealII | 416.18% | 1724.000 | 8899.000 | - | 2.80% | - |
| 401.bzip2 | 409.86% | 2941.000 | 14995.000 | - | 7.97% | - |
| 471.omnetpp | 288.00% | 2724.000 | 10569.000 | - | -20.92% | - |
| 459.GemsFDTD | 282.68% | 6173.000 | 23623.000 | - | 10.17% | - |
| 456.hmmer | 279.49% | 2882.000 | 10937.000 | - | 2.87% | - |
| 470.lbm | 237.83% | 3788.000 | 12797.000 | - | -6.60% | - |
| 481.wrf | 204.63% | 5534.000 | 16858.000 | - | -2.91% | - |
| 483.xalancbmk | 189.52% | 3818.000 | 11054.000 | - | -9.45% | - |
| 473.astar | 176.64% | 5128.000 | 14186.000 | - | -5.73% | - |
| 410.bwaves | 149.36% | 5652.000 | 14094.000 | - | 4.62% | - |
| 464.h264ref | 138.81% | 5761.000 | 13758.000 | - | 11.67% | - |
| 445.gobmk | 130.42% | 5023.000 | 11574.000 | - | -0.60% | - |
| 435.gromacs | 110.92% | 7269.000 | 15332.000 | - | 5.04% | - |
| 458.sjeng | 85.65% | 7567.000 | 14048.000 | - | -4.57% | - |
| 416.gamess | 65.29% | 12465.000 | 20603.000 | - | -2.89% | - |
| 437.leslie3d | 21.23% | 11640.000 | 14111.000 | - | 3.42% | - |
| Performance Regressions - sample variability | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 454.calculix | 8450.00% | 4.000 | 342.000 | - | 6.54% | - |
| 454.calculix (avg) | 8450.00% | 4.000 | 342.000 | - | 6.54% | - |
| 462.libquantum | 3500.00% | 10.000 | 360.000 | - | 3.75% | - |
| 462.libquantum (avg) | 3500.00% | 10.000 | 360.000 | - | 3.75% | - |
| 403.gcc | 1800.00% | 4.000 | 76.000 | - | 46.15% | - |
| 403.gcc (avg) | 1800.00% | 4.000 | 76.000 | - | 46.15% | - |
| 462.libquantum (max) | 1192.03% | 138.000 | 1783.000 | - | -0.22% | - |
| 482.sphinx3 | 1131.08% | 74.000 | 911.000 | - | 34.17% | - |
| 482.sphinx3 (avg) | 1131.08% | 74.000 | 911.000 | - | 34.17% | - |
| 454.calculix (max) | 895.08% | 61.000 | 607.000 | - | 0.50% | - |
| 403.gcc (max) | 569.09% | 55.000 | 368.000 | - | 9.52% | - |
| 444.namd | 501.47% | 68.000 | 409.000 | - | -5.10% | - |
| 444.namd (avg) | 501.47% | 68.000 | 409.000 | - | -5.10% | - |
| 450.soplex | 494.44% | 36.000 | 214.000 | - | 4.90% | - |
| 450.soplex (avg) | 494.44% | 36.000 | 214.000 | - | 4.90% | - |
| 433.milc | 313.04% | 69.000 | 285.000 | - | -1.04% | - |
| 433.milc (avg) | 313.04% | 69.000 | 285.000 | - | -1.04% | - |
| 429.mcf | 308.26% | 109.000 | 445.000 | - | 16.19% | - |
| 429.mcf (avg) | 308.26% | 109.000 | 445.000 | - | 16.19% | - |
| 482.sphinx3 (max) | 283.21% | 911.000 | 3491.000 | - | 69.14% | - |
| 453.povray | 254.76% | 42.000 | 149.000 | - | -5.10% | - |
| 453.povray (avg) | 254.76% | 42.000 | 149.000 | - | -5.10% | - |
| 436.cactusADM | 210.48% | 124.000 | 385.000 | - | 3.77% | - |
| 436.cactusADM (avg) | 210.48% | 124.000 | 385.000 | - | 3.77% | - |
| 429.mcf (max) | 95.69% | 1322.000 | 2587.000 | - | -6.44% | - |
| 471.omnetpp | 88.79% | 223.000 | 421.000 | - | 1.20% | - |
| 471.omnetpp (avg) | 88.79% | 223.000 | 421.000 | - | 1.20% | - |
| 434.zeusmp | 86.39% | 147.000 | 274.000 | - | 6.20% | - |
| 434.zeusmp (avg) | 86.39% | 147.000 | 274.000 | - | 6.20% | - |
| 470.lbm | 70.71% | 239.000 | 408.000 | - | -1.21% | - |
| 470.lbm (avg) | 70.71% | 239.000 | 408.000 | - | -1.21% | - |
| 401.bzip2 | 55.28% | 161.000 | 250.000 | - | 34.41% | - |
| 401.bzip2 (avg) | 55.28% | 161.000 | 250.000 | - | 34.41% | - |
| 400.perlbench | 50.48% | 105.000 | 158.000 | - | 0.64% | - |
| 400.perlbench (avg) | 50.48% | 105.000 | 158.000 | - | 0.64% | - |
| 459.GemsFDTD | 34.44% | 360.000 | 484.000 | - | 43.20% | - |
| 459.GemsFDTD (avg) | 34.44% | 360.000 | 484.000 | - | 43.20% | - |
| 453.povray (max) | 26.05% | 499.000 | 629.000 | - | -10.91% | - |
| 483.xalancbmk | 5.24% | 248.000 | 261.000 | - | 13.97% | - |
| 483.xalancbmk (avg) | 5.24% | 248.000 | 261.000 | - | 13.97% | - |
| 410.bwaves | 5.22% | 249.000 | 262.000 | - | 13.42% | - |
| 410.bwaves (avg) | 5.22% | 249.000 | 262.000 | - | 13.42% | - |
| 471.omnetpp (max) | 2.35% | 2169.000 | 2220.000 | - | -26.78% | - |
| Performance Improvements - Execution | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 465.tonto | -21.42% | 10941.000 | 8597.000 | - | -7.45% | - |
| Performance Improvements - sample variability | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 403.gcc (unexplained diff vs previous) (percentage) | -99.97% | 15435.710 | 3.910 | - | 0.00% | - |
| 433.milc (unexplained diff vs previous) (percentage) | -99.88% | 980.800 | 1.200 | - | -62.50% | - |
| 444.namd (unexplained diff vs previous) (percentage) | -99.85% | 1118.610 | 1.720 | - | -76.79% | - |
| 462.libquantum (unexplained diff vs previous) (percentage) | -99.81% | 9655.710 | 18.300 | - | 20233.33% | - |
| 482.sphinx3 (unexplained diff vs previous) (percentage) | -99.62% | 2759.050 | 10.440 | - | 0.00% | - |
| 400.perlbench (unexplained diff vs previous) (percentage) | -99.58% | 527.480 | 2.230 | - | 0.00% | - |
| 436.cactusADM (unexplained diff vs previous) (percentage) | -99.02% | 787.130 | 7.720 | - | 122.48% | - |
| 429.mcf (unexplained diff vs previous) (percentage) | -98.65% | 1305.690 | 17.630 | - | 790.40% | - |
| 433.milc (unexplained diff vs previous) | -98.63% | 11289.000 | 155.000 | - | -61.92% | - |
| 434.zeusmp (unexplained diff vs previous) (percentage) | -98.27% | 448.690 | 7.770 | - | 111.14% | - |
| 444.namd (unexplained diff vs previous) | -98.13% | 8356.000 | 156.000 | - | -77.13% | - |
| 401.bzip2 (unexplained diff vs previous) (percentage) | -98.00% | 368.340 | 7.380 | - | 1266.67% | - |
| 447.dealII (max) (percentage) | -97.94% | 80.280 | 1.650 | - | -6.25% | - |
| 445.gobmk (max) (percentage) | -97.49% | 52.630 | 1.320 | - | -8.33% | - |
| 454.calculix (max) (percentage) | -97.33% | 99.730 | 2.660 | - | -5.67% | - |
| 470.lbm (unexplained diff vs previous) (percentage) | -97.32% | 263.730 | 7.060 | - | 483.47% | - |
| 400.perlbench (unexplained diff vs previous) | -97.26% | 8772.000 | 240.000 | - | 0.00% | - |
| 456.hmmer (max) (percentage) | -97.15% | 73.590 | 2.100 | - | -6.25% | - |
| 473.astar (unexplained diff vs previous) (percentage) | -96.93% | 197.850 | 6.080 | - | 4242.86% | - |
| 400.perlbench (max) (percentage) | -96.91% | 84.060 | 2.600 | - | -12.75% | - |
| 450.soplex (max) (percentage) | -96.89% | 96.240 | 2.990 | - | -8.56% | - |
| 410.bwaves (unexplained diff vs previous) (percentage) | -96.79% | 137.900 | 4.420 | - | 481.58% | - |
| 481.wrf (max) (percentage) | -96.71% | 68.700 | 2.260 | - | -1.74% | - |
| 433.milc (max) (percentage) | -96.50% | 90.750 | 3.180 | - | -11.17% | - |
| 459.GemsFDTD (unexplained diff vs previous) (percentage) | -96.31% | 250.410 | 9.230 | - | 871.58% | - |
| 403.gcc (unexplained diff vs previous) | -95.90% | 8644.000 | 354.000 | - | 0.00% | - |
| 403.gcc (max) (percentage) | -95.90% | 99.360 | 4.070 | - | 5.17% | - |
| 483.xalancbmk (unexplained diff vs previous) (percentage) | -95.24% | 219.170 | 10.430 | - | 0.00% | - |
| 458.sjeng (unexplained diff vs previous) (percentage) | -94.73% | 90.870 | 4.790 | - | 11875.00% | - |
| 445.gobmk (max) | -94.25% | 2643.000 | 152.000 | - | -8.98% | - |
| 471.omnetpp (unexplained diff vs previous) (percentage) | -93.24% | 391.300 | 26.450 | - | 26350.00% | - |
| 416.gamess (max) (percentage) | -92.50% | 38.550 | 2.890 | - | -7.07% | - |
| 410.bwaves (max) (percentage) | -92.03% | 57.970 | 4.620 | - | 128.71% | - |
| 410.bwaves (unexplained diff vs previous) | -92.01% | 7794.000 | 623.000 | - | 504.85% | - |
| 436.cactusADM (max) (percentage) | -91.92% | 88.730 | 7.170 | - | 99.17% | - |
| 444.namd (max) (percentage) | -91.92% | 91.790 | 7.420 | - | -8.62% | - |
| 436.cactusADM (unexplained diff vs previous) | -91.66% | 16396.000 | 1367.000 | - | 106.50% | - |
| 473.astar (unexplained diff vs previous) | -91.49% | 10146.000 | 863.000 | - | 4009.52% | - |
| 473.astar (max) (percentage) | -91.37% | 66.430 | 5.730 | - | 24.84% | - |
| 464.h264ref (unexplained diff vs previous) (percentage) | -91.20% | 118.780 | 10.450 | - | 2077.08% | - |
| 434.zeusmp (max) (percentage) | -91.18% | 81.770 | 7.210 | - | 88.74% | - |
| 470.lbm (unexplained diff vs previous) | -90.95% | 9990.000 | 904.000 | - | 444.58% | - |
| 434.zeusmp (unexplained diff vs previous) | -90.76% | 11280.000 | 1042.000 | - | 95.86% | - |
| 458.sjeng (max) (percentage) | -90.40% | 47.610 | 4.570 | - | 3.86% | - |
| 458.sjeng (unexplained diff vs previous) | -90.21% | 6876.000 | 673.000 | - | 11116.67% | - |
| 481.wrf (max) | -90.00% | 3801.000 | 380.000 | - | -4.76% | - |
| 401.bzip2 (max) (percentage) | -89.87% | 78.650 | 7.970 | - | 25.71% | - |
| 401.bzip2 (unexplained diff vs previous) | -89.78% | 10833.000 | 1107.000 | - | 1376.00% | - |
| 447.dealII (max) | -89.45% | 1384.000 | 146.000 | - | -3.95% | - |
| 453.povray (max) (percentage) | -89.45% | 91.250 | 9.630 | - | -6.41% | - |
| 456.hmmer (max) | -89.20% | 2120.000 | 229.000 | - | -3.78% | - |
| 403.gcc (avg) (percentage) | -88.39% | 7.320 | 0.850 | - | 41.67% | - |
| 435.gromacs (max) (percentage) | -88.14% | 49.160 | 5.830 | - | -6.72% | - |
| 482.sphinx3 (unexplained diff vs previous) | -88.00% | 26073.000 | 3128.000 | - | 0.00% | - |
| 482.sphinx3 (max) (percentage) | -87.93% | 96.500 | 11.650 | - | 51.50% | - |
| 416.gamess (max) | -87.62% | 4805.000 | 595.000 | - | -9.71% | - |
| 470.lbm (max) (percentage) | -86.62% | 72.510 | 9.700 | - | -8.58% | - |
| 483.xalancbmk (max) (percentage) | -86.24% | 68.670 | 9.450 | - | -11.68% | - |
| 483.xalancbmk (unexplained diff vs previous) | -86.22% | 8368.000 | 1153.000 | - | 0.00% | - |
| 459.GemsFDTD (unexplained diff vs previous) | -85.90% | 15458.000 | 2180.000 | - | 968.63% | - |
| 447.dealII (avg) (percentage) | -85.79% | 5.770 | 0.820 | - | 0.00% | - |
| 459.GemsFDTD (max) (percentage) | -85.77% | 71.460 | 10.170 | - | 51.79% | - |
| 462.libquantum (unexplained diff vs previous) | -84.40% | 13518.000 | 2109.000 | - | 17475.00% | - |
| 462.libquantum (max) (percentage) | -84.37% | 98.970 | 15.470 | - | 18.00% | - |
| 429.mcf (max) (percentage) | -83.86% | 92.890 | 14.990 | - | 10.06% | - |
| 429.mcf (unexplained diff vs previous) | -83.63% | 18593.000 | 3044.000 | - | 655.33% | - |
| 437.leslie3d (unexplained diff vs previous) (percentage) | -83.40% | 19.880 | 3.300 | - | 29.41% | - |
| 458.sjeng (max) | -82.20% | 3602.000 | 641.000 | - | -0.93% | - |
| 454.calculix (avg) (percentage) | -81.30% | 8.020 | 1.500 | - | 0.00% | - |
| 445.gobmk (avg) (percentage) | -80.82% | 3.910 | 0.750 | - | 0.00% | - |
| 410.bwaves (max) | -80.13% | 3276.000 | 651.000 | - | 139.34% | - |
| 400.perlbench (max) | -80.03% | 1397.000 | 279.000 | - | -14.68% | - |
| 437.leslie3d (unexplained diff vs previous) | -79.86% | 2314.000 | 466.000 | - | 33.91% | - |
| 437.leslie3d (max) (percentage) | -79.37% | 16.580 | 3.420 | - | 37.35% | - |
| 464.h264ref (unexplained diff vs previous) | -78.99% | 6843.000 | 1438.000 | - | 2337.29% | - |
| 450.soplex (avg) (percentage) | -78.85% | 6.430 | 1.360 | - | 0.00% | - |
| 464.h264ref (max) (percentage) | -78.50% | 54.290 | 11.670 | - | 26.44% | - |
| 456.hmmer (avg) (percentage) | -78.46% | 4.410 | 0.950 | - | 0.00% | - |
| 400.perlbench (avg) (percentage) | -76.85% | 6.350 | 1.470 | - | 2.80% | - |
| 473.astar (max) | -76.16% | 3406.000 | 812.000 | - | 17.68% | - |
| 437.leslie3d (max) | -75.01% | 1929.000 | 482.000 | - | 42.18% | - |
| 435.gromacs (max) | -75.01% | 3573.000 | 893.000 | - | -2.08% | - |
| 471.omnetpp (unexplained diff vs previous) | -73.77% | 10659.000 | 2796.000 | - | 19871.43% | - |
| 471.omnetpp (max) (percentage) | -73.62% | 79.650 | 21.010 | - | -7.40% | - |
| 481.wrf (avg) (percentage) | -73.08% | 6.240 | 1.680 | - | 0.00% | - |
| 458.sjeng (avg) (percentage) | -73.04% | 3.190 | 0.860 | - | 32.31% | - |
| 473.astar (avg) (percentage) | -71.63% | 4.160 | 1.180 | - | 22.92% | - |
| 453.povray (avg) (percentage) | -70.68% | 7.810 | 2.290 | - | 0.00% | - |
| 401.bzip2 (avg) (percentage) | -69.53% | 5.480 | 1.670 | - | 24.63% | - |
| 429.mcf (avg) (percentage) | -66.36% | 7.670 | 2.580 | - | 36.51% | - |
| 434.zeusmp (avg) (percentage) | -64.96% | 5.850 | 2.050 | - | 14.53% | - |
| 459.GemsFDTD (avg) (percentage) | -64.90% | 5.840 | 2.050 | - | 29.75% | - |
| 436.cactusADM (avg) (percentage) | -63.55% | 5.980 | 2.180 | - | 11.79% | - |
| 483.xalancbmk (avg) (percentage) | -63.54% | 6.500 | 2.370 | - | 26.06% | - |
| 433.milc (avg) (percentage) | -63.31% | 6.050 | 2.220 | - | -2.20% | - |
| 482.sphinx3 (avg) (percentage) | -61.66% | 7.930 | 3.040 | - | 20.16% | - |
| 465.tonto (max) | -61.60% | 2112.000 | 811.000 | - | -15.34% | - |
| 435.gromacs (avg) (percentage) | -61.46% | 5.060 | 1.950 | - | 0.00% | - |
| 465.tonto (unexplained diff vs previous) | -60.93% | 1771.000 | 692.000 | - | 733.73% | - |
| 433.milc (max) | -60.82% | 1044.000 | 409.000 | - | -10.11% | - |
| 483.xalancbmk (max) | -60.17% | 2621.000 | 1044.000 | - | -20.06% | - |
| 464.h264ref (avg) (percentage) | -59.33% | 5.090 | 2.070 | - | 38.93% | - |
| 462.libquantum (avg) (percentage) | -59.14% | 7.660 | 3.130 | - | 22.75% | - |
| 416.gamess (avg) (percentage) | -58.82% | 4.420 | 1.820 | - | 0.00% | - |
| 410.bwaves (avg) (percentage) | -57.82% | 4.410 | 1.860 | - | 8.14% | - |
| 445.gobmk | -56.12% | 196.000 | 86.000 | - | -1.15% | - |
| 445.gobmk (avg) | -56.12% | 196.000 | 86.000 | - | -1.15% | - |
| 470.lbm (max) | -54.81% | 2746.000 | 1241.000 | - | -14.59% | - |
| 434.zeusmp (max) | -52.99% | 2055.000 | 966.000 | - | 75.32% | - |
| 471.omnetpp (avg) (percentage) | -51.34% | 8.200 | 3.990 | - | 27.88% | - |
| 465.tonto (max) (percentage) | -51.11% | 19.310 | 9.440 | - | -8.53% | - |
| 444.namd (avg) (percentage) | -50.87% | 9.220 | 4.530 | - | -3.41% | - |
| 465.tonto (unexplained diff vs previous) (percentage) | -50.28% | 16.190 | 8.050 | - | 804.49% | - |
| 458.sjeng | -50.21% | 241.000 | 120.000 | - | 26.32% | - |
| 458.sjeng (avg) | -50.21% | 241.000 | 120.000 | - | 26.32% | - |
| 470.lbm (avg) (percentage) | -49.61% | 6.330 | 3.190 | - | 5.63% | - |
| 464.h264ref (max) | -48.67% | 3127.000 | 1605.000 | - | 41.16% | - |
| 401.bzip2 (max) | -48.34% | 2313.000 | 1195.000 | - | 35.80% | - |
| 459.GemsFDTD (max) | -45.55% | 4411.000 | 2402.000 | - | 67.27% | - |
| 465.tonto | -45.21% | 365.000 | 200.000 | - | 9.89% | - |
| 465.tonto (avg) | -45.21% | 365.000 | 200.000 | - | 9.89% | - |
| 416.gamess | -32.00% | 550.000 | 374.000 | - | -3.11% | - |
| 416.gamess (avg) | -32.00% | 550.000 | 374.000 | - | -3.11% | - |
| 436.cactusADM (max) | -31.33% | 1848.000 | 1269.000 | - | 84.99% | - |
| 465.tonto (avg) (percentage) | -30.24% | 3.340 | 2.330 | - | 18.27% | - |
| 447.dealII | -27.27% | 99.000 | 72.000 | - | 2.86% | - |
| 447.dealII (avg) | -27.27% | 99.000 | 72.000 | - | 2.86% | - |
| 437.leslie3d (avg) (percentage) | -22.62% | 3.050 | 2.360 | - | 2.61% | - |
| 473.astar | -21.60% | 213.000 | 167.000 | - | 15.97% | - |
| 473.astar (avg) | -21.60% | 213.000 | 167.000 | - | 15.97% | - |
| 456.hmmer | -18.90% | 127.000 | 103.000 | - | 1.98% | - |
| 456.hmmer (avg) | -18.90% | 127.000 | 103.000 | - | 1.98% | - |
| 435.gromacs | -18.80% | 367.000 | 298.000 | - | 4.93% | - |
| 435.gromacs (avg) | -18.80% | 367.000 | 298.000 | - | 4.93% | - |
| 481.wrf | -17.97% | 345.000 | 283.000 | - | -2.75% | - |
| 481.wrf (avg) | -17.97% | 345.000 | 283.000 | - | -2.75% | - |
| 450.soplex (max) | -13.39% | 545.000 | 472.000 | - | -3.87% | - |
| 437.leslie3d | -6.20% | 355.000 | 333.000 | - | 6.39% | - |
| 437.leslie3d (avg) | -6.20% | 355.000 | 333.000 | - | 6.39% | - |
| 464.h264ref | -3.07% | 293.000 | 284.000 | - | 55.19% | - |
| 464.h264ref (avg) | -3.07% | 293.000 | 284.000 | - | 55.19% | - |
| 444.namd (max) | -2.04% | 685.000 | 671.000 | - | -10.17% | - |
Report Time: 0.37s