Fields
| hardware | None |
| os | None |
Parameters
Fields
| Name | Value |
|---|
Parameters
| Name | Value |
|---|---|
| git_binutils | https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=99d679e7b30ea9a0b6ffcd64e9ba35e43166151b (+ 15 commits) |
| git_gcc | https://github.com/gcc-mirror/gcc/commit/c8e93a08693cdd8e18f129f3a1918ed3d32eeebe (+ 130 commits) |
| git_glibc | https://sourceware.org/git/?p=glibc.git;a=commit;h=22c96052acf78c5f4644117bece38715fc7210cf (+ 3 commits) |
| git_linux | https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=85b49e2cff27a81badba95e274bf47402836a9cd (+ 191 commits) |
| test_url | https://ci.linaro.org/job/tcwg_bmk_ci_gnu-build-tcwg_bmk_apm-gnu-master-arm-spec2k6-Os_LTO/152/ |
Filter
gnu-arm-master-Os_LTO test results
| Run | Order | Start Time | Duration |
|---|---|---|---|
| Current | 0152 (4-changed-components) | 2022-09-14T06:23:33 | 0:00:00 |
| Previous | 0151 (3-changed-components) | 2024-02-24T21:37:40 | 0:00:00 |
| Baseline | 0001 (3-changed-components) | 2022-12-30T06:27:35 | 0:00:00 |
Tests Summary
| Status Group | # | # (B) |
|---|---|---|
| Performance Regressions | 170 | 148 |
| Performance Improvements | 45 | 46 |
| Added Tests | 5 | 0 |
| Unchanged Tests | 1016 | 1042 |
| Total Tests | 1236 |
| Performance Regressions - Code Size | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 470.lbm | 6.11% | 10221.000 | 10845.000 | - | 0.00% | - |
| 434.zeusmp | 3.71% | 139198.000 | 144364.000 | - | 2.34% | - |
| Performance Regressions - Execution | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 454.calculix | 48008.47% | 59.000 | 28384.000 | - | -12.64% | - |
| 403.gcc | 15386.21% | 58.000 | 8982.000 | - | 1.03% | - |
| 462.libquantum | 8132.04% | 206.000 | 16958.000 | - | -0.28% | - |
| 482.sphinx3 | 3874.45% | 912.000 | 36247.000 | - | -0.93% | - |
| 450.soplex | 2503.81% | 604.000 | 15727.000 | - | 0.11% | - |
| 444.namd | 1668.59% | 901.000 | 15935.000 | - | -0.14% | - |
| 453.povray | 1258.30% | 542.000 | 7362.000 | - | -0.45% | - |
| 433.milc | 1162.88% | 1099.000 | 13879.000 | - | 1.54% | - |
| 429.mcf | 1118.63% | 966.000 | 11772.000 | - | 0.38% | - |
| 436.cactusADM | 834.28% | 2614.000 | 24422.000 | - | 0.11% | - |
| 434.zeusmp | 650.70% | 2801.000 | 21027.000 | - | 0.45% | - |
| 400.perlbench | 590.53% | 1636.000 | 11297.000 | - | 0.73% | - |
| 401.bzip2 | 466.60% | 3006.000 | 17032.000 | - | 0.36% | - |
| 447.dealII | 381.50% | 1903.000 | 9163.000 | - | 0.68% | - |
| 456.hmmer | 338.51% | 4544.000 | 19926.000 | - | 4.90% | - |
| 470.lbm | 334.41% | 3749.000 | 16286.000 | - | -0.16% | - |
| 459.GemsFDTD | 255.42% | 7146.000 | 25398.000 | - | 0.13% | - |
| 481.wrf | 242.02% | 6435.000 | 22009.000 | - | 0.08% | - |
| 471.omnetpp | 223.91% | 2790.000 | 9037.000 | - | -2.46% | - |
| 473.astar | 166.82% | 4861.000 | 12970.000 | - | -0.10% | - |
| 410.bwaves | 153.58% | 5922.000 | 15017.000 | - | 1.84% | - |
| 445.gobmk | 142.86% | 5110.000 | 12410.000 | - | 0.11% | - |
| 464.h264ref | 141.08% | 6202.000 | 14952.000 | - | -1.68% | - |
| 435.gromacs | 124.51% | 7504.000 | 16847.000 | - | -0.04% | - |
| 458.sjeng | 105.74% | 7881.000 | 16214.000 | - | 1.22% | - |
| 416.gamess | 99.32% | 14807.000 | 29514.000 | - | 0.36% | - |
| 437.leslie3d | 42.36% | 12768.000 | 18177.000 | - | 0.59% | - |
| Performance Regressions - sample variability | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 454.calculix (max) | 154800.00% | 1.000 | 1549.000 | - | 469.49% | - |
| 454.calculix | 64850.00% | 2.000 | 1299.000 | - | 97.12% | - |
| 454.calculix (avg) | 64850.00% | 2.000 | 1299.000 | - | 97.12% | - |
| 433.milc (unexplained diff vs previous) | 24000.00% | 1.000 | 241.000 | - | 151.04% | - |
| 482.sphinx3 (max) | 23792.31% | 13.000 | 3106.000 | - | 169.62% | - |
| 470.lbm (unexplained diff vs previous) | 12185.71% | 7.000 | 860.000 | - | 4.62% | - |
| 444.namd (max) | 11871.43% | 7.000 | 838.000 | - | -4.66% | - |
| 444.namd (unexplained diff vs previous) | 11285.71% | 7.000 | 797.000 | - | -4.44% | - |
| 482.sphinx3 (unexplained diff vs previous) | 10035.71% | 14.000 | 1419.000 | - | 26.92% | - |
| 436.cactusADM (max) | 9230.77% | 13.000 | 1213.000 | - | -1.46% | - |
| 436.cactusADM (unexplained diff vs previous) | 8792.31% | 13.000 | 1156.000 | - | -1.45% | - |
| 482.sphinx3 | 8555.56% | 18.000 | 1558.000 | - | 81.37% | - |
| 482.sphinx3 (avg) | 8555.56% | 18.000 | 1558.000 | - | 81.37% | - |
| 403.gcc | 8400.00% | 1.000 | 85.000 | - | 123.68% | - |
| 403.gcc (avg) | 8400.00% | 1.000 | 85.000 | - | 123.68% | - |
| 403.gcc (unexplained diff vs previous) | 7600.00% | 1.000 | 77.000 | - | 48.08% | - |
| 456.hmmer (unexplained diff vs previous) | 5400.00% | 3.000 | 165.000 | - | 68.37% | - |
| 444.namd | 4992.86% | 14.000 | 713.000 | - | 72.22% | - |
| 444.namd (avg) | 4992.86% | 14.000 | 713.000 | - | 72.22% | - |
| 462.libquantum | 3833.33% | 3.000 | 118.000 | - | 268.75% | - |
| 462.libquantum (avg) | 3833.33% | 3.000 | 118.000 | - | 268.75% | - |
| 403.gcc (max) | 3640.00% | 5.000 | 187.000 | - | 259.62% | - |
| 470.lbm (max) | 3304.17% | 24.000 | 817.000 | - | -8.51% | - |
| 434.zeusmp (unexplained diff vs previous) | 3092.31% | 13.000 | 415.000 | - | -11.70% | - |
| 416.gamess (max) | 3087.10% | 31.000 | 988.000 | - | 7.04% | - |
| 416.gamess (unexplained diff vs previous) | 2990.32% | 31.000 | 958.000 | - | 6.92% | - |
| 453.povray (max) | 2966.67% | 12.000 | 368.000 | - | 92.67% | - |
| 471.omnetpp (max) | 2734.04% | 47.000 | 1332.000 | - | 674.42% | - |
| 470.lbm (unexplained diff vs previous) (percentage) | 2678.95% | 0.190 | 5.280 | - | 4.76% | - |
| 464.h264ref (max) | 2603.12% | 32.000 | 865.000 | - | 1366.10% | - |
| 453.povray | 2377.78% | 9.000 | 223.000 | - | 97.35% | - |
| 453.povray (avg) | 2377.78% | 9.000 | 223.000 | - | 97.35% | - |
| 433.milc (max) | 2181.82% | 11.000 | 251.000 | - | 158.76% | - |
| 436.cactusADM | 2036.11% | 36.000 | 769.000 | - | 31.45% | - |
| 436.cactusADM (avg) | 2036.11% | 36.000 | 769.000 | - | 31.45% | - |
| 481.wrf (max) | 1994.44% | 36.000 | 754.000 | - | -17.51% | - |
| 433.milc (unexplained diff vs previous) (percentage) | 1833.33% | 0.090 | 1.740 | - | 148.57% | - |
| 456.hmmer (max) | 1733.33% | 9.000 | 165.000 | - | 68.37% | - |
| 459.GemsFDTD (max) | 1582.14% | 56.000 | 942.000 | - | 62.98% | - |
| 416.gamess (max) (percentage) | 1495.24% | 0.210 | 3.350 | - | 6.69% | - |
| 416.gamess (unexplained diff vs previous) (percentage) | 1447.62% | 0.210 | 3.250 | - | 6.56% | - |
| 434.zeusmp (max) | 1407.14% | 28.000 | 422.000 | - | -12.27% | - |
| 450.soplex (max) | 1307.69% | 26.000 | 366.000 | - | 430.43% | - |
| 456.hmmer (unexplained diff vs previous) (percentage) | 1085.71% | 0.070 | 0.830 | - | 59.62% | - |
| 433.milc | 1073.68% | 19.000 | 223.000 | - | 137.23% | - |
| 433.milc (avg) | 1073.68% | 19.000 | 223.000 | - | 137.23% | - |
| 464.h264ref (max) (percentage) | 1013.46% | 0.520 | 5.790 | - | 1384.62% | - |
| 410.bwaves (max) | 1011.54% | 52.000 | 578.000 | - | 122.31% | - |
| 436.cactusADM (max) (percentage) | 894.00% | 0.500 | 4.970 | - | -1.58% | - |
| 436.cactusADM (unexplained diff vs previous) (percentage) | 846.00% | 0.500 | 4.730 | - | -1.66% | - |
| 429.mcf (max) | 844.69% | 179.000 | 1691.000 | - | 4470.27% | - |
| 470.lbm | 809.52% | 63.000 | 573.000 | - | -5.76% | - |
| 470.lbm (avg) | 809.52% | 63.000 | 573.000 | - | -5.76% | - |
| 471.omnetpp (max) (percentage) | 772.19% | 1.690 | 14.740 | - | 692.47% | - |
| 435.gromacs (max) | 750.00% | 120.000 | 1020.000 | - | 244.59% | - |
| 458.sjeng (max) | 707.27% | 55.000 | 444.000 | - | 825.00% | - |
| 434.zeusmp | 682.93% | 41.000 | 321.000 | - | 25.88% | - |
| 434.zeusmp (avg) | 682.93% | 41.000 | 321.000 | - | 25.88% | - |
| 470.lbm (max) (percentage) | 660.61% | 0.660 | 5.020 | - | -8.39% | - |
| 444.namd (max) (percentage) | 574.36% | 0.780 | 5.260 | - | -4.54% | - |
| 481.wrf | 554.84% | 124.000 | 812.000 | - | 43.72% | - |
| 481.wrf (avg) | 554.84% | 124.000 | 812.000 | - | 43.72% | - |
| 444.namd (unexplained diff vs previous) (percentage) | 541.03% | 0.780 | 5.000 | - | -4.40% | - |
| 462.libquantum (max) (percentage) | 529.17% | 0.480 | 3.020 | - | 3675.00% | - |
| 473.astar (max) | 513.46% | 52.000 | 319.000 | - | 422.95% | - |
| 481.wrf (max) (percentage) | 501.75% | 0.570 | 3.430 | - | -17.55% | - |
| 429.mcf | 500.00% | 58.000 | 348.000 | - | 521.43% | - |
| 429.mcf (avg) | 500.00% | 58.000 | 348.000 | - | 521.43% | - |
| 482.sphinx3 (max) (percentage) | 467.55% | 1.510 | 8.570 | - | 172.06% | - |
| 450.soplex | 452.63% | 19.000 | 105.000 | - | 183.78% | - |
| 450.soplex (avg) | 452.63% | 19.000 | 105.000 | - | 183.78% | - |
| 459.GemsFDTD | 440.17% | 117.000 | 632.000 | - | 79.55% | - |
| 459.GemsFDTD (avg) | 440.17% | 117.000 | 632.000 | - | 79.55% | - |
| 471.omnetpp | 438.18% | 55.000 | 296.000 | - | 171.56% | - |
| 471.omnetpp (avg) | 438.18% | 55.000 | 296.000 | - | 171.56% | - |
| 416.gamess | 419.85% | 131.000 | 681.000 | - | 40.41% | - |
| 416.gamess (avg) | 419.85% | 131.000 | 681.000 | - | 40.41% | - |
| 447.dealII (max) | 414.71% | 34.000 | 175.000 | - | 16.67% | - |
| 447.dealII (unexplained diff vs previous) | 405.88% | 34.000 | 172.000 | - | 152.94% | - |
| 459.GemsFDTD (max) (percentage) | 369.62% | 0.790 | 3.710 | - | 62.72% | - |
| 410.bwaves (max) (percentage) | 337.50% | 0.880 | 3.850 | - | 117.51% | - |
| 434.zeusmp (unexplained diff vs previous) (percentage) | 328.26% | 0.460 | 1.970 | - | -12.44% | - |
| 456.hmmer (max) (percentage) | 315.00% | 0.200 | 0.830 | - | 59.62% | - |
| 464.h264ref | 305.71% | 70.000 | 284.000 | - | 381.36% | - |
| 464.h264ref (avg) | 305.71% | 70.000 | 284.000 | - | 381.36% | - |
| 458.sjeng (max) (percentage) | 291.43% | 0.700 | 2.740 | - | 813.33% | - |
| 435.gromacs (max) (percentage) | 276.40% | 1.610 | 6.060 | - | 244.32% | - |
| 450.soplex (unexplained diff vs previous) | 275.00% | 12.000 | 45.000 | - | -34.78% | - |
| 447.dealII | 268.42% | 38.000 | 140.000 | - | 77.22% | - |
| 447.dealII (avg) | 268.42% | 38.000 | 140.000 | - | 77.22% | - |
| 483.xalancbmk (max) (percentage) | 237.42% | 1.550 | 5.230 | - | 468.48% | - |
| 456.hmmer | 218.42% | 38.000 | 121.000 | - | 116.07% | - |
| 456.hmmer (avg) | 218.42% | 38.000 | 121.000 | - | 116.07% | - |
| 410.bwaves (unexplained diff vs previous) | 210.64% | 47.000 | 146.000 | - | -43.19% | - |
| 410.bwaves | 208.64% | 81.000 | 250.000 | - | -13.49% | - |
| 410.bwaves (avg) | 208.64% | 81.000 | 250.000 | - | -13.49% | - |
| 435.gromacs | 191.50% | 153.000 | 446.000 | - | 178.75% | - |
| 435.gromacs (avg) | 191.50% | 153.000 | 446.000 | - | 178.75% | - |
| 444.namd (avg) (percentage) | 180.00% | 1.600 | 4.480 | - | 72.31% | - |
| 465.tonto (max) (percentage) | 167.53% | 0.770 | 2.060 | - | 20.47% | - |
| 416.gamess (avg) (percentage) | 159.55% | 0.890 | 2.310 | - | 40.00% | - |
| 401.bzip2 | 154.29% | 70.000 | 178.000 | - | 295.56% | - |
| 401.bzip2 (avg) | 154.29% | 70.000 | 178.000 | - | 295.56% | - |
| 482.sphinx3 (unexplained diff vs previous) (percentage) | 153.90% | 1.540 | 3.910 | - | 27.78% | - |
| 458.sjeng | 130.26% | 76.000 | 175.000 | - | 386.11% | - |
| 458.sjeng (avg) | 130.26% | 76.000 | 175.000 | - | 386.11% | - |
| 473.astar (max) (percentage) | 127.78% | 1.080 | 2.460 | - | 423.40% | - |
| 436.cactusADM (avg) (percentage) | 123.40% | 1.410 | 3.150 | - | 31.25% | - |
| 453.povray (max) (percentage) | 122.67% | 2.250 | 5.010 | - | 93.44% | - |
| 482.sphinx3 (avg) (percentage) | 113.93% | 2.010 | 4.300 | - | 82.98% | - |
| 465.tonto (max) | 109.00% | 100.000 | 209.000 | - | -6.28% | - |
| 470.lbm (avg) (percentage) | 108.28% | 1.690 | 3.520 | - | -5.63% | - |
| 434.zeusmp (max) (percentage) | 97.06% | 1.020 | 2.010 | - | -12.61% | - |
| 481.wrf (avg) (percentage) | 91.19% | 1.930 | 3.690 | - | 43.58% | - |
| 483.xalancbmk (avg) (percentage) | 84.21% | 1.140 | 2.100 | - | 275.00% | - |
| 429.mcf (unexplained diff vs previous) | 79.49% | 39.000 | 70.000 | - | 600.00% | - |
| 454.calculix (max) (percentage) | 77.85% | 3.070 | 5.460 | - | 550.00% | - |
| 433.milc (max) (percentage) | 77.45% | 1.020 | 1.810 | - | 154.93% | - |
| 465.tonto (avg) (percentage) | 73.33% | 0.900 | 1.560 | - | 36.84% | - |
| 464.h264ref (avg) (percentage) | 68.14% | 1.130 | 1.900 | - | 387.18% | - |
| 453.povray (avg) (percentage) | 64.67% | 1.840 | 3.030 | - | 98.04% | - |
| 471.omnetpp (avg) (percentage) | 64.00% | 2.000 | 3.280 | - | 177.97% | - |
| 459.GemsFDTD (avg) (percentage) | 50.91% | 1.650 | 2.490 | - | 79.14% | - |
| 445.gobmk (max) | 50.00% | 26.000 | 39.000 | - | 18.18% | - |
| 400.perlbench (max) | 48.15% | 27.000 | 40.000 | - | -55.06% | - |
| 465.tonto | 36.21% | 116.000 | 158.000 | - | 6.76% | - |
| 465.tonto (avg) | 36.21% | 116.000 | 158.000 | - | 6.76% | - |
| 454.calculix (avg) (percentage) | 33.14% | 3.440 | 4.580 | - | 125.62% | - |
| 435.gromacs (avg) (percentage) | 29.27% | 2.050 | 2.650 | - | 178.95% | - |
| 400.perlbench | 25.00% | 32.000 | 40.000 | - | -6.98% | - |
| 400.perlbench (avg) | 25.00% | 32.000 | 40.000 | - | -6.98% | - |
| 410.bwaves (unexplained diff vs previous) (percentage) | 22.78% | 0.790 | 0.970 | - | -44.25% | - |
| 473.astar | 22.22% | 90.000 | 110.000 | - | 115.69% | - |
| 473.astar (avg) | 22.22% | 90.000 | 110.000 | - | 115.69% | - |
| 410.bwaves (avg) (percentage) | 21.01% | 1.380 | 1.670 | - | -14.80% | - |
| 401.bzip2 (max) | 17.39% | 69.000 | 81.000 | - | 20.90% | - |
| 458.sjeng (avg) (percentage) | 11.34% | 0.970 | 1.080 | - | 369.57% | - |
| 447.dealII (unexplained diff vs previous) (percentage) | 5.03% | 1.790 | 1.880 | - | 150.67% | - |
| 447.dealII (max) (percentage) | 4.95% | 1.820 | 1.910 | - | 15.76% | - |
| 434.zeusmp (avg) (percentage) | 2.68% | 1.490 | 1.530 | - | 25.41% | - |
| Performance Regressions - Score | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| nb_total_tests | -3.33% | 30.000 | 29.000 | - | 0.00% | - |
| Performance Improvements - Code Size | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 437.leslie3d | -3.01% | 49564.000 | 48073.000 | - | 0.15% | - |
| 453.povray | -2.00% | 499105.000 | 489103.000 | - | 0.02% | - |
| 416.gamess | -1.67% | 4631717.000 | 4554432.000 | - | -0.01% | - |
| 473.astar | -1.47% | 15781.000 | 15549.000 | - | 0.00% | - |
| 403.gcc | -1.13% | 1603710.000 | 1585625.000 | - | -0.28% | - |
| 447.dealII | -1.07% | 193202.000 | 191138.000 | - | 0.00% | - |
| Performance Improvements - Execution | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 465.tonto | -21.56% | 12989.000 | 10189.000 | - | -21.89% | - |
| Performance Improvements - sample variability | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 462.libquantum (unexplained diff vs previous) (percentage) | -97.96% | 0.490 | 0.010 | - | -87.50% | - |
| 450.soplex (unexplained diff vs previous) (percentage) | -85.43% | 1.990 | 0.290 | - | -34.09% | - |
| 401.bzip2 (unexplained diff vs previous) (percentage) | -85.40% | 2.260 | 0.330 | - | -19.51% | - |
| 429.mcf (unexplained diff vs previous) (percentage) | -85.40% | 4.040 | 0.590 | - | 555.56% | - |
| 471.omnetpp (unexplained diff vs previous) (percentage) | -83.14% | 1.720 | 0.290 | - | -56.72% | - |
| 400.perlbench (avg) (percentage) | -81.73% | 1.970 | 0.360 | - | -7.69% | - |
| 401.bzip2 (max) (percentage) | -79.22% | 2.310 | 0.480 | - | 20.00% | - |
| 450.soplex (avg) (percentage) | -79.19% | 3.220 | 0.670 | - | 179.17% | - |
| 400.perlbench (max) (percentage) | -78.57% | 1.680 | 0.360 | - | -55.00% | - |
| 437.leslie3d (max) (percentage) | -78.23% | 11.620 | 2.530 | - | -18.39% | - |
| 403.gcc (max) (percentage) | -77.67% | 9.360 | 2.090 | - | 254.24% | - |
| 437.leslie3d (unexplained diff vs previous) (percentage) | -76.27% | 10.410 | 2.470 | - | 139.81% | - |
| 473.astar (unexplained diff vs previous) (percentage) | -74.74% | 0.950 | 0.240 | - | -48.94% | - |
| 445.gobmk (avg) (percentage) | -73.55% | 1.210 | 0.320 | - | 45.45% | - |
| 437.leslie3d (max) | -69.05% | 1483.000 | 459.000 | - | -18.04% | - |
| 437.leslie3d (unexplained diff vs previous) | -66.22% | 1329.000 | 449.000 | - | 140.11% | - |
| 403.gcc (avg) (percentage) | -59.92% | 2.370 | 0.950 | - | 120.93% | - |
| 462.libquantum (avg) (percentage) | -59.30% | 1.720 | 0.700 | - | 268.42% | - |
| 437.leslie3d (avg) (percentage) | -58.11% | 4.130 | 1.730 | - | 3.59% | - |
| 401.bzip2 (avg) (percentage) | -55.13% | 2.340 | 1.050 | - | 288.89% | - |
| 473.astar (avg) (percentage) | -54.55% | 1.870 | 0.850 | - | 112.50% | - |
| 429.mcf (avg) (percentage) | -51.32% | 6.080 | 2.960 | - | 516.67% | - |
| 403.gcc (unexplained diff vs previous) (percentage) | -50.00% | 1.720 | 0.860 | - | 48.28% | - |
| 450.soplex (max) (percentage) | -47.29% | 4.420 | 2.330 | - | 429.55% | - |
| 471.omnetpp (unexplained diff vs previous) | -45.83% | 48.000 | 26.000 | - | -58.06% | - |
| 437.leslie3d | -40.42% | 527.000 | 314.000 | - | 4.32% | - |
| 437.leslie3d (avg) | -40.42% | 527.000 | 314.000 | - | 4.32% | - |
| 445.gobmk (max) (percentage) | -38.46% | 0.520 | 0.320 | - | 18.52% | - |
| 445.gobmk | -36.07% | 61.000 | 39.000 | - | 44.44% | - |
| 445.gobmk (avg) | -36.07% | 61.000 | 39.000 | - | 44.44% | - |
| 473.astar (unexplained diff vs previous) | -32.61% | 46.000 | 31.000 | - | -49.18% | - |
| 456.hmmer (avg) (percentage) | -28.24% | 0.850 | 0.610 | - | 103.33% | - |
| 447.dealII (avg) (percentage) | -25.00% | 2.040 | 1.530 | - | 75.86% | - |
| 429.mcf (max) (percentage) | -22.70% | 18.590 | 14.370 | - | 4390.62% | - |
| 401.bzip2 (unexplained diff vs previous) | -16.18% | 68.000 | 57.000 | - | -17.39% | - |
| 433.milc (avg) (percentage) | -8.00% | 1.750 | 1.610 | - | 133.33% | - |
| Performance Improvements - Score | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| nb_compile_successful | 3.57% | 28.000 | 29.000 | - | 0.00% | - |
| nb_execution_successful | 3.57% | 28.000 | 29.000 | - | 0.00% | - |
| Added Tests - Code Size |
|---|
| 483.xalancbmk |
| Added Tests - Execution |
|---|
| 483.xalancbmk |
| Added Tests - sample variability |
|---|
| 483.xalancbmk |
| 483.xalancbmk (avg) |
| 483.xalancbmk (max) |
| Performance Regressions - Code Size | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 434.zeusmp | 2.34% | 141060.000 | 144364.000 | - | 3.71% | - |
| 459.GemsFDTD | 1.12% | 195766.000 | 197966.000 | - | -0.31% | - |
| 450.soplex | 1.10% | 135596.000 | 137094.000 | - | 0.06% | - |
| Performance Regressions - Execution | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 456.hmmer | 4.90% | 18995.000 | 19926.000 | - | 338.51% | - |
| 410.bwaves | 1.84% | 14745.000 | 15017.000 | - | 153.58% | - |
| 483.xalancbmk | 1.78% | 8027.000 | 8170.000 | - | 0.00% | - |
| 433.milc | 1.54% | 13668.000 | 13879.000 | - | 1162.88% | - |
| 458.sjeng | 1.22% | 16018.000 | 16214.000 | - | 105.74% | - |
| 403.gcc | 1.03% | 8890.000 | 8982.000 | - | 15386.21% | - |
| Performance Regressions - sample variability | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 429.mcf (max) | 4470.27% | 37.000 | 1691.000 | - | 844.69% | - |
| 429.mcf (max) (percentage) | 4390.62% | 0.320 | 14.370 | - | -22.70% | - |
| 462.libquantum (max) | 3838.46% | 13.000 | 512.000 | - | 0.00% | - |
| 462.libquantum (max) (percentage) | 3675.00% | 0.080 | 3.020 | - | 529.17% | - |
| 464.h264ref (max) (percentage) | 1384.62% | 0.390 | 5.790 | - | 1013.46% | - |
| 464.h264ref (max) | 1366.10% | 59.000 | 865.000 | - | 2603.12% | - |
| 458.sjeng (max) | 825.00% | 48.000 | 444.000 | - | 707.27% | - |
| 458.sjeng (max) (percentage) | 813.33% | 0.300 | 2.740 | - | 291.43% | - |
| 471.omnetpp (max) (percentage) | 692.47% | 1.860 | 14.740 | - | 772.19% | - |
| 471.omnetpp (max) | 674.42% | 172.000 | 1332.000 | - | 2734.04% | - |
| 429.mcf (unexplained diff vs previous) | 600.00% | 10.000 | 70.000 | - | 79.49% | - |
| 429.mcf (unexplained diff vs previous) (percentage) | 555.56% | 0.090 | 0.590 | - | -85.40% | - |
| 454.calculix (max) (percentage) | 550.00% | 0.840 | 5.460 | - | 77.85% | - |
| 429.mcf | 521.43% | 56.000 | 348.000 | - | 500.00% | - |
| 429.mcf (avg) | 521.43% | 56.000 | 348.000 | - | 500.00% | - |
| 429.mcf (avg) (percentage) | 516.67% | 0.480 | 2.960 | - | -51.32% | - |
| 483.xalancbmk (max) | 484.93% | 73.000 | 427.000 | - | 0.00% | - |
| 454.calculix (max) | 469.49% | 272.000 | 1549.000 | - | 154800.00% | - |
| 483.xalancbmk (max) (percentage) | 468.48% | 0.920 | 5.230 | - | 237.42% | - |
| 450.soplex (max) | 430.43% | 69.000 | 366.000 | - | 1307.69% | - |
| 450.soplex (max) (percentage) | 429.55% | 0.440 | 2.330 | - | -47.29% | - |
| 473.astar (max) (percentage) | 423.40% | 0.470 | 2.460 | - | 127.78% | - |
| 473.astar (max) | 422.95% | 61.000 | 319.000 | - | 513.46% | - |
| 464.h264ref (avg) (percentage) | 387.18% | 0.390 | 1.900 | - | 68.14% | - |
| 458.sjeng | 386.11% | 36.000 | 175.000 | - | 130.26% | - |
| 458.sjeng (avg) | 386.11% | 36.000 | 175.000 | - | 130.26% | - |
| 464.h264ref | 381.36% | 59.000 | 284.000 | - | 305.71% | - |
| 464.h264ref (avg) | 381.36% | 59.000 | 284.000 | - | 305.71% | - |
| 458.sjeng (avg) (percentage) | 369.57% | 0.230 | 1.080 | - | 11.34% | - |
| 401.bzip2 | 295.56% | 45.000 | 178.000 | - | 154.29% | - |
| 401.bzip2 (avg) | 295.56% | 45.000 | 178.000 | - | 154.29% | - |
| 401.bzip2 (avg) (percentage) | 288.89% | 0.270 | 1.050 | - | -55.13% | - |
| 483.xalancbmk | 288.64% | 44.000 | 171.000 | - | 0.00% | - |
| 483.xalancbmk (avg) | 288.64% | 44.000 | 171.000 | - | 0.00% | - |
| 483.xalancbmk (avg) (percentage) | 275.00% | 0.560 | 2.100 | - | 84.21% | - |
| 462.libquantum | 268.75% | 32.000 | 118.000 | - | 3833.33% | - |
| 462.libquantum (avg) | 268.75% | 32.000 | 118.000 | - | 3833.33% | - |
| 462.libquantum (avg) (percentage) | 268.42% | 0.190 | 0.700 | - | -59.30% | - |
| 403.gcc (max) | 259.62% | 52.000 | 187.000 | - | 3640.00% | - |
| 403.gcc (max) (percentage) | 254.24% | 0.590 | 2.090 | - | -77.67% | - |
| 435.gromacs (max) | 244.59% | 296.000 | 1020.000 | - | 750.00% | - |
| 435.gromacs (max) (percentage) | 244.32% | 1.760 | 6.060 | - | 276.40% | - |
| 450.soplex | 183.78% | 37.000 | 105.000 | - | 452.63% | - |
| 450.soplex (avg) | 183.78% | 37.000 | 105.000 | - | 452.63% | - |
| 450.soplex (avg) (percentage) | 179.17% | 0.240 | 0.670 | - | -79.19% | - |
| 435.gromacs (avg) (percentage) | 178.95% | 0.950 | 2.650 | - | 29.27% | - |
| 435.gromacs | 178.75% | 160.000 | 446.000 | - | 191.50% | - |
| 435.gromacs (avg) | 178.75% | 160.000 | 446.000 | - | 191.50% | - |
| 471.omnetpp (avg) (percentage) | 177.97% | 1.180 | 3.280 | - | 64.00% | - |
| 482.sphinx3 (max) (percentage) | 172.06% | 3.150 | 8.570 | - | 467.55% | - |
| 471.omnetpp | 171.56% | 109.000 | 296.000 | - | 438.18% | - |
| 471.omnetpp (avg) | 171.56% | 109.000 | 296.000 | - | 438.18% | - |
| 482.sphinx3 (max) | 169.62% | 1152.000 | 3106.000 | - | 23792.31% | - |
| 433.milc (max) | 158.76% | 97.000 | 251.000 | - | 2181.82% | - |
| 433.milc (max) (percentage) | 154.93% | 0.710 | 1.810 | - | 77.45% | - |
| 447.dealII (unexplained diff vs previous) | 152.94% | 68.000 | 172.000 | - | 405.88% | - |
| 433.milc (unexplained diff vs previous) | 151.04% | 96.000 | 241.000 | - | 24000.00% | - |
| 447.dealII (unexplained diff vs previous) (percentage) | 150.67% | 0.750 | 1.880 | - | 5.03% | - |
| 433.milc (unexplained diff vs previous) (percentage) | 148.57% | 0.700 | 1.740 | - | 1833.33% | - |
| 437.leslie3d (unexplained diff vs previous) | 140.11% | 187.000 | 449.000 | - | -66.22% | - |
| 437.leslie3d (unexplained diff vs previous) (percentage) | 139.81% | 1.030 | 2.470 | - | -76.27% | - |
| 433.milc | 137.23% | 94.000 | 223.000 | - | 1073.68% | - |
| 433.milc (avg) | 137.23% | 94.000 | 223.000 | - | 1073.68% | - |
| 433.milc (avg) (percentage) | 133.33% | 0.690 | 1.610 | - | -8.00% | - |
| 454.calculix (avg) (percentage) | 125.62% | 2.030 | 4.580 | - | 33.14% | - |
| 403.gcc | 123.68% | 38.000 | 85.000 | - | 8400.00% | - |
| 403.gcc (avg) | 123.68% | 38.000 | 85.000 | - | 8400.00% | - |
| 410.bwaves (max) | 122.31% | 260.000 | 578.000 | - | 1011.54% | - |
| 403.gcc (avg) (percentage) | 120.93% | 0.430 | 0.950 | - | -59.92% | - |
| 410.bwaves (max) (percentage) | 117.51% | 1.770 | 3.850 | - | 337.50% | - |
| 456.hmmer | 116.07% | 56.000 | 121.000 | - | 218.42% | - |
| 456.hmmer (avg) | 116.07% | 56.000 | 121.000 | - | 218.42% | - |
| 473.astar | 115.69% | 51.000 | 110.000 | - | 22.22% | - |
| 473.astar (avg) | 115.69% | 51.000 | 110.000 | - | 22.22% | - |
| 473.astar (avg) (percentage) | 112.50% | 0.400 | 0.850 | - | -54.55% | - |
| 456.hmmer (avg) (percentage) | 103.33% | 0.300 | 0.610 | - | -28.24% | - |
| 453.povray (avg) (percentage) | 98.04% | 1.530 | 3.030 | - | 64.67% | - |
| 453.povray | 97.35% | 113.000 | 223.000 | - | 2377.78% | - |
| 453.povray (avg) | 97.35% | 113.000 | 223.000 | - | 2377.78% | - |
| 454.calculix | 97.12% | 659.000 | 1299.000 | - | 64850.00% | - |
| 454.calculix (avg) | 97.12% | 659.000 | 1299.000 | - | 64850.00% | - |
| 453.povray (max) (percentage) | 93.44% | 2.590 | 5.010 | - | 122.67% | - |
| 453.povray (max) | 92.67% | 191.000 | 368.000 | - | 2966.67% | - |
| 482.sphinx3 (avg) (percentage) | 82.98% | 2.350 | 4.300 | - | 113.93% | - |
| 482.sphinx3 | 81.37% | 859.000 | 1558.000 | - | 8555.56% | - |
| 482.sphinx3 (avg) | 81.37% | 859.000 | 1558.000 | - | 8555.56% | - |
| 459.GemsFDTD | 79.55% | 352.000 | 632.000 | - | 440.17% | - |
| 459.GemsFDTD (avg) | 79.55% | 352.000 | 632.000 | - | 440.17% | - |
| 459.GemsFDTD (avg) (percentage) | 79.14% | 1.390 | 2.490 | - | 50.91% | - |
| 447.dealII | 77.22% | 79.000 | 140.000 | - | 268.42% | - |
| 447.dealII (avg) | 77.22% | 79.000 | 140.000 | - | 268.42% | - |
| 447.dealII (avg) (percentage) | 75.86% | 0.870 | 1.530 | - | -25.00% | - |
| 444.namd (avg) (percentage) | 72.31% | 2.600 | 4.480 | - | 180.00% | - |
| 444.namd | 72.22% | 414.000 | 713.000 | - | 4992.86% | - |
| 444.namd (avg) | 72.22% | 414.000 | 713.000 | - | 4992.86% | - |
| 456.hmmer (max) | 68.37% | 98.000 | 165.000 | - | 1733.33% | - |
| 456.hmmer (unexplained diff vs previous) | 68.37% | 98.000 | 165.000 | - | 5400.00% | - |
| 459.GemsFDTD (max) | 62.98% | 578.000 | 942.000 | - | 1582.14% | - |
| 459.GemsFDTD (max) (percentage) | 62.72% | 2.280 | 3.710 | - | 369.62% | - |
| 456.hmmer (max) (percentage) | 59.62% | 0.520 | 0.830 | - | 315.00% | - |
| 456.hmmer (unexplained diff vs previous) (percentage) | 59.62% | 0.520 | 0.830 | - | 1085.71% | - |
| 403.gcc (unexplained diff vs previous) (percentage) | 48.28% | 0.580 | 0.860 | - | -50.00% | - |
| 403.gcc (unexplained diff vs previous) | 48.08% | 52.000 | 77.000 | - | 7600.00% | - |
| 445.gobmk (avg) (percentage) | 45.45% | 0.220 | 0.320 | - | -73.55% | - |
| 445.gobmk | 44.44% | 27.000 | 39.000 | - | -36.07% | - |
| 445.gobmk (avg) | 44.44% | 27.000 | 39.000 | - | -36.07% | - |
| 481.wrf | 43.72% | 565.000 | 812.000 | - | 554.84% | - |
| 481.wrf (avg) | 43.72% | 565.000 | 812.000 | - | 554.84% | - |
| 481.wrf (avg) (percentage) | 43.58% | 2.570 | 3.690 | - | 91.19% | - |
| 416.gamess | 40.41% | 485.000 | 681.000 | - | 419.85% | - |
| 416.gamess (avg) | 40.41% | 485.000 | 681.000 | - | 419.85% | - |
| 416.gamess (avg) (percentage) | 40.00% | 1.650 | 2.310 | - | 159.55% | - |
| 465.tonto (avg) (percentage) | 36.84% | 1.140 | 1.560 | - | 73.33% | - |
| 436.cactusADM | 31.45% | 585.000 | 769.000 | - | 2036.11% | - |
| 436.cactusADM (avg) | 31.45% | 585.000 | 769.000 | - | 2036.11% | - |
| 436.cactusADM (avg) (percentage) | 31.25% | 2.400 | 3.150 | - | 123.40% | - |
| 482.sphinx3 (unexplained diff vs previous) (percentage) | 27.78% | 3.060 | 3.910 | - | 153.90% | - |
| 482.sphinx3 (unexplained diff vs previous) | 26.92% | 1118.000 | 1419.000 | - | 10035.71% | - |
| 434.zeusmp | 25.88% | 255.000 | 321.000 | - | 682.93% | - |
| 434.zeusmp (avg) | 25.88% | 255.000 | 321.000 | - | 682.93% | - |
| 434.zeusmp (avg) (percentage) | 25.41% | 1.220 | 1.530 | - | 2.68% | - |
| 401.bzip2 (max) | 20.90% | 67.000 | 81.000 | - | 17.39% | - |
| 465.tonto (max) (percentage) | 20.47% | 1.710 | 2.060 | - | 167.53% | - |
| 401.bzip2 (max) (percentage) | 20.00% | 0.400 | 0.480 | - | -79.22% | - |
| 445.gobmk (max) (percentage) | 18.52% | 0.270 | 0.320 | - | -38.46% | - |
| 445.gobmk (max) | 18.18% | 33.000 | 39.000 | - | 50.00% | - |
| 447.dealII (max) | 16.67% | 150.000 | 175.000 | - | 414.71% | - |
| 447.dealII (max) (percentage) | 15.76% | 1.650 | 1.910 | - | 4.95% | - |
| 416.gamess (max) | 7.04% | 923.000 | 988.000 | - | 3087.10% | - |
| 416.gamess (unexplained diff vs previous) | 6.92% | 896.000 | 958.000 | - | 2990.32% | - |
| 465.tonto | 6.76% | 148.000 | 158.000 | - | 36.21% | - |
| 465.tonto (avg) | 6.76% | 148.000 | 158.000 | - | 36.21% | - |
| 416.gamess (max) (percentage) | 6.69% | 3.140 | 3.350 | - | 1495.24% | - |
| 416.gamess (unexplained diff vs previous) (percentage) | 6.56% | 3.050 | 3.250 | - | 1447.62% | - |
| 470.lbm (unexplained diff vs previous) (percentage) | 4.76% | 5.040 | 5.280 | - | 2678.95% | - |
| 470.lbm (unexplained diff vs previous) | 4.62% | 822.000 | 860.000 | - | 12185.71% | - |
| 437.leslie3d | 4.32% | 301.000 | 314.000 | - | -40.42% | - |
| 437.leslie3d (avg) | 4.32% | 301.000 | 314.000 | - | -40.42% | - |
| 437.leslie3d (avg) (percentage) | 3.59% | 1.670 | 1.730 | - | -58.11% | - |
| Performance Improvements - Execution | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 465.tonto | -21.89% | 13044.000 | 10189.000 | - | -21.56% | - |
| 454.calculix | -12.64% | 32491.000 | 28384.000 | - | 48008.47% | - |
| 471.omnetpp | -2.46% | 9265.000 | 9037.000 | - | 223.91% | - |
| 464.h264ref | -1.68% | 15208.000 | 14952.000 | - | 141.08% | - |
| Performance Improvements - sample variability | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 462.libquantum (unexplained diff vs previous) | -92.86% | 14.000 | 1.000 | - | 0.00% | - |
| 462.libquantum (unexplained diff vs previous) (percentage) | -87.50% | 0.080 | 0.010 | - | -97.96% | - |
| 471.omnetpp (unexplained diff vs previous) | -58.06% | 62.000 | 26.000 | - | -45.83% | - |
| 471.omnetpp (unexplained diff vs previous) (percentage) | -56.72% | 0.670 | 0.290 | - | -83.14% | - |
| 400.perlbench (max) | -55.06% | 89.000 | 40.000 | - | 48.15% | - |
| 400.perlbench (max) (percentage) | -55.00% | 0.800 | 0.360 | - | -78.57% | - |
| 473.astar (unexplained diff vs previous) | -49.18% | 61.000 | 31.000 | - | -32.61% | - |
| 473.astar (unexplained diff vs previous) (percentage) | -48.94% | 0.470 | 0.240 | - | -74.74% | - |
| 410.bwaves (unexplained diff vs previous) (percentage) | -44.25% | 1.740 | 0.970 | - | 22.78% | - |
| 410.bwaves (unexplained diff vs previous) | -43.19% | 257.000 | 146.000 | - | 210.64% | - |
| 450.soplex (unexplained diff vs previous) | -34.78% | 69.000 | 45.000 | - | 275.00% | - |
| 450.soplex (unexplained diff vs previous) (percentage) | -34.09% | 0.440 | 0.290 | - | -85.43% | - |
| 401.bzip2 (unexplained diff vs previous) (percentage) | -19.51% | 0.410 | 0.330 | - | -85.40% | - |
| 437.leslie3d (max) (percentage) | -18.39% | 3.100 | 2.530 | - | -78.23% | - |
| 437.leslie3d (max) | -18.04% | 560.000 | 459.000 | - | -69.05% | - |
| 481.wrf (max) (percentage) | -17.55% | 4.160 | 3.430 | - | 501.75% | - |
| 481.wrf (max) | -17.51% | 914.000 | 754.000 | - | 1994.44% | - |
| 401.bzip2 (unexplained diff vs previous) | -17.39% | 69.000 | 57.000 | - | -16.18% | - |
| 410.bwaves (avg) (percentage) | -14.80% | 1.960 | 1.670 | - | 21.01% | - |
| 410.bwaves | -13.49% | 289.000 | 250.000 | - | 208.64% | - |
| 410.bwaves (avg) | -13.49% | 289.000 | 250.000 | - | 208.64% | - |
| 434.zeusmp (max) (percentage) | -12.61% | 2.300 | 2.010 | - | 97.06% | - |
| 434.zeusmp (unexplained diff vs previous) (percentage) | -12.44% | 2.250 | 1.970 | - | 328.26% | - |
| 434.zeusmp (max) | -12.27% | 481.000 | 422.000 | - | 1407.14% | - |
| 434.zeusmp (unexplained diff vs previous) | -11.70% | 470.000 | 415.000 | - | 3092.31% | - |
| 470.lbm (max) | -8.51% | 893.000 | 817.000 | - | 3304.17% | - |
| 470.lbm (max) (percentage) | -8.39% | 5.480 | 5.020 | - | 660.61% | - |
| 400.perlbench (avg) (percentage) | -7.69% | 0.390 | 0.360 | - | -81.73% | - |
| 400.perlbench | -6.98% | 43.000 | 40.000 | - | 25.00% | - |
| 400.perlbench (avg) | -6.98% | 43.000 | 40.000 | - | 25.00% | - |
| 465.tonto (max) | -6.28% | 223.000 | 209.000 | - | 109.00% | - |
| 470.lbm | -5.76% | 608.000 | 573.000 | - | 809.52% | - |
| 470.lbm (avg) | -5.76% | 608.000 | 573.000 | - | 809.52% | - |
| 470.lbm (avg) (percentage) | -5.63% | 3.730 | 3.520 | - | 108.28% | - |
| 444.namd (max) | -4.66% | 879.000 | 838.000 | - | 11871.43% | - |
| 444.namd (max) (percentage) | -4.54% | 5.510 | 5.260 | - | 574.36% | - |
| 444.namd (unexplained diff vs previous) | -4.44% | 834.000 | 797.000 | - | 11285.71% | - |
| 444.namd (unexplained diff vs previous) (percentage) | -4.40% | 5.230 | 5.000 | - | 541.03% | - |
| 436.cactusADM (unexplained diff vs previous) (percentage) | -1.66% | 4.810 | 4.730 | - | 846.00% | - |
| 436.cactusADM (max) (percentage) | -1.58% | 5.050 | 4.970 | - | 894.00% | - |
| 436.cactusADM (max) | -1.46% | 1231.000 | 1213.000 | - | 9230.77% | - |
| 436.cactusADM (unexplained diff vs previous) | -1.45% | 1173.000 | 1156.000 | - | 8792.31% | - |
Report Time: 0.38s