Regression: Regression of 50 benchmarks: 401.bzip2 (max), 401.bzip2 (max) (percentage), 403.gcc (max), 403.gcc (max) (percentage), 4...



Metric
Order
Δ ID Machine Metric Test Good, Bad OldNew Now Current Age
2091 llvm-arm-master-O2:733278613444249056 execution_variation 450.soplex (unexplained diff vs previous) 0410 (no-change), 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1) 8.04.0 -50.00% None 0.00% 2022-11-29T01:26:57
2092 llvm-arm-master-O2:733278613444249056 execution_variation 464.h264ref (avg) 0410 (no-change), 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1) 62.066.0 6.45% 61.0 -1.61% 2022-11-29T01:26:57
2093 llvm-arm-master-O2:733278613444249056 execution_variation 450.soplex (max) 0410 (no-change), 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1) 22.020.0 -9.09% 20.0 -9.09% 2022-11-29T01:26:57
2094 llvm-arm-master-O2:733278613444249056 execution_variation 470.lbm (max) 0410 (no-change), 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1) 72.057.0 -20.83% 31.0 -64.37% 2022-11-29T01:26:57
2095 llvm-arm-master-O2:733278613444249056 execution_variation 462.libquantum (unexplained diff vs previous) 0410 (no-change), 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1) 6.05.0 -16.67% 7.0 -53.33% 2022-11-29T01:26:57
2096 llvm-arm-master-O2:733278613444249056 execution_variation 464.h264ref 0410 (no-change), 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1) 62.066.0 6.45% 61.0 -1.61% 2022-11-29T01:26:57
2097 llvm-arm-master-O2:733278613444249056 execution_variation 473.astar (max) (percentage) 0410 (no-change), 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1) 0.230.22 -4.35% 0.16 -30.43% 2022-11-29T01:26:57
2098 llvm-arm-master-O2:733278613444249056 execution_variation 444.namd 0410 (no-change), 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1) 16.017.0 6.25% 17.0 6.25% 2022-11-29T01:26:57
2099 llvm-arm-master-O2:733278613444249056 execution_variation 401.bzip2 (max) 0410 (no-change), 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1) 17.018.0 5.88% 10.0 -47.37% 2022-11-29T01:26:57
2100 llvm-arm-master-O2:733278613444249056 execution_variation 403.gcc (max) 0410 (no-change), 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1) 8.07.0 -12.50% 54.0 500.00% 2022-11-29T01:26:57
2101 llvm-arm-master-O2:733278613444249056 execution_variation 403.gcc (max) (percentage) 0410 (no-change), 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1) 0.130.12 -7.69% 0.83 492.86% 2022-11-29T01:26:57
2102 llvm-arm-master-O2:733278613444249056 execution_variation 471.omnetpp (max) (percentage) 0410 (no-change), 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1) 0.480.47 -2.08% 0.63 23.53% 2022-11-29T01:26:57
2103 llvm-arm-master-O2:733278613444249056 execution_variation 464.h264ref (max) (percentage) 0410 (no-change), 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1) 1.281.35 5.47% 0.43 -66.41% 2022-11-29T01:26:57
2104 llvm-arm-master-O2:733278613444249056 execution_variation 482.sphinx3 (max) 0410 (no-change), 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1) 242.0232.0 -4.13% 47.0 -80.58% 2022-11-29T01:26:57
2105 llvm-arm-master-O2:733278613444249056 execution_variation 450.soplex (avg) (percentage) 0410 (no-change), 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1) 0.180.19 5.56% 0.19 -5.00% 2022-11-29T01:26:57
2107 llvm-arm-master-O2:733278613444249056 execution_variation 482.sphinx3 (max) (percentage) 0410 (no-change), 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1) 1.331.27 -4.51% 0.26 -80.45% 2022-11-29T01:26:57
2108 llvm-arm-master-O2:733278613444249056 execution_variation 470.lbm (max) (percentage) 0410 (no-change), 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1) 0.460.36 -21.74% 0.2 -63.64% 2022-11-29T01:26:57
2109 llvm-arm-master-O2:733278613444249056 execution_variation 456.hmmer (unexplained diff vs previous) (percentage) 0410 (no-change), 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1) 1.040.83 -20.19% 1.54 -2.53% 2022-11-29T01:26:57
2110 llvm-arm-master-O2:733278613444249056 execution_variation 458.sjeng (max) (percentage) 0410 (no-change), 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1) 1.991.92 -3.52% 0.36 -81.91% 2022-11-29T01:26:57
2111 llvm-arm-master-O2:733278613444249056 execution_variation 453.povray (max) 0410 (no-change), 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1) 34.036.0 5.88% 12.0 -69.23% 2022-11-29T01:26:57
2112 llvm-arm-master-O2:733278613444249056 execution_variation 470.lbm (unexplained diff vs previous) 0410 (no-change), 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1) 42.036.0 -14.29% 18.0 -71.88% 2022-11-29T01:26:57
2113 llvm-arm-master-O2:733278613444249056 execution_variation 462.libquantum (max) (percentage) 0410 (no-change), 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1) 0.260.09 -65.38% 0.06 -76.92% 2022-11-29T01:26:57
2114 llvm-arm-master-O2:733278613444249056 execution_variation 464.h264ref (unexplained diff vs previous) 0410 (no-change), 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1) 126.0135.0 7.14% 25.0 -80.16% 2022-11-29T01:26:57
2115 llvm-arm-master-O2:733278613444249056 execution_variation 429.mcf (unexplained diff vs previous) (percentage) 0410 (no-change), 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1) 0.180.14 -22.22% None 0.00% 2022-11-29T01:26:57
2116 llvm-arm-master-O2:733278613444249056 execution_variation 433.milc (unexplained diff vs previous) 0410 (no-change), 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1) 8.014.0 75.00% 6.0 100.00% 2022-11-29T01:26:57
2117 llvm-arm-master-O2:733278613444249056 execution_variation 456.hmmer (unexplained diff vs previous) 0410 (no-change), 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1) 79.064.0 -18.99% 120.0 0.00% 2022-11-29T01:26:57
2118 llvm-arm-master-O2:733278613444249056 execution_variation 445.gobmk (max) (percentage) 0410 (no-change), 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1) 0.290.27 -6.90% 0.28 -3.45% 2022-11-29T01:26:57
2119 llvm-arm-master-O2:733278613444249056 execution_variation 453.povray (max) (percentage) 0410 (no-change), 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1) 0.760.79 3.95% 0.27 -68.24% 2022-11-29T01:26:57
2120 llvm-arm-master-O2:733278613444249056 execution_variation 444.namd (max) (percentage) 0410 (no-change), 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1) 0.250.22 -12.00% 0.28 12.00% 2022-11-29T01:26:57
2121 llvm-arm-master-O2:733278613444249056 execution_variation 464.h264ref (max) 0410 (no-change), 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1) 127.0132.0 3.94% 42.0 -66.93% 2022-11-29T01:26:57
2122 llvm-arm-master-O2:733278613444249056 execution_variation 462.libquantum (avg) 0410 (no-change), 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1) 26.024.0 -7.69% 19.0 -26.92% 2022-11-29T01:26:57
2123 llvm-arm-master-O2:733278613444249056 execution_variation 433.milc (unexplained diff vs previous) (percentage) 0410 (no-change), 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1) 0.070.12 71.43% 0.05 66.67% 2022-11-29T01:26:57
2124 llvm-arm-master-O2:733278613444249056 execution_variation 473.astar (max) 0410 (no-change), 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1) 21.020.0 -4.76% 15.0 -28.57% 2022-11-29T01:26:57
2125 llvm-arm-master-O2:733278613444249056 execution_variation 450.soplex (max) (percentage) 0410 (no-change), 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1) 0.270.24 -11.11% 0.25 -7.41% 2022-11-29T01:26:57
2126 llvm-arm-master-O2:733278613444249056 execution_variation 444.namd (avg) 0410 (no-change), 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1) 16.017.0 6.25% 17.0 6.25% 2022-11-29T01:26:57
2127 llvm-arm-master-O2:733278613444249056 execution_variation 483.xalancbmk (max) 0410 (no-change), 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1) 134.0129.0 -3.73% 66.0 -50.75% 2022-11-29T01:26:57
2128 llvm-arm-master-O2:733278613444249056 execution_variation 462.libquantum (unexplained diff vs previous) (percentage) 0410 (no-change), 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1) 0.040.03 -25.00% 0.05 -50.00% 2022-11-29T01:26:57
2129 llvm-arm-master-O2:733278613444249056 execution_variation 458.sjeng (max) 0410 (no-change), 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1) 292.0281.0 -3.77% 52.0 -82.19% 2022-11-29T01:26:57
2130 llvm-arm-master-O2:733278613444249056 execution_variation 445.gobmk (max) 0410 (no-change), 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1) 31.029.0 -6.45% 31.0 0.00% 2022-11-29T01:26:57
2131 llvm-arm-master-O2:733278613444249056 execution_variation 450.soplex (unexplained diff vs previous) (percentage) 0410 (no-change), 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1) 0.090.05 -44.44% None 0.00% 2022-11-29T01:26:57
2132 llvm-arm-master-O2:733278613444249056 execution_variation 483.xalancbmk (avg) 0410 (no-change), 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1) 51.052.0 1.96% 53.0 3.92% 2022-11-29T01:26:57
2133 llvm-arm-master-O2:733278613444249056 execution_variation 429.mcf (unexplained diff vs previous) 0410 (no-change), 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1) 10.013.0 30.00% None 0.00% 2022-11-29T01:26:57
2134 llvm-arm-master-O2:733278613444249056 execution_variation 483.xalancbmk (max) (percentage) 0410 (no-change), 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1) 2.352.21 -5.96% 1.14 -51.49% 2022-11-29T01:26:57
2135 llvm-arm-master-O2:733278613444249056 execution_variation 401.bzip2 (max) (percentage) 0410 (no-change), 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1) 0.150.16 6.67% 0.09 -47.06% 2022-11-29T01:26:57
2136 llvm-arm-master-O2:733278613444249056 execution_variation 464.h264ref (unexplained diff vs previous) (percentage) 0410 (no-change), 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1) 1.261.37 8.73% 0.25 -80.16% 2022-11-29T01:26:57
2137 llvm-arm-master-O2:733278613444249056 execution_variation 464.h264ref (avg) (percentage) 0410 (no-change), 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1) 0.630.68 7.94% 0.62 -1.59% 2022-11-29T01:26:57
2138 llvm-arm-master-O2:733278613444249056 execution_variation 462.libquantum 0410 (no-change), 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1) 26.024.0 -7.69% 19.0 -26.92% 2022-11-29T01:26:57
2139 llvm-arm-master-O2:733278613444249056 execution_variation 470.lbm (unexplained diff vs previous) (percentage) 0410 (no-change), 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1) 0.260.23 -11.54% 0.11 -72.50% 2022-11-29T01:26:57
2140 llvm-arm-master-O2:733278613444249056 execution_variation 444.namd (max) 0410 (no-change), 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1) 24.022.0 -8.33% 27.0 12.50% 2022-11-29T01:26:57
2141 llvm-arm-master-O2:733278613444249056 execution_variation 462.libquantum (max) 0410 (no-change), 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1) 38.013.0 -65.79% 8.0 -78.95% 2022-11-29T01:26:57
Change State Split Delete