Regression: Regression of 79 benchmarks: 401.bzip2, 401.bzip2 (avg), 401.bzip2 (avg) (percentage), 403.gcc (max) (percentage), 403.g...



Metric
Order
Δ ID Machine Metric Test Good, Bad OldNew Now Current Age
2142 llvm-arm-master-O2:733278613444249056 execution_variation 453.povray (avg) 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1), 0413 (no-change) 27.026.0 -3.70% 22.0 -18.52% 2022-11-30T07:16:55
2143 llvm-arm-master-O2:733278613444249056 execution_variation 450.soplex (unexplained diff vs previous) 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1), 0413 (no-change) 4.05.0 25.00% None 0.00% 2022-11-30T07:16:55
2144 llvm-arm-master-O2:733278613444249056 execution_variation 450.soplex (max) 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1), 0413 (no-change) 20.018.0 -10.00% 20.0 0.00% 2022-11-30T07:16:55
2145 llvm-arm-master-O2:733278613444249056 execution_variation 470.lbm (max) 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1), 0413 (no-change) 57.053.0 -7.02% 31.0 -45.61% 2022-11-30T07:16:55
2146 llvm-arm-master-O2:733278613444249056 execution_variation 462.libquantum (avg) (percentage) 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1), 0413 (no-change) 0.170.16 -5.88% 0.13 -23.53% 2022-11-30T07:16:55
2147 llvm-arm-master-O2:733278613444249056 execution_variation 471.omnetpp (avg) (percentage) 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1), 0413 (no-change) 0.450.46 2.22% 0.46 -4.17% 2022-11-30T07:16:55
2148 llvm-arm-master-O2:733278613444249056 execution_variation 471.omnetpp (avg) 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1), 0413 (no-change) 32.033.0 3.12% 33.0 -5.71% 2022-11-30T07:16:55
2149 llvm-arm-master-O2:733278613444249056 execution_variation 482.sphinx3 (unexplained diff vs previous) (percentage) 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1), 0413 (no-change) 0.130.12 -7.69% None 0.00% 2022-11-30T07:16:55
2150 llvm-arm-master-O2:733278613444249056 execution_variation 444.namd 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1), 0413 (no-change) 17.018.0 5.88% 17.0 0.00% 2022-11-30T07:16:55
2151 llvm-arm-master-O2:733278613444249056 execution_variation 456.hmmer (max) (percentage) 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1), 0413 (no-change) 1.351.27 -5.93% 1.63 19.85% 2022-11-30T07:16:55
2152 llvm-arm-master-O2:733278613444249056 execution_variation 456.hmmer (avg) (percentage) 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1), 0413 (no-change) 1.141.12 -1.75% 1.1 -7.56% 2022-11-30T07:16:55
2153 llvm-arm-master-O2:733278613444249056 execution_variation 403.gcc (max) (percentage) 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1), 0413 (no-change) 0.440.45 2.27% 0.83 591.67% 2022-11-30T07:16:55
2154 llvm-arm-master-O2:733278613444249056 execution_variation 471.omnetpp (max) (percentage) 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1), 0413 (no-change) 0.320.38 18.75% 0.63 34.04% 2022-11-30T07:16:55
2155 llvm-arm-master-O2:733278613444249056 execution_variation 445.gobmk 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1), 0413 (no-change) 20.021.0 5.00% 24.0 20.00% 2022-11-30T07:16:55
2156 llvm-arm-master-O2:733278613444249056 execution_variation 453.povray (unexplained diff vs previous) (percentage) 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1), 0413 (no-change) 0.470.41 -12.77% None 0.00% 2022-11-30T07:16:55
2157 llvm-arm-master-O2:733278613444249056 execution_variation 473.astar (unexplained diff vs previous) 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1), 0413 (no-change) 15.014.0 -6.67% 10.0 0.00% 2022-11-30T07:16:55
2158 llvm-arm-master-O2:733278613444249056 execution_variation 464.h264ref (max) (percentage) 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1), 0413 (no-change) 1.121.18 5.36% 0.43 -68.15% 2022-11-30T07:16:55
2159 llvm-arm-master-O2:733278613444249056 execution_variation 482.sphinx3 (max) 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1), 0413 (no-change) 149.095.0 -36.24% 47.0 -79.74% 2022-11-30T07:16:55
2160 llvm-arm-master-O2:733278613444249056 execution_variation 482.sphinx3 (unexplained diff vs previous) 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1), 0413 (no-change) 24.022.0 -8.33% None 0.00% 2022-11-30T07:16:55
2161 llvm-arm-master-O2:733278613444249056 execution_variation 429.mcf (max) (percentage) 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1), 0413 (no-change) 0.130.12 -7.69% 0.11 -21.43% 2022-11-30T07:16:55
2162 llvm-arm-master-O2:733278613444249056 execution_variation 447.dealII (unexplained diff vs previous) 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1), 0413 (no-change) 52.050.0 -3.85% None 0.00% 2022-11-30T07:16:55
2163 llvm-arm-master-O2:733278613444249056 execution_variation 483.xalancbmk 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1), 0413 (no-change) 51.050.0 -1.96% 53.0 1.92% 2022-11-30T07:16:55
2164 llvm-arm-master-O2:733278613444249056 execution_variation 482.sphinx3 (max) (percentage) 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1), 0413 (no-change) 0.820.52 -36.59% 0.26 -79.53% 2022-11-30T07:16:55
2165 llvm-arm-master-O2:733278613444249056 execution_variation 483.xalancbmk (unexplained diff vs previous) (percentage) 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1), 0413 (no-change) 0.560.67 19.64% None 0.00% 2022-11-30T07:16:55
2166 llvm-arm-master-O2:733278613444249056 execution_variation 444.namd (unexplained diff vs previous) (percentage) 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1), 0413 (no-change) 0.380.37 -2.63% 0.04 0.00% 2022-11-30T07:16:55
2167 llvm-arm-master-O2:733278613444249056 execution_variation 444.namd (avg) (percentage) 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1), 0413 (no-change) 0.170.19 11.76% 0.18 5.88% 2022-11-30T07:16:55
2168 llvm-arm-master-O2:733278613444249056 execution_variation 470.lbm (max) (percentage) 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1), 0413 (no-change) 0.360.34 -5.56% 0.2 -44.44% 2022-11-30T07:16:55
2169 llvm-arm-master-O2:733278613444249056 execution_variation 453.povray (unexplained diff vs previous) 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1), 0413 (no-change) 22.019.0 -13.64% None 0.00% 2022-11-30T07:16:55
2170 llvm-arm-master-O2:733278613444249056 execution_variation 453.povray 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1), 0413 (no-change) 27.026.0 -3.70% 22.0 -18.52% 2022-11-30T07:16:55
2171 llvm-arm-master-O2:733278613444249056 execution_variation 456.hmmer 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1), 0413 (no-change) 84.085.0 1.19% 85.0 -6.59% 2022-11-30T07:16:55
2172 llvm-arm-master-O2:733278613444249056 execution_variation 456.hmmer (unexplained diff vs previous) (percentage) 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1), 0413 (no-change) 0.10.16 60.00% 1.54 85.54% 2022-11-30T07:16:55
2173 llvm-arm-master-O2:733278613444249056 execution_variation 458.sjeng (max) (percentage) 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1), 0413 (no-change) 0.841.26 50.00% 0.36 -81.25% 2022-11-30T07:16:55
2174 llvm-arm-master-O2:733278613444249056 execution_variation 470.lbm (unexplained diff vs previous) 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1), 0413 (no-change) 27.028.0 3.70% 18.0 -50.00% 2022-11-30T07:16:55
2175 llvm-arm-master-O2:733278613444249056 execution_variation 471.omnetpp (unexplained diff vs previous) 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1), 0413 (no-change) 17.015.0 -11.76% 45.0 0.00% 2022-11-30T07:16:55
2176 llvm-arm-master-O2:733278613444249056 execution_variation 464.h264ref (unexplained diff vs previous) 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1), 0413 (no-change) 62.065.0 4.84% 25.0 -81.48% 2022-11-30T07:16:55
2177 llvm-arm-master-O2:733278613444249056 execution_variation 458.sjeng (unexplained diff vs previous) 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1), 0413 (no-change) 102.093.0 -8.82% 44.0 0.00% 2022-11-30T07:16:55
2178 llvm-arm-master-O2:733278613444249056 execution_variation 433.milc (unexplained diff vs previous) 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1), 0413 (no-change) 8.010.0 25.00% 6.0 -57.14% 2022-11-30T07:16:55
2179 llvm-arm-master-O2:733278613444249056 execution_variation 456.hmmer (unexplained diff vs previous) 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1), 0413 (no-change) 8.012.0 50.00% 120.0 87.50% 2022-11-30T07:16:55
2180 llvm-arm-master-O2:733278613444249056 execution_variation 445.gobmk (max) (percentage) 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1), 0413 (no-change) 0.320.33 3.13% 0.28 3.70% 2022-11-30T07:16:55
2181 llvm-arm-master-O2:733278613444249056 execution_variation 403.gcc (unexplained diff vs previous) (percentage) 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1), 0413 (no-change) 0.440.45 2.27% 0.84 0.00% 2022-11-30T07:16:55
2182 llvm-arm-master-O2:733278613444249056 execution_variation 453.povray (max) (percentage) 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1), 0413 (no-change) 0.760.75 -1.32% 0.27 -65.82% 2022-11-30T07:16:55
2183 llvm-arm-master-O2:733278613444249056 execution_variation 444.namd (max) (percentage) 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1), 0413 (no-change) 0.380.37 -2.63% 0.28 27.27% 2022-11-30T07:16:55
2184 llvm-arm-master-O2:733278613444249056 execution_variation 471.omnetpp 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1), 0413 (no-change) 32.033.0 3.12% 33.0 -5.71% 2022-11-30T07:16:55
2185 llvm-arm-master-O2:733278613444249056 execution_variation 464.h264ref (max) 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1), 0413 (no-change) 110.0115.0 4.55% 42.0 -68.18% 2022-11-30T07:16:55
2186 llvm-arm-master-O2:733278613444249056 execution_variation 462.libquantum (avg) 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1), 0413 (no-change) 24.023.0 -4.17% 19.0 -20.83% 2022-11-30T07:16:55
2187 llvm-arm-master-O2:733278613444249056 execution_variation 473.astar (max) 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1), 0413 (no-change) 17.018.0 5.88% 15.0 -25.00% 2022-11-30T07:16:55
2188 llvm-arm-master-O2:733278613444249056 execution_variation 444.namd (unexplained diff vs previous) 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1), 0413 (no-change) 38.037.0 -2.63% 4.0 0.00% 2022-11-30T07:16:55
2189 llvm-arm-master-O2:733278613444249056 execution_variation 401.bzip2 (avg) (percentage) 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1), 0413 (no-change) 0.090.1 11.11% 0.09 0.00% 2022-11-30T07:16:55
2190 llvm-arm-master-O2:733278613444249056 execution_variation 453.povray (avg) (percentage) 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1), 0413 (no-change) 0.60.58 -3.33% 0.48 -20.00% 2022-11-30T07:16:55
2191 llvm-arm-master-O2:733278613444249056 execution_variation 450.soplex (max) (percentage) 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1), 0413 (no-change) 0.240.22 -8.33% 0.25 4.17% 2022-11-30T07:16:55
2192 llvm-arm-master-O2:733278613444249056 execution_variation 444.namd (avg) 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1), 0413 (no-change) 17.018.0 5.88% 17.0 0.00% 2022-11-30T07:16:55
2193 llvm-arm-master-O2:733278613444249056 execution_variation 471.omnetpp (max) 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1), 0413 (no-change) 23.028.0 21.74% 46.0 35.29% 2022-11-30T07:16:55
2194 llvm-arm-master-O2:733278613444249056 execution_variation 401.bzip2 (avg) 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1), 0413 (no-change) 10.011.0 10.00% 10.0 0.00% 2022-11-30T07:16:55
2195 llvm-arm-master-O2:733278613444249056 execution_variation 483.xalancbmk (max) 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1), 0413 (no-change) 114.0116.0 1.75% 66.0 -48.84% 2022-11-30T07:16:55
2196 llvm-arm-master-O2:733278613444249056 execution_variation 458.sjeng (max) 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1), 0413 (no-change) 122.0183.0 50.00% 52.0 -81.49% 2022-11-30T07:16:55
2197 llvm-arm-master-O2:733278613444249056 execution_variation 458.sjeng (unexplained diff vs previous) (percentage) 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1), 0413 (no-change) 0.70.64 -8.57% 0.3 0.00% 2022-11-30T07:16:55
2198 llvm-arm-master-O2:733278613444249056 execution_variation 445.gobmk (max) 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1), 0413 (no-change) 34.036.0 5.88% 31.0 6.90% 2022-11-30T07:16:55
2199 llvm-arm-master-O2:733278613444249056 execution_variation 471.omnetpp (unexplained diff vs previous) (percentage) 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1), 0413 (no-change) 0.230.2 -13.04% 0.61 0.00% 2022-11-30T07:16:55
2200 llvm-arm-master-O2:733278613444249056 execution_variation 445.gobmk (unexplained diff vs previous) 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1), 0413 (no-change) 42.036.0 -14.29% None 0.00% 2022-11-30T07:16:55
2201 llvm-arm-master-O2:733278613444249056 execution_variation 473.astar (unexplained diff vs previous) (percentage) 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1), 0413 (no-change) 0.160.15 -6.25% 0.11 0.00% 2022-11-30T07:16:55
2202 llvm-arm-master-O2:733278613444249056 execution_variation 447.dealII (max) (percentage) 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1), 0413 (no-change) 0.990.97 -2.02% 0.68 -8.11% 2022-11-30T07:16:55
2203 llvm-arm-master-O2:733278613444249056 execution_variation 447.dealII (unexplained diff vs previous) (percentage) 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1), 0413 (no-change) 1.00.96 -4.00% None 0.00% 2022-11-30T07:16:55
2204 llvm-arm-master-O2:733278613444249056 execution_variation 456.hmmer (avg) 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1), 0413 (no-change) 84.085.0 1.19% 85.0 -6.59% 2022-11-30T07:16:55
2205 llvm-arm-master-O2:733278613444249056 execution_variation 483.xalancbmk (unexplained diff vs previous) 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1), 0413 (no-change) 32.039.0 21.88% None 0.00% 2022-11-30T07:16:55
2206 llvm-arm-master-O2:733278613444249056 execution_variation 403.gcc (unexplained diff vs previous) 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1), 0413 (no-change) 29.030.0 3.45% 55.0 0.00% 2022-11-30T07:16:55
2207 llvm-arm-master-O2:733278613444249056 execution_variation 483.xalancbmk (avg) (percentage) 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1), 0413 (no-change) 0.850.87 2.35% 0.92 2.22% 2022-11-30T07:16:55
2208 llvm-arm-master-O2:733278613444249056 execution_variation 483.xalancbmk (avg) 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1), 0413 (no-change) 51.050.0 -1.96% 53.0 1.92% 2022-11-30T07:16:55
2209 llvm-arm-master-O2:733278613444249056 execution_variation 483.xalancbmk (max) (percentage) 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1), 0413 (no-change) 2.021.99 -1.49% 1.14 -48.42% 2022-11-30T07:16:55
2210 llvm-arm-master-O2:733278613444249056 execution_variation 433.milc (max) 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1), 0413 (no-change) 13.011.0 -15.38% 9.0 -35.71% 2022-11-30T07:16:55
2211 llvm-arm-master-O2:733278613444249056 execution_variation 482.sphinx3 (avg) (percentage) 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1), 0413 (no-change) 0.620.61 -1.61% 0.53 -18.46% 2022-11-30T07:16:55
2212 llvm-arm-master-O2:733278613444249056 execution_variation 456.hmmer (max) 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1), 0413 (no-change) 103.097.0 -5.83% 126.0 21.15% 2022-11-30T07:16:55
2213 llvm-arm-master-O2:733278613444249056 execution_variation 464.h264ref (unexplained diff vs previous) (percentage) 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1), 0413 (no-change) 0.630.67 6.35% 0.25 -81.75% 2022-11-30T07:16:55
2214 llvm-arm-master-O2:733278613444249056 execution_variation 429.mcf (max) 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1), 0413 (no-change) 12.011.0 -8.33% 10.0 -23.08% 2022-11-30T07:16:55
2215 llvm-arm-master-O2:733278613444249056 execution_variation 445.gobmk (avg) 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1), 0413 (no-change) 20.021.0 5.00% 24.0 20.00% 2022-11-30T07:16:55
2216 llvm-arm-master-O2:733278613444249056 execution_variation 462.libquantum 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1), 0413 (no-change) 24.023.0 -4.17% 19.0 -20.83% 2022-11-30T07:16:55
2217 llvm-arm-master-O2:733278613444249056 execution_variation 445.gobmk (unexplained diff vs previous) (percentage) 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1), 0413 (no-change) 0.380.33 -13.16% None 0.00% 2022-11-30T07:16:55
2218 llvm-arm-master-O2:733278613444249056 execution_variation 447.dealII (max) 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1), 0413 (no-change) 51.050.0 -1.96% 35.0 -7.89% 2022-11-30T07:16:55
2219 llvm-arm-master-O2:733278613444249056 execution_variation 444.namd (max) 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1), 0413 (no-change) 37.036.0 -2.70% 27.0 22.73% 2022-11-30T07:16:55
2220 llvm-arm-master-O2:733278613444249056 execution_variation 401.bzip2 0411 (llvmorg-16-init-12524-gd1ef4b0a8da1), 0413 (no-change) 10.011.0 10.00% 10.0 0.00% 2022-11-30T07:16:55
Change State Split Delete