Regression: Regression of 76 benchmarks: 403.gcc, 403.gcc (avg), 403.gcc (avg) (percentage), 403.gcc (max), 403.gcc (max) (percentag...



Metric
Order
Δ ID Machine Metric Test Good, Bad OldNew Now Current Age
2252 llvm-arm-master-O2:733278613444249056 execution_variation 453.povray (avg) 0415 (llvmorg-16-init-13290-g632118a090ac), 0422 (no-change) 26.024.0 -7.69% 22.0 -15.38% 2022-12-05T17:31:45
2253 llvm-arm-master-O2:733278613444249056 execution_variation 450.soplex (unexplained diff vs previous) 0415 (llvmorg-16-init-13290-g632118a090ac), 0422 (no-change) 27.029.0 7.41% None 0.00% 2022-12-05T17:31:45
2254 llvm-arm-master-O2:733278613444249056 execution_variation 464.h264ref (avg) 0415 (llvmorg-16-init-13290-g632118a090ac), 0422 (no-change) 66.067.0 1.52% 61.0 -7.58% 2022-12-05T17:31:45
2255 llvm-arm-master-O2:733278613444249056 execution_variation 450.soplex (max) 0415 (llvmorg-16-init-13290-g632118a090ac), 0422 (no-change) 27.029.0 7.41% 20.0 25.00% 2022-12-05T17:31:45
2256 llvm-arm-master-O2:733278613444249056 execution_variation 458.sjeng (avg) 0415 (llvmorg-16-init-13290-g632118a090ac), 0422 (no-change) 115.0107.0 -6.96% 92.0 -20.69% 2022-12-05T17:31:45
2257 llvm-arm-master-O2:733278613444249056 execution_variation 470.lbm (max) 0415 (llvmorg-16-init-13290-g632118a090ac), 0422 (no-change) 57.065.0 14.04% 31.0 -60.26% 2022-12-05T17:31:45
2258 llvm-arm-master-O2:733278613444249056 execution_variation 471.omnetpp (avg) (percentage) 0415 (llvmorg-16-init-13290-g632118a090ac), 0422 (no-change) 0.460.45 -2.17% 0.46 0.00% 2022-12-05T17:31:45
2259 llvm-arm-master-O2:733278613444249056 execution_variation 471.omnetpp (avg) 0415 (llvmorg-16-init-13290-g632118a090ac), 0422 (no-change) 33.032.0 -3.03% 33.0 0.00% 2022-12-05T17:31:45
2260 llvm-arm-master-O2:733278613444249056 execution_variation 458.sjeng (avg) (percentage) 0415 (llvmorg-16-init-13290-g632118a090ac), 0422 (no-change) 0.770.74 -3.90% 0.63 -21.25% 2022-12-05T17:31:45
2261 llvm-arm-master-O2:733278613444249056 execution_variation 464.h264ref 0415 (llvmorg-16-init-13290-g632118a090ac), 0422 (no-change) 66.067.0 1.52% 61.0 -7.58% 2022-12-05T17:31:45
2262 llvm-arm-master-O2:733278613444249056 execution_variation 482.sphinx3 (unexplained diff vs previous) (percentage) 0415 (llvmorg-16-init-13290-g632118a090ac), 0422 (no-change) 0.220.36 63.64% None 0.00% 2022-12-05T17:31:45
2263 llvm-arm-master-O2:733278613444249056 execution_variation 456.hmmer (max) (percentage) 0415 (llvmorg-16-init-13290-g632118a090ac), 0422 (no-change) 1.211.16 -4.13% 1.63 34.71% 2022-12-05T17:31:45
2264 llvm-arm-master-O2:733278613444249056 execution_variation 456.hmmer (avg) (percentage) 0415 (llvmorg-16-init-13290-g632118a090ac), 0422 (no-change) 1.091.04 -4.59% 1.1 -1.79% 2022-12-05T17:31:45
2265 llvm-arm-master-O2:733278613444249056 execution_variation 403.gcc (max) 0415 (llvmorg-16-init-13290-g632118a090ac), 0422 (no-change) 33.034.0 3.03% 54.0 107.69% 2022-12-05T17:31:45
2266 llvm-arm-master-O2:733278613444249056 execution_variation 403.gcc 0415 (llvmorg-16-init-13290-g632118a090ac), 0422 (no-change) 15.016.0 6.67% 23.0 64.29% 2022-12-05T17:31:45
2267 llvm-arm-master-O2:733278613444249056 execution_variation 403.gcc (max) (percentage) 0415 (llvmorg-16-init-13290-g632118a090ac), 0422 (no-change) 0.510.52 1.96% 0.83 107.50% 2022-12-05T17:31:45
2268 llvm-arm-master-O2:733278613444249056 execution_variation 471.omnetpp (max) (percentage) 0415 (llvmorg-16-init-13290-g632118a090ac), 0422 (no-change) 0.360.35 -2.78% 0.63 75.00% 2022-12-05T17:31:45
2269 llvm-arm-master-O2:733278613444249056 execution_variation 445.gobmk 0415 (llvmorg-16-init-13290-g632118a090ac), 0422 (no-change) 22.024.0 9.09% 24.0 9.09% 2022-12-05T17:31:45
2270 llvm-arm-master-O2:733278613444249056 execution_variation 473.astar (unexplained diff vs previous) 0415 (llvmorg-16-init-13290-g632118a090ac), 0422 (no-change) 3.04.0 33.33% 10.0 0.00% 2022-12-05T17:31:45
2271 llvm-arm-master-O2:733278613444249056 execution_variation 464.h264ref (max) (percentage) 0415 (llvmorg-16-init-13290-g632118a090ac), 0422 (no-change) 0.971.01 4.12% 0.43 -60.19% 2022-12-05T17:31:45
2272 llvm-arm-master-O2:733278613444249056 execution_variation 482.sphinx3 (unexplained diff vs previous) 0415 (llvmorg-16-init-13290-g632118a090ac), 0422 (no-change) 41.066.0 60.98% None 0.00% 2022-12-05T17:31:45
2273 llvm-arm-master-O2:733278613444249056 execution_variation 482.sphinx3 0415 (llvmorg-16-init-13290-g632118a090ac), 0422 (no-change) 105.0107.0 1.90% 96.0 -13.51% 2022-12-05T17:31:45
2274 llvm-arm-master-O2:733278613444249056 execution_variation 447.dealII (unexplained diff vs previous) 0415 (llvmorg-16-init-13290-g632118a090ac), 0422 (no-change) 50.042.0 -16.00% None 0.00% 2022-12-05T17:31:45
2275 llvm-arm-master-O2:733278613444249056 execution_variation 483.xalancbmk (unexplained diff vs previous) (percentage) 0415 (llvmorg-16-init-13290-g632118a090ac), 0422 (no-change) 1.031.13 9.71% None 0.00% 2022-12-05T17:31:45
2276 llvm-arm-master-O2:733278613444249056 execution_variation 444.namd (unexplained diff vs previous) (percentage) 0415 (llvmorg-16-init-13290-g632118a090ac), 0422 (no-change) 0.020.07 250.00% 0.04 0.00% 2022-12-05T17:31:45
2277 llvm-arm-master-O2:733278613444249056 execution_variation 470.lbm (max) (percentage) 0415 (llvmorg-16-init-13290-g632118a090ac), 0422 (no-change) 0.360.41 13.89% 0.2 -59.18% 2022-12-05T17:31:45
2278 llvm-arm-master-O2:733278613444249056 execution_variation 453.povray 0415 (llvmorg-16-init-13290-g632118a090ac), 0422 (no-change) 26.024.0 -7.69% 22.0 -15.38% 2022-12-05T17:31:45
2279 llvm-arm-master-O2:733278613444249056 execution_variation 456.hmmer 0415 (llvmorg-16-init-13290-g632118a090ac), 0422 (no-change) 84.078.0 -7.14% 85.0 1.19% 2022-12-05T17:31:45
2280 llvm-arm-master-O2:733278613444249056 execution_variation 456.hmmer (unexplained diff vs previous) (percentage) 0415 (llvmorg-16-init-13290-g632118a090ac), 0422 (no-change) 0.160.04 -75.00% 1.54 0.00% 2022-12-05T17:31:45
2281 llvm-arm-master-O2:733278613444249056 execution_variation 453.povray (max) 0415 (llvmorg-16-init-13290-g632118a090ac), 0422 (no-change) 31.015.0 -51.61% 12.0 -63.64% 2022-12-05T17:31:45
2282 llvm-arm-master-O2:733278613444249056 execution_variation 470.lbm (unexplained diff vs previous) 0415 (llvmorg-16-init-13290-g632118a090ac), 0422 (no-change) 28.030.0 7.14% 18.0 -76.92% 2022-12-05T17:31:45
2283 llvm-arm-master-O2:733278613444249056 execution_variation 403.gcc (avg) 0415 (llvmorg-16-init-13290-g632118a090ac), 0422 (no-change) 15.016.0 6.67% 23.0 64.29% 2022-12-05T17:31:45
2284 llvm-arm-master-O2:733278613444249056 execution_variation 471.omnetpp (unexplained diff vs previous) 0415 (llvmorg-16-init-13290-g632118a090ac), 0422 (no-change) 28.026.0 -7.14% 45.0 0.00% 2022-12-05T17:31:45
2285 llvm-arm-master-O2:733278613444249056 execution_variation 462.libquantum (max) (percentage) 0415 (llvmorg-16-init-13290-g632118a090ac), 0422 (no-change) 0.080.06 -25.00% 0.06 -25.00% 2022-12-05T17:31:45
2286 llvm-arm-master-O2:733278613444249056 execution_variation 464.h264ref (unexplained diff vs previous) 0415 (llvmorg-16-init-13290-g632118a090ac), 0422 (no-change) 65.077.0 18.46% 25.0 0.00% 2022-12-05T17:31:45
2287 llvm-arm-master-O2:733278613444249056 execution_variation 447.dealII 0415 (llvmorg-16-init-13290-g632118a090ac), 0422 (no-change) 29.031.0 6.90% 28.0 -3.45% 2022-12-05T17:31:45
2288 llvm-arm-master-O2:733278613444249056 execution_variation 458.sjeng (unexplained diff vs previous) 0415 (llvmorg-16-init-13290-g632118a090ac), 0422 (no-change) 21.07.0 -66.67% 44.0 0.00% 2022-12-05T17:31:45
2289 llvm-arm-master-O2:733278613444249056 execution_variation 456.hmmer (unexplained diff vs previous) 0415 (llvmorg-16-init-13290-g632118a090ac), 0422 (no-change) 12.03.0 -75.00% 120.0 0.00% 2022-12-05T17:31:45
2290 llvm-arm-master-O2:733278613444249056 execution_variation 445.gobmk (max) (percentage) 0415 (llvmorg-16-init-13290-g632118a090ac), 0422 (no-change) 0.330.35 6.06% 0.28 -9.68% 2022-12-05T17:31:45
2291 llvm-arm-master-O2:733278613444249056 execution_variation 403.gcc (unexplained diff vs previous) (percentage) 0415 (llvmorg-16-init-13290-g632118a090ac), 0422 (no-change) 0.520.51 -1.92% 0.84 0.00% 2022-12-05T17:31:45
2292 llvm-arm-master-O2:733278613444249056 execution_variation 453.povray (max) (percentage) 0415 (llvmorg-16-init-13290-g632118a090ac), 0422 (no-change) 0.690.33 -52.17% 0.27 -63.01% 2022-12-05T17:31:45
2293 llvm-arm-master-O2:733278613444249056 execution_variation 447.dealII (avg) 0415 (llvmorg-16-init-13290-g632118a090ac), 0422 (no-change) 29.031.0 6.90% 28.0 -3.45% 2022-12-05T17:31:45
2294 llvm-arm-master-O2:733278613444249056 execution_variation 471.omnetpp 0415 (llvmorg-16-init-13290-g632118a090ac), 0422 (no-change) 33.032.0 -3.03% 33.0 0.00% 2022-12-05T17:31:45
2295 llvm-arm-master-O2:733278613444249056 execution_variation 464.h264ref (max) 0415 (llvmorg-16-init-13290-g632118a090ac), 0422 (no-change) 95.099.0 4.21% 42.0 -60.00% 2022-12-05T17:31:45
2296 llvm-arm-master-O2:733278613444249056 execution_variation 458.sjeng 0415 (llvmorg-16-init-13290-g632118a090ac), 0422 (no-change) 115.0107.0 -6.96% 92.0 -20.69% 2022-12-05T17:31:45
2297 llvm-arm-master-O2:733278613444249056 execution_variation 473.astar (max) 0415 (llvmorg-16-init-13290-g632118a090ac), 0422 (no-change) 15.016.0 6.67% 15.0 -11.76% 2022-12-05T17:31:45
2298 llvm-arm-master-O2:733278613444249056 execution_variation 444.namd (unexplained diff vs previous) 0415 (llvmorg-16-init-13290-g632118a090ac), 0422 (no-change) 2.07.0 250.00% 4.0 0.00% 2022-12-05T17:31:45
2299 llvm-arm-master-O2:733278613444249056 execution_variation 453.povray (avg) (percentage) 0415 (llvmorg-16-init-13290-g632118a090ac), 0422 (no-change) 0.580.53 -8.62% 0.48 -17.24% 2022-12-05T17:31:45
2300 llvm-arm-master-O2:733278613444249056 execution_variation 450.soplex (max) (percentage) 0415 (llvmorg-16-init-13290-g632118a090ac), 0422 (no-change) 0.330.35 6.06% 0.25 25.00% 2022-12-05T17:31:45
2301 llvm-arm-master-O2:733278613444249056 execution_variation 471.omnetpp (max) 0415 (llvmorg-16-init-13290-g632118a090ac), 0422 (no-change) 26.025.0 -3.85% 46.0 76.92% 2022-12-05T17:31:45
2302 llvm-arm-master-O2:733278613444249056 execution_variation 445.gobmk (avg) (percentage) 0415 (llvmorg-16-init-13290-g632118a090ac), 0422 (no-change) 0.210.22 4.76% 0.22 10.00% 2022-12-05T17:31:45
2303 llvm-arm-master-O2:733278613444249056 execution_variation 483.xalancbmk (max) 0415 (llvmorg-16-init-13290-g632118a090ac), 0422 (no-change) 110.0105.0 -4.55% 66.0 -40.00% 2022-12-05T17:31:45
2304 llvm-arm-master-O2:733278613444249056 execution_variation 458.sjeng (unexplained diff vs previous) (percentage) 0415 (llvmorg-16-init-13290-g632118a090ac), 0422 (no-change) 0.140.05 -64.29% 0.3 0.00% 2022-12-05T17:31:45
2305 llvm-arm-master-O2:733278613444249056 execution_variation 445.gobmk (max) 0415 (llvmorg-16-init-13290-g632118a090ac), 0422 (no-change) 36.038.0 5.56% 31.0 -8.82% 2022-12-05T17:31:45
2306 llvm-arm-master-O2:733278613444249056 execution_variation 403.gcc (avg) (percentage) 0415 (llvmorg-16-init-13290-g632118a090ac), 0422 (no-change) 0.260.25 -3.85% 0.36 63.64% 2022-12-05T17:31:45
2307 llvm-arm-master-O2:733278613444249056 execution_variation 471.omnetpp (unexplained diff vs previous) (percentage) 0415 (llvmorg-16-init-13290-g632118a090ac), 0422 (no-change) 0.380.36 -5.26% 0.61 0.00% 2022-12-05T17:31:45
2308 llvm-arm-master-O2:733278613444249056 execution_variation 445.gobmk (unexplained diff vs previous) 0415 (llvmorg-16-init-13290-g632118a090ac), 0422 (no-change) 36.038.0 5.56% None 0.00% 2022-12-05T17:31:45
2309 llvm-arm-master-O2:733278613444249056 execution_variation 473.astar (unexplained diff vs previous) (percentage) 0415 (llvmorg-16-init-13290-g632118a090ac), 0422 (no-change) 0.030.04 33.33% 0.11 0.00% 2022-12-05T17:31:45
2310 llvm-arm-master-O2:733278613444249056 execution_variation 447.dealII (max) (percentage) 0415 (llvmorg-16-init-13290-g632118a090ac), 0422 (no-change) 0.790.81 2.53% 0.68 -25.27% 2022-12-05T17:31:45
2311 llvm-arm-master-O2:733278613444249056 execution_variation 447.dealII (unexplained diff vs previous) (percentage) 0415 (llvmorg-16-init-13290-g632118a090ac), 0422 (no-change) 0.960.81 -15.62% None 0.00% 2022-12-05T17:31:45
2312 llvm-arm-master-O2:733278613444249056 execution_variation 456.hmmer (avg) 0415 (llvmorg-16-init-13290-g632118a090ac), 0422 (no-change) 84.078.0 -7.14% 85.0 1.19% 2022-12-05T17:31:45
2313 llvm-arm-master-O2:733278613444249056 execution_variation 483.xalancbmk (unexplained diff vs previous) 0415 (llvmorg-16-init-13290-g632118a090ac), 0422 (no-change) 59.065.0 10.17% None 0.00% 2022-12-05T17:31:45
2314 llvm-arm-master-O2:733278613444249056 execution_variation 483.xalancbmk (avg) (percentage) 0415 (llvmorg-16-init-13290-g632118a090ac), 0422 (no-change) 0.90.89 -1.11% 0.92 5.75% 2022-12-05T17:31:45
2315 llvm-arm-master-O2:733278613444249056 execution_variation 450.soplex (unexplained diff vs previous) (percentage) 0415 (llvmorg-16-init-13290-g632118a090ac), 0422 (no-change) 0.320.35 9.37% None 0.00% 2022-12-05T17:31:45
2316 llvm-arm-master-O2:733278613444249056 execution_variation 483.xalancbmk (max) (percentage) 0415 (llvmorg-16-init-13290-g632118a090ac), 0422 (no-change) 1.91.83 -3.68% 1.14 -40.00% 2022-12-05T17:31:45
2317 llvm-arm-master-O2:733278613444249056 execution_variation 447.dealII (avg) (percentage) 0415 (llvmorg-16-init-13290-g632118a090ac), 0422 (no-change) 0.570.6 5.26% 0.55 -3.51% 2022-12-05T17:31:45
2318 llvm-arm-master-O2:733278613444249056 execution_variation 433.milc (max) 0415 (llvmorg-16-init-13290-g632118a090ac), 0422 (no-change) 10.09.0 -10.00% 9.0 -10.00% 2022-12-05T17:31:45
2319 llvm-arm-master-O2:733278613444249056 execution_variation 482.sphinx3 (avg) (percentage) 0415 (llvmorg-16-init-13290-g632118a090ac), 0422 (no-change) 0.580.59 1.72% 0.53 -13.11% 2022-12-05T17:31:45
2320 llvm-arm-master-O2:733278613444249056 execution_variation 456.hmmer (max) 0415 (llvmorg-16-init-13290-g632118a090ac), 0422 (no-change) 91.087.0 -4.40% 126.0 38.46% 2022-12-05T17:31:45
2321 llvm-arm-master-O2:733278613444249056 execution_variation 464.h264ref (unexplained diff vs previous) (percentage) 0415 (llvmorg-16-init-13290-g632118a090ac), 0422 (no-change) 0.670.78 16.42% 0.25 0.00% 2022-12-05T17:31:45
2322 llvm-arm-master-O2:733278613444249056 execution_variation 482.sphinx3 (avg) 0415 (llvmorg-16-init-13290-g632118a090ac), 0422 (no-change) 105.0107.0 1.90% 96.0 -13.51% 2022-12-05T17:31:45
2323 llvm-arm-master-O2:733278613444249056 execution_variation 445.gobmk (avg) 0415 (llvmorg-16-init-13290-g632118a090ac), 0422 (no-change) 22.024.0 9.09% 24.0 9.09% 2022-12-05T17:31:45
2324 llvm-arm-master-O2:733278613444249056 execution_variation 470.lbm (unexplained diff vs previous) (percentage) 0415 (llvmorg-16-init-13290-g632118a090ac), 0422 (no-change) 0.180.19 5.56% 0.11 -77.55% 2022-12-05T17:31:45
2325 llvm-arm-master-O2:733278613444249056 execution_variation 447.dealII (max) 0415 (llvmorg-16-init-13290-g632118a090ac), 0422 (no-change) 41.042.0 2.44% 35.0 -25.53% 2022-12-05T17:31:45
2326 llvm-arm-master-O2:733278613444249056 execution_variation 462.libquantum (max) 0415 (llvmorg-16-init-13290-g632118a090ac), 0422 (no-change) 11.08.0 -27.27% 8.0 -27.27% 2022-12-05T17:31:45
2327 llvm-arm-master-O2:733278613444249056 execution_variation 445.gobmk (unexplained diff vs previous) (percentage) 0415 (llvmorg-16-init-13290-g632118a090ac), 0422 (no-change) 0.330.34 3.03% None 0.00% 2022-12-05T17:31:45
Change State Split Delete