Regression: Regression of 70 benchmarks: 401.bzip2 (max), 401.bzip2 (max) (percentage), 403.gcc (unexplained diff vs previous), 429....



Metric
Order
Δ ID Machine Metric Test Good, Bad OldNew Now Current Age
1965 llvm-arm-master-O2:733278613444249056 execution_variation 450.soplex (unexplained diff vs previous) 0406 (no-change), 0408 (llvmorg-16-init-12045-g5888e5aebce6) 14.013.0 -7.14% None 0.00% 2022-11-24T14:29:48
1966 llvm-arm-master-O2:733278613444249056 execution_variation 433.milc (max) (percentage) 0406 (no-change), 0408 (llvmorg-16-init-12045-g5888e5aebce6) 0.040.02 -50.00% 0.08 100.00% 2022-11-24T14:29:48
1967 llvm-arm-master-O2:733278613444249056 execution_variation 464.h264ref (avg) 0406 (no-change), 0408 (llvmorg-16-init-12045-g5888e5aebce6) 56.057.0 1.79% 61.0 17.31% 2022-11-24T14:29:48
1968 llvm-arm-master-O2:733278613444249056 execution_variation 470.lbm (max) 0406 (no-change), 0408 (llvmorg-16-init-12045-g5888e5aebce6) 89.090.0 1.12% 31.0 -67.37% 2022-11-24T14:29:48
1969 llvm-arm-master-O2:733278613444249056 execution_variation 471.omnetpp (avg) (percentage) 0406 (no-change), 0408 (llvmorg-16-init-12045-g5888e5aebce6) 0.490.48 -2.04% 0.46 -6.12% 2022-11-24T14:29:48
1970 llvm-arm-master-O2:733278613444249056 execution_variation 471.omnetpp (avg) 0406 (no-change), 0408 (llvmorg-16-init-12045-g5888e5aebce6) 33.034.0 3.03% 33.0 -5.71% 2022-11-24T14:29:48
1971 llvm-arm-master-O2:733278613444249056 execution_variation 458.sjeng (avg) (percentage) 0406 (no-change), 0408 (llvmorg-16-init-12045-g5888e5aebce6) 0.770.8 3.90% 0.63 -26.74% 2022-11-24T14:29:48
1972 llvm-arm-master-O2:733278613444249056 execution_variation 464.h264ref 0406 (no-change), 0408 (llvmorg-16-init-12045-g5888e5aebce6) 56.057.0 1.79% 61.0 17.31% 2022-11-24T14:29:48
1973 llvm-arm-master-O2:733278613444249056 execution_variation 482.sphinx3 (unexplained diff vs previous) (percentage) 0406 (no-change), 0408 (llvmorg-16-init-12045-g5888e5aebce6) 0.180.13 -27.78% None 0.00% 2022-11-24T14:29:48
1974 llvm-arm-master-O2:733278613444249056 execution_variation 401.bzip2 (max) 0406 (no-change), 0408 (llvmorg-16-init-12045-g5888e5aebce6) 14.013.0 -7.14% 10.0 -28.57% 2022-11-24T14:29:48
1975 llvm-arm-master-O2:733278613444249056 execution_variation 456.hmmer (max) (percentage) 0406 (no-change), 0408 (llvmorg-16-init-12045-g5888e5aebce6) 1.761.81 2.84% 1.63 3.82% 2022-11-24T14:29:48
1976 llvm-arm-master-O2:733278613444249056 execution_variation 456.hmmer (avg) (percentage) 0406 (no-change), 0408 (llvmorg-16-init-12045-g5888e5aebce6) 1.211.19 -1.65% 1.1 -3.51% 2022-11-24T14:29:48
1977 llvm-arm-master-O2:733278613444249056 execution_variation 482.sphinx3 (max) 0406 (no-change), 0408 (llvmorg-16-init-12045-g5888e5aebce6) 289.0260.0 -10.03% 47.0 -83.74% 2022-11-24T14:29:48
1978 llvm-arm-master-O2:733278613444249056 execution_variation 482.sphinx3 (unexplained diff vs previous) 0406 (no-change), 0408 (llvmorg-16-init-12045-g5888e5aebce6) 32.024.0 -25.00% None 0.00% 2022-11-24T14:29:48
1979 llvm-arm-master-O2:733278613444249056 execution_variation 482.sphinx3 0406 (no-change), 0408 (llvmorg-16-init-12045-g5888e5aebce6) 124.0119.0 -4.03% 96.0 -25.00% 2022-11-24T14:29:48
1980 llvm-arm-master-O2:733278613444249056 execution_variation 470.lbm (avg) 0406 (no-change), 0408 (llvmorg-16-init-12045-g5888e5aebce6) 55.058.0 5.45% 49.0 -22.22% 2022-11-24T14:29:48
1981 llvm-arm-master-O2:733278613444249056 execution_variation 433.milc 0406 (no-change), 0408 (llvmorg-16-init-12045-g5888e5aebce6) 8.07.0 -12.50% 8.0 0.00% 2022-11-24T14:29:48
1982 llvm-arm-master-O2:733278613444249056 execution_variation 447.dealII (unexplained diff vs previous) 0406 (no-change), 0408 (llvmorg-16-init-12045-g5888e5aebce6) 11.015.0 36.36% None 0.00% 2022-11-24T14:29:48
1983 llvm-arm-master-O2:733278613444249056 execution_variation 483.xalancbmk 0406 (no-change), 0408 (llvmorg-16-init-12045-g5888e5aebce6) 48.051.0 6.25% 53.0 29.27% 2022-11-24T14:29:48
1984 llvm-arm-master-O2:733278613444249056 execution_variation 482.sphinx3 (max) (percentage) 0406 (no-change), 0408 (llvmorg-16-init-12045-g5888e5aebce6) 1.581.42 -10.13% 0.26 -83.54% 2022-11-24T14:29:48
1985 llvm-arm-master-O2:733278613444249056 execution_variation 483.xalancbmk (unexplained diff vs previous) (percentage) 0406 (no-change), 0408 (llvmorg-16-init-12045-g5888e5aebce6) 2.062.59 25.73% None 0.00% 2022-11-24T14:29:48
1986 llvm-arm-master-O2:733278613444249056 execution_variation 444.namd (unexplained diff vs previous) (percentage) 0406 (no-change), 0408 (llvmorg-16-init-12045-g5888e5aebce6) 0.270.28 3.70% 0.04 100.00% 2022-11-24T14:29:48
1987 llvm-arm-master-O2:733278613444249056 execution_variation 470.lbm (avg) (percentage) 0406 (no-change), 0408 (llvmorg-16-init-12045-g5888e5aebce6) 0.350.37 5.71% 0.31 -22.50% 2022-11-24T14:29:48
1988 llvm-arm-master-O2:733278613444249056 execution_variation 470.lbm 0406 (no-change), 0408 (llvmorg-16-init-12045-g5888e5aebce6) 55.058.0 5.45% 49.0 -22.22% 2022-11-24T14:29:48
1989 llvm-arm-master-O2:733278613444249056 execution_variation 473.astar (avg) (percentage) 0406 (no-change), 0408 (llvmorg-16-init-12045-g5888e5aebce6) 0.130.12 -7.69% 0.12 -7.69% 2022-11-24T14:29:48
1990 llvm-arm-master-O2:733278613444249056 execution_variation 433.milc (avg) (percentage) 0406 (no-change), 0408 (llvmorg-16-init-12045-g5888e5aebce6) 0.070.06 -14.29% 0.07 0.00% 2022-11-24T14:29:48
1991 llvm-arm-master-O2:733278613444249056 execution_variation 458.sjeng (max) (percentage) 0406 (no-change), 0408 (llvmorg-16-init-12045-g5888e5aebce6) 2.272.1 -7.49% 0.36 -84.14% 2022-11-24T14:29:48
1992 llvm-arm-master-O2:733278613444249056 execution_variation 453.povray (max) 0406 (no-change), 0408 (llvmorg-16-init-12045-g5888e5aebce6) 51.043.0 -15.69% 12.0 -76.92% 2022-11-24T14:29:48
1993 llvm-arm-master-O2:733278613444249056 execution_variation 470.lbm (unexplained diff vs previous) 0406 (no-change), 0408 (llvmorg-16-init-12045-g5888e5aebce6) 27.011.0 -59.26% 18.0 -57.14% 2022-11-24T14:29:48
1994 llvm-arm-master-O2:733278613444249056 execution_variation 471.omnetpp (unexplained diff vs previous) 0406 (no-change), 0408 (llvmorg-16-init-12045-g5888e5aebce6) 23.022.0 -4.35% 45.0 164.71% 2022-11-24T14:29:48
1995 llvm-arm-master-O2:733278613444249056 execution_variation 462.libquantum (max) (percentage) 0406 (no-change), 0408 (llvmorg-16-init-12045-g5888e5aebce6) 0.280.26 -7.14% 0.06 -78.57% 2022-11-24T14:29:48
1996 llvm-arm-master-O2:733278613444249056 execution_variation 464.h264ref (unexplained diff vs previous) 0406 (no-change), 0408 (llvmorg-16-init-12045-g5888e5aebce6) 104.0102.0 -1.92% 25.0 -44.44% 2022-11-24T14:29:48
1997 llvm-arm-master-O2:733278613444249056 execution_variation 458.sjeng (unexplained diff vs previous) 0406 (no-change), 0408 (llvmorg-16-init-12045-g5888e5aebce6) 25.031.0 24.00% 44.0 109.52% 2022-11-24T14:29:48
1998 llvm-arm-master-O2:733278613444249056 execution_variation 456.hmmer (unexplained diff vs previous) 0406 (no-change), 0408 (llvmorg-16-init-12045-g5888e5aebce6) 132.0137.0 3.79% 120.0 51.90% 2022-11-24T14:29:48
1999 llvm-arm-master-O2:733278613444249056 execution_variation 445.gobmk (max) (percentage) 0406 (no-change), 0408 (llvmorg-16-init-12045-g5888e5aebce6) 0.290.32 10.34% 0.28 -28.21% 2022-11-24T14:29:48
2000 llvm-arm-master-O2:733278613444249056 execution_variation 453.povray (max) (percentage) 0406 (no-change), 0408 (llvmorg-16-init-12045-g5888e5aebce6) 1.110.94 -15.32% 0.27 -76.11% 2022-11-24T14:29:48
2001 llvm-arm-master-O2:733278613444249056 execution_variation 473.astar 0406 (no-change), 0408 (llvmorg-16-init-12045-g5888e5aebce6) 12.011.0 -8.33% 11.0 -8.33% 2022-11-24T14:29:48
2002 llvm-arm-master-O2:733278613444249056 execution_variation 444.namd (max) (percentage) 0406 (no-change), 0408 (llvmorg-16-init-12045-g5888e5aebce6) 0.270.28 3.70% 0.28 -6.67% 2022-11-24T14:29:48
2003 llvm-arm-master-O2:733278613444249056 execution_variation 471.omnetpp 0406 (no-change), 0408 (llvmorg-16-init-12045-g5888e5aebce6) 33.034.0 3.03% 33.0 -5.71% 2022-11-24T14:29:48
2004 llvm-arm-master-O2:733278613444249056 execution_variation 444.namd (unexplained diff vs previous) 0406 (no-change), 0408 (llvmorg-16-init-12045-g5888e5aebce6) 27.028.0 3.70% 4.0 100.00% 2022-11-24T14:29:48
2005 llvm-arm-master-O2:733278613444249056 execution_variation 483.xalancbmk (max) 0406 (no-change), 0408 (llvmorg-16-init-12045-g5888e5aebce6) 114.0143.0 25.44% 66.0 -12.00% 2022-11-24T14:29:48
2006 llvm-arm-master-O2:733278613444249056 execution_variation 458.sjeng (max) 0406 (no-change), 0408 (llvmorg-16-init-12045-g5888e5aebce6) 330.0305.0 -7.58% 52.0 -84.24% 2022-11-24T14:29:48
2007 llvm-arm-master-O2:733278613444249056 execution_variation 458.sjeng (unexplained diff vs previous) (percentage) 0406 (no-change), 0408 (llvmorg-16-init-12045-g5888e5aebce6) 0.170.21 23.53% 0.3 114.29% 2022-11-24T14:29:48
2008 llvm-arm-master-O2:733278613444249056 execution_variation 445.gobmk (max) 0406 (no-change), 0408 (llvmorg-16-init-12045-g5888e5aebce6) 31.034.0 9.68% 31.0 -26.19% 2022-11-24T14:29:48
2009 llvm-arm-master-O2:733278613444249056 execution_variation 471.omnetpp (unexplained diff vs previous) (percentage) 0406 (no-change), 0408 (llvmorg-16-init-12045-g5888e5aebce6) 0.320.3 -6.25% 0.61 165.22% 2022-11-24T14:29:48
2010 llvm-arm-master-O2:733278613444249056 execution_variation 445.gobmk (unexplained diff vs previous) 0406 (no-change), 0408 (llvmorg-16-init-12045-g5888e5aebce6) 2.01.0 -50.00% None 0.00% 2022-11-24T14:29:48
2011 llvm-arm-master-O2:733278613444249056 execution_variation 473.astar (avg) 0406 (no-change), 0408 (llvmorg-16-init-12045-g5888e5aebce6) 12.011.0 -8.33% 11.0 -8.33% 2022-11-24T14:29:48
2012 llvm-arm-master-O2:733278613444249056 execution_variation 447.dealII (max) (percentage) 0406 (no-change), 0408 (llvmorg-16-init-12045-g5888e5aebce6) 0.830.87 4.82% 0.68 -31.31% 2022-11-24T14:29:48
2013 llvm-arm-master-O2:733278613444249056 execution_variation 447.dealII (unexplained diff vs previous) (percentage) 0406 (no-change), 0408 (llvmorg-16-init-12045-g5888e5aebce6) 0.210.29 38.10% None 0.00% 2022-11-24T14:29:48
2014 llvm-arm-master-O2:733278613444249056 execution_variation 483.xalancbmk (unexplained diff vs previous) 0406 (no-change), 0408 (llvmorg-16-init-12045-g5888e5aebce6) 117.0147.0 25.64% None 0.00% 2022-11-24T14:29:48
2015 llvm-arm-master-O2:733278613444249056 execution_variation 403.gcc (unexplained diff vs previous) 0406 (no-change), 0408 (llvmorg-16-init-12045-g5888e5aebce6) 13.012.0 -7.69% 55.0 2650.00% 2022-11-24T14:29:48
2016 llvm-arm-master-O2:733278613444249056 execution_variation 483.xalancbmk (avg) (percentage) 0406 (no-change), 0408 (llvmorg-16-init-12045-g5888e5aebce6) 0.850.9 5.88% 0.92 27.78% 2022-11-24T14:29:48
2017 llvm-arm-master-O2:733278613444249056 execution_variation 450.soplex (unexplained diff vs previous) (percentage) 0406 (no-change), 0408 (llvmorg-16-init-12045-g5888e5aebce6) 0.170.15 -11.76% None 0.00% 2022-11-24T14:29:48
2018 llvm-arm-master-O2:733278613444249056 execution_variation 483.xalancbmk (avg) 0406 (no-change), 0408 (llvmorg-16-init-12045-g5888e5aebce6) 48.051.0 6.25% 53.0 29.27% 2022-11-24T14:29:48
2019 llvm-arm-master-O2:733278613444249056 execution_variation 483.xalancbmk (max) (percentage) 0406 (no-change), 0408 (llvmorg-16-init-12045-g5888e5aebce6) 2.022.53 25.25% 1.14 -11.63% 2022-11-24T14:29:48
2020 llvm-arm-master-O2:733278613444249056 execution_variation 447.dealII (avg) (percentage) 0406 (no-change), 0408 (llvmorg-16-init-12045-g5888e5aebce6) 0.540.53 -1.85% 0.55 -1.79% 2022-11-24T14:29:48
2021 llvm-arm-master-O2:733278613444249056 execution_variation 433.milc (max) 0406 (no-change), 0408 (llvmorg-16-init-12045-g5888e5aebce6) 4.02.0 -50.00% 9.0 125.00% 2022-11-24T14:29:48
2022 llvm-arm-master-O2:733278613444249056 execution_variation 433.milc (avg) 0406 (no-change), 0408 (llvmorg-16-init-12045-g5888e5aebce6) 8.07.0 -12.50% 8.0 0.00% 2022-11-24T14:29:48
2023 llvm-arm-master-O2:733278613444249056 execution_variation 401.bzip2 (max) (percentage) 0406 (no-change), 0408 (llvmorg-16-init-12045-g5888e5aebce6) 0.130.12 -7.69% 0.09 -30.77% 2022-11-24T14:29:48
2024 llvm-arm-master-O2:733278613444249056 execution_variation 482.sphinx3 (avg) (percentage) 0406 (no-change), 0408 (llvmorg-16-init-12045-g5888e5aebce6) 0.670.65 -2.99% 0.53 -24.29% 2022-11-24T14:29:48
2025 llvm-arm-master-O2:733278613444249056 execution_variation 456.hmmer (max) 0406 (no-change), 0408 (llvmorg-16-init-12045-g5888e5aebce6) 132.0139.0 5.30% 126.0 5.88% 2022-11-24T14:29:48
2026 llvm-arm-master-O2:733278613444249056 execution_variation 464.h264ref (unexplained diff vs previous) (percentage) 0406 (no-change), 0408 (llvmorg-16-init-12045-g5888e5aebce6) 1.061.04 -1.89% 0.25 -45.65% 2022-11-24T14:29:48
2027 llvm-arm-master-O2:733278613444249056 execution_variation 482.sphinx3 (avg) 0406 (no-change), 0408 (llvmorg-16-init-12045-g5888e5aebce6) 124.0119.0 -4.03% 96.0 -25.00% 2022-11-24T14:29:48
2028 llvm-arm-master-O2:733278613444249056 execution_variation 429.mcf (max) 0406 (no-change), 0408 (llvmorg-16-init-12045-g5888e5aebce6) 14.013.0 -7.14% 10.0 -28.57% 2022-11-24T14:29:48
2029 llvm-arm-master-O2:733278613444249056 execution_variation 464.h264ref (avg) (percentage) 0406 (no-change), 0408 (llvmorg-16-init-12045-g5888e5aebce6) 0.570.58 1.75% 0.62 14.81% 2022-11-24T14:29:48
2030 llvm-arm-master-O2:733278613444249056 execution_variation 470.lbm (unexplained diff vs previous) (percentage) 0406 (no-change), 0408 (llvmorg-16-init-12045-g5888e5aebce6) 0.170.07 -58.82% 0.11 -57.69% 2022-11-24T14:29:48
2031 llvm-arm-master-O2:733278613444249056 execution_variation 445.gobmk (unexplained diff vs previous) (percentage) 0406 (no-change), 0408 (llvmorg-16-init-12045-g5888e5aebce6) 0.020.01 -50.00% None 0.00% 2022-11-24T14:29:48
2032 llvm-arm-master-O2:733278613444249056 execution_variation 447.dealII (max) 0406 (no-change), 0408 (llvmorg-16-init-12045-g5888e5aebce6) 42.045.0 7.14% 35.0 -31.37% 2022-11-24T14:29:48
2033 llvm-arm-master-O2:733278613444249056 execution_variation 444.namd (max) 0406 (no-change), 0408 (llvmorg-16-init-12045-g5888e5aebce6) 26.027.0 3.85% 27.0 -6.90% 2022-11-24T14:29:48
2034 llvm-arm-master-O2:733278613444249056 execution_variation 462.libquantum (max) 0406 (no-change), 0408 (llvmorg-16-init-12045-g5888e5aebce6) 41.038.0 -7.32% 8.0 -80.49% 2022-11-24T14:29:48
Change State Split Delete