Regression: Regression of 77 benchmarks: 401.bzip2 (max), 401.bzip2 (max) (percentage), 403.gcc, 403.gcc (avg), 403.gcc (avg) (perce...



Metric
Order
Δ ID Machine Metric Test Good, Bad OldNew Now Current Age
1888 llvm-arm-master-O2:733278613444249056 execution_variation 453.povray (avg) 0404 (llvmorg-16-init-11387-g470aea5ed403), 0406 (no-change) 29.032.0 10.34% 22.0 -24.14% 2022-11-20T15:55:21
1889 llvm-arm-master-O2:733278613444249056 execution_variation 464.h264ref (avg) 0404 (llvmorg-16-init-11387-g470aea5ed403), 0406 (no-change) 53.052.0 -1.89% 61.0 15.09% 2022-11-20T15:55:21
1890 llvm-arm-master-O2:733278613444249056 execution_variation 450.soplex (max) 0404 (llvmorg-16-init-11387-g470aea5ed403), 0406 (no-change) 23.024.0 4.35% 20.0 -25.93% 2022-11-20T15:55:21
1891 llvm-arm-master-O2:733278613444249056 execution_variation 458.sjeng (avg) 0404 (llvmorg-16-init-11387-g470aea5ed403), 0406 (no-change) 133.0125.0 -6.02% 92.0 -30.83% 2022-11-20T15:55:21
1892 llvm-arm-master-O2:733278613444249056 execution_variation 470.lbm (max) 0404 (llvmorg-16-init-11387-g470aea5ed403), 0406 (no-change) 91.095.0 4.40% 31.0 -69.31% 2022-11-20T15:55:21
1893 llvm-arm-master-O2:733278613444249056 execution_variation 471.omnetpp (avg) (percentage) 0404 (llvmorg-16-init-11387-g470aea5ed403), 0406 (no-change) 0.480.49 2.08% 0.46 -11.54% 2022-11-20T15:55:21
1894 llvm-arm-master-O2:733278613444249056 execution_variation 462.libquantum (unexplained diff vs previous) 0404 (llvmorg-16-init-11387-g470aea5ed403), 0406 (no-change) 2.06.0 200.00% 7.0 250.00% 2022-11-20T15:55:21
1895 llvm-arm-master-O2:733278613444249056 execution_variation 471.omnetpp (avg) 0404 (llvmorg-16-init-11387-g470aea5ed403), 0406 (no-change) 34.035.0 2.94% 33.0 -10.81% 2022-11-20T15:55:21
1896 llvm-arm-master-O2:733278613444249056 execution_variation 458.sjeng (avg) (percentage) 0404 (llvmorg-16-init-11387-g470aea5ed403), 0406 (no-change) 0.920.86 -6.52% 0.63 -31.52% 2022-11-20T15:55:21
1897 llvm-arm-master-O2:733278613444249056 execution_variation 464.h264ref 0404 (llvmorg-16-init-11387-g470aea5ed403), 0406 (no-change) 53.052.0 -1.89% 61.0 15.09% 2022-11-20T15:55:21
1898 llvm-arm-master-O2:733278613444249056 execution_variation 482.sphinx3 (unexplained diff vs previous) (percentage) 0404 (llvmorg-16-init-11387-g470aea5ed403), 0406 (no-change) 1.031.06 2.91% None 0.00% 2022-11-20T15:55:21
1899 llvm-arm-master-O2:733278613444249056 execution_variation 444.namd 0404 (llvmorg-16-init-11387-g470aea5ed403), 0406 (no-change) 14.015.0 7.14% 17.0 6.25% 2022-11-20T15:55:21
1900 llvm-arm-master-O2:733278613444249056 execution_variation 401.bzip2 (max) 0404 (llvmorg-16-init-11387-g470aea5ed403), 0406 (no-change) 15.014.0 -6.67% 10.0 -37.50% 2022-11-20T15:55:21
1901 llvm-arm-master-O2:733278613444249056 execution_variation 456.hmmer (max) (percentage) 0404 (llvmorg-16-init-11387-g470aea5ed403), 0406 (no-change) 1.591.57 -1.26% 1.63 -7.39% 2022-11-20T15:55:21
1902 llvm-arm-master-O2:733278613444249056 execution_variation 403.gcc (max) 0404 (llvmorg-16-init-11387-g470aea5ed403), 0406 (no-change) 11.08.0 -27.27% 54.0 116.00% 2022-11-20T15:55:21
1903 llvm-arm-master-O2:733278613444249056 execution_variation 403.gcc 0404 (llvmorg-16-init-11387-g470aea5ed403), 0406 (no-change) 13.014.0 7.69% 23.0 53.33% 2022-11-20T15:55:21
1904 llvm-arm-master-O2:733278613444249056 execution_variation 403.gcc (max) (percentage) 0404 (llvmorg-16-init-11387-g470aea5ed403), 0406 (no-change) 0.180.13 -27.78% 0.83 118.42% 2022-11-20T15:55:21
1905 llvm-arm-master-O2:733278613444249056 execution_variation 471.omnetpp (max) (percentage) 0404 (llvmorg-16-init-11387-g470aea5ed403), 0406 (no-change) 0.290.32 10.34% 0.63 -40.57% 2022-11-20T15:55:21
1906 llvm-arm-master-O2:733278613444249056 execution_variation 453.povray (unexplained diff vs previous) (percentage) 0404 (llvmorg-16-init-11387-g470aea5ed403), 0406 (no-change) 1.151.12 -2.61% None 0.00% 2022-11-20T15:55:21
1907 llvm-arm-master-O2:733278613444249056 execution_variation 473.astar (unexplained diff vs previous) 0404 (llvmorg-16-init-11387-g470aea5ed403), 0406 (no-change) 1.03.0 200.00% 10.0 900.00% 2022-11-20T15:55:21
1908 llvm-arm-master-O2:733278613444249056 execution_variation 464.h264ref (max) (percentage) 0404 (llvmorg-16-init-11387-g470aea5ed403), 0406 (no-change) 0.640.47 -26.56% 0.43 -33.85% 2022-11-20T15:55:21
1909 llvm-arm-master-O2:733278613444249056 execution_variation 482.sphinx3 (max) 0404 (llvmorg-16-init-11387-g470aea5ed403), 0406 (no-change) 352.0289.0 -17.90% 47.0 -86.65% 2022-11-20T15:55:21
1910 llvm-arm-master-O2:733278613444249056 execution_variation 482.sphinx3 (unexplained diff vs previous) 0404 (llvmorg-16-init-11387-g470aea5ed403), 0406 (no-change) 190.0195.0 2.63% None 0.00% 2022-11-20T15:55:21
1911 llvm-arm-master-O2:733278613444249056 execution_variation 482.sphinx3 0404 (llvmorg-16-init-11387-g470aea5ed403), 0406 (no-change) 124.0128.0 3.23% 96.0 -22.58% 2022-11-20T15:55:21
1912 llvm-arm-master-O2:733278613444249056 execution_variation 470.lbm (avg) 0404 (llvmorg-16-init-11387-g470aea5ed403), 0406 (no-change) 61.063.0 3.28% 49.0 -24.62% 2022-11-20T15:55:21
1913 llvm-arm-master-O2:733278613444249056 execution_variation 429.mcf (max) (percentage) 0404 (llvmorg-16-init-11387-g470aea5ed403), 0406 (no-change) 0.120.15 25.00% 0.11 -38.89% 2022-11-20T15:55:21
1914 llvm-arm-master-O2:733278613444249056 execution_variation 447.dealII (unexplained diff vs previous) 0404 (llvmorg-16-init-11387-g470aea5ed403), 0406 (no-change) 56.052.0 -7.14% None 0.00% 2022-11-20T15:55:21
1915 llvm-arm-master-O2:733278613444249056 execution_variation 483.xalancbmk 0404 (llvmorg-16-init-11387-g470aea5ed403), 0406 (no-change) 40.041.0 2.50% 53.0 43.24% 2022-11-20T15:55:21
1916 llvm-arm-master-O2:733278613444249056 execution_variation 482.sphinx3 (max) (percentage) 0404 (llvmorg-16-init-11387-g470aea5ed403), 0406 (no-change) 1.91.58 -16.84% 0.26 -86.32% 2022-11-20T15:55:21
1917 llvm-arm-master-O2:733278613444249056 execution_variation 483.xalancbmk (unexplained diff vs previous) (percentage) 0404 (llvmorg-16-init-11387-g470aea5ed403), 0406 (no-change) 1.031.27 23.30% None 0.00% 2022-11-20T15:55:21
1918 llvm-arm-master-O2:733278613444249056 execution_variation 444.namd (unexplained diff vs previous) (percentage) 0404 (llvmorg-16-init-11387-g470aea5ed403), 0406 (no-change) 0.010.02 100.00% 0.04 -83.33% 2022-11-20T15:55:21
1919 llvm-arm-master-O2:733278613444249056 execution_variation 444.namd (avg) (percentage) 0404 (llvmorg-16-init-11387-g470aea5ed403), 0406 (no-change) 0.150.16 6.67% 0.18 5.88% 2022-11-20T15:55:21
1920 llvm-arm-master-O2:733278613444249056 execution_variation 470.lbm (max) (percentage) 0404 (llvmorg-16-init-11387-g470aea5ed403), 0406 (no-change) 0.580.6 3.45% 0.2 -68.75% 2022-11-20T15:55:21
1921 llvm-arm-master-O2:733278613444249056 execution_variation 470.lbm 0404 (llvmorg-16-init-11387-g470aea5ed403), 0406 (no-change) 61.063.0 3.28% 49.0 -24.62% 2022-11-20T15:55:21
1922 llvm-arm-master-O2:733278613444249056 execution_variation 453.povray (unexplained diff vs previous) 0404 (llvmorg-16-init-11387-g470aea5ed403), 0406 (no-change) 53.052.0 -1.89% None 0.00% 2022-11-20T15:55:21
1923 llvm-arm-master-O2:733278613444249056 execution_variation 453.povray 0404 (llvmorg-16-init-11387-g470aea5ed403), 0406 (no-change) 29.032.0 10.34% 22.0 -24.14% 2022-11-20T15:55:21
1924 llvm-arm-master-O2:733278613444249056 execution_variation 456.hmmer (unexplained diff vs previous) (percentage) 0404 (llvmorg-16-init-11387-g470aea5ed403), 0406 (no-change) 1.081.04 -3.70% 1.54 170.18% 2022-11-20T15:55:21
1925 llvm-arm-master-O2:733278613444249056 execution_variation 458.sjeng (max) (percentage) 0404 (llvmorg-16-init-11387-g470aea5ed403), 0406 (no-change) 2.522.27 -9.92% 0.36 -85.71% 2022-11-20T15:55:21
1926 llvm-arm-master-O2:733278613444249056 execution_variation 470.lbm (unexplained diff vs previous) 0404 (llvmorg-16-init-11387-g470aea5ed403), 0406 (no-change) 45.042.0 -6.67% 18.0 -68.42% 2022-11-20T15:55:21
1927 llvm-arm-master-O2:733278613444249056 execution_variation 403.gcc (avg) 0404 (llvmorg-16-init-11387-g470aea5ed403), 0406 (no-change) 13.014.0 7.69% 23.0 53.33% 2022-11-20T15:55:21
1928 llvm-arm-master-O2:733278613444249056 execution_variation 471.omnetpp (unexplained diff vs previous) 0404 (llvmorg-16-init-11387-g470aea5ed403), 0406 (no-change) 18.017.0 -5.56% 45.0 60.71% 2022-11-20T15:55:21
1929 llvm-arm-master-O2:733278613444249056 execution_variation 464.h264ref (unexplained diff vs previous) 0404 (llvmorg-16-init-11387-g470aea5ed403), 0406 (no-change) 40.045.0 12.50% 25.0 -59.68% 2022-11-20T15:55:21
1930 llvm-arm-master-O2:733278613444249056 execution_variation 458.sjeng (unexplained diff vs previous) 0404 (llvmorg-16-init-11387-g470aea5ed403), 0406 (no-change) 25.021.0 -16.00% 44.0 -88.33% 2022-11-20T15:55:21
1931 llvm-arm-master-O2:733278613444249056 execution_variation 456.hmmer (unexplained diff vs previous) 0404 (llvmorg-16-init-11387-g470aea5ed403), 0406 (no-change) 83.079.0 -4.82% 120.0 179.07% 2022-11-20T15:55:21
1932 llvm-arm-master-O2:733278613444249056 execution_variation 403.gcc (unexplained diff vs previous) (percentage) 0404 (llvmorg-16-init-11387-g470aea5ed403), 0406 (no-change) 0.050.03 -40.00% 0.84 394.12% 2022-11-20T15:55:21
1933 llvm-arm-master-O2:733278613444249056 execution_variation 444.namd (max) (percentage) 0404 (llvmorg-16-init-11387-g470aea5ed403), 0406 (no-change) 0.320.3 -6.25% 0.28 -12.50% 2022-11-20T15:55:21
1934 llvm-arm-master-O2:733278613444249056 execution_variation 471.omnetpp 0404 (llvmorg-16-init-11387-g470aea5ed403), 0406 (no-change) 34.035.0 2.94% 33.0 -10.81% 2022-11-20T15:55:21
1935 llvm-arm-master-O2:733278613444249056 execution_variation 464.h264ref (max) 0404 (llvmorg-16-init-11387-g470aea5ed403), 0406 (no-change) 63.045.0 -28.57% 42.0 -33.33% 2022-11-20T15:55:21
1936 llvm-arm-master-O2:733278613444249056 execution_variation 458.sjeng 0404 (llvmorg-16-init-11387-g470aea5ed403), 0406 (no-change) 133.0125.0 -6.02% 92.0 -30.83% 2022-11-20T15:55:21
1937 llvm-arm-master-O2:733278613444249056 execution_variation 444.namd (unexplained diff vs previous) 0404 (llvmorg-16-init-11387-g470aea5ed403), 0406 (no-change) 1.02.0 100.00% 4.0 -83.33% 2022-11-20T15:55:21
1938 llvm-arm-master-O2:733278613444249056 execution_variation 453.povray (avg) (percentage) 0404 (llvmorg-16-init-11387-g470aea5ed403), 0406 (no-change) 0.640.69 7.81% 0.48 -25.00% 2022-11-20T15:55:21
1939 llvm-arm-master-O2:733278613444249056 execution_variation 444.namd (avg) 0404 (llvmorg-16-init-11387-g470aea5ed403), 0406 (no-change) 14.015.0 7.14% 17.0 6.25% 2022-11-20T15:55:21
1940 llvm-arm-master-O2:733278613444249056 execution_variation 471.omnetpp (max) 0404 (llvmorg-16-init-11387-g470aea5ed403), 0406 (no-change) 21.023.0 9.52% 46.0 -40.26% 2022-11-20T15:55:21
1941 llvm-arm-master-O2:733278613444249056 execution_variation 483.xalancbmk (max) 0404 (llvmorg-16-init-11387-g470aea5ed403), 0406 (no-change) 77.075.0 -2.60% 66.0 78.38% 2022-11-20T15:55:21
1942 llvm-arm-master-O2:733278613444249056 execution_variation 462.libquantum (unexplained diff vs previous) (percentage) 0404 (llvmorg-16-init-11387-g470aea5ed403), 0406 (no-change) 0.010.04 300.00% 0.05 400.00% 2022-11-20T15:55:21
1943 llvm-arm-master-O2:733278613444249056 execution_variation 458.sjeng (max) 0404 (llvmorg-16-init-11387-g470aea5ed403), 0406 (no-change) 366.0330.0 -9.84% 52.0 -85.79% 2022-11-20T15:55:21
1944 llvm-arm-master-O2:733278613444249056 execution_variation 458.sjeng (unexplained diff vs previous) (percentage) 0404 (llvmorg-16-init-11387-g470aea5ed403), 0406 (no-change) 0.170.14 -17.65% 0.3 -88.42% 2022-11-20T15:55:21
1945 llvm-arm-master-O2:733278613444249056 execution_variation 403.gcc (avg) (percentage) 0404 (llvmorg-16-init-11387-g470aea5ed403), 0406 (no-change) 0.230.22 -4.35% 0.36 56.52% 2022-11-20T15:55:21
1946 llvm-arm-master-O2:733278613444249056 execution_variation 471.omnetpp (unexplained diff vs previous) (percentage) 0404 (llvmorg-16-init-11387-g470aea5ed403), 0406 (no-change) 0.250.23 -8.00% 0.61 60.53% 2022-11-20T15:55:21
1947 llvm-arm-master-O2:733278613444249056 execution_variation 473.astar (unexplained diff vs previous) (percentage) 0404 (llvmorg-16-init-11387-g470aea5ed403), 0406 (no-change) 0.010.03 200.00% 0.11 1000.00% 2022-11-20T15:55:21
1948 llvm-arm-master-O2:733278613444249056 execution_variation 447.dealII (max) (percentage) 0404 (llvmorg-16-init-11387-g470aea5ed403), 0406 (no-change) 1.00.99 -1.00% 0.68 -37.04% 2022-11-20T15:55:21
1949 llvm-arm-master-O2:733278613444249056 execution_variation 447.dealII (unexplained diff vs previous) (percentage) 0404 (llvmorg-16-init-11387-g470aea5ed403), 0406 (no-change) 1.071.0 -6.54% None 0.00% 2022-11-20T15:55:21
1950 llvm-arm-master-O2:733278613444249056 execution_variation 483.xalancbmk (unexplained diff vs previous) 0404 (llvmorg-16-init-11387-g470aea5ed403), 0406 (no-change) 59.074.0 25.42% None 0.00% 2022-11-20T15:55:21
1951 llvm-arm-master-O2:733278613444249056 execution_variation 403.gcc (unexplained diff vs previous) 0404 (llvmorg-16-init-11387-g470aea5ed403), 0406 (no-change) 3.02.0 -33.33% 55.0 400.00% 2022-11-20T15:55:21
1952 llvm-arm-master-O2:733278613444249056 execution_variation 483.xalancbmk (avg) 0404 (llvmorg-16-init-11387-g470aea5ed403), 0406 (no-change) 40.041.0 2.50% 53.0 43.24% 2022-11-20T15:55:21
1953 llvm-arm-master-O2:733278613444249056 execution_variation 483.xalancbmk (max) (percentage) 0404 (llvmorg-16-init-11387-g470aea5ed403), 0406 (no-change) 1.351.29 -4.44% 1.14 75.38% 2022-11-20T15:55:21
1954 llvm-arm-master-O2:733278613444249056 execution_variation 401.bzip2 (max) (percentage) 0404 (llvmorg-16-init-11387-g470aea5ed403), 0406 (no-change) 0.140.13 -7.14% 0.09 -40.00% 2022-11-20T15:55:21
1955 llvm-arm-master-O2:733278613444249056 execution_variation 482.sphinx3 (avg) (percentage) 0404 (llvmorg-16-init-11387-g470aea5ed403), 0406 (no-change) 0.670.7 4.48% 0.53 -20.90% 2022-11-20T15:55:21
1956 llvm-arm-master-O2:733278613444249056 execution_variation 456.hmmer (max) 0404 (llvmorg-16-init-11387-g470aea5ed403), 0406 (no-change) 121.0119.0 -1.65% 126.0 -4.55% 2022-11-20T15:55:21
1957 llvm-arm-master-O2:733278613444249056 execution_variation 464.h264ref (unexplained diff vs previous) (percentage) 0404 (llvmorg-16-init-11387-g470aea5ed403), 0406 (no-change) 0.410.46 12.20% 0.25 -60.32% 2022-11-20T15:55:21
1958 llvm-arm-master-O2:733278613444249056 execution_variation 482.sphinx3 (avg) 0404 (llvmorg-16-init-11387-g470aea5ed403), 0406 (no-change) 124.0128.0 3.23% 96.0 -22.58% 2022-11-20T15:55:21
1959 llvm-arm-master-O2:733278613444249056 execution_variation 429.mcf (max) 0404 (llvmorg-16-init-11387-g470aea5ed403), 0406 (no-change) 11.014.0 27.27% 10.0 -41.18% 2022-11-20T15:55:21
1960 llvm-arm-master-O2:733278613444249056 execution_variation 470.lbm (unexplained diff vs previous) (percentage) 0404 (llvmorg-16-init-11387-g470aea5ed403), 0406 (no-change) 0.280.26 -7.14% 0.11 -69.44% 2022-11-20T15:55:21
1961 llvm-arm-master-O2:733278613444249056 execution_variation 445.gobmk (unexplained diff vs previous) (percentage) 0404 (llvmorg-16-init-11387-g470aea5ed403), 0406 (no-change) 0.380.39 2.63% None 0.00% 2022-11-20T15:55:21
1962 llvm-arm-master-O2:733278613444249056 execution_variation 447.dealII (max) 0404 (llvmorg-16-init-11387-g470aea5ed403), 0406 (no-change) 52.051.0 -1.92% 35.0 -37.50% 2022-11-20T15:55:21
1963 llvm-arm-master-O2:733278613444249056 execution_variation 444.namd (max) 0404 (llvmorg-16-init-11387-g470aea5ed403), 0406 (no-change) 31.029.0 -6.45% 27.0 -12.90% 2022-11-20T15:55:21
1964 llvm-arm-master-O2:733278613444249056 execution_variation 462.libquantum (max) 0404 (llvmorg-16-init-11387-g470aea5ed403), 0406 (no-change) 42.041.0 -2.38% 8.0 -80.95% 2022-11-20T15:55:21
Change State Split Delete