Regression: Regression of 70 benchmarks: 500.perlbench_r (max), 500.perlbench_r (max) (percentage), 500.perlbench_r (unexplained dif...



Metric
Order
Δ ID Machine Metric Test Good, Bad OldNew Now Current Age
1890 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (avg) 0205 (llvmorg-19-init-01406-g9a5fb74fd162), 0206 (llvmorg-19-init-01407-gd193ac4f7180) 20.021.0 5.00% 17.0 -15.00% 2024-02-05T02:25:57
1891 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (unexplained diff vs previous) (percentage) 0205 (llvmorg-19-init-01406-g9a5fb74fd162), 0206 (llvmorg-19-init-01407-gd193ac4f7180) 0.60.59 -1.67% 0.24 0.00% 2024-02-05T02:25:57
1892 llvm-aarch64-master-O3:239801545695209356 execution_variation 548.exchange2_r (unexplained diff vs previous) 0205 (llvmorg-19-init-01406-g9a5fb74fd162), 0206 (llvmorg-19-init-01407-gd193ac4f7180) 9.08.0 -11.11% None 0.00% 2024-02-05T02:25:57
1893 llvm-aarch64-master-O3:239801545695209356 execution_variation 549.fotonik3d_r (max) (percentage) 0205 (llvmorg-19-init-01406-g9a5fb74fd162), 0206 (llvmorg-19-init-01407-gd193ac4f7180) 2.872.78 -3.14% 3.34 16.38% 2024-02-05T02:25:57
1894 llvm-aarch64-master-O3:239801545695209356 execution_variation 549.fotonik3d_r 0205 (llvmorg-19-init-01406-g9a5fb74fd162), 0206 (llvmorg-19-init-01407-gd193ac4f7180) 36.035.0 -2.78% 20.0 -45.95% 2024-02-05T02:25:57
1895 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (unexplained diff vs previous) 0205 (llvmorg-19-init-01406-g9a5fb74fd162), 0206 (llvmorg-19-init-01407-gd193ac4f7180) 35.039.0 11.43% 17.0 -48.48% 2024-02-05T02:25:57
1896 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (max) 0205 (llvmorg-19-init-01406-g9a5fb74fd162), 0206 (llvmorg-19-init-01407-gd193ac4f7180) 38.037.0 -2.63% 18.0 -52.63% 2024-02-05T02:25:57
1897 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (max) 0205 (llvmorg-19-init-01406-g9a5fb74fd162), 0206 (llvmorg-19-init-01407-gd193ac4f7180) 56.055.0 -1.79% 20.0 -64.29% 2024-02-05T02:25:57
1898 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (unexplained diff vs previous) (percentage) 0205 (llvmorg-19-init-01406-g9a5fb74fd162), 0206 (llvmorg-19-init-01407-gd193ac4f7180) 1.160.73 -37.07% 0.55 0.00% 2024-02-05T02:25:57
1899 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (max) (percentage) 0205 (llvmorg-19-init-01406-g9a5fb74fd162), 0206 (llvmorg-19-init-01407-gd193ac4f7180) 1.131.08 -4.42% 0.55 -51.33% 2024-02-05T02:25:57
1900 llvm-aarch64-master-O3:239801545695209356 execution_variation 557.xz_r (unexplained diff vs previous) 0205 (llvmorg-19-init-01406-g9a5fb74fd162), 0206 (llvmorg-19-init-01407-gd193ac4f7180) 5.06.0 20.00% 11.0 450.00% 2024-02-05T02:25:57
1901 llvm-aarch64-master-O3:239801545695209356 execution_variation 503.bwaves_r (avg) 0205 (llvmorg-19-init-01406-g9a5fb74fd162), 0206 (llvmorg-19-init-01407-gd193ac4f7180) 7.08.0 14.29% 6.0 -14.29% 2024-02-05T02:25:57
1902 llvm-aarch64-master-O3:239801545695209356 execution_variation 503.bwaves_r (max) (percentage) 0205 (llvmorg-19-init-01406-g9a5fb74fd162), 0206 (llvmorg-19-init-01407-gd193ac4f7180) 0.910.87 -4.40% 0.57 -37.36% 2024-02-05T02:25:57
1903 llvm-aarch64-master-O3:239801545695209356 execution_variation 526.blender_r (unexplained diff vs previous) (percentage) 0205 (llvmorg-19-init-01406-g9a5fb74fd162), 0206 (llvmorg-19-init-01407-gd193ac4f7180) 0.30.15 -50.00% 0.0 0.00% 2024-02-05T02:25:57
1904 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (avg) 0205 (llvmorg-19-init-01406-g9a5fb74fd162), 0206 (llvmorg-19-init-01407-gd193ac4f7180) 25.027.0 8.00% 19.0 -24.00% 2024-02-05T02:25:57
1905 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (max) (percentage) 0205 (llvmorg-19-init-01406-g9a5fb74fd162), 0206 (llvmorg-19-init-01407-gd193ac4f7180) 9.679.87 2.07% 2.43 -73.73% 2024-02-05T02:25:57
1906 llvm-aarch64-master-O3:239801545695209356 execution_variation 503.bwaves_r (unexplained diff vs previous) (percentage) 0205 (llvmorg-19-init-01406-g9a5fb74fd162), 0206 (llvmorg-19-init-01407-gd193ac4f7180) 0.90.79 -12.22% 0.09 -90.00% 2024-02-05T02:25:57
1907 llvm-aarch64-master-O3:239801545695209356 execution_variation 503.bwaves_r (max) 0205 (llvmorg-19-init-01406-g9a5fb74fd162), 0206 (llvmorg-19-init-01407-gd193ac4f7180) 18.017.0 -5.56% 12.0 -33.33% 2024-02-05T02:25:57
1908 llvm-aarch64-master-O3:239801545695209356 execution_variation 548.exchange2_r (unexplained diff vs previous) (percentage) 0205 (llvmorg-19-init-01406-g9a5fb74fd162), 0206 (llvmorg-19-init-01407-gd193ac4f7180) 0.250.23 -8.00% None 0.00% 2024-02-05T02:25:57
1909 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r (max) (percentage) 0205 (llvmorg-19-init-01406-g9a5fb74fd162), 0206 (llvmorg-19-init-01407-gd193ac4f7180) 1.132.79 146.90% 0.44 -58.10% 2024-02-05T02:25:57
1910 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r (max) 0205 (llvmorg-19-init-01406-g9a5fb74fd162), 0206 (llvmorg-19-init-01407-gd193ac4f7180) 30.078.0 160.00% 11.0 -60.71% 2024-02-05T02:25:57
1911 llvm-aarch64-master-O3:239801545695209356 execution_variation 523.xalancbmk_r (max) (percentage) 0205 (llvmorg-19-init-01406-g9a5fb74fd162), 0206 (llvmorg-19-init-01407-gd193ac4f7180) 0.851.77 108.24% 0.42 5.00% 2024-02-05T02:25:57
1912 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (unexplained diff vs previous) 0205 (llvmorg-19-init-01406-g9a5fb74fd162), 0206 (llvmorg-19-init-01407-gd193ac4f7180) 10.025.0 150.00% 19.0 0.00% 2024-02-05T02:25:57
1913 llvm-aarch64-master-O3:239801545695209356 execution_variation 538.imagick_r (avg) (percentage) 0205 (llvmorg-19-init-01406-g9a5fb74fd162), 0206 (llvmorg-19-init-01407-gd193ac4f7180) 0.10.09 -10.00% 0.1 0.00% 2024-02-05T02:25:57
1914 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r (unexplained diff vs previous) 0205 (llvmorg-19-init-01406-g9a5fb74fd162), 0206 (llvmorg-19-init-01407-gd193ac4f7180) 31.076.0 145.16% 12.0 71.43% 2024-02-05T02:25:57
1915 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r (avg) 0205 (llvmorg-19-init-01406-g9a5fb74fd162), 0206 (llvmorg-19-init-01407-gd193ac4f7180) 16.020.0 25.00% 10.0 -28.57% 2024-02-05T02:25:57
1916 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (unexplained diff vs previous) (percentage) 0205 (llvmorg-19-init-01406-g9a5fb74fd162), 0206 (llvmorg-19-init-01407-gd193ac4f7180) 9.8110.95 11.62% 2.38 0.00% 2024-02-05T02:25:57
1917 llvm-aarch64-master-O3:239801545695209356 execution_variation 510.parest_r (max) (percentage) 0205 (llvmorg-19-init-01406-g9a5fb74fd162), 0206 (llvmorg-19-init-01407-gd193ac4f7180) 0.540.76 40.74% 0.54 35.00% 2024-02-05T02:25:57
1918 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (avg) (percentage) 0205 (llvmorg-19-init-01406-g9a5fb74fd162), 0206 (llvmorg-19-init-01407-gd193ac4f7180) 0.60.62 3.33% 0.51 -15.00% 2024-02-05T02:25:57
1919 llvm-aarch64-master-O3:239801545695209356 execution_variation 523.xalancbmk_r (unexplained diff vs previous) 0205 (llvmorg-19-init-01406-g9a5fb74fd162), 0206 (llvmorg-19-init-01407-gd193ac4f7180) 9.038.0 322.22% 2.0 0.00% 2024-02-05T02:25:57
1920 llvm-aarch64-master-O3:239801545695209356 execution_variation 525.x264_r (unexplained diff vs previous) 0205 (llvmorg-19-init-01406-g9a5fb74fd162), 0206 (llvmorg-19-init-01407-gd193ac4f7180) 4.03.0 -25.00% 1.0 0.00% 2024-02-05T02:25:57
1921 llvm-aarch64-master-O3:239801545695209356 execution_variation 510.parest_r (avg) (percentage) 0205 (llvmorg-19-init-01406-g9a5fb74fd162), 0206 (llvmorg-19-init-01407-gd193ac4f7180) 0.370.38 2.70% 0.33 -2.94% 2024-02-05T02:25:57
1922 llvm-aarch64-master-O3:239801545695209356 execution_variation 503.bwaves_r (avg) (percentage) 0205 (llvmorg-19-init-01406-g9a5fb74fd162), 0206 (llvmorg-19-init-01407-gd193ac4f7180) 0.390.43 10.26% 0.32 -13.51% 2024-02-05T02:25:57
1923 llvm-aarch64-master-O3:239801545695209356 execution_variation 510.parest_r (max) 0205 (llvmorg-19-init-01406-g9a5fb74fd162), 0206 (llvmorg-19-init-01407-gd193ac4f7180) 17.023.0 35.29% 16.0 33.33% 2024-02-05T02:25:57
1924 llvm-aarch64-master-O3:239801545695209356 execution_variation 541.leela_r (max) 0205 (llvmorg-19-init-01406-g9a5fb74fd162), 0206 (llvmorg-19-init-01407-gd193ac4f7180) 14.013.0 -7.14% 11.0 -21.43% 2024-02-05T02:25:57
1926 llvm-aarch64-master-O3:239801545695209356 execution_variation 525.x264_r (unexplained diff vs previous) (percentage) 0205 (llvmorg-19-init-01406-g9a5fb74fd162), 0206 (llvmorg-19-init-01407-gd193ac4f7180) 0.320.24 -25.00% 0.08 0.00% 2024-02-05T02:25:57
1927 llvm-aarch64-master-O3:239801545695209356 execution_variation 531.deepsjeng_r (unexplained diff vs previous) 0205 (llvmorg-19-init-01406-g9a5fb74fd162), 0206 (llvmorg-19-init-01407-gd193ac4f7180) 9.08.0 -11.11% 2.0 0.00% 2024-02-05T02:25:57
1928 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (max) (percentage) 0205 (llvmorg-19-init-01406-g9a5fb74fd162), 0206 (llvmorg-19-init-01407-gd193ac4f7180) 0.530.6 13.21% 0.98 104.17% 2024-02-05T02:25:57
1929 llvm-aarch64-master-O3:239801545695209356 execution_variation 523.xalancbmk_r (avg) 0205 (llvmorg-19-init-01406-g9a5fb74fd162), 0206 (llvmorg-19-init-01407-gd193ac4f7180) 13.012.0 -7.69% 11.0 22.22% 2024-02-05T02:25:57
1930 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (max) 0205 (llvmorg-19-init-01406-g9a5fb74fd162), 0206 (llvmorg-19-init-01407-gd193ac4f7180) 298.0286.0 -4.03% 70.0 -76.51% 2024-02-05T02:25:57
1932 llvm-aarch64-master-O3:239801545695209356 execution_variation 531.deepsjeng_r (unexplained diff vs previous) (percentage) 0205 (llvmorg-19-init-01406-g9a5fb74fd162), 0206 (llvmorg-19-init-01407-gd193ac4f7180) 0.320.28 -12.50% 0.07 0.00% 2024-02-05T02:25:57
1933 llvm-aarch64-master-O3:239801545695209356 execution_variation 510.parest_r (unexplained diff vs previous) 0205 (llvmorg-19-init-01406-g9a5fb74fd162), 0206 (llvmorg-19-init-01407-gd193ac4f7180) 17.024.0 41.18% 17.0 41.67% 2024-02-05T02:25:57
1934 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (unexplained diff vs previous) (percentage) 0205 (llvmorg-19-init-01406-g9a5fb74fd162), 0206 (llvmorg-19-init-01407-gd193ac4f7180) 1.581.76 11.39% 0.77 -49.34% 2024-02-05T02:25:57
1935 llvm-aarch64-master-O3:239801545695209356 execution_variation 523.xalancbmk_r (avg) (percentage) 0205 (llvmorg-19-init-01406-g9a5fb74fd162), 0206 (llvmorg-19-init-01407-gd193ac4f7180) 0.620.59 -4.84% 0.55 22.22% 2024-02-05T02:25:57
1936 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (avg) (percentage) 0205 (llvmorg-19-init-01406-g9a5fb74fd162), 0206 (llvmorg-19-init-01407-gd193ac4f7180) 1.191.24 4.20% 0.87 -26.89% 2024-02-05T02:25:57
1937 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (max) (percentage) 0205 (llvmorg-19-init-01406-g9a5fb74fd162), 0206 (llvmorg-19-init-01407-gd193ac4f7180) 2.62.49 -4.23% 0.95 -63.46% 2024-02-05T02:25:57
1938 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r 0205 (llvmorg-19-init-01406-g9a5fb74fd162), 0206 (llvmorg-19-init-01407-gd193ac4f7180) 20.021.0 5.00% 17.0 -15.00% 2024-02-05T02:25:57
1939 llvm-aarch64-master-O3:239801545695209356 execution_variation 549.fotonik3d_r (max) 0205 (llvmorg-19-init-01406-g9a5fb74fd162), 0206 (llvmorg-19-init-01407-gd193ac4f7180) 57.052.0 -8.77% 57.0 0.00% 2024-02-05T02:25:57
1940 llvm-aarch64-master-O3:239801545695209356 execution_variation 541.leela_r (avg) (percentage) 0205 (llvmorg-19-init-01406-g9a5fb74fd162), 0206 (llvmorg-19-init-01407-gd193ac4f7180) 0.280.27 -3.57% 0.23 -20.69% 2024-02-05T02:25:57
1941 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r (avg) (percentage) 0205 (llvmorg-19-init-01406-g9a5fb74fd162), 0206 (llvmorg-19-init-01407-gd193ac4f7180) 0.580.72 24.14% 0.39 -29.09% 2024-02-05T02:25:57
1942 llvm-aarch64-master-O3:239801545695209356 execution_variation 549.fotonik3d_r (avg) 0205 (llvmorg-19-init-01406-g9a5fb74fd162), 0206 (llvmorg-19-init-01407-gd193ac4f7180) 36.035.0 -2.78% 20.0 -45.95% 2024-02-05T02:25:57
1943 llvm-aarch64-master-O3:239801545695209356 execution_variation 503.bwaves_r 0205 (llvmorg-19-init-01406-g9a5fb74fd162), 0206 (llvmorg-19-init-01407-gd193ac4f7180) 7.08.0 14.29% 6.0 -14.29% 2024-02-05T02:25:57
1944 llvm-aarch64-master-O3:239801545695209356 execution_variation 525.x264_r (avg) (percentage) 0205 (llvmorg-19-init-01406-g9a5fb74fd162), 0206 (llvmorg-19-init-01407-gd193ac4f7180) 0.380.39 2.63% 0.36 -10.00% 2024-02-05T02:25:57
1945 llvm-aarch64-master-O3:239801545695209356 execution_variation 523.xalancbmk_r (unexplained diff vs previous) (percentage) 0205 (llvmorg-19-init-01406-g9a5fb74fd162), 0206 (llvmorg-19-init-01407-gd193ac4f7180) 0.421.74 314.29% 0.09 0.00% 2024-02-05T02:25:57
1946 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (avg) 0205 (llvmorg-19-init-01406-g9a5fb74fd162), 0206 (llvmorg-19-init-01407-gd193ac4f7180) 119.0116.0 -2.52% 139.0 25.23% 2024-02-05T02:25:57
1947 llvm-aarch64-master-O3:239801545695209356 execution_variation 557.xz_r (unexplained diff vs previous) (percentage) 0205 (llvmorg-19-init-01406-g9a5fb74fd162), 0206 (llvmorg-19-init-01407-gd193ac4f7180) 0.140.16 14.29% 0.3 400.00% 2024-02-05T02:25:57
1948 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r 0205 (llvmorg-19-init-01406-g9a5fb74fd162), 0206 (llvmorg-19-init-01407-gd193ac4f7180) 25.027.0 8.00% 19.0 -24.00% 2024-02-05T02:25:57
1949 llvm-aarch64-master-O3:239801545695209356 execution_variation 508.namd_r (max) (percentage) 0205 (llvmorg-19-init-01406-g9a5fb74fd162), 0206 (llvmorg-19-init-01407-gd193ac4f7180) 0.770.69 -10.39% 0.55 -28.57% 2024-02-05T02:25:57
1950 llvm-aarch64-master-O3:239801545695209356 execution_variation 525.x264_r (max) (percentage) 0205 (llvmorg-19-init-01406-g9a5fb74fd162), 0206 (llvmorg-19-init-01407-gd193ac4f7180) 0.530.52 -1.89% 0.69 25.45% 2024-02-05T02:25:57
1951 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r (unexplained diff vs previous) (percentage) 0205 (llvmorg-19-init-01406-g9a5fb74fd162), 0206 (llvmorg-19-init-01407-gd193ac4f7180) 1.142.72 138.60% 0.45 73.08% 2024-02-05T02:25:57
1952 llvm-aarch64-master-O3:239801545695209356 execution_variation 526.blender_r (unexplained diff vs previous) 0205 (llvmorg-19-init-01406-g9a5fb74fd162), 0206 (llvmorg-19-init-01407-gd193ac4f7180) 6.03.0 -50.00% 0.0 0.00% 2024-02-05T02:25:57
1953 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (max) 0205 (llvmorg-19-init-01406-g9a5fb74fd162), 0206 (llvmorg-19-init-01407-gd193ac4f7180) 16.019.0 18.75% 32.0 113.33% 2024-02-05T02:25:57
1954 llvm-aarch64-master-O3:239801545695209356 execution_variation 541.leela_r (max) (percentage) 0205 (llvmorg-19-init-01406-g9a5fb74fd162), 0206 (llvmorg-19-init-01407-gd193ac4f7180) 0.410.37 -9.76% 0.34 -19.05% 2024-02-05T02:25:57
1955 llvm-aarch64-master-O3:239801545695209356 execution_variation 526.blender_r (avg) (percentage) 0205 (llvmorg-19-init-01406-g9a5fb74fd162), 0206 (llvmorg-19-init-01407-gd193ac4f7180) 0.540.52 -3.70% 0.66 11.86% 2024-02-05T02:25:57
1956 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r 0205 (llvmorg-19-init-01406-g9a5fb74fd162), 0206 (llvmorg-19-init-01407-gd193ac4f7180) 119.0116.0 -2.52% 139.0 25.23% 2024-02-05T02:25:57
1957 llvm-aarch64-master-O3:239801545695209356 execution_variation 510.parest_r (unexplained diff vs previous) (percentage) 0205 (llvmorg-19-init-01406-g9a5fb74fd162), 0206 (llvmorg-19-init-01407-gd193ac4f7180) 0.540.77 42.59% 0.55 44.74% 2024-02-05T02:25:57
1958 llvm-aarch64-master-O3:239801545695209356 execution_variation 523.xalancbmk_r (max) 0205 (llvmorg-19-init-01406-g9a5fb74fd162), 0206 (llvmorg-19-init-01407-gd193ac4f7180) 18.038.0 111.11% 8.0 0.00% 2024-02-05T02:25:57
1959 llvm-aarch64-master-O3:239801545695209356 execution_variation 503.bwaves_r (unexplained diff vs previous) 0205 (llvmorg-19-init-01406-g9a5fb74fd162), 0206 (llvmorg-19-init-01407-gd193ac4f7180) 18.016.0 -11.11% 2.0 -88.89% 2024-02-05T02:25:57
1960 llvm-aarch64-master-O3:239801545695209356 execution_variation 531.deepsjeng_r (max) (percentage) 0205 (llvmorg-19-init-01406-g9a5fb74fd162), 0206 (llvmorg-19-init-01407-gd193ac4f7180) 0.30.28 -6.67% 0.07 -65.00% 2024-02-05T02:25:57
1961 llvm-aarch64-master-O3:239801545695209356 execution_variation 508.namd_r (max) 0205 (llvmorg-19-init-01406-g9a5fb74fd162), 0206 (llvmorg-19-init-01407-gd193ac4f7180) 14.012.0 -14.29% 9.0 -35.71% 2024-02-05T02:25:57
Change State Split Delete