Regression: Regression of 44 benchmarks: 500.perlbench_r (max), 500.perlbench_r (max) (percentage), 500.perlbench_r (unexplained dif...



Metric
Order
Δ ID Machine Metric Test Good, Bad OldNew Now Current Age
8927 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (unexplained diff vs previous) (percentage) 0785 (llvmorg-21-init-03346-gb2152823e003), 0786 (llvmorg-21-init-03347-g9fefc013dbd0) 0.340.36 5.88% 0.24 -46.67% 2025-02-27T18:02:28
8928 llvm-aarch64-master-O3:239801545695209356 execution_variation 521.wrf_r (max) 0785 (llvmorg-21-init-03346-gb2152823e003), 0786 (llvmorg-21-init-03347-g9fefc013dbd0) 40.039.0 -2.50% 36.0 -5.26% 2025-02-27T18:02:28
8929 llvm-aarch64-master-O3:239801545695209356 execution_variation 549.fotonik3d_r (max) (percentage) 0785 (llvmorg-21-init-03346-gb2152823e003), 0786 (llvmorg-21-init-03347-g9fefc013dbd0) 1.121.07 -4.46% 3.34 198.21% 2025-02-27T18:02:28
8930 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (unexplained diff vs previous) 0785 (llvmorg-21-init-03346-gb2152823e003), 0786 (llvmorg-21-init-03347-g9fefc013dbd0) 25.024.0 -4.00% 17.0 -19.05% 2025-02-27T18:02:28
8931 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (max) 0785 (llvmorg-21-init-03346-gb2152823e003), 0786 (llvmorg-21-init-03347-g9fefc013dbd0) 12.014.0 16.67% 18.0 5.88% 2025-02-27T18:02:28
8932 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (unexplained diff vs previous) 0785 (llvmorg-21-init-03346-gb2152823e003), 0786 (llvmorg-21-init-03347-g9fefc013dbd0) 369.0356.0 -3.52% 69.0 -77.67% 2025-02-27T18:02:28
8933 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (max) 0785 (llvmorg-21-init-03346-gb2152823e003), 0786 (llvmorg-21-init-03347-g9fefc013dbd0) 37.035.0 -5.41% 20.0 -45.95% 2025-02-27T18:02:28
8934 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (unexplained diff vs previous) (percentage) 0785 (llvmorg-21-init-03346-gb2152823e003), 0786 (llvmorg-21-init-03347-g9fefc013dbd0) 0.290.2 -31.03% 0.55 10.00% 2025-02-27T18:02:28
8935 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (max) (percentage) 0785 (llvmorg-21-init-03346-gb2152823e003), 0786 (llvmorg-21-init-03347-g9fefc013dbd0) 0.380.42 10.53% 0.55 10.00% 2025-02-27T18:02:28
8936 llvm-aarch64-master-O3:239801545695209356 execution_variation 526.blender_r (unexplained diff vs previous) (percentage) 0785 (llvmorg-21-init-03346-gb2152823e003), 0786 (llvmorg-21-init-03347-g9fefc013dbd0) 0.550.5 -9.09% 0.0 0.00% 2025-02-27T18:02:28
8937 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (max) (percentage) 0785 (llvmorg-21-init-03346-gb2152823e003), 0786 (llvmorg-21-init-03347-g9fefc013dbd0) 10.8911.14 2.30% 2.43 -77.31% 2025-02-27T18:02:28
8938 llvm-aarch64-master-O3:239801545695209356 execution_variation 508.namd_r (unexplained diff vs previous) (percentage) 0785 (llvmorg-21-init-03346-gb2152823e003), 0786 (llvmorg-21-init-03347-g9fefc013dbd0) 0.490.44 -10.20% 0.11 -77.55% 2025-02-27T18:02:28
8939 llvm-aarch64-master-O3:239801545695209356 execution_variation 508.namd_r (unexplained diff vs previous) 0785 (llvmorg-21-init-03346-gb2152823e003), 0786 (llvmorg-21-init-03347-g9fefc013dbd0) 9.08.0 -11.11% 2.0 -77.78% 2025-02-27T18:02:28
8940 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (avg) (percentage) 0785 (llvmorg-21-init-03346-gb2152823e003), 0786 (llvmorg-21-init-03347-g9fefc013dbd0) 5.015.09 1.60% 4.81 -3.99% 2025-02-27T18:02:28
8941 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r (max) 0785 (llvmorg-21-init-03346-gb2152823e003), 0786 (llvmorg-21-init-03347-g9fefc013dbd0) 15.014.0 -6.67% 11.0 37.50% 2025-02-27T18:02:28
8942 llvm-aarch64-master-O3:239801545695209356 execution_variation 523.xalancbmk_r (max) (percentage) 0785 (llvmorg-21-init-03346-gb2152823e003), 0786 (llvmorg-21-init-03347-g9fefc013dbd0) 0.390.16 -58.97% 0.42 7.69% 2025-02-27T18:02:28
8943 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (unexplained diff vs previous) 0785 (llvmorg-21-init-03346-gb2152823e003), 0786 (llvmorg-21-init-03347-g9fefc013dbd0) 10.07.0 -30.00% 19.0 11.76% 2025-02-27T18:02:28
8944 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r (unexplained diff vs previous) 0785 (llvmorg-21-init-03346-gb2152823e003), 0786 (llvmorg-21-init-03347-g9fefc013dbd0) 12.015.0 25.00% 12.0 200.00% 2025-02-27T18:02:28
8945 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (unexplained diff vs previous) (percentage) 0785 (llvmorg-21-init-03346-gb2152823e003), 0786 (llvmorg-21-init-03347-g9fefc013dbd0) 12.0812.54 3.81% 2.38 -75.39% 2025-02-27T18:02:28
8946 llvm-aarch64-master-O3:239801545695209356 execution_variation 510.parest_r (max) (percentage) 0785 (llvmorg-21-init-03346-gb2152823e003), 0786 (llvmorg-21-init-03347-g9fefc013dbd0) 0.70.74 5.71% 0.54 10.20% 2025-02-27T18:02:28
8947 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (unexplained diff vs previous) 0785 (llvmorg-21-init-03346-gb2152823e003), 0786 (llvmorg-21-init-03347-g9fefc013dbd0) 11.012.0 9.09% 8.0 -46.67% 2025-02-27T18:02:28
8948 llvm-aarch64-master-O3:239801545695209356 execution_variation 510.parest_r (max) 0785 (llvmorg-21-init-03346-gb2152823e003), 0786 (llvmorg-21-init-03347-g9fefc013dbd0) 21.023.0 9.52% 16.0 6.67% 2025-02-27T18:02:28
8949 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (max) (percentage) 0785 (llvmorg-21-init-03346-gb2152823e003), 0786 (llvmorg-21-init-03347-g9fefc013dbd0) 0.460.4 -13.04% 0.98 113.04% 2025-02-27T18:02:28
8950 llvm-aarch64-master-O3:239801545695209356 execution_variation 526.blender_r (max) (percentage) 0785 (llvmorg-21-init-03346-gb2152823e003), 0786 (llvmorg-21-init-03347-g9fefc013dbd0) 0.480.5 4.17% 0.59 195.00% 2025-02-27T18:02:28
8951 llvm-aarch64-master-O3:239801545695209356 execution_variation 510.parest_r (unexplained diff vs previous) 0785 (llvmorg-21-init-03346-gb2152823e003), 0786 (llvmorg-21-init-03347-g9fefc013dbd0) 22.023.0 4.55% 17.0 183.33% 2025-02-27T18:02:28
8952 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (unexplained diff vs previous) (percentage) 0785 (llvmorg-21-init-03346-gb2152823e003), 0786 (llvmorg-21-init-03347-g9fefc013dbd0) 1.151.1 -4.35% 0.77 -18.95% 2025-02-27T18:02:28
8953 llvm-aarch64-master-O3:239801545695209356 execution_variation 523.xalancbmk_r (avg) (percentage) 0785 (llvmorg-21-init-03346-gb2152823e003), 0786 (llvmorg-21-init-03347-g9fefc013dbd0) 0.60.59 -1.67% 0.55 -8.33% 2025-02-27T18:02:28
8954 llvm-aarch64-master-O3:239801545695209356 execution_variation 521.wrf_r (max) (percentage) 0785 (llvmorg-21-init-03346-gb2152823e003), 0786 (llvmorg-21-init-03347-g9fefc013dbd0) 2.462.43 -1.22% 2.29 -6.91% 2025-02-27T18:02:28
8955 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (max) (percentage) 0785 (llvmorg-21-init-03346-gb2152823e003), 0786 (llvmorg-21-init-03347-g9fefc013dbd0) 1.711.62 -5.26% 0.95 -44.44% 2025-02-27T18:02:28
8956 llvm-aarch64-master-O3:239801545695209356 execution_variation 557.xz_r (max) (percentage) 0785 (llvmorg-21-init-03346-gb2152823e003), 0786 (llvmorg-21-init-03347-g9fefc013dbd0) 0.110.13 18.18% 0.3 275.00% 2025-02-27T18:02:28
8957 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (avg) 0785 (llvmorg-21-init-03346-gb2152823e003), 0786 (llvmorg-21-init-03347-g9fefc013dbd0) 142.0144.0 1.41% 139.0 -13.12% 2025-02-27T18:02:28
8958 llvm-aarch64-master-O3:239801545695209356 execution_variation 508.namd_r (max) (percentage) 0785 (llvmorg-21-init-03346-gb2152823e003), 0786 (llvmorg-21-init-03347-g9fefc013dbd0) 0.430.44 2.33% 0.55 12.24% 2025-02-27T18:02:28
8959 llvm-aarch64-master-O3:239801545695209356 execution_variation 525.x264_r (max) (percentage) 0785 (llvmorg-21-init-03346-gb2152823e003), 0786 (llvmorg-21-init-03347-g9fefc013dbd0) 0.330.3 -9.09% 0.69 109.09% 2025-02-27T18:02:28
8960 llvm-aarch64-master-O3:239801545695209356 execution_variation 526.blender_r (unexplained diff vs previous) 0785 (llvmorg-21-init-03346-gb2152823e003), 0786 (llvmorg-21-init-03347-g9fefc013dbd0) 11.010.0 -9.09% 0.0 0.00% 2025-02-27T18:02:28
8961 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r (unexplained diff vs previous) (percentage) 0785 (llvmorg-21-init-03346-gb2152823e003), 0786 (llvmorg-21-init-03347-g9fefc013dbd0) 0.450.56 24.44% 0.45 200.00% 2025-02-27T18:02:28
8962 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (max) 0785 (llvmorg-21-init-03346-gb2152823e003), 0786 (llvmorg-21-init-03347-g9fefc013dbd0) 15.013.0 -13.33% 32.0 113.33% 2025-02-27T18:02:28
8963 llvm-aarch64-master-O3:239801545695209356 execution_variation 549.fotonik3d_r (unexplained diff vs previous) (percentage) 0785 (llvmorg-21-init-03346-gb2152823e003), 0786 (llvmorg-21-init-03347-g9fefc013dbd0) 0.420.7 66.67% 3.23 822.86% 2025-02-27T18:02:28
8964 llvm-aarch64-master-O3:239801545695209356 execution_variation 541.leela_r (max) (percentage) 0785 (llvmorg-21-init-03346-gb2152823e003), 0786 (llvmorg-21-init-03347-g9fefc013dbd0) 0.290.31 6.90% 0.34 3.03% 2025-02-27T18:02:28
8965 llvm-aarch64-master-O3:239801545695209356 execution_variation 549.fotonik3d_r (unexplained diff vs previous) 0785 (llvmorg-21-init-03346-gb2152823e003), 0786 (llvmorg-21-init-03347-g9fefc013dbd0) 7.012.0 71.43% 56.0 833.33% 2025-02-27T18:02:28
8966 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r 0785 (llvmorg-21-init-03346-gb2152823e003), 0786 (llvmorg-21-init-03347-g9fefc013dbd0) 142.0144.0 1.41% 139.0 -13.12% 2025-02-27T18:02:28
8967 llvm-aarch64-master-O3:239801545695209356 execution_variation 510.parest_r (unexplained diff vs previous) (percentage) 0785 (llvmorg-21-init-03346-gb2152823e003), 0786 (llvmorg-21-init-03347-g9fefc013dbd0) 0.710.73 2.82% 0.55 189.47% 2025-02-27T18:02:28
8968 llvm-aarch64-master-O3:239801545695209356 execution_variation 523.xalancbmk_r (max) 0785 (llvmorg-21-init-03346-gb2152823e003), 0786 (llvmorg-21-init-03347-g9fefc013dbd0) 8.03.0 -62.50% 8.0 0.00% 2025-02-27T18:02:28
8969 llvm-aarch64-master-O3:239801545695209356 execution_variation 502.gcc_r (max) (percentage) 0785 (llvmorg-21-init-03346-gb2152823e003), 0786 (llvmorg-21-init-03347-g9fefc013dbd0) 0.520.51 -1.92% 0.49 -5.77% 2025-02-27T18:02:28
8970 llvm-aarch64-master-O3:239801545695209356 execution_variation 531.deepsjeng_r (max) (percentage) 0785 (llvmorg-21-init-03346-gb2152823e003), 0786 (llvmorg-21-init-03347-g9fefc013dbd0) 0.170.16 -5.88% 0.07 -58.82% 2025-02-27T18:02:28
Change State Split Delete