Regression: Regression of 48 benchmarks: 500.perlbench_r (max), 500.perlbench_r (max) (percentage), 500.perlbench_r (unexplained dif...



Metric
Order
Δ ID Machine Metric Test Good, Bad OldNew Now Current Age
8971 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (unexplained diff vs previous) (percentage) 0786 (llvmorg-21-init-03347-g9fefc013dbd0), 0789 (llvmorg-21-init-03514-ga0540e6c9897) 0.450.49 8.89% 0.24 -33.33% 2025-02-28T22:16:12
8972 llvm-aarch64-master-O3:239801545695209356 execution_variation 549.fotonik3d_r (max) (percentage) 0786 (llvmorg-21-init-03347-g9fefc013dbd0), 0789 (llvmorg-21-init-03514-ga0540e6c9897) 2.712.35 -13.28% 3.34 212.15% 2025-02-28T22:16:12
8973 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (unexplained diff vs previous) 0786 (llvmorg-21-init-03347-g9fefc013dbd0), 0789 (llvmorg-21-init-03514-ga0540e6c9897) 25.029.0 16.00% 17.0 -29.17% 2025-02-28T22:16:12
8974 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (max) 0786 (llvmorg-21-init-03347-g9fefc013dbd0), 0789 (llvmorg-21-init-03514-ga0540e6c9897) 18.024.0 33.33% 18.0 28.57% 2025-02-28T22:16:12
8975 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (unexplained diff vs previous) 0786 (llvmorg-21-init-03347-g9fefc013dbd0), 0789 (llvmorg-21-init-03514-ga0540e6c9897) 19.013.0 -31.58% 69.0 -80.62% 2025-02-28T22:16:12
8976 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (max) 0786 (llvmorg-21-init-03347-g9fefc013dbd0), 0789 (llvmorg-21-init-03514-ga0540e6c9897) 35.034.0 -2.86% 20.0 -42.86% 2025-02-28T22:16:12
8977 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (unexplained diff vs previous) (percentage) 0786 (llvmorg-21-init-03347-g9fefc013dbd0), 0789 (llvmorg-21-init-03514-ga0540e6c9897) 0.50.7 40.00% 0.55 175.00% 2025-02-28T22:16:12
8978 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (max) (percentage) 0786 (llvmorg-21-init-03347-g9fefc013dbd0), 0789 (llvmorg-21-init-03514-ga0540e6c9897) 0.550.7 27.27% 0.55 30.95% 2025-02-28T22:16:12
8979 llvm-aarch64-master-O3:239801545695209356 execution_variation 503.bwaves_r (max) (percentage) 0786 (llvmorg-21-init-03347-g9fefc013dbd0), 0789 (llvmorg-21-init-03514-ga0540e6c9897) 0.510.55 7.84% 0.57 103.57% 2025-02-28T22:16:12
8980 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (max) (percentage) 0786 (llvmorg-21-init-03347-g9fefc013dbd0), 0789 (llvmorg-21-init-03514-ga0540e6c9897) 9.09.28 3.11% 2.43 -78.19% 2025-02-28T22:16:12
8981 llvm-aarch64-master-O3:239801545695209356 execution_variation 503.bwaves_r (unexplained diff vs previous) (percentage) 0786 (llvmorg-21-init-03347-g9fefc013dbd0), 0789 (llvmorg-21-init-03514-ga0540e6c9897) 0.510.56 9.80% 0.09 -60.87% 2025-02-28T22:16:12
8982 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r (max) (percentage) 0786 (llvmorg-21-init-03347-g9fefc013dbd0), 0789 (llvmorg-21-init-03514-ga0540e6c9897) 0.450.5 11.11% 0.44 -21.43% 2025-02-28T22:16:12
8983 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r (max) 0786 (llvmorg-21-init-03347-g9fefc013dbd0), 0789 (llvmorg-21-init-03514-ga0540e6c9897) 12.013.0 8.33% 11.0 -21.43% 2025-02-28T22:16:12
8984 llvm-aarch64-master-O3:239801545695209356 execution_variation 523.xalancbmk_r (max) (percentage) 0786 (llvmorg-21-init-03347-g9fefc013dbd0), 0789 (llvmorg-21-init-03514-ga0540e6c9897) 0.160.19 18.75% 0.42 162.50% 2025-02-28T22:16:12
8985 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (unexplained diff vs previous) 0786 (llvmorg-21-init-03347-g9fefc013dbd0), 0789 (llvmorg-21-init-03514-ga0540e6c9897) 17.024.0 41.18% 19.0 171.43% 2025-02-28T22:16:12
8986 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r (unexplained diff vs previous) 0786 (llvmorg-21-init-03347-g9fefc013dbd0), 0789 (llvmorg-21-init-03514-ga0540e6c9897) 12.011.0 -8.33% 12.0 -20.00% 2025-02-28T22:16:12
8987 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (unexplained diff vs previous) (percentage) 0786 (llvmorg-21-init-03347-g9fefc013dbd0), 0789 (llvmorg-21-init-03514-ga0540e6c9897) 0.680.46 -32.35% 2.38 -81.02% 2025-02-28T22:16:12
8988 llvm-aarch64-master-O3:239801545695209356 execution_variation 510.parest_r (max) (percentage) 0786 (llvmorg-21-init-03347-g9fefc013dbd0), 0789 (llvmorg-21-init-03514-ga0540e6c9897) 0.70.65 -7.14% 0.54 -27.03% 2025-02-28T22:16:12
8989 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (unexplained diff vs previous) 0786 (llvmorg-21-init-03347-g9fefc013dbd0), 0789 (llvmorg-21-init-03514-ga0540e6c9897) 15.016.0 6.67% 8.0 -33.33% 2025-02-28T22:16:12
8990 llvm-aarch64-master-O3:239801545695209356 execution_variation 525.x264_r (unexplained diff vs previous) 0786 (llvmorg-21-init-03347-g9fefc013dbd0), 0789 (llvmorg-21-init-03514-ga0540e6c9897) 2.03.0 50.00% 1.0 0.00% 2025-02-28T22:16:12
8991 llvm-aarch64-master-O3:239801545695209356 execution_variation 538.imagick_r (max) 0786 (llvmorg-21-init-03347-g9fefc013dbd0), 0789 (llvmorg-21-init-03514-ga0540e6c9897) 5.04.0 -20.00% 5.0 0.00% 2025-02-28T22:16:12
8992 llvm-aarch64-master-O3:239801545695209356 execution_variation 510.parest_r (max) 0786 (llvmorg-21-init-03347-g9fefc013dbd0), 0789 (llvmorg-21-init-03514-ga0540e6c9897) 21.020.0 -4.76% 16.0 -30.43% 2025-02-28T22:16:12
8993 llvm-aarch64-master-O3:239801545695209356 execution_variation 541.leela_r (unexplained diff vs previous) 0786 (llvmorg-21-init-03347-g9fefc013dbd0), 0789 (llvmorg-21-init-03514-ga0540e6c9897) 6.05.0 -16.67% 12.0 20.00% 2025-02-28T22:16:12
8994 llvm-aarch64-master-O3:239801545695209356 execution_variation 541.leela_r (max) 0786 (llvmorg-21-init-03347-g9fefc013dbd0), 0789 (llvmorg-21-init-03514-ga0540e6c9897) 10.08.0 -20.00% 11.0 10.00% 2025-02-28T22:16:12
8995 llvm-aarch64-master-O3:239801545695209356 execution_variation 525.x264_r (unexplained diff vs previous) (percentage) 0786 (llvmorg-21-init-03347-g9fefc013dbd0), 0789 (llvmorg-21-init-03514-ga0540e6c9897) 0.170.25 47.06% 0.08 0.00% 2025-02-28T22:16:12
8996 llvm-aarch64-master-O3:239801545695209356 execution_variation 531.deepsjeng_r (unexplained diff vs previous) 0786 (llvmorg-21-init-03347-g9fefc013dbd0), 0789 (llvmorg-21-init-03514-ga0540e6c9897) 2.01.0 -50.00% 2.0 0.00% 2025-02-28T22:16:12
8997 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (max) (percentage) 0786 (llvmorg-21-init-03347-g9fefc013dbd0), 0789 (llvmorg-21-init-03514-ga0540e6c9897) 0.460.49 6.52% 0.98 145.00% 2025-02-28T22:16:12
8998 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (max) 0786 (llvmorg-21-init-03347-g9fefc013dbd0), 0789 (llvmorg-21-init-03514-ga0540e6c9897) 254.0262.0 3.15% 70.0 -77.85% 2025-02-28T22:16:12
8999 llvm-aarch64-master-O3:239801545695209356 execution_variation 531.deepsjeng_r (unexplained diff vs previous) (percentage) 0786 (llvmorg-21-init-03347-g9fefc013dbd0), 0789 (llvmorg-21-init-03514-ga0540e6c9897) 0.070.04 -42.86% 0.07 0.00% 2025-02-28T22:16:12
9000 llvm-aarch64-master-O3:239801545695209356 execution_variation 510.parest_r (unexplained diff vs previous) 0786 (llvmorg-21-init-03347-g9fefc013dbd0), 0789 (llvmorg-21-init-03514-ga0540e6c9897) 10.013.0 30.00% 17.0 -26.09% 2025-02-28T22:16:12
9001 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (unexplained diff vs previous) (percentage) 0786 (llvmorg-21-init-03347-g9fefc013dbd0), 0789 (llvmorg-21-init-03514-ga0540e6c9897) 1.151.31 13.91% 0.77 -30.00% 2025-02-28T22:16:12
9002 llvm-aarch64-master-O3:239801545695209356 execution_variation 523.xalancbmk_r (avg) (percentage) 0786 (llvmorg-21-init-03347-g9fefc013dbd0), 0789 (llvmorg-21-init-03514-ga0540e6c9897) 0.590.58 -1.69% 0.55 -6.78% 2025-02-28T22:16:12
9003 llvm-aarch64-master-O3:239801545695209356 execution_variation 521.wrf_r (max) (percentage) 0786 (llvmorg-21-init-03347-g9fefc013dbd0), 0789 (llvmorg-21-init-03514-ga0540e6c9897) 2.432.4 -1.23% 2.29 -5.76% 2025-02-28T22:16:12
9004 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (avg) (percentage) 0786 (llvmorg-21-init-03347-g9fefc013dbd0), 0789 (llvmorg-21-init-03514-ga0540e6c9897) 0.870.88 1.15% 0.87 0.00% 2025-02-28T22:16:12
9005 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (max) (percentage) 0786 (llvmorg-21-init-03347-g9fefc013dbd0), 0789 (llvmorg-21-init-03514-ga0540e6c9897) 1.621.55 -4.32% 0.95 -41.36% 2025-02-28T22:16:12
9006 llvm-aarch64-master-O3:239801545695209356 execution_variation 549.fotonik3d_r (max) 0786 (llvmorg-21-init-03347-g9fefc013dbd0), 0789 (llvmorg-21-init-03514-ga0540e6c9897) 45.040.0 -11.11% 57.0 216.67% 2025-02-28T22:16:12
9007 llvm-aarch64-master-O3:239801545695209356 execution_variation 541.leela_r (unexplained diff vs previous) (percentage) 0786 (llvmorg-21-init-03347-g9fefc013dbd0), 0789 (llvmorg-21-init-03514-ga0540e6c9897) 0.170.14 -17.65% 0.34 17.24% 2025-02-28T22:16:12
9008 llvm-aarch64-master-O3:239801545695209356 execution_variation 525.x264_r (max) (percentage) 0786 (llvmorg-21-init-03347-g9fefc013dbd0), 0789 (llvmorg-21-init-03514-ga0540e6c9897) 0.30.28 -6.67% 0.69 130.00% 2025-02-28T22:16:12
9009 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r (unexplained diff vs previous) (percentage) 0786 (llvmorg-21-init-03347-g9fefc013dbd0), 0789 (llvmorg-21-init-03514-ga0540e6c9897) 0.370.41 10.81% 0.45 -19.64% 2025-02-28T22:16:12
9010 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (max) 0786 (llvmorg-21-init-03347-g9fefc013dbd0), 0789 (llvmorg-21-init-03514-ga0540e6c9897) 15.016.0 6.67% 32.0 146.15% 2025-02-28T22:16:12
9011 llvm-aarch64-master-O3:239801545695209356 execution_variation 549.fotonik3d_r (unexplained diff vs previous) (percentage) 0786 (llvmorg-21-init-03347-g9fefc013dbd0), 0789 (llvmorg-21-init-03514-ga0540e6c9897) 2.252.29 1.78% 3.23 361.43% 2025-02-28T22:16:12
9012 llvm-aarch64-master-O3:239801545695209356 execution_variation 541.leela_r (max) (percentage) 0786 (llvmorg-21-init-03347-g9fefc013dbd0), 0789 (llvmorg-21-init-03514-ga0540e6c9897) 0.290.24 -17.24% 0.34 9.68% 2025-02-28T22:16:12
9013 llvm-aarch64-master-O3:239801545695209356 execution_variation 549.fotonik3d_r (unexplained diff vs previous) 0786 (llvmorg-21-init-03347-g9fefc013dbd0), 0789 (llvmorg-21-init-03514-ga0540e6c9897) 38.040.0 5.26% 56.0 366.67% 2025-02-28T22:16:12
9014 llvm-aarch64-master-O3:239801545695209356 execution_variation 510.parest_r (unexplained diff vs previous) (percentage) 0786 (llvmorg-21-init-03347-g9fefc013dbd0), 0789 (llvmorg-21-init-03514-ga0540e6c9897) 0.320.42 31.25% 0.55 -24.66% 2025-02-28T22:16:12
9015 llvm-aarch64-master-O3:239801545695209356 execution_variation 523.xalancbmk_r (max) 0786 (llvmorg-21-init-03347-g9fefc013dbd0), 0789 (llvmorg-21-init-03514-ga0540e6c9897) 3.04.0 33.33% 8.0 166.67% 2025-02-28T22:16:12
9016 llvm-aarch64-master-O3:239801545695209356 execution_variation 503.bwaves_r (unexplained diff vs previous) 0786 (llvmorg-21-init-03347-g9fefc013dbd0), 0789 (llvmorg-21-init-03514-ga0540e6c9897) 11.012.0 9.09% 2.0 -60.00% 2025-02-28T22:16:12
9017 llvm-aarch64-master-O3:239801545695209356 execution_variation 531.deepsjeng_r (max) (percentage) 0786 (llvmorg-21-init-03347-g9fefc013dbd0), 0789 (llvmorg-21-init-03514-ga0540e6c9897) 0.160.15 -6.25% 0.07 -56.25% 2025-02-28T22:16:12
9018 llvm-aarch64-master-O3:239801545695209356 execution_variation 538.imagick_r (max) (percentage) 0786 (llvmorg-21-init-03347-g9fefc013dbd0), 0789 (llvmorg-21-init-03514-ga0540e6c9897) 0.160.14 -12.50% 0.15 -6.25% 2025-02-28T22:16:12
Change State Split Delete