Regression: Regression of 54 benchmarks: 500.perlbench_r (max) (percentage), 500.perlbench_r (unexplained diff vs previous), 500.per...



Metric
Order
Δ ID Machine Metric Test Good, Bad OldNew Now Current Age
8575 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (unexplained diff vs previous) (percentage) 0770 (llvmorg-21-init-02371-g5d4998bc02ce), 0771 (llvmorg-21-init-02372-gf5b311e47de0) 0.270.03 -88.89% 0.24 -29.41% 2025-02-11T00:20:26
8576 llvm-aarch64-master-O3:239801545695209356 execution_variation 549.fotonik3d_r (max) (percentage) 0770 (llvmorg-21-init-02371-g5d4998bc02ce), 0771 (llvmorg-21-init-02372-gf5b311e47de0) 4.294.12 -3.96% 3.34 -22.14% 2025-02-11T00:20:26
8577 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (unexplained diff vs previous) 0770 (llvmorg-21-init-02371-g5d4998bc02ce), 0771 (llvmorg-21-init-02372-gf5b311e47de0) 19.018.0 -5.26% 17.0 -32.00% 2025-02-11T00:20:26
8578 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (max) 0770 (llvmorg-21-init-02371-g5d4998bc02ce), 0771 (llvmorg-21-init-02372-gf5b311e47de0) 18.017.0 -5.56% 18.0 0.00% 2025-02-11T00:20:26
8579 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (unexplained diff vs previous) 0770 (llvmorg-21-init-02371-g5d4998bc02ce), 0771 (llvmorg-21-init-02372-gf5b311e47de0) 21.019.0 -9.52% 69.0 -8.00% 2025-02-11T00:20:26
8580 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (max) 0770 (llvmorg-21-init-02371-g5d4998bc02ce), 0771 (llvmorg-21-init-02372-gf5b311e47de0) 19.020.0 5.26% 20.0 -16.67% 2025-02-11T00:20:26
8581 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (unexplained diff vs previous) (percentage) 0770 (llvmorg-21-init-02371-g5d4998bc02ce), 0771 (llvmorg-21-init-02372-gf5b311e47de0) 0.320.44 37.50% 0.55 816.67% 2025-02-11T00:20:26
8582 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (max) (percentage) 0770 (llvmorg-21-init-02371-g5d4998bc02ce), 0771 (llvmorg-21-init-02372-gf5b311e47de0) 0.550.52 -5.45% 0.55 0.00% 2025-02-11T00:20:26
8583 llvm-aarch64-master-O3:239801545695209356 execution_variation 538.imagick_r (unexplained diff vs previous) 0770 (llvmorg-21-init-02371-g5d4998bc02ce), 0771 (llvmorg-21-init-02372-gf5b311e47de0) 3.04.0 33.33% 1.0 0.00% 2025-02-11T00:20:26
8584 llvm-aarch64-master-O3:239801545695209356 execution_variation 503.bwaves_r (max) (percentage) 0770 (llvmorg-21-init-02371-g5d4998bc02ce), 0771 (llvmorg-21-init-02372-gf5b311e47de0) 0.270.28 3.70% 0.57 111.11% 2025-02-11T00:20:26
8585 llvm-aarch64-master-O3:239801545695209356 execution_variation 526.blender_r (unexplained diff vs previous) (percentage) 0770 (llvmorg-21-init-02371-g5d4998bc02ce), 0771 (llvmorg-21-init-02372-gf5b311e47de0) 0.60.55 -8.33% 0.0 0.00% 2025-02-11T00:20:26
8586 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (avg) 0770 (llvmorg-21-init-02371-g5d4998bc02ce), 0771 (llvmorg-21-init-02372-gf5b311e47de0) 18.019.0 5.56% 19.0 5.56% 2025-02-11T00:20:26
8587 llvm-aarch64-master-O3:239801545695209356 execution_variation 508.namd_r (unexplained diff vs previous) (percentage) 0770 (llvmorg-21-init-02371-g5d4998bc02ce), 0771 (llvmorg-21-init-02372-gf5b311e47de0) 0.610.55 -9.84% 0.11 0.00% 2025-02-11T00:20:26
8588 llvm-aarch64-master-O3:239801545695209356 execution_variation 508.namd_r (unexplained diff vs previous) 0770 (llvmorg-21-init-02371-g5d4998bc02ce), 0771 (llvmorg-21-init-02372-gf5b311e47de0) 11.010.0 -9.09% 2.0 0.00% 2025-02-11T00:20:26
8589 llvm-aarch64-master-O3:239801545695209356 execution_variation 503.bwaves_r (unexplained diff vs previous) (percentage) 0770 (llvmorg-21-init-02371-g5d4998bc02ce), 0771 (llvmorg-21-init-02372-gf5b311e47de0) 0.250.28 12.00% 0.09 -35.71% 2025-02-11T00:20:26
8590 llvm-aarch64-master-O3:239801545695209356 execution_variation 503.bwaves_r (max) 0770 (llvmorg-21-init-02371-g5d4998bc02ce), 0771 (llvmorg-21-init-02372-gf5b311e47de0) 7.06.0 -14.29% 12.0 140.00% 2025-02-11T00:20:26
8591 llvm-aarch64-master-O3:239801545695209356 execution_variation 557.xz_r (max) 0770 (llvmorg-21-init-02371-g5d4998bc02ce), 0771 (llvmorg-21-init-02372-gf5b311e47de0) 8.07.0 -12.50% 11.0 37.50% 2025-02-11T00:20:26
8592 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r (max) (percentage) 0770 (llvmorg-21-init-02371-g5d4998bc02ce), 0771 (llvmorg-21-init-02372-gf5b311e47de0) 0.440.45 2.27% 0.44 10.00% 2025-02-11T00:20:26
8593 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (unexplained diff vs previous) 0770 (llvmorg-21-init-02371-g5d4998bc02ce), 0771 (llvmorg-21-init-02372-gf5b311e47de0) 11.015.0 36.36% 19.0 850.00% 2025-02-11T00:20:26
8594 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (unexplained diff vs previous) (percentage) 0770 (llvmorg-21-init-02371-g5d4998bc02ce), 0771 (llvmorg-21-init-02372-gf5b311e47de0) 0.720.68 -5.56% 2.38 -10.53% 2025-02-11T00:20:26
8595 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (unexplained diff vs previous) 0770 (llvmorg-21-init-02371-g5d4998bc02ce), 0771 (llvmorg-21-init-02372-gf5b311e47de0) 9.01.0 -88.89% 8.0 -27.27% 2025-02-11T00:20:26
8596 llvm-aarch64-master-O3:239801545695209356 execution_variation 541.leela_r (unexplained diff vs previous) 0770 (llvmorg-21-init-02371-g5d4998bc02ce), 0771 (llvmorg-21-init-02372-gf5b311e47de0) 19.022.0 15.79% 12.0 1100.00% 2025-02-11T00:20:26
8597 llvm-aarch64-master-O3:239801545695209356 execution_variation 541.leela_r (max) 0770 (llvmorg-21-init-02371-g5d4998bc02ce), 0771 (llvmorg-21-init-02372-gf5b311e47de0) 19.021.0 10.53% 11.0 -8.33% 2025-02-11T00:20:26
8598 llvm-aarch64-master-O3:239801545695209356 execution_variation 531.deepsjeng_r (unexplained diff vs previous) 0770 (llvmorg-21-init-02371-g5d4998bc02ce), 0771 (llvmorg-21-init-02372-gf5b311e47de0) 3.02.0 -33.33% 2.0 -60.00% 2025-02-11T00:20:26
8599 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (max) (percentage) 0770 (llvmorg-21-init-02371-g5d4998bc02ce), 0771 (llvmorg-21-init-02372-gf5b311e47de0) 0.330.31 -6.06% 0.98 196.97% 2025-02-11T00:20:26
8600 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (max) 0770 (llvmorg-21-init-02371-g5d4998bc02ce), 0771 (llvmorg-21-init-02372-gf5b311e47de0) 217.0233.0 7.37% 70.0 -72.44% 2025-02-11T00:20:26
8601 llvm-aarch64-master-O3:239801545695209356 execution_variation 531.deepsjeng_r (unexplained diff vs previous) (percentage) 0770 (llvmorg-21-init-02371-g5d4998bc02ce), 0771 (llvmorg-21-init-02372-gf5b311e47de0) 0.040.07 75.00% 0.07 -61.11% 2025-02-11T00:20:26
8602 llvm-aarch64-master-O3:239801545695209356 execution_variation 526.blender_r (max) (percentage) 0770 (llvmorg-21-init-02371-g5d4998bc02ce), 0771 (llvmorg-21-init-02372-gf5b311e47de0) 0.40.55 37.50% 0.59 47.50% 2025-02-11T00:20:26
8603 llvm-aarch64-master-O3:239801545695209356 execution_variation 510.parest_r (unexplained diff vs previous) 0770 (llvmorg-21-init-02371-g5d4998bc02ce), 0771 (llvmorg-21-init-02372-gf5b311e47de0) 4.03.0 -25.00% 17.0 -10.53% 2025-02-11T00:20:26
8604 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (unexplained diff vs previous) (percentage) 0770 (llvmorg-21-init-02371-g5d4998bc02ce), 0771 (llvmorg-21-init-02372-gf5b311e47de0) 0.860.82 -4.65% 0.77 -33.04% 2025-02-11T00:20:26
8605 llvm-aarch64-master-O3:239801545695209356 execution_variation 526.blender_r (max) 0770 (llvmorg-21-init-02371-g5d4998bc02ce), 0771 (llvmorg-21-init-02372-gf5b311e47de0) 8.010.0 25.00% 11.0 37.50% 2025-02-11T00:20:26
8606 llvm-aarch64-master-O3:239801545695209356 execution_variation 523.xalancbmk_r (avg) (percentage) 0770 (llvmorg-21-init-02371-g5d4998bc02ce), 0771 (llvmorg-21-init-02372-gf5b311e47de0) 0.630.62 -1.59% 0.55 -12.70% 2025-02-11T00:20:26
8607 llvm-aarch64-master-O3:239801545695209356 execution_variation 531.deepsjeng_r (max) 0770 (llvmorg-21-init-02371-g5d4998bc02ce), 0771 (llvmorg-21-init-02372-gf5b311e47de0) 3.04.0 33.33% 1.0 -80.00% 2025-02-11T00:20:26
8608 llvm-aarch64-master-O3:239801545695209356 execution_variation 521.wrf_r (max) (percentage) 0770 (llvmorg-21-init-02371-g5d4998bc02ce), 0771 (llvmorg-21-init-02372-gf5b311e47de0) 2.742.7 -1.46% 2.29 -16.42% 2025-02-11T00:20:26
8609 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (max) (percentage) 0770 (llvmorg-21-init-02371-g5d4998bc02ce), 0771 (llvmorg-21-init-02372-gf5b311e47de0) 0.960.95 -1.04% 0.95 -16.67% 2025-02-11T00:20:26
8610 llvm-aarch64-master-O3:239801545695209356 execution_variation 502.gcc_r (max) 0770 (llvmorg-21-init-02371-g5d4998bc02ce), 0771 (llvmorg-21-init-02372-gf5b311e47de0) 12.011.0 -8.33% 9.0 -25.00% 2025-02-11T00:20:26
8611 llvm-aarch64-master-O3:239801545695209356 execution_variation 549.fotonik3d_r (avg) (percentage) 0770 (llvmorg-21-init-02371-g5d4998bc02ce), 0771 (llvmorg-21-init-02372-gf5b311e47de0) 1.171.21 3.42% 1.21 3.42% 2025-02-11T00:20:26
8612 llvm-aarch64-master-O3:239801545695209356 execution_variation 541.leela_r (avg) (percentage) 0770 (llvmorg-21-init-02371-g5d4998bc02ce), 0771 (llvmorg-21-init-02372-gf5b311e47de0) 0.220.23 4.55% 0.23 4.55% 2025-02-11T00:20:26
8613 llvm-aarch64-master-O3:239801545695209356 execution_variation 557.xz_r (max) (percentage) 0770 (llvmorg-21-init-02371-g5d4998bc02ce), 0771 (llvmorg-21-init-02372-gf5b311e47de0) 0.190.2 5.26% 0.3 36.36% 2025-02-11T00:20:26
8614 llvm-aarch64-master-O3:239801545695209356 execution_variation 538.imagick_r (unexplained diff vs previous) (percentage) 0770 (llvmorg-21-init-02371-g5d4998bc02ce), 0771 (llvmorg-21-init-02372-gf5b311e47de0) 0.090.12 33.33% 0.03 0.00% 2025-02-11T00:20:26
8615 llvm-aarch64-master-O3:239801545695209356 execution_variation 525.x264_r (avg) (percentage) 0770 (llvmorg-21-init-02371-g5d4998bc02ce), 0771 (llvmorg-21-init-02372-gf5b311e47de0) 0.390.38 -2.56% 0.36 -7.69% 2025-02-11T00:20:26
8616 llvm-aarch64-master-O3:239801545695209356 execution_variation 541.leela_r (unexplained diff vs previous) (percentage) 0770 (llvmorg-21-init-02371-g5d4998bc02ce), 0771 (llvmorg-21-init-02372-gf5b311e47de0) 0.540.63 16.67% 0.34 1033.33% 2025-02-11T00:20:26
8617 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r 0770 (llvmorg-21-init-02371-g5d4998bc02ce), 0771 (llvmorg-21-init-02372-gf5b311e47de0) 18.019.0 5.56% 19.0 5.56% 2025-02-11T00:20:26
8618 llvm-aarch64-master-O3:239801545695209356 execution_variation 508.namd_r (max) (percentage) 0770 (llvmorg-21-init-02371-g5d4998bc02ce), 0771 (llvmorg-21-init-02372-gf5b311e47de0) 0.740.71 -4.05% 0.55 -25.68% 2025-02-11T00:20:26
8619 llvm-aarch64-master-O3:239801545695209356 execution_variation 525.x264_r (max) (percentage) 0770 (llvmorg-21-init-02371-g5d4998bc02ce), 0771 (llvmorg-21-init-02372-gf5b311e47de0) 0.540.56 3.70% 0.69 15.00% 2025-02-11T00:20:26
8620 llvm-aarch64-master-O3:239801545695209356 execution_variation 526.blender_r (unexplained diff vs previous) 0770 (llvmorg-21-init-02371-g5d4998bc02ce), 0771 (llvmorg-21-init-02372-gf5b311e47de0) 12.011.0 -8.33% 0.0 0.00% 2025-02-11T00:20:26
8621 llvm-aarch64-master-O3:239801545695209356 execution_variation 549.fotonik3d_r (unexplained diff vs previous) (percentage) 0770 (llvmorg-21-init-02371-g5d4998bc02ce), 0771 (llvmorg-21-init-02372-gf5b311e47de0) 2.253.65 62.22% 3.23 43.56% 2025-02-11T00:20:26
8622 llvm-aarch64-master-O3:239801545695209356 execution_variation 541.leela_r (max) (percentage) 0770 (llvmorg-21-init-02371-g5d4998bc02ce), 0771 (llvmorg-21-init-02372-gf5b311e47de0) 0.540.63 16.67% 0.34 -5.56% 2025-02-11T00:20:26
8623 llvm-aarch64-master-O3:239801545695209356 execution_variation 549.fotonik3d_r (unexplained diff vs previous) 0770 (llvmorg-21-init-02371-g5d4998bc02ce), 0771 (llvmorg-21-init-02372-gf5b311e47de0) 38.064.0 68.42% 56.0 47.37% 2025-02-11T00:20:26
8624 llvm-aarch64-master-O3:239801545695209356 execution_variation 510.parest_r (unexplained diff vs previous) (percentage) 0770 (llvmorg-21-init-02371-g5d4998bc02ce), 0771 (llvmorg-21-init-02372-gf5b311e47de0) 0.130.1 -23.08% 0.55 -9.84% 2025-02-11T00:20:26
8625 llvm-aarch64-master-O3:239801545695209356 execution_variation 503.bwaves_r (unexplained diff vs previous) 0770 (llvmorg-21-init-02371-g5d4998bc02ce), 0771 (llvmorg-21-init-02372-gf5b311e47de0) 5.06.0 20.00% 2.0 -33.33% 2025-02-11T00:20:26
8626 llvm-aarch64-master-O3:239801545695209356 execution_variation 502.gcc_r (max) (percentage) 0770 (llvmorg-21-init-02371-g5d4998bc02ce), 0771 (llvmorg-21-init-02372-gf5b311e47de0) 0.650.64 -1.54% 0.49 -24.62% 2025-02-11T00:20:26
8627 llvm-aarch64-master-O3:239801545695209356 execution_variation 538.imagick_r (max) (percentage) 0770 (llvmorg-21-init-02371-g5d4998bc02ce), 0771 (llvmorg-21-init-02372-gf5b311e47de0) 0.170.16 -5.88% 0.15 -11.76% 2025-02-11T00:20:26
8628 llvm-aarch64-master-O3:239801545695209356 execution_variation 508.namd_r (max) 0770 (llvmorg-21-init-02371-g5d4998bc02ce), 0771 (llvmorg-21-init-02372-gf5b311e47de0) 11.012.0 9.09% 9.0 -30.77% 2025-02-11T00:20:26
Change State Split Delete