Regression: Regression of 54 benchmarks: 500.perlbench_r, 500.perlbench_r (avg), 500.perlbench_r (avg) (percentage), 500.perlbench_r...



Metric
Order
Δ ID Machine Metric Test Good, Bad OldNew Now Current Age
2666 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (avg) 0255 (llvmorg-19-init-05330-g33960c90258e), 0256 (llvmorg-19-init-05331-g4b0276d1c9cb) 31.034.0 9.68% 17.0 -45.16% 2024-03-13T06:17:21
2667 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (unexplained diff vs previous) (percentage) 0255 (llvmorg-19-init-05330-g33960c90258e), 0256 (llvmorg-19-init-05331-g4b0276d1c9cb) 0.130.12 -7.69% 0.24 0.00% 2024-03-13T06:17:21
2668 llvm-aarch64-master-O3:239801545695209356 execution_variation 549.fotonik3d_r (max) (percentage) 0255 (llvmorg-19-init-05330-g33960c90258e), 0256 (llvmorg-19-init-05331-g4b0276d1c9cb) 3.273.22 -1.53% 3.34 2.14% 2024-03-13T06:17:21
2669 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (unexplained diff vs previous) 0255 (llvmorg-19-init-05330-g33960c90258e), 0256 (llvmorg-19-init-05331-g4b0276d1c9cb) 33.042.0 27.27% 17.0 0.00% 2024-03-13T06:17:21
2670 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (max) 0255 (llvmorg-19-init-05330-g33960c90258e), 0256 (llvmorg-19-init-05331-g4b0276d1c9cb) 56.061.0 8.93% 18.0 -61.70% 2024-03-13T06:17:21
2671 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (unexplained diff vs previous) 0255 (llvmorg-19-init-05330-g33960c90258e), 0256 (llvmorg-19-init-05331-g4b0276d1c9cb) 21.040.0 90.48% 69.0 0.00% 2024-03-13T06:17:21
2672 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (max) 0255 (llvmorg-19-init-05330-g33960c90258e), 0256 (llvmorg-19-init-05331-g4b0276d1c9cb) 33.042.0 27.27% 20.0 -9.09% 2024-03-13T06:17:21
2673 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (unexplained diff vs previous) (percentage) 0255 (llvmorg-19-init-05330-g33960c90258e), 0256 (llvmorg-19-init-05331-g4b0276d1c9cb) 1.841.76 -4.35% 0.55 0.00% 2024-03-13T06:17:21
2674 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (max) (percentage) 0255 (llvmorg-19-init-05330-g33960c90258e), 0256 (llvmorg-19-init-05331-g4b0276d1c9cb) 1.681.79 6.55% 0.55 -60.71% 2024-03-13T06:17:21
2675 llvm-aarch64-master-O3:239801545695209356 execution_variation 557.xz_r (unexplained diff vs previous) 0255 (llvmorg-19-init-05330-g33960c90258e), 0256 (llvmorg-19-init-05331-g4b0276d1c9cb) 6.09.0 50.00% 11.0 0.00% 2024-03-13T06:17:21
2676 llvm-aarch64-master-O3:239801545695209356 execution_variation 503.bwaves_r (max) (percentage) 0255 (llvmorg-19-init-05330-g33960c90258e), 0256 (llvmorg-19-init-05331-g4b0276d1c9cb) 0.40.48 20.00% 0.57 42.50% 2024-03-13T06:17:21
2677 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (max) (percentage) 0255 (llvmorg-19-init-05330-g33960c90258e), 0256 (llvmorg-19-init-05331-g4b0276d1c9cb) 7.226.19 -14.27% 2.43 -66.34% 2024-03-13T06:17:21
2678 llvm-aarch64-master-O3:239801545695209356 execution_variation 503.bwaves_r (unexplained diff vs previous) (percentage) 0255 (llvmorg-19-init-05330-g33960c90258e), 0256 (llvmorg-19-init-05331-g4b0276d1c9cb) 0.240.48 100.00% 0.09 0.00% 2024-03-13T06:17:21
2679 llvm-aarch64-master-O3:239801545695209356 execution_variation 503.bwaves_r (max) 0255 (llvmorg-19-init-05330-g33960c90258e), 0256 (llvmorg-19-init-05331-g4b0276d1c9cb) 8.010.0 25.00% 12.0 50.00% 2024-03-13T06:17:21
2680 llvm-aarch64-master-O3:239801545695209356 execution_variation 557.xz_r (max) 0255 (llvmorg-19-init-05330-g33960c90258e), 0256 (llvmorg-19-init-05331-g4b0276d1c9cb) 6.09.0 50.00% 11.0 120.00% 2024-03-13T06:17:21
2681 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r (max) (percentage) 0255 (llvmorg-19-init-05330-g33960c90258e), 0256 (llvmorg-19-init-05331-g4b0276d1c9cb) 0.890.85 -4.49% 0.44 -50.56% 2024-03-13T06:17:21
2682 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r (max) 0255 (llvmorg-19-init-05330-g33960c90258e), 0256 (llvmorg-19-init-05331-g4b0276d1c9cb) 24.023.0 -4.17% 11.0 -54.17% 2024-03-13T06:17:21
2683 llvm-aarch64-master-O3:239801545695209356 execution_variation 523.xalancbmk_r (max) (percentage) 0255 (llvmorg-19-init-05330-g33960c90258e), 0256 (llvmorg-19-init-05331-g4b0276d1c9cb) 1.391.34 -3.60% 0.42 -69.78% 2024-03-13T06:17:21
2684 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (unexplained diff vs previous) 0255 (llvmorg-19-init-05330-g33960c90258e), 0256 (llvmorg-19-init-05331-g4b0276d1c9cb) 63.061.0 -3.17% 19.0 0.00% 2024-03-13T06:17:21
2685 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r (unexplained diff vs previous) 0255 (llvmorg-19-init-05330-g33960c90258e), 0256 (llvmorg-19-init-05331-g4b0276d1c9cb) 3.01.0 -66.67% 12.0 50.00% 2024-03-13T06:17:21
2686 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r 0255 (llvmorg-19-init-05330-g33960c90258e), 0256 (llvmorg-19-init-05331-g4b0276d1c9cb) 15.014.0 -6.67% 14.0 -6.67% 2024-03-13T06:17:21
2687 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r (avg) 0255 (llvmorg-19-init-05330-g33960c90258e), 0256 (llvmorg-19-init-05331-g4b0276d1c9cb) 16.017.0 6.25% 10.0 -44.44% 2024-03-13T06:17:21
2688 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (unexplained diff vs previous) (percentage) 0255 (llvmorg-19-init-05330-g33960c90258e), 0256 (llvmorg-19-init-05331-g4b0276d1c9cb) 0.651.26 93.85% 2.38 0.00% 2024-03-13T06:17:21
2689 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (avg) (percentage) 0255 (llvmorg-19-init-05330-g33960c90258e), 0256 (llvmorg-19-init-05331-g4b0276d1c9cb) 0.931.01 8.60% 0.51 -45.16% 2024-03-13T06:17:21
2690 llvm-aarch64-master-O3:239801545695209356 execution_variation 523.xalancbmk_r (unexplained diff vs previous) 0255 (llvmorg-19-init-05330-g33960c90258e), 0256 (llvmorg-19-init-05331-g4b0276d1c9cb) 38.028.0 -26.32% 2.0 0.00% 2024-03-13T06:17:21
2691 llvm-aarch64-master-O3:239801545695209356 execution_variation 525.x264_r (unexplained diff vs previous) 0255 (llvmorg-19-init-05330-g33960c90258e), 0256 (llvmorg-19-init-05331-g4b0276d1c9cb) 1.03.0 200.00% 1.0 0.00% 2024-03-13T06:17:21
2692 llvm-aarch64-master-O3:239801545695209356 execution_variation 541.leela_r (unexplained diff vs previous) 0255 (llvmorg-19-init-05330-g33960c90258e), 0256 (llvmorg-19-init-05331-g4b0276d1c9cb) 7.05.0 -28.57% 12.0 0.00% 2024-03-13T06:17:21
2693 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r 0255 (llvmorg-19-init-05330-g33960c90258e), 0256 (llvmorg-19-init-05331-g4b0276d1c9cb) 16.017.0 6.25% 10.0 -44.44% 2024-03-13T06:17:21
2694 llvm-aarch64-master-O3:239801545695209356 execution_variation 525.x264_r (unexplained diff vs previous) (percentage) 0255 (llvmorg-19-init-05330-g33960c90258e), 0256 (llvmorg-19-init-05331-g4b0276d1c9cb) 0.080.24 200.00% 0.08 0.00% 2024-03-13T06:17:21
2695 llvm-aarch64-master-O3:239801545695209356 execution_variation 523.xalancbmk_r (avg) 0255 (llvmorg-19-init-05330-g33960c90258e), 0256 (llvmorg-19-init-05331-g4b0276d1c9cb) 13.014.0 7.69% 11.0 -8.33% 2024-03-13T06:17:21
2696 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (max) 0255 (llvmorg-19-init-05330-g33960c90258e), 0256 (llvmorg-19-init-05331-g4b0276d1c9cb) 218.0196.0 -10.09% 70.0 -69.83% 2024-03-13T06:17:21
2697 llvm-aarch64-master-O3:239801545695209356 execution_variation 523.xalancbmk_r 0255 (llvmorg-19-init-05330-g33960c90258e), 0256 (llvmorg-19-init-05331-g4b0276d1c9cb) 13.014.0 7.69% 11.0 -8.33% 2024-03-13T06:17:21
2698 llvm-aarch64-master-O3:239801545695209356 execution_variation 526.blender_r (max) (percentage) 0255 (llvmorg-19-init-05330-g33960c90258e), 0256 (llvmorg-19-init-05331-g4b0276d1c9cb) 1.071.03 -3.74% 0.59 -44.86% 2024-03-13T06:17:21
2699 llvm-aarch64-master-O3:239801545695209356 execution_variation 510.parest_r (unexplained diff vs previous) 0255 (llvmorg-19-init-05330-g33960c90258e), 0256 (llvmorg-19-init-05331-g4b0276d1c9cb) 12.015.0 25.00% 17.0 0.00% 2024-03-13T06:17:21
2700 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (unexplained diff vs previous) (percentage) 0255 (llvmorg-19-init-05330-g33960c90258e), 0256 (llvmorg-19-init-05331-g4b0276d1c9cb) 1.51.87 24.67% 0.77 0.00% 2024-03-13T06:17:21
2701 llvm-aarch64-master-O3:239801545695209356 execution_variation 526.blender_r (max) 0255 (llvmorg-19-init-05330-g33960c90258e), 0256 (llvmorg-19-init-05331-g4b0276d1c9cb) 19.020.0 5.26% 11.0 -47.62% 2024-03-13T06:17:21
2702 llvm-aarch64-master-O3:239801545695209356 execution_variation 523.xalancbmk_r (avg) (percentage) 0255 (llvmorg-19-init-05330-g33960c90258e), 0256 (llvmorg-19-init-05331-g4b0276d1c9cb) 0.610.65 6.56% 0.55 -6.78% 2024-03-13T06:17:21
2703 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (avg) (percentage) 0255 (llvmorg-19-init-05330-g33960c90258e), 0256 (llvmorg-19-init-05331-g4b0276d1c9cb) 1.051.03 -1.90% 0.87 -10.31% 2024-03-13T06:17:21
2704 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (max) (percentage) 0255 (llvmorg-19-init-05330-g33960c90258e), 0256 (llvmorg-19-init-05331-g4b0276d1c9cb) 1.521.91 25.66% 0.95 -5.94% 2024-03-13T06:17:21
2705 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r 0255 (llvmorg-19-init-05330-g33960c90258e), 0256 (llvmorg-19-init-05331-g4b0276d1c9cb) 31.034.0 9.68% 17.0 -45.16% 2024-03-13T06:17:21
2706 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r (avg) (percentage) 0255 (llvmorg-19-init-05330-g33960c90258e), 0256 (llvmorg-19-init-05331-g4b0276d1c9cb) 0.620.64 3.23% 0.39 -41.79% 2024-03-13T06:17:21
2707 llvm-aarch64-master-O3:239801545695209356 execution_variation 557.xz_r (max) (percentage) 0255 (llvmorg-19-init-05330-g33960c90258e), 0256 (llvmorg-19-init-05331-g4b0276d1c9cb) 0.180.25 38.89% 0.3 114.29% 2024-03-13T06:17:21
2708 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (avg) (percentage) 0255 (llvmorg-19-init-05330-g33960c90258e), 0256 (llvmorg-19-init-05331-g4b0276d1c9cb) 0.480.46 -4.17% 0.44 -8.33% 2024-03-13T06:17:21
2709 llvm-aarch64-master-O3:239801545695209356 execution_variation 523.xalancbmk_r (unexplained diff vs previous) (percentage) 0255 (llvmorg-19-init-05330-g33960c90258e), 0256 (llvmorg-19-init-05331-g4b0276d1c9cb) 1.761.29 -26.70% 0.09 0.00% 2024-03-13T06:17:21
2710 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (avg) 0255 (llvmorg-19-init-05330-g33960c90258e), 0256 (llvmorg-19-init-05331-g4b0276d1c9cb) 157.0160.0 1.91% 139.0 -18.71% 2024-03-13T06:17:21
2711 llvm-aarch64-master-O3:239801545695209356 execution_variation 557.xz_r (unexplained diff vs previous) (percentage) 0255 (llvmorg-19-init-05330-g33960c90258e), 0256 (llvmorg-19-init-05331-g4b0276d1c9cb) 0.170.25 47.06% 0.3 0.00% 2024-03-13T06:17:21
2712 llvm-aarch64-master-O3:239801545695209356 execution_variation 541.leela_r (unexplained diff vs previous) (percentage) 0255 (llvmorg-19-init-05330-g33960c90258e), 0256 (llvmorg-19-init-05331-g4b0276d1c9cb) 0.090.14 55.56% 0.34 0.00% 2024-03-13T06:17:21
2713 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r (unexplained diff vs previous) (percentage) 0255 (llvmorg-19-init-05330-g33960c90258e), 0256 (llvmorg-19-init-05331-g4b0276d1c9cb) 0.110.04 -63.64% 0.45 55.17% 2024-03-13T06:17:21
2714 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (max) 0255 (llvmorg-19-init-05330-g33960c90258e), 0256 (llvmorg-19-init-05331-g4b0276d1c9cb) 15.014.0 -6.67% 32.0 113.33% 2024-03-13T06:17:21
2715 llvm-aarch64-master-O3:239801545695209356 execution_variation 541.leela_r (max) (percentage) 0255 (llvmorg-19-init-05330-g33960c90258e), 0256 (llvmorg-19-init-05331-g4b0276d1c9cb) 0.430.45 4.65% 0.34 -30.61% 2024-03-13T06:17:21
2716 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (avg) 0255 (llvmorg-19-init-05330-g33960c90258e), 0256 (llvmorg-19-init-05331-g4b0276d1c9cb) 15.014.0 -6.67% 14.0 -6.67% 2024-03-13T06:17:21
2717 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r 0255 (llvmorg-19-init-05330-g33960c90258e), 0256 (llvmorg-19-init-05331-g4b0276d1c9cb) 157.0160.0 1.91% 139.0 -18.71% 2024-03-13T06:17:21
2718 llvm-aarch64-master-O3:239801545695209356 execution_variation 510.parest_r (unexplained diff vs previous) (percentage) 0255 (llvmorg-19-init-05330-g33960c90258e), 0256 (llvmorg-19-init-05331-g4b0276d1c9cb) 0.380.47 23.68% 0.55 0.00% 2024-03-13T06:17:21
2719 llvm-aarch64-master-O3:239801545695209356 execution_variation 503.bwaves_r (unexplained diff vs previous) 0255 (llvmorg-19-init-05330-g33960c90258e), 0256 (llvmorg-19-init-05331-g4b0276d1c9cb) 5.010.0 100.00% 2.0 0.00% 2024-03-13T06:17:21
Change State Split Delete