Regression: Regression of 71 benchmarks: 500.perlbench_r, 500.perlbench_r (avg), 500.perlbench_r (avg) (percentage), 500.perlbench_r...



Metric
Order
Δ ID Machine Metric Test Good, Bad OldNew Now Current Age
600 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (avg) 0041 (llvmorg-18-init-05608-g1dae4dd0d80f), 0044 (no-change) 20.024.0 20.00% 17.0 -39.29% 2023-09-13T10:37:05
601 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (unexplained diff vs previous) (percentage) 0041 (llvmorg-18-init-05608-g1dae4dd0d80f), 0044 (no-change) 0.450.39 -13.33% 0.24 -83.33% 2023-09-13T10:37:05
602 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (unexplained diff vs previous) 0041 (llvmorg-18-init-05608-g1dae4dd0d80f), 0044 (no-change) 5.04.0 -20.00% 17.0 -10.53% 2023-09-13T10:37:05
603 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (unexplained diff vs previous) 0041 (llvmorg-18-init-05608-g1dae4dd0d80f), 0044 (no-change) 146.0142.0 -2.74% 69.0 -48.89% 2023-09-13T10:37:05
604 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (max) 0041 (llvmorg-18-init-05608-g1dae4dd0d80f), 0044 (no-change) 33.017.0 -48.48% 20.0 -39.39% 2023-09-13T10:37:05
605 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (unexplained diff vs previous) (percentage) 0041 (llvmorg-18-init-05608-g1dae4dd0d80f), 0044 (no-change) 0.310.37 19.35% 0.55 -58.65% 2023-09-13T10:37:05
606 llvm-aarch64-master-O3:239801545695209356 execution_variation 541.leela_r (avg) 0041 (llvmorg-18-init-05608-g1dae4dd0d80f), 0044 (no-change) 7.09.0 28.57% 8.0 -27.27% 2023-09-13T10:37:05
607 llvm-aarch64-master-O3:239801545695209356 execution_variation 557.xz_r (unexplained diff vs previous) 0041 (llvmorg-18-init-05608-g1dae4dd0d80f), 0044 (no-change) 9.080.0 788.89% 11.0 57.14% 2023-09-13T10:37:05
608 llvm-aarch64-master-O3:239801545695209356 execution_variation 526.blender_r (unexplained diff vs previous) (percentage) 0041 (llvmorg-18-init-05608-g1dae4dd0d80f), 0044 (no-change) 0.150.1 -33.33% 0.0 0.00% 2023-09-13T10:37:05
609 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (avg) 0041 (llvmorg-18-init-05608-g1dae4dd0d80f), 0044 (no-change) 15.013.0 -13.33% 19.0 18.75% 2023-09-13T10:37:05
610 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (max) (percentage) 0041 (llvmorg-18-init-05608-g1dae4dd0d80f), 0044 (no-change) 4.534.64 2.43% 2.43 -43.62% 2023-09-13T10:37:05
611 llvm-aarch64-master-O3:239801545695209356 execution_variation 508.namd_r (unexplained diff vs previous) (percentage) 0041 (llvmorg-18-init-05608-g1dae4dd0d80f), 0044 (no-change) 0.370.32 -13.51% 0.11 0.00% 2023-09-13T10:37:05
612 llvm-aarch64-master-O3:239801545695209356 execution_variation 508.namd_r (unexplained diff vs previous) 0041 (llvmorg-18-init-05608-g1dae4dd0d80f), 0044 (no-change) 7.06.0 -14.29% 2.0 0.00% 2023-09-13T10:37:05
613 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (avg) (percentage) 0041 (llvmorg-18-init-05608-g1dae4dd0d80f), 0044 (no-change) 3.373.54 5.04% 4.81 45.76% 2023-09-13T10:37:05
614 llvm-aarch64-master-O3:239801545695209356 execution_variation 557.xz_r (max) 0041 (llvmorg-18-init-05608-g1dae4dd0d80f), 0044 (no-change) 9.078.0 766.67% 11.0 57.14% 2023-09-13T10:37:05
615 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r (max) (percentage) 0041 (llvmorg-18-init-05608-g1dae4dd0d80f), 0044 (no-change) 0.810.97 19.75% 0.44 -62.07% 2023-09-13T10:37:05
616 llvm-aarch64-master-O3:239801545695209356 execution_variation 526.blender_r 0041 (llvmorg-18-init-05608-g1dae4dd0d80f), 0044 (no-change) 4.05.0 25.00% 13.0 116.67% 2023-09-13T10:37:05
617 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r (max) 0041 (llvmorg-18-init-05608-g1dae4dd0d80f), 0044 (no-change) 23.027.0 17.39% 11.0 -65.62% 2023-09-13T10:37:05
618 llvm-aarch64-master-O3:239801545695209356 execution_variation 557.xz_r (avg) (percentage) 0041 (llvmorg-18-init-05608-g1dae4dd0d80f), 0044 (no-change) 0.150.53 253.33% 0.13 -13.33% 2023-09-13T10:37:05
619 llvm-aarch64-master-O3:239801545695209356 execution_variation 523.xalancbmk_r (max) (percentage) 0041 (llvmorg-18-init-05608-g1dae4dd0d80f), 0044 (no-change) 1.941.82 -6.19% 0.42 -78.35% 2023-09-13T10:37:05
620 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (unexplained diff vs previous) 0041 (llvmorg-18-init-05608-g1dae4dd0d80f), 0044 (no-change) 11.013.0 18.18% 19.0 -59.57% 2023-09-13T10:37:05
621 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r (unexplained diff vs previous) 0041 (llvmorg-18-init-05608-g1dae4dd0d80f), 0044 (no-change) 19.021.0 10.53% 12.0 -63.64% 2023-09-13T10:37:05
622 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r 0041 (llvmorg-18-init-05608-g1dae4dd0d80f), 0044 (no-change) 27.026.0 -3.70% 14.0 -53.33% 2023-09-13T10:37:05
623 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (unexplained diff vs previous) (percentage) 0041 (llvmorg-18-init-05608-g1dae4dd0d80f), 0044 (no-change) 4.574.86 6.35% 2.38 -46.03% 2023-09-13T10:37:05
624 llvm-aarch64-master-O3:239801545695209356 execution_variation 510.parest_r (max) (percentage) 0041 (llvmorg-18-init-05608-g1dae4dd0d80f), 0044 (no-change) 0.690.94 36.23% 0.54 -21.74% 2023-09-13T10:37:05
625 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (avg) (percentage) 0041 (llvmorg-18-init-05608-g1dae4dd0d80f), 0044 (no-change) 0.580.69 18.97% 0.51 -36.25% 2023-09-13T10:37:05
626 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (unexplained diff vs previous) 0041 (llvmorg-18-init-05608-g1dae4dd0d80f), 0044 (no-change) 15.013.0 -13.33% 8.0 -83.33% 2023-09-13T10:37:05
627 llvm-aarch64-master-O3:239801545695209356 execution_variation 525.x264_r (max) 0041 (llvmorg-18-init-05608-g1dae4dd0d80f), 0044 (no-change) 3.04.0 33.33% 8.0 60.00% 2023-09-13T10:37:05
628 llvm-aarch64-master-O3:239801545695209356 execution_variation 523.xalancbmk_r (unexplained diff vs previous) 0041 (llvmorg-18-init-05608-g1dae4dd0d80f), 0044 (no-change) 6.08.0 33.33% 2.0 -94.44% 2023-09-13T10:37:05
629 llvm-aarch64-master-O3:239801545695209356 execution_variation 510.parest_r (max) 0041 (llvmorg-18-init-05608-g1dae4dd0d80f), 0044 (no-change) 21.030.0 42.86% 16.0 -23.81% 2023-09-13T10:37:05
630 llvm-aarch64-master-O3:239801545695209356 execution_variation 541.leela_r (max) 0041 (llvmorg-18-init-05608-g1dae4dd0d80f), 0044 (no-change) 3.06.0 100.00% 11.0 -47.62% 2023-09-13T10:37:05
631 llvm-aarch64-master-O3:239801545695209356 execution_variation 531.deepsjeng_r (unexplained diff vs previous) 0041 (llvmorg-18-init-05608-g1dae4dd0d80f), 0044 (no-change) 16.032.0 100.00% 2.0 -50.00% 2023-09-13T10:37:05
632 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (max) (percentage) 0041 (llvmorg-18-init-05608-g1dae4dd0d80f), 0044 (no-change) 1.421.34 -5.63% 0.98 -30.99% 2023-09-13T10:37:05
633 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (max) 0041 (llvmorg-18-init-05608-g1dae4dd0d80f), 0044 (no-change) 138.0135.0 -2.17% 70.0 -46.56% 2023-09-13T10:37:05
634 llvm-aarch64-master-O3:239801545695209356 execution_variation 531.deepsjeng_r (unexplained diff vs previous) (percentage) 0041 (llvmorg-18-init-05608-g1dae4dd0d80f), 0044 (no-change) 0.541.1 103.70% 0.07 -50.00% 2023-09-13T10:37:05
635 llvm-aarch64-master-O3:239801545695209356 execution_variation 541.leela_r 0041 (llvmorg-18-init-05608-g1dae4dd0d80f), 0044 (no-change) 7.09.0 28.57% 8.0 -27.27% 2023-09-13T10:37:05
636 llvm-aarch64-master-O3:239801545695209356 execution_variation 510.parest_r (unexplained diff vs previous) 0041 (llvmorg-18-init-05608-g1dae4dd0d80f), 0044 (no-change) 22.030.0 36.36% 17.0 -22.73% 2023-09-13T10:37:05
637 llvm-aarch64-master-O3:239801545695209356 execution_variation 508.namd_r (avg) (percentage) 0041 (llvmorg-18-init-05608-g1dae4dd0d80f), 0044 (no-change) 0.210.19 -9.52% 0.28 75.00% 2023-09-13T10:37:05
638 llvm-aarch64-master-O3:239801545695209356 execution_variation 502.gcc_r (unexplained diff vs previous) 0041 (llvmorg-18-init-05608-g1dae4dd0d80f), 0044 (no-change) 63.055.0 -12.70% None 0.00% 2023-09-13T10:37:05
639 llvm-aarch64-master-O3:239801545695209356 execution_variation 531.deepsjeng_r (max) 0041 (llvmorg-18-init-05608-g1dae4dd0d80f), 0044 (no-change) 16.031.0 93.75% 1.0 -90.00% 2023-09-13T10:37:05
640 llvm-aarch64-master-O3:239801545695209356 execution_variation 502.gcc_r (avg) 0041 (llvmorg-18-init-05608-g1dae4dd0d80f), 0044 (no-change) 53.052.0 -1.89% 8.0 -84.91% 2023-09-13T10:37:05
641 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (avg) (percentage) 0041 (llvmorg-18-init-05608-g1dae4dd0d80f), 0044 (no-change) 0.830.75 -9.64% 0.87 0.00% 2023-09-13T10:37:05
642 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (max) (percentage) 0041 (llvmorg-18-init-05608-g1dae4dd0d80f), 0044 (no-change) 1.790.96 -46.37% 0.95 -46.93% 2023-09-13T10:37:05
643 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r 0041 (llvmorg-18-init-05608-g1dae4dd0d80f), 0044 (no-change) 20.024.0 20.00% 17.0 -39.29% 2023-09-13T10:37:05
644 llvm-aarch64-master-O3:239801545695209356 execution_variation 502.gcc_r (max) 0041 (llvmorg-18-init-05608-g1dae4dd0d80f), 0044 (no-change) 61.056.0 -8.20% 9.0 -85.25% 2023-09-13T10:37:05
645 llvm-aarch64-master-O3:239801545695209356 execution_variation 531.deepsjeng_r 0041 (llvmorg-18-init-05608-g1dae4dd0d80f), 0044 (no-change) 5.09.0 80.00% 3.0 -25.00% 2023-09-13T10:37:05
646 llvm-aarch64-master-O3:239801545695209356 execution_variation 531.deepsjeng_r (avg) (percentage) 0041 (llvmorg-18-init-05608-g1dae4dd0d80f), 0044 (no-change) 0.20.34 70.00% 0.12 -25.00% 2023-09-13T10:37:05
647 llvm-aarch64-master-O3:239801545695209356 execution_variation 531.deepsjeng_r (avg) 0041 (llvmorg-18-init-05608-g1dae4dd0d80f), 0044 (no-change) 5.09.0 80.00% 3.0 -25.00% 2023-09-13T10:37:05
648 llvm-aarch64-master-O3:239801545695209356 execution_variation 502.gcc_r (unexplained diff vs previous) (percentage) 0041 (llvmorg-18-init-05608-g1dae4dd0d80f), 0044 (no-change) 3.292.96 -10.03% None 0.00% 2023-09-13T10:37:05
649 llvm-aarch64-master-O3:239801545695209356 execution_variation 541.leela_r (avg) (percentage) 0041 (llvmorg-18-init-05608-g1dae4dd0d80f), 0044 (no-change) 0.320.27 -15.62% 0.23 -28.12% 2023-09-13T10:37:05
650 llvm-aarch64-master-O3:239801545695209356 execution_variation 557.xz_r (avg) 0041 (llvmorg-18-init-05608-g1dae4dd0d80f), 0044 (no-change) 5.019.0 280.00% 4.0 -20.00% 2023-09-13T10:37:05
651 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r (avg) (percentage) 0041 (llvmorg-18-init-05608-g1dae4dd0d80f), 0044 (no-change) 0.570.6 5.26% 0.39 -31.58% 2023-09-13T10:37:05
652 llvm-aarch64-master-O3:239801545695209356 execution_variation 557.xz_r (max) (percentage) 0041 (llvmorg-18-init-05608-g1dae4dd0d80f), 0044 (no-change) 0.242.12 783.33% 0.3 42.86% 2023-09-13T10:37:05
653 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (avg) (percentage) 0041 (llvmorg-18-init-05608-g1dae4dd0d80f), 0044 (no-change) 0.820.8 -2.44% 0.44 -52.69% 2023-09-13T10:37:05
654 llvm-aarch64-master-O3:239801545695209356 execution_variation 523.xalancbmk_r (unexplained diff vs previous) (percentage) 0041 (llvmorg-18-init-05608-g1dae4dd0d80f), 0044 (no-change) 0.280.37 32.14% 0.09 -94.61% 2023-09-13T10:37:05
655 llvm-aarch64-master-O3:239801545695209356 execution_variation 557.xz_r (unexplained diff vs previous) (percentage) 0041 (llvmorg-18-init-05608-g1dae4dd0d80f), 0044 (no-change) 0.242.17 804.17% 0.3 57.89% 2023-09-13T10:37:05
656 llvm-aarch64-master-O3:239801545695209356 execution_variation 502.gcc_r (avg) (percentage) 0041 (llvmorg-18-init-05608-g1dae4dd0d80f), 0044 (no-change) 2.772.82 1.81% 0.45 -83.75% 2023-09-13T10:37:05
657 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r 0041 (llvmorg-18-init-05608-g1dae4dd0d80f), 0044 (no-change) 15.013.0 -13.33% 19.0 18.75% 2023-09-13T10:37:05
658 llvm-aarch64-master-O3:239801545695209356 execution_variation 508.namd_r (max) (percentage) 0041 (llvmorg-18-init-05608-g1dae4dd0d80f), 0044 (no-change) 0.330.32 -3.03% 0.55 189.47% 2023-09-13T10:37:05
659 llvm-aarch64-master-O3:239801545695209356 execution_variation 525.x264_r (max) (percentage) 0041 (llvmorg-18-init-05608-g1dae4dd0d80f), 0044 (no-change) 0.40.37 -7.50% 0.69 72.50% 2023-09-13T10:37:05
660 llvm-aarch64-master-O3:239801545695209356 execution_variation 526.blender_r (unexplained diff vs previous) 0041 (llvmorg-18-init-05608-g1dae4dd0d80f), 0044 (no-change) 3.02.0 -33.33% 0.0 0.00% 2023-09-13T10:37:05
661 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r (unexplained diff vs previous) (percentage) 0041 (llvmorg-18-init-05608-g1dae4dd0d80f), 0044 (no-change) 0.810.75 -7.41% 0.45 -61.54% 2023-09-13T10:37:05
662 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (max) 0041 (llvmorg-18-init-05608-g1dae4dd0d80f), 0044 (no-change) 42.044.0 4.76% 32.0 -31.91% 2023-09-13T10:37:05
664 llvm-aarch64-master-O3:239801545695209356 execution_variation 541.leela_r (max) (percentage) 0041 (llvmorg-18-init-05608-g1dae4dd0d80f), 0044 (no-change) 0.110.17 54.55% 0.34 -44.26% 2023-09-13T10:37:05
665 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (avg) 0041 (llvmorg-18-init-05608-g1dae4dd0d80f), 0044 (no-change) 27.026.0 -3.70% 14.0 -53.33% 2023-09-13T10:37:05
666 llvm-aarch64-master-O3:239801545695209356 execution_variation 526.blender_r (avg) (percentage) 0041 (llvmorg-18-init-05608-g1dae4dd0d80f), 0044 (no-change) 0.340.28 -17.65% 0.66 94.12% 2023-09-13T10:37:05
667 llvm-aarch64-master-O3:239801545695209356 execution_variation 510.parest_r (unexplained diff vs previous) (percentage) 0041 (llvmorg-18-init-05608-g1dae4dd0d80f), 0044 (no-change) 0.690.93 34.78% 0.55 -20.29% 2023-09-13T10:37:05
668 llvm-aarch64-master-O3:239801545695209356 execution_variation 523.xalancbmk_r (max) 0041 (llvmorg-18-init-05608-g1dae4dd0d80f), 0044 (no-change) 41.039.0 -4.88% 8.0 -80.49% 2023-09-13T10:37:05
670 llvm-aarch64-master-O3:239801545695209356 execution_variation 502.gcc_r (max) (percentage) 0041 (llvmorg-18-init-05608-g1dae4dd0d80f), 0044 (no-change) 3.193.06 -4.08% 0.49 -84.64% 2023-09-13T10:37:05
671 llvm-aarch64-master-O3:239801545695209356 execution_variation 531.deepsjeng_r (max) (percentage) 0041 (llvmorg-18-init-05608-g1dae4dd0d80f), 0044 (no-change) 0.551.09 98.18% 0.07 -81.08% 2023-09-13T10:37:05
672 llvm-aarch64-master-O3:239801545695209356 execution_variation 526.blender_r (avg) 0041 (llvmorg-18-init-05608-g1dae4dd0d80f), 0044 (no-change) 4.05.0 25.00% 13.0 116.67% 2023-09-13T10:37:05
Change State Split Delete