Regression: Regression of 26 benchmarks: 401.bzip2, 401.bzip2 (avg), 401.bzip2 (avg) (percentage), 401.bzip2 (max), 401.bzip2 (max) ...



Metric
Order
Δ ID Machine Metric Test Good, Bad OldNew %Δ Now Current Age
5762 llvm-arm-master-O3:39854125689749889 execution_variation 429.mcf (max) (percentage) 0116 (llvmorg-18-init-14845-g9cf3e31172b7), 0117 (llvmorg-18-init-14846-g39093102cade) 0.380.36 -5.26% 0.54 42.11% 2023-12-14T06:29:51
5763 llvm-arm-master-O3:39854125689749889 execution_variation 458.sjeng 0116 (llvmorg-18-init-14845-g9cf3e31172b7), 0117 (llvmorg-18-init-14846-g39093102cade) 73.074.0 1.37% 73.0 0.00% 2023-12-14T06:29:51
5764 llvm-arm-master-O3:39854125689749889 execution_variation 462.libquantum (avg) 0116 (llvmorg-18-init-14845-g9cf3e31172b7), 0117 (llvmorg-18-init-14846-g39093102cade) 38.035.0 -7.89% 31.0 -18.42% 2023-12-14T06:29:51
5765 llvm-arm-master-O3:39854125689749889 execution_variation 429.mcf (avg) 0116 (llvmorg-18-init-14845-g9cf3e31172b7), 0117 (llvmorg-18-init-14846-g39093102cade) 25.024.0 -4.00% 22.0 -15.38% 2023-12-14T06:29:51
5766 llvm-arm-master-O3:39854125689749889 execution_variation 401.bzip2 (avg) (percentage) 0116 (llvmorg-18-init-14845-g9cf3e31172b7), 0117 (llvmorg-18-init-14846-g39093102cade) 0.540.53 -1.85% 0.83 48.21% 2023-12-14T06:29:51
5767 llvm-arm-master-O3:39854125689749889 execution_variation 458.sjeng (avg) 0116 (llvmorg-18-init-14845-g9cf3e31172b7), 0117 (llvmorg-18-init-14846-g39093102cade) 73.074.0 1.37% 73.0 0.00% 2023-12-14T06:29:51
5768 llvm-arm-master-O3:39854125689749889 execution_variation 429.mcf (unexplained diff vs previous) 0116 (llvmorg-18-init-14845-g9cf3e31172b7), 0117 (llvmorg-18-init-14846-g39093102cade) 9.010.0 11.11% 52.0 766.67% 2023-12-14T06:29:51
5769 llvm-arm-master-O3:39854125689749889 execution_variation 429.mcf (avg) (percentage) 0116 (llvmorg-18-init-14845-g9cf3e31172b7), 0117 (llvmorg-18-init-14846-g39093102cade) 0.260.25 -3.85% 0.23 -14.81% 2023-12-14T06:29:51
5770 llvm-arm-master-O3:39854125689749889 execution_variation 429.mcf 0116 (llvmorg-18-init-14845-g9cf3e31172b7), 0117 (llvmorg-18-init-14846-g39093102cade) 25.024.0 -4.00% 22.0 -15.38% 2023-12-14T06:29:51
5771 llvm-arm-master-O3:39854125689749889 execution_variation 462.libquantum (avg) (percentage) 0116 (llvmorg-18-init-14845-g9cf3e31172b7), 0117 (llvmorg-18-init-14846-g39093102cade) 0.260.24 -7.69% 0.27 3.85% 2023-12-14T06:29:51
5772 llvm-arm-master-O3:39854125689749889 execution_variation 462.libquantum (unexplained diff vs previous) 0116 (llvmorg-18-init-14845-g9cf3e31172b7), 0117 (llvmorg-18-init-14846-g39093102cade) 8.09.0 12.50% 51.0 537.50% 2023-12-14T06:29:51
5773 llvm-arm-master-O3:39854125689749889 execution_variation 401.bzip2 (avg) 0116 (llvmorg-18-init-14845-g9cf3e31172b7), 0117 (llvmorg-18-init-14846-g39093102cade) 61.059.0 -3.28% 94.0 49.21% 2023-12-14T06:29:51
5774 llvm-arm-master-O3:39854125689749889 execution_variation 401.bzip2 (max) (percentage) 0116 (llvmorg-18-init-14845-g9cf3e31172b7), 0117 (llvmorg-18-init-14846-g39093102cade) 0.690.67 -2.90% 0.65 -5.80% 2023-12-14T06:29:51
5775 llvm-arm-master-O3:39854125689749889 execution_variation 458.sjeng (max) 0116 (llvmorg-18-init-14845-g9cf3e31172b7), 0117 (llvmorg-18-init-14846-g39093102cade) 80.084.0 5.00% 136.0 46.24% 2023-12-14T06:29:51
5776 llvm-arm-master-O3:39854125689749889 execution_variation 401.bzip2 (unexplained diff vs previous) 0116 (llvmorg-18-init-14845-g9cf3e31172b7), 0117 (llvmorg-18-init-14846-g39093102cade) 16.031.0 93.75% 74.0 0.00% 2023-12-14T06:29:51
5777 llvm-arm-master-O3:39854125689749889 execution_variation 458.sjeng (max) (percentage) 0116 (llvmorg-18-init-14845-g9cf3e31172b7), 0117 (llvmorg-18-init-14846-g39093102cade) 0.570.59 3.51% 0.97 46.97% 2023-12-14T06:29:51
5778 llvm-arm-master-O3:39854125689749889 execution_variation 458.sjeng (unexplained diff vs previous) (percentage) 0116 (llvmorg-18-init-14845-g9cf3e31172b7), 0117 (llvmorg-18-init-14846-g39093102cade) 0.570.59 3.51% 0.61 6000.00% 2023-12-14T06:29:51
5779 llvm-arm-master-O3:39854125689749889 execution_variation 429.mcf (max) 0116 (llvmorg-18-init-14845-g9cf3e31172b7), 0117 (llvmorg-18-init-14846-g39093102cade) 36.034.0 -5.56% 52.0 44.44% 2023-12-14T06:29:51
5780 llvm-arm-master-O3:39854125689749889 execution_variation 401.bzip2 (max) 0116 (llvmorg-18-init-14845-g9cf3e31172b7), 0117 (llvmorg-18-init-14846-g39093102cade) 77.075.0 -2.60% 73.0 -5.19% 2023-12-14T06:29:51
5781 llvm-arm-master-O3:39854125689749889 execution_variation 462.libquantum (max) (percentage) 0116 (llvmorg-18-init-14845-g9cf3e31172b7), 0117 (llvmorg-18-init-14846-g39093102cade) 0.330.29 -12.12% 0.43 30.30% 2023-12-14T06:29:51
5782 llvm-arm-master-O3:39854125689749889 execution_variation 401.bzip2 (unexplained diff vs previous) (percentage) 0116 (llvmorg-18-init-14845-g9cf3e31172b7), 0117 (llvmorg-18-init-14846-g39093102cade) 0.140.28 100.00% 0.65 0.00% 2023-12-14T06:29:51
5783 llvm-arm-master-O3:39854125689749889 execution_variation 458.sjeng (unexplained diff vs previous) 0116 (llvmorg-18-init-14845-g9cf3e31172b7), 0117 (llvmorg-18-init-14846-g39093102cade) 81.084.0 3.70% 86.0 8500.00% 2023-12-14T06:29:51
5784 llvm-arm-master-O3:39854125689749889 execution_variation 429.mcf (unexplained diff vs previous) (percentage) 0116 (llvmorg-18-init-14845-g9cf3e31172b7), 0117 (llvmorg-18-init-14846-g39093102cade) 0.090.1 11.11% 0.54 800.00% 2023-12-14T06:29:51
5785 llvm-arm-master-O3:39854125689749889 execution_variation 462.libquantum 0116 (llvmorg-18-init-14845-g9cf3e31172b7), 0117 (llvmorg-18-init-14846-g39093102cade) 38.035.0 -7.89% 31.0 -18.42% 2023-12-14T06:29:51
5786 llvm-arm-master-O3:39854125689749889 execution_variation 462.libquantum (max) 0116 (llvmorg-18-init-14845-g9cf3e31172b7), 0117 (llvmorg-18-init-14846-g39093102cade) 48.042.0 -12.50% 50.0 4.17% 2023-12-14T06:29:51
5787 llvm-arm-master-O3:39854125689749889 execution_variation 401.bzip2 0116 (llvmorg-18-init-14845-g9cf3e31172b7), 0117 (llvmorg-18-init-14846-g39093102cade) 61.059.0 -3.28% 94.0 49.21% 2023-12-14T06:29:51
Change State Split Delete