Regression: Regression of 19 benchmarks: 401.bzip2, 401.bzip2 (avg), 401.bzip2 (avg) (percentage), 401.bzip2 (max), 401.bzip2 (max) ... [Detected Fixed]



Metric
Order
Δ ID Machine Metric Test Good, Bad OldNew Now Current Age
5909 llvm-arm-master-O3:39854125689749889 execution_variation 429.mcf (max) (percentage) 0126 (llvmorg-18-init-15183-ge5c523e86104), 0127 (llvmorg-18-init-15184-g9783f28cbb15) 0.360.35 -2.78% 0.54 38.46% 2023-12-18T15:55:17
5910 llvm-arm-master-O3:39854125689749889 execution_variation 462.libquantum (avg) 0126 (llvmorg-18-init-15183-ge5c523e86104), 0127 (llvmorg-18-init-15184-g9783f28cbb15) 35.033.0 -5.71% 31.0 -11.43% 2023-12-18T15:55:17
5911 llvm-arm-master-O3:39854125689749889 execution_variation 401.bzip2 (avg) (percentage) 0126 (llvmorg-18-init-15183-ge5c523e86104), 0127 (llvmorg-18-init-15184-g9783f28cbb15) 0.980.96 -2.04% 0.83 -15.31% 2023-12-18T15:55:17
5912 llvm-arm-master-O3:39854125689749889 execution_variation 429.mcf (unexplained diff vs previous) 0126 (llvmorg-18-init-15183-ge5c523e86104), 0127 (llvmorg-18-init-15184-g9783f28cbb15) 37.034.0 -8.11% 52.0 36.84% 2023-12-18T15:55:17
5913 llvm-arm-master-O3:39854125689749889 execution_variation 401.bzip2 (avg) 0126 (llvmorg-18-init-15183-ge5c523e86104), 0127 (llvmorg-18-init-15184-g9783f28cbb15) 111.0108.0 -2.70% 94.0 -15.32% 2023-12-18T15:55:17
5914 llvm-arm-master-O3:39854125689749889 execution_variation 401.bzip2 (max) (percentage) 0126 (llvmorg-18-init-15183-ge5c523e86104), 0127 (llvmorg-18-init-15184-g9783f28cbb15) 2.262.03 -10.18% 0.65 -71.24% 2023-12-18T15:55:17
5915 llvm-arm-master-O3:39854125689749889 execution_variation 458.sjeng (max) 0126 (llvmorg-18-init-15183-ge5c523e86104), 0127 (llvmorg-18-init-15184-g9783f28cbb15) 147.0140.0 -4.76% 136.0 -7.48% 2023-12-18T15:55:17
5916 llvm-arm-master-O3:39854125689749889 execution_variation 401.bzip2 (unexplained diff vs previous) 0126 (llvmorg-18-init-15183-ge5c523e86104), 0127 (llvmorg-18-init-15184-g9783f28cbb15) 69.080.0 15.94% 74.0 10.45% 2023-12-18T15:55:17
5917 llvm-arm-master-O3:39854125689749889 execution_variation 458.sjeng (max) (percentage) 0126 (llvmorg-18-init-15183-ge5c523e86104), 0127 (llvmorg-18-init-15184-g9783f28cbb15) 1.030.98 -4.85% 0.97 -5.83% 2023-12-18T15:55:17
5918 llvm-arm-master-O3:39854125689749889 execution_variation 458.sjeng (unexplained diff vs previous) (percentage) 0126 (llvmorg-18-init-15183-ge5c523e86104), 0127 (llvmorg-18-init-15184-g9783f28cbb15) 0.030.09 200.00% 0.61 0.00% 2023-12-18T15:55:17
5919 llvm-arm-master-O3:39854125689749889 execution_variation 429.mcf (max) 0126 (llvmorg-18-init-15183-ge5c523e86104), 0127 (llvmorg-18-init-15184-g9783f28cbb15) 34.033.0 -2.94% 52.0 40.54% 2023-12-18T15:55:17
5920 llvm-arm-master-O3:39854125689749889 execution_variation 401.bzip2 (max) 0126 (llvmorg-18-init-15183-ge5c523e86104), 0127 (llvmorg-18-init-15184-g9783f28cbb15) 256.0229.0 -10.55% 73.0 -71.48% 2023-12-18T15:55:17
5921 llvm-arm-master-O3:39854125689749889 execution_variation 462.libquantum (max) (percentage) 0126 (llvmorg-18-init-15183-ge5c523e86104), 0127 (llvmorg-18-init-15184-g9783f28cbb15) 0.250.24 -4.00% 0.43 65.38% 2023-12-18T15:55:17
5922 llvm-arm-master-O3:39854125689749889 execution_variation 401.bzip2 (unexplained diff vs previous) (percentage) 0126 (llvmorg-18-init-15183-ge5c523e86104), 0127 (llvmorg-18-init-15184-g9783f28cbb15) 0.610.71 16.39% 0.65 10.17% 2023-12-18T15:55:17
5923 llvm-arm-master-O3:39854125689749889 execution_variation 458.sjeng (unexplained diff vs previous) 0126 (llvmorg-18-init-15183-ge5c523e86104), 0127 (llvmorg-18-init-15184-g9783f28cbb15) 5.013.0 160.00% 86.0 0.00% 2023-12-18T15:55:17
5924 llvm-arm-master-O3:39854125689749889 execution_variation 429.mcf (unexplained diff vs previous) (percentage) 0126 (llvmorg-18-init-15183-ge5c523e86104), 0127 (llvmorg-18-init-15184-g9783f28cbb15) 0.380.35 -7.89% 0.54 38.46% 2023-12-18T15:55:17
5925 llvm-arm-master-O3:39854125689749889 execution_variation 462.libquantum 0126 (llvmorg-18-init-15183-ge5c523e86104), 0127 (llvmorg-18-init-15184-g9783f28cbb15) 35.033.0 -5.71% 31.0 -11.43% 2023-12-18T15:55:17
5926 llvm-arm-master-O3:39854125689749889 execution_variation 462.libquantum (max) 0126 (llvmorg-18-init-15183-ge5c523e86104), 0127 (llvmorg-18-init-15184-g9783f28cbb15) 36.035.0 -2.78% 50.0 31.58% 2023-12-18T15:55:17
5927 llvm-arm-master-O3:39854125689749889 execution_variation 401.bzip2 0126 (llvmorg-18-init-15183-ge5c523e86104), 0127 (llvmorg-18-init-15184-g9783f28cbb15) 111.0108.0 -2.70% 94.0 -15.32% 2023-12-18T15:55:17
Change State Split Delete