Regression: Regression of 15 benchmarks: 401.bzip2 (max), 401.bzip2 (max) (percentage), 401.bzip2 (unexplained diff vs previous), 40... [Detected Fixed]



Metric
Order
Δ ID Machine Metric Test Good, Bad OldNew Now Current Age
6248 llvm-arm-master-O3:39854125689749889 execution_variation 462.libquantum (avg) 0159 (llvmorg-19-init-01423-g42b5b720caf6), 0161 (no-change) 30.029.0 -3.33% 31.0 3.33% 2024-02-03T12:32:57
6249 llvm-arm-master-O3:39854125689749889 execution_variation 462.libquantum (unexplained diff vs previous) 0159 (llvmorg-19-init-01423-g42b5b720caf6), 0161 (no-change) 8.03.0 -62.50% 51.0 537.50% 2024-02-03T12:32:57
6250 llvm-arm-master-O3:39854125689749889 execution_variation 462.libquantum (unexplained diff vs previous) (percentage) 0159 (llvmorg-19-init-01423-g42b5b720caf6), 0161 (no-change) 0.050.02 -60.00% 0.43 760.00% 2024-02-03T12:32:57
6251 llvm-arm-master-O3:39854125689749889 execution_variation 401.bzip2 (max) (percentage) 0159 (llvmorg-19-init-01423-g42b5b720caf6), 0161 (no-change) 0.960.9 -6.25% 0.65 -36.89% 2024-02-03T12:32:57
6252 llvm-arm-master-O3:39854125689749889 execution_variation 458.sjeng (max) 0159 (llvmorg-19-init-01423-g42b5b720caf6), 0161 (no-change) 95.085.0 -10.53% 136.0 43.16% 2024-02-03T12:32:57
6253 llvm-arm-master-O3:39854125689749889 execution_variation 401.bzip2 (unexplained diff vs previous) 0159 (llvmorg-19-init-01423-g42b5b720caf6), 0161 (no-change) 29.027.0 -6.90% 74.0 -35.65% 2024-02-03T12:32:57
6254 llvm-arm-master-O3:39854125689749889 execution_variation 458.sjeng (max) (percentage) 0159 (llvmorg-19-init-01423-g42b5b720caf6), 0161 (no-change) 0.670.6 -10.45% 0.97 44.78% 2024-02-03T12:32:57
6255 llvm-arm-master-O3:39854125689749889 execution_variation 458.sjeng (unexplained diff vs previous) (percentage) 0159 (llvmorg-19-init-01423-g42b5b720caf6), 0161 (no-change) 0.310.39 25.81% 0.61 -8.96% 2024-02-03T12:32:57
6256 llvm-arm-master-O3:39854125689749889 execution_variation 429.mcf (max) 0159 (llvmorg-19-init-01423-g42b5b720caf6), 0161 (no-change) 11.010.0 -9.09% 52.0 372.73% 2024-02-03T12:32:57
6257 llvm-arm-master-O3:39854125689749889 execution_variation 401.bzip2 (max) 0159 (llvmorg-19-init-01423-g42b5b720caf6), 0161 (no-change) 107.0101.0 -5.61% 73.0 -37.07% 2024-02-03T12:32:57
6258 llvm-arm-master-O3:39854125689749889 execution_variation 462.libquantum (max) (percentage) 0159 (llvmorg-19-init-01423-g42b5b720caf6), 0161 (no-change) 0.10.09 -10.00% 0.43 330.00% 2024-02-03T12:32:57
6259 llvm-arm-master-O3:39854125689749889 execution_variation 401.bzip2 (unexplained diff vs previous) (percentage) 0159 (llvmorg-19-init-01423-g42b5b720caf6), 0161 (no-change) 0.250.24 -4.00% 0.65 -36.27% 2024-02-03T12:32:57
6260 llvm-arm-master-O3:39854125689749889 execution_variation 458.sjeng (unexplained diff vs previous) 0159 (llvmorg-19-init-01423-g42b5b720caf6), 0161 (no-change) 44.055.0 25.00% 86.0 -9.47% 2024-02-03T12:32:57
6261 llvm-arm-master-O3:39854125689749889 execution_variation 462.libquantum 0159 (llvmorg-19-init-01423-g42b5b720caf6), 0161 (no-change) 30.029.0 -3.33% 31.0 3.33% 2024-02-03T12:32:57
6262 llvm-arm-master-O3:39854125689749889 execution_variation 462.libquantum (max) 0159 (llvmorg-19-init-01423-g42b5b720caf6), 0161 (no-change) 14.013.0 -7.14% 50.0 257.14% 2024-02-03T12:32:57
Change State Split Delete