Regression: Regression of 15 benchmarks: 401.bzip2 (avg) (percentage), 401.bzip2 (max), 401.bzip2 (max) (percentage), 401.bzip2 (une... [Detected Fixed]



Metric
Order
Δ ID Machine Metric Test Good, Bad OldNew Now Current Age
5964 llvm-arm-master-O3:39854125689749889 execution_variation 429.mcf (max) (percentage) 0131 (no-change), 0133 (llvmorg-18-init-15416-g7a87ff64e1fe) 0.310.28 -9.68% 0.54 74.19% 2023-12-19T17:58:47
5965 llvm-arm-master-O3:39854125689749889 execution_variation 458.sjeng 0131 (no-change), 0133 (llvmorg-18-init-15416-g7a87ff64e1fe) 68.067.0 -1.47% 73.0 1.39% 2023-12-19T17:58:47
5966 llvm-arm-master-O3:39854125689749889 execution_variation 462.libquantum (avg) 0131 (no-change), 0133 (llvmorg-18-init-15416-g7a87ff64e1fe) 33.030.0 -9.09% 31.0 -6.06% 2023-12-19T17:58:47
5967 llvm-arm-master-O3:39854125689749889 execution_variation 401.bzip2 (avg) (percentage) 0131 (no-change), 0133 (llvmorg-18-init-15416-g7a87ff64e1fe) 0.960.95 -1.04% 0.83 -11.70% 2023-12-19T17:58:47
5968 llvm-arm-master-O3:39854125689749889 execution_variation 458.sjeng (avg) 0131 (no-change), 0133 (llvmorg-18-init-15416-g7a87ff64e1fe) 68.067.0 -1.47% 73.0 1.39% 2023-12-19T17:58:47
5969 llvm-arm-master-O3:39854125689749889 execution_variation 462.libquantum (avg) (percentage) 0131 (no-change), 0133 (llvmorg-18-init-15416-g7a87ff64e1fe) 0.230.21 -8.70% 0.27 17.39% 2023-12-19T17:58:47
5970 llvm-arm-master-O3:39854125689749889 execution_variation 458.sjeng (avg) (percentage) 0131 (no-change), 0133 (llvmorg-18-init-15416-g7a87ff64e1fe) 0.480.47 -2.08% 0.52 1.96% 2023-12-19T17:58:47
5971 llvm-arm-master-O3:39854125689749889 execution_variation 401.bzip2 (max) (percentage) 0131 (no-change), 0133 (llvmorg-18-init-15416-g7a87ff64e1fe) 1.811.74 -3.87% 0.65 -64.09% 2023-12-19T17:58:47
5972 llvm-arm-master-O3:39854125689749889 execution_variation 401.bzip2 (unexplained diff vs previous) 0131 (no-change), 0133 (llvmorg-18-init-15416-g7a87ff64e1fe) 104.0117.0 12.50% 74.0 -28.85% 2023-12-19T17:58:47
5973 llvm-arm-master-O3:39854125689749889 execution_variation 458.sjeng (unexplained diff vs previous) (percentage) 0131 (no-change), 0133 (llvmorg-18-init-15416-g7a87ff64e1fe) 0.020.01 -50.00% 0.61 2950.00% 2023-12-19T17:58:47
5974 llvm-arm-master-O3:39854125689749889 execution_variation 429.mcf (max) 0131 (no-change), 0133 (llvmorg-18-init-15416-g7a87ff64e1fe) 30.027.0 -10.00% 52.0 73.33% 2023-12-19T17:58:47
5975 llvm-arm-master-O3:39854125689749889 execution_variation 401.bzip2 (max) 0131 (no-change), 0133 (llvmorg-18-init-15416-g7a87ff64e1fe) 203.0198.0 -2.46% 73.0 -64.04% 2023-12-19T17:58:47
5976 llvm-arm-master-O3:39854125689749889 execution_variation 401.bzip2 (unexplained diff vs previous) (percentage) 0131 (no-change), 0133 (llvmorg-18-init-15416-g7a87ff64e1fe) 0.921.03 11.96% 0.65 -29.35% 2023-12-19T17:58:47
5977 llvm-arm-master-O3:39854125689749889 execution_variation 458.sjeng (unexplained diff vs previous) 0131 (no-change), 0133 (llvmorg-18-init-15416-g7a87ff64e1fe) 3.01.0 -66.67% 86.0 2766.67% 2023-12-19T17:58:47
5978 llvm-arm-master-O3:39854125689749889 execution_variation 462.libquantum 0131 (no-change), 0133 (llvmorg-18-init-15416-g7a87ff64e1fe) 33.030.0 -9.09% 31.0 -6.06% 2023-12-19T17:58:47
Change State Split Delete