Regression: Regression of 18 benchmarks: 401.bzip2 (max), 401.bzip2 (max) (percentage), 429.mcf, 429.mcf (avg), 429.mcf (avg) (perce... [Detected Fixed]



Metric
Order
Δ ID Machine Metric Test Good, Bad OldNew %Δ Now Current Age
5744 llvm-arm-master-O3:39854125689749889 execution_variation 429.mcf (max) (percentage) 0114 (no-change), 0116 (llvmorg-18-init-14845-g9cf3e31172b7) 0.420.38 -9.52% 0.54 28.57% 2023-12-13T21:46:04
5745 llvm-arm-master-O3:39854125689749889 execution_variation 458.sjeng 0114 (no-change), 0116 (llvmorg-18-init-14845-g9cf3e31172b7) 77.073.0 -5.19% 73.0 -8.75% 2023-12-13T21:46:04
5746 llvm-arm-master-O3:39854125689749889 execution_variation 462.libquantum (avg) 0114 (no-change), 0116 (llvmorg-18-init-14845-g9cf3e31172b7) 39.038.0 -2.56% 31.0 -24.39% 2023-12-13T21:46:04
5747 llvm-arm-master-O3:39854125689749889 execution_variation 429.mcf (avg) 0114 (no-change), 0116 (llvmorg-18-init-14845-g9cf3e31172b7) 25.026.0 4.00% 22.0 -21.43% 2023-12-13T21:46:04
5748 llvm-arm-master-O3:39854125689749889 execution_variation 458.sjeng (avg) 0114 (no-change), 0116 (llvmorg-18-init-14845-g9cf3e31172b7) 77.073.0 -5.19% 73.0 -8.75% 2023-12-13T21:46:04
5749 llvm-arm-master-O3:39854125689749889 execution_variation 429.mcf (avg) (percentage) 0114 (no-change), 0116 (llvmorg-18-init-14845-g9cf3e31172b7) 0.260.27 3.85% 0.23 -20.69% 2023-12-13T21:46:04
5750 llvm-arm-master-O3:39854125689749889 execution_variation 429.mcf 0114 (no-change), 0116 (llvmorg-18-init-14845-g9cf3e31172b7) 25.026.0 4.00% 22.0 -21.43% 2023-12-13T21:46:04
5751 llvm-arm-master-O3:39854125689749889 execution_variation 462.libquantum (avg) (percentage) 0114 (no-change), 0116 (llvmorg-18-init-14845-g9cf3e31172b7) 0.250.26 4.00% 0.27 -3.57% 2023-12-13T21:46:04
5752 llvm-arm-master-O3:39854125689749889 execution_variation 458.sjeng (avg) (percentage) 0114 (no-change), 0116 (llvmorg-18-init-14845-g9cf3e31172b7) 0.540.52 -3.70% 0.52 -8.77% 2023-12-13T21:46:04
5753 llvm-arm-master-O3:39854125689749889 execution_variation 401.bzip2 (max) (percentage) 0114 (no-change), 0116 (llvmorg-18-init-14845-g9cf3e31172b7) 0.740.69 -6.76% 0.65 -12.16% 2023-12-13T21:46:04
5754 llvm-arm-master-O3:39854125689749889 execution_variation 458.sjeng (max) 0114 (no-change), 0116 (llvmorg-18-init-14845-g9cf3e31172b7) 100.093.0 -7.00% 136.0 9.68% 2023-12-13T21:46:04
5755 llvm-arm-master-O3:39854125689749889 execution_variation 458.sjeng (max) (percentage) 0114 (no-change), 0116 (llvmorg-18-init-14845-g9cf3e31172b7) 0.70.66 -5.71% 0.97 10.23% 2023-12-13T21:46:04
5756 llvm-arm-master-O3:39854125689749889 execution_variation 429.mcf (max) 0114 (no-change), 0116 (llvmorg-18-init-14845-g9cf3e31172b7) 40.036.0 -10.00% 52.0 30.00% 2023-12-13T21:46:04
5757 llvm-arm-master-O3:39854125689749889 execution_variation 401.bzip2 (max) 0114 (no-change), 0116 (llvmorg-18-init-14845-g9cf3e31172b7) 83.077.0 -7.23% 73.0 -12.05% 2023-12-13T21:46:04
5758 llvm-arm-master-O3:39854125689749889 execution_variation 462.libquantum (max) (percentage) 0114 (no-change), 0116 (llvmorg-18-init-14845-g9cf3e31172b7) 0.420.33 -21.43% 0.43 -2.27% 2023-12-13T21:46:04
5759 llvm-arm-master-O3:39854125689749889 execution_variation 458.sjeng (unexplained diff vs previous) 0114 (no-change), 0116 (llvmorg-18-init-14845-g9cf3e31172b7) 2.01.0 -50.00% 86.0 -31.75% 2023-12-13T21:46:04
5760 llvm-arm-master-O3:39854125689749889 execution_variation 462.libquantum 0114 (no-change), 0116 (llvmorg-18-init-14845-g9cf3e31172b7) 39.038.0 -2.56% 31.0 -24.39% 2023-12-13T21:46:04
5761 llvm-arm-master-O3:39854125689749889 execution_variation 462.libquantum (max) 0114 (no-change), 0116 (llvmorg-18-init-14845-g9cf3e31172b7) 61.048.0 -21.31% 50.0 -21.88% 2023-12-13T21:46:04
Change State Split Delete