Regression: Regression of 28 benchmarks: 401.bzip2, 401.bzip2 (avg), 401.bzip2 (avg) (percentage), 401.bzip2 (max), 401.bzip2 (max) ...



Metric
Order
Δ ID Machine Metric Test Good, Bad OldNew Now Current Age
5497 llvm-arm-master-O3:39854125689749889 execution_variation 429.mcf (max) (percentage) 0092 (llvmorg-18-init-12183-gb9975cec0ea0), 0094 (no-change) 0.170.49 188.24% 0.54 350.00% 2023-11-19T14:44:43
5498 llvm-arm-master-O3:39854125689749889 execution_variation 462.libquantum (avg) 0092 (llvmorg-18-init-12183-gb9975cec0ea0), 0094 (no-change) 23.029.0 26.09% 31.0 40.91% 2023-11-19T14:44:43
5499 llvm-arm-master-O3:39854125689749889 execution_variation 458.sjeng 0092 (llvmorg-18-init-12183-gb9975cec0ea0), 0094 (no-change) 138.0141.0 2.17% 73.0 -56.55% 2023-11-19T14:44:43
5500 llvm-arm-master-O3:39854125689749889 execution_variation 429.mcf (avg) 0092 (llvmorg-18-init-12183-gb9975cec0ea0), 0094 (no-change) 7.013.0 85.71% 22.0 266.67% 2023-11-19T14:44:43
5501 llvm-arm-master-O3:39854125689749889 execution_variation 401.bzip2 (avg) (percentage) 0092 (llvmorg-18-init-12183-gb9975cec0ea0), 0094 (no-change) 0.590.66 11.86% 0.83 40.68% 2023-11-19T14:44:43
5502 llvm-arm-master-O3:39854125689749889 execution_variation 458.sjeng (avg) 0092 (llvmorg-18-init-12183-gb9975cec0ea0), 0094 (no-change) 138.0141.0 2.17% 73.0 -56.55% 2023-11-19T14:44:43
5503 llvm-arm-master-O3:39854125689749889 execution_variation 429.mcf (unexplained diff vs previous) 0092 (llvmorg-18-init-12183-gb9975cec0ea0), 0094 (no-change) 16.047.0 193.75% 52.0 2500.00% 2023-11-19T14:44:43
5504 llvm-arm-master-O3:39854125689749889 execution_variation 429.mcf (avg) (percentage) 0092 (llvmorg-18-init-12183-gb9975cec0ea0), 0094 (no-change) 0.080.14 75.00% 0.23 228.57% 2023-11-19T14:44:43
5505 llvm-arm-master-O3:39854125689749889 execution_variation 429.mcf 0092 (llvmorg-18-init-12183-gb9975cec0ea0), 0094 (no-change) 7.013.0 85.71% 22.0 266.67% 2023-11-19T14:44:43
5506 llvm-arm-master-O3:39854125689749889 execution_variation 462.libquantum (avg) (percentage) 0092 (llvmorg-18-init-12183-gb9975cec0ea0), 0094 (no-change) 0.160.2 25.00% 0.27 80.00% 2023-11-19T14:44:43
5507 llvm-arm-master-O3:39854125689749889 execution_variation 462.libquantum (unexplained diff vs previous) 0092 (llvmorg-18-init-12183-gb9975cec0ea0), 0094 (no-change) 63.067.0 6.35% 51.0 292.31% 2023-11-19T14:44:43
5508 llvm-arm-master-O3:39854125689749889 execution_variation 401.bzip2 (avg) 0092 (llvmorg-18-init-12183-gb9975cec0ea0), 0094 (no-change) 66.075.0 13.64% 94.0 42.42% 2023-11-19T14:44:43
5509 llvm-arm-master-O3:39854125689749889 execution_variation 462.libquantum (unexplained diff vs previous) (percentage) 0092 (llvmorg-18-init-12183-gb9975cec0ea0), 0094 (no-change) 0.430.45 4.65% 0.43 377.78% 2023-11-19T14:44:43
5510 llvm-arm-master-O3:39854125689749889 execution_variation 458.sjeng (avg) (percentage) 0092 (llvmorg-18-init-12183-gb9975cec0ea0), 0094 (no-change) 0.991.0 1.01% 0.52 -56.30% 2023-11-19T14:44:43
5511 llvm-arm-master-O3:39854125689749889 execution_variation 401.bzip2 (max) (percentage) 0092 (llvmorg-18-init-12183-gb9975cec0ea0), 0094 (no-change) 1.151.02 -11.30% 0.65 -44.44% 2023-11-19T14:44:43
5512 llvm-arm-master-O3:39854125689749889 execution_variation 458.sjeng (max) 0092 (llvmorg-18-init-12183-gb9975cec0ea0), 0094 (no-change) 356.0340.0 -4.49% 136.0 -61.80% 2023-11-19T14:44:43
5513 llvm-arm-master-O3:39854125689749889 execution_variation 401.bzip2 (unexplained diff vs previous) 0092 (llvmorg-18-init-12183-gb9975cec0ea0), 0094 (no-change) 130.0113.0 -13.08% 74.0 -44.78% 2023-11-19T14:44:43
5514 llvm-arm-master-O3:39854125689749889 execution_variation 458.sjeng (max) (percentage) 0092 (llvmorg-18-init-12183-gb9975cec0ea0), 0094 (no-change) 2.522.4 -4.76% 0.97 -61.51% 2023-11-19T14:44:43
5515 llvm-arm-master-O3:39854125689749889 execution_variation 458.sjeng (unexplained diff vs previous) (percentage) 0092 (llvmorg-18-init-12183-gb9975cec0ea0), 0094 (no-change) 0.160.18 12.50% 0.61 281.25% 2023-11-19T14:44:43
5516 llvm-arm-master-O3:39854125689749889 execution_variation 429.mcf (max) 0092 (llvmorg-18-init-12183-gb9975cec0ea0), 0094 (no-change) 16.047.0 193.75% 52.0 372.73% 2023-11-19T14:44:43
5517 llvm-arm-master-O3:39854125689749889 execution_variation 401.bzip2 (max) 0092 (llvmorg-18-init-12183-gb9975cec0ea0), 0094 (no-change) 131.0116.0 -11.45% 73.0 -44.70% 2023-11-19T14:44:43
5518 llvm-arm-master-O3:39854125689749889 execution_variation 462.libquantum (max) (percentage) 0092 (llvmorg-18-init-12183-gb9975cec0ea0), 0094 (no-change) 0.430.46 6.98% 0.43 26.47% 2023-11-19T14:44:43
5519 llvm-arm-master-O3:39854125689749889 execution_variation 401.bzip2 (unexplained diff vs previous) (percentage) 0092 (llvmorg-18-init-12183-gb9975cec0ea0), 0094 (no-change) 1.130.99 -12.39% 0.65 -44.92% 2023-11-19T14:44:43
5520 llvm-arm-master-O3:39854125689749889 execution_variation 458.sjeng (unexplained diff vs previous) 0092 (llvmorg-18-init-12183-gb9975cec0ea0), 0094 (no-change) 28.026.0 -7.14% 86.0 290.91% 2023-11-19T14:44:43
5521 llvm-arm-master-O3:39854125689749889 execution_variation 429.mcf (unexplained diff vs previous) (percentage) 0092 (llvmorg-18-init-12183-gb9975cec0ea0), 0094 (no-change) 0.170.48 182.35% 0.54 2600.00% 2023-11-19T14:44:43
5522 llvm-arm-master-O3:39854125689749889 execution_variation 462.libquantum 0092 (llvmorg-18-init-12183-gb9975cec0ea0), 0094 (no-change) 23.029.0 26.09% 31.0 40.91% 2023-11-19T14:44:43
5523 llvm-arm-master-O3:39854125689749889 execution_variation 462.libquantum (max) 0092 (llvmorg-18-init-12183-gb9975cec0ea0), 0094 (no-change) 63.067.0 6.35% 50.0 2.04% 2023-11-19T14:44:43
5524 llvm-arm-master-O3:39854125689749889 execution_variation 401.bzip2 0092 (llvmorg-18-init-12183-gb9975cec0ea0), 0094 (no-change) 66.075.0 13.64% 94.0 42.42% 2023-11-19T14:44:43
Change State Split Delete