You can be blood brothers or blood sisters but be separated in the spirit. You can be married on paper but be separated spiritually. A person can be there in person but be absent.
Esau and Jacob were at war even in the mother’s womb.Genesis 25:23 And the LORD said to her: “Two nations are in your womb, Two peoples shall be separated from your body; One people shall be stronger than the other, And the older shall serve the younger.”
What must keep you, is spiritual significance of your union.