The Bible does not provide any justification for this.
"For this reason a man shall leave his father and his mother, and be joined to his wife; and they shall become one flesh." (Gen 2:24)