I read through all the comments and found some great suggestions. Clearly this is a case with more details that aren't known to all the readers. Granted, I am not sure you would want to share all the details in such a public forum.
I wonder if involving your Bishop (assuming you are LDS) might not be a wise step. If he is already involved ignore this post. If he isn't you might consider bringing him into the situation. They often are aware of others struggling with similar challenges. They can also listen to all the parties involved and through inspiration and the keys they hold offer counsel. Finally they have access to vast counseling resources. As a sitting Bishop I know these situations can be very difficult and are often complicated. All the best to you and your children.
