I joined the church last year and my husband is not (a most likely will never be) a member.
Sometimes it's hard, when people are talking about the blessings of have a preisthood holder in the home I sometimes feel lonely. But my husband is supportive of my decision to join the church. We had a good talk about it prior to me joining. I'd suggest you disscuss things like tithing, Words of wisdom and children before joining as these are the issues that would be most difficult.
Please feel free to contact me if you have any further questions, I am very happy with the choice I made to join the church and now that I have the spirit with me I can't imagine not having it.