Adultery is a huge sin. There are only two things in this world that directly effect life and God protects zealously. That is the ability to take life out of this world and to bring life into it. God has foreordained mankind with the rights to create life, but only within the bonds of marriage. Without the bonds of marriage it is the most despicable sin below murder in the sight of God.
I have made mistakes regarding chastity in my life, but have worked them out with my bishop and vowed to never return to them. Remember, your bishop is not just there to confess to, but to be a spiritual coach to give you the strength to push through this rough spot in your life and give you the strength to forsake the sin forever.
That being said, the bishop is the coach not the player. He will tell you to go do something and then report. To exercise and then turn in your exercise logs essentially as an analogy. It is not his responsibility to set up the meetings or to do these tasks for you. That is left up to you. Your bishop has not forgotten you, in fact, he is probably more concerned than you could imagine. (Again take this from somebody experienced.) He wants nothing more than to help you over come this, but you have to take the action. You need to get a hold of the clerk in your ward and set up an appointment with him (or even recurring appointments, such as an appointment at the same time every other week.) This will help him to help you and your wife.
Lastly, this is a hard thing to deal with, but if you turn to the Lord and look to him to make you stronger. Let him bear the weight of the yoke for you, you can make for as the lord said, "For my yoke is easy, and my burden is light." (Matt. 11:30 KJV) Pray for strength and know that you shall receive what you ask for and are in need of with full faith and it will be given to you.
Best of wishes and luck to you and your wive. Forever lean on the Lord.
-SomebodySomewhere