I don't think this has to be a big deal. When Christ was on the earth he said not to give the priesthood to the Gentiles, and even to not preach to them. The priesthood has been banned due to skin color or race, or culture, before and having it in the last century should be no big deal.
Some people may view it as racist old men, but it's God, and God's ways are not man's ways (Isaiah 55:8). God is the same today, tomorrow, and yesterday (Hebrew 13:8) and will not change because of man. What may be perceived as 'racism' is not if it's God. He decided when it would change, and change it did eventually. If you believe in the Bible then there is no issue here.