That’s just the thing though. I know a lot of members share in your interpretation (and I did too before getting married) but that’s pretty much why I was trying to figure out what those darn temple instructions were. I feel like the instructions in the temple were (are?) to simply wear them throughout your life. That’s a little different than ‘wear them at all times unless you’re doing something that prevents you from being able to wear them’ . It leaves it as more of a personal decision on what that means to each individual. For instance I can wear my garments throughout my life, but still take them off each night to sleep naked with my wife if that’s what we choose to do. (Personally I wonder if that’s one of the reasons they removed the ‘night and day’ wording on the recommend interview but I digress). I understand that the church encourages members to wear them at all times unless we reasonably can’t. I’m just trying to separate encouragement from what we actually agree to in the temple.
I completely agree that the real importance here is that the garments serve as a symbolic reminder of our covenant. Asking whether we should or shouldn’t wear them in x situation is probably the wrong question.