Here is what it saids about wearing temple garments in Handbook 1 Stake Presidents and Bishops since their seems to be some confusion over this. 3.4.5 Wearing and Caring for the Garment Church members who have been clothed with the garment in a temple have taken upon themselves a covenant obligation to wear it according to the instructions given in the endowment. When issuing temple recommends, priesthood leaders should teach the importance of wearing the garment properly. Leaders also emphasize the blessings that are related to this sacred privilege. These blessings are conditioned on worthiness and faithfulness in keeping temple covenants. The garment provides a constant reminder of the covenants made in a temple. When properly worn, it provides protection against temptation and evil. Wearing the garment is also an outward expression of an inward commitment to follow the Savior. Endowed members should wear the temple garment both day and night. They should not remove it, either entirely or partially, to work in the yard or for other activities that can reasonably be done with the garment worn properly beneath the clothing. Nor should they remove it to lounge around the home in swimwear or immodest clothing. When they must remove the garment, such as for swimming, they should put it back on as soon as possible. Members should not adjust the garment or wear it contrary to instructions in order to accommodate different styles of clothing. Nor should they alter the garment from its authorized design. When two-piece garments are used, both pieces should always be worn. The garment is sacred and should be treated with respect at all times. Garments should be kept off the floor. They should also be kept clean and mended. After garments are washed, they should not be hung in public areas to dry. Nor should they be displayed or exposed to the view of people who do not understand their significance. Members who have made covenants in the temple should be guided by the Holy Spirit to answer for themselves personal questions about wearing the garment.