Is it safe to use condoms in water, under water (shower, bath, hot tub, swimming pool, etc.)?

No harm. As the described scenarios should place you at any health risk. It likely will compromise the effectiveness of a condom, as it can "wash away" any spermicide and promote a condom "slipping off".