Ask your OB
There is some concern about maternal body temperature increases and the high temperatures that are experienced by a growing fetus.
In general, baby's temp is 2 degrees higher than the mother. These higher temps have been associated with higher rates of neural tube defects in the first trimester. Short baths are thought to be safe. Long, sweaty experiences in hot baths/tubs is not recommended.