Up to you
But wearing underwear won't stop bed bugs
from getting on you.
There is the rest of your body too. Just look for signs of bed bugs when you check in - small black specks between the mattress and boxspring, under the bed sheet, and at the head of the bed. Also, look for unclean bed linens. Just don't use a room or hotel that's unclean.