Can I spray for bugs around the baby?

Not a good idea. I'd have the baby away from any area you are going to spray for bugs for at least 48 hours. If you are going to spray any surface, like a carpet, I wouldn't allow him/her to be on it until after a week, and you've vacuumed a few times.