Is it safe to have fertilizer in our garden while i am pregnant?

Yes: Studies/research in human pregnancy are limited with anything that may cause harm to baby. So there is not any great evidence either way on these things. Limiting exposure in the first trimester is usually recommended. But realistically, it's most likely fine. If you are breathing and oxygenating well (not passed out), so is your baby because they hold onto oxygen better than you do.