I really love to garden. It feels good to dig my hands in the warm soil. Should I still do that if pregnant?

Yes -- with gloves. It sounds like you kinda already know the question! people (including pregnant women) are at higher risk of contracting toxoplasmosis from gardening than from litter boxes.