Is cayenne and lemon tea safe for pregnant women?

Yes. This is safe for you and the developing baby. There are no adverse effects from this combination.