I am35 weeks pregnant and drinking baking soda with water for bad heartburn, is it safe?

No. That doesn't sound very appetizing. Consider Tums or rolaids which are antacids, which are also likely easier on the stomach. Also Pepcid or zantac (ranitidine) which are h2 blockers and safe in pregnancy. Best of luck.