If your water source is safe to drink, it is perfectly ok to switch - and alot cheaper for you too.
If breast feeding
just hasn't worked out for you and you use formula
, just make sure you mix according to directions. You don't want to cheat your baby out of the nutients she needs for optimal growth by mixing wrong. And remember not to shake hard before feeding - you will end up with gas!