Does drinking water safety vary from city to city?

Yes. There are federal standards for safety, but the basic quality of the water varies greatly and the amout of chemicals added or already in them varies. There are a number of companies that will test your local water for safety and filter recommendations. Your local water quality is public information and avail. Directly from your city or other web sites.