Are there ways to make sure I'm drinking safe water without wasting any money?

Check the reports. If you are drinking water from a municipal water supply, they are required to continually test their water for contaminants and make these reports public. Ask you local water authority for a copy of the report. It may even be available on line. If you are using private well water you will have to endure the expense of having it tested yourself.