Would it be safe to eat fish, say, every other day even though they have mercury in them?

Yes. You might want to choose fish that are low in mercury. (farm raised catfish for example) limit your intake of tuna and swordfish or other big fish that have to eat lots of little fish to survive.