If you drink to much water do you get a headache from it?

Yes. Water intoxication can cause low serum sodium, which in turn can cause cerebral edema and even seizures. Headache is a symptom of cerebral edema. If headaches persist even after you stop drinking too much water, you need to see a doctor.