Having neck pain and headaches with increase in heart rate, after a spinal tap.

Be seen. I would just make sure your doctor that did the tap is aware. There are a number of potential complications that can occur with a spinal tap including a spinal headache. Sometimes more needs to be done. Let your doctor know.