The carotid artery in the neck forks into two branches at the ear
Just as in a river fork, flow at the fork is turbulent. This turbulence is what some people hear, even though there may be no narrowing in the artery. Next time you see your doctor have him/her listen over the carotid artery. If there is a bruit (swishing noise) there, an ultrasound study should be obtained.