Not a requirement
Patients switch doctors all of the time.
Sometimes it is for lack of results, sometimes for better geography, and sometimes a personality issue. Your doctor is likely to find out you switched when your records are requested to be transfered. Some will tell why they switched because it might improve the behavior of the first physician. Most however, do not tell.