Yours is the type of problem that can really only be addressed with a physical exam, so not really going to be able to tell you definitively over the internet what the pain in your breast is due to. Commonly, hormones are the #1 cause of breast pain
. But why not see another doctor for 2nd opinion so you can rest more easily. Best of luck.