I had sex a few days ago and I'm noticing that one of my breasts are sore to the touch. I have never had tender breasts ever. Should I be concerned?

Probably ok. Do a self breast exam, and if there are no changes in your breast you can probably just wait and see if the symptoms improve over the next few days. If they don't or the pain worsens, then I would recommend that you see your doctor.