There's a random scar on my nipple/breast, should I be concerned?

Have it checked. If there was no prior history of injury, surgery, or rash to the area, the scar could represent a skin lesion. Have it checked by a board certified dermatologist.
Did you have surgery. Or a cut/bite? Scars do not just appear.