Should I be very concerned with the bump on my gums?

Proper diagnosis. This is really a question for an oral surgeon. You do not tell us if it is painful or is it enlarging. Differential diagnosis includes, periapical abscess, fibroma, lipoma, or an inflammatory lesion. Yes, you should be concerned, because you do not know what is the diagnosis. See an ENT or an oral surgeon for lesions of the oral cavity.
Yes, if..... The bumps are getting bigger, if they are painful, bleeding or increasing in number. All that said, bumps on the gums are not normal. Have your dentist take a look and take x-rays if needed.