Is it normal to have a fleshy bump/lump at the base of the vaginal opening?

Possibly. You may be feeling a remnant of the hymen. I would ask your doctor next time you have an exam. If it isn't painful i wouldn't worry about it. But do ask when you have your next pelvic.