I have these small red smooth bumps on my vaginal lips. I've just now become sexual active, not even within the past week. How can I get rid of them?

Probably no need. Most likely it's just local irritation from the friction of sex, probably nothing abnormal and likely will return to previous appearance in a few days. If not, or if you otherwise remain concerned, see a doctor to be sure. I hope you're using adequate contraception and condoms to prevent STDs and HIV; and that you have been immunized against HPV. If not, ask your doctor about the vaccine.