Is there any over-the-counter antibiotics I can take for a abcess in the tooth?

No. Antibiotics are prescription medications for good reason. There a multiple kinds of antibiotics and the prescriber has to know which ones will work for a particular situation. Antibiotics don't cure infections, they help your body fight them. A tooth abscess needs to be treated by a dentist. It will not go away with antibiotics.