I think i have a yeast infection, would an over the counter work or do i absolutely have to go to a gyno?

If you have typical vaginal yeast symptoms (itching and irritation, only scant discharge [or none], and not much odor), then go ahead and try an OTC treatment. Any of several products with active ingredient ending in "azole" will work well. If it doesn't work, i.e. no change in symptoms after a few days, at that point you'll definitely need to get in-person care. Good luck.