I have a yeast infection I just started taking vaginal OTC and probiotic acidophilus but in reading do I only need to take acidophilus pills?

What do you mean by. "vaginal over the counter"- is this an anti-fungal medication? If yes, in most cases this combination should be fine. Oral probiotics are fine (vaginal probiotics aren't necessary).