I had a boil between my inner thigh and vagina, it burst/drained last night, but won't stop bleeding. Do I go see a doctor about it, or is it normal?

See a doctor before. secondary bacterial infection insues. Pus should come out but not continual bleeding. There's something more going on, and it requires medical attention quickly if it hasn't stopped bleeding yet.
Go see the MD. If it won't stop bleeding is a sign that it may not be a simple "boil" but something more of concern.