Thought I had an ingrown hair on labia it seems to be getting worse is swollen looks like a grouping and really hurts if touched, could it be herpes?

It could be. Genital lesions must be visualized to determine the cause. What you describe sounds like an infection of some sort. Herpes is one possibility but there are others. Consider seeing an Obgyn or attaching an image in a virtual visit with a Healthtap in your state to narrow down the cause.