Infected hair follicle above lip that tingles, what should I do?

Depends. Mild folliculitis usually heals on its own in about 2 weeks. You can take care of yourself at home with warm compresses made with white vinegar or burow's solution. These may ease itching and help healing. Also, medicated shampoo can be used to treat folliculitis on the scalp. If the infection doesn't go away, you may need an antibiotic or antifungal cream.