I woke up yesterday with a swollen red face. Used benedryl assuming I had an allergic reaction to a cream. Today hasn't changed too much. Aloe burns.

Sounds more serious. Consider a visit to local physician/urgent care for evaluation for other offending agents and treatment with stronger meds. Do it now because protection of your delicate facial structures is important. Let me know how you respond to care.