I think I might have foos allergy; should I go to the doctor or just keep taking benadryl (diphenhydramine)?

Definitely get check. You should definitely determine what you allergic to. It's common to find other things you are allergic to. The severity may change over time as well, and you should be wary of it and have an emergency kit available, just in case.