Are penicillin allergies usually severe?

Varies. Many penicillin allergies are severe and life-threatening, but a person can have much milder reactions as well. Penicillin allergies can run the full spectrum of severity.
Usually not. Most reactions are mild. It is the rare case when reactions are severe.