Can you be allergic to apples?

Yes. But it is more common to have a problem only with raw apple, particularly the peeling, due to oral allergy syndrome. This is caused by an allergy to birch tree pollen. Some of the proteins in the apple peel are similar enough to birch tree pollen proteins to cause a "cross reaction." usually this causes only mouth and throat symptoms. Talk to your allergist for more info.