What causes someone to be allergic to different pollens?

Many factors. The most important factors that lead to allergy are genetics (inheritance from parents) and exposure. Therefore, you are more likely to develop allergy to pollen if you parent(s) have similar allergies, and if you live in an area (southeast) with lots of pollen.