Can I have a latex allergy and not react to condoms? But react to other latex?

Yes and No. There are condoms that are not made of latex, particuarly polyurethane and lambskin. If you have a latex allergy, you will react to all other latex.