I have vaginal swelling i think it is a latex or spermicide allergy because we used a condom ?

Could be: However, it could be an infection or even trauma from sex. You might want to try a nonlubricated condom and then another time try to non latex condom to see which is causing the issue. If you have a reaction to either one, I would use an antihistamine if any symptoms like benedryl or zyrtec (cetirizine). This might be a good time to get on birth control as well.