After the first sign of cataracts, when should you have them removed?

Causing problems: Presence of cataracts does not mean they need to be removed. It's worth the risk of cataract surgery, when they are causing visual disability almost every day and cannot be corrected with glasses/contacts.

Depends: If the cataracts are not impairing your vision then it is recommended you wait on surgery. Cataract surgery is usually recommended by your ophthalmologist once your vision can no longer be improved with corrective lenses or if it's becoming a hazard for you to drive in spite of corrective lenses. This is a decision that is made between you and your ophthalmologist.