Does cancer chemotherapy usually make a woman sterile and unable to have future children?

Yes, possible. Yes possible, some of the chemo therapeutic agents will.
Not all chemo. Yes, some chemo (alkylating agents) can affect fertility and increase the risk for woman to be sterile/ lost of the ovarian function. However, not all chemoterapy do that. Also will depend on the type of chemo, the cumulative dose received , the intensity and the age of the patient. The lost of the ovarian function can be temporary or permanent.