What causes a man to have infertile problem?

Multiple. Many are born with abnormalities in sperm production. Some lose production ability with time. Infections can block tubes, vas deferens, that take sperm to the outside. Trauma or surgery can cause problems. Some have hormone problems that affect the sperm production. Drugs such as BP meds or steroids for weight lifting or sports can do it.