Too many thing
The causes of male infertility
are vast and include really non-specific things related to lifestyle, drug / alcohol
use, general health.
More complicated anatomical, genetic, hormonal causes can also be a cause. Best place is to start with pcp, maybe a semenanalysis if appropriate, then onwards to a specialist in male infertility.