A specialist eval
The real issue is sperm function. Men w/ poor function often have low count, motility and few normally shaped sperm. Causes run from genetic, heat (sauna, hot tub), medication (androgens for body-building), recreational drugs, extreme sports, unknown and others (no room here). Treatment based on cause but ivf/icsi works if needed.