Can being on a diet reduce my sperm?

No, unless. Not being on any reasonable diet. Crash diets, fad diets, and the worst of all - the 'hcg diet' - may possibly cause problems.