Could IBS affect male fertility?

No. Ibs is an inflammatory disease of the bowel. It does not affect the testicles and should not cause infertility.
Yes. Any medical condition that affects overall health can affect male fertility. The specific issues with ibs are fevers and weight loss, both of which can impair male fertility.