Can a male that was heavy into drugs growing up but has been clean for 5 years have infertility problems?

Yes. Irreversible affects are possible. A simple test of sperm characteristics (count, motility, morphology) would be a good start. If they're normal, then unlikely to be a cause of infertility.
Yes. Any male can have fertility issues. Drugs do effect the sexual hormone areas of the pituitary gland and can reduce function of the testicles. You would expect recovery with cessation of drug use but there are no guarantees. One needs to have testosterone, lh , and prolactin levels as well as sperm counts done.