Discuss with him
Not knowing how old our son is is hard to give advice.
Does he know that he is adopted? If so have you put a positive spin on it? Is it fear that he has discussed it? What do you know of his biological and what was the reason? There are questions i would have to know and then i could answer completely. If you have been frank with him it possibly will not matter whether he meets them.