Do you think I was mis diagnosed? I was told I might be infertile. No one in my family has that.

Unknown. Infertility often doesn't run in families. Most of the causes of infertility are not genetic so having a negative family history doesn't really make any difference but you might want to check with someone who has a specialty in infertility to be sure.