Are there some genetic reasons I get anorectal abscess off and on?

Possibly. Anorectal abscesses may be related to inflammatory bowel disease such as crohns or ulcerative colitis and/or fistulis tracts in the rectal area. This problem can be serious if not treated and should be evaluated by surgical eval and GI eval.