I just had a Bartholin's abscess removed surgically and I wanted to know if it's okay to have sex with same guy again?

Guy doesn't matter. Bartholin's gland abscesses are not due to sexually transmitted infections. So the partner doesn't matter, just be sure you are all healed up.