Can cigar smoke affect me?

Cigar & cancer. You may not inhale cigar smoke into your lungs, but you could get cancer within the oral cavity from cigar smoke.
Yes. Depends upon whether you are the smoker or getting second hand smoke. All smoke of tobacco origin is toxic and potentially carcinogenic. If you are smoking - stop. If around someone smoking ask them to go outside or go to another corner of the room.