Can breast infections be caused by body soaps?

Drying soap? If a soap was particularly drying or abrasive - it could lead to breaks in skin with possibility of an infection if skin comes in contact with germs.