What should I do if I just found that I have a breast abscess?

See a surgeon. Unless related to preganncy (and in that case see your ob) most breast abscesses need drainage - sometimes with a needle, but often surgical.