A lot of people will simply squeeze a cyst to extrude the cyst contents.
However, this won't actually get rid of the cyst. It may keep it from coming back for a while but it will gradually enlarge. And if the cyst ruptures under the skin the cyst material can really cause a problem. Having it surgically removed is often your best option.