What's the best way to remove an ingrown hair on my neck? crusty skin keeps growing on top of it, and picking away at it is just making it worse.

Ingrown hairs: Wikipedia has a very nice illustrated set of treatment steps at: http://www.Wikihow.Com/remove-an-ingrown-hair . Usually ingrown hairs are not difficult to treat and will go away on their own if left alone. From the difficulties you are describing i would be suspicious that something else might be going on, either an infection needing antibiotics, or something like a skin cancer.