Do overuse injuries usually go away with rest?

Overuse injuries. Yes unless a chronic inflammation or permanent damage has occurred.
Sometimes. Depends on the type of injury and how much rest is given. Very often, people return to activity sooner than they should and rein jury the area. Rest is truly the key along with common sense care.