Does scrubbing with a washcloth safely remove dry skin off the face?

Yes. Do not be overly aggressive. There are devices for home use that microdermabrasion the skin and even infuse anti aging products such as clarisonic.