Is there a non-prescription substitute for desoximetasone?

No. Low strength steroids (hydrocortisone) are available over-the-counter without a prescription but Desoximetasone is much stronger and only available by prescription.