How long do the anxiety symptoms usually last for after starting a new drug or upping the dose?

Depends on the med. If you are being treated with a benzodiazapine, you may feel the effect right away. If you are being treated with an ssri it may take a couple of weeks (or longer) once you have reached an adequate dose.