Big change in vision during annual exam -should I worry?

Depends. On the reason for the change -- reversible/correctable or irreversible.