If i don't wear my glasses for astigmatism will my vision get worse . ?

You won't C as well : Astigmatism is due to an unevenly curved cornea, that when light's reflected in, it doesn't produce a point focus on the retina. Your vision may not get worse, but you'll see blurry images w/o correction. If you don't like glasses, ask for a contact lens prescription that you can wear during the day, as it's often best not to wear it full time, so that your eyes can take a break, and just use your glasses.