Can my vision get worse if I always wear glasses?

No but... If you have the right prescription you will get used to seeing clearer so by comparison your vision without glasses may seem worse. Over 40 your reading vision will gradually get weaker as you age whether or not you were glasses.