Can retainers be tightened to move teeth back?

Oops. If teeth have shifted you're only seeing the tip of the iceberg. If change is minor retainer adjustment may help, but not entirely fix, the problem. Get to orthodontic specialist asap before problem gets worse. If problem severe enough, re-treatment may be necessary, and new result not as optimal as previous result. Don't wait, call now.