Would my teeth move after braces even if I wear my retainer?

Yes. You are a living, breathing entity. Your body will change throughout your lifetime. Retainers will minimize movement if worn as directed. If not worn as directed, expect relapse.