Will my teeth shift after having extraction?

Probably. Over time. Most missing teeth should be replaced. See your dentist for an e-valuation and discussion of treatment options.
Teeth shifting. Yes they can depending on the location see the dentist who removed the tooth and plan on a replacement tooth.