How come a child won't remember a memory until 4 years old or so?

Comes with language: Children have memory extremely early in life, its our ability to recall these memories that fades over time. Many people have memory that tracks back before age 4. Typically adults can recall memories that began around the time of language acquisition. Other early memories that may stick are ones that were very different from the norm (trauma or very unique events).