One reason why as adults we don’t have many—arguably any—true memories of life before our third birthdays is that we were not skilled language users at the time, able to frame, ponder, and store away our experiences. It might be the case that while we can have physical, bodily memories of events, people, even thoughts and moods, what we mean by “memories” is something facilitated only by the advent of linguistic competence.
