What happens when you start loosing gray matter?

Varies. There are many patterns and ages for this to be noticeable. Generally the first thing that becomes a bit of a problem is the remembering of names and faces. Later word search gets more difficult. And there is the classic "where did I leave my (keys, car, wallet, coffee cup, etc.)? This is a slow evolution over many years in the elderly (you are way too young).