Up to you!
The term "middle age" isn't in my opinion, a medical term with a clear definition of a start and end point.
I think traditional medical age related associations don't really hold true as often.
We are seeing young patients with diseases of older people, and we have older patients with bodies, health and attitudes of much younger patients.
You are as young as you want to be ;-).