No less than 2
The brain of an infant is growing so rapidly in the first 2 years that there is a need for a continuous supply of cholesterol & fat to sustain it.
Whole milk provides that support. After 2 the rate has slowed & other dietary sources will be adequate. Whatever the family is normally using will be fine.