Genes, may be
If you are discovering it now, ask the female how long has she noticed these to be the case.
While there are some medical medical conditions, like obesity
, sagging breasts etc. in majority of cases it is genetically determined. In some cases stimulation can cause nipples to revert to normal position and the problem can affect one or both sides.