The man's sperm
of a baby is determined by the two sex chromosomes inherited from the parents.
A baby will normally inherit one sex chromosome from the mother, and one from the father. A woman has two x chromosomes, so she can give either of her x chromosomes. The father can give either his x or y chromosome. A baby girl has 2 x chromosomes and a baby boy has 1 x and 1 y chromosome.