How can we get our baby to sleep though the night at 4 months?

It is too soon. At 4 months, you still need to respond to your baby at night. Many babies still need to eat at 3-5 hour intervals at this age. Ask again when your baby is 8-9 months old if he/she is still waking at night.