I am a big fan of enjoying your baby at home with little outside influences for the first month of life.
After that, entrusting good people to take care of your baby is a very important decision. It is good to get away as a couple to keep that 'spark' alive. It is all a fine balance. But think common sense.