What happens when your baby's chest sinks in (instead of rises) each time he breathes?

It is usually normal. Infants have soft bones, including ribs. Many babies will have "paradoxical chest movements" as you described. In most cases, it causes no problems and the baby will outgrow it. If your baby has trouble breathing or feeding due to the chest motions, consult your doctor right away.