Babies generally have sensitive skin.
If a shirt fabric is stiff or rough, it can irritate the skin. In addition, chemicals in the fabric from manufacturing, or from laundry soap can sometimes cause irritation. Finally, the cute little appliques many shirts have are often sewn into the shirt with a layer of fabric underneath. The edges of that fabric may protrude and irritate skin.