How premature does my baby need to be in order to worry about ivh?

Less than 32 weeks. The younger the baby at birth (gestational age), the chances for ivh increase. Usually >32 weeks, the ivh potential drops down.
IVH. The risk of ivh increases significantly if the premature birth occurs before 32 weeks of gestation (a full term baby is born at 40 weeks) or earlier.