Why would feel guilty as a caregiver?

Common. Guilt is a common emotion experienced by caregivers. It can include feelings that one could have done more, should have known better, would have done differently in retrospect etc. You must take care of yourself as well. Look for support information here: http://www.Nlm.Nih.Gov/medlineplus/caregivers.Html.