Is it normal to have a mucus like substance come out when I have a bowel movement? I am a very constipated person.

Yes. Costipation and mucous secretion suggest irritable bowel syndrome buut other conditionscan cause thei and the diagnosis of ibs may only after a workup with a colonoscopy seek medical evaluation especially if you have any family history of intestinal problems.