Is it normal with IBS to feel like you have to keep having a bowel movement but can't?

YES. This condition is called ibs-c or constipation type. You should be thoroughly examined by a physician and ask about prescription medication for same.