My nipple feels sore and there's a dull pain while I breastfed my baby. Is this normal to happen?

Yes. It is not uncommon for this to happen paricularly when you first start out. Gently push more breast tissue into your baby's mouth as he begins sucking. You can use vitamin E oil or lanolin on your nipples, this will help soften them. Either way it gets better with time.