Would it hurt me if I had sex 3 weeks after delivering a baby instead of 6 weeks?

Probably not. Unless there has been some unhealed injury to your reproductive organs, it should not be harmful to resume sexual intercourse 3 weeks after delivery. Be sure to use contraception unless you want to get pregnant again.