If my uterus points one way and my cervix another is labor going to be more difficult for me?

No. When the baby grows, everything lines right up. By the time of delivery, the cervix will be pushed to point straight down, and the uterus will be pointing straight up!