Supposedly my ovaries don't sit "right" in my body, they aren't sitting on each side of my unterus could this cause me to have a hard time concieving?

No: There is no such diagnosis as ovaries not sitting right. The problem conceiving probably has nothing to do with the position you ovaries are in, rather than their function or the ability of the egg cell to move from the ovary to the uterus through the tube connecting the two.

Ovarian postion: The ovaries and tubes in most women move around. If fixed in position due to adhesion's and/or scar tissue the tubes may not be able to pick up and egg and pregnancy decreases.