Should I be worried about a pain above my ovary?

How often. If it is persistant you should see your ob/gyn....If not it may be an infection.