Can you tell me if i switch from glasses(prism lens) to contacts(different prescription) will that cause unusual discomfort?

Depends: If you have double vision when you don't wear your glasses with prism, then you will have it with contact lenses. If double vision is not a problem for you, then contacts will likely work.

It can: Contact lenses do not correct for ocular misalignment like prism glasses can. If you need prism to avoid discomfort, then contact lenses are not a good choice for you.