Lately it feels like I am wearing a tampon all the time? Could I have prolapse of uterus or something?

Could be. The only way to know for sure would be with an exam by your doctor.
Yes. It may be a uterine prolapse or pelvic pressure from a pelvic mass. Please make an appointment with your gyn who can differentiate between all the possible causes.