Could a cyst in my nose be causing me pain?

Unlikely. A "cyst" in the nose would be a rare problem. A cyst might form in a sinus cavity but would be rare in the nose itself. If you are having chronic nose pain you should see an ENT specialist for evaluation.