See a hand orthopod
He/She can confirm diagnosis and inject with a steroid and if necessary cut it out.
It can recur though. In the "old" days they used to smash the cysts with a heavy book, such as the Bible. You wait until it bothers you enough.