Sorry, but it was too easy to respond by saying to stop the ne thing that causes pain! seriously, if using he joystick causes severe pain, it is likely related to overuse and irritation of nerves, tendons or muscles.
Trying a different grip, the other hand or decreasing use could help. If more pain or symptoms change get checked. Do get some outdoor exercise