Talk to your doctor
Noone can fully answer this question except the doctor who put you on the medication in the first place.
The answer depends on how severe or persistent your illness is. If you continues to urinate and have to drink water often, then you are not ready to go off it. Talk to your doctor about your individual condition.