CAN you? Of course!
But SHOULD YOU stop your medication? That's a different question and perhaps more appropriate.
You should never readjust your medications or their doses without checking with your doctor. If the side effects are simply intolerable then, fine but make every effort to contact the physician tout de suite and let them know. They'll want to substitute with something else in all likelihood.