Is it possible to stop taking prednisone for a while?

Possibly. It depends on why you are on it and how long that you have been on prednisone. If you have been on it a while, it has to be slowly tapered off. The speed of the taper is very individualized as every patient is different.