If I start taking atenolol for svt, will I be taking it forever?

Beta blockers. If you stop taking it the risk for svt is greater. Consider ablation with a cardiologist/electrophysiologist.
Ablation svt. unless you have catheter ablation, most likely yes. you can consult me on further info on ablation.