Will binge drinking only 3 times in my whole life cause any long term harm if i now don't drink completely?

Seriously doubt it: binge drinking is defined as 5 or more drinks for men and 4 or more drinks for women in a 2 hour period. Episodic, recurring binge drinking is associated with a number of long term injury and physical, emotional, and social health issues. Having stopped use of alcohol and having limited the number of episodes of heavy drinking nearly eliminates your personal long term risks. Be well.

Wise choice: I very seriously doubt you have done any prior harm to yourself, and the decision to avoid alcohol could be a very healthy future approach. Many people your age, are unfortunately highly attracted to recreational drugs and/or alcohol, and these bad choices can often leave lifelong permanent consequences. You have chosen a different path!!