When someone wants to fight with me,be it indoors or on the street in a close fight,after 3-4 minutes of fighting i end up panting and exhausted.because of which i take a lot of hits from attackers. what can i do to get rid of this panting and tired?

Fighting is a very strenuous exercise not to mention the “fight or flight” response that occurs from being attacked. It is really not surprising that you have these symptoms. But, if you think you are getting shortness of breath with more minimal activity, then see your doctor for an evaluation. Why are you being attacked? Perhaps avoiding that is important for your health. Good luck!