Can a chest infection cause permanent damage?

Yes. It can cause bronchiectasis when some of the air tubes become blind alleys when they should be conducting air to your lung tissue. If may also destroy part of your lungs -depending on the type of infection.