Could loud noise cause damage to inner ear? or just eardrum?

Yes: Loud noise - whether just one episode or sustained - can definitely damage the inner ear and is one of the single most prevalent causes of non-age-related or congenital hearing loss. Hearing protection and precautions are extremely important - even with everyday devices like headphones. If you area concerned about hearing loss, please see an audiologist and/or and ent. Hope this helps!