Yes, but rare
An infection of the ear can occasionally spread into the inner ear
and lead to damage of the hearing hair cells.
With some infections new bone will fill in the fluid filled spaces of the inner ear. Both of these changes would be permanent. Fortunately, the barriers to bacterial spread make these unusual events.