When should I be concerned about mild left ear pain?

See your doctior. You need to be examined by your doctor to learn the cause of your pain.