A benign tumor differs from a malignant tumor in that a benign tumor isn't supposed to kill you?

Generally yes. Most benign tumors are not capable of spreading an invading distant organs. That being said, there are rare examples of benign tumors that get so big that they can cause major symptoms and medical problems. Thankfully, these are pretty unusual.