How can I quit waking up multiple times per night?

Depends. Awakenings can be normal or signal a sleep disorder. So what you should ask yourself is whether the arousals from sleep are due to a reversible sleep disorder. Knowing what it is will guide the therapy process. For example the treatment for sleep apnea completely differs from treatment of insomnia with awakenings. I would recommend talking with your physician first ti find out.