Is there anything I can do to deal with the pain of otitis externa?

Pain meds? Have you tried some oral pain meds, like tylenol (acetaminophen) or ibuprofen? There are some ear drops that have anesthetic in them there are also ear drops with steroids, which work as an antiflammatory to help reduce pain and swelling.
See an ENT. For more details, see my patient information sheet at http://www.Richmondent.Com/assets/downloads/ear-nose-throat/ears-hearing/swimmers-ear.Pdf.