What can you put on a blister in your mouth to relieve pain? Baby orajel?

Oral blister. Orajel, anbesol, or viscous Lidocaine (prescription item) would all make sense. They tend to help some but are not dramatic cures. If you see a doctor there are certain treatments s/he can try like silver nitrate application or cortisone injection.