What would cause bad burning in my chest, and back?

Burning sensation : The key to medicine is getting a thorough detailed history of your symptoms and then do a complete and thorough physical examination and when appropriate laboratory and imaging examination. Then when all of the information is available you can have a discussion with your physician and plan what to do to treat it and avoid having it again!