Is upset stomach normal late in pregnancy?

It can be. Some women have nausea off and on the whole pregnancy. Also, certainly dyspepsia and heartburn are very common in the third trimester. I would alert your OB doc at your next follow up to make sure he/she doesn't think its anything to worry about. Gallbladder issues are fairly common in pregnancy too.