Is it common to have breathing difficulty during your pregnancy?

Depends. Many women will have a gradual elevation of the diaphragm due to the enlarging baby during the late 2nd and 3rd trimester. They may need more effort to take a deep breathe. Some may need to sleep with more pillows. If one has sudden shortness of breathe they should consult their md asap.