There are many different chemicals in fire extinguishers these days.
None of them are very healthy to inhale in large quantities but "a little bit" is hard to quantify. I would suggest that you check the fire extinguisher and find out what is in it and then google the material safety data sheet (msds) for that substance. This lays out all the health risks associated with the chemical in question.
Answer assisted by David Miller, Medical Student