Is it normal to have a little swelling from a stress fracture?

This is normal: All healing requires that your body produces some inflammation to break down and remove the injured tissue and replace the damaged parts with fresh, new parts. How long you take to heal depends on how healthy the injured area is. Give your injury rest, allow it to heal. However, be alert for signs of infection, like redness and excess warmth.

Yes: It is not unusual to have some swelling with stress fractures.