Yes and Try to Stop
It very well could be infected.
Toothpicks can easily injure your soft tissues. If it is mild, usually it will get better with some warm salt water rinses. If it last more than a few days, you should see a dentist. The more important thing is to try to keep those toothpicks away from your gums. Eventually, you'll be glad you did!