Your body cannot break down the material like it does with food.
Therefore, the biggest concern is that it passes through your esophagus, GI tract, etc. Without causing bleeding or other problems. It depends on how large the piece was and how sharp it was. If you have any discomfort breathing or swallowing, or if you have blood in your stool, then definitely consult your physician.