If you have only a small amount of pain/swelling and you can "walk it off", then ok to wait.
But, if soreness persists 7 days without 50% improvement , then get examined. A common error physicians make is to not be concerned if the pain persists after 7 days. There are "hidden" injuries that are missed. The minimum is a repeat xray. If the xray is ok, then get an orthopedic surgeon evaluation.