Do not wait. The sooner your see a hand specialist the better chance you have of healing of the bone.
Wait and you run the risk of a non-union and more difficult surgery. Please go see your doctor! soon..............Yesterday, or at least when his office opens, preferably.