It takes a few days after fracture
for swelling to start to decrease.
The pain from a fracture gradually diminishes as the fracture begins to heal and become stable. Until then ther may be some pain at the fracture due to the normal muscle paul on the fracture fragments. If the pain is unchanged for a couple of weeks, see your doctor.