Does my finger swelling mean it's broken or what?

Or what? Infected, inflamed, fractured, gouty, rheumatoid, injured in soft tissue alone, tendonitis, trigger finger, arthritis , a tumor, vascular disease, cold intolerance, raynauds, many things can cause swelling.
No. Not unless the swelling was caused by trauma. Otherwise, infection or arthritis are more likely causes.