How often should I take breaks when working out after a broken finger?

Commen sense. There really is no one answer. It depends on what you might be doing. Biking, running, swimming, lower leg activities shouldn't matter. If you are lifting weights, that might become sore for your finger. I would stop if and when your finger gets sore. Hope it helps.