My right hand has numbness and some swelling in the two smaller fingers and my right elbow is tender. I've been icing the elbow should I emoblize it?

Many question though. When and how did this happen? Any injury? Do you have any associated medical conditions like RA or SLE? Do you do repeated work using Right hand? Icing is good . Anti Inflammatory medicine like Advil/Aleve may give you temporary relief. You may need to get examined in person if continues to get worse.