My index finger has been swollen around the nail for two weeks and the skin below the nail just started getting yellow, should I be worried?

Sounds like infected. This sound like a bacterial infection and the yellow color makes me wonder about pus. Infections in the nail area and end of the finger can be tricky because the room for expansion is limited. I think this might need to be opened and drained.