I've been having on and off numbness and slight pain in the fingers of my right hand, and less often in my left (excluding my thumbs). i don't have any other symptoms of diabetes; is this something i should worry about?

Numbness in hands: May be carpal tunnel - more common in diabetes. or neck issues ( radiculopathy), or vitamin deficiency (B12 ) or toxins- lead, insecticides. If persistent follow up with neurologist for EMG/ MCS ( nerve conduction) that can detect carpal tunnel syndrome(CTS)vs radiculopathy. Consider a carpal tunnel splint you can get online or in pharmacy - wear to sleep as CTS exacerbates in sleep

COULD BE: something starting or not. Keep track of symptoms, exactly where, intensity an how often. Carpal tunnel starts slow, on off.

Carpal tunnel likely: This sound most consistent with carpal tunnel syndrome (treated with night splints, anti inflammatory meds, decrease in causative activity) or possibly irritation of a nerve in the neck. Diabetic nerve pain does not usually look like this. A doctor evaluation with neurological exam is best if conservative treatment above doesn’t help, or if there is persistent numbness in hands or weak grip