Wbc's down from 8 to 4.4, lympho abs down from 2300 to 1008, no energy, light brown yellowish stools, all in last three weeks. should i be concerned?

In a word "yes" but: While the number you stated are certainly NOT alarming, they would seem to confirm that something is going on, serious or otherwise. I would more concerned with a significant change in bowel habits & stool and your perception of fatigue. Since you had blood work twice, I assume you are being followed by a physician and recommend you follow up.