How much will a caffeine withdraw affect someone with generalized anxiety?

Eventually help: Caffeine use can worsen anxiety, because it increases many of the physical symptoms of anxiety. So, getting off caffeine will be a good idea for people with generalized anxiety. Depending on how much you rely on caffeine, withdrawing from it can be a challenge though. Prepare for a few days' tiredness, maybe headache, flu-like symptoms. Tylenol (acetaminophen) helps. Will be better for you in the long-run.