How much should I worry about calf pain?

Depends. It depends on the severity, frequency as well as the when and how. What makes it better or worse. One leg, both legs. Is it associated with swelling? Are there general health issues? Are you at risk for peripheral vascular disease? Do you have low spinal problems. Or does this come on only after vigorous exercise?