I have lipomas all around my body under my skin, should I worry?

Lipomatosis. This sounds like lipomatosis, however there are a few other syndromes that can do this as well. Most commonly, this is a benign disorder, and causes merely a cosmetic disturbance.
NO unless enlarging . You are probably suffering from lipomatosis which is a benign (non cancerous) genetic disease (autosomal dominant). If one enlarges rapidly or in an area that inhibits fuction or causes pain individual ones can be removed.