Can food intolerance ( not allergy) lower down our immune system? also ,can it cause muscle or joint pain ?

Basics: Stress on your system will reduce its ability to respond to any immune or other challenge. If you know you have a food intolerance & avoid it, your system returns all response to baseline levels. If you consume the material & trigger any significant symptoms you would see a transient decline in response. That decline is not permanent.