What organs are not part of the immune system?

All organs. The immune system functions to a degree in all the organs of your body. So, an infection anywhere will eventually be noticed and attacked. Certain organs, like the brain, eye, and testes are immune "privileged"--the immune cells will ignore those tissues to minimize the chance of disrupting their function. That is, unless something is seriously wrong (like a major infection).