You should not continue to make milk that long after stopping nursing, unless you are frequently stimulating your nipples.
Also, it seems the problem is one sided. You need to see your doctor, and have some tests done to find out what is happening. This usually is not cancer
, if that is worrying you.