Stop using the dye
It sounds like your body is telling you something! if you are having a reaction to a chemical, i would stop exposing yourself to such chemicals.
The kind of reaction is important to note as well - some are on the skin but some can be more systemic. Some less chemically based hair coloring agents exist such as henna that might not cause a problem. Talk with your beautician.