Can radiation therapy contribute to my colitis?

Yes . Please see my answer to a very related question. This transient symptom can be managed with medication if severe.
No. Radiation is not used to control or improve irritation/ inflammation or infection. Just the opposite, when radiation is used typically to treat cancer, it can cause some transient irritation and inflammation that is managed if needed by medication.