A psychiatrist is a medical doctor while a psychologist is not.
As a result they can more accurately review medical conditions that contribute or underly emotional illness. They can order labs, x-rays, specific neurological tests, and carefully consider the role of medications in symptom presentation. They can also perform physical examinations. Importantly, they can knowledgably prescibe meds.