You can generally check their credentials via their web sites & with state medical boards.
Board certification is a positive. Consider what you're wanting help with, and find a psychiatrist interested in that or who's taken additional training in it. You want to feel comfortable confiding in the doctor, and feel that s/he hears you. Willingness to answer your questions is important also.