What is the best thermometer to use on my baby?

Parent dependent. Whatever you feel most comfortable with. You could always ask your pediatrician or simply go online and look at lots and lots of reviews from like-minded parent's. The exergen thermometer has lots of media coverage, but its own set of drawbacks.
Rectal. Rectal most accurate usually and what physicians usually act on in the first year of life.