What makes you...
..."pretty sure?" are you matching rashes with pictures you find on the internet? Before anyone can tell you how to treat it (let alone when it will resolve), you need a precise diagnosis, so let your pediatrician or a dermatologist have a look.
This is your baby, after all; you don't want to guess at the diagnosis and embark on the wrong treatment.