What are some alternatives to medication in reducing my baby's fever?

Cooling measures: A lukewarm bath can quickly cool your baby; another option is sponge bathing; you are in effect, wiping the skin down, and then wringing it out in some room temp water and then repeating- this is a means of heat transfer, from your baby into a bucket of water.

Fever tips: First, fever is not a disease, but a symptom - not all fevers need to be treated. If your baby is uncomfortable, consider reducing using room temp/cool sponge-bathing, or you can try a homeopathic fever reduce like belladonna 30c. Note that this remedy has not been proven to work but is generally considered safe to use.