My 5 yr old got knocked in his baby tooth and it's loose now. Do I just leave it alone?

Yes. He is nearing the age when he would lose his teeth anyway.
Ask the dentist. Its true he is nearing the age of losing his teeth but you should take him to the dentist to check. They may want to take an x-ray to make sure the adult tooth wasn't damaged.