5 weeks pregnant I am taking folvite (folic acid) 5 mg before and after I got pregnant. Is this dose too much? If yes should I reduce? And will that harm my baby?

Maybe. That is a high dose of folic acid. I'm assuming that a doctor recommended that dose? There are definitely times when women should take higher doses of folic acid, such as history of neural tube defect, history of seizures, on anti-seizure medication, multiple gestation. I would speak with your doc to understand why such a high dose. Or, if you're worried, you can drop to 1mg a day.