Mylicon or gripe water; is it ok for babies to use this?

Yes. Mylicon (simethicone) is safe for babies. It helps break up small bubbles so they can burp. Gripe water is generally safe for babies. However there are so many different kinds now. Check with your doctor about specific products.