Do all children need formal religious training?

NO. Children do benefit from a greater sense of connection and control. Something like having an omniscient parent. It helps explain many things that happen in the world for them, even if they don't directly believe that this entity is directly involved. However, a formal training is up to you, a totally personal decision. Children should be educated overall about religion, but not necessarily in one.