Any problem letting my toddler play in the dirt?

Not so bad. There is accumulating data that our super clean environments do not challenge our immune systems enough and that is the reason for the increase in asthma and other immune disorders. For instance children raised on farms or in amish families have a far lower incidence of these conditions. So you might encourage this for your toddler as long as the dirt is not from an industrial waste discharge.