If the exposure was in adolescence it would affect brain function.
This would not, strictly speaking, cause "retardation" since brain is already developed. "as mad as a hatter" comes from the fact that hatters, at one time lined their hats with a lead treated head band. Read the mad hatter's tea party in alice in wonderland. Lead caused madness is real.