If took boxing as a hobby, and would get small hits in my head over the years, would this lower my iq?

Yes / No. Trauma over time can negatively affect cognition (iq). However, staying aerobically active and physically fit increases brain power. Depends on the intensity and frequency of head blows.