My 3 and a half year old has speech problems. He is getting better, but I am trying to toilet train him. But he refuses to sit on the potty?

Wait a While. Children are potty trained at different ages. Your son is just not ready. The average us male is potty trained by 3.5 yrs old. Encourage him, but don't push as this could lead to toilet resistance.