Is it safe to take calcium supplement with good amount of dairy products?

Depends: It depends on the reason why you are taking the calcium replacement. If you don't have bone problems (osteopenia/osteoporosis) or hypoparathyroidism (chronically low calcium on blood test) then you don't need to take calcium supplement and should get it from food such as dairy products. If you have the above conditions, then calcium suplements (at the recommended dose) + food are perfectly safe.