It is ok to heat food in those plastic frozen food containers?

Microwave. Don't heat plastic containers in the oven as they can melt ruining the food and creating a fire risk. Most containers are microwave safe, but check the label.