When your skin itches, does that mean my skin cells are dry?

Yes, it can. Dry skin definitely itches, especially when it stretches a little, like when you bend over or reach for something. Try a daily moisturizer to help with this.