I have a sinus infection with pressure in cheek, forehead. could the infection cause my upper teeth to be very sensitive to cold water when drinki?

Absolutely: We see this quite often, especially in the posterior maxillary teeth.

Absolutely: The layer of tissues between the upper sinuses and the ends of the roots of the upper back teeth is only 2 cells thick (microscopically thin), and therefore infected sinus and cold sensitivity go hand in hand. See your General Physician or an Ear/Nose/Throat specialist to treat your sinus infection.