Is this normal for first time glasses to feel dizzy?

Yes, but. It is normal the first few days you use them until your eyes get used to the new glasses but if this problem continues you should see the eye specialist again to fix the correction for your eyes sometimes could be more than you need.