I'm almost 38 weeks pregnant is it normal for my baby to have hiccups alot? Or is it something I should be worried about?

Quite common. Some have speculated that the close position of the babies stomach with the diaphragm causes a rubbing that triggers the hiccups.This is common & generally continues on through the first months after birth. Once the child grows longer & the stomach can drop away from the diaphragm the frequency declines. It bothers mom's more than the baby.
Perfectly Normal. Fetal hiccups are normal and show that your infant is neurologically intact. Make sure fetal movements are normal as instructed by your doc & enjoy the hiccups. Take care & enjoy your little one.