Hyoid bone is the only bone in the body not connected to any other, so in a way it is loose but it is kept tightly in place by very strong ligaments and helps to support your tongue and raise your larynx whenever you talk and swallow.
In absence of trauma to suggest dislocation
, you may have an anatomic abnormality that may need CT to detect. No exercises to improve it. Surgery maybe an option.