Is dextrose just sugar, and is it gluten-free?

Yes. Dextrose is a sugar, made by processing starches (such as corn starch, rice starch, or wheat starch). Due to the extensive processing, dextrose is considered gluten-free.