What should I do to keep a thumb guard on?

Explain. Are you referring to a thumb sucking guard? Several designs use velcro style closure or come in various sizes. How old is the wearer of this guard? You may need the larger style that has a wrist strap as shown in the photograph.