What I if choose not to get the surgery for orbital fracture/entrapment? What are the long-term downsides?

Diploplia. If there;s entrapment, eventually there could be double vision, pain, and restrictive movement of the eyeball. It would be strongly recommended. However, if there is no entrapment, then it depends on the risk of entrapment occurring...