Will going back to work one week after a hemorrhoid surgery affect my recovery ?

Probably not: Depending what you do at work, going back to work early probably won't effect the results of your surgery. It may depend upon how your recovery is proceeding. You should discuss this with your surgeon.

Not likely: Unless you don't eat or drink properly and maintain daily soft but formed stools. However your stamina may not be what you expect and usually 10-14 days recovery is safer and better before returning to a full schedule. Also depends on what kind of work. If work is very physical i would wait 14 days, but if just a desk job, use your judgement to determine your limitations.