Did the dentist that extracted your tooth place you on any medicine? Were antibiotics involved? Was the extraction difficult? Was there more bleeding during the procedure than normal? Are you taking any other medications? If none of those pertain to you, 3-4 days is the absolute minimum time you must abstain.
If any of the above apply, it may be much longer.