Can I use magic mouthwash then have some tylenol (acetaminophen) or motrin?

Sure. Magic mouthwash has different formulations, none of which will interact with oral analgesics, especially since you do not swallow the mouthwash. Still, check with the physician that prescribed the mouthwash to be sure the pills do not interact with anything else you might be taking.