I have another infection on my tonsils, is it ok for me to take ibuprofen, for pain, and acetaminophen, for fever, at the same time?

Yes, but not needed. Ibuprofen and Acetaminophen are both capable of relieving pain and reducing fever. So there is no need to use them together right from the start. It is generally safe to combine these two drugs, but usually unnecessary. Consider using medicated lozenges to relieve your sore throat.