Is it bad to have an infected tooth taken out?

Yes. If the tooth is deemed salvageable it should be saved, especially if it is in function. Get a root canal!
No. You would want the infected tooth removed. But the type of infection the tooth has would determine whether antibiotics . If the tooth is removed the doctor would most likely put you on an antibiotic.