I feel like bacteria is causing acne on face and chin what should I take?

Tetracycline. Your question sounds like you'd rather take oral meds than apply topicals like benzoyl peroxide ( which is economical and somewhat effective). Oral tetracyclines are first line therapy for facial inflammatory acne.
Treatment can help. For treatment of acne, over-the-counter benzoyl peroxide gel/cream is helpful. If desired, a doctor can add an antibiotic gel/cream. If more help is needed, prescription retinoids such as Retin-A or differin (adapalene) gel can be used instead of benzoyl peroxide. Oral contraceptives (for women) and oral antibiotics are options also. If acne is quite severe, a dermatologist may prescribe oral accutane.