Doesn't antibacterial soap just kill bad bacteria?

Not a concern. We worry about killing "good bacteria" in the GI tract. It's not an issue on the skin. There's no harm if you happen to kill some harmless bacteria living on your hands. However, plain soap and water is enough for most purposes.