Is it safe to leave my baby alone for a few minutes so I can shower?

Yes. But make sure the baby is in a safe place- crib, playpen, buckled into their carseat, etc. You can leave the bathroom door open so you can hear them during your shower as well.
Yes. Yes it is ok as long as your baby is in a safe place such as the playpen or crib - not your bed.