Do you bleed inside the bladder when you have a urinary tract infection?

Yes, varying degrees. If you see urine under the microscope, you will see red blood cells. Although gross blood in urine occurs, hemorrhagic cystitis, it is uncommon.