Should I be concerned if I have been peeing out cloudy urine?

Yes. If associated with pain, this could indicate a urinary tract infection.
NOT NECESSARILY. If you are otherwise asymptomatic this should not be a concern, since this may simply be precipitation of salts creating the cloudiness and not representative of infection. Even if this was due to bacterial growth, asymptomatic bacteriuria in women need not be treated.