Should I be concerned if I have been peeing out clear urine that's almost never yellow?

Clear urine. Sounds normal....More fluids, clearer urine.
No. You probably drink plenty of fluids or lose less fluids possibly due to less than usual sweating or both. In absence of any symptoms or history of medical disease, i would not worry. Having said that, the urine of kidney failure patients is known to be dilute. If you had no blood tests in your recent medical history, you need one for reassurance purposes.