Could the water building up in my testicles be sperm?

No. Water buildup around the testicles is called a hydrocele. It is a fluid collection that is not sperm or urine. It is a benign condition but an evaluation should be performed to rule out other pathology.