Me and my boyfriend were fooling around, he might of got some precum on his fingers and then inserted them in my vagina, should i be concered ?

That is concerning: Most studies have shown low levels of sperm or no sperm in pre-ejaculate with sperm not being motile (however, don't know how promptly samples were examined). One small study published in 2011 showed that there are some individuals with a high motile sperm count in pre-ejaculate. See: http://www.ncbi.nlm.nih.gov/pmc/articles/PMC3564677/