I've got mouth ulcers after kissing my boyfriend. What does herpes feel like?

Might be. Tender shallow ulcers which may or may not be accompanied by fever, malaise, may occur with primary herpetic outbreaks. These will generally last 7-10 days and resolve spontaneously.