How do you know if someone has oral herpes, if he has no sore?

No way. Unfortunately there is no other way without asking them. But over 80% of the human population has oral herpes- most get it from their parents or friends from sharing things such as spoons, cans of soda, etc.
No way to know. Many folks have oral herpes without knowing. The only way for you to be sure is to ask.