My penis is swollen towards the head. No sexual contact at all. What might this be?

Inflammation. Swelling of the skin around the head of the penis could be a sign of inflammation or even a penile skin infection known as balanitis. I recommend carefully cleaning the foreskin with soapy water, keeping it dry, and having your primary care provider or urologist look at it as soon as you can.