If it hurts to fully stick out my are, did I fracture my elbow or just sprain it?

Possible fracture. It is actually quite common to sustain a radial head or radial neck fracture without knowing it. The symptom is often just a stiff elbow that improves over time. It is difficult to know whether you have a fracture without x-rays and examination. I'd recommend getting it checked.