Yes. Depends on what kind of arthritis you may have. Inflammatory types of arthritis can cause fevers. Headaches are common in all kinds of arthritis usually due to neck problems. Suggest seeing a rheumatologist to determine if you have an inflammatory arthritic condition and possibly a spine specialist to evaluate your neck as well.
Inflammation. Some forms of arthritis do cause headaches and fevers (inflammatory arthritis such as rheumatoid arthritis). Consult your pcp.