Work on posture
Often the neck is in extension while riding a bike which places increased force on the neck joints.
This can refer pain to the upper back. You could also have fatigue in the shoulder blade (scapula) stabilizing muscles (rhomboids, etc). Both of these can be improved by working on posture and strengthening the back muscles. If the pain persists see your md.