Is it worth a trip to the doctor for palpitations?

Yes and no. It bothers you in many ways and you are concern, see your doc. Otherwise don't.
Absolutely. While the cause of palpitations is often benign, a visit to the doctor makes sense -- you will likely receive and ekg, have labwork ordered, and possibly a holter monitor (heart monitor that can be worn for 24 hours) -- until then, limit your caffeine and maximize your sleep and nutrition.