Can dehydration cause you to feel like you're having an anxiety / panic attack?

Absolutely. Any condition which limits blood flow to the brain can result in a wide range of metabolic derangements that can affect the psyche. In the dehydrated state, the brain can easily misinterpret both external and internal signals leading to psychiatric symptoms such as confusion, panic, and even frank psychosis.