Is there an over-the-counter treatment for urticaria?

Antihistamines. Avoiding what you believe to be causing the urticaria (hives) is the best treatment, but sometimes not easily done. Antihistamines can also help greatly, and are available over the counter.