Made mistake of wearing contacts on opposite eyes. Did I infect them?

No. Just caused blurred vision, which presumably resolved when you switched them back to the correct contact in the correct eye. However, if eyes are red, painful, having discharge or vision remains poor even with changing back the contacts, the contacts should be removed and symptoms evaluated with an exam.