Is it harmful to wear the wrong contact prescription on your eyes?

No. While you may not see as well and may get headaches and eye strain, wearing the wrong prescription will not permanently damage your eyes. Wearing the wrong base curves or other parameters can damage your eyes however. In other words, they must fit properly.