I accidentally peeled off my cold sore, is this bad?

Delayed healing. Picking the crust off the top of a cold sore will probably delay the healing process and may make the virus more transmissible to others. Let it take its course once the 'blister' has ruptured.