My cold sore is starting to dry and crust. Is it ok to take off that top layer of crust?

No. Would recommend not removing the "crust" as this is protective and removing it renders the area potentially susceptible to secondary bacterial infection.