My cold sore is starting to dry and crust. Is it ok to take off that top layer of crust?

No. Would recommend not removing the "crust" as this is protective and removing it renders the area potentially susceptible to secondary bacterial infection.
Cold sore. I agree with Dr. Raff. Not only is that top layer protective- but the area below the crust is probably teaming with virus.