White crusty scab on the right side of the head of the penis should I be worried? Or is bad hygine

Both? If you are not keeping clean, then hygiene could delay healing. More suspcious for an std or related genito-urinary infection. It should be evaluated by a dr. Many health dept's have free / low-cost "std clinics" set up which can do exam and testing discretely.