Is it normal that you don't have alot of pain and swelling when you fracture the scaphoid ?

It is possible: scaphoid fx can be a tricky diagnosis and is one of the more missed fractures. That can have deleterious effects if not found out early enough. May be missed often on xray and may need CT.

Can be easy to miss : Scaphoid fractures can be a challenge. Important for a provider to evaluate for these whenever an injury to the hand, wrist or even forearm is suspected. If tender at the scaphoid (which doesn't always show obvious swelling or bruising) on physical exam, special scaphoid-view XR should be done. Tricky because these can often look normal, so CT is often used to further evaluate for a fracture.