The belly button is an easily irritated area because it consists mostly of skin-on-skin contact.
Avoid using the peroxide and the irritation should subside. If it does not, you may have a superficial fungal infection
. See your physician about a topical antifungal cream.
Answer assisted by Brian Fishman, Medical Student