How do I make my keratosis pilaris less noticable?

Exfolliation. Removing the thicker skin layers with a scrub or buffer can help appearance. Moisturizing will help too, but likely less so.