How do I get rid of those little bumps on the back of both of my arms?

Keratosis pilaris. "those little bumps" on the back of your arms that look like chicken skin maybe a condition called keratosis pilaris, which is benign. Since they are often dry and itchy, moisturizers are the treatment of choice. Occasional exfoliation may also help the condition.