Do the goosebumps itch? There is a condition called keratosis pilaris
that often occurs over the ouside of the upper arms and occasionally on the upper outer thighs, but these usually do not itch.
An over-the-counter lotion, amlactin, often helps this condition. If it itches, it might be due to a medication you have been taking.