Do you get inverted nipples during puberty?

Generally not. Sometimes during breast feeding, but pregnancy and breast feeding often cause invented nipples to "pop out". Sometimes frequent manual stimulation will do the same thing. They are generally a benign condition.