Would it be healthy for a child to carry around a feather?

No. The end of a feather is sharp and they can poke themselves or someone else in the eye with it. Feathers also carry dust mites, so i vote no.
Attachment... ...To a comfort item is common - it represents something stable in an unpredictable world.