Have a headache today. Is it safe to take an Aleve (naproxen) or Advil twice in one day, to make it go away?

Yes. Aleve (naproxen) can be taken twice per day and advil can be take three times per day. These should snot be taken together. Use one or the other. If the headache persists then see your pcp.