They are either not canker sores (aphthous ulcers
) or it's not pus
that you see, feel or taste.
See your dentist right away to find out exactly what you have and how best to treat it. If you would rather not see your dentist, then it doesn't matter how you treat it as your guess would be as good as ours, considering we can't actually see what you are describing.