If I were to bite into one of the pills would it taste like sugar if it is a sugar pill?

Not necessarily. The "sugar pills" in the birth control packs are actually placebo pills made with fillers, not necessarily sugar. The sometimes have iron in them with some oral contraceptives.